diff --git "a/train.log" "b/train.log"
new file mode 100644--- /dev/null
+++ "b/train.log"
@@ -0,0 +1,5209 @@
+W0909 02:23:22.976000 1678122 site-packages/torch/distributed/run.py:766] 
+W0909 02:23:22.976000 1678122 site-packages/torch/distributed/run.py:766] *****************************************
+W0909 02:23:22.976000 1678122 site-packages/torch/distributed/run.py:766] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. 
+W0909 02:23:22.976000 1678122 site-packages/torch/distributed/run.py:766] *****************************************
+[INFO] Running in WANDB offline mode[INFO] Running in WANDB offline mode[INFO] Running in WANDB offline mode
+
+
+[INFO] Running in WANDB offline mode
+[INFO] Running in WANDB offline mode
+[INFO] Running in WANDB offline mode
+[INFO] Running in WANDB offline mode
+[INFO] Running in WANDB offline mode
+Trainer._get_train_sampler replaced with custom implementation.
+warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
+[2026-09-09 02:23:32,113] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
+Trainer._get_train_sampler replaced with custom implementation.
+warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
+Trainer._get_train_sampler replaced with custom implementation.
+warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
+[2026-09-09 02:23:32,231] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
+[2026-09-09 02:23:32,267] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
+Trainer._get_train_sampler replaced with custom implementation.
+warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
+[2026-09-09 02:23:32,371] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
+[2026-09-09 02:23:32,504] [INFO] [comm.py:658:init_distributed] cdb=None
+Trainer._get_train_sampler replaced with custom implementation.
+warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
+[2026-09-09 02:23:32,587] [INFO] [comm.py:658:init_distributed] cdb=None
+[2026-09-09 02:23:32,593] [INFO] [comm.py:658:init_distributed] cdb=None
+[2026-09-09 02:23:32,610] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
+Trainer._get_train_sampler replaced with custom implementation.
+warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
+[2026-09-09 02:23:32,719] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
+[2026-09-09 02:23:32,752] [INFO] [comm.py:658:init_distributed] cdb=None
+[2026-09-09 02:23:32,752] [INFO] [comm.py:689:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
+Trainer._get_train_sampler replaced with custom implementation.
+Trainer._get_train_sampler replaced with custom implementation.
+warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
+warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
+[2026-09-09 02:23:32,916] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
+[2026-09-09 02:23:32,917] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
+[2026-09-09 02:23:32,929] [INFO] [comm.py:658:init_distributed] cdb=None
+[2026-09-09 02:23:33,031] [INFO] [comm.py:658:init_distributed] cdb=None
+[2026-09-09 02:23:33,281] [INFO] [comm.py:658:init_distributed] cdb=None
+[2026-09-09 02:23:33,290] [INFO] [comm.py:658:init_distributed] cdb=None
+
Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 11229.13it/s]
+
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 11639.58it/s]
+
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 11594.09it/s]
+
Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 11705.08it/s]
+
Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 10893.24it/s]
+
Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 10698.09it/s]
+
Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 10748.26it/s]
+
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 11795.27it/s]
+[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
+[FeatureFusion] geometry fusion delta scaled by 0.5
+[FeatureFusion] importance gate ENABLED on geometry delta
+[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
+[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
+[FeatureFusion] geometry fusion delta scaled by 0.5
+[FeatureFusion] importance gate ENABLED on geometry delta
+[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
+[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
+[FeatureFusion] geometry fusion delta scaled by 0.5
+[FeatureFusion] importance gate ENABLED on geometry delta
+[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
+[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
+[FeatureFusion] geometry fusion delta scaled by 0.5
+[FeatureFusion] importance gate ENABLED on geometry delta
+[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
+[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
+[FeatureFusion] geometry fusion delta scaled by 0.5
+[FeatureFusion] importance gate ENABLED on geometry delta
+[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
+[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
+[FeatureFusion] geometry fusion delta scaled by 0.5
+[FeatureFusion] importance gate ENABLED on geometry delta
+[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
+[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
+[FeatureFusion] geometry fusion delta scaled by 0.5
+[FeatureFusion] importance gate ENABLED on geometry delta
+[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
+[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
+[FeatureFusion] geometry fusion delta scaled by 0.5
+[FeatureFusion] importance gate ENABLED on geometry delta
+[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
+Loading weights from local directory
+Loading weights from local directory
+Loading weights from local directory
+Loading weights from local directory
+Loading weights from local directory
+Loading weights from local directory
+Loading weights from local directory
+Loading weights from local directory
+>>>>> STOP loss up-weight: 3.0 on token ids [48964]
+Qwen3_5Config {
+  "architectures": [
+    "Qwen3_5ForConditionalGeneration"
+  ],
+  "dtype": "bfloat16",
+  "feature_fusion_method": "deepstack_language_add",
+  "fusion_num_layers": 1,
+  "geometry_encoder_layers": [
+    23
+  ],
+  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
+  "geometry_encoder_streaming": true,
+  "geometry_encoder_type": "vggt",
+  "geometry_frame_strict": true,
+  "geometry_fusion_layers": [
+    2
+  ],
+  "geometry_fusion_scale": 0.5,
+  "geometry_importance_gate": true,
+  "geometry_learnable_scale": true,
+  "geometry_merger_type": "mlp",
+  "geometry_spatial_bias": false,
+  "image_token_id": 248056,
+  "include_camera_token": false,
+  "model_type": "qwen3_5",
+  "pos_encoding_type": "none",
+  "reference_frame": "first",
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "attn_output_gate": true,
+    "bos_token_id": null,
+    "dtype": "bfloat16",
+    "eos_token_id": 248044,
+    "full_attention_interval": 4,
+    "head_dim": 256,
+    "hidden_act": "silu",
+    "hidden_size": 2560,
+    "initializer_range": 0.02,
+    "intermediate_size": 9216,
+    "layer_types": [
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention"
+    ],
+    "linear_conv_kernel_dim": 4,
+    "linear_key_head_dim": 128,
+    "linear_num_key_heads": 16,
+    "linear_num_value_heads": 32,
+    "linear_value_head_dim": 128,
+    "mamba_ssm_dtype": "float32",
+    "max_position_embeddings": 262144,
+    "mlp_only_layers": [],
+    "model_type": "qwen3_5_text",
+    "mtp_num_hidden_layers": 1,
+    "mtp_use_dedicated_embeddings": false,
+    "num_attention_heads": 16,
+    "num_hidden_layers": 32,
+    "num_key_value_heads": 4,
+    "pad_token_id": null,
+    "partial_rotary_factor": 0.25,
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "mrope_interleaved": true,
+      "mrope_section": [
+        11,
+        11,
+        10
+      ],
+      "partial_rotary_factor": 0.25,
+      "rope_theta": 10000000,
+      "rope_type": "default"
+    },
+    "tie_word_embeddings": true,
+    "use_cache": true,
+    "vocab_size": 248320
+  },
+  "tie_word_embeddings": true,
+  "transformers_version": "5.3.0",
+  "use_cache": false,
+  "use_geometry_encoder": true,
+  "video_token_id": 248057,
+  "vision_config": {
+    "deepstack_visual_indexes": [],
+    "depth": 24,
+    "dtype": "bfloat16",
+    "hidden_act": "gelu_pytorch_tanh",
+    "hidden_size": 1024,
+    "in_channels": 3,
+    "initializer_range": 0.02,
+    "intermediate_size": 4096,
+    "model_type": "qwen3_5",
+    "num_heads": 16,
+    "num_position_embeddings": 2304,
+    "out_hidden_size": 2560,
+    "patch_size": 16,
+    "spatial_merge_size": 2,
+    "temporal_patch_size": 2
+  },
+  "vision_end_token_id": 248054,
+  "vision_language_fusion_layers": null,
+  "vision_start_token_id": 248053
+}
+
+Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
+>>>>> STOP loss up-weight: 3.0 on token ids [48964]
+Vision Module - Attention Blocks:
+Trainable Block Indices: None
+Non-Trainable Block Indices: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23]
+Merger Module Trainable: True
+LLM Module - Embed Tokens Trainable: True
+LLM Module - Trainable Layer Indices: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31]
+LLM Module - Non-Trainable Layer Indices: None
+Qwen3_5Config {
+  "architectures": [
+    "Qwen3_5ForConditionalGeneration"
+  ],
+  "dtype": "bfloat16",
+  "feature_fusion_method": "deepstack_language_add",
+  "fusion_num_layers": 1,
+  "geometry_encoder_layers": [
+    23
+  ],
+  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
+  "geometry_encoder_streaming": true,
+  "geometry_encoder_type": "vggt",
+  "geometry_frame_strict": true,
+  "geometry_fusion_layers": [
+    2
+  ],
+  "geometry_fusion_scale": 0.5,
+  "geometry_importance_gate": true,
+  "geometry_learnable_scale": true,
+  "geometry_merger_type": "mlp",
+  "geometry_spatial_bias": false,
+  "image_token_id": 248056,
+  "include_camera_token": false,
+  "model_type": "qwen3_5",
+  "pos_encoding_type": "none",
+  "reference_frame": "first",
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "attn_output_gate": true,
+    "bos_token_id": null,
+    "dtype": "bfloat16",
+    "eos_token_id": 248044,
+    "full_attention_interval": 4,
+    "head_dim": 256,
+    "hidden_act": "silu",
+    "hidden_size": 2560,
+    "initializer_range": 0.02,
+    "intermediate_size": 9216,
+    "layer_types": [
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention"
+    ],
+    "linear_conv_kernel_dim": 4,
+    "linear_key_head_dim": 128,
+    "linear_num_key_heads": 16,
+    "linear_num_value_heads": 32,
+    "linear_value_head_dim": 128,
+    "mamba_ssm_dtype": "float32",
+    "max_position_embeddings": 262144,
+    "mlp_only_layers": [],
+    "model_type": "qwen3_5_text",
+    "mtp_num_hidden_layers": 1,
+    "mtp_use_dedicated_embeddings": false,
+    "num_attention_heads": 16,
+    "num_hidden_layers": 32,
+    "num_key_value_heads": 4,
+    "pad_token_id": null,
+    "partial_rotary_factor": 0.25,
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "mrope_interleaved": true,
+      "mrope_section": [
+        11,
+        11,
+        10
+      ],
+      "partial_rotary_factor": 0.25,
+      "rope_theta": 10000000,
+      "rope_type": "default"
+    },
+    "tie_word_embeddings": true,
+    "use_cache": true,
+    "vocab_size": 248320
+  },
+  "tie_word_embeddings": true,
+  "transformers_version": "5.3.0",
+  "use_cache": false,
+  "use_geometry_encoder": true,
+  "video_token_id": 248057,
+  "vision_config": {
+    "deepstack_visual_indexes": [],
+    "depth": 24,
+    "dtype": "bfloat16",
+    "hidden_act": "gelu_pytorch_tanh",
+    "hidden_size": 1024,
+    "in_channels": 3,
+    "initializer_range": 0.02,
+    "intermediate_size": 4096,
+    "model_type": "qwen3_5",
+    "num_heads": 16,
+    "num_position_embeddings": 2304,
+    "out_hidden_size": 2560,
+    "patch_size": 16,
+    "spatial_merge_size": 2,
+    "temporal_patch_size": 2
+  },
+  "vision_end_token_id": 248054,
+  "vision_language_fusion_layers": null,
+  "vision_start_token_id": 248053
+}
+
+Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
+>>>>> STOP loss up-weight: 3.0 on token ids [48964]
+Qwen3_5Config {
+  "architectures": [
+    "Qwen3_5ForConditionalGeneration"
+  ],
+  "dtype": "bfloat16",
+  "feature_fusion_method": "deepstack_language_add",
+  "fusion_num_layers": 1,
+  "geometry_encoder_layers": [
+    23
+  ],
+  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
+  "geometry_encoder_streaming": true,
+  "geometry_encoder_type": "vggt",
+  "geometry_frame_strict": true,
+  "geometry_fusion_layers": [
+    2
+  ],
+  "geometry_fusion_scale": 0.5,
+  "geometry_importance_gate": true,
+  "geometry_learnable_scale": true,
+  "geometry_merger_type": "mlp",
+  "geometry_spatial_bias": false,
+  "image_token_id": 248056,
+  "include_camera_token": false,
+  "model_type": "qwen3_5",
+  "pos_encoding_type": "none",
+  "reference_frame": "first",
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "attn_output_gate": true,
+    "bos_token_id": null,
+    "dtype": "bfloat16",
+    "eos_token_id": 248044,
+    "full_attention_interval": 4,
+    "head_dim": 256,
+    "hidden_act": "silu",
+    "hidden_size": 2560,
+    "initializer_range": 0.02,
+    "intermediate_size": 9216,
+    "layer_types": [
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention"
+    ],
+    "linear_conv_kernel_dim": 4,
+    "linear_key_head_dim": 128,
+    "linear_num_key_heads": 16,
+    "linear_num_value_heads": 32,
+    "linear_value_head_dim": 128,
+    "mamba_ssm_dtype": "float32",
+    "max_position_embeddings": 262144,
+    "mlp_only_layers": [],
+    "model_type": "qwen3_5_text",
+    "mtp_num_hidden_layers": 1,
+    "mtp_use_dedicated_embeddings": false,
+    "num_attention_heads": 16,
+    "num_hidden_layers": 32,
+    "num_key_value_heads": 4,
+    "pad_token_id": null,
+    "partial_rotary_factor": 0.25,
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "mrope_interleaved": true,
+      "mrope_section": [
+        11,
+        11,
+        10
+      ],
+      "partial_rotary_factor": 0.25,
+      "rope_theta": 10000000,
+      "rope_type": "default"
+    },
+    "tie_word_embeddings": true,
+    "use_cache": true,
+    "vocab_size": 248320
+  },
+  "tie_word_embeddings": true,
+  "transformers_version": "5.3.0",
+  "use_cache": false,
+  "use_geometry_encoder": true,
+  "video_token_id": 248057,
+  "vision_config": {
+    "deepstack_visual_indexes": [],
+    "depth": 24,
+    "dtype": "bfloat16",
+    "hidden_act": "gelu_pytorch_tanh",
+    "hidden_size": 1024,
+    "in_channels": 3,
+    "initializer_range": 0.02,
+    "intermediate_size": 4096,
+    "model_type": "qwen3_5",
+    "num_heads": 16,
+    "num_position_embeddings": 2304,
+    "out_hidden_size": 2560,
+    "patch_size": 16,
+    "spatial_merge_size": 2,
+    "temporal_patch_size": 2
+  },
+  "vision_end_token_id": 248054,
+  "vision_language_fusion_layers": null,
+  "vision_start_token_id": 248053
+}
+
+Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
+>>>>> STOP loss up-weight: 3.0 on token ids [48964]
+Qwen3_5Config {
+  "architectures": [
+    "Qwen3_5ForConditionalGeneration"
+  ],
+  "dtype": "bfloat16",
+  "feature_fusion_method": "deepstack_language_add",
+  "fusion_num_layers": 1,
+  "geometry_encoder_layers": [
+    23
+  ],
+  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
+  "geometry_encoder_streaming": true,
+  "geometry_encoder_type": "vggt",
+  "geometry_frame_strict": true,
+  "geometry_fusion_layers": [
+    2
+  ],
+  "geometry_fusion_scale": 0.5,
+  "geometry_importance_gate": true,
+  "geometry_learnable_scale": true,
+  "geometry_merger_type": "mlp",
+  "geometry_spatial_bias": false,
+  "image_token_id": 248056,
+  "include_camera_token": false,
+  "model_type": "qwen3_5",
+  "pos_encoding_type": "none",
+  "reference_frame": "first",
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "attn_output_gate": true,
+    "bos_token_id": null,
+    "dtype": "bfloat16",
+    "eos_token_id": 248044,
+    "full_attention_interval": 4,
+    "head_dim": 256,
+    "hidden_act": "silu",
+    "hidden_size": 2560,
+    "initializer_range": 0.02,
+    "intermediate_size": 9216,
+    "layer_types": [
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention"
+    ],
+    "linear_conv_kernel_dim": 4,
+    "linear_key_head_dim": 128,
+    "linear_num_key_heads": 16,
+    "linear_num_value_heads": 32,
+    "linear_value_head_dim": 128,
+    "mamba_ssm_dtype": "float32",
+    "max_position_embeddings": 262144,
+    "mlp_only_layers": [],
+    "model_type": "qwen3_5_text",
+    "mtp_num_hidden_layers": 1,
+    "mtp_use_dedicated_embeddings": false,
+    "num_attention_heads": 16,
+    "num_hidden_layers": 32,
+    "num_key_value_heads": 4,
+    "pad_token_id": null,
+    "partial_rotary_factor": 0.25,
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "mrope_interleaved": true,
+      "mrope_section": [
+        11,
+        11,
+        10
+      ],
+      "partial_rotary_factor": 0.25,
+      "rope_theta": 10000000,
+      "rope_type": "default"
+    },
+    "tie_word_embeddings": true,
+    "use_cache": true,
+    "vocab_size": 248320
+  },
+  "tie_word_embeddings": true,
+  "transformers_version": "5.3.0",
+  "use_cache": false,
+  "use_geometry_encoder": true,
+  "video_token_id": 248057,
+  "vision_config": {
+    "deepstack_visual_indexes": [],
+    "depth": 24,
+    "dtype": "bfloat16",
+    "hidden_act": "gelu_pytorch_tanh",
+    "hidden_size": 1024,
+    "in_channels": 3,
+    "initializer_range": 0.02,
+    "intermediate_size": 4096,
+    "model_type": "qwen3_5",
+    "num_heads": 16,
+    "num_position_embeddings": 2304,
+    "out_hidden_size": 2560,
+    "patch_size": 16,
+    "spatial_merge_size": 2,
+    "temporal_patch_size": 2
+  },
+  "vision_end_token_id": 248054,
+  "vision_language_fusion_layers": null,
+  "vision_start_token_id": 248053
+}
+
+Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
+>>>>> STOP loss up-weight: 3.0 on token ids [48964]
+Qwen3_5Config {
+  "architectures": [
+    "Qwen3_5ForConditionalGeneration"
+  ],
+  "dtype": "bfloat16",
+  "feature_fusion_method": "deepstack_language_add",
+  "fusion_num_layers": 1,
+  "geometry_encoder_layers": [
+    23
+  ],
+  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
+  "geometry_encoder_streaming": true,
+  "geometry_encoder_type": "vggt",
+  "geometry_frame_strict": true,
+  "geometry_fusion_layers": [
+    2
+  ],
+  "geometry_fusion_scale": 0.5,
+  "geometry_importance_gate": true,
+  "geometry_learnable_scale": true,
+  "geometry_merger_type": "mlp",
+  "geometry_spatial_bias": false,
+  "image_token_id": 248056,
+  "include_camera_token": false,
+  "model_type": "qwen3_5",
+  "pos_encoding_type": "none",
+  "reference_frame": "first",
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "attn_output_gate": true,
+    "bos_token_id": null,
+    "dtype": "bfloat16",
+    "eos_token_id": 248044,
+    "full_attention_interval": 4,
+    "head_dim": 256,
+    "hidden_act": "silu",
+    "hidden_size": 2560,
+    "initializer_range": 0.02,
+    "intermediate_size": 9216,
+    "layer_types": [
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention"
+    ],
+    "linear_conv_kernel_dim": 4,
+    "linear_key_head_dim": 128,
+    "linear_num_key_heads": 16,
+    "linear_num_value_heads": 32,
+    "linear_value_head_dim": 128,
+    "mamba_ssm_dtype": "float32",
+    "max_position_embeddings": 262144,
+    "mlp_only_layers": [],
+    "model_type": "qwen3_5_text",
+    "mtp_num_hidden_layers": 1,
+    "mtp_use_dedicated_embeddings": false,
+    "num_attention_heads": 16,
+    "num_hidden_layers": 32,
+    "num_key_value_heads": 4,
+    "pad_token_id": null,
+    "partial_rotary_factor": 0.25,
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "mrope_interleaved": true,
+      "mrope_section": [
+        11,
+        11,
+        10
+      ],
+      "partial_rotary_factor": 0.25,
+      "rope_theta": 10000000,
+      "rope_type": "default"
+    },
+    "tie_word_embeddings": true,
+    "use_cache": true,
+    "vocab_size": 248320
+  },
+  "tie_word_embeddings": true,
+  "transformers_version": "5.3.0",
+  "use_cache": false,
+  "use_geometry_encoder": true,
+  "video_token_id": 248057,
+  "vision_config": {
+    "deepstack_visual_indexes": [],
+    "depth": 24,
+    "dtype": "bfloat16",
+    "hidden_act": "gelu_pytorch_tanh",
+    "hidden_size": 1024,
+    "in_channels": 3,
+    "initializer_range": 0.02,
+    "intermediate_size": 4096,
+    "model_type": "qwen3_5",
+    "num_heads": 16,
+    "num_position_embeddings": 2304,
+    "out_hidden_size": 2560,
+    "patch_size": 16,
+    "spatial_merge_size": 2,
+    "temporal_patch_size": 2
+  },
+  "vision_end_token_id": 248054,
+  "vision_language_fusion_layers": null,
+  "vision_start_token_id": 248053
+}
+
+Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
+>>>>> STOP loss up-weight: 3.0 on token ids [48964]
+Qwen3_5Config {
+  "architectures": [
+    "Qwen3_5ForConditionalGeneration"
+  ],
+  "dtype": "bfloat16",
+  "feature_fusion_method": "deepstack_language_add",
+  "fusion_num_layers": 1,
+  "geometry_encoder_layers": [
+    23
+  ],
+  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
+  "geometry_encoder_streaming": true,
+  "geometry_encoder_type": "vggt",
+  "geometry_frame_strict": true,
+  "geometry_fusion_layers": [
+    2
+  ],
+  "geometry_fusion_scale": 0.5,
+  "geometry_importance_gate": true,
+  "geometry_learnable_scale": true,
+  "geometry_merger_type": "mlp",
+  "geometry_spatial_bias": false,
+  "image_token_id": 248056,
+  "include_camera_token": false,
+  "model_type": "qwen3_5",
+  "pos_encoding_type": "none",
+  "reference_frame": "first",
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "attn_output_gate": true,
+    "bos_token_id": null,
+    "dtype": "bfloat16",
+    "eos_token_id": 248044,
+    "full_attention_interval": 4,
+    "head_dim": 256,
+    "hidden_act": "silu",
+    "hidden_size": 2560,
+    "initializer_range": 0.02,
+    "intermediate_size": 9216,
+    "layer_types": [
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention"
+    ],
+    "linear_conv_kernel_dim": 4,
+    "linear_key_head_dim": 128,
+    "linear_num_key_heads": 16,
+    "linear_num_value_heads": 32,
+    "linear_value_head_dim": 128,
+    "mamba_ssm_dtype": "float32",
+    "max_position_embeddings": 262144,
+    "mlp_only_layers": [],
+    "model_type": "qwen3_5_text",
+    "mtp_num_hidden_layers": 1,
+    "mtp_use_dedicated_embeddings": false,
+    "num_attention_heads": 16,
+    "num_hidden_layers": 32,
+    "num_key_value_heads": 4,
+    "pad_token_id": null,
+    "partial_rotary_factor": 0.25,
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "mrope_interleaved": true,
+      "mrope_section": [
+        11,
+        11,
+        10
+      ],
+      "partial_rotary_factor": 0.25,
+      "rope_theta": 10000000,
+      "rope_type": "default"
+    },
+    "tie_word_embeddings": true,
+    "use_cache": true,
+    "vocab_size": 248320
+  },
+  "tie_word_embeddings": true,
+  "transformers_version": "5.3.0",
+  "use_cache": false,
+  "use_geometry_encoder": true,
+  "video_token_id": 248057,
+  "vision_config": {
+    "deepstack_visual_indexes": [],
+    "depth": 24,
+    "dtype": "bfloat16",
+    "hidden_act": "gelu_pytorch_tanh",
+    "hidden_size": 1024,
+    "in_channels": 3,
+    "initializer_range": 0.02,
+    "intermediate_size": 4096,
+    "model_type": "qwen3_5",
+    "num_heads": 16,
+    "num_position_embeddings": 2304,
+    "out_hidden_size": 2560,
+    "patch_size": 16,
+    "spatial_merge_size": 2,
+    "temporal_patch_size": 2
+  },
+  "vision_end_token_id": 248054,
+  "vision_language_fusion_layers": null,
+  "vision_start_token_id": 248053
+}
+
+Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
+>>>>> STOP loss up-weight: 3.0 on token ids [48964]
+Qwen3_5Config {
+  "architectures": [
+    "Qwen3_5ForConditionalGeneration"
+  ],
+  "dtype": "bfloat16",
+  "feature_fusion_method": "deepstack_language_add",
+  "fusion_num_layers": 1,
+  "geometry_encoder_layers": [
+    23
+  ],
+  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
+  "geometry_encoder_streaming": true,
+  "geometry_encoder_type": "vggt",
+  "geometry_frame_strict": true,
+  "geometry_fusion_layers": [
+    2
+  ],
+  "geometry_fusion_scale": 0.5,
+  "geometry_importance_gate": true,
+  "geometry_learnable_scale": true,
+  "geometry_merger_type": "mlp",
+  "geometry_spatial_bias": false,
+  "image_token_id": 248056,
+  "include_camera_token": false,
+  "model_type": "qwen3_5",
+  "pos_encoding_type": "none",
+  "reference_frame": "first",
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "attn_output_gate": true,
+    "bos_token_id": null,
+    "dtype": "bfloat16",
+    "eos_token_id": 248044,
+    "full_attention_interval": 4,
+    "head_dim": 256,
+    "hidden_act": "silu",
+    "hidden_size": 2560,
+    "initializer_range": 0.02,
+    "intermediate_size": 9216,
+    "layer_types": [
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention"
+    ],
+    "linear_conv_kernel_dim": 4,
+    "linear_key_head_dim": 128,
+    "linear_num_key_heads": 16,
+    "linear_num_value_heads": 32,
+    "linear_value_head_dim": 128,
+    "mamba_ssm_dtype": "float32",
+    "max_position_embeddings": 262144,
+    "mlp_only_layers": [],
+    "model_type": "qwen3_5_text",
+    "mtp_num_hidden_layers": 1,
+    "mtp_use_dedicated_embeddings": false,
+    "num_attention_heads": 16,
+    "num_hidden_layers": 32,
+    "num_key_value_heads": 4,
+    "pad_token_id": null,
+    "partial_rotary_factor": 0.25,
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "mrope_interleaved": true,
+      "mrope_section": [
+        11,
+        11,
+        10
+      ],
+      "partial_rotary_factor": 0.25,
+      "rope_theta": 10000000,
+      "rope_type": "default"
+    },
+    "tie_word_embeddings": true,
+    "use_cache": true,
+    "vocab_size": 248320
+  },
+  "tie_word_embeddings": true,
+  "transformers_version": "5.3.0",
+  "use_cache": false,
+  "use_geometry_encoder": true,
+  "video_token_id": 248057,
+  "vision_config": {
+    "deepstack_visual_indexes": [],
+    "depth": 24,
+    "dtype": "bfloat16",
+    "hidden_act": "gelu_pytorch_tanh",
+    "hidden_size": 1024,
+    "in_channels": 3,
+    "initializer_range": 0.02,
+    "intermediate_size": 4096,
+    "model_type": "qwen3_5",
+    "num_heads": 16,
+    "num_position_embeddings": 2304,
+    "out_hidden_size": 2560,
+    "patch_size": 16,
+    "spatial_merge_size": 2,
+    "temporal_patch_size": 2
+  },
+  "vision_end_token_id": 248054,
+  "vision_language_fusion_layers": null,
+  "vision_start_token_id": 248053
+}
+
+Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
+>>>>> STOP loss up-weight: 3.0 on token ids [48964]
+Qwen3_5Config {
+  "architectures": [
+    "Qwen3_5ForConditionalGeneration"
+  ],
+  "dtype": "bfloat16",
+  "feature_fusion_method": "deepstack_language_add",
+  "fusion_num_layers": 1,
+  "geometry_encoder_layers": [
+    23
+  ],
+  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
+  "geometry_encoder_streaming": true,
+  "geometry_encoder_type": "vggt",
+  "geometry_frame_strict": true,
+  "geometry_fusion_layers": [
+    2
+  ],
+  "geometry_fusion_scale": 0.5,
+  "geometry_importance_gate": true,
+  "geometry_learnable_scale": true,
+  "geometry_merger_type": "mlp",
+  "geometry_spatial_bias": false,
+  "image_token_id": 248056,
+  "include_camera_token": false,
+  "model_type": "qwen3_5",
+  "pos_encoding_type": "none",
+  "reference_frame": "first",
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "attn_output_gate": true,
+    "bos_token_id": null,
+    "dtype": "bfloat16",
+    "eos_token_id": 248044,
+    "full_attention_interval": 4,
+    "head_dim": 256,
+    "hidden_act": "silu",
+    "hidden_size": 2560,
+    "initializer_range": 0.02,
+    "intermediate_size": 9216,
+    "layer_types": [
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention"
+    ],
+    "linear_conv_kernel_dim": 4,
+    "linear_key_head_dim": 128,
+    "linear_num_key_heads": 16,
+    "linear_num_value_heads": 32,
+    "linear_value_head_dim": 128,
+    "mamba_ssm_dtype": "float32",
+    "max_position_embeddings": 262144,
+    "mlp_only_layers": [],
+    "model_type": "qwen3_5_text",
+    "mtp_num_hidden_layers": 1,
+    "mtp_use_dedicated_embeddings": false,
+    "num_attention_heads": 16,
+    "num_hidden_layers": 32,
+    "num_key_value_heads": 4,
+    "pad_token_id": null,
+    "partial_rotary_factor": 0.25,
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "mrope_interleaved": true,
+      "mrope_section": [
+        11,
+        11,
+        10
+      ],
+      "partial_rotary_factor": 0.25,
+      "rope_theta": 10000000,
+      "rope_type": "default"
+    },
+    "tie_word_embeddings": true,
+    "use_cache": true,
+    "vocab_size": 248320
+  },
+  "tie_word_embeddings": true,
+  "transformers_version": "5.3.0",
+  "use_cache": false,
+  "use_geometry_encoder": true,
+  "video_token_id": 248057,
+  "vision_config": {
+    "deepstack_visual_indexes": [],
+    "depth": 24,
+    "dtype": "bfloat16",
+    "hidden_act": "gelu_pytorch_tanh",
+    "hidden_size": 1024,
+    "in_channels": 3,
+    "initializer_range": 0.02,
+    "intermediate_size": 4096,
+    "model_type": "qwen3_5",
+    "num_heads": 16,
+    "num_position_embeddings": 2304,
+    "out_hidden_size": 2560,
+    "patch_size": 16,
+    "spatial_merge_size": 2,
+    "temporal_patch_size": 2
+  },
+  "vision_end_token_id": 248054,
+  "vision_language_fusion_layers": null,
+  "vision_start_token_id": 248053
+}
+
+Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
+Total training samples: 2429620
+Total training samples: 2429620
+Total training samples: 2429620
+Formatting inputs...Skip in lazy mode
+The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
+Total training samples: 2429620
+Total training samples: 2429620
+Formatting inputs...Skip in lazy mode
+The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
+Formatting inputs...Skip in lazy mode
+The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
+Total training samples: 2429620
+Formatting inputs...Skip in lazy mode
+The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
+Formatting inputs...Skip in lazy mode
+The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
+Formatting inputs...Skip in lazy mode
+The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
+Total training samples: 2429620
+Formatting inputs...Skip in lazy mode
+The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
+Total training samples: 2429620
+Formatting inputs...Skip in lazy mode
+The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
+NCCL version 2.26.2+cuda12.2
+
  0%|          | 0/37963 [00:00<?, ?it/s]/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
  0%|          | 1/37963 [00:45<482:28:02, 45.75s/it]
  0%|          | 2/37963 [00:53<248:34:14, 23.57s/it]
  0%|          | 3/37963 [01:01<172:21:32, 16.35s/it]
  0%|          | 4/37963 [01:09<136:41:37, 12.96s/it]
  0%|          | 5/37963 [01:24<145:57:20, 13.84s/it]
  0%|          | 6/37963 [01:32<124:53:37, 11.85s/it]
  0%|          | 7/37963 [01:40<110:56:16, 10.52s/it]
  0%|          | 8/37963 [01:48<101:06:46,  9.59s/it]
  0%|          | 9/37963 [01:55<95:30:58,  9.06s/it] 
  0%|          | 10/37963 [02:03<91:03:19,  8.64s/it]
                                                     
{'loss': '2.414', 'grad_norm': '1290', 'learning_rate': '1.58e-07', 'epoch': '0.0002634'}
+
  0%|          | 10/37963 [02:04<91:03:19,  8.64s/it]
  0%|          | 11/37963 [02:19<114:14:02, 10.84s/it]
  0%|          | 12/37963 [02:27<105:07:33,  9.97s/it]
  0%|          | 13/37963 [02:35<97:36:27,  9.26s/it] 
  0%|          | 14/37963 [02:42<92:42:51,  8.80s/it]
  0%|          | 15/37963 [02:50<89:28:48,  8.49s/it]
  0%|          | 16/37963 [02:58<86:30:32,  8.21s/it]
  0%|          | 17/37963 [03:05<83:53:55,  7.96s/it]
  0%|          | 18/37963 [03:13<82:44:42,  7.85s/it]
  0%|          | 19/37963 [03:20<81:46:32,  7.76s/it]
  0%|          | 20/37963 [03:28<80:58:19,  7.68s/it]
                                                     
{'loss': '0.7374', 'grad_norm': '60.16', 'learning_rate': '3.336e-07', 'epoch': '0.0005268'}
+
  0%|          | 20/37963 [03:28<80:58:19,  7.68s/it]
  0%|          | 21/37963 [03:35<81:03:04,  7.69s/it]
  0%|          | 22/37963 [03:43<80:44:14,  7.66s/it]
  0%|          | 23/37963 [03:51<80:31:34,  7.64s/it]
  0%|          | 24/37963 [03:58<79:33:16,  7.55s/it]
  0%|          | 25/37963 [04:06<80:02:33,  7.60s/it]
  0%|          | 26/37963 [04:13<80:18:09,  7.62s/it]
  0%|          | 27/37963 [04:21<80:20:54,  7.62s/it]
  0%|          | 28/37963 [04:29<80:51:32,  7.67s/it]
  0%|          | 29/37963 [04:36<80:25:44,  7.63s/it]
  0%|          | 30/37963 [04:44<81:01:47,  7.69s/it]
                                                     
{'loss': '0.3174', 'grad_norm': '31.27', 'learning_rate': '5.092e-07', 'epoch': '0.0007902'}
+
  0%|          | 30/37963 [04:44<81:01:47,  7.69s/it]
  0%|          | 31/37963 [04:52<81:05:54,  7.70s/it]
  0%|          | 32/37963 [04:59<80:24:31,  7.63s/it]
  0%|          | 33/37963 [05:07<80:14:10,  7.62s/it]
  0%|          | 34/37963 [05:14<79:49:01,  7.58s/it]
  0%|          | 35/37963 [05:22<80:21:51,  7.63s/it]
  0%|          | 36/37963 [05:30<80:11:05,  7.61s/it]
  0%|          | 37/37963 [05:37<80:08:27,  7.61s/it]
  0%|          | 38/37963 [05:52<104:12:02,  9.89s/it]
  0%|          | 39/37963 [06:00<96:13:03,  9.13s/it] 
  0%|          | 40/37963 [06:07<91:14:26,  8.66s/it]
                                                     
{'loss': '0.2593', 'grad_norm': '15.83', 'learning_rate': '6.848e-07', 'epoch': '0.001054'}
+
  0%|          | 40/37963 [06:07<91:14:26,  8.66s/it]
  0%|          | 41/37963 [06:20<104:24:10,  9.91s/it]
  0%|          | 42/37963 [06:31<106:24:07, 10.10s/it]
  0%|          | 43/37963 [06:39<98:59:52,  9.40s/it] 
  0%|          | 44/37963 [06:46<93:45:21,  8.90s/it]
  0%|          | 45/37963 [06:56<97:50:23,  9.29s/it]
  0%|          | 46/37963 [07:07<101:11:50,  9.61s/it]
  0%|          | 47/37963 [07:14<94:31:01,  8.97s/it] 
  0%|          | 48/37963 [07:25<98:39:15,  9.37s/it]
  0%|          | 49/37963 [07:33<94:08:57,  8.94s/it]
  0%|          | 50/37963 [07:46<107:12:24, 10.18s/it]
                                                      
{'loss': '0.2672', 'grad_norm': '20.32', 'learning_rate': '8.604e-07', 'epoch': '0.001317'}
+
  0%|          | 50/37963 [07:46<107:12:24, 10.18s/it]
  0%|          | 51/37963 [07:53<99:32:34,  9.45s/it] 
  0%|          | 52/37963 [08:01<93:13:30,  8.85s/it]
  0%|          | 53/37963 [08:08<88:37:08,  8.42s/it]
  0%|          | 54/37963 [08:16<87:02:36,  8.27s/it]
  0%|          | 55/37963 [08:23<83:55:02,  7.97s/it]
  0%|          | 56/37963 [08:31<81:59:34,  7.79s/it]
  0%|          | 57/37963 [08:38<81:27:32,  7.74s/it]
  0%|          | 58/37963 [08:46<80:58:37,  7.69s/it]
  0%|          | 59/37963 [08:54<81:04:26,  7.70s/it]
  0%|          | 60/37963 [09:01<81:18:43,  7.72s/it]
                                                     
{'loss': '0.2518', 'grad_norm': '13.95', 'learning_rate': '1.036e-06', 'epoch': '0.00158'}
+
  0%|          | 60/37963 [09:01<81:18:43,  7.72s/it]
  0%|          | 61/37963 [09:09<80:43:04,  7.67s/it]
  0%|          | 62/37963 [09:16<79:29:34,  7.55s/it]
  0%|          | 63/37963 [09:24<79:56:39,  7.59s/it]
  0%|          | 64/37963 [09:31<79:30:24,  7.55s/it]
  0%|          | 65/37963 [09:39<79:46:54,  7.58s/it]
  0%|          | 66/37963 [09:46<78:47:54,  7.49s/it]
  0%|          | 67/37963 [09:54<79:03:52,  7.51s/it]
  0%|          | 68/37963 [10:01<78:56:36,  7.50s/it]
  0%|          | 69/37963 [10:09<78:07:57,  7.42s/it]
  0%|          | 70/37963 [10:16<79:01:27,  7.51s/it]
                                                     
{'loss': '0.2284', 'grad_norm': '14.04', 'learning_rate': '1.212e-06', 'epoch': '0.001844'}
+
  0%|          | 70/37963 [10:16<79:01:27,  7.51s/it]
  0%|          | 71/37963 [10:24<79:38:56,  7.57s/it]
  0%|          | 72/37963 [10:32<79:54:05,  7.59s/it]
  0%|          | 73/37963 [10:39<80:16:54,  7.63s/it]
  0%|          | 74/37963 [10:47<80:11:25,  7.62s/it]
  0%|          | 75/37963 [10:54<79:39:13,  7.57s/it]
  0%|          | 76/37963 [11:02<79:41:01,  7.57s/it]
  0%|          | 77/37963 [11:10<79:47:55,  7.58s/it]
  0%|          | 78/37963 [11:17<80:02:36,  7.61s/it]
  0%|          | 79/37963 [11:25<81:03:03,  7.70s/it]
  0%|          | 80/37963 [11:33<81:10:27,  7.71s/it]
                                                     
{'loss': '0.2462', 'grad_norm': '9.702', 'learning_rate': '1.387e-06', 'epoch': '0.002107'}
+
  0%|          | 80/37963 [11:33<81:10:27,  7.71s/it]
  0%|          | 81/37963 [11:41<81:07:06,  7.71s/it]
  0%|          | 82/37963 [11:48<80:57:28,  7.69s/it]
  0%|          | 83/37963 [11:56<81:10:04,  7.71s/it]
  0%|          | 84/37963 [12:04<81:06:25,  7.71s/it]
  0%|          | 85/37963 [12:16<96:27:54,  9.17s/it]
  0%|          | 86/37963 [12:24<91:59:11,  8.74s/it]
  0%|          | 87/37963 [12:32<88:59:37,  8.46s/it]
  0%|          | 88/37963 [12:40<86:25:40,  8.21s/it]
  0%|          | 89/37963 [12:47<84:53:16,  8.07s/it]
  0%|          | 90/37963 [12:55<82:56:31,  7.88s/it]
                                                     
{'loss': '0.2228', 'grad_norm': '14.72', 'learning_rate': '1.563e-06', 'epoch': '0.002371'}
+
  0%|          | 90/37963 [12:55<82:56:31,  7.88s/it]
  0%|          | 91/37963 [13:05<91:01:43,  8.65s/it]
  0%|          | 92/37963 [13:15<94:58:13,  9.03s/it]
  0%|          | 93/37963 [13:25<97:34:50,  9.28s/it]
  0%|          | 94/37963 [13:38<108:02:24, 10.27s/it]
  0%|          | 95/37963 [13:45<99:54:24,  9.50s/it] 
  0%|          | 96/37963 [13:53<93:46:49,  8.92s/it]
  0%|          | 97/37963 [14:00<89:33:36,  8.51s/it]
  0%|          | 98/37963 [14:11<95:06:47,  9.04s/it]
  0%|          | 99/37963 [14:18<90:58:46,  8.65s/it]
  0%|          | 100/37963 [14:26<87:00:39,  8.27s/it]
                                                      
{'loss': '0.2235', 'grad_norm': '12.44', 'learning_rate': '1.738e-06', 'epoch': '0.002634'}
+
  0%|          | 100/37963 [14:26<87:00:39,  8.27s/it]
  0%|          | 101/37963 [14:33<84:33:58,  8.04s/it]
  0%|          | 102/37963 [14:41<83:23:39,  7.93s/it]
  0%|          | 103/37963 [14:49<82:47:06,  7.87s/it]
  0%|          | 104/37963 [14:56<81:34:55,  7.76s/it]
  0%|          | 105/37963 [15:03<79:38:51,  7.57s/it]
  0%|          | 106/37963 [15:11<79:25:18,  7.55s/it]
  0%|          | 107/37963 [15:18<79:25:01,  7.55s/it]
  0%|          | 108/37963 [15:26<79:34:15,  7.57s/it]
  0%|          | 109/37963 [15:33<79:20:59,  7.55s/it]
  0%|          | 110/37963 [15:41<79:53:19,  7.60s/it]
                                                      
{'loss': '0.2267', 'grad_norm': '10.91', 'learning_rate': '1.914e-06', 'epoch': '0.002898'}
+
  0%|          | 110/37963 [15:41<79:53:19,  7.60s/it]
  0%|          | 111/37963 [15:49<79:59:20,  7.61s/it]
  0%|          | 112/37963 [15:56<79:56:57,  7.60s/it]
  0%|          | 113/37963 [16:04<80:26:39,  7.65s/it]
  0%|          | 114/37963 [16:12<80:23:45,  7.65s/it]
  0%|          | 115/37963 [16:19<79:53:16,  7.60s/it]
  0%|          | 116/37963 [16:27<80:21:29,  7.64s/it]
  0%|          | 117/37963 [16:35<80:10:39,  7.63s/it]
  0%|          | 118/37963 [16:42<79:54:42,  7.60s/it]
  0%|          | 119/37963 [16:50<79:42:10,  7.58s/it]
  0%|          | 120/37963 [16:57<79:41:12,  7.58s/it]
                                                      
{'loss': '0.2509', 'grad_norm': '18.42', 'learning_rate': '2.09e-06', 'epoch': '0.003161'}
+
  0%|          | 120/37963 [16:57<79:41:12,  7.58s/it]
  0%|          | 121/37963 [17:05<79:00:51,  7.52s/it]
  0%|          | 122/37963 [17:12<79:02:31,  7.52s/it]
  0%|          | 123/37963 [17:20<78:41:40,  7.49s/it]
  0%|          | 124/37963 [17:27<78:42:33,  7.49s/it]
  0%|          | 125/37963 [17:34<78:02:56,  7.43s/it]
  0%|          | 126/37963 [17:42<78:50:39,  7.50s/it]
  0%|          | 127/37963 [17:50<80:09:33,  7.63s/it]
  0%|          | 128/37963 [18:00<88:17:30,  8.40s/it]
  0%|          | 129/37963 [18:08<85:36:12,  8.15s/it]
  0%|          | 130/37963 [18:15<83:53:17,  7.98s/it]
                                                      
{'loss': '0.2194', 'grad_norm': '13.62', 'learning_rate': '2.265e-06', 'epoch': '0.003424'}
+
  0%|          | 130/37963 [18:15<83:53:17,  7.98s/it]
  0%|          | 131/37963 [18:23<83:01:24,  7.90s/it]
  0%|          | 132/37963 [18:31<82:42:00,  7.87s/it]
  0%|          | 133/37963 [18:38<80:49:56,  7.69s/it]
  0%|          | 134/37963 [18:46<80:33:23,  7.67s/it]
  0%|          | 135/37963 [18:56<88:41:42,  8.44s/it]
  0%|          | 136/37963 [19:04<86:53:21,  8.27s/it]
  0%|          | 137/37963 [19:12<85:16:32,  8.12s/it]
  0%|          | 138/37963 [19:19<83:33:37,  7.95s/it]
  0%|          | 139/37963 [19:32<99:00:01,  9.42s/it]
  0%|          | 140/37963 [19:42<102:06:53,  9.72s/it]
                                                       
{'loss': '0.2264', 'grad_norm': '16.11', 'learning_rate': '2.441e-06', 'epoch': '0.003688'}
+
  0%|          | 140/37963 [19:42<102:06:53,  9.72s/it]
  0%|          | 141/37963 [19:50<96:27:58,  9.18s/it] 
  0%|          | 142/37963 [20:00<98:49:23,  9.41s/it]
  0%|          | 143/37963 [20:08<93:11:43,  8.87s/it]
  0%|          | 144/37963 [20:16<89:41:13,  8.54s/it]
  0%|          | 145/37963 [20:23<86:48:19,  8.26s/it]
  0%|          | 146/37963 [20:31<84:25:09,  8.04s/it]
  0%|          | 147/37963 [20:38<82:52:44,  7.89s/it]
  0%|          | 148/37963 [20:49<90:26:08,  8.61s/it]
  0%|          | 149/37963 [20:56<87:11:10,  8.30s/it]
  0%|          | 150/37963 [21:04<84:30:54,  8.05s/it]
                                                      
{'loss': '0.2245', 'grad_norm': '7.984', 'learning_rate': '2.616e-06', 'epoch': '0.003951'}
+
  0%|          | 150/37963 [21:04<84:30:54,  8.05s/it]
  0%|          | 151/37963 [21:11<82:24:07,  7.85s/it]
  0%|          | 152/37963 [21:21<89:35:09,  8.53s/it]
  0%|          | 153/37963 [21:29<86:33:25,  8.24s/it]
  0%|          | 154/37963 [21:36<84:48:14,  8.07s/it]
  0%|          | 155/37963 [21:44<83:31:25,  7.95s/it]
  0%|          | 156/37963 [21:52<82:28:16,  7.85s/it]
  0%|          | 157/37963 [21:59<81:29:20,  7.76s/it]
  0%|          | 158/37963 [22:07<81:41:12,  7.78s/it]
  0%|          | 159/37963 [22:15<81:21:09,  7.75s/it]
  0%|          | 160/37963 [22:22<81:10:10,  7.73s/it]
                                                      
{'loss': '0.2517', 'grad_norm': '15.92', 'learning_rate': '2.792e-06', 'epoch': '0.004215'}
+
  0%|          | 160/37963 [22:22<81:10:10,  7.73s/it]
  0%|          | 161/37963 [22:30<80:53:02,  7.70s/it]
  0%|          | 162/37963 [22:38<80:52:10,  7.70s/it]
  0%|          | 163/37963 [22:45<79:52:35,  7.61s/it]
  0%|          | 164/37963 [22:53<79:49:05,  7.60s/it]
  0%|          | 165/37963 [23:00<80:16:06,  7.65s/it]
  0%|          | 166/37963 [23:08<80:25:29,  7.66s/it]
  0%|          | 167/37963 [23:16<80:35:03,  7.68s/it]
  0%|          | 168/37963 [23:24<80:29:55,  7.67s/it]
  0%|          | 169/37963 [23:31<80:02:40,  7.62s/it]
  0%|          | 170/37963 [23:39<80:38:20,  7.68s/it]
                                                      
{'loss': '0.2459', 'grad_norm': '9.313', 'learning_rate': '2.968e-06', 'epoch': '0.004478'}
+
  0%|          | 170/37963 [23:39<80:38:20,  7.68s/it]
  0%|          | 171/37963 [23:46<79:56:57,  7.62s/it]
  0%|          | 172/37963 [23:54<80:41:00,  7.69s/it]
  0%|          | 173/37963 [24:02<80:07:54,  7.63s/it]
  0%|          | 174/37963 [24:09<80:23:01,  7.66s/it]
  0%|          | 175/37963 [24:17<80:13:30,  7.64s/it]
  0%|          | 176/37963 [24:27<88:07:00,  8.39s/it]
  0%|          | 177/37963 [24:35<84:45:46,  8.08s/it]
  0%|          | 178/37963 [24:42<83:47:01,  7.98s/it]
  0%|          | 179/37963 [24:52<90:06:46,  8.59s/it]
  0%|          | 180/37963 [25:00<86:48:08,  8.27s/it]
                                                      
{'loss': '0.245', 'grad_norm': '6.511', 'learning_rate': '3.143e-06', 'epoch': '0.004741'}
+
  0%|          | 180/37963 [25:00<86:48:08,  8.27s/it]
  0%|          | 181/37963 [25:07<84:29:09,  8.05s/it]
  0%|          | 182/37963 [25:15<83:10:30,  7.93s/it]
  0%|          | 183/37963 [25:28<98:19:49,  9.37s/it]
  0%|          | 184/37963 [25:35<92:47:31,  8.84s/it]
  0%|          | 185/37963 [25:43<89:26:23,  8.52s/it]
  0%|          | 186/37963 [25:53<94:38:16,  9.02s/it]
  0%|          | 187/37963 [26:01<90:46:28,  8.65s/it]
  0%|          | 188/37963 [26:09<87:49:36,  8.37s/it]
  0%|          | 189/37963 [26:16<85:38:53,  8.16s/it]
  1%|          | 190/37963 [26:24<84:14:48,  8.03s/it]
                                                      
{'loss': '0.2234', 'grad_norm': '6.968', 'learning_rate': '3.319e-06', 'epoch': '0.005005'}
+
  1%|          | 190/37963 [26:24<84:14:48,  8.03s/it]
  1%|          | 191/37963 [26:32<83:11:28,  7.93s/it]
  1%|          | 192/37963 [26:42<90:36:46,  8.64s/it]
  1%|          | 193/37963 [26:52<95:50:42,  9.14s/it]
  1%|          | 194/37963 [27:00<90:36:58,  8.64s/it]
  1%|          | 195/37963 [27:08<87:42:13,  8.36s/it]
  1%|          | 196/37963 [27:18<93:29:09,  8.91s/it]
  1%|          | 197/37963 [27:25<88:34:16,  8.44s/it]
  1%|          | 198/37963 [27:33<85:49:45,  8.18s/it]
  1%|          | 199/37963 [27:40<84:12:03,  8.03s/it]
  1%|          | 200/37963 [27:48<81:51:24,  7.80s/it]
                                                      
{'loss': '0.2363', 'grad_norm': '12.93', 'learning_rate': '3.494e-06', 'epoch': '0.005268'}
+
  1%|          | 200/37963 [27:48<81:51:24,  7.80s/it]
  1%|          | 201/37963 [27:55<80:57:17,  7.72s/it]
  1%|          | 202/37963 [28:03<80:22:30,  7.66s/it]
  1%|          | 203/37963 [28:10<79:52:29,  7.62s/it]
  1%|          | 204/37963 [28:18<80:20:23,  7.66s/it]
  1%|          | 205/37963 [28:26<79:55:41,  7.62s/it]
  1%|          | 206/37963 [28:33<80:19:03,  7.66s/it]
  1%|          | 207/37963 [28:41<80:46:45,  7.70s/it]
  1%|          | 208/37963 [28:49<80:11:17,  7.65s/it]
  1%|          | 209/37963 [28:56<80:06:55,  7.64s/it]
  1%|          | 210/37963 [29:04<79:55:54,  7.62s/it]
                                                      
{'loss': '0.2312', 'grad_norm': '17.01', 'learning_rate': '3.67e-06', 'epoch': '0.005532'}
+
  1%|          | 210/37963 [29:04<79:55:54,  7.62s/it]
  1%|          | 211/37963 [29:12<80:07:03,  7.64s/it]
  1%|          | 212/37963 [29:19<80:02:09,  7.63s/it]
  1%|          | 213/37963 [29:27<79:49:28,  7.61s/it]
  1%|          | 214/37963 [29:34<80:11:24,  7.65s/it]
  1%|          | 215/37963 [29:42<80:05:38,  7.64s/it]
  1%|          | 216/37963 [29:50<80:09:42,  7.65s/it]
  1%|          | 217/37963 [29:57<79:56:11,  7.62s/it]
  1%|          | 218/37963 [30:05<79:48:22,  7.61s/it]
  1%|          | 219/37963 [30:12<79:47:57,  7.61s/it]
  1%|          | 220/37963 [30:20<79:43:28,  7.60s/it]
                                                      
{'loss': '0.2144', 'grad_norm': '23.7', 'learning_rate': '3.845e-06', 'epoch': '0.005795'}
+
  1%|          | 220/37963 [30:20<79:43:28,  7.60s/it]
  1%|          | 221/37963 [30:28<79:16:40,  7.56s/it]
  1%|          | 222/37963 [30:35<79:29:43,  7.58s/it]
  1%|          | 223/37963 [30:43<79:55:19,  7.62s/it]
  1%|          | 224/37963 [30:53<88:35:58,  8.45s/it]
  1%|          | 225/37963 [31:01<86:03:45,  8.21s/it]
  1%|          | 226/37963 [31:10<90:13:26,  8.61s/it]
  1%|          | 227/37963 [31:18<86:59:29,  8.30s/it]
  1%|          | 228/37963 [31:26<84:39:20,  8.08s/it]
  1%|          | 229/37963 [31:33<83:32:11,  7.97s/it]
  1%|          | 230/37963 [31:41<82:22:20,  7.86s/it]
                                                      
{'loss': '0.2204', 'grad_norm': '15.13', 'learning_rate': '4.021e-06', 'epoch': '0.006059'}
+
  1%|          | 230/37963 [31:41<82:22:20,  7.86s/it]
  1%|          | 231/37963 [31:49<81:45:09,  7.80s/it]
  1%|          | 232/37963 [31:56<80:47:22,  7.71s/it]
  1%|          | 233/37963 [32:06<89:00:22,  8.49s/it]
  1%|          | 234/37963 [32:14<87:07:43,  8.31s/it]
  1%|          | 235/37963 [32:22<84:33:59,  8.07s/it]
  1%|          | 236/37963 [32:29<83:02:07,  7.92s/it]
  1%|          | 237/37963 [32:42<98:15:49,  9.38s/it]
  1%|          | 238/37963 [32:50<92:43:20,  8.85s/it]
  1%|          | 239/37963 [32:57<88:24:42,  8.44s/it]
  1%|          | 240/37963 [33:07<92:37:57,  8.84s/it]
                                                      
{'loss': '0.2474', 'grad_norm': '12.88', 'learning_rate': '4.197e-06', 'epoch': '0.006322'}
+
  1%|          | 240/37963 [33:07<92:37:57,  8.84s/it]
  1%|          | 241/37963 [33:14<88:02:18,  8.40s/it]
  1%|          | 242/37963 [33:22<85:25:28,  8.15s/it]
  1%|          | 243/37963 [33:30<84:16:23,  8.04s/it]
  1%|          | 244/37963 [33:37<83:02:31,  7.93s/it]
  1%|          | 245/37963 [33:45<82:31:38,  7.88s/it]
  1%|          | 246/37963 [33:55<89:23:09,  8.53s/it]
  1%|          | 247/37963 [34:03<86:58:03,  8.30s/it]
  1%|          | 248/37963 [34:11<85:05:16,  8.12s/it]
  1%|          | 249/37963 [34:18<82:43:22,  7.90s/it]
  1%|          | 250/37963 [34:26<81:39:14,  7.79s/it]
                                                      
{'loss': '0.192', 'grad_norm': '11.15', 'learning_rate': '4.372e-06', 'epoch': '0.006585'}
+
  1%|          | 250/37963 [34:26<81:39:14,  7.79s/it]
  1%|          | 251/37963 [34:33<80:05:07,  7.64s/it]
  1%|          | 252/37963 [34:40<79:31:37,  7.59s/it]
  1%|          | 253/37963 [34:48<79:39:06,  7.60s/it]
  1%|          | 254/37963 [34:56<79:55:29,  7.63s/it]
  1%|          | 255/37963 [35:03<80:13:36,  7.66s/it]
  1%|          | 256/37963 [35:11<79:26:01,  7.58s/it]
  1%|          | 257/37963 [35:18<79:14:14,  7.57s/it]
  1%|          | 258/37963 [35:26<78:46:28,  7.52s/it]
  1%|          | 259/37963 [35:33<79:15:40,  7.57s/it]
  1%|          | 260/37963 [35:41<79:11:50,  7.56s/it]
                                                      
{'loss': '0.225', 'grad_norm': '9.845', 'learning_rate': '4.548e-06', 'epoch': '0.006849'}
+
  1%|          | 260/37963 [35:41<79:11:50,  7.56s/it]
  1%|          | 261/37963 [35:49<80:00:01,  7.64s/it]
  1%|          | 262/37963 [35:56<79:24:32,  7.58s/it]
  1%|          | 263/37963 [36:04<80:06:48,  7.65s/it]
  1%|          | 264/37963 [36:12<80:32:13,  7.69s/it]
  1%|          | 265/37963 [36:19<80:20:19,  7.67s/it]
  1%|          | 266/37963 [36:27<80:19:51,  7.67s/it]
  1%|          | 267/37963 [36:35<80:49:49,  7.72s/it]
  1%|          | 268/37963 [36:43<81:05:24,  7.74s/it]
  1%|          | 269/37963 [36:50<80:31:44,  7.69s/it]
  1%|          | 270/37963 [37:01<88:47:21,  8.48s/it]
                                                      
{'loss': '0.2011', 'grad_norm': '7.028', 'learning_rate': '4.723e-06', 'epoch': '0.007112'}
+
  1%|          | 270/37963 [37:01<88:47:21,  8.48s/it]
  1%|          | 271/37963 [37:08<86:04:11,  8.22s/it]
  1%|          | 272/37963 [37:16<83:46:07,  8.00s/it]
  1%|          | 273/37963 [37:26<91:11:29,  8.71s/it]
  1%|          | 274/37963 [37:34<88:44:06,  8.48s/it]
  1%|          | 275/37963 [37:42<85:58:20,  8.21s/it]
  1%|          | 276/37963 [37:49<84:15:56,  8.05s/it]
  1%|          | 277/37963 [37:57<82:57:44,  7.93s/it]
  1%|          | 278/37963 [38:05<81:43:39,  7.81s/it]
  1%|          | 279/37963 [38:12<80:57:33,  7.73s/it]
  1%|          | 280/37963 [38:20<80:22:11,  7.68s/it]
                                                      
{'loss': '0.2096', 'grad_norm': '12.54', 'learning_rate': '4.899e-06', 'epoch': '0.007376'}
+
  1%|          | 280/37963 [38:20<80:22:11,  7.68s/it]
  1%|          | 281/37963 [38:27<79:58:17,  7.64s/it]
  1%|          | 282/37963 [38:35<80:39:44,  7.71s/it]
  1%|          | 283/37963 [38:43<79:57:39,  7.64s/it]
  1%|          | 284/37963 [38:53<88:37:42,  8.47s/it]
  1%|          | 285/37963 [39:03<94:16:49,  9.01s/it]
  1%|          | 286/37963 [39:11<90:11:40,  8.62s/it]
  1%|          | 287/37963 [39:21<94:51:21,  9.06s/it]
  1%|          | 288/37963 [39:29<90:27:00,  8.64s/it]
  1%|          | 289/37963 [39:36<87:20:07,  8.35s/it]
  1%|          | 290/37963 [39:44<84:49:21,  8.11s/it]
                                                      
{'loss': '0.1995', 'grad_norm': '9.311', 'learning_rate': '5.075e-06', 'epoch': '0.007639'}
+
  1%|          | 290/37963 [39:44<84:49:21,  8.11s/it]
  1%|          | 291/37963 [39:54<91:25:29,  8.74s/it]
  1%|          | 292/37963 [40:01<86:57:24,  8.31s/it]
  1%|          | 293/37963 [40:09<84:57:42,  8.12s/it]
  1%|          | 294/37963 [40:19<91:22:38,  8.73s/it]
  1%|          | 295/37963 [40:27<88:30:02,  8.46s/it]
  1%|          | 296/37963 [40:35<86:07:44,  8.23s/it]
  1%|          | 297/37963 [40:43<85:13:16,  8.15s/it]
  1%|          | 298/37963 [40:50<83:57:58,  8.03s/it]
  1%|          | 299/37963 [40:58<82:32:56,  7.89s/it]
  1%|          | 300/37963 [41:06<81:27:19,  7.79s/it]
                                                      
{'loss': '0.2052', 'grad_norm': '7.942', 'learning_rate': '5.25e-06', 'epoch': '0.007902'}
+
  1%|          | 300/37963 [41:06<81:27:19,  7.79s/it]
  1%|          | 301/37963 [41:13<80:45:03,  7.72s/it]
  1%|          | 302/37963 [41:21<80:51:52,  7.73s/it]
  1%|          | 303/37963 [41:28<80:24:16,  7.69s/it]
  1%|          | 304/37963 [41:36<80:30:27,  7.70s/it]
  1%|          | 305/37963 [41:44<80:04:19,  7.65s/it]
  1%|          | 306/37963 [41:52<81:18:27,  7.77s/it]
  1%|          | 307/37963 [41:59<81:00:17,  7.74s/it]
  1%|          | 308/37963 [42:07<81:21:08,  7.78s/it]
  1%|          | 309/37963 [42:15<80:32:34,  7.70s/it]
  1%|          | 310/37963 [42:22<80:26:35,  7.69s/it]
                                                      
{'loss': '0.2028', 'grad_norm': '8.614', 'learning_rate': '5.426e-06', 'epoch': '0.008166'}
+
  1%|          | 310/37963 [42:22<80:26:35,  7.69s/it]
  1%|          | 311/37963 [42:30<78:34:44,  7.51s/it]
  1%|          | 312/37963 [42:37<77:58:51,  7.46s/it]
  1%|          | 313/37963 [42:45<78:45:13,  7.53s/it]
  1%|          | 314/37963 [42:52<78:39:31,  7.52s/it]
  1%|          | 315/37963 [43:00<78:47:02,  7.53s/it]
  1%|          | 316/37963 [43:07<78:49:55,  7.54s/it]
  1%|          | 317/37963 [43:17<86:54:10,  8.31s/it]
  1%|          | 318/37963 [43:25<85:08:21,  8.14s/it]
  1%|          | 319/37963 [43:33<84:24:14,  8.07s/it]
  1%|          | 320/37963 [43:41<83:19:25,  7.97s/it]
                                                      
{'loss': '0.2083', 'grad_norm': '11.38', 'learning_rate': '5.601e-06', 'epoch': '0.008429'}
+
  1%|          | 320/37963 [43:41<83:19:25,  7.97s/it]
  1%|          | 321/37963 [43:48<82:20:21,  7.87s/it]
  1%|          | 322/37963 [43:58<89:20:04,  8.54s/it]
  1%|          | 323/37963 [44:06<87:09:17,  8.34s/it]
  1%|          | 324/37963 [44:14<84:59:35,  8.13s/it]
  1%|          | 325/37963 [44:22<83:21:31,  7.97s/it]
  1%|          | 326/37963 [44:29<81:34:58,  7.80s/it]
  1%|          | 327/37963 [44:37<81:23:01,  7.78s/it]
  1%|          | 328/37963 [44:44<81:13:03,  7.77s/it]
  1%|          | 329/37963 [44:52<81:35:13,  7.80s/it]
  1%|          | 330/37963 [45:00<81:00:26,  7.75s/it]
                                                      
{'loss': '0.2186', 'grad_norm': '6.943', 'learning_rate': '5.777e-06', 'epoch': '0.008693'}
+
  1%|          | 330/37963 [45:00<81:00:26,  7.75s/it]
  1%|          | 331/37963 [45:08<81:22:01,  7.78s/it]
  1%|          | 332/37963 [45:18<88:38:13,  8.48s/it]
  1%|          | 333/37963 [45:26<86:47:36,  8.30s/it]
  1%|          | 334/37963 [45:36<91:51:51,  8.79s/it]
  1%|          | 335/37963 [45:44<88:35:07,  8.48s/it]
  1%|          | 336/37963 [45:51<85:48:37,  8.21s/it]
  1%|          | 337/37963 [45:59<83:55:44,  8.03s/it]
  1%|          | 338/37963 [46:06<82:09:28,  7.86s/it]
  1%|          | 339/37963 [46:16<89:34:59,  8.57s/it]
  1%|          | 340/37963 [46:24<85:21:52,  8.17s/it]
                                                      
{'loss': '0.2084', 'grad_norm': '12.01', 'learning_rate': '5.953e-06', 'epoch': '0.008956'}
+
  1%|          | 340/37963 [46:24<85:21:52,  8.17s/it]
  1%|          | 341/37963 [46:34<91:43:16,  8.78s/it]
  1%|          | 342/37963 [46:41<87:49:29,  8.40s/it]
  1%|          | 343/37963 [46:49<85:51:33,  8.22s/it]
  1%|          | 344/37963 [46:57<84:16:45,  8.07s/it]
  1%|          | 345/37963 [47:04<82:10:33,  7.86s/it]
  1%|          | 346/37963 [47:12<81:40:26,  7.82s/it]
  1%|          | 347/37963 [47:19<80:43:14,  7.73s/it]
  1%|          | 348/37963 [47:30<88:48:49,  8.50s/it]
  1%|          | 349/37963 [47:38<86:44:03,  8.30s/it]
  1%|          | 350/37963 [47:45<84:45:35,  8.11s/it]
                                                      
{'loss': '0.2251', 'grad_norm': '10.15', 'learning_rate': '6.128e-06', 'epoch': '0.00922'}
+
  1%|          | 350/37963 [47:45<84:45:35,  8.11s/it]
  1%|          | 351/37963 [47:53<82:28:36,  7.89s/it]
  1%|          | 352/37963 [48:00<81:08:06,  7.77s/it]
  1%|          | 353/37963 [48:08<80:47:41,  7.73s/it]
  1%|          | 354/37963 [48:15<80:17:41,  7.69s/it]
  1%|          | 355/37963 [48:23<80:09:34,  7.67s/it]
  1%|          | 356/37963 [48:31<79:44:33,  7.63s/it]
  1%|          | 357/37963 [48:38<79:23:46,  7.60s/it]
  1%|          | 358/37963 [48:46<79:25:40,  7.60s/it]
  1%|          | 359/37963 [48:53<78:58:32,  7.56s/it]
  1%|          | 360/37963 [49:01<79:19:45,  7.59s/it]
                                                      
{'loss': '0.2093', 'grad_norm': '9.247', 'learning_rate': '6.304e-06', 'epoch': '0.009483'}
+
  1%|          | 360/37963 [49:01<79:19:45,  7.59s/it]
  1%|          | 361/37963 [49:11<87:25:09,  8.37s/it]
  1%|          | 362/37963 [49:19<85:01:09,  8.14s/it]
  1%|          | 363/37963 [49:26<83:54:51,  8.03s/it]
  1%|          | 364/37963 [49:34<82:37:57,  7.91s/it]
  1%|          | 365/37963 [49:44<90:08:19,  8.63s/it]
  1%|          | 366/37963 [49:52<87:34:59,  8.39s/it]
  1%|          | 367/37963 [50:00<85:08:47,  8.15s/it]
  1%|          | 368/37963 [50:07<83:43:46,  8.02s/it]
  1%|          | 369/37963 [50:15<82:26:07,  7.89s/it]
  1%|          | 370/37963 [50:23<81:08:40,  7.77s/it]
                                                      
{'loss': '0.2175', 'grad_norm': '7.53', 'learning_rate': '6.479e-06', 'epoch': '0.009746'}
+
  1%|          | 370/37963 [50:23<81:08:40,  7.77s/it]
  1%|          | 371/37963 [50:30<80:49:58,  7.74s/it]
  1%|          | 372/37963 [50:38<80:36:15,  7.72s/it]
  1%|          | 373/37963 [50:45<79:55:20,  7.65s/it]
  1%|          | 374/37963 [50:53<78:47:07,  7.55s/it]
  1%|          | 375/37963 [51:01<79:49:01,  7.64s/it]
  1%|          | 376/37963 [51:11<87:57:35,  8.42s/it]
  1%|          | 377/37963 [51:19<85:43:22,  8.21s/it]
  1%|          | 378/37963 [51:29<91:54:23,  8.80s/it]
  1%|          | 379/37963 [51:37<88:48:57,  8.51s/it]
  1%|          | 380/37963 [51:44<86:28:29,  8.28s/it]
                                                      
{'loss': '0.214', 'grad_norm': '8.697', 'learning_rate': '6.655e-06', 'epoch': '0.01001'}
+
  1%|          | 380/37963 [51:44<86:28:29,  8.28s/it]
  1%|          | 381/37963 [51:52<84:32:41,  8.10s/it]
  1%|          | 382/37963 [52:00<83:41:08,  8.02s/it]
  1%|          | 383/37963 [52:07<82:24:07,  7.89s/it]
  1%|          | 384/37963 [52:15<81:59:13,  7.85s/it]
  1%|          | 385/37963 [52:23<81:01:56,  7.76s/it]
  1%|          | 386/37963 [52:30<80:59:38,  7.76s/it]
  1%|          | 387/37963 [52:41<88:38:47,  8.49s/it]
  1%|          | 388/37963 [52:48<84:32:09,  8.10s/it]
  1%|          | 389/37963 [52:55<82:52:20,  7.94s/it]
  1%|          | 390/37963 [53:03<82:39:43,  7.92s/it]
                                                      
{'loss': '0.2111', 'grad_norm': '13.37', 'learning_rate': '6.831e-06', 'epoch': '0.01027'}
+
  1%|          | 390/37963 [53:03<82:39:43,  7.92s/it]
  1%|          | 391/37963 [53:11<82:16:19,  7.88s/it]
  1%|          | 392/37963 [53:19<81:01:26,  7.76s/it]
  1%|          | 393/37963 [53:26<81:01:48,  7.76s/it]
  1%|          | 394/37963 [53:33<78:25:02,  7.51s/it]
  1%|          | 395/37963 [53:44<87:50:59,  8.42s/it]
  1%|          | 396/37963 [53:51<85:10:34,  8.16s/it]
  1%|          | 397/37963 [54:02<91:31:59,  8.77s/it]
  1%|          | 398/37963 [54:09<88:11:26,  8.45s/it]
  1%|          | 399/37963 [54:17<84:59:30,  8.15s/it]
  1%|          | 400/37963 [54:25<84:01:43,  8.05s/it]
                                                      
{'loss': '0.2031', 'grad_norm': '6.869', 'learning_rate': '7.006e-06', 'epoch': '0.01054'}
+
  1%|          | 400/37963 [54:25<84:01:43,  8.05s/it]
  1%|          | 401/37963 [54:32<82:37:53,  7.92s/it]
  1%|          | 402/37963 [54:39<80:44:35,  7.74s/it]
  1%|          | 403/37963 [54:47<79:02:40,  7.58s/it]
  1%|          | 404/37963 [54:54<78:16:21,  7.50s/it]
  1%|          | 405/37963 [55:04<85:54:19,  8.23s/it]
  1%|          | 406/37963 [55:12<84:35:59,  8.11s/it]
  1%|          | 407/37963 [55:20<84:08:44,  8.07s/it]
  1%|          | 408/37963 [55:27<82:06:45,  7.87s/it]
  1%|          | 409/37963 [55:35<81:38:15,  7.83s/it]
  1%|          | 410/37963 [55:42<80:23:07,  7.71s/it]
                                                      
{'loss': '0.1917', 'grad_norm': '4.798', 'learning_rate': '7.182e-06', 'epoch': '0.0108'}
+
  1%|          | 410/37963 [55:42<80:23:07,  7.71s/it]
  1%|          | 411/37963 [55:50<80:18:13,  7.70s/it]
  1%|          | 412/37963 [55:58<80:29:40,  7.72s/it]
  1%|          | 413/37963 [56:08<87:35:00,  8.40s/it]
  1%|          | 414/37963 [56:15<84:44:42,  8.12s/it]
  1%|          | 415/37963 [56:23<82:58:35,  7.96s/it]
  1%|          | 416/37963 [56:30<81:43:36,  7.84s/it]
  1%|          | 417/37963 [56:38<80:12:34,  7.69s/it]
  1%|          | 418/37963 [56:45<79:36:56,  7.63s/it]
  1%|          | 419/37963 [56:56<88:14:30,  8.46s/it]
  1%|          | 420/37963 [57:03<85:56:18,  8.24s/it]
                                                      
{'loss': '0.2045', 'grad_norm': '5.487', 'learning_rate': '7.357e-06', 'epoch': '0.01106'}
+
  1%|          | 420/37963 [57:03<85:56:18,  8.24s/it]
  1%|          | 421/37963 [57:11<83:45:36,  8.03s/it]
  1%|          | 422/37963 [57:18<81:33:03,  7.82s/it]
  1%|          | 423/37963 [57:26<81:15:13,  7.79s/it]
  1%|          | 424/37963 [57:34<81:19:46,  7.80s/it]
  1%|          | 425/37963 [57:44<88:46:18,  8.51s/it]
  1%|          | 426/37963 [57:51<86:03:28,  8.25s/it]
  1%|          | 427/37963 [57:59<82:53:05,  7.95s/it]
  1%|          | 428/37963 [58:06<81:52:35,  7.85s/it]
  1%|          | 429/37963 [58:14<81:28:02,  7.81s/it]
  1%|          | 430/37963 [58:22<81:07:28,  7.78s/it]
                                                      
{'loss': '0.1888', 'grad_norm': '14.05', 'learning_rate': '7.533e-06', 'epoch': '0.01133'}
+
  1%|          | 430/37963 [58:22<81:07:28,  7.78s/it]
  1%|          | 431/37963 [58:29<80:32:06,  7.72s/it]
  1%|          | 432/37963 [58:37<81:07:47,  7.78s/it]
  1%|          | 433/37963 [58:45<80:54:33,  7.76s/it]
  1%|          | 434/37963 [58:53<80:39:16,  7.74s/it]
  1%|          | 435/37963 [59:00<80:40:15,  7.74s/it]
  1%|          | 436/37963 [59:08<78:58:50,  7.58s/it]
  1%|          | 437/37963 [59:15<78:02:24,  7.49s/it]
  1%|          | 438/37963 [59:23<78:30:57,  7.53s/it]
  1%|          | 439/37963 [59:30<79:18:58,  7.61s/it]
  1%|          | 440/37963 [59:38<79:39:58,  7.64s/it]
                                                      
{'loss': '0.1986', 'grad_norm': '4.086', 'learning_rate': '7.709e-06', 'epoch': '0.01159'}
+
  1%|          | 440/37963 [59:38<79:39:58,  7.64s/it]
  1%|          | 441/37963 [59:48<87:59:06,  8.44s/it]
  1%|          | 442/37963 [59:56<86:00:52,  8.25s/it]
  1%|          | 443/37963 [1:00:06<92:05:09,  8.84s/it]
  1%|          | 444/37963 [1:00:14<87:56:17,  8.44s/it]
  1%|          | 445/37963 [1:00:24<93:42:24,  8.99s/it]
  1%|          | 446/37963 [1:00:32<88:53:23,  8.53s/it]
  1%|          | 447/37963 [1:00:39<85:16:10,  8.18s/it]
  1%|          | 448/37963 [1:00:49<91:34:35,  8.79s/it]
  1%|          | 449/37963 [1:00:57<88:04:37,  8.45s/it]
  1%|          | 450/37963 [1:01:04<85:17:08,  8.18s/it]
                                                        
{'loss': '0.2078', 'grad_norm': '8.606', 'learning_rate': '7.884e-06', 'epoch': '0.01185'}
+
  1%|          | 450/37963 [1:01:04<85:17:08,  8.18s/it]
  1%|          | 451/37963 [1:01:12<83:25:31,  8.01s/it]
  1%|          | 452/37963 [1:01:20<83:14:53,  7.99s/it]
  1%|          | 453/37963 [1:01:28<81:59:07,  7.87s/it]
  1%|          | 454/37963 [1:01:35<81:39:16,  7.84s/it]
  1%|          | 455/37963 [1:01:43<81:31:53,  7.83s/it]
  1%|          | 456/37963 [1:01:51<81:28:48,  7.82s/it]
  1%|          | 457/37963 [1:01:58<80:03:31,  7.68s/it]
  1%|          | 458/37963 [1:02:06<79:45:51,  7.66s/it]
  1%|          | 459/37963 [1:02:13<78:36:15,  7.55s/it]
  1%|          | 460/37963 [1:02:21<79:01:43,  7.59s/it]
                                                        
{'loss': '0.1977', 'grad_norm': '7.416', 'learning_rate': '8.06e-06', 'epoch': '0.01212'}
+
  1%|          | 460/37963 [1:02:21<79:01:43,  7.59s/it]
  1%|          | 461/37963 [1:02:29<79:24:20,  7.62s/it]
  1%|          | 462/37963 [1:02:39<87:36:44,  8.41s/it]
  1%|          | 463/37963 [1:02:47<85:46:28,  8.23s/it]
  1%|          | 464/37963 [1:02:54<84:30:25,  8.11s/it]
  1%|          | 465/37963 [1:03:02<83:13:35,  7.99s/it]
  1%|          | 466/37963 [1:03:10<81:35:07,  7.83s/it]
  1%|          | 467/37963 [1:03:20<88:04:04,  8.46s/it]
  1%|          | 468/37963 [1:03:27<85:13:52,  8.18s/it]
  1%|          | 469/37963 [1:03:34<82:45:57,  7.95s/it]
  1%|          | 470/37963 [1:03:42<82:16:56,  7.90s/it]
                                                        
{'loss': '0.1897', 'grad_norm': '4.727', 'learning_rate': '8.235e-06', 'epoch': '0.01238'}
+
  1%|          | 470/37963 [1:03:42<82:16:56,  7.90s/it]
  1%|          | 471/37963 [1:03:50<81:17:05,  7.81s/it]
  1%|          | 472/37963 [1:03:57<79:55:11,  7.67s/it]
  1%|          | 473/37963 [1:04:08<88:28:42,  8.50s/it]
  1%|          | 474/37963 [1:04:15<85:34:29,  8.22s/it]
  1%|▏         | 475/37963 [1:04:23<84:03:54,  8.07s/it]
  1%|▏         | 476/37963 [1:04:31<83:42:31,  8.04s/it]
  1%|▏         | 477/37963 [1:04:39<82:56:33,  7.97s/it]
  1%|▏         | 478/37963 [1:04:46<81:15:08,  7.80s/it]
  1%|▏         | 479/37963 [1:04:54<80:24:59,  7.72s/it]
  1%|▏         | 480/37963 [1:05:01<80:03:28,  7.69s/it]
                                                        
{'loss': '0.2022', 'grad_norm': '5.477', 'learning_rate': '8.411e-06', 'epoch': '0.01264'}
+
  1%|▏         | 480/37963 [1:05:01<80:03:28,  7.69s/it]
  1%|▏         | 481/37963 [1:05:09<80:09:08,  7.70s/it]
  1%|▏         | 482/37963 [1:05:17<79:52:11,  7.67s/it]
  1%|▏         | 483/37963 [1:05:24<79:19:42,  7.62s/it]
  1%|▏         | 484/37963 [1:05:32<79:32:55,  7.64s/it]
  1%|▏         | 485/37963 [1:05:39<79:14:50,  7.61s/it]
  1%|▏         | 486/37963 [1:05:47<78:34:00,  7.55s/it]
  1%|▏         | 487/37963 [1:05:57<85:57:56,  8.26s/it]
  1%|▏         | 488/37963 [1:06:04<84:19:23,  8.10s/it]
  1%|▏         | 489/37963 [1:06:14<90:28:57,  8.69s/it]
  1%|▏         | 490/37963 [1:06:22<87:24:25,  8.40s/it]
                                                        
{'loss': '0.2068', 'grad_norm': '9.653', 'learning_rate': '8.586e-06', 'epoch': '0.01291'}
+
  1%|▏         | 490/37963 [1:06:22<87:24:25,  8.40s/it]
  1%|▏         | 491/37963 [1:06:30<84:24:40,  8.11s/it]
  1%|▏         | 492/37963 [1:06:37<82:03:25,  7.88s/it]
  1%|▏         | 493/37963 [1:06:44<80:24:56,  7.73s/it]
  1%|▏         | 494/37963 [1:06:52<80:32:05,  7.74s/it]
  1%|▏         | 495/37963 [1:07:02<88:34:39,  8.51s/it]
  1%|▏         | 496/37963 [1:07:10<85:19:31,  8.20s/it]
  1%|▏         | 497/37963 [1:07:17<83:35:52,  8.03s/it]
  1%|▏         | 498/37963 [1:07:25<82:13:58,  7.90s/it]
  1%|▏         | 499/37963 [1:07:35<89:28:45,  8.60s/it]
  1%|▏         | 500/37963 [1:07:43<86:56:09,  8.35s/it]
                                                        
{'loss': '0.2251', 'grad_norm': '12.81', 'learning_rate': '8.762e-06', 'epoch': '0.01317'}
+
  1%|▏         | 500/37963 [1:07:43<86:56:09,  8.35s/it]
  1%|▏         | 501/37963 [1:07:51<84:55:18,  8.16s/it]
  1%|▏         | 502/37963 [1:07:59<84:06:48,  8.08s/it]
  1%|▏         | 503/37963 [1:08:07<83:17:46,  8.00s/it]
  1%|▏         | 504/37963 [1:08:14<81:16:37,  7.81s/it]
  1%|▏         | 505/37963 [1:08:22<80:53:37,  7.77s/it]
  1%|▏         | 506/37963 [1:08:29<80:18:35,  7.72s/it]
  1%|▏         | 507/37963 [1:08:37<79:49:11,  7.67s/it]
  1%|▏         | 508/37963 [1:08:44<79:36:35,  7.65s/it]
  1%|▏         | 509/37963 [1:08:52<79:54:43,  7.68s/it]
  1%|▏         | 510/37963 [1:09:02<87:31:55,  8.41s/it]
                                                        
{'loss': '0.2248', 'grad_norm': '8.395', 'learning_rate': '8.938e-06', 'epoch': '0.01343'}
+
  1%|▏         | 510/37963 [1:09:02<87:31:55,  8.41s/it]
  1%|▏         | 511/37963 [1:09:12<92:59:11,  8.94s/it]
  1%|▏         | 512/37963 [1:09:20<88:49:23,  8.54s/it]
  1%|▏         | 513/37963 [1:09:28<85:58:54,  8.27s/it]
  1%|▏         | 514/37963 [1:09:35<83:30:45,  8.03s/it]
  1%|▏         | 515/37963 [1:09:43<82:21:39,  7.92s/it]
  1%|▏         | 516/37963 [1:09:50<81:04:16,  7.79s/it]
  1%|▏         | 517/37963 [1:09:58<80:38:01,  7.75s/it]
  1%|▏         | 518/37963 [1:10:06<80:15:36,  7.72s/it]
  1%|▏         | 519/37963 [1:10:14<81:07:30,  7.80s/it]
  1%|▏         | 520/37963 [1:10:21<80:12:23,  7.71s/it]
                                                        
{'loss': '0.2096', 'grad_norm': '8.015', 'learning_rate': '9.113e-06', 'epoch': '0.0137'}
+
  1%|▏         | 520/37963 [1:10:21<80:12:23,  7.71s/it]
  1%|▏         | 521/37963 [1:10:34<96:20:19,  9.26s/it]
  1%|▏         | 522/37963 [1:10:41<91:08:12,  8.76s/it]
  1%|▏         | 523/37963 [1:10:49<87:31:41,  8.42s/it]
  1%|▏         | 524/37963 [1:10:56<84:19:41,  8.11s/it]
  1%|▏         | 525/37963 [1:11:04<82:33:03,  7.94s/it]
  1%|▏         | 526/37963 [1:11:12<81:37:30,  7.85s/it]
  1%|▏         | 527/37963 [1:11:19<81:05:32,  7.80s/it]
  1%|▏         | 528/37963 [1:11:27<80:18:16,  7.72s/it]
  1%|▏         | 529/37963 [1:11:35<80:20:16,  7.73s/it]
  1%|▏         | 530/37963 [1:11:45<88:31:08,  8.51s/it]
                                                        
{'loss': '0.2053', 'grad_norm': '5.109', 'learning_rate': '9.289e-06', 'epoch': '0.01396'}
+
  1%|▏         | 530/37963 [1:11:45<88:31:08,  8.51s/it]
  1%|▏         | 531/37963 [1:11:53<86:09:01,  8.29s/it]
  1%|▏         | 532/37963 [1:12:00<83:20:22,  8.02s/it]
  1%|▏         | 533/37963 [1:12:10<90:01:48,  8.66s/it]
  1%|▏         | 534/37963 [1:12:18<87:22:24,  8.40s/it]
  1%|▏         | 535/37963 [1:12:26<84:35:34,  8.14s/it]
  1%|▏         | 536/37963 [1:12:33<82:36:37,  7.95s/it]
  1%|▏         | 537/37963 [1:12:41<81:18:23,  7.82s/it]
  1%|▏         | 538/37963 [1:12:48<80:38:59,  7.76s/it]
  1%|▏         | 539/37963 [1:12:58<87:08:24,  8.38s/it]
  1%|▏         | 540/37963 [1:13:06<85:44:59,  8.25s/it]
                                                        
{'loss': '0.2222', 'grad_norm': '9.934', 'learning_rate': '9.464e-06', 'epoch': '0.01422'}
+
  1%|▏         | 540/37963 [1:13:06<85:44:59,  8.25s/it]
  1%|▏         | 541/37963 [1:13:14<83:32:20,  8.04s/it]
  1%|▏         | 542/37963 [1:13:21<82:05:05,  7.90s/it]
  1%|▏         | 543/37963 [1:13:32<90:00:11,  8.66s/it]
  1%|▏         | 544/37963 [1:13:39<86:47:52,  8.35s/it]
  1%|▏         | 545/37963 [1:13:47<84:23:05,  8.12s/it]
  1%|▏         | 546/37963 [1:13:54<82:56:18,  7.98s/it]
  1%|▏         | 547/37963 [1:14:02<81:29:36,  7.84s/it]
  1%|▏         | 548/37963 [1:14:10<80:51:19,  7.78s/it]
  1%|▏         | 549/37963 [1:14:17<79:53:21,  7.69s/it]
  1%|▏         | 550/37963 [1:14:25<79:49:31,  7.68s/it]
                                                        
{'loss': '0.2062', 'grad_norm': '2.815', 'learning_rate': '9.64e-06', 'epoch': '0.01449'}
+
  1%|▏         | 550/37963 [1:14:25<79:49:31,  7.68s/it]
  1%|▏         | 551/37963 [1:14:33<80:12:47,  7.72s/it]
  1%|▏         | 552/37963 [1:14:40<79:58:14,  7.70s/it]
  1%|▏         | 553/37963 [1:14:48<79:32:12,  7.65s/it]
  1%|▏         | 554/37963 [1:14:56<80:13:09,  7.72s/it]
  1%|▏         | 555/37963 [1:15:06<87:26:26,  8.41s/it]
  1%|▏         | 556/37963 [1:15:14<85:54:49,  8.27s/it]
  1%|▏         | 557/37963 [1:15:21<83:34:36,  8.04s/it]
  1%|▏         | 558/37963 [1:15:29<82:26:38,  7.93s/it]
  1%|▏         | 559/37963 [1:15:36<81:01:47,  7.80s/it]
  1%|▏         | 560/37963 [1:15:44<80:41:11,  7.77s/it]
                                                        
{'loss': '0.1982', 'grad_norm': '6.357', 'learning_rate': '9.816e-06', 'epoch': '0.01475'}
+
  1%|▏         | 560/37963 [1:15:44<80:41:11,  7.77s/it]
  1%|▏         | 561/37963 [1:15:52<80:34:21,  7.76s/it]
  1%|▏         | 562/37963 [1:16:02<88:26:11,  8.51s/it]
  1%|▏         | 563/37963 [1:16:10<85:37:09,  8.24s/it]
  1%|▏         | 564/37963 [1:16:17<82:37:47,  7.95s/it]
  1%|▏         | 565/37963 [1:16:27<89:31:20,  8.62s/it]
  1%|▏         | 566/37963 [1:16:35<87:27:21,  8.42s/it]
  1%|▏         | 567/37963 [1:16:43<85:16:30,  8.21s/it]
  1%|▏         | 568/37963 [1:16:53<91:28:21,  8.81s/it]
  1%|▏         | 569/37963 [1:17:00<86:41:14,  8.35s/it]
  2%|▏         | 570/37963 [1:17:08<84:35:31,  8.14s/it]
                                                        
{'loss': '0.2043', 'grad_norm': '4.393', 'learning_rate': '9.991e-06', 'epoch': '0.01501'}
+
  2%|▏         | 570/37963 [1:17:08<84:35:31,  8.14s/it]
  2%|▏         | 571/37963 [1:17:16<83:35:25,  8.05s/it]
  2%|▏         | 572/37963 [1:17:23<82:03:56,  7.90s/it]
  2%|▏         | 573/37963 [1:17:31<80:41:23,  7.77s/it]
  2%|▏         | 574/37963 [1:17:38<80:07:45,  7.72s/it]
  2%|▏         | 575/37963 [1:17:46<79:26:56,  7.65s/it]
  2%|▏         | 576/37963 [1:17:56<88:11:24,  8.49s/it]
  2%|▏         | 577/37963 [1:18:04<85:08:19,  8.20s/it]
  2%|▏         | 578/37963 [1:18:12<84:04:37,  8.10s/it]
  2%|▏         | 579/37963 [1:18:19<83:11:54,  8.01s/it]
  2%|▏         | 580/37963 [1:18:27<82:06:22,  7.91s/it]
                                                        
{'loss': '0.2019', 'grad_norm': '5.147', 'learning_rate': '1.017e-05', 'epoch': '0.01528'}
+
  2%|▏         | 580/37963 [1:18:27<82:06:22,  7.91s/it]
  2%|▏         | 581/37963 [1:18:35<80:54:34,  7.79s/it]
  2%|▏         | 582/37963 [1:18:42<80:01:40,  7.71s/it]
  2%|▏         | 583/37963 [1:18:52<88:24:41,  8.51s/it]
  2%|▏         | 584/37963 [1:19:00<85:44:08,  8.26s/it]
  2%|▏         | 585/37963 [1:19:11<92:38:56,  8.92s/it]
  2%|▏         | 586/37963 [1:19:18<89:07:52,  8.58s/it]
  2%|▏         | 587/37963 [1:19:26<85:44:59,  8.26s/it]
  2%|▏         | 588/37963 [1:19:33<83:22:31,  8.03s/it]
  2%|▏         | 589/37963 [1:19:41<81:55:35,  7.89s/it]
  2%|▏         | 590/37963 [1:19:49<81:05:52,  7.81s/it]
                                                        
{'loss': '0.1931', 'grad_norm': '8.421', 'learning_rate': '1.034e-05', 'epoch': '0.01554'}
+
  2%|▏         | 590/37963 [1:19:49<81:05:52,  7.81s/it]
  2%|▏         | 591/37963 [1:19:56<80:22:41,  7.74s/it]
  2%|▏         | 592/37963 [1:20:04<79:50:26,  7.69s/it]
  2%|▏         | 593/37963 [1:20:11<79:42:35,  7.68s/it]
  2%|▏         | 594/37963 [1:20:19<79:50:13,  7.69s/it]
  2%|▏         | 595/37963 [1:20:27<79:59:42,  7.71s/it]
  2%|▏         | 596/37963 [1:20:34<79:26:49,  7.65s/it]
  2%|▏         | 597/37963 [1:20:45<87:39:01,  8.44s/it]
  2%|▏         | 598/37963 [1:20:55<93:40:38,  9.03s/it]
  2%|▏         | 599/37963 [1:21:03<90:13:35,  8.69s/it]
  2%|▏         | 600/37963 [1:21:10<86:08:29,  8.30s/it]
                                                        
{'loss': '0.2041', 'grad_norm': '9.292', 'learning_rate': '1.052e-05', 'epoch': '0.0158'}
+
  2%|▏         | 600/37963 [1:21:10<86:08:29,  8.30s/it]
  2%|▏         | 601/37963 [1:21:18<83:27:54,  8.04s/it]
  2%|▏         | 602/37963 [1:21:25<81:28:19,  7.85s/it]
  2%|▏         | 603/37963 [1:21:33<80:30:35,  7.76s/it]
  2%|▏         | 604/37963 [1:21:40<79:55:54,  7.70s/it]
  2%|▏         | 605/37963 [1:21:48<79:49:01,  7.69s/it]
  2%|▏         | 606/37963 [1:21:56<79:30:55,  7.66s/it]
  2%|▏         | 607/37963 [1:22:06<87:00:40,  8.39s/it]
  2%|▏         | 608/37963 [1:22:14<85:38:06,  8.25s/it]
  2%|▏         | 609/37963 [1:22:21<84:21:38,  8.13s/it]
  2%|▏         | 610/37963 [1:22:29<83:30:14,  8.05s/it]
                                                        
{'loss': '0.2033', 'grad_norm': '5.013', 'learning_rate': '1.069e-05', 'epoch': '0.01607'}
+
  2%|▏         | 610/37963 [1:22:29<83:30:14,  8.05s/it]
  2%|▏         | 611/37963 [1:22:37<81:18:48,  7.84s/it]
  2%|▏         | 612/37963 [1:22:47<88:41:43,  8.55s/it]
  2%|▏         | 613/37963 [1:22:57<92:56:53,  8.96s/it]
  2%|▏         | 614/37963 [1:23:04<88:55:26,  8.57s/it]
  2%|▏         | 615/37963 [1:23:12<86:11:39,  8.31s/it]
  2%|▏         | 616/37963 [1:23:19<82:49:14,  7.98s/it]
  2%|▏         | 617/37963 [1:23:27<81:53:44,  7.89s/it]
  2%|▏         | 618/37963 [1:23:35<82:23:18,  7.94s/it]
  2%|▏         | 619/37963 [1:23:43<81:25:46,  7.85s/it]
  2%|▏         | 620/37963 [1:23:53<88:35:59,  8.54s/it]
                                                        
{'loss': '0.1933', 'grad_norm': '5.38', 'learning_rate': '1.087e-05', 'epoch': '0.01633'}
+
  2%|▏         | 620/37963 [1:23:53<88:35:59,  8.54s/it]
  2%|▏         | 621/37963 [1:24:00<85:36:38,  8.25s/it]
  2%|▏         | 622/37963 [1:24:08<83:34:13,  8.06s/it]
  2%|▏         | 623/37963 [1:24:16<82:09:48,  7.92s/it]
  2%|▏         | 624/37963 [1:24:24<82:17:46,  7.93s/it]
  2%|▏         | 625/37963 [1:24:31<81:16:01,  7.84s/it]
  2%|▏         | 626/37963 [1:24:39<81:02:29,  7.81s/it]
  2%|▏         | 627/37963 [1:24:47<80:30:34,  7.76s/it]
  2%|▏         | 628/37963 [1:24:57<88:01:06,  8.49s/it]
  2%|▏         | 629/37963 [1:25:04<85:15:13,  8.22s/it]
  2%|▏         | 630/37963 [1:25:12<83:11:29,  8.02s/it]
                                                        
{'loss': '0.221', 'grad_norm': '10.37', 'learning_rate': '1.104e-05', 'epoch': '0.0166'}
+
  2%|▏         | 630/37963 [1:25:12<83:11:29,  8.02s/it]
  2%|▏         | 631/37963 [1:25:22<89:45:53,  8.66s/it]
  2%|▏         | 632/37963 [1:25:30<86:23:04,  8.33s/it]
  2%|▏         | 633/37963 [1:25:37<84:31:36,  8.15s/it]
  2%|▏         | 634/37963 [1:25:45<82:41:31,  7.97s/it]
  2%|▏         | 635/37963 [1:25:53<81:39:42,  7.88s/it]
  2%|▏         | 636/37963 [1:26:00<81:08:12,  7.83s/it]
  2%|▏         | 637/37963 [1:26:08<80:56:01,  7.81s/it]
  2%|▏         | 638/37963 [1:26:16<81:10:44,  7.83s/it]
  2%|▏         | 639/37963 [1:26:24<80:13:43,  7.74s/it]
  2%|▏         | 640/37963 [1:26:31<79:52:10,  7.70s/it]
                                                        
{'loss': '0.1883', 'grad_norm': '8.093', 'learning_rate': '1.122e-05', 'epoch': '0.01686'}
+
  2%|▏         | 640/37963 [1:26:31<79:52:10,  7.70s/it]
  2%|▏         | 641/37963 [1:26:39<79:12:56,  7.64s/it]
  2%|▏         | 642/37963 [1:26:46<78:47:52,  7.60s/it]
  2%|▏         | 643/37963 [1:26:54<78:34:38,  7.58s/it]
  2%|▏         | 644/37963 [1:27:01<78:32:59,  7.58s/it]
  2%|▏         | 645/37963 [1:27:09<79:02:39,  7.63s/it]
  2%|▏         | 646/37963 [1:27:22<95:34:10,  9.22s/it]
  2%|▏         | 647/37963 [1:27:30<90:39:39,  8.75s/it]
  2%|▏         | 648/37963 [1:27:37<87:34:45,  8.45s/it]
  2%|▏         | 649/37963 [1:27:45<84:26:58,  8.15s/it]
  2%|▏         | 650/37963 [1:27:53<83:21:11,  8.04s/it]
                                                        
{'loss': '0.1956', 'grad_norm': '7.107', 'learning_rate': '1.14e-05', 'epoch': '0.01712'}
+
  2%|▏         | 650/37963 [1:27:53<83:21:11,  8.04s/it]
  2%|▏         | 651/37963 [1:28:00<82:26:27,  7.95s/it]
  2%|▏         | 652/37963 [1:28:08<81:38:38,  7.88s/it]
  2%|▏         | 653/37963 [1:28:16<80:34:10,  7.77s/it]
  2%|▏         | 654/37963 [1:28:23<80:03:34,  7.73s/it]
  2%|▏         | 655/37963 [1:28:31<79:52:41,  7.71s/it]
  2%|▏         | 656/37963 [1:28:44<95:42:41,  9.24s/it]
  2%|▏         | 657/37963 [1:28:52<91:57:59,  8.87s/it]
  2%|▏         | 658/37963 [1:28:59<87:53:53,  8.48s/it]
  2%|▏         | 659/37963 [1:29:07<85:20:23,  8.24s/it]
  2%|▏         | 660/37963 [1:29:15<83:34:50,  8.07s/it]
                                                        
{'loss': '0.2209', 'grad_norm': '4.923', 'learning_rate': '1.157e-05', 'epoch': '0.01739'}
+
  2%|▏         | 660/37963 [1:29:15<83:34:50,  8.07s/it]
  2%|▏         | 661/37963 [1:29:25<89:38:42,  8.65s/it]
  2%|▏         | 662/37963 [1:29:32<86:36:03,  8.36s/it]
  2%|▏         | 663/37963 [1:29:40<83:48:36,  8.09s/it]
  2%|▏         | 664/37963 [1:29:50<90:12:54,  8.71s/it]
  2%|▏         | 665/37963 [1:29:58<87:26:53,  8.44s/it]
  2%|▏         | 666/37963 [1:30:05<85:08:35,  8.22s/it]
  2%|▏         | 667/37963 [1:30:13<82:52:26,  8.00s/it]
  2%|▏         | 668/37963 [1:30:20<81:14:01,  7.84s/it]
  2%|▏         | 669/37963 [1:30:28<80:50:13,  7.80s/it]
  2%|▏         | 670/37963 [1:30:35<79:26:04,  7.67s/it]
                                                        
{'loss': '0.2059', 'grad_norm': '5.95', 'learning_rate': '1.175e-05', 'epoch': '0.01765'}
+
  2%|▏         | 670/37963 [1:30:35<79:26:04,  7.67s/it]
  2%|▏         | 671/37963 [1:30:43<79:13:33,  7.65s/it]
  2%|▏         | 672/37963 [1:30:51<79:27:22,  7.67s/it]
  2%|▏         | 673/37963 [1:30:58<79:26:50,  7.67s/it]
  2%|▏         | 674/37963 [1:31:06<79:39:48,  7.69s/it]
  2%|▏         | 675/37963 [1:31:14<79:43:56,  7.70s/it]
  2%|▏         | 676/37963 [1:31:21<79:12:12,  7.65s/it]
  2%|▏         | 677/37963 [1:31:29<78:49:22,  7.61s/it]
  2%|▏         | 678/37963 [1:31:37<78:55:24,  7.62s/it]
  2%|▏         | 679/37963 [1:31:47<87:12:22,  8.42s/it]
  2%|▏         | 680/37963 [1:31:54<84:28:31,  8.16s/it]
                                                        
{'loss': '0.2006', 'grad_norm': '6.091', 'learning_rate': '1.192e-05', 'epoch': '0.01791'}
+
  2%|▏         | 680/37963 [1:31:54<84:28:31,  8.16s/it]
  2%|▏         | 681/37963 [1:32:02<82:32:17,  7.97s/it]
  2%|▏         | 682/37963 [1:32:12<89:54:36,  8.68s/it]
  2%|▏         | 683/37963 [1:32:20<86:15:24,  8.33s/it]
  2%|▏         | 684/37963 [1:32:27<83:55:37,  8.10s/it]
  2%|▏         | 685/37963 [1:32:35<82:57:43,  8.01s/it]
  2%|▏         | 686/37963 [1:32:43<81:16:55,  7.85s/it]
  2%|▏         | 687/37963 [1:32:50<80:10:55,  7.74s/it]
  2%|▏         | 688/37963 [1:32:58<79:32:43,  7.68s/it]
  2%|▏         | 689/37963 [1:33:08<86:40:43,  8.37s/it]
  2%|▏         | 690/37963 [1:33:18<92:22:39,  8.92s/it]
                                                        
{'loss': '0.2189', 'grad_norm': '8.927', 'learning_rate': '1.21e-05', 'epoch': '0.01818'}
+
  2%|▏         | 690/37963 [1:33:18<92:22:39,  8.92s/it]
  2%|▏         | 691/37963 [1:33:25<87:58:48,  8.50s/it]
  2%|▏         | 692/37963 [1:33:33<85:43:42,  8.28s/it]
  2%|▏         | 693/37963 [1:33:41<83:42:38,  8.09s/it]
  2%|▏         | 694/37963 [1:33:48<82:35:02,  7.98s/it]
  2%|▏         | 695/37963 [1:33:56<81:41:12,  7.89s/it]
  2%|▏         | 696/37963 [1:34:04<81:14:18,  7.85s/it]
  2%|▏         | 697/37963 [1:34:11<79:37:53,  7.69s/it]
  2%|▏         | 698/37963 [1:34:19<79:00:46,  7.63s/it]
  2%|▏         | 699/37963 [1:34:26<78:49:47,  7.62s/it]
  2%|▏         | 700/37963 [1:34:34<79:23:05,  7.67s/it]
                                                        
{'loss': '0.2093', 'grad_norm': '16.86', 'learning_rate': '1.227e-05', 'epoch': '0.01844'}
+
  2%|▏         | 700/37963 [1:34:34<79:23:05,  7.67s/it]
  2%|▏         | 701/37963 [1:34:44<87:34:26,  8.46s/it]
  2%|▏         | 702/37963 [1:34:52<84:50:48,  8.20s/it]
  2%|▏         | 703/37963 [1:35:00<83:10:29,  8.04s/it]
  2%|▏         | 704/37963 [1:35:10<89:47:44,  8.68s/it]
  2%|▏         | 705/37963 [1:35:17<86:32:28,  8.36s/it]
  2%|▏         | 706/37963 [1:35:25<83:16:20,  8.05s/it]
  2%|▏         | 707/37963 [1:35:32<81:44:39,  7.90s/it]
  2%|▏         | 708/37963 [1:35:40<81:33:28,  7.88s/it]
  2%|▏         | 709/37963 [1:35:48<80:34:10,  7.79s/it]
  2%|▏         | 710/37963 [1:35:55<80:32:21,  7.78s/it]
                                                        
{'loss': '0.188', 'grad_norm': '7.197', 'learning_rate': '1.245e-05', 'epoch': '0.0187'}
+
  2%|▏         | 710/37963 [1:35:55<80:32:21,  7.78s/it]
  2%|▏         | 711/37963 [1:36:03<79:54:37,  7.72s/it]
  2%|▏         | 712/37963 [1:36:13<85:38:58,  8.28s/it]
  2%|▏         | 713/37963 [1:36:20<83:21:26,  8.06s/it]
  2%|▏         | 714/37963 [1:36:28<82:37:08,  7.98s/it]
  2%|▏         | 715/37963 [1:36:38<90:09:30,  8.71s/it]
  2%|▏         | 716/37963 [1:36:46<87:13:22,  8.43s/it]
  2%|▏         | 717/37963 [1:36:54<84:53:30,  8.21s/it]
  2%|▏         | 718/37963 [1:37:02<83:47:29,  8.10s/it]
  2%|▏         | 719/37963 [1:37:09<82:33:59,  7.98s/it]
  2%|▏         | 720/37963 [1:37:17<82:28:34,  7.97s/it]
                                                        
{'loss': '0.196', 'grad_norm': '7.076', 'learning_rate': '1.263e-05', 'epoch': '0.01897'}
+
  2%|▏         | 720/37963 [1:37:17<82:28:34,  7.97s/it]
  2%|▏         | 721/37963 [1:37:25<81:04:43,  7.84s/it]
  2%|▏         | 722/37963 [1:37:32<80:06:05,  7.74s/it]
  2%|▏         | 723/37963 [1:37:40<79:57:32,  7.73s/it]
  2%|▏         | 724/37963 [1:37:48<79:16:47,  7.66s/it]
  2%|▏         | 725/37963 [1:37:55<78:43:53,  7.61s/it]
  2%|▏         | 726/37963 [1:38:03<79:21:02,  7.67s/it]
  2%|▏         | 727/37963 [1:38:10<78:57:58,  7.63s/it]
  2%|▏         | 728/37963 [1:38:18<78:55:51,  7.63s/it]
  2%|▏         | 729/37963 [1:38:26<79:10:30,  7.66s/it]
  2%|▏         | 730/37963 [1:38:33<78:54:17,  7.63s/it]
                                                        
{'loss': '0.1969', 'grad_norm': '5.116', 'learning_rate': '1.28e-05', 'epoch': '0.01923'}
+
  2%|▏         | 730/37963 [1:38:33<78:54:17,  7.63s/it]
  2%|▏         | 731/37963 [1:38:44<87:06:35,  8.42s/it]
  2%|▏         | 732/37963 [1:38:51<84:41:37,  8.19s/it]
  2%|▏         | 733/37963 [1:39:02<92:05:12,  8.90s/it]
  2%|▏         | 734/37963 [1:39:10<88:12:06,  8.53s/it]
  2%|▏         | 735/37963 [1:39:17<84:52:44,  8.21s/it]
  2%|▏         | 736/37963 [1:39:25<83:31:16,  8.08s/it]
  2%|▏         | 737/37963 [1:39:33<82:56:40,  8.02s/it]
  2%|▏         | 738/37963 [1:39:40<81:31:11,  7.88s/it]
  2%|▏         | 739/37963 [1:39:48<80:47:06,  7.81s/it]
  2%|▏         | 740/37963 [1:39:55<79:56:33,  7.73s/it]
                                                        
{'loss': '0.2057', 'grad_norm': '8.357', 'learning_rate': '1.298e-05', 'epoch': '0.01949'}
+
  2%|▏         | 740/37963 [1:39:55<79:56:33,  7.73s/it]
  2%|▏         | 741/37963 [1:40:03<79:50:14,  7.72s/it]
  2%|▏         | 742/37963 [1:40:11<79:28:01,  7.69s/it]
  2%|▏         | 743/37963 [1:40:18<79:02:41,  7.65s/it]
  2%|▏         | 744/37963 [1:40:28<86:57:35,  8.41s/it]
  2%|▏         | 745/37963 [1:40:39<92:27:59,  8.94s/it]
  2%|▏         | 746/37963 [1:40:46<88:01:50,  8.52s/it]
  2%|▏         | 747/37963 [1:40:57<93:50:22,  9.08s/it]
  2%|▏         | 748/37963 [1:41:04<89:41:53,  8.68s/it]
  2%|▏         | 749/37963 [1:41:12<86:26:56,  8.36s/it]
  2%|▏         | 750/37963 [1:41:19<83:38:47,  8.09s/it]
                                                        
{'loss': '0.2261', 'grad_norm': '6.787', 'learning_rate': '1.315e-05', 'epoch': '0.01976'}
+
  2%|▏         | 750/37963 [1:41:19<83:38:47,  8.09s/it]
  2%|▏         | 751/37963 [1:41:27<81:48:27,  7.91s/it]
  2%|▏         | 752/37963 [1:41:35<81:04:41,  7.84s/it]
  2%|▏         | 753/37963 [1:41:43<81:34:10,  7.89s/it]
  2%|▏         | 754/37963 [1:41:50<80:51:34,  7.82s/it]
  2%|▏         | 755/37963 [1:42:00<88:16:31,  8.54s/it]
  2%|▏         | 756/37963 [1:42:08<85:00:42,  8.23s/it]
  2%|▏         | 757/37963 [1:42:15<82:47:58,  8.01s/it]
  2%|▏         | 758/37963 [1:42:23<81:29:00,  7.88s/it]
  2%|▏         | 759/37963 [1:42:33<88:18:18,  8.54s/it]
  2%|▏         | 760/37963 [1:42:41<85:02:36,  8.23s/it]
                                                        
{'loss': '0.2073', 'grad_norm': '5.885', 'learning_rate': '1.333e-05', 'epoch': '0.02002'}
+
  2%|▏         | 760/37963 [1:42:41<85:02:36,  8.23s/it]
  2%|▏         | 761/37963 [1:42:48<83:29:33,  8.08s/it]
  2%|▏         | 762/37963 [1:42:56<81:05:41,  7.85s/it]
  2%|▏         | 763/37963 [1:43:03<80:36:03,  7.80s/it]
  2%|▏         | 764/37963 [1:43:11<79:42:02,  7.71s/it]
  2%|▏         | 765/37963 [1:43:19<79:40:09,  7.71s/it]
  2%|▏         | 766/37963 [1:43:26<79:36:11,  7.70s/it]
  2%|▏         | 767/37963 [1:43:34<79:20:51,  7.68s/it]
  2%|▏         | 768/37963 [1:43:42<80:40:33,  7.81s/it]
  2%|▏         | 769/37963 [1:43:50<80:23:23,  7.78s/it]
  2%|▏         | 770/37963 [1:43:57<79:57:15,  7.74s/it]
                                                        
{'loss': '0.2157', 'grad_norm': '8.398', 'learning_rate': '1.35e-05', 'epoch': '0.02028'}
+
  2%|▏         | 770/37963 [1:43:57<79:57:15,  7.74s/it]
  2%|▏         | 771/37963 [1:44:05<79:48:15,  7.72s/it]
  2%|▏         | 772/37963 [1:44:13<80:18:05,  7.77s/it]
  2%|▏         | 773/37963 [1:44:21<80:28:28,  7.79s/it]
  2%|▏         | 774/37963 [1:44:31<87:03:25,  8.43s/it]
  2%|▏         | 775/37963 [1:44:38<84:13:43,  8.15s/it]
  2%|▏         | 776/37963 [1:44:46<82:16:13,  7.96s/it]
  2%|▏         | 777/37963 [1:44:56<88:38:51,  8.58s/it]
  2%|▏         | 778/37963 [1:45:04<86:11:57,  8.35s/it]
  2%|▏         | 779/37963 [1:45:11<83:42:20,  8.10s/it]
  2%|▏         | 780/37963 [1:45:19<83:09:01,  8.05s/it]
                                                        
{'loss': '0.2031', 'grad_norm': '3.8', 'learning_rate': '1.368e-05', 'epoch': '0.02055'}
+
  2%|▏         | 780/37963 [1:45:19<83:09:01,  8.05s/it]
  2%|▏         | 781/37963 [1:45:27<81:40:40,  7.91s/it]
  2%|▏         | 782/37963 [1:45:34<81:23:08,  7.88s/it]
  2%|▏         | 783/37963 [1:45:42<80:20:07,  7.78s/it]
  2%|▏         | 784/37963 [1:45:50<79:54:29,  7.74s/it]
  2%|▏         | 785/37963 [1:45:57<79:34:18,  7.71s/it]
  2%|▏         | 786/37963 [1:46:05<78:55:47,  7.64s/it]
  2%|▏         | 787/37963 [1:46:15<86:55:45,  8.42s/it]
  2%|▏         | 788/37963 [1:46:22<83:46:52,  8.11s/it]
  2%|▏         | 789/37963 [1:46:30<82:15:04,  7.97s/it]
  2%|▏         | 790/37963 [1:46:38<81:12:16,  7.86s/it]
                                                        
{'loss': '0.1923', 'grad_norm': '6.292', 'learning_rate': '1.385e-05', 'epoch': '0.02081'}
+
  2%|▏         | 790/37963 [1:46:38<81:12:16,  7.86s/it]
  2%|▏         | 791/37963 [1:46:47<87:36:27,  8.48s/it]
  2%|▏         | 792/37963 [1:46:58<93:11:44,  9.03s/it]
  2%|▏         | 793/37963 [1:47:06<90:12:02,  8.74s/it]
  2%|▏         | 794/37963 [1:47:16<93:22:56,  9.04s/it]
  2%|▏         | 795/37963 [1:47:23<89:01:34,  8.62s/it]
  2%|▏         | 796/37963 [1:47:31<85:52:45,  8.32s/it]
  2%|▏         | 797/37963 [1:47:38<82:10:29,  7.96s/it]
  2%|▏         | 798/37963 [1:47:46<81:48:54,  7.93s/it]
  2%|▏         | 799/37963 [1:47:56<89:10:46,  8.64s/it]
  2%|▏         | 800/37963 [1:48:04<86:34:38,  8.39s/it]
                                                        
{'loss': '0.2153', 'grad_norm': '15.66', 'learning_rate': '1.403e-05', 'epoch': '0.02107'}
+
  2%|▏         | 800/37963 [1:48:04<86:34:38,  8.39s/it]
  2%|▏         | 801/37963 [1:48:12<84:34:48,  8.19s/it]
  2%|▏         | 802/37963 [1:48:19<82:32:07,  8.00s/it]
  2%|▏         | 803/37963 [1:48:27<81:24:34,  7.89s/it]
  2%|▏         | 804/37963 [1:48:34<80:06:55,  7.76s/it]
  2%|▏         | 805/37963 [1:48:45<88:36:01,  8.58s/it]
  2%|▏         | 806/37963 [1:48:53<86:13:11,  8.35s/it]
  2%|▏         | 807/37963 [1:49:00<84:16:13,  8.16s/it]
  2%|▏         | 808/37963 [1:49:08<82:59:33,  8.04s/it]
  2%|▏         | 809/37963 [1:49:16<82:08:51,  7.96s/it]
  2%|▏         | 810/37963 [1:49:24<82:10:31,  7.96s/it]
                                                        
{'loss': '0.1957', 'grad_norm': '4.332', 'learning_rate': '1.421e-05', 'epoch': '0.02134'}
+
  2%|▏         | 810/37963 [1:49:24<82:10:31,  7.96s/it]
  2%|▏         | 811/37963 [1:49:31<81:00:27,  7.85s/it]
  2%|▏         | 812/37963 [1:49:39<81:22:17,  7.89s/it]
  2%|▏         | 813/37963 [1:49:47<80:25:52,  7.79s/it]
  2%|▏         | 814/37963 [1:49:54<79:29:40,  7.70s/it]
  2%|▏         | 815/37963 [1:50:02<79:06:20,  7.67s/it]
  2%|▏         | 816/37963 [1:50:10<79:07:09,  7.67s/it]
  2%|▏         | 817/37963 [1:50:17<78:37:18,  7.62s/it]
  2%|▏         | 818/37963 [1:50:24<77:10:01,  7.48s/it]
  2%|▏         | 819/37963 [1:50:32<78:07:38,  7.57s/it]
  2%|▏         | 820/37963 [1:50:40<78:01:05,  7.56s/it]
                                                        
{'loss': '0.1914', 'grad_norm': '4.031', 'learning_rate': '1.438e-05', 'epoch': '0.0216'}
+
  2%|▏         | 820/37963 [1:50:40<78:01:05,  7.56s/it]
  2%|▏         | 821/37963 [1:50:50<85:13:59,  8.26s/it]
  2%|▏         | 822/37963 [1:50:57<83:23:55,  8.08s/it]
  2%|▏         | 823/37963 [1:51:05<81:44:03,  7.92s/it]
  2%|▏         | 824/37963 [1:51:12<79:46:01,  7.73s/it]
  2%|▏         | 825/37963 [1:51:19<78:43:15,  7.63s/it]
  2%|▏         | 826/37963 [1:51:27<79:13:21,  7.68s/it]
  2%|▏         | 827/37963 [1:51:35<80:00:42,  7.76s/it]
  2%|▏         | 828/37963 [1:51:45<86:32:35,  8.39s/it]
  2%|▏         | 829/37963 [1:51:53<84:57:39,  8.24s/it]
  2%|▏         | 830/37963 [1:52:01<84:06:57,  8.15s/it]
                                                        
{'loss': '0.1955', 'grad_norm': '3.378', 'learning_rate': '1.456e-05', 'epoch': '0.02186'}
+
  2%|▏         | 830/37963 [1:52:01<84:06:57,  8.15s/it]
  2%|▏         | 831/37963 [1:52:09<82:20:37,  7.98s/it]
  2%|▏         | 832/37963 [1:52:16<82:15:42,  7.98s/it]
  2%|▏         | 833/37963 [1:52:24<81:52:57,  7.94s/it]
  2%|▏         | 834/37963 [1:52:32<81:02:52,  7.86s/it]
  2%|▏         | 835/37963 [1:52:42<88:45:52,  8.61s/it]
  2%|▏         | 836/37963 [1:52:52<93:33:08,  9.07s/it]
  2%|▏         | 837/37963 [1:53:00<89:18:42,  8.66s/it]
  2%|▏         | 838/37963 [1:53:10<93:39:06,  9.08s/it]
  2%|▏         | 839/37963 [1:53:18<90:01:22,  8.73s/it]
  2%|▏         | 840/37963 [1:53:28<93:37:00,  9.08s/it]
                                                        
{'loss': '0.1939', 'grad_norm': '3.45', 'learning_rate': '1.473e-05', 'epoch': '0.02213'}
+
  2%|▏         | 840/37963 [1:53:28<93:37:00,  9.08s/it]
  2%|▏         | 841/37963 [1:53:36<88:54:29,  8.62s/it]
  2%|▏         | 842/37963 [1:53:43<85:54:59,  8.33s/it]
  2%|▏         | 843/37963 [1:53:54<91:58:51,  8.92s/it]
  2%|▏         | 844/37963 [1:54:01<88:22:50,  8.57s/it]
  2%|▏         | 845/37963 [1:54:09<85:24:52,  8.28s/it]
  2%|▏         | 846/37963 [1:54:17<83:57:45,  8.14s/it]
  2%|▏         | 847/37963 [1:54:24<81:41:14,  7.92s/it]
  2%|▏         | 848/37963 [1:54:34<89:08:36,  8.65s/it]
  2%|▏         | 849/37963 [1:54:42<85:42:43,  8.31s/it]
  2%|▏         | 850/37963 [1:54:50<83:42:47,  8.12s/it]
                                                        
{'loss': '0.1954', 'grad_norm': '5.601', 'learning_rate': '1.491e-05', 'epoch': '0.02239'}
+
  2%|▏         | 850/37963 [1:54:50<83:42:47,  8.12s/it]
  2%|▏         | 851/37963 [1:54:57<82:29:22,  8.00s/it]
  2%|▏         | 852/37963 [1:55:05<81:54:47,  7.95s/it]
  2%|▏         | 853/37963 [1:55:13<79:49:10,  7.74s/it]
  2%|▏         | 854/37963 [1:55:20<79:44:54,  7.74s/it]
  2%|▏         | 855/37963 [1:55:28<79:43:28,  7.73s/it]
  2%|▏         | 856/37963 [1:55:36<79:18:28,  7.69s/it]
  2%|▏         | 857/37963 [1:55:43<79:50:47,  7.75s/it]
  2%|▏         | 858/37963 [1:55:51<79:54:59,  7.75s/it]
  2%|▏         | 859/37963 [1:55:59<79:20:16,  7.70s/it]
  2%|▏         | 860/37963 [1:56:06<79:09:29,  7.68s/it]
                                                        
{'loss': '0.1957', 'grad_norm': '3.866', 'learning_rate': '1.508e-05', 'epoch': '0.02265'}
+
  2%|▏         | 860/37963 [1:56:06<79:09:29,  7.68s/it]
  2%|▏         | 861/37963 [1:56:14<78:57:18,  7.66s/it]
  2%|▏         | 862/37963 [1:56:22<78:37:41,  7.63s/it]
  2%|▏         | 863/37963 [1:56:29<78:49:55,  7.65s/it]
  2%|▏         | 864/37963 [1:56:40<87:46:44,  8.52s/it]
  2%|▏         | 865/37963 [1:56:48<85:25:52,  8.29s/it]
  2%|▏         | 866/37963 [1:56:55<83:49:24,  8.13s/it]
  2%|▏         | 867/37963 [1:57:03<83:17:09,  8.08s/it]
  2%|▏         | 868/37963 [1:57:11<82:20:06,  7.99s/it]
  2%|▏         | 869/37963 [1:57:19<80:44:38,  7.84s/it]
  2%|▏         | 870/37963 [1:57:26<80:23:13,  7.80s/it]
                                                        
{'loss': '0.2002', 'grad_norm': '7.67', 'learning_rate': '1.526e-05', 'epoch': '0.02292'}
+
  2%|▏         | 870/37963 [1:57:26<80:23:13,  7.80s/it]
  2%|▏         | 871/37963 [1:57:34<80:03:41,  7.77s/it]
  2%|▏         | 872/37963 [1:57:42<79:31:17,  7.72s/it]
  2%|▏         | 873/37963 [1:57:49<79:08:32,  7.68s/it]
  2%|▏         | 874/37963 [1:57:57<78:34:24,  7.63s/it]
  2%|▏         | 875/37963 [1:58:05<79:28:17,  7.71s/it]
  2%|▏         | 876/37963 [1:58:13<80:48:38,  7.84s/it]
  2%|▏         | 877/37963 [1:58:20<79:44:48,  7.74s/it]
  2%|▏         | 878/37963 [1:58:28<79:48:44,  7.75s/it]
  2%|▏         | 879/37963 [1:58:36<79:06:47,  7.68s/it]
  2%|▏         | 880/37963 [1:58:46<87:55:31,  8.54s/it]
                                                        
{'loss': '0.2175', 'grad_norm': '4.061', 'learning_rate': '1.543e-05', 'epoch': '0.02318'}
+
  2%|▏         | 880/37963 [1:58:46<87:55:31,  8.54s/it]
  2%|▏         | 881/37963 [1:58:54<86:09:32,  8.36s/it]
  2%|▏         | 882/37963 [1:59:04<92:07:24,  8.94s/it]
  2%|▏         | 883/37963 [1:59:15<96:51:03,  9.40s/it]
  2%|▏         | 884/37963 [1:59:25<98:53:47,  9.60s/it]
  2%|▏         | 885/37963 [1:59:35<101:53:17,  9.89s/it]
  2%|▏         | 886/37963 [1:59:43<95:31:25,  9.27s/it] 
  2%|▏         | 887/37963 [1:59:51<91:24:02,  8.87s/it]
  2%|▏         | 888/37963 [1:59:59<88:12:59,  8.57s/it]
  2%|▏         | 889/37963 [2:00:07<84:54:48,  8.25s/it]
  2%|▏         | 890/37963 [2:00:14<83:19:38,  8.09s/it]
                                                        
{'loss': '0.2013', 'grad_norm': '6.226', 'learning_rate': '1.561e-05', 'epoch': '0.02344'}
+
  2%|▏         | 890/37963 [2:00:14<83:19:38,  8.09s/it]
  2%|▏         | 891/37963 [2:00:24<89:26:54,  8.69s/it]
  2%|▏         | 892/37963 [2:00:32<85:08:26,  8.27s/it]
  2%|▏         | 893/37963 [2:00:39<83:37:57,  8.12s/it]
  2%|▏         | 894/37963 [2:00:47<81:57:35,  7.96s/it]
  2%|▏         | 895/37963 [2:00:55<81:24:01,  7.91s/it]
  2%|▏         | 896/37963 [2:01:02<80:01:52,  7.77s/it]
  2%|▏         | 897/37963 [2:01:12<87:17:38,  8.48s/it]
  2%|▏         | 898/37963 [2:01:20<85:01:10,  8.26s/it]
  2%|▏         | 899/37963 [2:01:28<82:49:54,  8.05s/it]
  2%|▏         | 900/37963 [2:01:35<81:34:45,  7.92s/it]
                                                        
{'loss': '0.1843', 'grad_norm': '4.976', 'learning_rate': '1.579e-05', 'epoch': '0.02371'}
+
  2%|▏         | 900/37963 [2:01:35<81:34:45,  7.92s/it]
  2%|▏         | 901/37963 [2:01:43<80:20:58,  7.80s/it]
  2%|▏         | 902/37963 [2:01:50<79:44:20,  7.75s/it]
  2%|▏         | 903/37963 [2:01:58<79:12:38,  7.69s/it]
  2%|▏         | 904/37963 [2:02:06<79:01:24,  7.68s/it]
  2%|▏         | 905/37963 [2:02:13<77:53:24,  7.57s/it]
  2%|▏         | 906/37963 [2:02:21<78:46:10,  7.65s/it]
  2%|▏         | 907/37963 [2:02:28<77:47:21,  7.56s/it]
  2%|▏         | 908/37963 [2:02:39<86:56:12,  8.45s/it]
  2%|▏         | 909/37963 [2:02:46<83:23:39,  8.10s/it]
  2%|▏         | 910/37963 [2:02:54<82:00:14,  7.97s/it]
                                                        
{'loss': '0.1979', 'grad_norm': '4.327', 'learning_rate': '1.596e-05', 'epoch': '0.02397'}
+
  2%|▏         | 910/37963 [2:02:54<82:00:14,  7.97s/it]
  2%|▏         | 911/37963 [2:03:01<80:31:07,  7.82s/it]
  2%|▏         | 912/37963 [2:03:08<78:45:37,  7.65s/it]
  2%|▏         | 913/37963 [2:03:16<78:41:26,  7.65s/it]
  2%|▏         | 914/37963 [2:03:24<79:00:03,  7.68s/it]
  2%|▏         | 915/37963 [2:03:31<78:31:55,  7.63s/it]
  2%|▏         | 916/37963 [2:03:39<78:35:47,  7.64s/it]
  2%|▏         | 917/37963 [2:03:47<78:53:01,  7.67s/it]
  2%|▏         | 918/37963 [2:03:55<79:31:55,  7.73s/it]
  2%|▏         | 919/37963 [2:04:02<79:35:59,  7.74s/it]
  2%|▏         | 920/37963 [2:04:10<79:44:10,  7.75s/it]
                                                        
{'loss': '0.2022', 'grad_norm': '11.19', 'learning_rate': '1.614e-05', 'epoch': '0.02423'}
+
  2%|▏         | 920/37963 [2:04:10<79:44:10,  7.75s/it]
  2%|▏         | 921/37963 [2:04:18<78:56:20,  7.67s/it]
  2%|▏         | 922/37963 [2:04:25<78:29:13,  7.63s/it]
  2%|▏         | 923/37963 [2:04:33<78:47:31,  7.66s/it]
  2%|▏         | 924/37963 [2:04:41<79:03:59,  7.68s/it]
  2%|▏         | 925/37963 [2:04:49<80:25:03,  7.82s/it]
  2%|▏         | 926/37963 [2:04:56<79:56:55,  7.77s/it]
  2%|▏         | 927/37963 [2:05:06<87:02:23,  8.46s/it]
  2%|▏         | 928/37963 [2:05:16<91:17:26,  8.87s/it]
  2%|▏         | 929/37963 [2:05:24<87:06:51,  8.47s/it]
  2%|▏         | 930/37963 [2:05:31<84:44:38,  8.24s/it]
                                                        
{'loss': '0.2066', 'grad_norm': '2.854', 'learning_rate': '1.631e-05', 'epoch': '0.0245'}
+
  2%|▏         | 930/37963 [2:05:31<84:44:38,  8.24s/it]
  2%|▏         | 931/37963 [2:05:42<90:29:24,  8.80s/it]
  2%|▏         | 932/37963 [2:05:50<88:11:03,  8.57s/it]
  2%|▏         | 933/37963 [2:06:00<93:20:10,  9.07s/it]
  2%|▏         | 934/37963 [2:06:08<89:20:43,  8.69s/it]
  2%|▏         | 935/37963 [2:06:15<86:32:52,  8.41s/it]
  2%|▏         | 936/37963 [2:06:23<84:40:44,  8.23s/it]
  2%|▏         | 937/37963 [2:06:31<83:28:03,  8.12s/it]
  2%|▏         | 938/37963 [2:06:41<89:33:27,  8.71s/it]
  2%|▏         | 939/37963 [2:06:51<93:51:18,  9.13s/it]
  2%|▏         | 940/37963 [2:06:59<88:58:24,  8.65s/it]
                                                        
{'loss': '0.1884', 'grad_norm': '3.32', 'learning_rate': '1.649e-05', 'epoch': '0.02476'}
+
  2%|▏         | 940/37963 [2:06:59<88:58:24,  8.65s/it]
  2%|▏         | 941/37963 [2:07:07<86:28:05,  8.41s/it]
  2%|▏         | 942/37963 [2:07:14<84:33:35,  8.22s/it]
  2%|▏         | 943/37963 [2:07:22<82:36:16,  8.03s/it]
  2%|▏         | 944/37963 [2:07:30<80:51:35,  7.86s/it]
  2%|▏         | 945/37963 [2:07:40<87:56:29,  8.55s/it]
  2%|▏         | 946/37963 [2:07:48<86:10:13,  8.38s/it]
  2%|▏         | 947/37963 [2:07:55<82:19:36,  8.01s/it]
  2%|▏         | 948/37963 [2:08:02<81:14:20,  7.90s/it]
  2%|▏         | 949/37963 [2:08:10<80:18:39,  7.81s/it]
  3%|▎         | 950/37963 [2:08:17<79:03:19,  7.69s/it]
                                                        
{'loss': '0.1853', 'grad_norm': '3.573', 'learning_rate': '1.666e-05', 'epoch': '0.02502'}
+
  3%|▎         | 950/37963 [2:08:17<79:03:19,  7.69s/it]
  3%|▎         | 951/37963 [2:08:25<78:26:40,  7.63s/it]
  3%|▎         | 952/37963 [2:08:33<78:47:52,  7.66s/it]
  3%|▎         | 953/37963 [2:08:40<77:46:39,  7.57s/it]
  3%|▎         | 954/37963 [2:08:50<86:40:59,  8.43s/it]
  3%|▎         | 955/37963 [2:08:58<83:43:14,  8.14s/it]
  3%|▎         | 956/37963 [2:09:06<82:32:57,  8.03s/it]
  3%|▎         | 957/37963 [2:09:13<81:48:39,  7.96s/it]
  3%|▎         | 958/37963 [2:09:21<81:10:09,  7.90s/it]
  3%|▎         | 959/37963 [2:09:29<80:36:22,  7.84s/it]
  3%|▎         | 960/37963 [2:09:37<80:04:51,  7.79s/it]
                                                        
{'loss': '0.1894', 'grad_norm': '4.551', 'learning_rate': '1.684e-05', 'epoch': '0.02529'}
+
  3%|▎         | 960/37963 [2:09:37<80:04:51,  7.79s/it]
  3%|▎         | 961/37963 [2:09:44<78:59:29,  7.69s/it]
  3%|▎         | 962/37963 [2:09:52<78:17:31,  7.62s/it]
  3%|▎         | 963/37963 [2:09:59<79:00:38,  7.69s/it]
  3%|▎         | 964/37963 [2:10:07<79:41:14,  7.75s/it]
  3%|▎         | 965/37963 [2:10:15<79:05:40,  7.70s/it]
  3%|▎         | 966/37963 [2:10:23<79:09:10,  7.70s/it]
  3%|▎         | 967/37963 [2:10:30<78:41:38,  7.66s/it]
  3%|▎         | 968/37963 [2:10:38<78:51:36,  7.67s/it]
  3%|▎         | 969/37963 [2:10:45<78:38:32,  7.65s/it]
  3%|▎         | 970/37963 [2:10:53<79:06:07,  7.70s/it]
                                                        
{'loss': '0.181', 'grad_norm': '2.284', 'learning_rate': '1.701e-05', 'epoch': '0.02555'}
+
  3%|▎         | 970/37963 [2:10:53<79:06:07,  7.70s/it]
  3%|▎         | 971/37963 [2:11:03<86:58:35,  8.46s/it]
  3%|▎         | 972/37963 [2:11:11<84:46:19,  8.25s/it]
  3%|▎         | 973/37963 [2:11:19<82:32:59,  8.03s/it]
  3%|▎         | 974/37963 [2:11:26<81:08:17,  7.90s/it]
  3%|▎         | 975/37963 [2:11:34<80:40:46,  7.85s/it]
  3%|▎         | 976/37963 [2:11:44<87:57:26,  8.56s/it]
  3%|▎         | 977/37963 [2:11:55<93:43:52,  9.12s/it]
  3%|▎         | 978/37963 [2:12:02<89:23:46,  8.70s/it]
  3%|▎         | 979/37963 [2:12:13<93:54:20,  9.14s/it]
  3%|▎         | 980/37963 [2:12:20<89:14:09,  8.69s/it]
                                                        
{'loss': '0.204', 'grad_norm': '8.401', 'learning_rate': '1.719e-05', 'epoch': '0.02581'}
+
  3%|▎         | 980/37963 [2:12:20<89:14:09,  8.69s/it]
  3%|▎         | 981/37963 [2:12:28<86:23:21,  8.41s/it]
  3%|▎         | 982/37963 [2:12:36<84:32:45,  8.23s/it]
  3%|▎         | 983/37963 [2:12:43<82:15:48,  8.01s/it]
  3%|▎         | 984/37963 [2:12:51<80:13:12,  7.81s/it]
  3%|▎         | 985/37963 [2:12:58<79:18:56,  7.72s/it]
  3%|▎         | 986/37963 [2:13:06<79:46:49,  7.77s/it]
  3%|▎         | 987/37963 [2:13:14<79:12:04,  7.71s/it]
  3%|▎         | 988/37963 [2:13:24<86:36:09,  8.43s/it]
  3%|▎         | 989/37963 [2:13:31<82:51:56,  8.07s/it]
  3%|▎         | 990/37963 [2:13:41<89:33:17,  8.72s/it]
                                                        
{'loss': '0.186', 'grad_norm': '4.814', 'learning_rate': '1.737e-05', 'epoch': '0.02608'}
+
  3%|▎         | 990/37963 [2:13:41<89:33:17,  8.72s/it]
  3%|▎         | 991/37963 [2:13:49<86:01:21,  8.38s/it]
  3%|▎         | 992/37963 [2:13:56<83:37:31,  8.14s/it]
  3%|▎         | 993/37963 [2:14:07<91:06:10,  8.87s/it]
  3%|▎         | 994/37963 [2:14:15<87:08:01,  8.48s/it]
  3%|▎         | 995/37963 [2:14:22<84:11:59,  8.20s/it]
  3%|▎         | 996/37963 [2:14:30<82:46:12,  8.06s/it]
  3%|▎         | 997/37963 [2:14:37<81:15:13,  7.91s/it]
  3%|▎         | 998/37963 [2:14:45<80:49:49,  7.87s/it]
  3%|▎         | 999/37963 [2:14:53<80:29:03,  7.84s/it]
  3%|▎         | 1000/37963 [2:15:01<79:50:01,  7.78s/it]
                                                         
{'loss': '0.1947', 'grad_norm': '6.092', 'learning_rate': '1.754e-05', 'epoch': '0.02634'}
+
  3%|▎         | 1000/37963 [2:15:01<79:50:01,  7.78s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.41s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.41s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
  3%|▎         | 1001/37963 [2:16:04<250:15:24, 24.37s/it]
  3%|▎         | 1002/37963 [2:16:12<199:24:00, 19.42s/it]
  3%|▎         | 1003/37963 [2:16:19<163:52:52, 15.96s/it]
  3%|▎         | 1004/37963 [2:16:27<138:07:30, 13.45s/it]
  3%|▎         | 1005/37963 [2:16:35<119:52:59, 11.68s/it]
  3%|▎         | 1006/37963 [2:16:42<106:58:15, 10.42s/it]
  3%|▎         | 1007/37963 [2:16:52<105:54:37, 10.32s/it]
  3%|▎         | 1008/37963 [2:17:00<97:53:05,  9.54s/it] 
  3%|▎         | 1009/37963 [2:17:08<92:25:39,  9.00s/it]
  3%|▎         | 1010/37963 [2:17:15<88:13:17,  8.59s/it]
                                                         
{'loss': '0.2061', 'grad_norm': '4.306', 'learning_rate': '1.772e-05', 'epoch': '0.0266'}
+
  3%|▎         | 1010/37963 [2:17:15<88:13:17,  8.59s/it]
  3%|▎         | 1011/37963 [2:17:23<84:53:58,  8.27s/it]
  3%|▎         | 1012/37963 [2:17:30<82:30:49,  8.04s/it]
  3%|▎         | 1013/37963 [2:17:38<81:26:14,  7.93s/it]
  3%|▎         | 1014/37963 [2:17:46<80:26:30,  7.84s/it]
  3%|▎         | 1015/37963 [2:17:53<80:48:44,  7.87s/it]
  3%|▎         | 1016/37963 [2:18:01<80:25:32,  7.84s/it]
  3%|▎         | 1017/37963 [2:18:11<87:48:08,  8.56s/it]
  3%|▎         | 1018/37963 [2:18:20<86:20:05,  8.41s/it]
  3%|▎         | 1019/37963 [2:18:27<84:07:45,  8.20s/it]
  3%|▎         | 1020/37963 [2:18:35<82:30:30,  8.04s/it]
                                                         
{'loss': '0.2071', 'grad_norm': '6.567', 'learning_rate': '1.789e-05', 'epoch': '0.02687'}
+
  3%|▎         | 1020/37963 [2:18:35<82:30:30,  8.04s/it]
  3%|▎         | 1021/37963 [2:18:43<81:20:54,  7.93s/it]
  3%|▎         | 1022/37963 [2:18:55<95:36:08,  9.32s/it]
  3%|▎         | 1023/37963 [2:19:03<91:12:00,  8.89s/it]
  3%|▎         | 1024/37963 [2:19:13<95:03:16,  9.26s/it]
  3%|▎         | 1025/37963 [2:19:21<89:45:17,  8.75s/it]
  3%|▎         | 1026/37963 [2:19:28<86:33:26,  8.44s/it]
  3%|▎         | 1027/37963 [2:19:36<83:54:04,  8.18s/it]
  3%|▎         | 1028/37963 [2:19:43<81:33:25,  7.95s/it]
  3%|▎         | 1029/37963 [2:19:52<82:06:31,  8.00s/it]
  3%|▎         | 1030/37963 [2:19:59<81:03:59,  7.90s/it]
                                                         
{'loss': '0.1898', 'grad_norm': '4.914', 'learning_rate': '1.807e-05', 'epoch': '0.02713'}
+
  3%|▎         | 1030/37963 [2:19:59<81:03:59,  7.90s/it]
  3%|▎         | 1031/37963 [2:20:07<81:04:44,  7.90s/it]
  3%|▎         | 1032/37963 [2:20:15<80:09:53,  7.81s/it]
  3%|▎         | 1033/37963 [2:20:22<78:23:43,  7.64s/it]
  3%|▎         | 1034/37963 [2:20:29<78:01:05,  7.61s/it]
  3%|▎         | 1035/37963 [2:20:37<78:07:08,  7.62s/it]
  3%|▎         | 1036/37963 [2:20:45<77:50:35,  7.59s/it]
  3%|▎         | 1037/37963 [2:20:52<78:16:51,  7.63s/it]
  3%|▎         | 1038/37963 [2:21:02<85:11:42,  8.31s/it]
  3%|▎         | 1039/37963 [2:21:10<84:23:38,  8.23s/it]
  3%|▎         | 1040/37963 [2:21:18<83:03:11,  8.10s/it]
                                                         
{'loss': '0.1996', 'grad_norm': '3.198', 'learning_rate': '1.824e-05', 'epoch': '0.0274'}
+
  3%|▎         | 1040/37963 [2:21:18<83:03:11,  8.10s/it]
  3%|▎         | 1041/37963 [2:21:26<81:46:15,  7.97s/it]
  3%|▎         | 1042/37963 [2:21:36<88:21:58,  8.62s/it]
  3%|▎         | 1043/37963 [2:21:44<85:48:14,  8.37s/it]
  3%|▎         | 1044/37963 [2:21:51<83:40:46,  8.16s/it]
  3%|▎         | 1045/37963 [2:22:01<88:51:27,  8.66s/it]
  3%|▎         | 1046/37963 [2:22:09<86:23:33,  8.42s/it]
  3%|▎         | 1047/37963 [2:22:17<83:40:16,  8.16s/it]
  3%|▎         | 1048/37963 [2:22:24<81:52:52,  7.99s/it]
  3%|▎         | 1049/37963 [2:22:32<80:46:44,  7.88s/it]
  3%|▎         | 1050/37963 [2:22:39<79:55:57,  7.80s/it]
                                                         
{'loss': '0.1844', 'grad_norm': '2.928', 'learning_rate': '1.842e-05', 'epoch': '0.02766'}
+
  3%|▎         | 1050/37963 [2:22:39<79:55:57,  7.80s/it]
  3%|▎         | 1051/37963 [2:22:47<79:46:34,  7.78s/it]
  3%|▎         | 1052/37963 [2:22:55<78:38:04,  7.67s/it]
  3%|▎         | 1053/37963 [2:23:02<78:52:28,  7.69s/it]
  3%|▎         | 1054/37963 [2:23:10<78:35:20,  7.67s/it]
  3%|▎         | 1055/37963 [2:23:18<78:31:54,  7.66s/it]
  3%|▎         | 1056/37963 [2:23:25<78:42:28,  7.68s/it]
  3%|▎         | 1057/37963 [2:23:33<78:27:56,  7.65s/it]
  3%|▎         | 1058/37963 [2:23:41<78:46:45,  7.68s/it]
  3%|▎         | 1059/37963 [2:23:48<78:40:19,  7.67s/it]
  3%|▎         | 1060/37963 [2:23:56<78:50:00,  7.69s/it]
                                                         
{'loss': '0.2048', 'grad_norm': '3.882', 'learning_rate': '1.86e-05', 'epoch': '0.02792'}
+
  3%|▎         | 1060/37963 [2:23:56<78:50:00,  7.69s/it]
  3%|▎         | 1061/37963 [2:24:06<86:52:38,  8.48s/it]
  3%|▎         | 1062/37963 [2:24:14<84:17:41,  8.22s/it]
  3%|▎         | 1063/37963 [2:24:21<82:01:59,  8.00s/it]
  3%|▎         | 1064/37963 [2:24:29<80:41:20,  7.87s/it]
  3%|▎         | 1065/37963 [2:24:39<87:04:22,  8.50s/it]
  3%|▎         | 1066/37963 [2:24:47<84:15:09,  8.22s/it]
  3%|▎         | 1067/37963 [2:24:54<82:23:33,  8.04s/it]
  3%|▎         | 1068/37963 [2:25:02<80:21:44,  7.84s/it]
  3%|▎         | 1069/37963 [2:25:09<79:00:11,  7.71s/it]
  3%|▎         | 1070/37963 [2:25:19<86:17:14,  8.42s/it]
                                                         
{'loss': '0.1932', 'grad_norm': '4.102', 'learning_rate': '1.877e-05', 'epoch': '0.02819'}
+
  3%|▎         | 1070/37963 [2:25:19<86:17:14,  8.42s/it]
  3%|▎         | 1071/37963 [2:25:27<83:55:49,  8.19s/it]
  3%|▎         | 1072/37963 [2:25:34<82:29:12,  8.05s/it]
  3%|▎         | 1073/37963 [2:25:42<81:01:04,  7.91s/it]
  3%|▎         | 1074/37963 [2:25:50<81:08:53,  7.92s/it]
  3%|▎         | 1075/37963 [2:25:57<80:02:57,  7.81s/it]
  3%|▎         | 1076/37963 [2:26:07<86:42:58,  8.46s/it]
  3%|▎         | 1077/37963 [2:26:15<83:45:40,  8.17s/it]
  3%|▎         | 1078/37963 [2:26:25<89:35:34,  8.74s/it]
  3%|▎         | 1079/37963 [2:26:33<86:04:32,  8.40s/it]
  3%|▎         | 1080/37963 [2:26:40<83:21:52,  8.14s/it]
                                                         
{'loss': '0.2127', 'grad_norm': '3.616', 'learning_rate': '1.895e-05', 'epoch': '0.02845'}
+
  3%|▎         | 1080/37963 [2:26:40<83:21:52,  8.14s/it]
  3%|▎         | 1081/37963 [2:26:48<81:09:24,  7.92s/it]
  3%|▎         | 1082/37963 [2:26:55<80:15:32,  7.83s/it]
  3%|▎         | 1083/37963 [2:27:03<79:44:42,  7.78s/it]
  3%|▎         | 1084/37963 [2:27:11<79:16:22,  7.74s/it]
  3%|▎         | 1085/37963 [2:27:18<78:45:55,  7.69s/it]
  3%|▎         | 1086/37963 [2:27:26<78:22:04,  7.65s/it]
  3%|▎         | 1087/37963 [2:27:33<78:09:30,  7.63s/it]
  3%|▎         | 1088/37963 [2:27:41<77:52:22,  7.60s/it]
  3%|▎         | 1089/37963 [2:27:49<78:18:09,  7.64s/it]
  3%|▎         | 1090/37963 [2:27:56<77:49:05,  7.60s/it]
                                                         
{'loss': '0.2093', 'grad_norm': '7.155', 'learning_rate': '1.912e-05', 'epoch': '0.02871'}
+
  3%|▎         | 1090/37963 [2:27:56<77:49:05,  7.60s/it]
  3%|▎         | 1091/37963 [2:28:04<77:46:01,  7.59s/it]
  3%|▎         | 1092/37963 [2:28:14<85:35:59,  8.36s/it]
  3%|▎         | 1093/37963 [2:28:21<83:04:38,  8.11s/it]
  3%|▎         | 1094/37963 [2:28:29<81:16:38,  7.94s/it]
  3%|▎         | 1095/37963 [2:28:36<80:09:26,  7.83s/it]
  3%|▎         | 1096/37963 [2:28:46<86:53:15,  8.48s/it]
  3%|▎         | 1097/37963 [2:28:54<84:53:44,  8.29s/it]
  3%|▎         | 1098/37963 [2:29:02<82:25:40,  8.05s/it]
  3%|▎         | 1099/37963 [2:29:12<88:18:09,  8.62s/it]
  3%|▎         | 1100/37963 [2:29:20<85:55:27,  8.39s/it]
                                                         
{'loss': '0.1911', 'grad_norm': '3.994', 'learning_rate': '1.93e-05', 'epoch': '0.02898'}
+
  3%|▎         | 1100/37963 [2:29:20<85:55:27,  8.39s/it]
  3%|▎         | 1101/37963 [2:29:27<83:40:24,  8.17s/it]
  3%|▎         | 1102/37963 [2:29:35<81:54:15,  8.00s/it]
  3%|▎         | 1103/37963 [2:29:43<81:25:29,  7.95s/it]
  3%|▎         | 1104/37963 [2:29:50<80:51:51,  7.90s/it]
  3%|▎         | 1105/37963 [2:29:58<79:43:07,  7.79s/it]
  3%|▎         | 1106/37963 [2:30:05<78:55:54,  7.71s/it]
  3%|▎         | 1107/37963 [2:30:13<78:37:06,  7.68s/it]
  3%|▎         | 1108/37963 [2:30:23<86:30:11,  8.45s/it]
  3%|▎         | 1109/37963 [2:30:33<91:29:29,  8.94s/it]
  3%|▎         | 1110/37963 [2:30:41<86:50:11,  8.48s/it]
                                                         
{'loss': '0.2081', 'grad_norm': '3.579', 'learning_rate': '1.947e-05', 'epoch': '0.02924'}
+
  3%|▎         | 1110/37963 [2:30:41<86:50:11,  8.48s/it]
  3%|▎         | 1111/37963 [2:30:49<85:33:10,  8.36s/it]
  3%|▎         | 1112/37963 [2:30:56<82:58:23,  8.11s/it]
  3%|▎         | 1113/37963 [2:31:04<81:55:07,  8.00s/it]
  3%|▎         | 1114/37963 [2:31:12<81:22:50,  7.95s/it]
  3%|▎         | 1115/37963 [2:31:20<80:55:26,  7.91s/it]
  3%|▎         | 1116/37963 [2:31:30<88:09:34,  8.61s/it]
  3%|▎         | 1117/37963 [2:31:38<85:45:31,  8.38s/it]
  3%|▎         | 1118/37963 [2:31:45<83:06:32,  8.12s/it]
  3%|▎         | 1119/37963 [2:31:53<82:29:42,  8.06s/it]
  3%|▎         | 1120/37963 [2:32:01<81:30:25,  7.96s/it]
                                                         
{'loss': '0.188', 'grad_norm': '8.661', 'learning_rate': '1.965e-05', 'epoch': '0.0295'}
+
  3%|▎         | 1120/37963 [2:32:01<81:30:25,  7.96s/it]
  3%|▎         | 1121/37963 [2:32:09<81:04:44,  7.92s/it]
  3%|▎         | 1122/37963 [2:32:17<80:54:10,  7.91s/it]
  3%|▎         | 1123/37963 [2:32:24<80:04:10,  7.82s/it]
  3%|▎         | 1124/37963 [2:32:32<79:36:00,  7.78s/it]
  3%|▎         | 1125/37963 [2:32:40<78:57:20,  7.72s/it]
  3%|▎         | 1126/37963 [2:32:47<77:36:12,  7.58s/it]
  3%|▎         | 1127/37963 [2:32:57<85:27:08,  8.35s/it]
  3%|▎         | 1128/37963 [2:33:05<83:30:02,  8.16s/it]
  3%|▎         | 1129/37963 [2:33:12<81:41:13,  7.98s/it]
  3%|▎         | 1130/37963 [2:33:20<80:54:41,  7.91s/it]
                                                         
{'loss': '0.1939', 'grad_norm': '5.08', 'learning_rate': '1.982e-05', 'epoch': '0.02977'}
+
  3%|▎         | 1130/37963 [2:33:20<80:54:41,  7.91s/it]
  3%|▎         | 1131/37963 [2:33:28<80:32:42,  7.87s/it]
  3%|▎         | 1132/37963 [2:33:38<87:03:23,  8.51s/it]
  3%|▎         | 1133/37963 [2:33:45<84:22:25,  8.25s/it]
  3%|▎         | 1134/37963 [2:33:53<82:59:47,  8.11s/it]
  3%|▎         | 1135/37963 [2:34:01<82:09:21,  8.03s/it]
  3%|▎         | 1136/37963 [2:34:09<81:14:03,  7.94s/it]
  3%|▎         | 1137/37963 [2:34:17<80:26:39,  7.86s/it]
  3%|▎         | 1138/37963 [2:34:24<79:56:46,  7.82s/it]
  3%|▎         | 1139/37963 [2:34:32<79:31:35,  7.77s/it]
  3%|▎         | 1140/37963 [2:34:42<86:56:54,  8.50s/it]
                                                         
{'loss': '0.1994', 'grad_norm': '2.984', 'learning_rate': '2e-05', 'epoch': '0.03003'}
+
  3%|▎         | 1140/37963 [2:34:42<86:56:54,  8.50s/it]
  3%|▎         | 1141/37963 [2:34:52<92:40:24,  9.06s/it]
  3%|▎         | 1142/37963 [2:35:00<88:35:45,  8.66s/it]
  3%|▎         | 1143/37963 [2:35:08<85:23:24,  8.35s/it]
  3%|▎         | 1144/37963 [2:35:15<82:53:37,  8.10s/it]
  3%|▎         | 1145/37963 [2:35:23<80:46:40,  7.90s/it]
  3%|▎         | 1146/37963 [2:35:31<80:39:22,  7.89s/it]
  3%|▎         | 1147/37963 [2:35:38<79:28:53,  7.77s/it]
  3%|▎         | 1148/37963 [2:35:49<87:59:16,  8.60s/it]
  3%|▎         | 1149/37963 [2:35:56<84:28:38,  8.26s/it]
  3%|▎         | 1150/37963 [2:36:04<82:10:45,  8.04s/it]
                                                         
{'loss': '0.1987', 'grad_norm': '8.437', 'learning_rate': '2e-05', 'epoch': '0.03029'}
+
  3%|▎         | 1150/37963 [2:36:04<82:10:45,  8.04s/it]
  3%|▎         | 1151/37963 [2:36:14<88:40:19,  8.67s/it]
  3%|▎         | 1152/37963 [2:36:21<84:31:52,  8.27s/it]
  3%|▎         | 1153/37963 [2:36:31<90:21:33,  8.84s/it]
  3%|▎         | 1154/37963 [2:36:39<85:35:16,  8.37s/it]
  3%|▎         | 1155/37963 [2:36:47<84:19:09,  8.25s/it]
  3%|▎         | 1156/37963 [2:36:54<81:26:27,  7.97s/it]
  3%|▎         | 1157/37963 [2:37:01<79:45:56,  7.80s/it]
  3%|▎         | 1158/37963 [2:37:09<80:06:17,  7.84s/it]
  3%|▎         | 1159/37963 [2:37:16<78:13:28,  7.65s/it]
  3%|▎         | 1160/37963 [2:37:26<85:31:37,  8.37s/it]
                                                         
{'loss': '0.187', 'grad_norm': '5.824', 'learning_rate': '2e-05', 'epoch': '0.03056'}
+
  3%|▎         | 1160/37963 [2:37:26<85:31:37,  8.37s/it]
  3%|▎         | 1161/37963 [2:37:34<83:07:38,  8.13s/it]
  3%|▎         | 1162/37963 [2:37:41<81:05:22,  7.93s/it]
  3%|▎         | 1163/37963 [2:37:49<79:48:46,  7.81s/it]
  3%|▎         | 1164/37963 [2:37:57<79:43:22,  7.80s/it]
  3%|▎         | 1165/37963 [2:38:04<78:57:04,  7.72s/it]
  3%|▎         | 1166/37963 [2:38:12<77:31:30,  7.58s/it]
  3%|▎         | 1167/37963 [2:38:19<77:25:51,  7.58s/it]
  3%|▎         | 1168/37963 [2:38:27<77:13:52,  7.56s/it]
  3%|▎         | 1169/37963 [2:38:34<76:39:44,  7.50s/it]
  3%|▎         | 1170/37963 [2:38:41<76:31:24,  7.49s/it]
                                                         
{'loss': '0.1991', 'grad_norm': '3.485', 'learning_rate': '2e-05', 'epoch': '0.03082'}
+
  3%|▎         | 1170/37963 [2:38:41<76:31:24,  7.49s/it]
  3%|▎         | 1171/37963 [2:38:49<76:37:56,  7.50s/it]
  3%|▎         | 1172/37963 [2:38:57<77:23:57,  7.57s/it]
  3%|▎         | 1173/37963 [2:39:04<77:31:15,  7.59s/it]
  3%|▎         | 1174/37963 [2:39:12<77:33:00,  7.59s/it]
  3%|▎         | 1175/37963 [2:39:19<77:21:16,  7.57s/it]
  3%|▎         | 1176/37963 [2:39:27<78:05:40,  7.64s/it]
  3%|▎         | 1177/37963 [2:39:35<78:20:39,  7.67s/it]
  3%|▎         | 1178/37963 [2:39:43<78:24:01,  7.67s/it]
  3%|▎         | 1179/37963 [2:39:51<78:45:57,  7.71s/it]
  3%|▎         | 1180/37963 [2:39:58<78:04:50,  7.64s/it]
                                                         
{'loss': '0.1874', 'grad_norm': '5.495', 'learning_rate': '2e-05', 'epoch': '0.03108'}
+
  3%|▎         | 1180/37963 [2:39:58<78:04:50,  7.64s/it]
  3%|▎         | 1181/37963 [2:40:08<86:00:51,  8.42s/it]
  3%|▎         | 1182/37963 [2:40:16<83:58:49,  8.22s/it]
  3%|▎         | 1183/37963 [2:40:24<82:15:15,  8.05s/it]
  3%|▎         | 1184/37963 [2:40:31<79:58:51,  7.83s/it]
  3%|▎         | 1185/37963 [2:40:41<87:14:16,  8.54s/it]
  3%|▎         | 1186/37963 [2:40:51<92:17:36,  9.03s/it]
  3%|▎         | 1187/37963 [2:40:59<87:56:12,  8.61s/it]
  3%|▎         | 1188/37963 [2:41:07<84:57:19,  8.32s/it]
  3%|▎         | 1189/37963 [2:41:14<83:20:29,  8.16s/it]
  3%|▎         | 1190/37963 [2:41:22<82:06:49,  8.04s/it]
                                                         
{'loss': '0.1981', 'grad_norm': '8.124', 'learning_rate': '2e-05', 'epoch': '0.03135'}
+
  3%|▎         | 1190/37963 [2:41:22<82:06:49,  8.04s/it]
  3%|▎         | 1191/37963 [2:41:30<80:12:04,  7.85s/it]
  3%|▎         | 1192/37963 [2:41:37<80:00:06,  7.83s/it]
  3%|▎         | 1193/37963 [2:41:45<79:19:44,  7.77s/it]
  3%|▎         | 1194/37963 [2:41:55<86:27:42,  8.47s/it]
  3%|▎         | 1195/37963 [2:42:03<83:52:02,  8.21s/it]
  3%|▎         | 1196/37963 [2:42:12<88:23:18,  8.65s/it]
  3%|▎         | 1197/37963 [2:42:20<85:24:43,  8.36s/it]
  3%|▎         | 1198/37963 [2:42:30<91:32:57,  8.96s/it]
  3%|▎         | 1199/37963 [2:42:38<87:10:00,  8.54s/it]
  3%|▎         | 1200/37963 [2:42:45<83:53:00,  8.21s/it]
                                                         
{'loss': '0.185', 'grad_norm': '5.617', 'learning_rate': '2e-05', 'epoch': '0.03161'}
+
  3%|▎         | 1200/37963 [2:42:45<83:53:00,  8.21s/it]
  3%|▎         | 1201/37963 [2:42:53<82:24:24,  8.07s/it]
  3%|▎         | 1202/37963 [2:43:01<80:51:13,  7.92s/it]
  3%|▎         | 1203/37963 [2:43:11<87:58:23,  8.62s/it]
  3%|▎         | 1204/37963 [2:43:18<84:38:49,  8.29s/it]
  3%|▎         | 1205/37963 [2:43:29<90:03:31,  8.82s/it]
  3%|▎         | 1206/37963 [2:43:36<86:51:25,  8.51s/it]
  3%|▎         | 1207/37963 [2:43:44<83:55:12,  8.22s/it]
  3%|▎         | 1208/37963 [2:43:51<82:10:56,  8.05s/it]
  3%|▎         | 1209/37963 [2:43:59<81:03:38,  7.94s/it]
  3%|▎         | 1210/37963 [2:44:07<80:28:13,  7.88s/it]
                                                         
{'loss': '0.19', 'grad_norm': '12.93', 'learning_rate': '2e-05', 'epoch': '0.03187'}
+
  3%|▎         | 1210/37963 [2:44:07<80:28:13,  7.88s/it]
  3%|▎         | 1211/37963 [2:44:15<79:56:37,  7.83s/it]
  3%|▎         | 1212/37963 [2:44:22<79:10:47,  7.76s/it]
  3%|▎         | 1213/37963 [2:44:30<78:26:01,  7.68s/it]
  3%|▎         | 1214/37963 [2:44:37<78:02:02,  7.64s/it]
  3%|▎         | 1215/37963 [2:44:45<77:36:11,  7.60s/it]
  3%|▎         | 1216/37963 [2:44:53<78:03:37,  7.65s/it]
  3%|▎         | 1217/37963 [2:45:00<78:09:33,  7.66s/it]
  3%|▎         | 1218/37963 [2:45:08<78:27:48,  7.69s/it]
  3%|▎         | 1219/37963 [2:45:16<78:25:17,  7.68s/it]
  3%|▎         | 1220/37963 [2:45:23<78:05:14,  7.65s/it]
                                                         
{'loss': '0.2039', 'grad_norm': '7.84', 'learning_rate': '2e-05', 'epoch': '0.03214'}
+
  3%|▎         | 1220/37963 [2:45:23<78:05:14,  7.65s/it]
  3%|▎         | 1221/37963 [2:45:31<78:07:37,  7.65s/it]
  3%|▎         | 1222/37963 [2:45:39<78:15:32,  7.67s/it]
  3%|▎         | 1223/37963 [2:45:46<77:44:40,  7.62s/it]
  3%|▎         | 1224/37963 [2:45:54<77:57:05,  7.64s/it]
  3%|▎         | 1225/37963 [2:46:04<85:37:20,  8.39s/it]
  3%|▎         | 1226/37963 [2:46:11<82:58:37,  8.13s/it]
  3%|▎         | 1227/37963 [2:46:19<81:35:47,  8.00s/it]
  3%|▎         | 1228/37963 [2:46:30<88:52:31,  8.71s/it]
  3%|▎         | 1229/37963 [2:46:37<86:38:19,  8.49s/it]
  3%|▎         | 1230/37963 [2:46:45<83:51:42,  8.22s/it]
                                                         
{'loss': '0.2171', 'grad_norm': '8.025', 'learning_rate': '2e-05', 'epoch': '0.0324'}
+
  3%|▎         | 1230/37963 [2:46:45<83:51:42,  8.22s/it]
  3%|▎         | 1231/37963 [2:46:53<82:53:02,  8.12s/it]
  3%|▎         | 1232/37963 [2:47:01<81:18:57,  7.97s/it]
  3%|▎         | 1233/37963 [2:47:08<79:03:11,  7.75s/it]
  3%|▎         | 1234/37963 [2:47:16<79:59:08,  7.84s/it]
  3%|▎         | 1235/37963 [2:47:23<78:44:29,  7.72s/it]
  3%|▎         | 1236/37963 [2:47:31<78:33:25,  7.70s/it]
  3%|▎         | 1237/37963 [2:47:39<78:13:52,  7.67s/it]
  3%|▎         | 1238/37963 [2:47:46<78:12:01,  7.67s/it]
  3%|▎         | 1239/37963 [2:47:54<78:25:28,  7.69s/it]
  3%|▎         | 1240/37963 [2:48:07<93:27:22,  9.16s/it]
                                                         
{'loss': '0.2119', 'grad_norm': '12.38', 'learning_rate': '2e-05', 'epoch': '0.03266'}
+
  3%|▎         | 1240/37963 [2:48:07<93:27:22,  9.16s/it]
  3%|▎         | 1241/37963 [2:48:14<89:28:01,  8.77s/it]
  3%|▎         | 1242/37963 [2:48:22<86:14:11,  8.45s/it]
  3%|▎         | 1243/37963 [2:48:30<83:30:00,  8.19s/it]
  3%|▎         | 1244/37963 [2:48:37<80:42:56,  7.91s/it]
  3%|▎         | 1245/37963 [2:48:45<79:37:41,  7.81s/it]
  3%|▎         | 1246/37963 [2:48:55<87:05:52,  8.54s/it]
  3%|▎         | 1247/37963 [2:49:02<84:10:02,  8.25s/it]
  3%|▎         | 1248/37963 [2:49:10<82:36:03,  8.10s/it]
  3%|▎         | 1249/37963 [2:49:20<89:13:28,  8.75s/it]
  3%|▎         | 1250/37963 [2:49:28<85:36:39,  8.39s/it]
                                                         
{'loss': '0.1975', 'grad_norm': '4.594', 'learning_rate': '2e-05', 'epoch': '0.03293'}
+
  3%|▎         | 1250/37963 [2:49:28<85:36:39,  8.39s/it]
  3%|▎         | 1251/37963 [2:49:38<91:16:11,  8.95s/it]
  3%|▎         | 1252/37963 [2:49:45<86:14:11,  8.46s/it]
  3%|▎         | 1253/37963 [2:49:53<83:27:51,  8.19s/it]
  3%|▎         | 1254/37963 [2:50:01<82:11:03,  8.06s/it]
  3%|▎         | 1255/37963 [2:50:08<80:49:08,  7.93s/it]
  3%|▎         | 1256/37963 [2:50:16<80:15:58,  7.87s/it]
  3%|▎         | 1257/37963 [2:50:24<79:48:20,  7.83s/it]
  3%|▎         | 1258/37963 [2:50:31<79:01:55,  7.75s/it]
  3%|▎         | 1259/37963 [2:50:42<86:11:59,  8.45s/it]
  3%|▎         | 1260/37963 [2:50:49<84:10:46,  8.26s/it]
                                                         
{'loss': '0.2035', 'grad_norm': '4.265', 'learning_rate': '2e-05', 'epoch': '0.03319'}
+
  3%|▎         | 1260/37963 [2:50:49<84:10:46,  8.26s/it]
  3%|▎         | 1261/37963 [2:50:57<82:09:40,  8.06s/it]
  3%|▎         | 1262/37963 [2:51:04<80:21:26,  7.88s/it]
  3%|▎         | 1263/37963 [2:51:12<79:46:35,  7.83s/it]
  3%|▎         | 1264/37963 [2:51:20<79:04:18,  7.76s/it]
  3%|▎         | 1265/37963 [2:51:27<79:01:23,  7.75s/it]
  3%|▎         | 1266/37963 [2:51:35<79:23:46,  7.79s/it]
  3%|▎         | 1267/37963 [2:51:43<77:52:28,  7.64s/it]
  3%|▎         | 1268/37963 [2:51:50<78:31:26,  7.70s/it]
  3%|▎         | 1269/37963 [2:51:58<77:50:52,  7.64s/it]
  3%|▎         | 1270/37963 [2:52:06<78:23:14,  7.69s/it]
                                                         
{'loss': '0.202', 'grad_norm': '1.971', 'learning_rate': '2e-05', 'epoch': '0.03345'}
+
  3%|▎         | 1270/37963 [2:52:06<78:23:14,  7.69s/it]
  3%|▎         | 1271/37963 [2:52:13<77:57:27,  7.65s/it]
  3%|▎         | 1272/37963 [2:52:21<77:56:08,  7.65s/it]
  3%|▎         | 1273/37963 [2:52:29<78:06:24,  7.66s/it]
  3%|▎         | 1274/37963 [2:52:36<78:02:32,  7.66s/it]
  3%|▎         | 1275/37963 [2:52:44<78:13:30,  7.68s/it]
  3%|▎         | 1276/37963 [2:52:52<78:03:46,  7.66s/it]
  3%|▎         | 1277/37963 [2:53:02<85:56:38,  8.43s/it]
  3%|▎         | 1278/37963 [2:53:10<83:59:07,  8.24s/it]
  3%|▎         | 1279/37963 [2:53:17<81:03:17,  7.95s/it]
  3%|▎         | 1280/37963 [2:53:27<88:07:07,  8.65s/it]
                                                         
{'loss': '0.1879', 'grad_norm': '2.558', 'learning_rate': '2e-05', 'epoch': '0.03372'}
+
  3%|▎         | 1280/37963 [2:53:27<88:07:07,  8.65s/it]
  3%|▎         | 1281/37963 [2:53:35<85:56:41,  8.43s/it]
  3%|▎         | 1282/37963 [2:53:43<84:09:12,  8.26s/it]
  3%|▎         | 1283/37963 [2:53:51<82:23:11,  8.09s/it]
  3%|▎         | 1284/37963 [2:53:58<80:34:23,  7.91s/it]
  3%|▎         | 1285/37963 [2:54:06<79:19:21,  7.79s/it]
  3%|▎         | 1286/37963 [2:54:14<79:35:51,  7.81s/it]
  3%|▎         | 1287/37963 [2:54:21<79:47:18,  7.83s/it]
  3%|▎         | 1288/37963 [2:54:31<86:19:07,  8.47s/it]
  3%|▎         | 1289/37963 [2:54:39<83:38:35,  8.21s/it]
  3%|▎         | 1290/37963 [2:54:47<81:36:42,  8.01s/it]
                                                         
{'loss': '0.2096', 'grad_norm': '3.236', 'learning_rate': '2e-05', 'epoch': '0.03398'}
+
  3%|▎         | 1290/37963 [2:54:47<81:36:42,  8.01s/it]
  3%|▎         | 1291/37963 [2:54:54<81:05:39,  7.96s/it]
  3%|▎         | 1292/37963 [2:55:05<87:51:40,  8.63s/it]
  3%|▎         | 1293/37963 [2:55:12<84:50:50,  8.33s/it]
  3%|▎         | 1294/37963 [2:55:25<98:03:57,  9.63s/it]
  3%|▎         | 1295/37963 [2:55:33<92:18:54,  9.06s/it]
  3%|▎         | 1296/37963 [2:55:40<86:40:09,  8.51s/it]
  3%|▎         | 1297/37963 [2:55:47<83:33:57,  8.20s/it]
  3%|▎         | 1298/37963 [2:55:55<81:05:34,  7.96s/it]
  3%|▎         | 1299/37963 [2:56:03<80:45:15,  7.93s/it]
  3%|▎         | 1300/37963 [2:56:13<87:25:26,  8.58s/it]
                                                         
{'loss': '0.1935', 'grad_norm': '4.583', 'learning_rate': '2e-05', 'epoch': '0.03424'}
+
  3%|▎         | 1300/37963 [2:56:13<87:25:26,  8.58s/it]
  3%|▎         | 1301/37963 [2:56:21<85:02:48,  8.35s/it]
  3%|▎         | 1302/37963 [2:56:28<82:44:32,  8.13s/it]
  3%|▎         | 1303/37963 [2:56:38<89:17:22,  8.77s/it]
  3%|▎         | 1304/37963 [2:56:46<85:25:38,  8.39s/it]
  3%|▎         | 1305/37963 [2:56:53<82:46:52,  8.13s/it]
  3%|▎         | 1306/37963 [2:57:01<81:56:52,  8.05s/it]
  3%|▎         | 1307/37963 [2:57:09<80:30:04,  7.91s/it]
  3%|▎         | 1308/37963 [2:57:16<79:30:12,  7.81s/it]
  3%|▎         | 1309/37963 [2:57:24<78:34:58,  7.72s/it]
  3%|▎         | 1310/37963 [2:57:31<77:28:16,  7.61s/it]
                                                         
{'loss': '0.2021', 'grad_norm': '8.891', 'learning_rate': '2e-05', 'epoch': '0.03451'}
+
  3%|▎         | 1310/37963 [2:57:31<77:28:16,  7.61s/it]
  3%|▎         | 1311/37963 [2:57:39<78:10:37,  7.68s/it]
  3%|▎         | 1312/37963 [2:57:47<79:03:13,  7.76s/it]
  3%|▎         | 1313/37963 [2:57:55<78:33:04,  7.72s/it]
  3%|▎         | 1314/37963 [2:58:02<78:31:45,  7.71s/it]
  3%|▎         | 1315/37963 [2:58:10<78:18:54,  7.69s/it]
  3%|▎         | 1316/37963 [2:58:18<77:59:56,  7.66s/it]
  3%|▎         | 1317/37963 [2:58:25<77:18:35,  7.59s/it]
  3%|▎         | 1318/37963 [2:58:33<77:58:45,  7.66s/it]
  3%|▎         | 1319/37963 [2:58:41<78:06:59,  7.67s/it]
  3%|▎         | 1320/37963 [2:58:48<77:03:48,  7.57s/it]
                                                         
{'loss': '0.1925', 'grad_norm': '2.375', 'learning_rate': '2e-05', 'epoch': '0.03477'}
+
  3%|▎         | 1320/37963 [2:58:48<77:03:48,  7.57s/it]
  3%|▎         | 1321/37963 [2:58:55<76:53:24,  7.55s/it]
  3%|▎         | 1322/37963 [2:59:03<76:57:11,  7.56s/it]
  3%|▎         | 1323/37963 [2:59:10<76:22:55,  7.50s/it]
  3%|▎         | 1324/37963 [2:59:18<76:24:54,  7.51s/it]
  3%|▎         | 1325/37963 [2:59:28<84:26:22,  8.30s/it]
  3%|▎         | 1326/37963 [2:59:36<82:34:26,  8.11s/it]
  3%|▎         | 1327/37963 [2:59:43<81:22:54,  8.00s/it]
  3%|▎         | 1328/37963 [2:59:53<86:57:27,  8.55s/it]
  4%|▎         | 1329/37963 [3:00:00<82:51:24,  8.14s/it]
  4%|▎         | 1330/37963 [3:00:08<80:53:08,  7.95s/it]
                                                         
{'loss': '0.1924', 'grad_norm': '2.338', 'learning_rate': '2e-05', 'epoch': '0.03503'}
+
  4%|▎         | 1330/37963 [3:00:08<80:53:08,  7.95s/it]
  4%|▎         | 1331/37963 [3:00:15<79:36:16,  7.82s/it]
  4%|▎         | 1332/37963 [3:00:23<77:57:55,  7.66s/it]
  4%|▎         | 1333/37963 [3:00:30<77:44:10,  7.64s/it]
  4%|▎         | 1334/37963 [3:00:38<77:39:41,  7.63s/it]
  4%|▎         | 1335/37963 [3:00:46<77:58:57,  7.66s/it]
  4%|▎         | 1336/37963 [3:00:53<77:38:49,  7.63s/it]
  4%|▎         | 1337/37963 [3:01:01<77:17:43,  7.60s/it]
  4%|▎         | 1338/37963 [3:01:11<84:57:44,  8.35s/it]
  4%|▎         | 1339/37963 [3:01:19<83:07:26,  8.17s/it]
  4%|▎         | 1340/37963 [3:01:26<82:00:36,  8.06s/it]
                                                         
{'loss': '0.1988', 'grad_norm': '4.02', 'learning_rate': '2e-05', 'epoch': '0.0353'}
+
  4%|▎         | 1340/37963 [3:01:26<82:00:36,  8.06s/it]
  4%|▎         | 1341/37963 [3:01:36<87:55:42,  8.64s/it]
  4%|▎         | 1342/37963 [3:01:49<100:51:26,  9.91s/it]
  4%|▎         | 1343/37963 [3:01:57<93:26:18,  9.19s/it] 
  4%|▎         | 1344/37963 [3:02:05<89:05:09,  8.76s/it]
  4%|▎         | 1345/37963 [3:02:12<86:23:40,  8.49s/it]
  4%|▎         | 1346/37963 [3:02:23<91:27:31,  8.99s/it]
  4%|▎         | 1347/37963 [3:02:30<87:21:48,  8.59s/it]
  4%|▎         | 1348/37963 [3:02:41<92:29:23,  9.09s/it]
  4%|▎         | 1349/37963 [3:02:48<88:22:07,  8.69s/it]
  4%|▎         | 1350/37963 [3:02:56<84:23:45,  8.30s/it]
                                                         
{'loss': '0.2087', 'grad_norm': '4.781', 'learning_rate': '2e-05', 'epoch': '0.03556'}
+
  4%|▎         | 1350/37963 [3:02:56<84:23:45,  8.30s/it]
  4%|▎         | 1351/37963 [3:03:04<83:01:12,  8.16s/it]
  4%|▎         | 1352/37963 [3:03:11<81:32:48,  8.02s/it]
  4%|▎         | 1353/37963 [3:03:19<80:40:12,  7.93s/it]
  4%|▎         | 1354/37963 [3:03:27<80:29:42,  7.92s/it]
  4%|▎         | 1355/37963 [3:03:35<79:51:52,  7.85s/it]
  4%|▎         | 1356/37963 [3:03:42<78:54:44,  7.76s/it]
  4%|▎         | 1357/37963 [3:03:50<78:38:23,  7.73s/it]
  4%|▎         | 1358/37963 [3:03:57<78:25:08,  7.71s/it]
  4%|▎         | 1359/37963 [3:04:05<78:49:25,  7.75s/it]
  4%|▎         | 1360/37963 [3:04:13<78:20:55,  7.71s/it]
                                                         
{'loss': '0.1963', 'grad_norm': '10.17', 'learning_rate': '2e-05', 'epoch': '0.03582'}
+
  4%|▎         | 1360/37963 [3:04:13<78:20:55,  7.71s/it]
  4%|▎         | 1361/37963 [3:04:20<78:04:57,  7.68s/it]
  4%|▎         | 1362/37963 [3:04:28<78:14:43,  7.70s/it]
  4%|▎         | 1363/37963 [3:04:36<78:22:45,  7.71s/it]
  4%|▎         | 1364/37963 [3:04:43<77:47:11,  7.65s/it]
  4%|▎         | 1365/37963 [3:04:51<77:42:12,  7.64s/it]
  4%|▎         | 1366/37963 [3:04:59<77:16:17,  7.60s/it]
  4%|▎         | 1367/37963 [3:05:07<78:24:24,  7.71s/it]
  4%|▎         | 1368/37963 [3:05:17<85:39:02,  8.43s/it]
  4%|▎         | 1369/37963 [3:05:24<82:58:32,  8.16s/it]
  4%|▎         | 1370/37963 [3:05:32<81:38:21,  8.03s/it]
                                                         
{'loss': '0.1948', 'grad_norm': '5.859', 'learning_rate': '2e-05', 'epoch': '0.03609'}
+
  4%|▎         | 1370/37963 [3:05:32<81:38:21,  8.03s/it]
  4%|▎         | 1371/37963 [3:05:40<80:46:43,  7.95s/it]
  4%|▎         | 1372/37963 [3:05:47<79:31:31,  7.82s/it]
  4%|▎         | 1373/37963 [3:05:55<79:26:48,  7.82s/it]
  4%|▎         | 1374/37963 [3:06:03<79:10:13,  7.79s/it]
  4%|▎         | 1375/37963 [3:06:10<78:58:03,  7.77s/it]
  4%|▎         | 1376/37963 [3:06:18<78:09:39,  7.69s/it]
  4%|▎         | 1377/37963 [3:06:26<77:50:26,  7.66s/it]
  4%|▎         | 1378/37963 [3:06:33<77:51:40,  7.66s/it]
  4%|▎         | 1379/37963 [3:06:41<77:28:09,  7.62s/it]
  4%|▎         | 1380/37963 [3:06:48<77:32:59,  7.63s/it]
                                                         
{'loss': '0.1912', 'grad_norm': '4.283', 'learning_rate': '2e-05', 'epoch': '0.03635'}
+
  4%|▎         | 1380/37963 [3:06:48<77:32:59,  7.63s/it]
  4%|▎         | 1381/37963 [3:06:59<85:49:46,  8.45s/it]
  4%|▎         | 1382/37963 [3:07:06<83:04:49,  8.18s/it]
  4%|▎         | 1383/37963 [3:07:14<81:33:33,  8.03s/it]
  4%|▎         | 1384/37963 [3:07:22<80:17:59,  7.90s/it]
  4%|▎         | 1385/37963 [3:07:34<93:46:25,  9.23s/it]
  4%|▎         | 1386/37963 [3:07:42<89:10:45,  8.78s/it]
  4%|▎         | 1387/37963 [3:07:52<93:47:12,  9.23s/it]
  4%|▎         | 1388/37963 [3:08:00<88:47:26,  8.74s/it]
  4%|▎         | 1389/37963 [3:08:10<93:49:28,  9.24s/it]
  4%|▎         | 1390/37963 [3:08:20<97:09:38,  9.56s/it]
                                                         
{'loss': '0.187', 'grad_norm': '3.015', 'learning_rate': '2e-05', 'epoch': '0.03661'}
+
  4%|▎         | 1390/37963 [3:08:20<97:09:38,  9.56s/it]
  4%|▎         | 1391/37963 [3:08:28<90:53:21,  8.95s/it]
  4%|▎         | 1392/37963 [3:08:38<94:38:09,  9.32s/it]
  4%|▎         | 1393/37963 [3:08:46<90:15:03,  8.88s/it]
  4%|▎         | 1394/37963 [3:08:53<86:06:01,  8.48s/it]
  4%|▎         | 1395/37963 [3:09:01<83:15:26,  8.20s/it]
  4%|▎         | 1396/37963 [3:09:08<81:10:48,  7.99s/it]
  4%|▎         | 1397/37963 [3:09:16<80:24:57,  7.92s/it]
  4%|▎         | 1398/37963 [3:09:23<78:30:38,  7.73s/it]
  4%|▎         | 1399/37963 [3:09:31<78:09:03,  7.69s/it]
  4%|▎         | 1400/37963 [3:09:39<78:23:15,  7.72s/it]
                                                         
{'loss': '0.1804', 'grad_norm': '3.736', 'learning_rate': '2e-05', 'epoch': '0.03688'}
+
  4%|▎         | 1400/37963 [3:09:39<78:23:15,  7.72s/it]
  4%|▎         | 1401/37963 [3:09:46<78:05:11,  7.69s/it]
  4%|▎         | 1402/37963 [3:09:54<78:48:44,  7.76s/it]
  4%|▎         | 1403/37963 [3:10:02<79:15:15,  7.80s/it]
  4%|▎         | 1404/37963 [3:10:10<78:56:29,  7.77s/it]
  4%|▎         | 1405/37963 [3:10:18<78:39:15,  7.75s/it]
  4%|▎         | 1406/37963 [3:10:25<77:11:20,  7.60s/it]
  4%|▎         | 1407/37963 [3:10:32<77:02:05,  7.59s/it]
  4%|▎         | 1408/37963 [3:10:40<77:19:33,  7.62s/it]
  4%|▎         | 1409/37963 [3:10:48<76:53:43,  7.57s/it]
  4%|▎         | 1410/37963 [3:10:55<76:34:59,  7.54s/it]
                                                         
{'loss': '0.1896', 'grad_norm': '4.767', 'learning_rate': '2e-05', 'epoch': '0.03714'}
+
  4%|▎         | 1410/37963 [3:10:55<76:34:59,  7.54s/it]
  4%|▎         | 1411/37963 [3:11:02<75:55:20,  7.48s/it]
  4%|▎         | 1412/37963 [3:11:13<84:19:32,  8.31s/it]
  4%|▎         | 1413/37963 [3:11:20<81:49:51,  8.06s/it]
  4%|▎         | 1414/37963 [3:11:27<79:17:26,  7.81s/it]
  4%|▎         | 1415/37963 [3:11:35<77:46:03,  7.66s/it]
  4%|▎         | 1416/37963 [3:11:42<77:56:03,  7.68s/it]
  4%|▎         | 1417/37963 [3:11:50<77:26:37,  7.63s/it]
  4%|▎         | 1418/37963 [3:11:58<77:32:11,  7.64s/it]
  4%|▎         | 1419/37963 [3:12:05<77:30:51,  7.64s/it]
  4%|▎         | 1420/37963 [3:12:13<77:32:25,  7.64s/it]
                                                         
{'loss': '0.206', 'grad_norm': '2.449', 'learning_rate': '2e-05', 'epoch': '0.0374'}
+
  4%|▎         | 1420/37963 [3:12:13<77:32:25,  7.64s/it]
  4%|▎         | 1421/37963 [3:12:20<77:31:40,  7.64s/it]
  4%|▎         | 1422/37963 [3:12:28<77:37:00,  7.65s/it]
  4%|▎         | 1423/37963 [3:12:36<77:22:59,  7.62s/it]
  4%|▍         | 1424/37963 [3:12:43<77:44:24,  7.66s/it]
  4%|▍         | 1425/37963 [3:12:51<77:18:24,  7.62s/it]
  4%|▍         | 1426/37963 [3:12:58<76:55:40,  7.58s/it]
  4%|▍         | 1427/37963 [3:13:06<77:45:40,  7.66s/it]
  4%|▍         | 1428/37963 [3:13:14<77:15:21,  7.61s/it]
  4%|▍         | 1429/37963 [3:13:21<77:14:32,  7.61s/it]
  4%|▍         | 1430/37963 [3:13:32<85:04:59,  8.38s/it]
                                                         
{'loss': '0.1883', 'grad_norm': '3.979', 'learning_rate': '2e-05', 'epoch': '0.03767'}
+
  4%|▍         | 1430/37963 [3:13:32<85:04:59,  8.38s/it]
  4%|▍         | 1431/37963 [3:13:42<90:06:32,  8.88s/it]
  4%|▍         | 1432/37963 [3:13:49<86:37:42,  8.54s/it]
  4%|▍         | 1433/37963 [3:14:02<99:14:58,  9.78s/it]
  4%|▍         | 1434/37963 [3:14:10<92:50:43,  9.15s/it]
  4%|▍         | 1435/37963 [3:14:22<103:24:43, 10.19s/it]
  4%|▍         | 1436/37963 [3:14:30<96:29:55,  9.51s/it] 
  4%|▍         | 1437/37963 [3:14:38<90:32:44,  8.92s/it]
  4%|▍         | 1438/37963 [3:14:48<94:53:10,  9.35s/it]
  4%|▍         | 1439/37963 [3:14:56<89:48:29,  8.85s/it]
  4%|▍         | 1440/37963 [3:15:03<85:32:10,  8.43s/it]
                                                         
{'loss': '0.1819', 'grad_norm': '6.329', 'learning_rate': '2e-05', 'epoch': '0.03793'}
+
  4%|▍         | 1440/37963 [3:15:03<85:32:10,  8.43s/it]
  4%|▍         | 1441/37963 [3:15:11<83:17:21,  8.21s/it]
  4%|▍         | 1442/37963 [3:15:19<81:54:47,  8.07s/it]
  4%|▍         | 1443/37963 [3:15:26<80:31:27,  7.94s/it]
  4%|▍         | 1444/37963 [3:15:34<80:20:59,  7.92s/it]
  4%|▍         | 1445/37963 [3:15:42<78:18:28,  7.72s/it]
  4%|▍         | 1446/37963 [3:15:49<78:45:57,  7.77s/it]
  4%|▍         | 1447/37963 [3:15:57<78:12:14,  7.71s/it]
  4%|▍         | 1448/37963 [3:16:05<78:30:05,  7.74s/it]
  4%|▍         | 1449/37963 [3:16:13<79:01:47,  7.79s/it]
  4%|▍         | 1450/37963 [3:16:20<78:14:23,  7.71s/it]
                                                         
{'loss': '0.2031', 'grad_norm': '3.333', 'learning_rate': '2e-05', 'epoch': '0.0382'}
+
  4%|▍         | 1450/37963 [3:16:20<78:14:23,  7.71s/it]
  4%|▍         | 1451/37963 [3:16:28<77:39:31,  7.66s/it]
  4%|▍         | 1452/37963 [3:16:36<78:11:19,  7.71s/it]
  4%|▍         | 1453/37963 [3:16:43<77:10:57,  7.61s/it]
  4%|▍         | 1454/37963 [3:16:51<77:31:26,  7.64s/it]
  4%|▍         | 1455/37963 [3:16:58<77:46:19,  7.67s/it]
  4%|▍         | 1456/37963 [3:17:06<77:15:36,  7.62s/it]
  4%|▍         | 1457/37963 [3:17:13<77:05:28,  7.60s/it]
  4%|▍         | 1458/37963 [3:17:21<77:39:30,  7.66s/it]
  4%|▍         | 1459/37963 [3:17:29<77:44:22,  7.67s/it]
  4%|▍         | 1460/37963 [3:17:37<78:18:47,  7.72s/it]
                                                         
{'loss': '0.1943', 'grad_norm': '4.432', 'learning_rate': '2e-05', 'epoch': '0.03846'}
+
  4%|▍         | 1460/37963 [3:17:37<78:18:47,  7.72s/it]
  4%|▍         | 1461/37963 [3:17:45<78:26:19,  7.74s/it]
  4%|▍         | 1462/37963 [3:17:54<84:55:10,  8.38s/it]
  4%|▍         | 1463/37963 [3:18:02<82:38:21,  8.15s/it]
  4%|▍         | 1464/37963 [3:18:10<81:20:36,  8.02s/it]
  4%|▍         | 1465/37963 [3:18:17<79:46:54,  7.87s/it]
  4%|▍         | 1466/37963 [3:18:25<79:05:34,  7.80s/it]
  4%|▍         | 1467/37963 [3:18:33<78:57:32,  7.79s/it]
  4%|▍         | 1468/37963 [3:18:40<78:43:04,  7.77s/it]
  4%|▍         | 1469/37963 [3:18:48<78:47:49,  7.77s/it]
  4%|▍         | 1470/37963 [3:18:56<78:38:02,  7.76s/it]
                                                         
{'loss': '0.1863', 'grad_norm': '3.509', 'learning_rate': '2e-05', 'epoch': '0.03872'}
+
  4%|▍         | 1470/37963 [3:18:56<78:38:02,  7.76s/it]
  4%|▍         | 1471/37963 [3:19:03<77:38:00,  7.66s/it]
  4%|▍         | 1472/37963 [3:19:11<77:36:13,  7.66s/it]
  4%|▍         | 1473/37963 [3:19:19<77:27:20,  7.64s/it]
  4%|▍         | 1474/37963 [3:19:29<85:40:40,  8.45s/it]
  4%|▍         | 1475/37963 [3:19:37<83:12:05,  8.21s/it]
  4%|▍         | 1476/37963 [3:19:47<88:36:33,  8.74s/it]
  4%|▍         | 1477/37963 [3:19:57<93:18:08,  9.21s/it]
  4%|▍         | 1478/37963 [3:20:05<88:32:59,  8.74s/it]
  4%|▍         | 1479/37963 [3:20:12<85:01:45,  8.39s/it]
  4%|▍         | 1480/37963 [3:20:20<82:33:33,  8.15s/it]
                                                         
{'loss': '0.1961', 'grad_norm': '4.161', 'learning_rate': '2e-05', 'epoch': '0.03899'}
+
  4%|▍         | 1480/37963 [3:20:20<82:33:33,  8.15s/it]
  4%|▍         | 1481/37963 [3:20:27<81:30:55,  8.04s/it]
  4%|▍         | 1482/37963 [3:20:35<80:00:11,  7.89s/it]
  4%|▍         | 1483/37963 [3:20:48<95:14:27,  9.40s/it]
  4%|▍         | 1484/37963 [3:20:56<90:16:06,  8.91s/it]
  4%|▍         | 1485/37963 [3:21:04<87:08:07,  8.60s/it]
  4%|▍         | 1486/37963 [3:21:14<91:39:23,  9.05s/it]
  4%|▍         | 1487/37963 [3:21:22<88:26:21,  8.73s/it]
  4%|▍         | 1488/37963 [3:21:29<85:43:33,  8.46s/it]
  4%|▍         | 1489/37963 [3:21:37<83:04:01,  8.20s/it]
  4%|▍         | 1490/37963 [3:21:45<81:37:57,  8.06s/it]
                                                         
{'loss': '0.193', 'grad_norm': '5.102', 'learning_rate': '2e-05', 'epoch': '0.03925'}
+
  4%|▍         | 1490/37963 [3:21:45<81:37:57,  8.06s/it]
  4%|▍         | 1491/37963 [3:21:53<80:43:39,  7.97s/it]
  4%|▍         | 1492/37963 [3:22:03<87:50:49,  8.67s/it]
  4%|▍         | 1493/37963 [3:22:11<84:40:39,  8.36s/it]
  4%|▍         | 1494/37963 [3:22:18<81:43:17,  8.07s/it]
  4%|▍         | 1495/37963 [3:22:26<80:30:05,  7.95s/it]
  4%|▍         | 1496/37963 [3:22:33<79:15:27,  7.82s/it]
  4%|▍         | 1497/37963 [3:22:41<79:03:47,  7.81s/it]
  4%|▍         | 1498/37963 [3:22:49<78:59:28,  7.80s/it]
  4%|▍         | 1499/37963 [3:22:56<77:59:22,  7.70s/it]
  4%|▍         | 1500/37963 [3:23:04<78:14:09,  7.72s/it]
                                                         
{'loss': '0.1867', 'grad_norm': '4.438', 'learning_rate': '2e-05', 'epoch': '0.03951'}
+
  4%|▍         | 1500/37963 [3:23:04<78:14:09,  7.72s/it]
  4%|▍         | 1501/37963 [3:23:12<78:55:48,  7.79s/it]
  4%|▍         | 1502/37963 [3:23:20<79:00:01,  7.80s/it]
  4%|▍         | 1503/37963 [3:23:27<78:13:36,  7.72s/it]
  4%|▍         | 1504/37963 [3:23:35<78:22:55,  7.74s/it]
  4%|▍         | 1505/37963 [3:23:43<78:00:01,  7.70s/it]
  4%|▍         | 1506/37963 [3:23:50<77:22:41,  7.64s/it]
  4%|▍         | 1507/37963 [3:23:58<78:18:58,  7.73s/it]
  4%|▍         | 1508/37963 [3:24:06<77:27:13,  7.65s/it]
  4%|▍         | 1509/37963 [3:24:13<76:48:45,  7.59s/it]
  4%|▍         | 1510/37963 [3:24:21<77:34:10,  7.66s/it]
                                                         
{'loss': '0.1759', 'grad_norm': '5.512', 'learning_rate': '2e-05', 'epoch': '0.03978'}
+
  4%|▍         | 1510/37963 [3:24:21<77:34:10,  7.66s/it]
  4%|▍         | 1511/37963 [3:24:28<77:14:10,  7.63s/it]
  4%|▍         | 1512/37963 [3:24:36<76:55:14,  7.60s/it]
  4%|▍         | 1513/37963 [3:24:43<76:42:26,  7.58s/it]
  4%|▍         | 1514/37963 [3:24:51<77:14:35,  7.63s/it]
  4%|▍         | 1515/37963 [3:24:59<77:02:39,  7.61s/it]
  4%|▍         | 1516/37963 [3:25:09<85:35:10,  8.45s/it]
  4%|▍         | 1517/37963 [3:25:17<83:01:14,  8.20s/it]
  4%|▍         | 1518/37963 [3:25:24<81:12:20,  8.02s/it]
  4%|▍         | 1519/37963 [3:25:32<79:59:08,  7.90s/it]
  4%|▍         | 1520/37963 [3:25:42<86:59:33,  8.59s/it]
                                                         
{'loss': '0.1746', 'grad_norm': '2.257', 'learning_rate': '1.999e-05', 'epoch': '0.04004'}
+
  4%|▍         | 1520/37963 [3:25:42<86:59:33,  8.59s/it]
  4%|▍         | 1521/37963 [3:25:50<83:34:51,  8.26s/it]
  4%|▍         | 1522/37963 [3:26:02<96:44:08,  9.56s/it]
  4%|▍         | 1523/37963 [3:26:10<90:23:19,  8.93s/it]
  4%|▍         | 1524/37963 [3:26:18<87:02:39,  8.60s/it]
  4%|▍         | 1525/37963 [3:26:25<84:41:04,  8.37s/it]
  4%|▍         | 1526/37963 [3:26:33<82:38:42,  8.17s/it]
  4%|▍         | 1527/37963 [3:26:41<80:35:09,  7.96s/it]
  4%|▍         | 1528/37963 [3:26:48<79:37:40,  7.87s/it]
  4%|▍         | 1529/37963 [3:26:56<79:04:28,  7.81s/it]
  4%|▍         | 1530/37963 [3:27:03<78:07:31,  7.72s/it]
                                                         
{'loss': '0.1809', 'grad_norm': '5.216', 'learning_rate': '1.999e-05', 'epoch': '0.0403'}
+
  4%|▍         | 1530/37963 [3:27:03<78:07:31,  7.72s/it]
  4%|▍         | 1531/37963 [3:27:11<77:49:47,  7.69s/it]
  4%|▍         | 1532/37963 [3:27:21<85:35:03,  8.46s/it]
  4%|▍         | 1533/37963 [3:27:29<83:02:10,  8.21s/it]
  4%|▍         | 1534/37963 [3:27:37<81:36:38,  8.06s/it]
  4%|▍         | 1535/37963 [3:27:47<87:56:08,  8.69s/it]
  4%|▍         | 1536/37963 [3:27:57<92:34:56,  9.15s/it]
  4%|▍         | 1537/37963 [3:28:05<88:10:49,  8.71s/it]
  4%|▍         | 1538/37963 [3:28:12<84:54:53,  8.39s/it]
  4%|▍         | 1539/37963 [3:28:22<90:02:20,  8.90s/it]
  4%|▍         | 1540/37963 [3:28:30<86:03:28,  8.51s/it]
                                                         
{'loss': '0.2086', 'grad_norm': '6.665', 'learning_rate': '1.999e-05', 'epoch': '0.04057'}
+
  4%|▍         | 1540/37963 [3:28:30<86:03:28,  8.51s/it]
  4%|▍         | 1541/37963 [3:28:38<83:59:05,  8.30s/it]
  4%|▍         | 1542/37963 [3:28:45<81:14:56,  8.03s/it]
  4%|▍         | 1543/37963 [3:28:53<80:33:25,  7.96s/it]
  4%|▍         | 1544/37963 [3:29:01<79:59:25,  7.91s/it]
  4%|▍         | 1545/37963 [3:29:08<77:50:32,  7.69s/it]
  4%|▍         | 1546/37963 [3:29:16<77:25:12,  7.65s/it]
  4%|▍         | 1547/37963 [3:29:23<77:38:25,  7.68s/it]
  4%|▍         | 1548/37963 [3:29:31<77:38:49,  7.68s/it]
  4%|▍         | 1549/37963 [3:29:39<78:35:10,  7.77s/it]
  4%|▍         | 1550/37963 [3:29:47<78:13:35,  7.73s/it]
                                                         
{'loss': '0.1942', 'grad_norm': '3.927', 'learning_rate': '1.999e-05', 'epoch': '0.04083'}
+
  4%|▍         | 1550/37963 [3:29:47<78:13:35,  7.73s/it]
  4%|▍         | 1551/37963 [3:29:54<77:48:30,  7.69s/it]
  4%|▍         | 1552/37963 [3:30:02<77:34:37,  7.67s/it]
  4%|▍         | 1553/37963 [3:30:10<78:34:55,  7.77s/it]
  4%|▍         | 1554/37963 [3:30:17<77:59:37,  7.71s/it]
  4%|▍         | 1555/37963 [3:30:25<77:11:09,  7.63s/it]
  4%|▍         | 1556/37963 [3:30:33<77:29:19,  7.66s/it]
  4%|▍         | 1557/37963 [3:30:40<76:36:15,  7.58s/it]
  4%|▍         | 1558/37963 [3:30:47<76:36:07,  7.58s/it]
  4%|▍         | 1559/37963 [3:30:55<76:30:41,  7.57s/it]
  4%|▍         | 1560/37963 [3:31:03<76:38:14,  7.58s/it]
                                                         
{'loss': '0.176', 'grad_norm': '6.071', 'learning_rate': '1.999e-05', 'epoch': '0.04109'}
+
  4%|▍         | 1560/37963 [3:31:03<76:38:14,  7.58s/it]
  4%|▍         | 1561/37963 [3:31:10<77:19:27,  7.65s/it]
  4%|▍         | 1562/37963 [3:31:18<77:29:41,  7.66s/it]
  4%|▍         | 1563/37963 [3:31:26<77:25:59,  7.66s/it]
  4%|▍         | 1564/37963 [3:31:34<77:48:15,  7.70s/it]
  4%|▍         | 1565/37963 [3:31:41<77:39:10,  7.68s/it]
  4%|▍         | 1566/37963 [3:31:52<85:40:24,  8.47s/it]
  4%|▍         | 1567/37963 [3:31:59<83:02:56,  8.21s/it]
  4%|▍         | 1568/37963 [3:32:10<89:49:17,  8.88s/it]
  4%|▍         | 1569/37963 [3:32:17<86:11:31,  8.53s/it]
  4%|▍         | 1570/37963 [3:32:27<90:42:14,  8.97s/it]
                                                         
{'loss': '0.1836', 'grad_norm': '6.444', 'learning_rate': '1.999e-05', 'epoch': '0.04136'}
+
  4%|▍         | 1570/37963 [3:32:27<90:42:14,  8.97s/it]
  4%|▍         | 1571/37963 [3:32:35<86:54:50,  8.60s/it]
  4%|▍         | 1572/37963 [3:32:43<84:33:33,  8.37s/it]
  4%|▍         | 1573/37963 [3:32:51<82:27:43,  8.16s/it]
  4%|▍         | 1574/37963 [3:32:58<81:09:45,  8.03s/it]
  4%|▍         | 1575/37963 [3:33:06<79:27:28,  7.86s/it]
  4%|▍         | 1576/37963 [3:33:18<94:03:07,  9.31s/it]
  4%|▍         | 1577/37963 [3:33:26<90:19:17,  8.94s/it]
  4%|▍         | 1578/37963 [3:33:34<85:56:01,  8.50s/it]
  4%|▍         | 1579/37963 [3:33:42<84:10:02,  8.33s/it]
  4%|▍         | 1580/37963 [3:33:50<82:01:13,  8.12s/it]
                                                         
{'loss': '0.188', 'grad_norm': '3.782', 'learning_rate': '1.999e-05', 'epoch': '0.04162'}
+
  4%|▍         | 1580/37963 [3:33:50<82:01:13,  8.12s/it]
  4%|▍         | 1581/37963 [3:33:57<79:50:37,  7.90s/it]
  4%|▍         | 1582/37963 [3:34:04<78:11:25,  7.74s/it]
  4%|▍         | 1583/37963 [3:34:12<77:33:21,  7.67s/it]
  4%|▍         | 1584/37963 [3:34:22<86:19:55,  8.54s/it]
  4%|▍         | 1585/37963 [3:34:30<82:28:10,  8.16s/it]
  4%|▍         | 1586/37963 [3:34:40<89:01:38,  8.81s/it]
  4%|▍         | 1587/37963 [3:34:50<93:40:44,  9.27s/it]
  4%|▍         | 1588/37963 [3:34:58<89:01:11,  8.81s/it]
  4%|▍         | 1589/37963 [3:35:06<85:43:17,  8.48s/it]
  4%|▍         | 1590/37963 [3:35:13<82:26:46,  8.16s/it]
                                                         
{'loss': '0.1903', 'grad_norm': '3.003', 'learning_rate': '1.999e-05', 'epoch': '0.04188'}
+
  4%|▍         | 1590/37963 [3:35:13<82:26:46,  8.16s/it]
  4%|▍         | 1591/37963 [3:35:21<80:56:24,  8.01s/it]
  4%|▍         | 1592/37963 [3:35:28<79:33:37,  7.87s/it]
  4%|▍         | 1593/37963 [3:35:36<78:56:29,  7.81s/it]
  4%|▍         | 1594/37963 [3:35:44<78:19:53,  7.75s/it]
  4%|▍         | 1595/37963 [3:35:51<77:33:30,  7.68s/it]
  4%|▍         | 1596/37963 [3:35:59<77:01:14,  7.62s/it]
  4%|▍         | 1597/37963 [3:36:06<77:35:11,  7.68s/it]
  4%|▍         | 1598/37963 [3:36:14<76:53:22,  7.61s/it]
  4%|▍         | 1599/37963 [3:36:22<76:54:21,  7.61s/it]
  4%|▍         | 1600/37963 [3:36:29<75:13:08,  7.45s/it]
                                                         
{'loss': '0.2035', 'grad_norm': '2.762', 'learning_rate': '1.999e-05', 'epoch': '0.04215'}
+
  4%|▍         | 1600/37963 [3:36:29<75:13:08,  7.45s/it]
  4%|▍         | 1601/37963 [3:36:36<76:11:12,  7.54s/it]
  4%|▍         | 1602/37963 [3:36:44<76:52:39,  7.61s/it]
  4%|▍         | 1603/37963 [3:36:52<76:36:16,  7.58s/it]
  4%|▍         | 1604/37963 [3:36:59<76:21:09,  7.56s/it]
  4%|▍         | 1605/37963 [3:37:07<76:59:53,  7.62s/it]
  4%|▍         | 1606/37963 [3:37:14<76:40:26,  7.59s/it]
  4%|▍         | 1607/37963 [3:37:22<76:44:38,  7.60s/it]
  4%|▍         | 1608/37963 [3:37:30<76:43:42,  7.60s/it]
  4%|▍         | 1609/37963 [3:37:37<76:43:33,  7.60s/it]
  4%|▍         | 1610/37963 [3:37:48<85:01:40,  8.42s/it]
                                                         
{'loss': '0.1842', 'grad_norm': '8.225', 'learning_rate': '1.999e-05', 'epoch': '0.04241'}
+
  4%|▍         | 1610/37963 [3:37:48<85:01:40,  8.42s/it]
  4%|▍         | 1611/37963 [3:37:55<82:44:42,  8.19s/it]
  4%|▍         | 1612/37963 [3:38:03<81:08:36,  8.04s/it]
  4%|▍         | 1613/37963 [3:38:10<79:20:43,  7.86s/it]
  4%|▍         | 1614/37963 [3:38:18<79:18:21,  7.85s/it]
  4%|▍         | 1615/37963 [3:38:26<78:59:44,  7.82s/it]
  4%|▍         | 1616/37963 [3:38:34<78:12:05,  7.75s/it]
  4%|▍         | 1617/37963 [3:38:44<85:46:41,  8.50s/it]
  4%|▍         | 1618/37963 [3:38:51<82:26:25,  8.17s/it]
  4%|▍         | 1619/37963 [3:38:59<81:40:35,  8.09s/it]
  4%|▍         | 1620/37963 [3:39:07<80:30:41,  7.98s/it]
                                                         
{'loss': '0.1928', 'grad_norm': '7.186', 'learning_rate': '1.999e-05', 'epoch': '0.04267'}
+
  4%|▍         | 1620/37963 [3:39:07<80:30:41,  7.98s/it]
  4%|▍         | 1621/37963 [3:39:14<79:32:26,  7.88s/it]
  4%|▍         | 1622/37963 [3:39:25<86:32:12,  8.57s/it]
  4%|▍         | 1623/37963 [3:39:32<83:14:19,  8.25s/it]
  4%|▍         | 1624/37963 [3:39:42<89:15:06,  8.84s/it]
  4%|▍         | 1625/37963 [3:39:50<86:12:27,  8.54s/it]
  4%|▍         | 1626/37963 [3:40:00<90:58:02,  9.01s/it]
  4%|▍         | 1627/37963 [3:40:08<87:43:40,  8.69s/it]
  4%|▍         | 1628/37963 [3:40:16<83:44:08,  8.30s/it]
  4%|▍         | 1629/37963 [3:40:23<81:20:04,  8.06s/it]
  4%|▍         | 1630/37963 [3:40:33<87:58:18,  8.72s/it]
                                                         
{'loss': '0.1796', 'grad_norm': '3.883', 'learning_rate': '1.999e-05', 'epoch': '0.04294'}
+
  4%|▍         | 1630/37963 [3:40:33<87:58:18,  8.72s/it]
  4%|▍         | 1631/37963 [3:40:41<85:51:34,  8.51s/it]
  4%|▍         | 1632/37963 [3:40:52<91:20:00,  9.05s/it]
  4%|▍         | 1633/37963 [3:41:00<88:19:31,  8.75s/it]
  4%|▍         | 1634/37963 [3:41:07<84:58:28,  8.42s/it]
  4%|▍         | 1635/37963 [3:41:18<90:39:50,  8.98s/it]
  4%|▍         | 1636/37963 [3:41:25<86:48:01,  8.60s/it]
  4%|▍         | 1637/37963 [3:41:33<84:35:20,  8.38s/it]
  4%|▍         | 1638/37963 [3:41:41<81:37:52,  8.09s/it]
  4%|▍         | 1639/37963 [3:41:49<80:48:48,  8.01s/it]
  4%|▍         | 1640/37963 [3:41:56<80:25:40,  7.97s/it]
                                                         
{'loss': '0.1929', 'grad_norm': '7.729', 'learning_rate': '1.999e-05', 'epoch': '0.0432'}
+
  4%|▍         | 1640/37963 [3:41:56<80:25:40,  7.97s/it]
  4%|▍         | 1641/37963 [3:42:04<79:42:20,  7.90s/it]
  4%|▍         | 1642/37963 [3:42:12<78:47:50,  7.81s/it]
  4%|▍         | 1643/37963 [3:42:19<77:34:02,  7.69s/it]
  4%|▍         | 1644/37963 [3:42:27<77:38:19,  7.70s/it]
  4%|▍         | 1645/37963 [3:42:35<78:16:38,  7.76s/it]
  4%|▍         | 1646/37963 [3:42:43<78:31:00,  7.78s/it]
  4%|▍         | 1647/37963 [3:42:50<78:41:15,  7.80s/it]
  4%|▍         | 1648/37963 [3:42:58<77:09:58,  7.65s/it]
  4%|▍         | 1649/37963 [3:43:05<77:07:10,  7.65s/it]
  4%|▍         | 1650/37963 [3:43:13<77:08:56,  7.65s/it]
                                                         
{'loss': '0.1798', 'grad_norm': '1.999', 'learning_rate': '1.999e-05', 'epoch': '0.04346'}
+
  4%|▍         | 1650/37963 [3:43:13<77:08:56,  7.65s/it]
  4%|▍         | 1651/37963 [3:43:21<77:29:57,  7.68s/it]
  4%|▍         | 1652/37963 [3:43:28<76:41:06,  7.60s/it]
  4%|▍         | 1653/37963 [3:43:39<84:48:51,  8.41s/it]
  4%|▍         | 1654/37963 [3:43:46<82:35:41,  8.19s/it]
  4%|▍         | 1655/37963 [3:43:54<80:52:10,  8.02s/it]
  4%|▍         | 1656/37963 [3:44:01<79:14:45,  7.86s/it]
  4%|▍         | 1657/37963 [3:44:09<78:41:34,  7.80s/it]
  4%|▍         | 1658/37963 [3:44:17<78:09:24,  7.75s/it]
  4%|▍         | 1659/37963 [3:44:24<78:18:02,  7.76s/it]
  4%|▍         | 1660/37963 [3:44:32<78:28:46,  7.78s/it]
                                                         
{'loss': '0.2093', 'grad_norm': '5.272', 'learning_rate': '1.999e-05', 'epoch': '0.04373'}
+
  4%|▍         | 1660/37963 [3:44:32<78:28:46,  7.78s/it]
  4%|▍         | 1661/37963 [3:44:40<78:04:25,  7.74s/it]
  4%|▍         | 1662/37963 [3:44:48<77:52:22,  7.72s/it]
  4%|▍         | 1663/37963 [3:44:55<77:26:35,  7.68s/it]
  4%|▍         | 1664/37963 [3:45:03<77:27:30,  7.68s/it]
  4%|▍         | 1665/37963 [3:45:13<84:39:42,  8.40s/it]
  4%|▍         | 1666/37963 [3:45:21<82:17:44,  8.16s/it]
  4%|▍         | 1667/37963 [3:45:28<80:44:38,  8.01s/it]
  4%|▍         | 1668/37963 [3:45:38<86:24:21,  8.57s/it]
  4%|▍         | 1669/37963 [3:45:46<83:59:26,  8.33s/it]
  4%|▍         | 1670/37963 [3:45:53<81:52:52,  8.12s/it]
                                                         
{'loss': '0.2037', 'grad_norm': '5.857', 'learning_rate': '1.999e-05', 'epoch': '0.04399'}
+
  4%|▍         | 1670/37963 [3:45:53<81:52:52,  8.12s/it]
  4%|▍         | 1671/37963 [3:46:01<80:06:08,  7.95s/it]
  4%|▍         | 1672/37963 [3:46:09<78:59:16,  7.84s/it]
  4%|▍         | 1673/37963 [3:46:19<87:09:33,  8.65s/it]
  4%|▍         | 1674/37963 [3:46:29<92:15:07,  9.15s/it]
  4%|▍         | 1675/37963 [3:46:39<94:58:19,  9.42s/it]
  4%|▍         | 1676/37963 [3:46:47<89:14:32,  8.85s/it]
  4%|▍         | 1677/37963 [3:46:55<85:09:39,  8.45s/it]
  4%|▍         | 1678/37963 [3:47:02<82:27:00,  8.18s/it]
  4%|▍         | 1679/37963 [3:47:10<80:54:10,  8.03s/it]
  4%|▍         | 1680/37963 [3:47:20<87:13:05,  8.65s/it]
                                                         
{'loss': '0.18', 'grad_norm': '2.415', 'learning_rate': '1.999e-05', 'epoch': '0.04425'}
+
  4%|▍         | 1680/37963 [3:47:20<87:13:05,  8.65s/it]
  4%|▍         | 1681/37963 [3:47:27<84:10:10,  8.35s/it]
  4%|▍         | 1682/37963 [3:47:35<82:40:22,  8.20s/it]
  4%|▍         | 1683/37963 [3:47:43<80:47:34,  8.02s/it]
  4%|▍         | 1684/37963 [3:47:50<79:21:55,  7.88s/it]
  4%|▍         | 1685/37963 [3:47:58<79:39:49,  7.91s/it]
  4%|▍         | 1686/37963 [3:48:06<79:12:41,  7.86s/it]
  4%|▍         | 1687/37963 [3:48:14<78:30:46,  7.79s/it]
  4%|▍         | 1688/37963 [3:48:21<77:45:52,  7.72s/it]
  4%|▍         | 1689/37963 [3:48:32<85:28:28,  8.48s/it]
  4%|▍         | 1690/37963 [3:48:39<82:57:29,  8.23s/it]
                                                         
{'loss': '0.1801', 'grad_norm': '3.986', 'learning_rate': '1.999e-05', 'epoch': '0.04452'}
+
  4%|▍         | 1690/37963 [3:48:39<82:57:29,  8.23s/it]
  4%|▍         | 1691/37963 [3:48:47<81:05:47,  8.05s/it]
  4%|▍         | 1692/37963 [3:48:55<80:01:42,  7.94s/it]
  4%|▍         | 1693/37963 [3:49:02<79:01:45,  7.84s/it]
  4%|▍         | 1694/37963 [3:49:10<77:58:22,  7.74s/it]
  4%|▍         | 1695/37963 [3:49:18<78:43:12,  7.81s/it]
  4%|▍         | 1696/37963 [3:49:25<78:26:43,  7.79s/it]
  4%|▍         | 1697/37963 [3:49:33<77:39:51,  7.71s/it]
  4%|▍         | 1698/37963 [3:49:40<75:51:20,  7.53s/it]
  4%|▍         | 1699/37963 [3:49:48<75:53:57,  7.53s/it]
  4%|▍         | 1700/37963 [3:49:55<75:50:42,  7.53s/it]
                                                         
{'loss': '0.1968', 'grad_norm': '2.413', 'learning_rate': '1.999e-05', 'epoch': '0.04478'}
+
  4%|▍         | 1700/37963 [3:49:55<75:50:42,  7.53s/it]
  4%|▍         | 1701/37963 [3:50:03<76:08:18,  7.56s/it]
  4%|▍         | 1702/37963 [3:50:10<76:03:00,  7.55s/it]
  4%|▍         | 1703/37963 [3:50:18<75:58:33,  7.54s/it]
  4%|▍         | 1704/37963 [3:50:25<76:15:45,  7.57s/it]
  4%|▍         | 1705/37963 [3:50:33<76:24:02,  7.59s/it]
  4%|▍         | 1706/37963 [3:50:41<76:27:15,  7.59s/it]
  4%|▍         | 1707/37963 [3:50:51<84:35:38,  8.40s/it]
  4%|▍         | 1708/37963 [3:50:58<81:35:51,  8.10s/it]
  5%|▍         | 1709/37963 [3:51:06<80:30:56,  8.00s/it]
  5%|▍         | 1710/37963 [3:51:14<78:58:28,  7.84s/it]
                                                         
{'loss': '0.1961', 'grad_norm': '5.418', 'learning_rate': '1.999e-05', 'epoch': '0.04504'}
+
  5%|▍         | 1710/37963 [3:51:14<78:58:28,  7.84s/it]
  5%|▍         | 1711/37963 [3:51:21<78:29:49,  7.80s/it]
  5%|▍         | 1712/37963 [3:51:29<77:51:36,  7.73s/it]
  5%|▍         | 1713/37963 [3:51:39<84:39:09,  8.41s/it]
  5%|▍         | 1714/37963 [3:51:46<82:01:37,  8.15s/it]
  5%|▍         | 1715/37963 [3:51:54<81:13:26,  8.07s/it]
  5%|▍         | 1716/37963 [3:52:02<80:22:07,  7.98s/it]
  5%|▍         | 1717/37963 [3:52:09<78:06:49,  7.76s/it]
  5%|▍         | 1718/37963 [3:52:17<77:43:45,  7.72s/it]
  5%|▍         | 1719/37963 [3:52:27<85:27:15,  8.49s/it]
  5%|▍         | 1720/37963 [3:52:37<90:23:02,  8.98s/it]
                                                         
{'loss': '0.1934', 'grad_norm': '4.244', 'learning_rate': '1.999e-05', 'epoch': '0.04531'}
+
  5%|▍         | 1720/37963 [3:52:37<90:23:02,  8.98s/it]
  5%|▍         | 1721/37963 [3:52:45<85:45:50,  8.52s/it]
  5%|▍         | 1722/37963 [3:52:53<83:45:44,  8.32s/it]
  5%|▍         | 1723/37963 [3:53:03<89:54:47,  8.93s/it]
  5%|▍         | 1724/37963 [3:53:13<94:31:57,  9.39s/it]
  5%|▍         | 1725/37963 [3:53:21<89:21:17,  8.88s/it]
  5%|▍         | 1726/37963 [3:53:28<84:15:12,  8.37s/it]
  5%|▍         | 1727/37963 [3:53:36<81:50:50,  8.13s/it]
  5%|▍         | 1728/37963 [3:53:46<89:13:30,  8.86s/it]
  5%|▍         | 1729/37963 [3:53:54<85:54:01,  8.53s/it]
  5%|▍         | 1730/37963 [3:54:02<83:18:12,  8.28s/it]
                                                         
{'loss': '0.194', 'grad_norm': '4.495', 'learning_rate': '1.999e-05', 'epoch': '0.04557'}
+
  5%|▍         | 1730/37963 [3:54:02<83:18:12,  8.28s/it]
  5%|▍         | 1731/37963 [3:54:10<81:43:17,  8.12s/it]
  5%|▍         | 1732/37963 [3:54:17<80:10:13,  7.97s/it]
  5%|▍         | 1733/37963 [3:54:28<87:22:45,  8.68s/it]
  5%|▍         | 1734/37963 [3:54:35<84:34:43,  8.40s/it]
  5%|▍         | 1735/37963 [3:54:43<82:36:58,  8.21s/it]
  5%|▍         | 1736/37963 [3:54:51<80:27:35,  8.00s/it]
  5%|▍         | 1737/37963 [3:54:58<79:33:39,  7.91s/it]
  5%|▍         | 1738/37963 [3:55:06<78:34:21,  7.81s/it]
  5%|▍         | 1739/37963 [3:55:14<78:07:48,  7.76s/it]
  5%|▍         | 1740/37963 [3:55:21<78:23:44,  7.79s/it]
                                                         
{'loss': '0.1831', 'grad_norm': '6.384', 'learning_rate': '1.999e-05', 'epoch': '0.04583'}
+
  5%|▍         | 1740/37963 [3:55:21<78:23:44,  7.79s/it]
  5%|▍         | 1741/37963 [3:55:29<78:04:06,  7.76s/it]
  5%|▍         | 1742/37963 [3:55:37<77:12:28,  7.67s/it]
  5%|▍         | 1743/37963 [3:55:44<76:37:20,  7.62s/it]
  5%|▍         | 1744/37963 [3:55:52<76:48:15,  7.63s/it]
  5%|▍         | 1745/37963 [3:55:59<77:04:29,  7.66s/it]
  5%|▍         | 1746/37963 [3:56:07<77:00:52,  7.66s/it]
  5%|▍         | 1747/37963 [3:56:15<76:34:07,  7.61s/it]
  5%|▍         | 1748/37963 [3:56:23<77:29:48,  7.70s/it]
  5%|▍         | 1749/37963 [3:56:30<77:45:50,  7.73s/it]
  5%|▍         | 1750/37963 [3:56:38<77:10:03,  7.67s/it]
                                                         
{'loss': '0.2011', 'grad_norm': '2.437', 'learning_rate': '1.999e-05', 'epoch': '0.0461'}
+
  5%|▍         | 1750/37963 [3:56:38<77:10:03,  7.67s/it]
  5%|▍         | 1751/37963 [3:56:46<77:04:23,  7.66s/it]
  5%|▍         | 1752/37963 [3:56:53<77:08:47,  7.67s/it]
  5%|▍         | 1753/37963 [3:57:01<76:09:13,  7.57s/it]
  5%|▍         | 1754/37963 [3:57:08<76:26:17,  7.60s/it]
  5%|▍         | 1755/37963 [3:57:16<77:06:06,  7.67s/it]
  5%|▍         | 1756/37963 [3:57:26<84:07:41,  8.36s/it]
  5%|▍         | 1757/37963 [3:57:36<89:57:28,  8.94s/it]
  5%|▍         | 1758/37963 [3:57:44<86:04:39,  8.56s/it]
  5%|▍         | 1759/37963 [3:57:51<82:56:12,  8.25s/it]
  5%|▍         | 1760/37963 [3:57:59<80:54:49,  8.05s/it]
                                                         
{'loss': '0.1917', 'grad_norm': '3.989', 'learning_rate': '1.999e-05', 'epoch': '0.04636'}
+
  5%|▍         | 1760/37963 [3:57:59<80:54:49,  8.05s/it]
  5%|▍         | 1761/37963 [3:58:07<79:06:23,  7.87s/it]
  5%|▍         | 1762/37963 [3:58:14<79:08:41,  7.87s/it]
  5%|▍         | 1763/37963 [3:58:25<86:45:09,  8.63s/it]
  5%|▍         | 1764/37963 [3:58:35<91:23:08,  9.09s/it]
  5%|▍         | 1765/37963 [3:58:43<87:34:43,  8.71s/it]
  5%|▍         | 1766/37963 [3:58:53<91:16:54,  9.08s/it]
  5%|▍         | 1767/37963 [3:59:01<87:45:39,  8.73s/it]
  5%|▍         | 1768/37963 [3:59:08<85:08:41,  8.47s/it]
  5%|▍         | 1769/37963 [3:59:16<83:00:32,  8.26s/it]
  5%|▍         | 1770/37963 [3:59:24<80:28:08,  8.00s/it]
                                                         
{'loss': '0.2012', 'grad_norm': '1.738', 'learning_rate': '1.999e-05', 'epoch': '0.04662'}
+
  5%|▍         | 1770/37963 [3:59:24<80:28:08,  8.00s/it]
  5%|▍         | 1771/37963 [3:59:31<78:10:22,  7.78s/it]
  5%|▍         | 1772/37963 [3:59:41<85:19:34,  8.49s/it]
  5%|▍         | 1773/37963 [3:59:49<83:22:04,  8.29s/it]
  5%|▍         | 1774/37963 [3:59:57<81:54:09,  8.15s/it]
  5%|▍         | 1775/37963 [4:00:04<79:53:23,  7.95s/it]
  5%|▍         | 1776/37963 [4:00:14<86:34:30,  8.61s/it]
  5%|▍         | 1777/37963 [4:00:22<83:57:37,  8.35s/it]
  5%|▍         | 1778/37963 [4:00:30<81:38:42,  8.12s/it]
  5%|▍         | 1779/37963 [4:00:37<79:44:07,  7.93s/it]
  5%|▍         | 1780/37963 [4:00:45<78:25:35,  7.80s/it]
                                                         
{'loss': '0.1936', 'grad_norm': '2.921', 'learning_rate': '1.999e-05', 'epoch': '0.04689'}
+
  5%|▍         | 1780/37963 [4:00:45<78:25:35,  7.80s/it]
  5%|▍         | 1781/37963 [4:00:55<87:01:10,  8.66s/it]
  5%|▍         | 1782/37963 [4:01:03<84:17:08,  8.39s/it]
  5%|▍         | 1783/37963 [4:01:11<82:17:25,  8.19s/it]
  5%|▍         | 1784/37963 [4:01:19<81:25:58,  8.10s/it]
  5%|▍         | 1785/37963 [4:01:27<80:27:40,  8.01s/it]
  5%|▍         | 1786/37963 [4:01:34<78:57:45,  7.86s/it]
  5%|▍         | 1787/37963 [4:01:42<77:59:41,  7.76s/it]
  5%|▍         | 1788/37963 [4:01:49<76:17:14,  7.59s/it]
  5%|▍         | 1789/37963 [4:01:57<76:56:28,  7.66s/it]
  5%|▍         | 1790/37963 [4:02:04<76:01:35,  7.57s/it]
                                                         
{'loss': '0.177', 'grad_norm': '2.718', 'learning_rate': '1.998e-05', 'epoch': '0.04715'}
+
  5%|▍         | 1790/37963 [4:02:04<76:01:35,  7.57s/it]
  5%|▍         | 1791/37963 [4:02:11<76:05:03,  7.57s/it]
  5%|▍         | 1792/37963 [4:02:19<76:42:34,  7.63s/it]
  5%|▍         | 1793/37963 [4:02:27<76:14:24,  7.59s/it]
  5%|▍         | 1794/37963 [4:02:34<76:04:07,  7.57s/it]
  5%|▍         | 1795/37963 [4:02:42<77:03:23,  7.67s/it]
  5%|▍         | 1796/37963 [4:02:50<77:24:20,  7.70s/it]
  5%|▍         | 1797/37963 [4:02:58<76:58:04,  7.66s/it]
  5%|▍         | 1798/37963 [4:03:05<76:35:06,  7.62s/it]
  5%|▍         | 1799/37963 [4:03:13<76:53:53,  7.65s/it]
  5%|▍         | 1800/37963 [4:03:23<84:50:27,  8.45s/it]
                                                         
{'loss': '0.1935', 'grad_norm': '4.917', 'learning_rate': '1.998e-05', 'epoch': '0.04741'}
+
  5%|▍         | 1800/37963 [4:03:23<84:50:27,  8.45s/it]
  5%|▍         | 1801/37963 [4:03:31<82:24:36,  8.20s/it]
  5%|▍         | 1802/37963 [4:03:39<81:08:18,  8.08s/it]
  5%|▍         | 1803/37963 [4:03:46<79:28:55,  7.91s/it]
  5%|▍         | 1804/37963 [4:03:54<78:47:33,  7.84s/it]
  5%|▍         | 1805/37963 [4:04:01<78:31:45,  7.82s/it]
  5%|▍         | 1806/37963 [4:04:09<77:58:00,  7.76s/it]
  5%|▍         | 1807/37963 [4:04:17<77:43:58,  7.74s/it]
  5%|▍         | 1808/37963 [4:04:27<84:50:00,  8.45s/it]
  5%|▍         | 1809/37963 [4:04:35<82:45:01,  8.24s/it]
  5%|▍         | 1810/37963 [4:04:42<80:22:15,  8.00s/it]
                                                         
{'loss': '0.1935', 'grad_norm': '2.854', 'learning_rate': '1.998e-05', 'epoch': '0.04768'}
+
  5%|▍         | 1810/37963 [4:04:42<80:22:15,  8.00s/it]
  5%|▍         | 1811/37963 [4:04:52<86:44:45,  8.64s/it]
  5%|▍         | 1812/37963 [4:05:00<83:09:48,  8.28s/it]
  5%|▍         | 1813/37963 [4:05:10<88:57:27,  8.86s/it]
  5%|▍         | 1814/37963 [4:05:17<84:56:49,  8.46s/it]
  5%|▍         | 1815/37963 [4:05:25<82:09:33,  8.18s/it]
  5%|▍         | 1816/37963 [4:05:33<81:06:38,  8.08s/it]
  5%|▍         | 1817/37963 [4:05:43<87:10:37,  8.68s/it]
  5%|▍         | 1818/37963 [4:05:50<83:40:56,  8.33s/it]
  5%|▍         | 1819/37963 [4:05:58<82:02:05,  8.17s/it]
  5%|▍         | 1820/37963 [4:06:06<80:04:17,  7.98s/it]
                                                         
{'loss': '0.1821', 'grad_norm': '4.789', 'learning_rate': '1.998e-05', 'epoch': '0.04794'}
+
  5%|▍         | 1820/37963 [4:06:06<80:04:17,  7.98s/it]
  5%|▍         | 1821/37963 [4:06:16<86:46:20,  8.64s/it]
  5%|▍         | 1822/37963 [4:06:23<83:28:01,  8.31s/it]
  5%|▍         | 1823/37963 [4:06:31<81:38:02,  8.13s/it]
  5%|▍         | 1824/37963 [4:06:39<80:10:12,  7.99s/it]
  5%|▍         | 1825/37963 [4:06:49<86:36:49,  8.63s/it]
  5%|▍         | 1826/37963 [4:06:57<84:27:47,  8.41s/it]
  5%|▍         | 1827/37963 [4:07:05<82:46:22,  8.25s/it]
  5%|▍         | 1828/37963 [4:07:12<81:01:46,  8.07s/it]
  5%|▍         | 1829/37963 [4:07:20<79:35:11,  7.93s/it]
  5%|��         | 1830/37963 [4:07:28<78:52:32,  7.86s/it]
                                                         
{'loss': '0.1916', 'grad_norm': '3.567', 'learning_rate': '1.998e-05', 'epoch': '0.0482'}
+
  5%|▍         | 1830/37963 [4:07:28<78:52:32,  7.86s/it]
  5%|▍         | 1831/37963 [4:07:35<78:02:16,  7.78s/it]
  5%|▍         | 1832/37963 [4:07:43<78:28:23,  7.82s/it]
  5%|▍         | 1833/37963 [4:07:51<77:51:58,  7.76s/it]
  5%|▍         | 1834/37963 [4:07:58<77:05:28,  7.68s/it]
  5%|▍         | 1835/37963 [4:08:08<84:35:07,  8.43s/it]
  5%|▍         | 1836/37963 [4:08:16<82:25:55,  8.21s/it]
  5%|▍         | 1837/37963 [4:08:24<80:51:40,  8.06s/it]
  5%|▍         | 1838/37963 [4:08:32<79:38:25,  7.94s/it]
  5%|▍         | 1839/37963 [4:08:39<78:18:52,  7.80s/it]
  5%|▍         | 1840/37963 [4:08:46<76:28:54,  7.62s/it]
                                                         
{'loss': '0.1965', 'grad_norm': '1.954', 'learning_rate': '1.998e-05', 'epoch': '0.04847'}
+
  5%|▍         | 1840/37963 [4:08:46<76:28:54,  7.62s/it]
  5%|▍         | 1841/37963 [4:08:54<76:35:56,  7.63s/it]
  5%|▍         | 1842/37963 [4:09:01<76:16:54,  7.60s/it]
  5%|▍         | 1843/37963 [4:09:11<83:38:29,  8.34s/it]
  5%|▍         | 1844/37963 [4:09:19<81:54:23,  8.16s/it]
  5%|▍         | 1845/37963 [4:09:27<80:24:32,  8.01s/it]
  5%|▍         | 1846/37963 [4:09:35<79:18:58,  7.91s/it]
  5%|▍         | 1847/37963 [4:09:42<78:20:37,  7.81s/it]
  5%|▍         | 1848/37963 [4:09:50<77:48:52,  7.76s/it]
  5%|▍         | 1849/37963 [4:09:57<76:56:29,  7.67s/it]
  5%|▍         | 1850/37963 [4:10:05<76:45:24,  7.65s/it]
                                                         
{'loss': '0.1909', 'grad_norm': '2.256', 'learning_rate': '1.998e-05', 'epoch': '0.04873'}
+
  5%|▍         | 1850/37963 [4:10:05<76:45:24,  7.65s/it]
  5%|▍         | 1851/37963 [4:10:12<76:50:04,  7.66s/it]
  5%|▍         | 1852/37963 [4:10:20<77:36:15,  7.74s/it]
  5%|▍         | 1853/37963 [4:10:28<76:51:34,  7.66s/it]
  5%|▍         | 1854/37963 [4:10:38<83:28:35,  8.32s/it]
  5%|▍         | 1855/37963 [4:10:45<81:16:58,  8.10s/it]
  5%|▍         | 1856/37963 [4:10:56<87:37:31,  8.74s/it]
  5%|▍         | 1857/37963 [4:11:06<91:51:51,  9.16s/it]
  5%|▍         | 1858/37963 [4:11:14<88:19:19,  8.81s/it]
  5%|▍         | 1859/37963 [4:11:21<83:59:34,  8.38s/it]
  5%|▍         | 1860/37963 [4:11:29<81:33:47,  8.13s/it]
                                                         
{'loss': '0.1739', 'grad_norm': '2.571', 'learning_rate': '1.998e-05', 'epoch': '0.049'}
+
  5%|▍         | 1860/37963 [4:11:29<81:33:47,  8.13s/it]
  5%|▍         | 1861/37963 [4:11:36<79:37:33,  7.94s/it]
  5%|▍         | 1862/37963 [4:11:43<77:53:42,  7.77s/it]
  5%|▍         | 1863/37963 [4:11:51<77:14:49,  7.70s/it]
  5%|▍         | 1864/37963 [4:11:59<77:17:14,  7.71s/it]
  5%|▍         | 1865/37963 [4:12:07<77:25:35,  7.72s/it]
  5%|▍         | 1866/37963 [4:12:14<77:34:03,  7.74s/it]
  5%|▍         | 1867/37963 [4:12:22<77:17:18,  7.71s/it]
  5%|▍         | 1868/37963 [4:12:29<76:40:29,  7.65s/it]
  5%|▍         | 1869/37963 [4:12:40<84:06:47,  8.39s/it]
  5%|▍         | 1870/37963 [4:12:47<81:56:58,  8.17s/it]
                                                         
{'loss': '0.2039', 'grad_norm': '4.293', 'learning_rate': '1.998e-05', 'epoch': '0.04926'}
+
  5%|▍         | 1870/37963 [4:12:47<81:56:58,  8.17s/it]
  5%|▍         | 1871/37963 [4:12:57<87:41:05,  8.75s/it]
  5%|▍         | 1872/37963 [4:13:05<84:48:22,  8.46s/it]
  5%|▍         | 1873/37963 [4:13:15<90:01:45,  8.98s/it]
  5%|▍         | 1874/37963 [4:13:23<85:56:13,  8.57s/it]
  5%|▍         | 1875/37963 [4:13:31<83:22:03,  8.32s/it]
  5%|▍         | 1876/37963 [4:13:39<82:40:22,  8.25s/it]
  5%|▍         | 1877/37963 [4:13:46<80:24:47,  8.02s/it]
  5%|▍         | 1878/37963 [4:13:54<78:52:12,  7.87s/it]
  5%|▍         | 1879/37963 [4:14:01<78:23:36,  7.82s/it]
  5%|▍         | 1880/37963 [4:14:09<77:58:00,  7.78s/it]
                                                         
{'loss': '0.184', 'grad_norm': '2.501', 'learning_rate': '1.998e-05', 'epoch': '0.04952'}
+
  5%|▍         | 1880/37963 [4:14:09<77:58:00,  7.78s/it]
  5%|▍         | 1881/37963 [4:14:16<76:43:10,  7.65s/it]
  5%|▍         | 1882/37963 [4:14:24<76:27:45,  7.63s/it]
  5%|▍         | 1883/37963 [4:14:32<76:10:00,  7.60s/it]
  5%|▍         | 1884/37963 [4:14:39<76:32:26,  7.64s/it]
  5%|▍         | 1885/37963 [4:14:47<77:02:37,  7.69s/it]
  5%|▍         | 1886/37963 [4:14:55<76:56:57,  7.68s/it]
  5%|▍         | 1887/37963 [4:15:02<76:27:46,  7.63s/it]
  5%|▍         | 1888/37963 [4:15:10<76:17:14,  7.61s/it]
  5%|▍         | 1889/37963 [4:15:20<84:03:21,  8.39s/it]
  5%|▍         | 1890/37963 [4:15:30<89:38:07,  8.95s/it]
                                                         
{'loss': '0.1966', 'grad_norm': '5.466', 'learning_rate': '1.998e-05', 'epoch': '0.04979'}
+
  5%|▍         | 1890/37963 [4:15:30<89:38:07,  8.95s/it]
  5%|▍         | 1891/37963 [4:15:38<85:42:52,  8.55s/it]
  5%|▍         | 1892/37963 [4:15:46<83:11:13,  8.30s/it]
  5%|▍         | 1893/37963 [4:15:53<81:04:59,  8.09s/it]
  5%|▍         | 1894/37963 [4:16:01<80:02:44,  7.99s/it]
  5%|▍         | 1895/37963 [4:16:09<78:46:15,  7.86s/it]
  5%|▍         | 1896/37963 [4:16:16<78:08:34,  7.80s/it]
  5%|▍         | 1897/37963 [4:16:24<78:12:58,  7.81s/it]
  5%|▍         | 1898/37963 [4:16:34<85:04:49,  8.49s/it]
  5%|▌         | 1899/37963 [4:16:42<82:52:19,  8.27s/it]
  5%|▌         | 1900/37963 [4:16:50<80:56:28,  8.08s/it]
                                                         
{'loss': '0.1861', 'grad_norm': '3.241', 'learning_rate': '1.998e-05', 'epoch': '0.05005'}
+
  5%|▌         | 1900/37963 [4:16:50<80:56:28,  8.08s/it]
  5%|▌         | 1901/37963 [4:16:57<79:12:57,  7.91s/it]
  5%|▌         | 1902/37963 [4:17:07<86:34:07,  8.64s/it]
  5%|▌         | 1903/37963 [4:17:15<83:41:47,  8.36s/it]
  5%|▌         | 1904/37963 [4:17:25<89:27:10,  8.93s/it]
  5%|▌         | 1905/37963 [4:17:33<86:13:37,  8.61s/it]
  5%|▌         | 1906/37963 [4:17:41<83:41:07,  8.36s/it]
  5%|▌         | 1907/37963 [4:17:48<80:13:16,  8.01s/it]
  5%|▌         | 1908/37963 [4:17:56<79:09:58,  7.90s/it]
  5%|▌         | 1909/37963 [4:18:03<77:50:08,  7.77s/it]
  5%|▌         | 1910/37963 [4:18:11<76:53:40,  7.68s/it]
                                                         
{'loss': '0.1916', 'grad_norm': '5.236', 'learning_rate': '1.998e-05', 'epoch': '0.05031'}
+
  5%|▌         | 1910/37963 [4:18:11<76:53:40,  7.68s/it]
  5%|▌         | 1911/37963 [4:18:19<77:47:43,  7.77s/it]
  5%|▌         | 1912/37963 [4:18:26<77:04:02,  7.70s/it]
  5%|▌         | 1913/37963 [4:18:36<83:38:29,  8.35s/it]
  5%|▌         | 1914/37963 [4:18:44<81:02:32,  8.09s/it]
  5%|▌         | 1915/37963 [4:18:54<87:06:07,  8.70s/it]
  5%|▌         | 1916/37963 [4:19:02<84:29:13,  8.44s/it]
  5%|▌         | 1917/37963 [4:19:12<90:04:36,  9.00s/it]
  5%|▌         | 1918/37963 [4:19:20<85:59:43,  8.59s/it]
  5%|▌         | 1919/37963 [4:19:27<83:13:29,  8.31s/it]
  5%|▌         | 1920/37963 [4:19:35<80:59:37,  8.09s/it]
                                                         
{'loss': '0.1688', 'grad_norm': '5.601', 'learning_rate': '1.998e-05', 'epoch': '0.05058'}
+
  5%|▌         | 1920/37963 [4:19:35<80:59:37,  8.09s/it]
  5%|▌         | 1921/37963 [4:19:42<78:26:39,  7.84s/it]
  5%|▌         | 1922/37963 [4:19:49<76:59:58,  7.69s/it]
  5%|▌         | 1923/37963 [4:19:57<76:38:15,  7.66s/it]
  5%|▌         | 1924/37963 [4:20:04<76:13:47,  7.61s/it]
  5%|▌         | 1925/37963 [4:20:12<75:50:25,  7.58s/it]
  5%|▌         | 1926/37963 [4:20:20<75:56:54,  7.59s/it]
  5%|▌         | 1927/37963 [4:20:27<75:59:30,  7.59s/it]
  5%|▌         | 1928/37963 [4:20:35<76:06:59,  7.60s/it]
  5%|▌         | 1929/37963 [4:20:42<75:00:15,  7.49s/it]
  5%|▌         | 1930/37963 [4:20:50<75:28:21,  7.54s/it]
                                                         
{'loss': '0.2009', 'grad_norm': '2.973', 'learning_rate': '1.998e-05', 'epoch': '0.05084'}
+
  5%|▌         | 1930/37963 [4:20:50<75:28:21,  7.54s/it]
  5%|▌         | 1931/37963 [4:20:57<76:07:46,  7.61s/it]
  5%|▌         | 1932/37963 [4:21:05<76:26:45,  7.64s/it]
  5%|▌         | 1933/37963 [4:21:13<77:08:15,  7.71s/it]
  5%|▌         | 1934/37963 [4:21:21<77:08:21,  7.71s/it]
  5%|▌         | 1935/37963 [4:21:29<77:39:43,  7.76s/it]
  5%|▌         | 1936/37963 [4:21:36<77:34:52,  7.75s/it]
  5%|▌         | 1937/37963 [4:21:44<76:41:25,  7.66s/it]
  5%|▌         | 1938/37963 [4:21:51<76:39:51,  7.66s/it]
  5%|▌         | 1939/37963 [4:21:59<77:13:42,  7.72s/it]
  5%|▌         | 1940/37963 [4:22:07<76:54:43,  7.69s/it]
                                                         
{'loss': '0.1995', 'grad_norm': '1.605', 'learning_rate': '1.998e-05', 'epoch': '0.0511'}
+
  5%|▌         | 1940/37963 [4:22:07<76:54:43,  7.69s/it]
  5%|▌         | 1941/37963 [4:22:14<76:33:52,  7.65s/it]
  5%|▌         | 1942/37963 [4:22:27<91:13:11,  9.12s/it]
  5%|▌         | 1943/37963 [4:22:35<86:44:34,  8.67s/it]
  5%|▌         | 1944/37963 [4:22:45<91:40:37,  9.16s/it]
  5%|▌         | 1945/37963 [4:22:53<86:58:50,  8.69s/it]
  5%|▌         | 1946/37963 [4:23:00<84:01:18,  8.40s/it]
  5%|▌         | 1947/37963 [4:23:08<82:38:37,  8.26s/it]
  5%|▌         | 1948/37963 [4:23:16<80:17:40,  8.03s/it]
  5%|▌         | 1949/37963 [4:23:23<78:57:23,  7.89s/it]
  5%|▌         | 1950/37963 [4:23:31<78:18:59,  7.83s/it]
                                                         
{'loss': '0.1913', 'grad_norm': '5.318', 'learning_rate': '1.998e-05', 'epoch': '0.05137'}
+
  5%|▌         | 1950/37963 [4:23:31<78:18:59,  7.83s/it]
  5%|▌         | 1951/37963 [4:23:38<77:24:37,  7.74s/it]
  5%|▌         | 1952/37963 [4:23:49<84:57:26,  8.49s/it]
  5%|▌         | 1953/37963 [4:23:56<81:58:08,  8.19s/it]
  5%|▌         | 1954/37963 [4:24:04<80:36:53,  8.06s/it]
  5%|▌         | 1955/37963 [4:24:12<79:24:02,  7.94s/it]
  5%|▌         | 1956/37963 [4:24:19<78:28:34,  7.85s/it]
  5%|▌         | 1957/37963 [4:24:27<77:50:42,  7.78s/it]
  5%|▌         | 1958/37963 [4:24:37<84:50:33,  8.48s/it]
  5%|▌         | 1959/37963 [4:24:44<81:48:12,  8.18s/it]
  5%|▌         | 1960/37963 [4:24:52<80:07:39,  8.01s/it]
                                                         
{'loss': '0.2', 'grad_norm': '3.704', 'learning_rate': '1.998e-05', 'epoch': '0.05163'}
+
  5%|▌         | 1960/37963 [4:24:52<80:07:39,  8.01s/it]
  5%|▌         | 1961/37963 [4:25:00<79:32:03,  7.95s/it]
  5%|▌         | 1962/37963 [4:25:07<77:22:33,  7.74s/it]
  5%|▌         | 1963/37963 [4:25:20<93:15:12,  9.33s/it]
  5%|▌         | 1964/37963 [4:25:28<88:59:24,  8.90s/it]
  5%|▌         | 1965/37963 [4:25:38<92:37:52,  9.26s/it]
  5%|▌         | 1966/37963 [4:25:46<87:30:49,  8.75s/it]
  5%|▌         | 1967/37963 [4:25:53<84:15:17,  8.43s/it]
  5%|▌         | 1968/37963 [4:26:01<82:01:22,  8.20s/it]
  5%|▌         | 1969/37963 [4:26:09<80:59:26,  8.10s/it]
  5%|▌         | 1970/37963 [4:26:17<79:44:06,  7.98s/it]
                                                         
{'loss': '0.1828', 'grad_norm': '5.355', 'learning_rate': '1.997e-05', 'epoch': '0.05189'}
+
  5%|▌         | 1970/37963 [4:26:17<79:44:06,  7.98s/it]
  5%|▌         | 1971/37963 [4:26:24<78:51:32,  7.89s/it]
  5%|▌         | 1972/37963 [4:26:32<77:49:59,  7.79s/it]
  5%|▌         | 1973/37963 [4:26:40<77:27:59,  7.75s/it]
  5%|▌         | 1974/37963 [4:26:47<77:02:30,  7.71s/it]
  5%|▌         | 1975/37963 [4:26:55<77:01:22,  7.70s/it]
  5%|▌         | 1976/37963 [4:27:02<76:22:33,  7.64s/it]
  5%|▌         | 1977/37963 [4:27:10<75:41:08,  7.57s/it]
  5%|▌         | 1978/37963 [4:27:17<75:49:47,  7.59s/it]
  5%|▌         | 1979/37963 [4:27:25<75:15:56,  7.53s/it]
  5%|▌         | 1980/37963 [4:27:32<75:31:09,  7.56s/it]
                                                         
{'loss': '0.1926', 'grad_norm': '2.789', 'learning_rate': '1.997e-05', 'epoch': '0.05216'}
+
  5%|▌         | 1980/37963 [4:27:32<75:31:09,  7.56s/it]
  5%|▌         | 1981/37963 [4:27:40<75:58:34,  7.60s/it]
  5%|▌         | 1982/37963 [4:27:48<76:16:02,  7.63s/it]
  5%|▌         | 1983/37963 [4:27:55<75:59:59,  7.60s/it]
  5%|▌         | 1984/37963 [4:28:03<76:42:39,  7.68s/it]
  5%|▌         | 1985/37963 [4:28:13<83:50:47,  8.39s/it]
  5%|▌         | 1986/37963 [4:28:21<81:41:00,  8.17s/it]
  5%|▌         | 1987/37963 [4:28:28<79:58:03,  8.00s/it]
  5%|▌         | 1988/37963 [4:28:38<85:20:48,  8.54s/it]
  5%|▌         | 1989/37963 [4:28:46<82:22:52,  8.24s/it]
  5%|▌         | 1990/37963 [4:28:53<80:16:02,  8.03s/it]
                                                         
{'loss': '0.1776', 'grad_norm': '2.573', 'learning_rate': '1.997e-05', 'epoch': '0.05242'}
+
  5%|▌         | 1990/37963 [4:28:53<80:16:02,  8.03s/it]
  5%|▌         | 1991/37963 [4:29:01<77:42:47,  7.78s/it]
  5%|▌         | 1992/37963 [4:29:08<77:09:06,  7.72s/it]
  5%|▌         | 1993/37963 [4:29:16<76:42:09,  7.68s/it]
  5%|▌         | 1994/37963 [4:29:24<77:08:39,  7.72s/it]
  5%|▌         | 1995/37963 [4:29:34<84:40:50,  8.48s/it]
  5%|▌         | 1996/37963 [4:29:41<81:42:17,  8.18s/it]
  5%|▌         | 1997/37963 [4:29:49<79:23:26,  7.95s/it]
  5%|▌         | 1998/37963 [4:29:56<78:35:28,  7.87s/it]
  5%|▌         | 1999/37963 [4:30:04<77:28:56,  7.76s/it]
  5%|▌         | 2000/37963 [4:30:11<76:13:14,  7.63s/it]
                                                         
{'loss': '0.1826', 'grad_norm': '5.634', 'learning_rate': '1.997e-05', 'epoch': '0.05268'}
+
  5%|▌         | 2000/37963 [4:30:11<76:13:14,  7.63s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.39s/it]
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.39s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
  5%|▌         | 2001/37963 [4:31:15<244:08:19, 24.44s/it]
  5%|▌         | 2002/37963 [4:31:25<201:36:25, 20.18s/it]
  5%|▌         | 2003/37963 [4:31:32<162:51:46, 16.30s/it]
  5%|▌         | 2004/37963 [4:31:40<136:52:20, 13.70s/it]
  5%|▌         | 2005/37963 [4:31:53<134:20:19, 13.45s/it]
  5%|▌         | 2006/37963 [4:32:01<117:06:51, 11.73s/it]
  5%|▌         | 2007/37963 [4:32:08<105:03:47, 10.52s/it]
  5%|▌         | 2008/37963 [4:32:16<95:35:00,  9.57s/it] 
  5%|▌         | 2009/37963 [4:32:24<90:32:30,  9.07s/it]
  5%|▌         | 2010/37963 [4:32:31<85:55:30,  8.60s/it]
                                                         
{'loss': '0.1809', 'grad_norm': '1.811', 'learning_rate': '1.997e-05', 'epoch': '0.05295'}
+
  5%|▌         | 2010/37963 [4:32:31<85:55:30,  8.60s/it]
  5%|▌         | 2011/37963 [4:32:38<82:25:23,  8.25s/it]
  5%|▌         | 2012/37963 [4:32:49<88:40:17,  8.88s/it]
  5%|▌         | 2013/37963 [4:32:56<84:48:36,  8.49s/it]
  5%|▌         | 2014/37963 [4:33:04<82:16:46,  8.24s/it]
  5%|▌         | 2015/37963 [4:33:12<80:26:30,  8.06s/it]
  5%|▌         | 2016/37963 [4:33:22<86:45:39,  8.69s/it]
  5%|▌         | 2017/37963 [4:33:29<82:59:07,  8.31s/it]
  5%|▌         | 2018/37963 [4:33:37<80:32:49,  8.07s/it]
  5%|▌         | 2019/37963 [4:33:44<78:52:50,  7.90s/it]
  5%|▌         | 2020/37963 [4:33:52<77:16:15,  7.74s/it]
                                                         
{'loss': '0.1979', 'grad_norm': '4.843', 'learning_rate': '1.997e-05', 'epoch': '0.05321'}
+
  5%|▌         | 2020/37963 [4:33:52<77:16:15,  7.74s/it]
  5%|▌         | 2021/37963 [4:33:59<76:51:03,  7.70s/it]
  5%|▌         | 2022/37963 [4:34:07<76:34:25,  7.67s/it]
  5%|▌         | 2023/37963 [4:34:14<75:14:02,  7.54s/it]
  5%|▌         | 2024/37963 [4:34:22<75:35:56,  7.57s/it]
  5%|▌         | 2025/37963 [4:34:29<76:09:46,  7.63s/it]
  5%|▌         | 2026/37963 [4:34:37<76:12:18,  7.63s/it]
  5%|▌         | 2027/37963 [4:34:45<76:52:16,  7.70s/it]
  5%|▌         | 2028/37963 [4:34:53<76:53:14,  7.70s/it]
  5%|▌         | 2029/37963 [4:35:00<76:49:21,  7.70s/it]
  5%|▌         | 2030/37963 [4:35:08<77:52:38,  7.80s/it]
                                                         
{'loss': '0.1829', 'grad_norm': '3.469', 'learning_rate': '1.997e-05', 'epoch': '0.05347'}
+
  5%|▌         | 2030/37963 [4:35:08<77:52:38,  7.80s/it]
  5%|▌         | 2031/37963 [4:35:16<78:02:38,  7.82s/it]
  5%|▌         | 2032/37963 [4:35:27<85:34:30,  8.57s/it]
  5%|▌         | 2033/37963 [4:35:34<83:19:45,  8.35s/it]
  5%|▌         | 2034/37963 [4:35:42<81:29:20,  8.16s/it]
  5%|▌         | 2035/37963 [4:35:53<88:01:03,  8.82s/it]
  5%|▌         | 2036/37963 [4:36:00<85:02:24,  8.52s/it]
  5%|▌         | 2037/37963 [4:36:08<82:25:27,  8.26s/it]
  5%|▌         | 2038/37963 [4:36:16<80:44:43,  8.09s/it]
  5%|▌         | 2039/37963 [4:36:23<78:39:12,  7.88s/it]
  5%|▌         | 2040/37963 [4:36:30<76:49:43,  7.70s/it]
                                                         
{'loss': '0.1866', 'grad_norm': '3.393', 'learning_rate': '1.997e-05', 'epoch': '0.05374'}
+
  5%|▌         | 2040/37963 [4:36:30<76:49:43,  7.70s/it]
  5%|▌         | 2041/37963 [4:36:38<76:48:47,  7.70s/it]
  5%|▌         | 2042/37963 [4:36:46<76:09:05,  7.63s/it]
  5%|▌         | 2043/37963 [4:36:53<76:40:32,  7.68s/it]
  5%|▌         | 2044/37963 [4:37:01<75:49:31,  7.60s/it]
  5%|▌         | 2045/37963 [4:37:11<83:56:33,  8.41s/it]
  5%|▌         | 2046/37963 [4:37:21<89:13:23,  8.94s/it]
  5%|▌         | 2047/37963 [4:37:29<85:48:06,  8.60s/it]
  5%|▌         | 2048/37963 [4:37:37<83:24:17,  8.36s/it]
  5%|▌         | 2049/37963 [4:37:47<89:17:09,  8.95s/it]
  5%|▌         | 2050/37963 [4:37:55<85:32:49,  8.58s/it]
                                                         
{'loss': '0.181', 'grad_norm': '2.564', 'learning_rate': '1.997e-05', 'epoch': '0.054'}
+
  5%|▌         | 2050/37963 [4:37:55<85:32:49,  8.58s/it]
  5%|▌         | 2051/37963 [4:38:02<82:34:22,  8.28s/it]
  5%|▌         | 2052/37963 [4:38:13<88:23:01,  8.86s/it]
  5%|▌         | 2053/37963 [4:38:21<85:30:38,  8.57s/it]
  5%|▌         | 2054/37963 [4:38:28<83:22:49,  8.36s/it]
  5%|▌         | 2055/37963 [4:38:36<81:00:43,  8.12s/it]
  5%|▌         | 2056/37963 [4:38:43<78:41:45,  7.89s/it]
  5%|▌         | 2057/37963 [4:38:51<76:29:06,  7.67s/it]
  5%|▌         | 2058/37963 [4:38:58<76:06:10,  7.63s/it]
  5%|▌         | 2059/37963 [4:39:06<77:01:10,  7.72s/it]
  5%|▌         | 2060/37963 [4:39:19<92:34:40,  9.28s/it]
                                                         
{'loss': '0.2', 'grad_norm': '3.326', 'learning_rate': '1.997e-05', 'epoch': '0.05426'}
+
  5%|▌         | 2060/37963 [4:39:19<92:34:40,  9.28s/it]
  5%|▌         | 2061/37963 [4:39:27<87:44:36,  8.80s/it]
  5%|▌         | 2062/37963 [4:39:34<83:50:47,  8.41s/it]
  5%|▌         | 2063/37963 [4:39:42<81:09:32,  8.14s/it]
  5%|▌         | 2064/37963 [4:39:49<79:43:16,  7.99s/it]
  5%|▌         | 2065/37963 [4:39:57<78:08:32,  7.84s/it]
  5%|▌         | 2066/37963 [4:40:04<77:11:20,  7.74s/it]
  5%|▌         | 2067/37963 [4:40:12<77:21:14,  7.76s/it]
  5%|▌         | 2068/37963 [4:40:20<76:55:52,  7.72s/it]
  5%|▌         | 2069/37963 [4:40:28<77:21:31,  7.76s/it]
  5%|▌         | 2070/37963 [4:40:35<76:57:39,  7.72s/it]
                                                         
{'loss': '0.2113', 'grad_norm': '6.902', 'learning_rate': '1.997e-05', 'epoch': '0.05453'}
+
  5%|▌         | 2070/37963 [4:40:35<76:57:39,  7.72s/it]
  5%|▌         | 2071/37963 [4:40:42<75:47:57,  7.60s/it]
  5%|▌         | 2072/37963 [4:40:50<75:43:33,  7.60s/it]
  5%|▌         | 2073/37963 [4:40:58<76:07:56,  7.64s/it]
  5%|▌         | 2074/37963 [4:41:05<76:04:23,  7.63s/it]
  5%|▌         | 2075/37963 [4:41:13<76:43:44,  7.70s/it]
  5%|▌         | 2076/37963 [4:41:21<76:37:49,  7.69s/it]
  5%|▌         | 2077/37963 [4:41:29<76:25:26,  7.67s/it]
  5%|▌         | 2078/37963 [4:41:36<76:15:47,  7.65s/it]
  5%|▌         | 2079/37963 [4:41:46<83:23:22,  8.37s/it]
  5%|▌         | 2080/37963 [4:41:56<89:07:37,  8.94s/it]
                                                         
{'loss': '0.1822', 'grad_norm': '5.949', 'learning_rate': '1.997e-05', 'epoch': '0.05479'}
+
  5%|▌         | 2080/37963 [4:41:56<89:07:37,  8.94s/it]
  5%|▌         | 2081/37963 [4:42:04<84:54:34,  8.52s/it]
  5%|▌         | 2082/37963 [4:42:12<82:00:48,  8.23s/it]
  5%|▌         | 2083/37963 [4:42:19<79:34:32,  7.98s/it]
  5%|▌         | 2084/37963 [4:42:27<78:59:09,  7.93s/it]
  5%|▌         | 2085/37963 [4:42:34<77:45:59,  7.80s/it]
  5%|▌         | 2086/37963 [4:42:42<77:39:30,  7.79s/it]
  5%|▌         | 2087/37963 [4:42:50<77:04:35,  7.73s/it]
  6%|▌         | 2088/37963 [4:42:57<76:07:14,  7.64s/it]
  6%|▌         | 2089/37963 [4:43:05<76:31:04,  7.68s/it]
  6%|▌         | 2090/37963 [4:43:12<75:54:34,  7.62s/it]
                                                         
{'loss': '0.1917', 'grad_norm': '3.115', 'learning_rate': '1.997e-05', 'epoch': '0.05505'}
+
  6%|▌         | 2090/37963 [4:43:12<75:54:34,  7.62s/it]
  6%|▌         | 2091/37963 [4:43:20<76:10:29,  7.64s/it]
  6%|▌         | 2092/37963 [4:43:28<75:57:12,  7.62s/it]
  6%|▌         | 2093/37963 [4:43:38<84:11:51,  8.45s/it]
  6%|▌         | 2094/37963 [4:43:46<81:37:51,  8.19s/it]
  6%|▌         | 2095/37963 [4:43:53<80:09:04,  8.04s/it]
  6%|▌         | 2096/37963 [4:44:01<78:35:05,  7.89s/it]
  6%|▌         | 2097/37963 [4:44:08<77:24:45,  7.77s/it]
  6%|▌         | 2098/37963 [4:44:16<76:28:45,  7.68s/it]
  6%|▌         | 2099/37963 [4:44:26<83:27:13,  8.38s/it]
  6%|▌         | 2100/37963 [4:44:34<82:01:31,  8.23s/it]
                                                         
{'loss': '0.1997', 'grad_norm': '3.685', 'learning_rate': '1.997e-05', 'epoch': '0.05532'}
+
  6%|▌         | 2100/37963 [4:44:34<82:01:31,  8.23s/it]
  6%|▌         | 2101/37963 [4:44:41<80:09:50,  8.05s/it]
  6%|▌         | 2102/37963 [4:44:49<78:43:12,  7.90s/it]
  6%|▌         | 2103/37963 [4:45:02<93:19:24,  9.37s/it]
  6%|▌         | 2104/37963 [4:45:09<87:12:44,  8.76s/it]
  6%|▌         | 2105/37963 [4:45:16<83:29:56,  8.38s/it]
  6%|▌         | 2106/37963 [4:45:27<89:36:26,  9.00s/it]
  6%|▌         | 2107/37963 [4:45:35<86:33:56,  8.69s/it]
  6%|▌         | 2108/37963 [4:45:45<90:28:50,  9.08s/it]
  6%|▌         | 2109/37963 [4:45:52<85:53:41,  8.62s/it]
  6%|▌         | 2110/37963 [4:46:00<82:11:41,  8.25s/it]
                                                         
{'loss': '0.1761', 'grad_norm': '5.683', 'learning_rate': '1.997e-05', 'epoch': '0.05558'}
+
  6%|▌         | 2110/37963 [4:46:00<82:11:41,  8.25s/it]
  6%|▌         | 2111/37963 [4:46:07<79:31:11,  7.98s/it]
  6%|▌         | 2112/37963 [4:46:15<78:06:05,  7.84s/it]
  6%|▌         | 2113/37963 [4:46:22<77:20:27,  7.77s/it]
  6%|▌         | 2114/37963 [4:46:30<76:50:16,  7.72s/it]
  6%|▌         | 2115/37963 [4:46:37<76:32:59,  7.69s/it]
  6%|▌         | 2116/37963 [4:46:45<76:33:04,  7.69s/it]
  6%|▌         | 2117/37963 [4:46:53<76:13:20,  7.65s/it]
  6%|▌         | 2118/37963 [4:47:00<75:09:32,  7.55s/it]
  6%|▌         | 2119/37963 [4:47:08<75:06:48,  7.54s/it]
  6%|▌         | 2120/37963 [4:47:15<75:07:10,  7.54s/it]
                                                         
{'loss': '0.2014', 'grad_norm': '4.704', 'learning_rate': '1.997e-05', 'epoch': '0.05584'}
+
  6%|▌         | 2120/37963 [4:47:15<75:07:10,  7.54s/it]
  6%|▌         | 2121/37963 [4:47:23<75:18:45,  7.56s/it]
  6%|▌         | 2122/37963 [4:47:30<75:23:45,  7.57s/it]
  6%|▌         | 2123/37963 [4:47:38<76:00:05,  7.63s/it]
  6%|▌         | 2124/37963 [4:47:48<83:13:06,  8.36s/it]
  6%|▌         | 2125/37963 [4:47:56<80:33:47,  8.09s/it]
  6%|▌         | 2126/37963 [4:48:03<79:04:14,  7.94s/it]
  6%|▌         | 2127/37963 [4:48:11<78:32:49,  7.89s/it]
  6%|▌         | 2128/37963 [4:48:21<85:42:09,  8.61s/it]
  6%|▌         | 2129/37963 [4:48:29<82:55:20,  8.33s/it]
  6%|▌         | 2130/37963 [4:48:37<81:09:06,  8.15s/it]
                                                         
{'loss': '0.2043', 'grad_norm': '7.783', 'learning_rate': '1.996e-05', 'epoch': '0.05611'}
+
  6%|▌         | 2130/37963 [4:48:37<81:09:06,  8.15s/it]
  6%|▌         | 2131/37963 [4:48:44<79:56:54,  8.03s/it]
  6%|▌         | 2132/37963 [4:48:52<78:30:14,  7.89s/it]
  6%|▌         | 2133/37963 [4:49:00<77:26:30,  7.78s/it]
  6%|▌         | 2134/37963 [4:49:07<77:09:07,  7.75s/it]
  6%|▌         | 2135/37963 [4:49:15<77:20:23,  7.77s/it]
  6%|▌         | 2136/37963 [4:49:22<76:22:06,  7.67s/it]
  6%|▌         | 2137/37963 [4:49:30<75:53:34,  7.63s/it]
  6%|▌         | 2138/37963 [4:49:37<75:31:38,  7.59s/it]
  6%|▌         | 2139/37963 [4:49:45<75:49:47,  7.62s/it]
  6%|▌         | 2140/37963 [4:49:53<75:52:11,  7.62s/it]
                                                         
{'loss': '0.1887', 'grad_norm': '3.179', 'learning_rate': '1.996e-05', 'epoch': '0.05637'}
+
  6%|▌         | 2140/37963 [4:49:53<75:52:11,  7.62s/it]
  6%|▌         | 2141/37963 [4:50:03<84:30:58,  8.49s/it]
  6%|▌         | 2142/37963 [4:50:11<82:26:22,  8.29s/it]
  6%|▌         | 2143/37963 [4:50:19<81:10:08,  8.16s/it]
  6%|▌         | 2144/37963 [4:50:27<80:17:08,  8.07s/it]
  6%|▌         | 2145/37963 [4:50:34<78:44:18,  7.91s/it]
  6%|▌         | 2146/37963 [4:50:42<77:58:31,  7.84s/it]
  6%|▌         | 2147/37963 [4:50:52<85:14:34,  8.57s/it]
  6%|▌         | 2148/37963 [4:51:00<81:57:09,  8.24s/it]
  6%|▌         | 2149/37963 [4:51:07<79:40:21,  8.01s/it]
  6%|▌         | 2150/37963 [4:51:15<77:35:58,  7.80s/it]
                                                         
{'loss': '0.1772', 'grad_norm': '2.664', 'learning_rate': '1.996e-05', 'epoch': '0.05663'}
+
  6%|▌         | 2150/37963 [4:51:15<77:35:58,  7.80s/it]
  6%|▌         | 2151/37963 [4:51:22<77:15:07,  7.77s/it]
  6%|▌         | 2152/37963 [4:51:30<76:53:21,  7.73s/it]
  6%|▌         | 2153/37963 [4:51:43<92:14:01,  9.27s/it]
  6%|▌         | 2154/37963 [4:51:50<87:01:34,  8.75s/it]
  6%|▌         | 2155/37963 [4:51:58<83:42:19,  8.42s/it]
  6%|▌         | 2156/37963 [4:52:11<96:39:45,  9.72s/it]
  6%|▌         | 2157/37963 [4:52:18<90:16:33,  9.08s/it]
  6%|▌         | 2158/37963 [4:52:26<84:47:06,  8.52s/it]
  6%|▌         | 2159/37963 [4:52:33<82:07:36,  8.26s/it]
  6%|▌         | 2160/37963 [4:52:41<79:49:15,  8.03s/it]
                                                         
{'loss': '0.1685', 'grad_norm': '3.071', 'learning_rate': '1.996e-05', 'epoch': '0.0569'}
+
  6%|▌         | 2160/37963 [4:52:41<79:49:15,  8.03s/it]
  6%|▌         | 2161/37963 [4:52:48<79:08:41,  7.96s/it]
  6%|▌         | 2162/37963 [4:52:56<77:47:57,  7.82s/it]
  6%|▌         | 2163/37963 [4:53:04<77:10:51,  7.76s/it]
  6%|▌         | 2164/37963 [4:53:11<76:16:09,  7.67s/it]
  6%|▌         | 2165/37963 [4:53:19<76:35:07,  7.70s/it]
  6%|▌         | 2166/37963 [4:53:27<76:52:44,  7.73s/it]
  6%|▌         | 2167/37963 [4:53:34<76:29:13,  7.69s/it]
  6%|▌         | 2168/37963 [4:53:42<76:00:40,  7.64s/it]
  6%|▌         | 2169/37963 [4:53:49<75:19:18,  7.58s/it]
  6%|▌         | 2170/37963 [4:53:57<75:20:23,  7.58s/it]
                                                         
{'loss': '0.1714', 'grad_norm': '3.73', 'learning_rate': '1.996e-05', 'epoch': '0.05716'}
+
  6%|▌         | 2170/37963 [4:53:57<75:20:23,  7.58s/it]
  6%|▌         | 2171/37963 [4:54:04<75:52:39,  7.63s/it]
  6%|▌         | 2172/37963 [4:54:15<83:26:16,  8.39s/it]
  6%|▌         | 2173/37963 [4:54:23<82:06:26,  8.26s/it]
  6%|▌         | 2174/37963 [4:54:30<80:17:30,  8.08s/it]
  6%|▌         | 2175/37963 [4:54:38<79:36:40,  8.01s/it]
  6%|▌         | 2176/37963 [4:54:46<79:08:32,  7.96s/it]
  6%|▌         | 2177/37963 [4:54:53<77:53:16,  7.84s/it]
  6%|▌         | 2178/37963 [4:55:01<76:53:46,  7.74s/it]
  6%|▌         | 2179/37963 [4:55:09<76:57:08,  7.74s/it]
  6%|▌         | 2180/37963 [4:55:16<76:07:01,  7.66s/it]
                                                         
{'loss': '0.2153', 'grad_norm': '3.485', 'learning_rate': '1.996e-05', 'epoch': '0.05742'}
+
  6%|▌         | 2180/37963 [4:55:16<76:07:01,  7.66s/it]
  6%|▌         | 2181/37963 [4:55:24<76:04:25,  7.65s/it]
  6%|▌         | 2182/37963 [4:55:34<84:57:23,  8.55s/it]
  6%|▌         | 2183/37963 [4:55:42<83:00:18,  8.35s/it]
  6%|▌         | 2184/37963 [4:55:50<81:15:46,  8.18s/it]
  6%|▌         | 2185/37963 [4:55:58<79:12:02,  7.97s/it]
  6%|▌         | 2186/37963 [4:56:05<78:45:17,  7.92s/it]
  6%|▌         | 2187/37963 [4:56:13<76:26:37,  7.69s/it]
  6%|▌         | 2188/37963 [4:56:21<77:24:36,  7.79s/it]
  6%|▌         | 2189/37963 [4:56:31<85:16:38,  8.58s/it]
  6%|▌         | 2190/37963 [4:56:39<82:15:33,  8.28s/it]
                                                         
{'loss': '0.1991', 'grad_norm': '8.013', 'learning_rate': '1.996e-05', 'epoch': '0.05769'}
+
  6%|▌         | 2190/37963 [4:56:39<82:15:33,  8.28s/it]
  6%|▌         | 2191/37963 [4:56:49<87:40:33,  8.82s/it]
  6%|▌         | 2192/37963 [4:56:56<84:22:29,  8.49s/it]
  6%|▌         | 2193/37963 [4:57:04<80:44:42,  8.13s/it]
  6%|▌         | 2194/37963 [4:57:11<79:04:45,  7.96s/it]
  6%|▌         | 2195/37963 [4:57:19<78:44:18,  7.92s/it]
  6%|▌         | 2196/37963 [4:57:27<77:37:14,  7.81s/it]
  6%|▌         | 2197/37963 [4:57:37<84:25:43,  8.50s/it]
  6%|▌         | 2198/37963 [4:57:44<81:23:08,  8.19s/it]
  6%|▌         | 2199/37963 [4:57:52<79:35:30,  8.01s/it]
  6%|▌         | 2200/37963 [4:57:59<78:03:44,  7.86s/it]
                                                         
{'loss': '0.1787', 'grad_norm': '1.846', 'learning_rate': '1.996e-05', 'epoch': '0.05795'}
+
  6%|��         | 2200/37963 [4:57:59<78:03:44,  7.86s/it]
  6%|▌         | 2201/37963 [4:58:07<77:23:22,  7.79s/it]
  6%|▌         | 2202/37963 [4:58:17<84:29:02,  8.50s/it]
  6%|▌         | 2203/37963 [4:58:25<82:41:58,  8.33s/it]
  6%|▌         | 2204/37963 [4:58:33<81:01:21,  8.16s/it]
  6%|▌         | 2205/37963 [4:58:43<87:35:21,  8.82s/it]
  6%|▌         | 2206/37963 [4:58:51<83:50:14,  8.44s/it]
  6%|▌         | 2207/37963 [4:58:59<82:13:27,  8.28s/it]
  6%|▌         | 2208/37963 [4:59:06<80:09:27,  8.07s/it]
  6%|▌         | 2209/37963 [4:59:14<78:46:38,  7.93s/it]
  6%|▌         | 2210/37963 [4:59:24<85:15:08,  8.58s/it]
                                                         
{'loss': '0.1927', 'grad_norm': '5.307', 'learning_rate': '1.996e-05', 'epoch': '0.05821'}
+
  6%|▌         | 2210/37963 [4:59:24<85:15:08,  8.58s/it]
  6%|▌         | 2211/37963 [4:59:32<82:57:30,  8.35s/it]
  6%|▌         | 2212/37963 [4:59:39<81:04:30,  8.16s/it]
  6%|▌         | 2213/37963 [4:59:47<79:19:52,  7.99s/it]
  6%|▌         | 2214/37963 [4:59:55<78:26:21,  7.90s/it]
  6%|▌         | 2215/37963 [5:00:03<78:12:13,  7.88s/it]
  6%|▌         | 2216/37963 [5:00:10<77:39:17,  7.82s/it]
  6%|▌         | 2217/37963 [5:00:18<76:19:11,  7.69s/it]
  6%|▌         | 2218/37963 [5:00:25<76:05:21,  7.66s/it]
  6%|▌         | 2219/37963 [5:00:33<75:36:56,  7.62s/it]
  6%|▌         | 2220/37963 [5:00:43<82:56:54,  8.35s/it]
                                                         
{'loss': '0.1798', 'grad_norm': '2.012', 'learning_rate': '1.996e-05', 'epoch': '0.05848'}
+
  6%|▌         | 2220/37963 [5:00:43<82:56:54,  8.35s/it]
  6%|▌         | 2221/37963 [5:00:51<81:13:01,  8.18s/it]
  6%|▌         | 2222/37963 [5:00:58<79:40:04,  8.02s/it]
  6%|▌         | 2223/37963 [5:01:06<78:21:58,  7.89s/it]
  6%|▌         | 2224/37963 [5:01:14<77:53:24,  7.85s/it]
  6%|▌         | 2225/37963 [5:01:21<77:27:32,  7.80s/it]
  6%|▌         | 2226/37963 [5:01:31<83:40:27,  8.43s/it]
  6%|▌         | 2227/37963 [5:01:39<81:25:09,  8.20s/it]
  6%|▌         | 2228/37963 [5:01:47<79:55:14,  8.05s/it]
  6%|▌         | 2229/37963 [5:01:54<78:58:55,  7.96s/it]
  6%|▌         | 2230/37963 [5:02:02<78:15:32,  7.88s/it]
                                                         
{'loss': '0.1961', 'grad_norm': '3.943', 'learning_rate': '1.996e-05', 'epoch': '0.05874'}
+
  6%|▌         | 2230/37963 [5:02:02<78:15:32,  7.88s/it]
  6%|▌         | 2231/37963 [5:02:10<77:14:58,  7.78s/it]
  6%|▌         | 2232/37963 [5:02:17<77:16:46,  7.79s/it]
  6%|▌         | 2233/37963 [5:02:25<76:51:47,  7.74s/it]
  6%|▌         | 2234/37963 [5:02:35<83:39:16,  8.43s/it]
  6%|▌         | 2235/37963 [5:02:43<81:35:51,  8.22s/it]
  6%|▌         | 2236/37963 [5:02:51<80:12:55,  8.08s/it]
  6%|▌         | 2237/37963 [5:03:00<85:50:27,  8.65s/it]
  6%|▌         | 2238/37963 [5:03:08<82:37:20,  8.33s/it]
  6%|▌         | 2239/37963 [5:03:16<80:05:09,  8.07s/it]
  6%|▌         | 2240/37963 [5:03:25<84:50:59,  8.55s/it]
                                                         
{'loss': '0.1775', 'grad_norm': '5.295', 'learning_rate': '1.996e-05', 'epoch': '0.05901'}
+
  6%|▌         | 2240/37963 [5:03:25<84:50:59,  8.55s/it]
  6%|▌         | 2241/37963 [5:03:33<81:34:50,  8.22s/it]
  6%|▌         | 2242/37963 [5:03:40<79:36:47,  8.02s/it]
  6%|▌         | 2243/37963 [5:03:48<78:47:15,  7.94s/it]
  6%|▌         | 2244/37963 [5:03:56<79:06:24,  7.97s/it]
  6%|▌         | 2245/37963 [5:04:03<77:29:02,  7.81s/it]
  6%|▌         | 2246/37963 [5:04:13<84:01:00,  8.47s/it]
  6%|▌         | 2247/37963 [5:04:21<81:13:49,  8.19s/it]
  6%|▌         | 2248/37963 [5:04:29<79:31:04,  8.02s/it]
  6%|▌         | 2249/37963 [5:04:39<86:00:34,  8.67s/it]
  6%|▌         | 2250/37963 [5:04:46<82:40:24,  8.33s/it]
                                                         
{'loss': '0.1855', 'grad_norm': '4.127', 'learning_rate': '1.996e-05', 'epoch': '0.05927'}
+
  6%|▌         | 2250/37963 [5:04:46<82:40:24,  8.33s/it]
  6%|▌         | 2251/37963 [5:04:54<80:11:55,  8.08s/it]
  6%|▌         | 2252/37963 [5:05:01<78:32:39,  7.92s/it]
  6%|▌         | 2253/37963 [5:05:09<78:13:48,  7.89s/it]
  6%|▌         | 2254/37963 [5:05:17<77:37:24,  7.83s/it]
  6%|▌         | 2255/37963 [5:05:24<76:04:03,  7.67s/it]
  6%|▌         | 2256/37963 [5:05:32<76:19:15,  7.69s/it]
  6%|▌         | 2257/37963 [5:05:39<75:37:15,  7.62s/it]
  6%|▌         | 2258/37963 [5:05:47<75:00:51,  7.56s/it]
  6%|▌         | 2259/37963 [5:05:54<75:06:09,  7.57s/it]
  6%|▌         | 2260/37963 [5:06:02<75:30:28,  7.61s/it]
                                                         
{'loss': '0.1788', 'grad_norm': '2.153', 'learning_rate': '1.995e-05', 'epoch': '0.05953'}
+
  6%|▌         | 2260/37963 [5:06:02<75:30:28,  7.61s/it]
  6%|▌         | 2261/37963 [5:06:10<75:38:44,  7.63s/it]
  6%|▌         | 2262/37963 [5:06:18<76:08:35,  7.68s/it]
  6%|▌         | 2263/37963 [5:06:28<83:09:23,  8.39s/it]
  6%|▌         | 2264/37963 [5:06:35<81:19:22,  8.20s/it]
  6%|▌         | 2265/37963 [5:06:43<79:44:55,  8.04s/it]
  6%|▌         | 2266/37963 [5:06:51<79:15:23,  7.99s/it]
  6%|▌         | 2267/37963 [5:06:59<78:32:19,  7.92s/it]
  6%|▌         | 2268/37963 [5:07:06<78:11:29,  7.89s/it]
  6%|▌         | 2269/37963 [5:07:14<78:10:15,  7.88s/it]
  6%|▌         | 2270/37963 [5:07:24<84:37:08,  8.53s/it]
                                                         
{'loss': '0.1771', 'grad_norm': '4.721', 'learning_rate': '1.995e-05', 'epoch': '0.0598'}
+
  6%|▌         | 2270/37963 [5:07:24<84:37:08,  8.53s/it]
  6%|▌         | 2271/37963 [5:07:32<82:12:01,  8.29s/it]
  6%|▌         | 2272/37963 [5:07:40<79:49:32,  8.05s/it]
  6%|▌         | 2273/37963 [5:07:47<77:21:22,  7.80s/it]
  6%|▌         | 2274/37963 [5:07:57<84:35:58,  8.53s/it]
  6%|▌         | 2275/37963 [5:08:05<81:42:20,  8.24s/it]
  6%|▌         | 2276/37963 [5:08:12<79:12:03,  7.99s/it]
  6%|▌         | 2277/37963 [5:08:20<78:18:02,  7.90s/it]
  6%|▌         | 2278/37963 [5:08:27<77:06:10,  7.78s/it]
  6%|▌         | 2279/37963 [5:08:35<76:20:18,  7.70s/it]
  6%|▌         | 2280/37963 [5:08:42<76:12:57,  7.69s/it]
                                                         
{'loss': '0.1954', 'grad_norm': '4.126', 'learning_rate': '1.995e-05', 'epoch': '0.06006'}
+
  6%|▌         | 2280/37963 [5:08:42<76:12:57,  7.69s/it]
  6%|▌         | 2281/37963 [5:08:50<76:03:46,  7.67s/it]
  6%|▌         | 2282/37963 [5:09:00<82:35:19,  8.33s/it]
  6%|▌         | 2283/37963 [5:09:07<80:09:23,  8.09s/it]
  6%|▌         | 2284/37963 [5:09:15<78:46:55,  7.95s/it]
  6%|▌         | 2285/37963 [5:09:22<77:07:45,  7.78s/it]
  6%|▌         | 2286/37963 [5:09:33<84:18:58,  8.51s/it]
  6%|▌         | 2287/37963 [5:09:40<81:42:40,  8.25s/it]
  6%|▌         | 2288/37963 [5:09:48<79:33:52,  8.03s/it]
  6%|▌         | 2289/37963 [5:09:55<78:26:43,  7.92s/it]
  6%|▌         | 2290/37963 [5:10:03<77:08:56,  7.79s/it]
                                                         
{'loss': '0.1781', 'grad_norm': '4.265', 'learning_rate': '1.995e-05', 'epoch': '0.06032'}
+
  6%|▌         | 2290/37963 [5:10:03<77:08:56,  7.79s/it]
  6%|▌         | 2291/37963 [5:10:11<76:46:43,  7.75s/it]
  6%|▌         | 2292/37963 [5:10:18<76:01:49,  7.67s/it]
  6%|▌         | 2293/37963 [5:10:28<83:10:27,  8.39s/it]
  6%|▌         | 2294/37963 [5:10:38<87:13:11,  8.80s/it]
  6%|▌         | 2295/37963 [5:10:46<83:49:15,  8.46s/it]
  6%|▌         | 2296/37963 [5:10:53<81:41:13,  8.24s/it]
  6%|▌         | 2297/37963 [5:11:01<80:04:49,  8.08s/it]
  6%|▌         | 2298/37963 [5:11:09<78:58:19,  7.97s/it]
  6%|▌         | 2299/37963 [5:11:19<85:32:34,  8.63s/it]
  6%|▌         | 2300/37963 [5:11:27<82:48:44,  8.36s/it]
                                                         
{'loss': '0.1806', 'grad_norm': '5.566', 'learning_rate': '1.995e-05', 'epoch': '0.06059'}
+
  6%|▌         | 2300/37963 [5:11:27<82:48:44,  8.36s/it]
  6%|▌         | 2301/37963 [5:11:34<79:47:41,  8.06s/it]
  6%|▌         | 2302/37963 [5:11:42<78:49:09,  7.96s/it]
  6%|▌         | 2303/37963 [5:11:49<77:40:34,  7.84s/it]
  6%|▌         | 2304/37963 [5:11:57<76:21:41,  7.71s/it]
  6%|▌         | 2305/37963 [5:12:04<76:04:40,  7.68s/it]
  6%|▌         | 2306/37963 [5:12:12<76:32:43,  7.73s/it]
  6%|▌         | 2307/37963 [5:12:20<76:12:36,  7.69s/it]
  6%|▌         | 2308/37963 [5:12:27<76:09:12,  7.69s/it]
  6%|▌         | 2309/37963 [5:12:35<75:37:01,  7.64s/it]
  6%|▌         | 2310/37963 [5:12:43<75:24:31,  7.61s/it]
                                                         
{'loss': '0.1769', 'grad_norm': '2.041', 'learning_rate': '1.995e-05', 'epoch': '0.06085'}
+
  6%|▌         | 2310/37963 [5:12:43<75:24:31,  7.61s/it]
  6%|▌         | 2311/37963 [5:12:50<75:51:49,  7.66s/it]
  6%|▌         | 2312/37963 [5:12:58<75:56:58,  7.67s/it]
  6%|▌         | 2313/37963 [5:13:11<91:31:45,  9.24s/it]
  6%|▌         | 2314/37963 [5:13:19<87:27:43,  8.83s/it]
  6%|▌         | 2315/37963 [5:13:27<84:17:31,  8.51s/it]
  6%|▌         | 2316/37963 [5:13:34<81:55:39,  8.27s/it]
  6%|▌         | 2317/37963 [5:13:42<79:18:58,  8.01s/it]
  6%|▌         | 2318/37963 [5:13:49<78:06:11,  7.89s/it]
  6%|▌         | 2319/37963 [5:13:57<77:10:58,  7.80s/it]
  6%|▌         | 2320/37963 [5:14:04<76:35:13,  7.74s/it]
                                                         
{'loss': '0.1885', 'grad_norm': '4.222', 'learning_rate': '1.995e-05', 'epoch': '0.06111'}
+
  6%|▌         | 2320/37963 [5:14:04<76:35:13,  7.74s/it]
  6%|▌         | 2321/37963 [5:14:12<76:24:30,  7.72s/it]
  6%|▌         | 2322/37963 [5:14:20<75:52:14,  7.66s/it]
  6%|▌         | 2323/37963 [5:14:27<75:45:48,  7.65s/it]
  6%|▌         | 2324/37963 [5:14:35<76:16:07,  7.70s/it]
  6%|▌         | 2325/37963 [5:14:43<76:10:03,  7.69s/it]
  6%|▌         | 2326/37963 [5:14:50<75:25:48,  7.62s/it]
  6%|▌         | 2327/37963 [5:14:58<75:54:33,  7.67s/it]
  6%|▌         | 2328/37963 [5:15:08<83:13:20,  8.41s/it]
  6%|▌         | 2329/37963 [5:15:16<80:24:34,  8.12s/it]
  6%|▌         | 2330/37963 [5:15:23<79:31:50,  8.03s/it]
                                                         
{'loss': '0.1839', 'grad_norm': '3.456', 'learning_rate': '1.995e-05', 'epoch': '0.06138'}
+
  6%|▌         | 2330/37963 [5:15:23<79:31:50,  8.03s/it]
  6%|▌         | 2331/37963 [5:15:33<85:31:55,  8.64s/it]
  6%|▌         | 2332/37963 [5:15:44<90:21:23,  9.13s/it]
  6%|▌         | 2333/37963 [5:15:51<86:10:20,  8.71s/it]
  6%|▌         | 2334/37963 [5:15:59<82:42:19,  8.36s/it]
  6%|▌         | 2335/37963 [5:16:06<80:06:39,  8.09s/it]
  6%|▌         | 2336/37963 [5:16:14<79:19:28,  8.02s/it]
  6%|▌         | 2337/37963 [5:16:25<85:59:45,  8.69s/it]
  6%|▌         | 2338/37963 [5:16:35<91:05:36,  9.21s/it]
  6%|▌         | 2339/37963 [5:16:43<87:06:05,  8.80s/it]
  6%|▌         | 2340/37963 [5:16:50<83:29:00,  8.44s/it]
                                                         
{'loss': '0.1972', 'grad_norm': '7.061', 'learning_rate': '1.995e-05', 'epoch': '0.06164'}
+
  6%|▌         | 2340/37963 [5:16:50<83:29:00,  8.44s/it]
  6%|▌         | 2341/37963 [5:16:58<80:44:14,  8.16s/it]
  6%|▌         | 2342/37963 [5:17:06<79:40:10,  8.05s/it]
  6%|▌         | 2343/37963 [5:17:13<78:17:39,  7.91s/it]
  6%|▌         | 2344/37963 [5:17:21<77:48:11,  7.86s/it]
  6%|▌         | 2345/37963 [5:17:28<76:10:15,  7.70s/it]
  6%|▌         | 2346/37963 [5:17:36<76:14:20,  7.71s/it]
  6%|▌         | 2347/37963 [5:17:46<82:10:42,  8.31s/it]
  6%|▌         | 2348/37963 [5:17:54<81:12:34,  8.21s/it]
  6%|▌         | 2349/37963 [5:18:01<79:15:15,  8.01s/it]
  6%|▌         | 2350/37963 [5:18:09<77:51:41,  7.87s/it]
                                                         
{'loss': '0.2023', 'grad_norm': '4.82', 'learning_rate': '1.995e-05', 'epoch': '0.0619'}
+
  6%|▌         | 2350/37963 [5:18:09<77:51:41,  7.87s/it]
  6%|▌         | 2351/37963 [5:18:17<77:48:48,  7.87s/it]
  6%|▌         | 2352/37963 [5:18:24<76:46:14,  7.76s/it]
  6%|▌         | 2353/37963 [5:18:32<75:39:17,  7.65s/it]
  6%|▌         | 2354/37963 [5:18:39<75:10:04,  7.60s/it]
  6%|▌         | 2355/37963 [5:18:47<75:15:57,  7.61s/it]
  6%|▌         | 2356/37963 [5:18:54<75:01:09,  7.58s/it]
  6%|▌         | 2357/37963 [5:19:05<83:08:03,  8.41s/it]
  6%|▌         | 2358/37963 [5:19:12<80:44:23,  8.16s/it]
  6%|▌         | 2359/37963 [5:19:20<78:10:03,  7.90s/it]
  6%|▌         | 2360/37963 [5:19:27<78:09:19,  7.90s/it]
                                                         
{'loss': '0.2005', 'grad_norm': '6.088', 'learning_rate': '1.995e-05', 'epoch': '0.06217'}
+
  6%|▌         | 2360/37963 [5:19:27<78:09:19,  7.90s/it]
  6%|▌         | 2361/37963 [5:19:35<77:04:22,  7.79s/it]
  6%|▌         | 2362/37963 [5:19:43<76:27:28,  7.73s/it]
  6%|▌         | 2363/37963 [5:19:50<76:09:21,  7.70s/it]
  6%|▌         | 2364/37963 [5:20:01<85:08:38,  8.61s/it]
  6%|▌         | 2365/37963 [5:20:08<81:09:02,  8.21s/it]
  6%|▌         | 2366/37963 [5:20:16<78:41:45,  7.96s/it]
  6%|▌         | 2367/37963 [5:20:23<77:33:16,  7.84s/it]
  6%|▌         | 2368/37963 [5:20:31<76:52:46,  7.78s/it]
  6%|▌         | 2369/37963 [5:20:38<75:43:33,  7.66s/it]
  6%|▌         | 2370/37963 [5:20:46<75:41:04,  7.66s/it]
                                                         
{'loss': '0.1811', 'grad_norm': '5.381', 'learning_rate': '1.994e-05', 'epoch': '0.06243'}
+
  6%|▌         | 2370/37963 [5:20:46<75:41:04,  7.66s/it]
  6%|▌         | 2371/37963 [5:20:54<76:15:02,  7.71s/it]
  6%|▌         | 2372/37963 [5:21:01<76:07:18,  7.70s/it]
  6%|▋         | 2373/37963 [5:21:09<75:41:51,  7.66s/it]
  6%|▋         | 2374/37963 [5:21:16<75:38:13,  7.65s/it]
  6%|▋         | 2375/37963 [5:21:26<82:24:16,  8.34s/it]
  6%|▋         | 2376/37963 [5:21:37<87:48:36,  8.88s/it]
  6%|▋         | 2377/37963 [5:21:44<84:53:47,  8.59s/it]
  6%|▋         | 2378/37963 [5:21:52<81:46:43,  8.27s/it]
  6%|▋         | 2379/37963 [5:22:02<87:06:37,  8.81s/it]
  6%|▋         | 2380/37963 [5:22:10<84:41:20,  8.57s/it]
                                                         
{'loss': '0.1741', 'grad_norm': '3.897', 'learning_rate': '1.994e-05', 'epoch': '0.06269'}
+
  6%|▋         | 2380/37963 [5:22:10<84:41:20,  8.57s/it]
  6%|▋         | 2381/37963 [5:22:17<80:50:36,  8.18s/it]
  6%|▋         | 2382/37963 [5:22:25<79:27:00,  8.04s/it]
  6%|▋         | 2383/37963 [5:22:32<77:17:33,  7.82s/it]
  6%|▋         | 2384/37963 [5:22:40<76:17:08,  7.72s/it]
  6%|▋         | 2385/37963 [5:22:47<75:49:03,  7.67s/it]
  6%|▋         | 2386/37963 [5:22:57<82:22:33,  8.34s/it]
  6%|▋         | 2387/37963 [5:23:05<79:43:28,  8.07s/it]
  6%|▋         | 2388/37963 [5:23:12<78:05:23,  7.90s/it]
  6%|▋         | 2389/37963 [5:23:20<77:13:01,  7.81s/it]
  6%|▋         | 2390/37963 [5:23:27<76:23:55,  7.73s/it]
                                                         
{'loss': '0.1888', 'grad_norm': '6.075', 'learning_rate': '1.994e-05', 'epoch': '0.06296'}
+
  6%|▋         | 2390/37963 [5:23:27<76:23:55,  7.73s/it]
  6%|▋         | 2391/37963 [5:23:38<83:56:41,  8.50s/it]
  6%|▋         | 2392/37963 [5:23:46<82:08:31,  8.31s/it]
  6%|▋         | 2393/37963 [5:23:53<79:57:32,  8.09s/it]
  6%|▋         | 2394/37963 [5:24:01<79:15:40,  8.02s/it]
  6%|▋         | 2395/37963 [5:24:09<77:48:23,  7.88s/it]
  6%|▋         | 2396/37963 [5:24:16<77:05:24,  7.80s/it]
  6%|▋         | 2397/37963 [5:24:24<76:23:55,  7.73s/it]
  6%|▋         | 2398/37963 [5:24:32<76:28:10,  7.74s/it]
  6%|▋         | 2399/37963 [5:24:39<75:36:25,  7.65s/it]
  6%|▋         | 2400/37963 [5:24:47<76:04:53,  7.70s/it]
                                                         
{'loss': '0.1825', 'grad_norm': '4.088', 'learning_rate': '1.994e-05', 'epoch': '0.06322'}
+
  6%|▋         | 2400/37963 [5:24:47<76:04:53,  7.70s/it]
  6%|▋         | 2401/37963 [5:24:57<83:34:43,  8.46s/it]
  6%|▋         | 2402/37963 [5:25:05<81:10:04,  8.22s/it]
  6%|▋         | 2403/37963 [5:25:15<86:56:38,  8.80s/it]
  6%|▋         | 2404/37963 [5:25:23<84:00:06,  8.50s/it]
  6%|▋         | 2405/37963 [5:25:30<81:18:42,  8.23s/it]
  6%|▋         | 2406/37963 [5:25:38<78:57:16,  7.99s/it]
  6%|▋         | 2407/37963 [5:25:45<77:28:24,  7.84s/it]
  6%|▋         | 2408/37963 [5:25:53<76:55:41,  7.79s/it]
  6%|▋         | 2409/37963 [5:26:00<76:03:40,  7.70s/it]
  6%|▋         | 2410/37963 [5:26:08<75:20:37,  7.63s/it]
                                                         
{'loss': '0.1881', 'grad_norm': '2.114', 'learning_rate': '1.994e-05', 'epoch': '0.06348'}
+
  6%|▋         | 2410/37963 [5:26:08<75:20:37,  7.63s/it]
  6%|▋         | 2411/37963 [5:26:18<82:02:46,  8.31s/it]
  6%|▋         | 2412/37963 [5:26:25<79:00:45,  8.00s/it]
  6%|▋         | 2413/37963 [5:26:33<78:29:17,  7.95s/it]
  6%|▋         | 2414/37963 [5:26:40<77:40:02,  7.87s/it]
  6%|▋         | 2415/37963 [5:26:48<77:28:44,  7.85s/it]
  6%|▋         | 2416/37963 [5:26:56<76:34:59,  7.76s/it]
  6%|▋         | 2417/37963 [5:27:03<74:54:09,  7.59s/it]
  6%|▋         | 2418/37963 [5:27:10<74:35:46,  7.56s/it]
  6%|▋         | 2419/37963 [5:27:18<75:13:46,  7.62s/it]
  6%|▋         | 2420/37963 [5:27:26<74:56:32,  7.59s/it]
                                                         
{'loss': '0.1831', 'grad_norm': '2.234', 'learning_rate': '1.994e-05', 'epoch': '0.06375'}
+
  6%|▋         | 2420/37963 [5:27:26<74:56:32,  7.59s/it]
  6%|▋         | 2421/37963 [5:27:33<75:02:04,  7.60s/it]
  6%|▋         | 2422/37963 [5:27:41<74:41:31,  7.57s/it]
  6%|▋         | 2423/37963 [5:27:48<74:36:49,  7.56s/it]
  6%|▋         | 2424/37963 [5:27:59<82:40:29,  8.37s/it]
  6%|▋         | 2425/37963 [5:28:07<81:55:59,  8.30s/it]
  6%|▋         | 2426/37963 [5:28:15<80:29:32,  8.15s/it]
  6%|▋         | 2427/37963 [5:28:22<78:48:29,  7.98s/it]
  6%|▋         | 2428/37963 [5:28:30<78:02:58,  7.91s/it]
  6%|▋         | 2429/37963 [5:28:38<77:41:57,  7.87s/it]
  6%|▋         | 2430/37963 [5:28:50<90:58:34,  9.22s/it]
                                                         
{'loss': '0.1808', 'grad_norm': '3.703', 'learning_rate': '1.994e-05', 'epoch': '0.06401'}
+
  6%|▋         | 2430/37963 [5:28:50<90:58:34,  9.22s/it]
  6%|▋         | 2431/37963 [5:28:58<86:29:30,  8.76s/it]
  6%|▋         | 2432/37963 [5:29:06<84:17:47,  8.54s/it]
  6%|▋         | 2433/37963 [5:29:16<89:09:54,  9.03s/it]
  6%|▋         | 2434/37963 [5:29:24<85:49:24,  8.70s/it]
  6%|▋         | 2435/37963 [5:29:34<89:53:05,  9.11s/it]
  6%|▋         | 2436/37963 [5:29:42<86:18:33,  8.75s/it]
  6%|▋         | 2437/37963 [5:29:49<82:39:26,  8.38s/it]
  6%|▋         | 2438/37963 [5:29:57<80:45:15,  8.18s/it]
  6%|▋         | 2439/37963 [5:30:05<78:56:50,  8.00s/it]
  6%|▋         | 2440/37963 [5:30:12<78:00:13,  7.91s/it]
                                                         
{'loss': '0.1901', 'grad_norm': '8.351', 'learning_rate': '1.994e-05', 'epoch': '0.06427'}
+
  6%|▋         | 2440/37963 [5:30:12<78:00:13,  7.91s/it]
  6%|▋         | 2441/37963 [5:30:20<77:54:59,  7.90s/it]
  6%|▋         | 2442/37963 [5:30:28<76:54:27,  7.79s/it]
  6%|▋         | 2443/37963 [5:30:36<76:56:55,  7.80s/it]
  6%|▋         | 2444/37963 [5:30:43<76:54:00,  7.79s/it]
  6%|▋         | 2445/37963 [5:30:54<84:11:11,  8.53s/it]
  6%|▋         | 2446/37963 [5:31:01<80:41:01,  8.18s/it]
  6%|▋         | 2447/37963 [5:31:09<78:37:59,  7.97s/it]
  6%|▋         | 2448/37963 [5:31:16<77:18:28,  7.84s/it]
  6%|▋         | 2449/37963 [5:31:24<77:16:16,  7.83s/it]
  6%|▋         | 2450/37963 [5:31:32<77:12:35,  7.83s/it]
                                                         
{'loss': '0.1635', 'grad_norm': '2.078', 'learning_rate': '1.994e-05', 'epoch': '0.06454'}
+
  6%|▋         | 2450/37963 [5:31:32<77:12:35,  7.83s/it]
  6%|▋         | 2451/37963 [5:31:42<84:05:45,  8.53s/it]
  6%|▋         | 2452/37963 [5:31:49<80:45:56,  8.19s/it]
  6%|▋         | 2453/37963 [5:31:57<78:26:50,  7.95s/it]
  6%|▋         | 2454/37963 [5:32:05<78:27:42,  7.95s/it]
  6%|▋         | 2455/37963 [5:32:12<76:48:27,  7.79s/it]
  6%|▋         | 2456/37963 [5:32:20<76:41:43,  7.78s/it]
  6%|▋         | 2457/37963 [5:32:27<75:49:52,  7.69s/it]
  6%|▋         | 2458/37963 [5:32:35<76:14:47,  7.73s/it]
  6%|▋         | 2459/37963 [5:32:42<74:57:05,  7.60s/it]
  6%|▋         | 2460/37963 [5:32:50<74:03:24,  7.51s/it]
                                                         
{'loss': '0.1774', 'grad_norm': '2.673', 'learning_rate': '1.994e-05', 'epoch': '0.0648'}
+
  6%|▋         | 2460/37963 [5:32:50<74:03:24,  7.51s/it]
  6%|▋         | 2461/37963 [5:32:57<74:09:49,  7.52s/it]
  6%|▋         | 2462/37963 [5:33:04<73:30:16,  7.45s/it]
  6%|▋         | 2463/37963 [5:33:12<73:24:05,  7.44s/it]
  6%|▋         | 2464/37963 [5:33:20<74:02:58,  7.51s/it]
  6%|▋         | 2465/37963 [5:33:30<82:14:30,  8.34s/it]
  6%|▋         | 2466/37963 [5:33:37<80:10:04,  8.13s/it]
  6%|▋         | 2467/37963 [5:33:45<78:13:59,  7.93s/it]
  7%|▋         | 2468/37963 [5:33:53<77:50:33,  7.90s/it]
  7%|▋         | 2469/37963 [5:34:00<76:34:28,  7.77s/it]
  7%|▋         | 2470/37963 [5:34:08<75:45:53,  7.68s/it]
                                                         
{'loss': '0.181', 'grad_norm': '2.975', 'learning_rate': '1.994e-05', 'epoch': '0.06506'}
+
  7%|▋         | 2470/37963 [5:34:08<75:45:53,  7.68s/it]
  7%|▋         | 2471/37963 [5:34:15<75:26:26,  7.65s/it]
  7%|▋         | 2472/37963 [5:34:26<83:07:33,  8.43s/it]
  7%|▋         | 2473/37963 [5:34:33<80:53:41,  8.21s/it]
  7%|▋         | 2474/37963 [5:34:43<86:57:03,  8.82s/it]
  7%|▋         | 2475/37963 [5:34:51<83:35:06,  8.48s/it]
  7%|▋         | 2476/37963 [5:34:59<81:21:14,  8.25s/it]
  7%|▋         | 2477/37963 [5:35:06<78:43:21,  7.99s/it]
  7%|▋         | 2478/37963 [5:35:19<93:31:06,  9.49s/it]
  7%|▋         | 2479/37963 [5:35:27<88:55:03,  9.02s/it]
  7%|▋         | 2480/37963 [5:35:35<84:27:30,  8.57s/it]
                                                         
{'loss': '0.1956', 'grad_norm': '4.12', 'learning_rate': '1.993e-05', 'epoch': '0.06533'}
+
  7%|▋         | 2480/37963 [5:35:35<84:27:30,  8.57s/it]
  7%|▋         | 2481/37963 [5:35:45<89:10:37,  9.05s/it]
  7%|▋         | 2482/37963 [5:35:53<85:39:36,  8.69s/it]
  7%|▋         | 2483/37963 [5:36:00<82:19:21,  8.35s/it]
  7%|▋         | 2484/37963 [5:36:08<80:38:14,  8.18s/it]
  7%|▋         | 2485/37963 [5:36:16<79:15:45,  8.04s/it]
  7%|▋         | 2486/37963 [5:36:23<77:45:05,  7.89s/it]
  7%|▋         | 2487/37963 [5:36:31<77:33:52,  7.87s/it]
  7%|▋         | 2488/37963 [5:36:39<76:53:09,  7.80s/it]
  7%|▋         | 2489/37963 [5:36:46<76:35:03,  7.77s/it]
  7%|▋         | 2490/37963 [5:36:54<77:02:04,  7.82s/it]
                                                         
{'loss': '0.2022', 'grad_norm': '3.244', 'learning_rate': '1.993e-05', 'epoch': '0.06559'}
+
  7%|▋         | 2490/37963 [5:36:54<77:02:04,  7.82s/it]
  7%|▋         | 2491/37963 [5:37:02<75:39:12,  7.68s/it]
  7%|▋         | 2492/37963 [5:37:12<83:41:05,  8.49s/it]
  7%|▋         | 2493/37963 [5:37:20<81:02:56,  8.23s/it]
  7%|▋         | 2494/37963 [5:37:28<79:53:21,  8.11s/it]
  7%|▋         | 2495/37963 [5:37:36<79:34:24,  8.08s/it]
  7%|▋         | 2496/37963 [5:37:43<78:37:54,  7.98s/it]
  7%|▋         | 2497/37963 [5:37:51<77:40:57,  7.89s/it]
  7%|▋         | 2498/37963 [5:37:59<77:25:53,  7.86s/it]
  7%|▋         | 2499/37963 [5:38:09<83:41:54,  8.50s/it]
  7%|▋         | 2500/37963 [5:38:16<81:16:38,  8.25s/it]
                                                         
{'loss': '0.1842', 'grad_norm': '6.82', 'learning_rate': '1.993e-05', 'epoch': '0.06585'}
+
  7%|▋         | 2500/37963 [5:38:16<81:16:38,  8.25s/it]
  7%|▋         | 2501/37963 [5:38:24<78:59:39,  8.02s/it]
  7%|▋         | 2502/37963 [5:38:32<77:45:06,  7.89s/it]
  7%|▋         | 2503/37963 [5:38:39<77:34:30,  7.88s/it]
  7%|▋         | 2504/37963 [5:38:47<76:30:22,  7.77s/it]
  7%|▋         | 2505/37963 [5:38:54<75:36:20,  7.68s/it]
  7%|▋         | 2506/37963 [5:39:02<75:30:41,  7.67s/it]
  7%|▋         | 2507/37963 [5:39:09<74:56:06,  7.61s/it]
  7%|▋         | 2508/37963 [5:39:17<74:28:15,  7.56s/it]
  7%|▋         | 2509/37963 [5:39:25<74:49:06,  7.60s/it]
  7%|▋         | 2510/37963 [5:39:32<75:35:37,  7.68s/it]
                                                         
{'loss': '0.1912', 'grad_norm': '3.572', 'learning_rate': '1.993e-05', 'epoch': '0.06612'}
+
  7%|▋         | 2510/37963 [5:39:32<75:35:37,  7.68s/it]
  7%|▋         | 2511/37963 [5:39:40<75:13:23,  7.64s/it]
  7%|▋         | 2512/37963 [5:39:47<74:16:48,  7.54s/it]
  7%|▋         | 2513/37963 [5:39:58<82:20:33,  8.36s/it]
  7%|▋         | 2514/37963 [5:40:05<80:19:16,  8.16s/it]
  7%|▋         | 2515/37963 [5:40:13<79:26:35,  8.07s/it]
  7%|▋         | 2516/37963 [5:40:21<78:01:11,  7.92s/it]
  7%|▋         | 2517/37963 [5:40:31<84:13:34,  8.55s/it]
  7%|▋         | 2518/37963 [5:40:39<81:56:06,  8.32s/it]
  7%|▋         | 2519/37963 [5:40:46<79:37:09,  8.09s/it]
  7%|▋         | 2520/37963 [5:40:56<86:25:37,  8.78s/it]
                                                         
{'loss': '0.195', 'grad_norm': '4.45', 'learning_rate': '1.993e-05', 'epoch': '0.06638'}
+
  7%|▋         | 2520/37963 [5:40:56<86:25:37,  8.78s/it]
  7%|▋         | 2521/37963 [5:41:04<83:24:46,  8.47s/it]
  7%|▋         | 2522/37963 [5:41:12<80:52:10,  8.21s/it]
  7%|▋         | 2523/37963 [5:41:20<79:33:04,  8.08s/it]
  7%|▋         | 2524/37963 [5:41:27<77:54:16,  7.91s/it]
  7%|▋         | 2525/37963 [5:41:35<77:34:25,  7.88s/it]
  7%|▋         | 2526/37963 [5:41:42<76:33:31,  7.78s/it]
  7%|▋         | 2527/37963 [5:41:50<75:53:32,  7.71s/it]
  7%|▋         | 2528/37963 [5:41:58<76:37:28,  7.78s/it]
  7%|▋         | 2529/37963 [5:42:06<75:49:44,  7.70s/it]
  7%|▋         | 2530/37963 [5:42:13<75:21:49,  7.66s/it]
                                                         
{'loss': '0.1954', 'grad_norm': '2.655', 'learning_rate': '1.993e-05', 'epoch': '0.06664'}
+
  7%|▋         | 2530/37963 [5:42:13<75:21:49,  7.66s/it]
  7%|▋         | 2531/37963 [5:42:23<81:57:23,  8.33s/it]
  7%|▋         | 2532/37963 [5:42:30<79:33:00,  8.08s/it]
  7%|▋         | 2533/37963 [5:42:41<86:00:13,  8.74s/it]
  7%|▋         | 2534/37963 [5:42:49<83:15:26,  8.46s/it]
  7%|▋         | 2535/37963 [5:43:01<96:04:28,  9.76s/it]
  7%|▋         | 2536/37963 [5:43:09<90:00:50,  9.15s/it]
  7%|▋         | 2537/37963 [5:43:17<85:47:41,  8.72s/it]
  7%|▋         | 2538/37963 [5:43:24<82:40:28,  8.40s/it]
  7%|▋         | 2539/37963 [5:43:32<80:07:19,  8.14s/it]
  7%|▋         | 2540/37963 [5:43:40<78:54:15,  8.02s/it]
                                                         
{'loss': '0.1832', 'grad_norm': '2.85', 'learning_rate': '1.993e-05', 'epoch': '0.06691'}
+
  7%|▋         | 2540/37963 [5:43:40<78:54:15,  8.02s/it]
  7%|▋         | 2541/37963 [5:43:47<76:36:41,  7.79s/it]
  7%|▋         | 2542/37963 [5:43:55<76:28:07,  7.77s/it]
  7%|▋         | 2543/37963 [5:44:05<83:14:01,  8.46s/it]
  7%|▋         | 2544/37963 [5:44:12<80:37:43,  8.20s/it]
  7%|▋         | 2545/37963 [5:44:20<78:21:11,  7.96s/it]
  7%|▋         | 2546/37963 [5:44:27<77:22:25,  7.86s/it]
  7%|▋         | 2547/37963 [5:44:35<77:13:31,  7.85s/it]
  7%|▋         | 2548/37963 [5:44:43<76:59:49,  7.83s/it]
  7%|▋         | 2549/37963 [5:44:51<76:14:01,  7.75s/it]
  7%|▋         | 2550/37963 [5:44:58<75:40:21,  7.69s/it]
                                                         
{'loss': '0.1647', 'grad_norm': '1.535', 'learning_rate': '1.993e-05', 'epoch': '0.06717'}
+
  7%|▋         | 2550/37963 [5:44:58<75:40:21,  7.69s/it]
  7%|▋         | 2551/37963 [5:45:06<76:08:27,  7.74s/it]
  7%|▋         | 2552/37963 [5:45:14<76:01:18,  7.73s/it]
  7%|▋         | 2553/37963 [5:45:21<74:45:14,  7.60s/it]
  7%|▋         | 2554/37963 [5:45:28<74:06:12,  7.53s/it]
  7%|▋         | 2555/37963 [5:45:36<74:11:30,  7.54s/it]
  7%|▋         | 2556/37963 [5:45:44<74:23:23,  7.56s/it]
  7%|▋         | 2557/37963 [5:45:51<74:26:19,  7.57s/it]
  7%|▋         | 2558/37963 [5:45:59<74:38:38,  7.59s/it]
  7%|▋         | 2559/37963 [5:46:06<74:38:25,  7.59s/it]
  7%|▋         | 2560/37963 [5:46:14<74:27:34,  7.57s/it]
                                                         
{'loss': '0.2073', 'grad_norm': '1.761', 'learning_rate': '1.993e-05', 'epoch': '0.06743'}
+
  7%|▋         | 2560/37963 [5:46:14<74:27:34,  7.57s/it]
  7%|▋         | 2561/37963 [5:46:27<89:27:47,  9.10s/it]
  7%|▋         | 2562/37963 [5:46:34<85:41:18,  8.71s/it]
  7%|▋         | 2563/37963 [5:46:42<82:43:13,  8.41s/it]
  7%|▋         | 2564/37963 [5:46:50<80:59:23,  8.24s/it]
  7%|▋         | 2565/37963 [5:46:58<79:14:20,  8.06s/it]
  7%|▋         | 2566/37963 [5:47:05<77:19:57,  7.87s/it]
  7%|▋         | 2567/37963 [5:47:12<76:15:42,  7.76s/it]
  7%|▋         | 2568/37963 [5:47:20<75:31:00,  7.68s/it]
  7%|▋         | 2569/37963 [5:47:30<83:24:16,  8.48s/it]
  7%|▋         | 2570/37963 [5:47:38<80:44:18,  8.21s/it]
                                                         
{'loss': '0.1966', 'grad_norm': '5.983', 'learning_rate': '1.993e-05', 'epoch': '0.0677'}
+
  7%|▋         | 2570/37963 [5:47:38<80:44:18,  8.21s/it]
  7%|▋         | 2571/37963 [5:47:45<78:32:40,  7.99s/it]
  7%|▋         | 2572/37963 [5:47:53<77:35:54,  7.89s/it]
  7%|▋         | 2573/37963 [5:48:01<77:41:58,  7.90s/it]
  7%|▋         | 2574/37963 [5:48:08<76:30:57,  7.78s/it]
  7%|▋         | 2575/37963 [5:48:16<76:30:07,  7.78s/it]
  7%|▋         | 2576/37963 [5:48:24<75:53:57,  7.72s/it]
  7%|▋         | 2577/37963 [5:48:32<76:06:35,  7.74s/it]
  7%|▋         | 2578/37963 [5:48:39<76:22:23,  7.77s/it]
  7%|▋         | 2579/37963 [5:48:47<76:07:23,  7.74s/it]
  7%|▋         | 2580/37963 [5:48:54<74:50:59,  7.62s/it]
                                                         
{'loss': '0.1894', 'grad_norm': '3.085', 'learning_rate': '1.992e-05', 'epoch': '0.06796'}
+
  7%|▋         | 2580/37963 [5:48:54<74:50:59,  7.62s/it]
  7%|▋         | 2581/37963 [5:49:02<74:06:30,  7.54s/it]
  7%|▋         | 2582/37963 [5:49:09<73:54:59,  7.52s/it]
  7%|▋         | 2583/37963 [5:49:20<81:57:44,  8.34s/it]
  7%|▋         | 2584/37963 [5:49:27<79:42:21,  8.11s/it]
  7%|▋         | 2585/37963 [5:49:37<86:11:06,  8.77s/it]
  7%|▋         | 2586/37963 [5:49:48<90:51:31,  9.25s/it]
  7%|▋         | 2587/37963 [5:49:58<94:09:37,  9.58s/it]
  7%|▋         | 2588/37963 [5:50:06<88:43:59,  9.03s/it]
  7%|▋         | 2589/37963 [5:50:14<84:41:00,  8.62s/it]
  7%|▋         | 2590/37963 [5:50:21<80:56:00,  8.24s/it]
                                                         
{'loss': '0.2021', 'grad_norm': '2.256', 'learning_rate': '1.992e-05', 'epoch': '0.06822'}
+
  7%|▋         | 2590/37963 [5:50:21<80:56:00,  8.24s/it]
  7%|▋         | 2591/37963 [5:50:28<78:38:03,  8.00s/it]
  7%|▋         | 2592/37963 [5:50:36<76:58:07,  7.83s/it]
  7%|▋         | 2593/37963 [5:50:43<76:16:08,  7.76s/it]
  7%|▋         | 2594/37963 [5:50:51<75:27:54,  7.68s/it]
  7%|▋         | 2595/37963 [5:50:58<74:56:47,  7.63s/it]
  7%|▋         | 2596/37963 [5:51:06<75:17:48,  7.66s/it]
  7%|▋         | 2597/37963 [5:51:14<74:49:06,  7.62s/it]
  7%|▋         | 2598/37963 [5:51:21<74:52:31,  7.62s/it]
  7%|▋         | 2599/37963 [5:51:29<74:46:45,  7.61s/it]
  7%|▋         | 2600/37963 [5:51:36<73:30:14,  7.48s/it]
                                                         
{'loss': '0.1869', 'grad_norm': '3.772', 'learning_rate': '1.992e-05', 'epoch': '0.06849'}
+
  7%|▋         | 2600/37963 [5:51:36<73:30:14,  7.48s/it]
  7%|▋         | 2601/37963 [5:51:43<73:22:04,  7.47s/it]
  7%|▋         | 2602/37963 [5:51:51<73:52:46,  7.52s/it]
  7%|▋         | 2603/37963 [5:51:59<73:55:28,  7.53s/it]
  7%|▋         | 2604/37963 [5:52:06<73:41:11,  7.50s/it]
  7%|▋         | 2605/37963 [5:52:14<75:00:30,  7.64s/it]
  7%|▋         | 2606/37963 [5:52:22<75:35:59,  7.70s/it]
  7%|▋         | 2607/37963 [5:52:29<73:54:43,  7.53s/it]
  7%|▋         | 2608/37963 [5:52:42<89:57:38,  9.16s/it]
  7%|▋         | 2609/37963 [5:52:50<85:57:18,  8.75s/it]
  7%|▋         | 2610/37963 [5:52:57<82:29:08,  8.40s/it]
                                                         
{'loss': '0.1822', 'grad_norm': '5.261', 'learning_rate': '1.992e-05', 'epoch': '0.06875'}
+
  7%|▋         | 2610/37963 [5:52:57<82:29:08,  8.40s/it]
  7%|▋         | 2611/37963 [5:53:05<79:04:02,  8.05s/it]
  7%|▋         | 2612/37963 [5:53:12<77:27:03,  7.89s/it]
  7%|▋         | 2613/37963 [5:53:20<76:03:35,  7.75s/it]
  7%|▋         | 2614/37963 [5:53:27<74:07:14,  7.55s/it]
  7%|▋         | 2615/37963 [5:53:34<73:01:39,  7.44s/it]
  7%|▋         | 2616/37963 [5:53:41<73:50:57,  7.52s/it]
  7%|▋         | 2617/37963 [5:53:51<80:28:34,  8.20s/it]
  7%|▋         | 2618/37963 [5:53:59<79:13:41,  8.07s/it]
  7%|▋         | 2619/37963 [5:54:06<77:24:51,  7.89s/it]
  7%|▋         | 2620/37963 [5:54:14<76:36:47,  7.80s/it]
                                                         
{'loss': '0.1866', 'grad_norm': '2.225', 'learning_rate': '1.992e-05', 'epoch': '0.06901'}
+
  7%|▋         | 2620/37963 [5:54:14<76:36:47,  7.80s/it]
  7%|▋         | 2621/37963 [5:54:22<76:13:21,  7.76s/it]
  7%|▋         | 2622/37963 [5:54:29<74:50:34,  7.62s/it]
  7%|▋         | 2623/37963 [5:54:37<75:13:09,  7.66s/it]
  7%|▋         | 2624/37963 [5:54:44<74:56:57,  7.64s/it]
  7%|▋         | 2625/37963 [5:54:52<75:30:51,  7.69s/it]
  7%|▋         | 2626/37963 [5:55:00<75:12:13,  7.66s/it]
  7%|▋         | 2627/37963 [5:55:10<82:48:09,  8.44s/it]
  7%|▋         | 2628/37963 [5:55:18<80:08:06,  8.16s/it]
  7%|▋         | 2629/37963 [5:55:25<78:34:25,  8.01s/it]
  7%|▋         | 2630/37963 [5:55:33<78:12:38,  7.97s/it]
                                                         
{'loss': '0.1734', 'grad_norm': '4.934', 'learning_rate': '1.992e-05', 'epoch': '0.06928'}
+
  7%|▋         | 2630/37963 [5:55:33<78:12:38,  7.97s/it]
  7%|▋         | 2631/37963 [5:55:44<85:53:31,  8.75s/it]
  7%|▋         | 2632/37963 [5:55:54<89:24:02,  9.11s/it]
  7%|▋         | 2633/37963 [5:56:01<84:17:11,  8.59s/it]
  7%|▋         | 2634/37963 [5:56:08<80:27:22,  8.20s/it]
  7%|▋         | 2635/37963 [5:56:16<78:32:47,  8.00s/it]
  7%|▋         | 2636/37963 [5:56:24<78:23:32,  7.99s/it]
  7%|▋         | 2637/37963 [5:56:34<85:50:29,  8.75s/it]
  7%|▋         | 2638/37963 [5:56:42<83:40:13,  8.53s/it]
  7%|▋         | 2639/37963 [5:56:52<87:58:42,  8.97s/it]
  7%|▋         | 2640/37963 [5:57:00<84:25:27,  8.60s/it]
                                                         
{'loss': '0.1776', 'grad_norm': '2.371', 'learning_rate': '1.992e-05', 'epoch': '0.06954'}
+
  7%|▋         | 2640/37963 [5:57:00<84:25:27,  8.60s/it]
  7%|▋         | 2641/37963 [5:57:08<81:30:31,  8.31s/it]
  7%|▋         | 2642/37963 [5:57:15<78:13:13,  7.97s/it]
  7%|▋         | 2643/37963 [5:57:22<77:03:30,  7.85s/it]
  7%|▋         | 2644/37963 [5:57:30<76:08:36,  7.76s/it]
  7%|▋         | 2645/37963 [5:57:38<75:33:35,  7.70s/it]
  7%|▋         | 2646/37963 [5:57:45<76:04:59,  7.76s/it]
  7%|▋         | 2647/37963 [5:57:53<74:56:27,  7.64s/it]
  7%|▋         | 2648/37963 [5:58:00<74:39:33,  7.61s/it]
  7%|▋         | 2649/37963 [5:58:08<74:37:06,  7.61s/it]
  7%|▋         | 2650/37963 [5:58:15<73:29:09,  7.49s/it]
                                                         
{'loss': '0.1783', 'grad_norm': '1.699', 'learning_rate': '1.992e-05', 'epoch': '0.06981'}
+
  7%|▋         | 2650/37963 [5:58:15<73:29:09,  7.49s/it]
  7%|▋         | 2651/37963 [5:58:25<80:49:53,  8.24s/it]
  7%|▋         | 2652/37963 [5:58:35<86:52:37,  8.86s/it]
  7%|▋         | 2653/37963 [5:58:43<83:10:58,  8.48s/it]
  7%|▋         | 2654/37963 [5:58:51<81:02:03,  8.26s/it]
  7%|▋         | 2655/37963 [5:58:59<79:32:29,  8.11s/it]
  7%|▋         | 2656/37963 [5:59:06<78:12:38,  7.97s/it]
  7%|▋         | 2657/37963 [5:59:14<77:10:20,  7.87s/it]
  7%|▋         | 2658/37963 [5:59:22<76:50:35,  7.84s/it]
  7%|▋         | 2659/37963 [5:59:29<76:18:55,  7.78s/it]
  7%|▋         | 2660/37963 [5:59:37<75:42:32,  7.72s/it]
                                                         
{'loss': '0.181', 'grad_norm': '4.325', 'learning_rate': '1.992e-05', 'epoch': '0.07007'}
+
  7%|▋         | 2660/37963 [5:59:37<75:42:32,  7.72s/it]
  7%|▋         | 2661/37963 [5:59:45<76:01:32,  7.75s/it]
  7%|▋         | 2662/37963 [5:59:52<75:24:19,  7.69s/it]
  7%|▋         | 2663/37963 [6:00:00<75:37:27,  7.71s/it]
  7%|▋         | 2664/37963 [6:00:07<74:45:24,  7.62s/it]
  7%|▋         | 2665/37963 [6:00:17<81:55:31,  8.36s/it]
  7%|▋         | 2666/37963 [6:00:25<79:12:16,  8.08s/it]
  7%|▋         | 2667/37963 [6:00:33<78:02:24,  7.96s/it]
  7%|▋         | 2668/37963 [6:00:40<77:38:08,  7.92s/it]
  7%|▋         | 2669/37963 [6:00:48<76:53:53,  7.84s/it]
  7%|▋         | 2670/37963 [6:00:56<76:27:43,  7.80s/it]
                                                         
{'loss': '0.175', 'grad_norm': '5.619', 'learning_rate': '1.991e-05', 'epoch': '0.07033'}
+
  7%|▋         | 2670/37963 [6:00:56<76:27:43,  7.80s/it]
  7%|▋         | 2671/37963 [6:01:04<76:20:54,  7.79s/it]
  7%|▋         | 2672/37963 [6:01:11<75:34:48,  7.71s/it]
  7%|▋         | 2673/37963 [6:01:19<74:57:37,  7.65s/it]
  7%|▋         | 2674/37963 [6:01:26<75:25:14,  7.69s/it]
  7%|▋         | 2675/37963 [6:01:39<90:56:10,  9.28s/it]
  7%|▋         | 2676/37963 [6:01:47<86:41:21,  8.84s/it]
  7%|▋         | 2677/37963 [6:01:55<82:35:56,  8.43s/it]
  7%|▋         | 2678/37963 [6:02:02<80:16:52,  8.19s/it]
  7%|▋         | 2679/37963 [6:02:10<79:06:28,  8.07s/it]
  7%|▋         | 2680/37963 [6:02:18<78:18:22,  7.99s/it]
                                                         
{'loss': '0.1693', 'grad_norm': '2.261', 'learning_rate': '1.991e-05', 'epoch': '0.0706'}
+
  7%|▋         | 2680/37963 [6:02:18<78:18:22,  7.99s/it]
  7%|▋         | 2681/37963 [6:02:28<85:35:48,  8.73s/it]
  7%|▋         | 2682/37963 [6:02:36<82:31:12,  8.42s/it]
  7%|▋         | 2683/37963 [6:02:44<80:56:32,  8.26s/it]
  7%|▋         | 2684/37963 [6:02:52<79:23:38,  8.10s/it]
  7%|▋         | 2685/37963 [6:02:59<77:53:30,  7.95s/it]
  7%|▋         | 2686/37963 [6:03:07<77:24:52,  7.90s/it]
  7%|▋         | 2687/37963 [6:03:15<76:24:18,  7.80s/it]
  7%|▋         | 2688/37963 [6:03:25<83:49:11,  8.55s/it]
  7%|▋         | 2689/37963 [6:03:33<81:37:12,  8.33s/it]
  7%|▋         | 2690/37963 [6:03:40<79:22:12,  8.10s/it]
                                                         
{'loss': '0.1963', 'grad_norm': '3.631', 'learning_rate': '1.991e-05', 'epoch': '0.07086'}
+
  7%|▋         | 2690/37963 [6:03:40<79:22:12,  8.10s/it]
  7%|▋         | 2691/37963 [6:03:47<76:09:12,  7.77s/it]
  7%|▋         | 2692/37963 [6:03:54<74:02:08,  7.56s/it]
  7%|▋         | 2693/37963 [6:04:05<81:50:25,  8.35s/it]
  7%|▋         | 2694/37963 [6:04:12<79:30:19,  8.12s/it]
  7%|▋         | 2695/37963 [6:04:20<78:14:29,  7.99s/it]
  7%|▋         | 2696/37963 [6:04:27<75:58:42,  7.76s/it]
  7%|▋         | 2697/37963 [6:04:35<75:39:35,  7.72s/it]
  7%|▋         | 2698/37963 [6:04:42<74:49:02,  7.64s/it]
  7%|▋         | 2699/37963 [6:04:55<90:13:42,  9.21s/it]
  7%|▋         | 2700/37963 [6:05:03<86:06:12,  8.79s/it]
                                                         
{'loss': '0.1929', 'grad_norm': '3.236', 'learning_rate': '1.991e-05', 'epoch': '0.07112'}
+
  7%|▋         | 2700/37963 [6:05:03<86:06:12,  8.79s/it]
  7%|▋         | 2701/37963 [6:05:10<81:39:47,  8.34s/it]
  7%|▋         | 2702/37963 [6:05:18<79:24:50,  8.11s/it]
  7%|▋         | 2703/37963 [6:05:25<77:05:34,  7.87s/it]
  7%|▋         | 2704/37963 [6:05:33<76:51:45,  7.85s/it]
  7%|▋         | 2705/37963 [6:05:40<76:07:07,  7.77s/it]
  7%|▋         | 2706/37963 [6:05:48<76:06:19,  7.77s/it]
  7%|▋         | 2707/37963 [6:05:56<75:59:58,  7.76s/it]
  7%|▋         | 2708/37963 [6:06:03<75:33:29,  7.72s/it]
  7%|▋         | 2709/37963 [6:06:14<83:01:23,  8.48s/it]
  7%|▋         | 2710/37963 [6:06:21<80:32:29,  8.22s/it]
                                                         
{'loss': '0.1722', 'grad_norm': '2.474', 'learning_rate': '1.991e-05', 'epoch': '0.07139'}
+
  7%|▋         | 2710/37963 [6:06:21<80:32:29,  8.22s/it]
  7%|▋         | 2711/37963 [6:06:29<79:16:49,  8.10s/it]
  7%|▋         | 2712/37963 [6:06:37<77:53:02,  7.95s/it]
  7%|▋         | 2713/37963 [6:06:45<77:22:27,  7.90s/it]
  7%|▋         | 2714/37963 [6:06:52<76:06:34,  7.77s/it]
  7%|▋         | 2715/37963 [6:07:00<75:38:55,  7.73s/it]
  7%|▋         | 2716/37963 [6:07:07<75:26:01,  7.70s/it]
  7%|▋         | 2717/37963 [6:07:15<75:01:40,  7.66s/it]
  7%|▋         | 2718/37963 [6:07:25<82:23:42,  8.42s/it]
  7%|▋         | 2719/37963 [6:07:35<87:11:35,  8.91s/it]
  7%|▋         | 2720/37963 [6:07:42<82:51:05,  8.46s/it]
                                                         
{'loss': '0.1894', 'grad_norm': '3.869', 'learning_rate': '1.991e-05', 'epoch': '0.07165'}
+
  7%|▋         | 2720/37963 [6:07:42<82:51:05,  8.46s/it]
  7%|▋         | 2721/37963 [6:07:50<80:59:00,  8.27s/it]
  7%|▋         | 2722/37963 [6:07:58<79:29:21,  8.12s/it]
  7%|▋         | 2723/37963 [6:08:06<78:22:08,  8.01s/it]
  7%|▋         | 2724/37963 [6:08:13<77:18:01,  7.90s/it]
  7%|▋         | 2725/37963 [6:08:24<83:43:53,  8.55s/it]
  7%|▋         | 2726/37963 [6:08:31<79:40:48,  8.14s/it]
  7%|▋         | 2727/37963 [6:08:38<78:00:58,  7.97s/it]
  7%|▋         | 2728/37963 [6:08:46<77:11:28,  7.89s/it]
  7%|▋         | 2729/37963 [6:08:53<75:41:16,  7.73s/it]
  7%|▋         | 2730/37963 [6:09:01<75:52:58,  7.75s/it]
                                                         
{'loss': '0.1965', 'grad_norm': '2.425', 'learning_rate': '1.991e-05', 'epoch': '0.07191'}
+
  7%|▋         | 2730/37963 [6:09:01<75:52:58,  7.75s/it]
  7%|▋         | 2731/37963 [6:09:09<76:09:20,  7.78s/it]
  7%|▋         | 2732/37963 [6:09:17<75:41:56,  7.74s/it]
  7%|▋         | 2733/37963 [6:09:24<75:20:53,  7.70s/it]
  7%|▋         | 2734/37963 [6:09:32<75:39:36,  7.73s/it]
  7%|▋         | 2735/37963 [6:09:40<75:52:42,  7.75s/it]
  7%|▋         | 2736/37963 [6:09:48<76:20:52,  7.80s/it]
  7%|▋         | 2737/37963 [6:09:58<83:46:46,  8.56s/it]
  7%|▋         | 2738/37963 [6:10:06<81:27:41,  8.33s/it]
  7%|▋         | 2739/37963 [6:10:14<79:52:07,  8.16s/it]
  7%|▋         | 2740/37963 [6:10:21<78:32:38,  8.03s/it]
                                                         
{'loss': '0.1907', 'grad_norm': '2.979', 'learning_rate': '1.991e-05', 'epoch': '0.07218'}
+
  7%|▋         | 2740/37963 [6:10:21<78:32:38,  8.03s/it]
  7%|▋         | 2741/37963 [6:10:29<76:44:53,  7.84s/it]
  7%|▋         | 2742/37963 [6:10:39<84:28:43,  8.63s/it]
  7%|▋         | 2743/37963 [6:10:47<82:03:11,  8.39s/it]
  7%|▋         | 2744/37963 [6:10:55<80:11:25,  8.20s/it]
  7%|▋         | 2745/37963 [6:11:03<79:03:27,  8.08s/it]
  7%|▋         | 2746/37963 [6:11:10<77:53:18,  7.96s/it]
  7%|▋         | 2747/37963 [6:11:18<77:17:08,  7.90s/it]
  7%|▋         | 2748/37963 [6:11:26<76:11:59,  7.79s/it]
  7%|▋         | 2749/37963 [6:11:33<75:24:36,  7.71s/it]
  7%|▋         | 2750/37963 [6:11:41<75:30:16,  7.72s/it]
                                                         
{'loss': '0.1849', 'grad_norm': '5.628', 'learning_rate': '1.991e-05', 'epoch': '0.07244'}
+
  7%|▋         | 2750/37963 [6:11:41<75:30:16,  7.72s/it]
  7%|▋         | 2751/37963 [6:11:48<74:58:24,  7.67s/it]
  7%|▋         | 2752/37963 [6:11:56<75:10:47,  7.69s/it]
  7%|▋         | 2753/37963 [6:12:12<98:01:10, 10.02s/it]
  7%|▋         | 2754/37963 [6:12:19<91:10:14,  9.32s/it]
  7%|▋         | 2755/37963 [6:12:27<85:37:08,  8.75s/it]
  7%|▋         | 2756/37963 [6:12:34<82:31:02,  8.44s/it]
  7%|▋         | 2757/37963 [6:12:42<80:00:25,  8.18s/it]
  7%|▋         | 2758/37963 [6:12:50<78:34:28,  8.03s/it]
  7%|▋         | 2759/37963 [6:12:58<77:49:56,  7.96s/it]
  7%|▋         | 2760/37963 [6:13:05<76:20:15,  7.81s/it]
                                                         
{'loss': '0.1802', 'grad_norm': '3.759', 'learning_rate': '1.99e-05', 'epoch': '0.0727'}
+
  7%|▋         | 2760/37963 [6:13:05<76:20:15,  7.81s/it]
  7%|▋         | 2761/37963 [6:13:12<75:24:11,  7.71s/it]
  7%|▋         | 2762/37963 [6:13:20<75:17:10,  7.70s/it]
  7%|▋         | 2763/37963 [6:13:30<82:41:52,  8.46s/it]
  7%|▋         | 2764/37963 [6:13:38<80:46:41,  8.26s/it]
  7%|▋         | 2765/37963 [6:13:46<79:05:02,  8.09s/it]
  7%|▋         | 2766/37963 [6:13:56<85:22:22,  8.73s/it]
  7%|▋         | 2767/37963 [6:14:04<82:39:47,  8.46s/it]
  7%|▋         | 2768/37963 [6:14:14<88:16:07,  9.03s/it]
  7%|▋         | 2769/37963 [6:14:22<83:53:06,  8.58s/it]
  7%|▋         | 2770/37963 [6:14:30<81:23:12,  8.33s/it]
                                                         
{'loss': '0.1785', 'grad_norm': '2.205', 'learning_rate': '1.99e-05', 'epoch': '0.07297'}
+
  7%|▋         | 2770/37963 [6:14:30<81:23:12,  8.33s/it]
  7%|▋         | 2771/37963 [6:14:37<79:38:58,  8.15s/it]
  7%|▋         | 2772/37963 [6:14:44<76:56:50,  7.87s/it]
  7%|▋         | 2773/37963 [6:14:52<76:14:23,  7.80s/it]
  7%|▋         | 2774/37963 [6:15:00<76:09:54,  7.79s/it]
  7%|▋         | 2775/37963 [6:15:07<74:56:14,  7.67s/it]
  7%|▋         | 2776/37963 [6:15:15<74:25:59,  7.62s/it]
  7%|▋         | 2777/37963 [6:15:22<74:05:41,  7.58s/it]
  7%|▋         | 2778/37963 [6:15:30<74:17:53,  7.60s/it]
  7%|▋         | 2779/37963 [6:15:37<74:01:27,  7.57s/it]
  7%|▋         | 2780/37963 [6:15:45<74:39:14,  7.64s/it]
                                                         
{'loss': '0.182', 'grad_norm': '3.609', 'learning_rate': '1.99e-05', 'epoch': '0.07323'}
+
  7%|▋         | 2780/37963 [6:15:45<74:39:14,  7.64s/it]
  7%|▋         | 2781/37963 [6:15:53<75:04:18,  7.68s/it]
  7%|▋         | 2782/37963 [6:16:01<75:12:13,  7.70s/it]
  7%|▋         | 2783/37963 [6:16:08<74:09:54,  7.59s/it]
  7%|▋         | 2784/37963 [6:16:16<74:02:31,  7.58s/it]
  7%|▋         | 2785/37963 [6:16:26<81:49:03,  8.37s/it]
  7%|▋         | 2786/37963 [6:16:36<87:38:01,  8.97s/it]
  7%|▋         | 2787/37963 [6:16:44<84:24:05,  8.64s/it]
  7%|▋         | 2788/37963 [6:16:52<82:04:10,  8.40s/it]
  7%|▋         | 2789/37963 [6:16:59<78:32:03,  8.04s/it]
  7%|▋         | 2790/37963 [6:17:07<77:10:41,  7.90s/it]
                                                         
{'loss': '0.1825', 'grad_norm': '5.375', 'learning_rate': '1.99e-05', 'epoch': '0.07349'}
+
  7%|▋         | 2790/37963 [6:17:07<77:10:41,  7.90s/it]
  7%|▋         | 2791/37963 [6:17:14<76:51:32,  7.87s/it]
  7%|▋         | 2792/37963 [6:17:22<76:25:29,  7.82s/it]
  7%|▋         | 2793/37963 [6:17:30<76:12:00,  7.80s/it]
  7%|▋         | 2794/37963 [6:17:37<75:30:20,  7.73s/it]
  7%|▋         | 2795/37963 [6:17:45<74:43:39,  7.65s/it]
  7%|▋         | 2796/37963 [6:17:52<74:16:07,  7.60s/it]
  7%|▋         | 2797/37963 [6:18:00<74:23:51,  7.62s/it]
  7%|▋         | 2798/37963 [6:18:08<74:52:07,  7.66s/it]
  7%|▋         | 2799/37963 [6:18:18<83:05:05,  8.51s/it]
  7%|▋         | 2800/37963 [6:18:26<80:49:09,  8.27s/it]
                                                         
{'loss': '0.1911', 'grad_norm': '7.502', 'learning_rate': '1.99e-05', 'epoch': '0.07376'}
+
  7%|▋         | 2800/37963 [6:18:26<80:49:09,  8.27s/it]
  7%|▋         | 2801/37963 [6:18:36<85:48:12,  8.78s/it]
  7%|▋         | 2802/37963 [6:18:44<82:27:59,  8.44s/it]
  7%|▋         | 2803/37963 [6:18:51<80:05:53,  8.20s/it]
  7%|▋         | 2804/37963 [6:18:59<77:43:30,  7.96s/it]
  7%|▋         | 2805/37963 [6:19:06<75:51:16,  7.77s/it]
  7%|▋         | 2806/37963 [6:19:16<82:19:58,  8.43s/it]
  7%|▋         | 2807/37963 [6:19:24<80:24:22,  8.23s/it]
  7%|▋         | 2808/37963 [6:19:31<77:47:26,  7.97s/it]
  7%|▋         | 2809/37963 [6:19:39<76:36:43,  7.85s/it]
  7%|▋         | 2810/37963 [6:19:49<83:41:38,  8.57s/it]
                                                         
{'loss': '0.1787', 'grad_norm': '2.986', 'learning_rate': '1.99e-05', 'epoch': '0.07402'}
+
  7%|▋         | 2810/37963 [6:19:49<83:41:38,  8.57s/it]
  7%|▋         | 2811/37963 [6:19:59<88:11:33,  9.03s/it]
  7%|▋         | 2812/37963 [6:20:07<84:50:37,  8.69s/it]
  7%|▋         | 2813/37963 [6:20:15<82:25:06,  8.44s/it]
  7%|▋         | 2814/37963 [6:20:23<80:08:36,  8.21s/it]
  7%|▋         | 2815/37963 [6:20:30<78:45:20,  8.07s/it]
  7%|▋         | 2816/37963 [6:20:38<77:23:34,  7.93s/it]
  7%|▋         | 2817/37963 [6:20:48<83:59:08,  8.60s/it]
  7%|▋         | 2818/37963 [6:20:56<81:38:09,  8.36s/it]
  7%|▋         | 2819/37963 [6:21:04<80:43:23,  8.27s/it]
  7%|▋         | 2820/37963 [6:21:11<78:45:08,  8.07s/it]
                                                         
{'loss': '0.1749', 'grad_norm': '3.554', 'learning_rate': '1.99e-05', 'epoch': '0.07428'}
+
  7%|▋         | 2820/37963 [6:21:11<78:45:08,  8.07s/it]
  7%|▋         | 2821/37963 [6:21:19<77:03:21,  7.89s/it]
  7%|▋         | 2822/37963 [6:21:27<76:25:22,  7.83s/it]
  7%|▋         | 2823/37963 [6:21:34<75:40:31,  7.75s/it]
  7%|▋         | 2824/37963 [6:21:42<75:39:52,  7.75s/it]
  7%|▋         | 2825/37963 [6:21:50<75:20:32,  7.72s/it]
  7%|▋         | 2826/37963 [6:21:57<74:48:55,  7.67s/it]
  7%|▋         | 2827/37963 [6:22:04<73:46:55,  7.56s/it]
  7%|▋         | 2828/37963 [6:22:12<73:32:59,  7.54s/it]
  7%|▋         | 2829/37963 [6:22:20<74:22:01,  7.62s/it]
  7%|▋         | 2830/37963 [6:22:28<74:51:28,  7.67s/it]
                                                         
{'loss': '0.1961', 'grad_norm': '4.422', 'learning_rate': '1.99e-05', 'epoch': '0.07455'}
+
  7%|▋         | 2830/37963 [6:22:28<74:51:28,  7.67s/it]
  7%|▋         | 2831/37963 [6:22:35<74:16:22,  7.61s/it]
  7%|▋         | 2832/37963 [6:22:43<74:46:22,  7.66s/it]
  7%|▋         | 2833/37963 [6:22:53<82:27:07,  8.45s/it]
  7%|▋         | 2834/37963 [6:23:03<87:48:29,  9.00s/it]
  7%|▋         | 2835/37963 [6:23:11<83:41:02,  8.58s/it]
  7%|▋         | 2836/37963 [6:23:19<80:52:37,  8.29s/it]
  7%|▋         | 2837/37963 [6:23:26<77:35:31,  7.95s/it]
  7%|▋         | 2838/37963 [6:23:33<76:56:14,  7.89s/it]
  7%|▋         | 2839/37963 [6:23:41<76:07:50,  7.80s/it]
  7%|▋         | 2840/37963 [6:23:49<75:24:03,  7.73s/it]
                                                         
{'loss': '0.1833', 'grad_norm': '4.469', 'learning_rate': '1.99e-05', 'epoch': '0.07481'}
+
  7%|▋         | 2840/37963 [6:23:49<75:24:03,  7.73s/it]
  7%|▋         | 2841/37963 [6:23:56<75:03:40,  7.69s/it]
  7%|▋         | 2842/37963 [6:24:04<74:35:54,  7.65s/it]
  7%|▋         | 2843/37963 [6:24:11<73:34:56,  7.54s/it]
  7%|▋         | 2844/37963 [6:24:19<73:38:04,  7.55s/it]
  7%|▋         | 2845/37963 [6:24:26<73:24:40,  7.53s/it]
  7%|▋         | 2846/37963 [6:24:34<73:24:15,  7.53s/it]
  7%|▋         | 2847/37963 [6:24:41<73:51:15,  7.57s/it]
  8%|▊         | 2848/37963 [6:24:49<73:47:44,  7.57s/it]
  8%|▊         | 2849/37963 [6:24:59<81:44:33,  8.38s/it]
  8%|▊         | 2850/37963 [6:25:09<86:07:33,  8.83s/it]
                                                         
{'loss': '0.1828', 'grad_norm': '1.867', 'learning_rate': '1.989e-05', 'epoch': '0.07507'}
+
  8%|▊         | 2850/37963 [6:25:09<86:07:33,  8.83s/it]
  8%|▊         | 2851/37963 [6:25:17<82:40:22,  8.48s/it]
  8%|▊         | 2852/37963 [6:25:24<80:10:25,  8.22s/it]
  8%|▊         | 2853/37963 [6:25:35<86:00:25,  8.82s/it]
  8%|▊         | 2854/37963 [6:25:44<89:22:18,  9.16s/it]
  8%|▊         | 2855/37963 [6:25:52<84:45:55,  8.69s/it]
  8%|▊         | 2856/37963 [6:25:59<80:39:49,  8.27s/it]
  8%|▊         | 2857/37963 [6:26:07<78:48:37,  8.08s/it]
  8%|▊         | 2858/37963 [6:26:15<77:25:43,  7.94s/it]
  8%|▊         | 2859/37963 [6:26:22<77:11:38,  7.92s/it]
  8%|▊         | 2860/37963 [6:26:33<83:30:18,  8.56s/it]
                                                         
{'loss': '0.1885', 'grad_norm': '8.038', 'learning_rate': '1.989e-05', 'epoch': '0.07534'}
+
  8%|▊         | 2860/37963 [6:26:33<83:30:18,  8.56s/it]
  8%|▊         | 2861/37963 [6:26:40<81:03:31,  8.31s/it]
  8%|▊         | 2862/37963 [6:26:48<79:10:44,  8.12s/it]
  8%|▊         | 2863/37963 [6:26:56<77:57:58,  8.00s/it]
  8%|▊         | 2864/37963 [6:27:03<75:50:53,  7.78s/it]
  8%|▊         | 2865/37963 [6:27:13<82:38:17,  8.48s/it]
  8%|▊         | 2866/37963 [6:27:21<80:41:32,  8.28s/it]
  8%|▊         | 2867/37963 [6:27:29<79:22:35,  8.14s/it]
  8%|▊         | 2868/37963 [6:27:36<77:43:18,  7.97s/it]
  8%|▊         | 2869/37963 [6:27:44<77:21:48,  7.94s/it]
  8%|▊         | 2870/37963 [6:27:52<76:23:05,  7.84s/it]
                                                         
{'loss': '0.1834', 'grad_norm': '3.711', 'learning_rate': '1.989e-05', 'epoch': '0.0756'}
+
  8%|▊         | 2870/37963 [6:27:52<76:23:05,  7.84s/it]
  8%|▊         | 2871/37963 [6:28:00<76:26:39,  7.84s/it]
  8%|▊         | 2872/37963 [6:28:07<75:43:15,  7.77s/it]
  8%|▊         | 2873/37963 [6:28:15<75:29:54,  7.75s/it]
  8%|▊         | 2874/37963 [6:28:23<75:20:31,  7.73s/it]
  8%|▊         | 2875/37963 [6:28:30<75:11:02,  7.71s/it]
  8%|▊         | 2876/37963 [6:28:40<82:09:23,  8.43s/it]
  8%|▊         | 2877/37963 [6:28:50<86:55:51,  8.92s/it]
  8%|▊         | 2878/37963 [6:28:58<84:00:01,  8.62s/it]
  8%|▊         | 2879/37963 [6:29:06<81:00:47,  8.31s/it]
  8%|▊         | 2880/37963 [6:29:14<79:07:45,  8.12s/it]
                                                         
{'loss': '0.2023', 'grad_norm': '4.456', 'learning_rate': '1.989e-05', 'epoch': '0.07586'}
+
  8%|▊         | 2880/37963 [6:29:14<79:07:45,  8.12s/it]
  8%|▊         | 2881/37963 [6:29:21<78:01:40,  8.01s/it]
  8%|▊         | 2882/37963 [6:29:29<76:53:09,  7.89s/it]
  8%|▊         | 2883/37963 [6:29:37<76:20:59,  7.84s/it]
  8%|▊         | 2884/37963 [6:29:44<75:39:03,  7.76s/it]
  8%|▊         | 2885/37963 [6:29:52<74:59:53,  7.70s/it]
  8%|▊         | 2886/37963 [6:29:59<74:59:47,  7.70s/it]
  8%|▊         | 2887/37963 [6:30:07<74:25:09,  7.64s/it]
  8%|▊         | 2888/37963 [6:30:15<74:44:47,  7.67s/it]
  8%|▊         | 2889/37963 [6:30:23<75:24:45,  7.74s/it]
  8%|▊         | 2890/37963 [6:30:30<75:10:27,  7.72s/it]
                                                         
{'loss': '0.1757', 'grad_norm': '3.581', 'learning_rate': '1.989e-05', 'epoch': '0.07613'}
+
  8%|▊         | 2890/37963 [6:30:30<75:10:27,  7.72s/it]
  8%|▊         | 2891/37963 [6:30:38<74:35:00,  7.66s/it]
  8%|▊         | 2892/37963 [6:30:46<75:11:43,  7.72s/it]
  8%|▊         | 2893/37963 [6:30:56<82:16:41,  8.45s/it]
  8%|▊         | 2894/37963 [6:31:03<79:36:11,  8.17s/it]
  8%|▊         | 2895/37963 [6:31:14<86:01:27,  8.83s/it]
  8%|▊         | 2896/37963 [6:31:21<82:13:18,  8.44s/it]
  8%|▊         | 2897/37963 [6:31:29<80:13:20,  8.24s/it]
  8%|▊         | 2898/37963 [6:31:37<78:41:05,  8.08s/it]
  8%|▊         | 2899/37963 [6:31:44<77:04:00,  7.91s/it]
  8%|▊         | 2900/37963 [6:31:52<75:50:11,  7.79s/it]
                                                         
{'loss': '0.1692', 'grad_norm': '5.044', 'learning_rate': '1.989e-05', 'epoch': '0.07639'}
+
  8%|▊         | 2900/37963 [6:31:52<75:50:11,  7.79s/it]
  8%|▊         | 2901/37963 [6:32:00<76:19:16,  7.84s/it]
  8%|▊         | 2902/37963 [6:32:07<75:36:39,  7.76s/it]
  8%|▊         | 2903/37963 [6:32:15<74:50:58,  7.69s/it]
  8%|▊         | 2904/37963 [6:32:23<74:58:30,  7.70s/it]
  8%|▊         | 2905/37963 [6:32:30<74:48:54,  7.68s/it]
  8%|▊         | 2906/37963 [6:32:37<73:19:13,  7.53s/it]
  8%|▊         | 2907/37963 [6:32:48<81:34:38,  8.38s/it]
  8%|▊         | 2908/37963 [6:32:58<87:45:33,  9.01s/it]
  8%|▊         | 2909/37963 [6:33:11<97:51:22, 10.05s/it]
  8%|▊         | 2910/37963 [6:33:18<91:16:13,  9.37s/it]
                                                         
{'loss': '0.194', 'grad_norm': '2.74', 'learning_rate': '1.989e-05', 'epoch': '0.07665'}
+
  8%|▊         | 2910/37963 [6:33:18<91:16:13,  9.37s/it]
  8%|▊         | 2911/37963 [6:33:26<86:11:39,  8.85s/it]
  8%|▊         | 2912/37963 [6:33:34<82:39:18,  8.49s/it]
  8%|▊         | 2913/37963 [6:33:41<80:09:11,  8.23s/it]
  8%|▊         | 2914/37963 [6:33:49<79:29:01,  8.16s/it]
  8%|▊         | 2915/37963 [6:33:57<77:37:52,  7.97s/it]
  8%|▊         | 2916/37963 [6:34:05<77:20:30,  7.94s/it]
  8%|▊         | 2917/37963 [6:34:12<76:44:32,  7.88s/it]
  8%|▊         | 2918/37963 [6:34:20<74:58:43,  7.70s/it]
  8%|▊         | 2919/37963 [6:34:27<74:11:27,  7.62s/it]
  8%|▊         | 2920/37963 [6:34:37<81:50:06,  8.41s/it]
                                                         
{'loss': '0.1855', 'grad_norm': '3.972', 'learning_rate': '1.988e-05', 'epoch': '0.07692'}
+
  8%|▊         | 2920/37963 [6:34:37<81:50:06,  8.41s/it]
  8%|▊         | 2921/37963 [6:34:48<87:26:50,  8.98s/it]
  8%|▊         | 2922/37963 [6:34:55<83:43:48,  8.60s/it]
  8%|▊         | 2923/37963 [6:35:03<80:59:24,  8.32s/it]
  8%|▊         | 2924/37963 [6:35:11<79:25:10,  8.16s/it]
  8%|▊         | 2925/37963 [6:35:19<77:47:27,  7.99s/it]
  8%|▊         | 2926/37963 [6:35:26<76:37:01,  7.87s/it]
  8%|▊         | 2927/37963 [6:35:34<76:09:24,  7.83s/it]
  8%|▊         | 2928/37963 [6:35:42<75:52:17,  7.80s/it]
  8%|▊         | 2929/37963 [6:35:49<75:15:19,  7.73s/it]
  8%|▊         | 2930/37963 [6:35:56<73:52:43,  7.59s/it]
                                                         
{'loss': '0.1828', 'grad_norm': '5.14', 'learning_rate': '1.988e-05', 'epoch': '0.07718'}
+
  8%|▊         | 2930/37963 [6:35:56<73:52:43,  7.59s/it]
  8%|▊         | 2931/37963 [6:36:04<74:11:37,  7.62s/it]
  8%|▊         | 2932/37963 [6:36:12<73:45:51,  7.58s/it]
  8%|▊         | 2933/37963 [6:36:19<74:31:40,  7.66s/it]
  8%|▊         | 2934/37963 [6:36:27<75:16:59,  7.74s/it]
  8%|▊         | 2935/37963 [6:36:35<74:29:45,  7.66s/it]
  8%|▊         | 2936/37963 [6:36:42<74:02:56,  7.61s/it]
  8%|▊         | 2937/37963 [6:36:50<74:06:35,  7.62s/it]
  8%|▊         | 2938/37963 [6:36:58<74:03:41,  7.61s/it]
  8%|▊         | 2939/37963 [6:37:05<74:04:51,  7.61s/it]
  8%|▊         | 2940/37963 [6:37:13<74:19:02,  7.64s/it]
                                                         
{'loss': '0.1935', 'grad_norm': '2.144', 'learning_rate': '1.988e-05', 'epoch': '0.07744'}
+
  8%|▊         | 2940/37963 [6:37:13<74:19:02,  7.64s/it]
  8%|▊         | 2941/37963 [6:37:21<74:50:01,  7.69s/it]
  8%|▊         | 2942/37963 [6:37:31<82:19:58,  8.46s/it]
  8%|▊         | 2943/37963 [6:37:39<80:57:24,  8.32s/it]
  8%|▊         | 2944/37963 [6:37:47<78:54:06,  8.11s/it]
  8%|▊         | 2945/37963 [6:37:54<77:20:23,  7.95s/it]
  8%|▊         | 2946/37963 [6:38:02<76:44:18,  7.89s/it]
  8%|▊         | 2947/37963 [6:38:12<83:35:33,  8.59s/it]
  8%|▊         | 2948/37963 [6:38:19<79:20:32,  8.16s/it]
  8%|▊         | 2949/37963 [6:38:27<77:50:24,  8.00s/it]
  8%|▊         | 2950/37963 [6:38:35<77:54:20,  8.01s/it]
                                                         
{'loss': '0.1765', 'grad_norm': '2.651', 'learning_rate': '1.988e-05', 'epoch': '0.07771'}
+
  8%|▊         | 2950/37963 [6:38:35<77:54:20,  8.01s/it]
  8%|▊         | 2951/37963 [6:38:42<76:32:06,  7.87s/it]
  8%|▊         | 2952/37963 [6:38:50<75:59:22,  7.81s/it]
  8%|▊         | 2953/37963 [6:38:58<75:12:09,  7.73s/it]
  8%|▊         | 2954/37963 [6:39:05<75:03:30,  7.72s/it]
  8%|▊         | 2955/37963 [6:39:13<74:51:04,  7.70s/it]
  8%|▊         | 2956/37963 [6:39:21<74:20:37,  7.65s/it]
  8%|▊         | 2957/37963 [6:39:31<81:56:21,  8.43s/it]
  8%|▊         | 2958/37963 [6:39:38<79:11:48,  8.14s/it]
  8%|▊         | 2959/37963 [6:39:46<77:33:50,  7.98s/it]
  8%|▊         | 2960/37963 [6:39:53<75:50:42,  7.80s/it]
                                                         
{'loss': '0.1893', 'grad_norm': '2.77', 'learning_rate': '1.988e-05', 'epoch': '0.07797'}
+
  8%|▊         | 2960/37963 [6:39:53<75:50:42,  7.80s/it]
  8%|▊         | 2961/37963 [6:40:04<82:55:01,  8.53s/it]
  8%|▊         | 2962/37963 [6:40:11<80:39:23,  8.30s/it]
  8%|▊         | 2963/37963 [6:40:24<93:34:35,  9.63s/it]
  8%|▊         | 2964/37963 [6:40:32<87:56:16,  9.05s/it]
  8%|▊         | 2965/37963 [6:40:39<83:59:06,  8.64s/it]
  8%|▊         | 2966/37963 [6:40:47<80:33:56,  8.29s/it]
  8%|▊         | 2967/37963 [6:40:55<79:52:52,  8.22s/it]
  8%|▊         | 2968/37963 [6:41:05<85:14:50,  8.77s/it]
  8%|▊         | 2969/37963 [6:41:15<89:25:43,  9.20s/it]
  8%|▊         | 2970/37963 [6:41:23<84:55:38,  8.74s/it]
                                                         
{'loss': '0.1979', 'grad_norm': '2.224', 'learning_rate': '1.988e-05', 'epoch': '0.07823'}
+
  8%|▊         | 2970/37963 [6:41:23<84:55:38,  8.74s/it]
  8%|▊         | 2971/37963 [6:41:30<81:28:05,  8.38s/it]
  8%|▊         | 2972/37963 [6:41:38<78:08:15,  8.04s/it]
  8%|▊         | 2973/37963 [6:41:45<76:53:00,  7.91s/it]
  8%|▊         | 2974/37963 [6:41:53<76:20:09,  7.85s/it]
  8%|▊         | 2975/37963 [6:42:01<76:01:20,  7.82s/it]
  8%|▊         | 2976/37963 [6:42:09<76:18:20,  7.85s/it]
  8%|▊         | 2977/37963 [6:42:16<76:06:00,  7.83s/it]
  8%|▊         | 2978/37963 [6:42:24<75:16:10,  7.75s/it]
  8%|▊         | 2979/37963 [6:42:32<74:53:39,  7.71s/it]
  8%|▊         | 2980/37963 [6:42:39<74:19:42,  7.65s/it]
                                                         
{'loss': '0.1924', 'grad_norm': '1.888', 'learning_rate': '1.988e-05', 'epoch': '0.0785'}
+
  8%|▊         | 2980/37963 [6:42:39<74:19:42,  7.65s/it]
  8%|▊         | 2981/37963 [6:42:47<74:53:14,  7.71s/it]
  8%|▊         | 2982/37963 [6:42:55<75:14:20,  7.74s/it]
  8%|▊         | 2983/37963 [6:43:02<74:59:25,  7.72s/it]
  8%|▊         | 2984/37963 [6:43:09<73:11:06,  7.53s/it]
  8%|▊         | 2985/37963 [6:43:20<81:32:57,  8.39s/it]
  8%|▊         | 2986/37963 [6:43:27<79:07:34,  8.14s/it]
  8%|▊         | 2987/37963 [6:43:35<77:21:20,  7.96s/it]
  8%|▊         | 2988/37963 [6:43:43<76:25:58,  7.87s/it]
  8%|▊         | 2989/37963 [6:43:50<75:16:30,  7.75s/it]
  8%|▊         | 2990/37963 [6:43:58<75:47:46,  7.80s/it]
                                                         
{'loss': '0.1804', 'grad_norm': '4.567', 'learning_rate': '1.988e-05', 'epoch': '0.07876'}
+
  8%|▊         | 2990/37963 [6:43:58<75:47:46,  7.80s/it]
  8%|▊         | 2991/37963 [6:44:06<74:49:41,  7.70s/it]
  8%|▊         | 2992/37963 [6:44:13<75:02:31,  7.73s/it]
  8%|▊         | 2993/37963 [6:44:21<74:29:11,  7.67s/it]
  8%|▊         | 2994/37963 [6:44:28<74:13:42,  7.64s/it]
  8%|▊         | 2995/37963 [6:44:38<80:56:15,  8.33s/it]
  8%|▊         | 2996/37963 [6:44:46<78:37:23,  8.09s/it]
  8%|▊         | 2997/37963 [6:44:53<75:54:24,  7.82s/it]
  8%|▊         | 2998/37963 [6:45:01<76:24:38,  7.87s/it]
  8%|▊         | 2999/37963 [6:45:09<75:55:07,  7.82s/it]
  8%|▊         | 3000/37963 [6:45:16<75:04:40,  7.73s/it]
                                                         
{'loss': '0.1732', 'grad_norm': '3.331', 'learning_rate': '1.987e-05', 'epoch': '0.07902'}
+
  8%|▊         | 3000/37963 [6:45:16<75:04:40,  7.73s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.42s/it]
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.42s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
  8%|▊         | 3001/37963 [6:46:20<239:00:04, 24.61s/it]
  8%|▊         | 3002/37963 [6:46:28<190:09:28, 19.58s/it]
  8%|▊         | 3003/37963 [6:46:35<154:38:37, 15.92s/it]
  8%|▊         | 3004/37963 [6:46:46<137:27:29, 14.16s/it]
  8%|▊         | 3005/37963 [6:46:53<118:27:17, 12.20s/it]
  8%|▊         | 3006/37963 [6:47:01<104:59:21, 10.81s/it]
  8%|▊         | 3007/37963 [6:47:08<94:41:58,  9.75s/it] 
  8%|▊         | 3008/37963 [6:47:16<88:38:12,  9.13s/it]
  8%|▊         | 3009/37963 [6:47:23<83:19:04,  8.58s/it]
  8%|▊         | 3010/37963 [6:47:36<96:04:41,  9.90s/it]
                                                         
{'loss': '0.1914', 'grad_norm': '3.721', 'learning_rate': '1.987e-05', 'epoch': '0.07929'}
+
  8%|▊         | 3010/37963 [6:47:36<96:04:41,  9.90s/it]
  8%|▊         | 3011/37963 [6:47:44<90:43:14,  9.34s/it]
  8%|▊         | 3012/37963 [6:47:52<86:20:14,  8.89s/it]
  8%|▊         | 3013/37963 [6:47:59<82:19:49,  8.48s/it]
  8%|▊         | 3014/37963 [6:48:10<87:46:38,  9.04s/it]
  8%|▊         | 3015/37963 [6:48:20<91:32:37,  9.43s/it]
  8%|▊         | 3016/37963 [6:48:30<93:46:59,  9.66s/it]
  8%|▊         | 3017/37963 [6:48:38<88:03:19,  9.07s/it]
  8%|▊         | 3018/37963 [6:48:46<84:35:36,  8.71s/it]
  8%|▊         | 3019/37963 [6:48:53<80:45:30,  8.32s/it]
  8%|▊         | 3020/37963 [6:49:01<79:11:05,  8.16s/it]
                                                         
{'loss': '0.1731', 'grad_norm': '3.811', 'learning_rate': '1.987e-05', 'epoch': '0.07955'}
+
  8%|▊         | 3020/37963 [6:49:01<79:11:05,  8.16s/it]
  8%|▊         | 3021/37963 [6:49:09<77:27:45,  7.98s/it]
  8%|▊         | 3022/37963 [6:49:16<75:06:19,  7.74s/it]
  8%|▊         | 3023/37963 [6:49:24<75:14:07,  7.75s/it]
  8%|▊         | 3024/37963 [6:49:31<75:21:17,  7.76s/it]
  8%|▊         | 3025/37963 [6:49:39<75:08:58,  7.74s/it]
  8%|▊         | 3026/37963 [6:49:47<74:55:27,  7.72s/it]
  8%|▊         | 3027/37963 [6:49:55<75:21:17,  7.76s/it]
  8%|▊         | 3028/37963 [6:50:02<75:24:32,  7.77s/it]
  8%|▊         | 3029/37963 [6:50:10<75:30:10,  7.78s/it]
  8%|▊         | 3030/37963 [6:50:20<82:04:43,  8.46s/it]
                                                         
{'loss': '0.1652', 'grad_norm': '5.058', 'learning_rate': '1.987e-05', 'epoch': '0.07981'}
+
  8%|▊         | 3030/37963 [6:50:20<82:04:43,  8.46s/it]
  8%|▊         | 3031/37963 [6:50:28<79:35:30,  8.20s/it]
  8%|▊         | 3032/37963 [6:50:35<77:04:56,  7.94s/it]
  8%|▊         | 3033/37963 [6:50:42<75:15:03,  7.76s/it]
  8%|▊         | 3034/37963 [6:50:50<74:47:46,  7.71s/it]
  8%|▊         | 3035/37963 [6:50:58<74:52:40,  7.72s/it]
  8%|▊         | 3036/37963 [6:51:06<75:00:52,  7.73s/it]
  8%|▊         | 3037/37963 [6:51:13<75:14:58,  7.76s/it]
  8%|▊         | 3038/37963 [6:51:21<74:52:46,  7.72s/it]
  8%|▊         | 3039/37963 [6:51:31<82:31:48,  8.51s/it]
  8%|▊         | 3040/37963 [6:51:39<79:45:11,  8.22s/it]
                                                         
{'loss': '0.1714', 'grad_norm': '2.782', 'learning_rate': '1.987e-05', 'epoch': '0.08008'}
+
  8%|▊         | 3040/37963 [6:51:39<79:45:11,  8.22s/it]
  8%|▊         | 3041/37963 [6:51:47<78:09:46,  8.06s/it]
  8%|▊         | 3042/37963 [6:51:54<76:52:10,  7.92s/it]
  8%|▊         | 3043/37963 [6:52:02<76:40:18,  7.90s/it]
  8%|▊         | 3044/37963 [6:52:10<76:10:39,  7.85s/it]
  8%|▊         | 3045/37963 [6:52:17<75:30:08,  7.78s/it]
  8%|▊         | 3046/37963 [6:52:25<74:52:28,  7.72s/it]
  8%|▊         | 3047/37963 [6:52:33<74:56:36,  7.73s/it]
  8%|▊         | 3048/37963 [6:52:40<74:14:52,  7.66s/it]
  8%|▊         | 3049/37963 [6:52:48<73:34:07,  7.59s/it]
  8%|▊         | 3050/37963 [6:52:55<74:10:05,  7.65s/it]
                                                         
{'loss': '0.1838', 'grad_norm': '4.159', 'learning_rate': '1.987e-05', 'epoch': '0.08034'}
+
  8%|▊         | 3050/37963 [6:52:55<74:10:05,  7.65s/it]
  8%|▊         | 3051/37963 [6:53:03<73:59:15,  7.63s/it]
  8%|▊         | 3052/37963 [6:53:10<73:04:07,  7.53s/it]
  8%|▊         | 3053/37963 [6:53:18<72:58:24,  7.53s/it]
  8%|▊         | 3054/37963 [6:53:25<72:55:21,  7.52s/it]
  8%|▊         | 3055/37963 [6:53:33<72:40:24,  7.49s/it]
  8%|▊         | 3056/37963 [6:53:41<73:22:37,  7.57s/it]
  8%|▊         | 3057/37963 [6:53:48<73:04:47,  7.54s/it]
  8%|▊         | 3058/37963 [6:54:01<88:08:22,  9.09s/it]
  8%|▊         | 3059/37963 [6:54:11<92:05:44,  9.50s/it]
  8%|▊         | 3060/37963 [6:54:19<87:07:54,  8.99s/it]
                                                         
{'loss': '0.192', 'grad_norm': '1.724', 'learning_rate': '1.987e-05', 'epoch': '0.08061'}
+
  8%|▊         | 3060/37963 [6:54:19<87:07:54,  8.99s/it]
  8%|▊         | 3061/37963 [6:54:29<90:44:05,  9.36s/it]
  8%|▊         | 3062/37963 [6:54:36<84:49:27,  8.75s/it]
  8%|▊         | 3063/37963 [6:54:47<89:04:13,  9.19s/it]
  8%|▊         | 3064/37963 [6:54:54<85:01:47,  8.77s/it]
  8%|▊         | 3065/37963 [6:55:03<82:50:26,  8.55s/it]
  8%|▊         | 3066/37963 [6:55:10<80:32:46,  8.31s/it]
  8%|▊         | 3067/37963 [6:55:18<78:23:00,  8.09s/it]
  8%|▊         | 3068/37963 [6:55:26<77:40:35,  8.01s/it]
  8%|▊         | 3069/37963 [6:55:34<77:21:29,  7.98s/it]
  8%|▊         | 3070/37963 [6:55:41<76:24:00,  7.88s/it]
                                                         
{'loss': '0.1741', 'grad_norm': '3.938', 'learning_rate': '1.986e-05', 'epoch': '0.08087'}
+
  8%|▊         | 3070/37963 [6:55:41<76:24:00,  7.88s/it]
  8%|▊         | 3071/37963 [6:55:49<75:59:39,  7.84s/it]
  8%|▊         | 3072/37963 [6:55:57<75:55:30,  7.83s/it]
  8%|▊         | 3073/37963 [6:56:04<75:30:32,  7.79s/it]
  8%|▊         | 3074/37963 [6:56:12<75:44:49,  7.82s/it]
  8%|▊         | 3075/37963 [6:56:20<75:21:49,  7.78s/it]
  8%|▊         | 3076/37963 [6:56:28<74:31:31,  7.69s/it]
  8%|▊         | 3077/37963 [6:56:35<74:31:27,  7.69s/it]
  8%|▊         | 3078/37963 [6:56:43<73:33:53,  7.59s/it]
  8%|▊         | 3079/37963 [6:56:50<73:40:45,  7.60s/it]
  8%|▊         | 3080/37963 [6:56:58<73:57:50,  7.63s/it]
                                                         
{'loss': '0.1935', 'grad_norm': '3.711', 'learning_rate': '1.986e-05', 'epoch': '0.08113'}
+
  8%|▊         | 3080/37963 [6:56:58<73:57:50,  7.63s/it]
  8%|▊         | 3081/37963 [6:57:06<74:18:04,  7.67s/it]
  8%|▊         | 3082/37963 [6:57:13<74:41:26,  7.71s/it]
  8%|▊         | 3083/37963 [6:57:21<74:44:08,  7.71s/it]
  8%|▊         | 3084/37963 [6:57:32<82:24:56,  8.51s/it]
  8%|▊         | 3085/37963 [6:57:39<80:21:11,  8.29s/it]
  8%|▊         | 3086/37963 [6:57:47<78:30:35,  8.10s/it]
  8%|▊         | 3087/37963 [6:57:55<77:07:09,  7.96s/it]
  8%|▊         | 3088/37963 [6:58:05<84:00:54,  8.67s/it]
  8%|▊         | 3089/37963 [6:58:13<81:21:05,  8.40s/it]
  8%|▊         | 3090/37963 [6:58:20<78:34:13,  8.11s/it]
                                                         
{'loss': '0.188', 'grad_norm': '5.659', 'learning_rate': '1.986e-05', 'epoch': '0.0814'}
+
  8%|▊         | 3090/37963 [6:58:20<78:34:13,  8.11s/it]
  8%|▊         | 3091/37963 [6:58:28<76:48:10,  7.93s/it]
  8%|▊         | 3092/37963 [6:58:35<75:53:39,  7.84s/it]
  8%|▊         | 3093/37963 [6:58:43<75:27:29,  7.79s/it]
  8%|▊         | 3094/37963 [6:58:51<75:52:24,  7.83s/it]
  8%|▊         | 3095/37963 [6:58:59<75:58:45,  7.84s/it]
  8%|▊         | 3096/37963 [6:59:07<75:46:01,  7.82s/it]
  8%|▊         | 3097/37963 [6:59:14<75:49:54,  7.83s/it]
  8%|▊         | 3098/37963 [6:59:22<76:00:49,  7.85s/it]
  8%|▊         | 3099/37963 [6:59:30<74:50:29,  7.73s/it]
  8%|▊         | 3100/37963 [6:59:37<74:01:26,  7.64s/it]
                                                         
{'loss': '0.204', 'grad_norm': '1.877', 'learning_rate': '1.986e-05', 'epoch': '0.08166'}
+
  8%|▊         | 3100/37963 [6:59:37<74:01:26,  7.64s/it]
  8%|▊         | 3101/37963 [6:59:45<73:56:19,  7.64s/it]
  8%|▊         | 3102/37963 [6:59:55<81:55:25,  8.46s/it]
  8%|▊         | 3103/37963 [7:00:05<87:03:20,  8.99s/it]
  8%|▊         | 3104/37963 [7:00:13<83:16:39,  8.60s/it]
  8%|▊         | 3105/37963 [7:00:23<87:45:09,  9.06s/it]
  8%|▊         | 3106/37963 [7:00:31<84:20:18,  8.71s/it]
  8%|▊         | 3107/37963 [7:00:44<96:13:24,  9.94s/it]
  8%|▊         | 3108/37963 [7:00:52<90:32:46,  9.35s/it]
  8%|▊         | 3109/37963 [7:01:00<85:46:57,  8.86s/it]
  8%|▊         | 3110/37963 [7:01:08<82:59:26,  8.57s/it]
                                                         
{'loss': '0.1763', 'grad_norm': '4.475', 'learning_rate': '1.986e-05', 'epoch': '0.08192'}
+
  8%|▊         | 3110/37963 [7:01:08<82:59:26,  8.57s/it]
  8%|▊         | 3111/37963 [7:01:15<80:30:15,  8.32s/it]
  8%|▊         | 3112/37963 [7:01:22<77:03:33,  7.96s/it]
  8%|▊         | 3113/37963 [7:01:30<77:00:51,  7.96s/it]
  8%|▊         | 3114/37963 [7:01:38<77:12:28,  7.98s/it]
  8%|▊         | 3115/37963 [7:01:46<76:44:23,  7.93s/it]
  8%|▊         | 3116/37963 [7:01:54<75:34:06,  7.81s/it]
  8%|▊         | 3117/37963 [7:02:04<81:50:27,  8.46s/it]
  8%|▊         | 3118/37963 [7:02:11<80:01:56,  8.27s/it]
  8%|▊         | 3119/37963 [7:02:19<78:08:10,  8.07s/it]
  8%|▊         | 3120/37963 [7:02:27<77:26:46,  8.00s/it]
                                                         
{'loss': '0.1766', 'grad_norm': '2.621', 'learning_rate': '1.986e-05', 'epoch': '0.08219'}
+
  8%|▊         | 3120/37963 [7:02:27<77:26:46,  8.00s/it]
  8%|▊         | 3121/37963 [7:02:35<76:21:00,  7.89s/it]
  8%|▊         | 3122/37963 [7:02:42<75:55:25,  7.84s/it]
  8%|▊         | 3123/37963 [7:02:50<75:24:22,  7.79s/it]
  8%|▊         | 3124/37963 [7:02:58<74:50:48,  7.73s/it]
  8%|▊         | 3125/37963 [7:03:05<74:41:46,  7.72s/it]
  8%|▊         | 3126/37963 [7:03:13<74:01:14,  7.65s/it]
  8%|▊         | 3127/37963 [7:03:20<74:02:48,  7.65s/it]
  8%|▊         | 3128/37963 [7:03:31<81:10:48,  8.39s/it]
  8%|▊         | 3129/37963 [7:03:38<78:57:13,  8.16s/it]
  8%|▊         | 3130/37963 [7:03:46<77:13:22,  7.98s/it]
                                                         
{'loss': '0.1968', 'grad_norm': '7.076', 'learning_rate': '1.986e-05', 'epoch': '0.08245'}
+
  8%|▊         | 3130/37963 [7:03:46<77:13:22,  7.98s/it]
  8%|▊         | 3131/37963 [7:03:53<75:18:15,  7.78s/it]
  8%|▊         | 3132/37963 [7:04:03<82:07:38,  8.49s/it]
  8%|▊         | 3133/37963 [7:04:11<80:05:47,  8.28s/it]
  8%|▊         | 3134/37963 [7:04:19<78:12:50,  8.08s/it]
  8%|▊         | 3135/37963 [7:04:26<77:00:12,  7.96s/it]
  8%|▊         | 3136/37963 [7:04:34<76:08:26,  7.87s/it]
  8%|▊         | 3137/37963 [7:04:41<74:31:03,  7.70s/it]
  8%|▊         | 3138/37963 [7:04:49<74:11:59,  7.67s/it]
  8%|▊         | 3139/37963 [7:04:57<74:15:39,  7.68s/it]
  8%|▊         | 3140/37963 [7:05:04<74:19:06,  7.68s/it]
                                                         
{'loss': '0.1883', 'grad_norm': '3.319', 'learning_rate': '1.985e-05', 'epoch': '0.08271'}
+
  8%|▊         | 3140/37963 [7:05:04<74:19:06,  7.68s/it]
  8%|▊         | 3141/37963 [7:05:12<73:57:40,  7.65s/it]
  8%|▊         | 3142/37963 [7:05:19<73:56:41,  7.64s/it]
  8%|▊         | 3143/37963 [7:05:27<73:35:11,  7.61s/it]
  8%|▊         | 3144/37963 [7:05:35<73:44:16,  7.62s/it]
  8%|▊         | 3145/37963 [7:05:42<73:20:57,  7.58s/it]
  8%|▊         | 3146/37963 [7:05:50<73:59:47,  7.65s/it]
  8%|▊         | 3147/37963 [7:06:00<81:27:08,  8.42s/it]
  8%|▊         | 3148/37963 [7:06:08<79:21:35,  8.21s/it]
  8%|▊         | 3149/37963 [7:06:16<77:50:41,  8.05s/it]
  8%|▊         | 3150/37963 [7:06:31<98:06:12, 10.14s/it]
                                                         
{'loss': '0.19', 'grad_norm': '5.973', 'learning_rate': '1.985e-05', 'epoch': '0.08298'}
+
  8%|▊         | 3150/37963 [7:06:31<98:06:12, 10.14s/it]
  8%|▊         | 3151/37963 [7:06:38<91:17:40,  9.44s/it]
  8%|▊         | 3152/37963 [7:06:46<85:55:47,  8.89s/it]
  8%|▊         | 3153/37963 [7:06:56<89:30:51,  9.26s/it]
  8%|▊         | 3154/37963 [7:07:04<84:26:51,  8.73s/it]
  8%|▊         | 3155/37963 [7:07:11<81:15:24,  8.40s/it]
  8%|▊         | 3156/37963 [7:07:19<79:35:03,  8.23s/it]
  8%|▊         | 3157/37963 [7:07:27<78:29:37,  8.12s/it]
  8%|▊         | 3158/37963 [7:07:35<77:10:00,  7.98s/it]
  8%|▊         | 3159/37963 [7:07:42<75:38:27,  7.82s/it]
  8%|▊         | 3160/37963 [7:07:50<74:57:52,  7.75s/it]
                                                         
{'loss': '0.1779', 'grad_norm': '5.753', 'learning_rate': '1.985e-05', 'epoch': '0.08324'}
+
  8%|▊         | 3160/37963 [7:07:50<74:57:52,  7.75s/it]
  8%|▊         | 3161/37963 [7:07:57<73:58:53,  7.65s/it]
  8%|▊         | 3162/37963 [7:08:05<74:40:36,  7.72s/it]
  8%|▊         | 3163/37963 [7:08:13<74:29:59,  7.71s/it]
  8%|▊         | 3164/37963 [7:08:20<74:33:23,  7.71s/it]
  8%|▊         | 3165/37963 [7:08:28<74:04:02,  7.66s/it]
  8%|▊         | 3166/37963 [7:08:36<74:14:36,  7.68s/it]
  8%|▊         | 3167/37963 [7:08:43<72:56:59,  7.55s/it]
  8%|▊         | 3168/37963 [7:08:50<71:58:14,  7.45s/it]
  8%|▊         | 3169/37963 [7:08:58<72:39:13,  7.52s/it]
  8%|▊         | 3170/37963 [7:09:05<72:25:18,  7.49s/it]
                                                         
{'loss': '0.1733', 'grad_norm': '1.213', 'learning_rate': '1.985e-05', 'epoch': '0.0835'}
+
  8%|▊         | 3170/37963 [7:09:05<72:25:18,  7.49s/it]
  8%|▊         | 3171/37963 [7:09:15<79:16:48,  8.20s/it]
  8%|▊         | 3172/37963 [7:09:23<77:52:49,  8.06s/it]
  8%|▊         | 3173/37963 [7:09:30<76:50:32,  7.95s/it]
  8%|▊         | 3174/37963 [7:09:38<76:11:51,  7.89s/it]
  8%|▊         | 3175/37963 [7:09:46<75:13:31,  7.78s/it]
  8%|▊         | 3176/37963 [7:09:56<82:15:07,  8.51s/it]
  8%|▊         | 3177/37963 [7:10:04<79:40:35,  8.25s/it]
  8%|▊         | 3178/37963 [7:10:11<78:18:33,  8.10s/it]
  8%|▊         | 3179/37963 [7:10:19<77:06:00,  7.98s/it]
  8%|▊         | 3180/37963 [7:10:27<75:46:04,  7.84s/it]
                                                         
{'loss': '0.167', 'grad_norm': '4.853', 'learning_rate': '1.985e-05', 'epoch': '0.08377'}
+
  8%|▊         | 3180/37963 [7:10:27<75:46:04,  7.84s/it]
  8%|▊         | 3181/37963 [7:10:37<83:35:57,  8.65s/it]
  8%|▊         | 3182/37963 [7:10:45<81:11:49,  8.40s/it]
  8%|▊         | 3183/37963 [7:10:53<79:01:04,  8.18s/it]
  8%|▊         | 3184/37963 [7:11:00<77:23:57,  8.01s/it]
  8%|▊         | 3185/37963 [7:11:08<75:52:42,  7.85s/it]
  8%|▊         | 3186/37963 [7:11:15<75:28:59,  7.81s/it]
  8%|▊         | 3187/37963 [7:11:23<74:56:07,  7.76s/it]
  8%|▊         | 3188/37963 [7:11:31<74:27:58,  7.71s/it]
  8%|▊         | 3189/37963 [7:11:38<75:00:28,  7.77s/it]
  8%|▊         | 3190/37963 [7:11:46<74:45:22,  7.74s/it]
                                                         
{'loss': '0.1751', 'grad_norm': '3.621', 'learning_rate': '1.985e-05', 'epoch': '0.08403'}
+
  8%|▊         | 3190/37963 [7:11:46<74:45:22,  7.74s/it]
  8%|▊         | 3191/37963 [7:11:54<75:19:48,  7.80s/it]
  8%|▊         | 3192/37963 [7:12:02<74:52:03,  7.75s/it]
  8%|▊         | 3193/37963 [7:12:12<80:50:32,  8.37s/it]
  8%|▊         | 3194/37963 [7:12:24<93:51:34,  9.72s/it]
  8%|▊         | 3195/37963 [7:12:32<87:50:16,  9.10s/it]
  8%|▊         | 3196/37963 [7:12:40<83:05:02,  8.60s/it]
  8%|▊         | 3197/37963 [7:12:47<79:50:10,  8.27s/it]
  8%|▊         | 3198/37963 [7:12:55<78:06:39,  8.09s/it]
  8%|▊         | 3199/37963 [7:13:03<77:28:44,  8.02s/it]
  8%|▊         | 3200/37963 [7:13:10<76:12:00,  7.89s/it]
                                                         
{'loss': '0.1909', 'grad_norm': '5.292', 'learning_rate': '1.985e-05', 'epoch': '0.08429'}
+
  8%|▊         | 3200/37963 [7:13:10<76:12:00,  7.89s/it]
  8%|▊         | 3201/37963 [7:13:20<82:26:39,  8.54s/it]
  8%|▊         | 3202/37963 [7:13:28<79:49:00,  8.27s/it]
  8%|▊         | 3203/37963 [7:13:36<78:23:59,  8.12s/it]
  8%|▊         | 3204/37963 [7:13:46<84:39:26,  8.77s/it]
  8%|▊         | 3205/37963 [7:13:54<82:02:33,  8.50s/it]
  8%|▊         | 3206/37963 [7:14:01<78:54:08,  8.17s/it]
  8%|▊         | 3207/37963 [7:14:09<77:21:34,  8.01s/it]
  8%|▊         | 3208/37963 [7:14:16<76:16:38,  7.90s/it]
  8%|▊         | 3209/37963 [7:14:24<75:24:53,  7.81s/it]
  8%|▊         | 3210/37963 [7:14:32<74:55:48,  7.76s/it]
                                                         
{'loss': '0.175', 'grad_norm': '2.766', 'learning_rate': '1.984e-05', 'epoch': '0.08456'}
+
  8%|▊         | 3210/37963 [7:14:32<74:55:48,  7.76s/it]
  8%|▊         | 3211/37963 [7:14:39<74:35:48,  7.73s/it]
  8%|▊         | 3212/37963 [7:14:47<74:17:22,  7.70s/it]
  8%|▊         | 3213/37963 [7:14:55<74:25:54,  7.71s/it]
  8%|▊         | 3214/37963 [7:15:02<74:12:29,  7.69s/it]
  8%|▊         | 3215/37963 [7:15:10<73:56:32,  7.66s/it]
  8%|▊         | 3216/37963 [7:15:17<73:40:20,  7.63s/it]
  8%|▊         | 3217/37963 [7:15:25<73:59:19,  7.67s/it]
  8%|▊         | 3218/37963 [7:15:33<74:25:22,  7.71s/it]
  8%|▊         | 3219/37963 [7:15:41<74:31:13,  7.72s/it]
  8%|▊         | 3220/37963 [7:15:49<75:05:29,  7.78s/it]
                                                         
{'loss': '0.1766', 'grad_norm': '6.492', 'learning_rate': '1.984e-05', 'epoch': '0.08482'}
+
  8%|▊         | 3220/37963 [7:15:49<75:05:29,  7.78s/it]
  8%|▊         | 3221/37963 [7:15:56<74:53:02,  7.76s/it]
  8%|▊         | 3222/37963 [7:16:04<74:19:26,  7.70s/it]
  8%|▊         | 3223/37963 [7:16:11<73:40:00,  7.63s/it]
  8%|▊         | 3224/37963 [7:16:19<73:11:26,  7.58s/it]
  8%|▊         | 3225/37963 [7:16:29<79:54:46,  8.28s/it]
  8%|▊         | 3226/37963 [7:16:36<77:44:47,  8.06s/it]
  9%|▊         | 3227/37963 [7:16:44<75:53:06,  7.86s/it]
  9%|▊         | 3228/37963 [7:16:51<75:22:28,  7.81s/it]
  9%|▊         | 3229/37963 [7:17:01<81:20:53,  8.43s/it]
  9%|▊         | 3230/37963 [7:17:12<86:48:44,  9.00s/it]
                                                         
{'loss': '0.1853', 'grad_norm': '2.689', 'learning_rate': '1.984e-05', 'epoch': '0.08508'}
+
  9%|▊         | 3230/37963 [7:17:12<86:48:44,  9.00s/it]
  9%|▊         | 3231/37963 [7:17:19<82:13:21,  8.52s/it]
  9%|▊         | 3232/37963 [7:17:27<79:50:14,  8.28s/it]
  9%|▊         | 3233/37963 [7:17:34<77:51:16,  8.07s/it]
  9%|▊         | 3234/37963 [7:17:42<76:13:18,  7.90s/it]
  9%|▊         | 3235/37963 [7:17:49<74:54:39,  7.77s/it]
  9%|▊         | 3236/37963 [7:17:57<73:51:16,  7.66s/it]
  9%|▊         | 3237/37963 [7:18:07<79:58:37,  8.29s/it]
  9%|▊         | 3238/37963 [7:18:14<78:21:02,  8.12s/it]
  9%|▊         | 3239/37963 [7:18:22<77:04:39,  7.99s/it]
  9%|▊         | 3240/37963 [7:18:30<76:48:55,  7.96s/it]
                                                         
{'loss': '0.1699', 'grad_norm': '4.231', 'learning_rate': '1.984e-05', 'epoch': '0.08535'}
+
  9%|▊         | 3240/37963 [7:18:30<76:48:55,  7.96s/it]
  9%|▊         | 3241/37963 [7:18:40<83:07:08,  8.62s/it]
  9%|▊         | 3242/37963 [7:18:50<87:46:22,  9.10s/it]
  9%|▊         | 3243/37963 [7:18:58<83:46:46,  8.69s/it]
  9%|▊         | 3244/37963 [7:19:06<81:00:35,  8.40s/it]
  9%|▊         | 3245/37963 [7:19:13<78:50:59,  8.18s/it]
  9%|▊         | 3246/37963 [7:19:21<77:57:32,  8.08s/it]
  9%|▊         | 3247/37963 [7:19:29<76:18:22,  7.91s/it]
  9%|▊         | 3248/37963 [7:19:36<75:33:09,  7.83s/it]
  9%|▊         | 3249/37963 [7:19:47<82:38:02,  8.57s/it]
  9%|▊         | 3250/37963 [7:19:54<79:40:51,  8.26s/it]
                                                         
{'loss': '0.1921', 'grad_norm': '2.411', 'learning_rate': '1.984e-05', 'epoch': '0.08561'}
+
  9%|▊         | 3250/37963 [7:19:54<79:40:51,  8.26s/it]
  9%|▊         | 3251/37963 [7:20:02<78:19:49,  8.12s/it]
  9%|▊         | 3252/37963 [7:20:10<76:58:15,  7.98s/it]
  9%|▊         | 3253/37963 [7:20:17<75:57:39,  7.88s/it]
  9%|▊         | 3254/37963 [7:20:25<75:40:18,  7.85s/it]
  9%|▊         | 3255/37963 [7:20:32<74:19:49,  7.71s/it]
  9%|▊         | 3256/37963 [7:20:40<75:12:50,  7.80s/it]
  9%|▊         | 3257/37963 [7:20:48<75:00:24,  7.78s/it]
  9%|▊         | 3258/37963 [7:20:56<74:46:04,  7.76s/it]
  9%|▊         | 3259/37963 [7:21:06<82:35:58,  8.57s/it]
  9%|▊         | 3260/37963 [7:21:14<79:42:08,  8.27s/it]
                                                         
{'loss': '0.1771', 'grad_norm': '4.202', 'learning_rate': '1.984e-05', 'epoch': '0.08587'}
+
  9%|▊         | 3260/37963 [7:21:14<79:42:08,  8.27s/it]
  9%|▊         | 3261/37963 [7:21:21<77:40:50,  8.06s/it]
  9%|▊         | 3262/37963 [7:21:29<76:36:01,  7.95s/it]
  9%|▊         | 3263/37963 [7:21:37<76:03:26,  7.89s/it]
  9%|▊         | 3264/37963 [7:21:45<75:53:07,  7.87s/it]
  9%|▊         | 3265/37963 [7:21:52<74:58:26,  7.78s/it]
  9%|▊         | 3266/37963 [7:22:00<75:05:18,  7.79s/it]
  9%|▊         | 3267/37963 [7:22:08<74:06:40,  7.69s/it]
  9%|▊         | 3268/37963 [7:22:15<73:41:14,  7.65s/it]
  9%|▊         | 3269/37963 [7:22:23<74:01:18,  7.68s/it]
  9%|▊         | 3270/37963 [7:22:30<73:36:21,  7.64s/it]
                                                         
{'loss': '0.1824', 'grad_norm': '2.848', 'learning_rate': '1.984e-05', 'epoch': '0.08614'}
+
  9%|▊         | 3270/37963 [7:22:30<73:36:21,  7.64s/it]
  9%|▊         | 3271/37963 [7:22:38<73:08:29,  7.59s/it]
  9%|▊         | 3272/37963 [7:22:45<72:41:42,  7.54s/it]
  9%|▊         | 3273/37963 [7:22:53<72:45:05,  7.55s/it]
  9%|▊         | 3274/37963 [7:23:03<80:31:54,  8.36s/it]
  9%|▊         | 3275/37963 [7:23:11<79:01:53,  8.20s/it]
  9%|▊         | 3276/37963 [7:23:19<77:29:10,  8.04s/it]
  9%|▊         | 3277/37963 [7:23:26<75:57:59,  7.88s/it]
  9%|▊         | 3278/37963 [7:23:37<83:59:22,  8.72s/it]
  9%|▊         | 3279/37963 [7:23:47<88:00:41,  9.14s/it]
  9%|▊         | 3280/37963 [7:23:55<85:14:12,  8.85s/it]
                                                         
{'loss': '0.1865', 'grad_norm': '2.888', 'learning_rate': '1.983e-05', 'epoch': '0.0864'}
+
  9%|▊         | 3280/37963 [7:23:55<85:14:12,  8.85s/it]
  9%|▊         | 3281/37963 [7:24:03<81:10:45,  8.43s/it]
  9%|▊         | 3282/37963 [7:24:10<78:47:31,  8.18s/it]
  9%|▊         | 3283/37963 [7:24:18<76:35:17,  7.95s/it]
  9%|▊         | 3284/37963 [7:24:25<75:45:18,  7.86s/it]
  9%|▊         | 3285/37963 [7:24:38<90:33:10,  9.40s/it]
  9%|▊         | 3286/37963 [7:24:46<85:18:00,  8.86s/it]
  9%|▊         | 3287/37963 [7:24:53<81:52:43,  8.50s/it]
  9%|▊         | 3288/37963 [7:25:01<79:14:17,  8.23s/it]
  9%|▊         | 3289/37963 [7:25:09<77:17:54,  8.03s/it]
  9%|▊         | 3290/37963 [7:25:19<83:19:01,  8.65s/it]
                                                         
{'loss': '0.1869', 'grad_norm': '5.303', 'learning_rate': '1.983e-05', 'epoch': '0.08666'}
+
  9%|▊         | 3290/37963 [7:25:19<83:19:01,  8.65s/it]
  9%|▊         | 3291/37963 [7:25:26<79:44:59,  8.28s/it]
  9%|▊         | 3292/37963 [7:25:34<77:56:31,  8.09s/it]
  9%|▊         | 3293/37963 [7:25:44<83:15:02,  8.64s/it]
  9%|▊         | 3294/37963 [7:25:51<80:22:47,  8.35s/it]
  9%|▊         | 3295/37963 [7:25:59<78:25:38,  8.14s/it]
  9%|▊         | 3296/37963 [7:26:07<77:03:12,  8.00s/it]
  9%|▊         | 3297/37963 [7:26:14<75:55:12,  7.88s/it]
  9%|▊         | 3298/37963 [7:26:21<73:46:30,  7.66s/it]
  9%|▊         | 3299/37963 [7:26:29<72:38:37,  7.54s/it]
  9%|▊         | 3300/37963 [7:26:36<73:00:46,  7.58s/it]
                                                         
{'loss': '0.2051', 'grad_norm': '6.293', 'learning_rate': '1.983e-05', 'epoch': '0.08693'}
+
  9%|▊         | 3300/37963 [7:26:36<73:00:46,  7.58s/it]
  9%|▊         | 3301/37963 [7:26:44<72:54:04,  7.57s/it]
  9%|▊         | 3302/37963 [7:26:52<73:44:30,  7.66s/it]
  9%|▊         | 3303/37963 [7:26:59<72:04:56,  7.49s/it]
  9%|▊         | 3304/37963 [7:27:06<71:58:18,  7.48s/it]
  9%|▊         | 3305/37963 [7:27:14<72:02:26,  7.48s/it]
  9%|▊         | 3306/37963 [7:27:21<72:08:00,  7.49s/it]
  9%|▊         | 3307/37963 [7:27:29<72:11:32,  7.50s/it]
  9%|▊         | 3308/37963 [7:27:37<72:33:12,  7.54s/it]
  9%|▊         | 3309/37963 [7:27:44<72:58:10,  7.58s/it]
  9%|▊         | 3310/37963 [7:27:51<72:08:58,  7.50s/it]
                                                         
{'loss': '0.1802', 'grad_norm': '4.565', 'learning_rate': '1.983e-05', 'epoch': '0.08719'}
+
  9%|▊         | 3310/37963 [7:27:51<72:08:58,  7.50s/it]
  9%|▊         | 3311/37963 [7:27:59<72:27:37,  7.53s/it]
  9%|▊         | 3312/37963 [7:28:07<72:32:16,  7.54s/it]
  9%|▊         | 3313/37963 [7:28:16<78:57:19,  8.20s/it]
  9%|▊         | 3314/37963 [7:28:24<77:20:35,  8.04s/it]
  9%|▊         | 3315/37963 [7:28:32<76:05:46,  7.91s/it]
  9%|▊         | 3316/37963 [7:28:39<75:07:11,  7.81s/it]
  9%|▊         | 3317/37963 [7:28:47<74:22:33,  7.73s/it]
  9%|▊         | 3318/37963 [7:28:54<74:19:04,  7.72s/it]
  9%|▊         | 3319/37963 [7:29:02<74:53:43,  7.78s/it]
  9%|▊         | 3320/37963 [7:29:10<74:17:38,  7.72s/it]
                                                         
{'loss': '0.1699', 'grad_norm': '7.401', 'learning_rate': '1.983e-05', 'epoch': '0.08745'}
+
  9%|▊         | 3320/37963 [7:29:10<74:17:38,  7.72s/it]
  9%|▊         | 3321/37963 [7:29:18<74:48:20,  7.77s/it]
  9%|▉         | 3322/37963 [7:29:28<81:36:29,  8.48s/it]
  9%|▉         | 3323/37963 [7:29:36<80:09:30,  8.33s/it]
  9%|▉         | 3324/37963 [7:29:44<79:00:22,  8.21s/it]
  9%|▉         | 3325/37963 [7:29:52<77:50:41,  8.09s/it]
  9%|▉         | 3326/37963 [7:30:02<84:44:08,  8.81s/it]
  9%|▉         | 3327/37963 [7:30:10<82:32:25,  8.58s/it]
  9%|▉         | 3328/37963 [7:30:20<85:41:46,  8.91s/it]
  9%|▉         | 3329/37963 [7:30:30<89:19:43,  9.29s/it]
  9%|▉         | 3330/37963 [7:30:38<84:26:56,  8.78s/it]
                                                         
{'loss': '0.1804', 'grad_norm': '2.458', 'learning_rate': '1.983e-05', 'epoch': '0.08772'}
+
  9%|▉         | 3330/37963 [7:30:38<84:26:56,  8.78s/it]
  9%|▉         | 3331/37963 [7:30:46<82:24:41,  8.57s/it]
  9%|▉         | 3332/37963 [7:30:54<80:06:44,  8.33s/it]
  9%|▉         | 3333/37963 [7:31:04<85:52:27,  8.93s/it]
  9%|▉         | 3334/37963 [7:31:12<82:46:53,  8.61s/it]
  9%|▉         | 3335/37963 [7:31:19<80:00:18,  8.32s/it]
  9%|▉         | 3336/37963 [7:31:29<85:11:30,  8.86s/it]
  9%|▉         | 3337/37963 [7:31:37<80:58:58,  8.42s/it]
  9%|▉         | 3338/37963 [7:31:47<85:51:14,  8.93s/it]
  9%|▉         | 3339/37963 [7:31:54<81:05:39,  8.43s/it]
  9%|▉         | 3340/37963 [7:32:01<77:34:40,  8.07s/it]
                                                         
{'loss': '0.172', 'grad_norm': '4.335', 'learning_rate': '1.982e-05', 'epoch': '0.08798'}
+
  9%|▉         | 3340/37963 [7:32:01<77:34:40,  8.07s/it]
  9%|▉         | 3341/37963 [7:32:09<75:54:57,  7.89s/it]
  9%|▉         | 3342/37963 [7:32:17<75:34:35,  7.86s/it]
  9%|▉         | 3343/37963 [7:32:24<73:23:27,  7.63s/it]
  9%|▉         | 3344/37963 [7:32:31<71:51:04,  7.47s/it]
  9%|▉         | 3345/37963 [7:32:39<73:06:42,  7.60s/it]
  9%|▉         | 3346/37963 [7:32:46<72:50:57,  7.58s/it]
  9%|▉         | 3347/37963 [7:32:54<73:16:06,  7.62s/it]
  9%|▉         | 3348/37963 [7:33:01<71:26:57,  7.43s/it]
  9%|▉         | 3349/37963 [7:33:09<72:00:53,  7.49s/it]
  9%|▉         | 3350/37963 [7:33:17<72:52:41,  7.58s/it]
                                                         
{'loss': '0.1843', 'grad_norm': '3.73', 'learning_rate': '1.982e-05', 'epoch': '0.08824'}
+
  9%|▉         | 3350/37963 [7:33:17<72:52:41,  7.58s/it]
  9%|▉         | 3351/37963 [7:33:24<73:26:29,  7.64s/it]
  9%|▉         | 3352/37963 [7:33:32<73:03:05,  7.60s/it]
  9%|▉         | 3353/37963 [7:33:40<73:33:07,  7.65s/it]
  9%|▉         | 3354/37963 [7:33:47<74:18:15,  7.73s/it]
  9%|▉         | 3355/37963 [7:33:55<74:07:47,  7.71s/it]
  9%|▉         | 3356/37963 [7:34:03<73:44:15,  7.67s/it]
  9%|▉         | 3357/37963 [7:34:10<73:45:28,  7.67s/it]
  9%|▉         | 3358/37963 [7:34:18<74:02:29,  7.70s/it]
  9%|▉         | 3359/37963 [7:34:26<73:23:26,  7.64s/it]
  9%|▉         | 3360/37963 [7:34:33<73:02:52,  7.60s/it]
                                                         
{'loss': '0.1868', 'grad_norm': '5.631', 'learning_rate': '1.982e-05', 'epoch': '0.08851'}
+
  9%|▉         | 3360/37963 [7:34:33<73:02:52,  7.60s/it]
  9%|▉         | 3361/37963 [7:34:44<81:12:22,  8.45s/it]
  9%|▉         | 3362/37963 [7:34:51<78:52:03,  8.21s/it]
  9%|▉         | 3363/37963 [7:34:59<77:51:37,  8.10s/it]
  9%|▉         | 3364/37963 [7:35:07<77:00:29,  8.01s/it]
  9%|▉         | 3365/37963 [7:35:15<76:01:17,  7.91s/it]
  9%|▉         | 3366/37963 [7:35:25<82:36:45,  8.60s/it]
  9%|▉         | 3367/37963 [7:35:32<79:38:18,  8.29s/it]
  9%|▉         | 3368/37963 [7:35:40<78:06:26,  8.13s/it]
  9%|▉         | 3369/37963 [7:35:48<76:55:35,  8.01s/it]
  9%|▉         | 3370/37963 [7:35:55<75:16:39,  7.83s/it]
                                                         
{'loss': '0.1886', 'grad_norm': '4.01', 'learning_rate': '1.982e-05', 'epoch': '0.08877'}
+
  9%|▉         | 3370/37963 [7:35:55<75:16:39,  7.83s/it]
  9%|▉         | 3371/37963 [7:36:03<74:53:44,  7.79s/it]
  9%|▉         | 3372/37963 [7:36:11<74:38:44,  7.77s/it]
  9%|▉         | 3373/37963 [7:36:21<81:47:41,  8.51s/it]
  9%|▉         | 3374/37963 [7:36:29<79:16:11,  8.25s/it]
  9%|▉         | 3375/37963 [7:36:39<85:21:55,  8.89s/it]
  9%|▉         | 3376/37963 [7:36:47<81:43:23,  8.51s/it]
  9%|▉         | 3377/37963 [7:36:57<86:27:11,  9.00s/it]
  9%|▉         | 3378/37963 [7:37:04<82:38:29,  8.60s/it]
  9%|▉         | 3379/37963 [7:37:12<79:34:54,  8.28s/it]
  9%|▉         | 3380/37963 [7:37:19<77:37:19,  8.08s/it]
                                                         
{'loss': '0.1797', 'grad_norm': '5.326', 'learning_rate': '1.982e-05', 'epoch': '0.08903'}
+
  9%|▉         | 3380/37963 [7:37:19<77:37:19,  8.08s/it]
  9%|▉         | 3381/37963 [7:37:27<75:30:19,  7.86s/it]
  9%|▉         | 3382/37963 [7:37:37<82:04:34,  8.54s/it]
  9%|▉         | 3383/37963 [7:37:45<79:31:51,  8.28s/it]
  9%|▉         | 3384/37963 [7:37:53<78:22:37,  8.16s/it]
  9%|▉         | 3385/37963 [7:38:03<83:57:07,  8.74s/it]
  9%|▉         | 3386/37963 [7:38:10<81:22:59,  8.47s/it]
  9%|▉         | 3387/37963 [7:38:21<86:14:56,  8.98s/it]
  9%|▉         | 3388/37963 [7:38:28<82:09:39,  8.55s/it]
  9%|▉         | 3389/37963 [7:38:36<79:19:31,  8.26s/it]
  9%|▉         | 3390/37963 [7:38:43<77:44:54,  8.10s/it]
                                                         
{'loss': '0.1719', 'grad_norm': '2.39', 'learning_rate': '1.982e-05', 'epoch': '0.0893'}
+
  9%|▉         | 3390/37963 [7:38:43<77:44:54,  8.10s/it]
  9%|▉         | 3391/37963 [7:38:51<76:03:58,  7.92s/it]
  9%|▉         | 3392/37963 [7:38:59<74:56:39,  7.80s/it]
  9%|▉         | 3393/37963 [7:39:06<73:40:42,  7.67s/it]
  9%|▉         | 3394/37963 [7:39:14<73:41:36,  7.67s/it]
  9%|��         | 3395/37963 [7:39:21<73:12:11,  7.62s/it]
  9%|▉         | 3396/37963 [7:39:28<72:15:49,  7.53s/it]
  9%|▉         | 3397/37963 [7:39:36<72:50:33,  7.59s/it]
  9%|▉         | 3398/37963 [7:39:44<72:59:01,  7.60s/it]
  9%|▉         | 3399/37963 [7:39:51<73:21:09,  7.64s/it]
  9%|▉         | 3400/37963 [7:39:59<73:27:04,  7.65s/it]
                                                         
{'loss': '0.1863', 'grad_norm': '2.116', 'learning_rate': '1.981e-05', 'epoch': '0.08956'}
+
  9%|▉         | 3400/37963 [7:39:59<73:27:04,  7.65s/it]
  9%|▉         | 3401/37963 [7:40:07<74:05:47,  7.72s/it]
  9%|▉         | 3402/37963 [7:40:15<73:48:38,  7.69s/it]
  9%|▉         | 3403/37963 [7:40:22<73:54:53,  7.70s/it]
  9%|▉         | 3404/37963 [7:40:30<74:03:57,  7.72s/it]
  9%|▉         | 3405/37963 [7:40:40<81:30:24,  8.49s/it]
  9%|▉         | 3406/37963 [7:40:48<79:36:53,  8.29s/it]
  9%|▉         | 3407/37963 [7:40:56<77:41:43,  8.09s/it]
  9%|▉         | 3408/37963 [7:41:04<76:36:10,  7.98s/it]
  9%|▉         | 3409/37963 [7:41:11<75:55:05,  7.91s/it]
  9%|▉         | 3410/37963 [7:41:19<74:15:29,  7.74s/it]
                                                         
{'loss': '0.1745', 'grad_norm': '3.559', 'learning_rate': '1.981e-05', 'epoch': '0.08982'}
+
  9%|▉         | 3410/37963 [7:41:19<74:15:29,  7.74s/it]
  9%|▉         | 3411/37963 [7:41:26<74:00:27,  7.71s/it]
  9%|▉         | 3412/37963 [7:41:34<73:42:35,  7.68s/it]
  9%|▉         | 3413/37963 [7:41:42<73:36:46,  7.67s/it]
  9%|▉         | 3414/37963 [7:41:49<73:08:22,  7.62s/it]
  9%|▉         | 3415/37963 [7:41:56<72:16:12,  7.53s/it]
  9%|▉         | 3416/37963 [7:42:04<72:23:32,  7.54s/it]
  9%|▉         | 3417/37963 [7:42:14<79:59:39,  8.34s/it]
  9%|▉         | 3418/37963 [7:42:22<78:26:25,  8.17s/it]
  9%|▉         | 3419/37963 [7:42:32<84:38:58,  8.82s/it]
  9%|▉         | 3420/37963 [7:42:43<89:06:48,  9.29s/it]
                                                         
{'loss': '0.1766', 'grad_norm': '3.283', 'learning_rate': '1.981e-05', 'epoch': '0.09009'}
+
  9%|▉         | 3420/37963 [7:42:43<89:06:48,  9.29s/it]
  9%|▉         | 3421/37963 [7:42:50<84:21:25,  8.79s/it]
  9%|▉         | 3422/37963 [7:42:58<81:21:56,  8.48s/it]
  9%|▉         | 3423/37963 [7:43:06<79:18:40,  8.27s/it]
  9%|▉         | 3424/37963 [7:43:16<84:38:39,  8.82s/it]
  9%|▉         | 3425/37963 [7:43:23<80:21:57,  8.38s/it]
  9%|▉         | 3426/37963 [7:43:31<78:07:09,  8.14s/it]
  9%|▉         | 3427/37963 [7:43:38<76:22:16,  7.96s/it]
  9%|▉         | 3428/37963 [7:43:49<83:44:01,  8.73s/it]
  9%|▉         | 3429/37963 [7:43:57<80:47:56,  8.42s/it]
  9%|▉         | 3430/37963 [7:44:07<85:48:10,  8.94s/it]
                                                         
{'loss': '0.1843', 'grad_norm': '2.042', 'learning_rate': '1.981e-05', 'epoch': '0.09035'}
+
  9%|▉         | 3430/37963 [7:44:07<85:48:10,  8.94s/it]
  9%|▉         | 3431/37963 [7:44:14<81:56:14,  8.54s/it]
  9%|▉         | 3432/37963 [7:44:22<78:23:24,  8.17s/it]
  9%|▉         | 3433/37963 [7:44:30<77:26:03,  8.07s/it]
  9%|▉         | 3434/37963 [7:44:37<76:22:14,  7.96s/it]
  9%|▉         | 3435/37963 [7:44:45<75:15:44,  7.85s/it]
  9%|▉         | 3436/37963 [7:44:52<74:20:47,  7.75s/it]
  9%|▉         | 3437/37963 [7:45:00<73:51:47,  7.70s/it]
  9%|▉         | 3438/37963 [7:45:08<73:53:45,  7.71s/it]
  9%|▉         | 3439/37963 [7:45:15<73:23:56,  7.65s/it]
  9%|▉         | 3440/37963 [7:45:25<80:27:45,  8.39s/it]
                                                         
{'loss': '0.191', 'grad_norm': '3.505', 'learning_rate': '1.981e-05', 'epoch': '0.09061'}
+
  9%|▉         | 3440/37963 [7:45:25<80:27:45,  8.39s/it]
  9%|▉         | 3441/37963 [7:45:33<78:07:38,  8.15s/it]
  9%|▉         | 3442/37963 [7:45:41<76:50:59,  8.01s/it]
  9%|▉         | 3443/37963 [7:45:48<75:06:52,  7.83s/it]
  9%|▉         | 3444/37963 [7:45:56<74:10:56,  7.74s/it]
  9%|▉         | 3445/37963 [7:46:03<73:34:49,  7.67s/it]
  9%|▉         | 3446/37963 [7:46:11<73:56:30,  7.71s/it]
  9%|▉         | 3447/37963 [7:46:19<73:51:57,  7.70s/it]
  9%|▉         | 3448/37963 [7:46:26<73:27:37,  7.66s/it]
  9%|▉         | 3449/37963 [7:46:36<80:30:41,  8.40s/it]
  9%|▉         | 3450/37963 [7:46:44<78:16:16,  8.16s/it]
                                                         
{'loss': '0.1747', 'grad_norm': '2.884', 'learning_rate': '1.981e-05', 'epoch': '0.09088'}
+
  9%|▉         | 3450/37963 [7:46:44<78:16:16,  8.16s/it]
  9%|▉         | 3451/37963 [7:46:52<77:00:26,  8.03s/it]
  9%|▉         | 3452/37963 [7:46:59<76:10:25,  7.95s/it]
  9%|▉         | 3453/37963 [7:47:07<75:25:00,  7.87s/it]
  9%|▉         | 3454/37963 [7:47:14<73:58:55,  7.72s/it]
  9%|▉         | 3455/37963 [7:47:22<74:06:10,  7.73s/it]
  9%|▉         | 3456/37963 [7:47:30<74:01:39,  7.72s/it]
  9%|▉         | 3457/37963 [7:47:37<73:14:52,  7.64s/it]
  9%|▉         | 3458/37963 [7:47:45<72:51:47,  7.60s/it]
  9%|▉         | 3459/37963 [7:47:52<72:08:23,  7.53s/it]
  9%|▉         | 3460/37963 [7:48:00<72:22:10,  7.55s/it]
                                                         
{'loss': '0.1718', 'grad_norm': '1.718', 'learning_rate': '1.98e-05', 'epoch': '0.09114'}
+
  9%|▉         | 3460/37963 [7:48:00<72:22:10,  7.55s/it]
  9%|▉         | 3461/37963 [7:48:08<72:59:24,  7.62s/it]
  9%|▉         | 3462/37963 [7:48:15<72:40:47,  7.58s/it]
  9%|▉         | 3463/37963 [7:48:25<80:01:32,  8.35s/it]
  9%|▉         | 3464/37963 [7:48:35<85:00:27,  8.87s/it]
  9%|▉         | 3465/37963 [7:48:43<80:55:01,  8.44s/it]
  9%|▉         | 3466/37963 [7:48:50<78:37:46,  8.21s/it]
  9%|▉         | 3467/37963 [7:48:58<76:42:30,  8.01s/it]
  9%|▉         | 3468/37963 [7:49:06<76:23:07,  7.97s/it]
  9%|▉         | 3469/37963 [7:49:13<75:07:14,  7.84s/it]
  9%|▉         | 3470/37963 [7:49:24<81:54:59,  8.55s/it]
                                                         
{'loss': '0.1743', 'grad_norm': '1.845', 'learning_rate': '1.98e-05', 'epoch': '0.09141'}
+
  9%|▉         | 3470/37963 [7:49:24<81:54:59,  8.55s/it]
  9%|▉         | 3471/37963 [7:49:31<79:14:46,  8.27s/it]
  9%|▉         | 3472/37963 [7:49:44<93:09:43,  9.72s/it]
  9%|▉         | 3473/37963 [7:49:52<87:10:16,  9.10s/it]
  9%|▉         | 3474/37963 [7:49:59<82:39:58,  8.63s/it]
  9%|▉         | 3475/37963 [7:50:07<79:44:31,  8.32s/it]
  9%|▉         | 3476/37963 [7:50:17<85:12:34,  8.89s/it]
  9%|▉         | 3477/37963 [7:50:25<81:52:34,  8.55s/it]
  9%|▉         | 3478/37963 [7:50:33<78:58:43,  8.24s/it]
  9%|▉         | 3479/37963 [7:50:40<77:30:19,  8.09s/it]
  9%|▉         | 3480/37963 [7:50:48<75:56:42,  7.93s/it]
                                                         
{'loss': '0.1999', 'grad_norm': '3.248', 'learning_rate': '1.98e-05', 'epoch': '0.09167'}
+
  9%|▉         | 3480/37963 [7:50:48<75:56:42,  7.93s/it]
  9%|▉         | 3481/37963 [7:50:56<76:01:51,  7.94s/it]
  9%|▉         | 3482/37963 [7:51:03<75:22:02,  7.87s/it]
  9%|▉         | 3483/37963 [7:51:11<74:12:41,  7.75s/it]
  9%|▉         | 3484/37963 [7:51:18<73:33:34,  7.68s/it]
  9%|▉         | 3485/37963 [7:51:26<74:10:41,  7.75s/it]
  9%|▉         | 3486/37963 [7:51:34<73:52:45,  7.71s/it]
  9%|▉         | 3487/37963 [7:51:42<73:49:51,  7.71s/it]
  9%|▉         | 3488/37963 [7:51:52<81:42:46,  8.53s/it]
  9%|▉         | 3489/37963 [7:52:00<78:39:47,  8.21s/it]
  9%|▉         | 3490/37963 [7:52:07<76:05:04,  7.95s/it]
                                                         
{'loss': '0.1658', 'grad_norm': '3.699', 'learning_rate': '1.98e-05', 'epoch': '0.09193'}
+
  9%|▉         | 3490/37963 [7:52:07<76:05:04,  7.95s/it]
  9%|▉         | 3491/37963 [7:52:14<74:51:37,  7.82s/it]
  9%|▉         | 3492/37963 [7:52:25<81:43:13,  8.53s/it]
  9%|▉         | 3493/37963 [7:52:33<79:54:44,  8.35s/it]
  9%|▉         | 3494/37963 [7:52:40<77:28:49,  8.09s/it]
  9%|▉         | 3495/37963 [7:52:48<76:05:17,  7.95s/it]
  9%|▉         | 3496/37963 [7:52:55<75:30:49,  7.89s/it]
  9%|▉         | 3497/37963 [7:53:03<75:04:23,  7.84s/it]
  9%|▉         | 3498/37963 [7:53:11<73:56:43,  7.72s/it]
  9%|▉         | 3499/37963 [7:53:18<73:08:28,  7.64s/it]
  9%|▉         | 3500/37963 [7:53:26<72:44:23,  7.60s/it]
                                                         
{'loss': '0.1902', 'grad_norm': '1.84', 'learning_rate': '1.98e-05', 'epoch': '0.0922'}
+
  9%|▉         | 3500/37963 [7:53:26<72:44:23,  7.60s/it]
  9%|▉         | 3501/37963 [7:53:33<72:21:25,  7.56s/it]
  9%|▉         | 3502/37963 [7:53:41<72:35:06,  7.58s/it]
  9%|▉         | 3503/37963 [7:53:48<72:28:18,  7.57s/it]
  9%|▉         | 3504/37963 [7:53:56<72:33:21,  7.58s/it]
  9%|▉         | 3505/37963 [7:54:03<72:06:24,  7.53s/it]
  9%|▉         | 3506/37963 [7:54:11<72:27:07,  7.57s/it]
  9%|▉         | 3507/37963 [7:54:21<79:50:31,  8.34s/it]
  9%|▉         | 3508/37963 [7:54:29<78:21:05,  8.19s/it]
  9%|▉         | 3509/37963 [7:54:37<77:02:01,  8.05s/it]
  9%|▉         | 3510/37963 [7:54:44<75:59:22,  7.94s/it]
                                                         
{'loss': '0.1771', 'grad_norm': '2.372', 'learning_rate': '1.98e-05', 'epoch': '0.09246'}
+
  9%|▉         | 3510/37963 [7:54:44<75:59:22,  7.94s/it]
  9%|▉         | 3511/37963 [7:54:54<82:18:16,  8.60s/it]
  9%|▉         | 3512/37963 [7:55:02<80:04:02,  8.37s/it]
  9%|▉         | 3513/37963 [7:55:10<78:09:35,  8.17s/it]
  9%|▉         | 3514/37963 [7:55:20<84:20:14,  8.81s/it]
  9%|▉         | 3515/37963 [7:55:28<81:18:55,  8.50s/it]
  9%|▉         | 3516/37963 [7:55:36<78:57:47,  8.25s/it]
  9%|▉         | 3517/37963 [7:55:43<76:34:39,  8.00s/it]
  9%|▉         | 3518/37963 [7:55:53<82:24:21,  8.61s/it]
  9%|▉         | 3519/37963 [7:56:03<86:23:00,  9.03s/it]
  9%|▉         | 3520/37963 [7:56:11<82:44:23,  8.65s/it]
                                                         
{'loss': '0.1792', 'grad_norm': '2.969', 'learning_rate': '1.979e-05', 'epoch': '0.09272'}
+
  9%|▉         | 3520/37963 [7:56:11<82:44:23,  8.65s/it]
  9%|▉         | 3521/37963 [7:56:19<80:13:56,  8.39s/it]
  9%|▉         | 3522/37963 [7:56:26<77:34:44,  8.11s/it]
  9%|▉         | 3523/37963 [7:56:34<76:25:07,  7.99s/it]
  9%|▉         | 3524/37963 [7:56:44<83:58:45,  8.78s/it]
  9%|▉         | 3525/37963 [7:56:52<80:27:40,  8.41s/it]
  9%|▉         | 3526/37963 [7:57:00<77:50:12,  8.14s/it]
  9%|▉         | 3527/37963 [7:57:07<76:05:23,  7.95s/it]
  9%|▉         | 3528/37963 [7:57:15<75:30:20,  7.89s/it]
  9%|▉         | 3529/37963 [7:57:22<74:05:57,  7.75s/it]
  9%|▉         | 3530/37963 [7:57:30<74:01:24,  7.74s/it]
                                                         
{'loss': '0.1741', 'grad_norm': '3.042', 'learning_rate': '1.979e-05', 'epoch': '0.09299'}
+
  9%|▉         | 3530/37963 [7:57:30<74:01:24,  7.74s/it]
  9%|▉         | 3531/37963 [7:57:38<73:35:41,  7.69s/it]
  9%|▉         | 3532/37963 [7:57:45<72:44:04,  7.60s/it]
  9%|▉         | 3533/37963 [7:57:53<72:56:20,  7.63s/it]
  9%|▉         | 3534/37963 [7:58:00<73:38:24,  7.70s/it]
  9%|▉         | 3535/37963 [7:58:08<73:09:06,  7.65s/it]
  9%|▉         | 3536/37963 [7:58:18<79:56:41,  8.36s/it]
  9%|▉         | 3537/37963 [7:58:28<85:23:29,  8.93s/it]
  9%|▉         | 3538/37963 [7:58:36<81:47:41,  8.55s/it]
  9%|▉         | 3539/37963 [7:58:44<79:18:55,  8.29s/it]
  9%|▉         | 3540/37963 [7:58:51<77:53:51,  8.15s/it]
                                                         
{'loss': '0.1857', 'grad_norm': '2.68', 'learning_rate': '1.979e-05', 'epoch': '0.09325'}
+
  9%|▉         | 3540/37963 [7:58:51<77:53:51,  8.15s/it]
  9%|▉         | 3541/37963 [7:58:59<76:55:18,  8.04s/it]
  9%|▉         | 3542/37963 [7:59:07<76:22:19,  7.99s/it]
  9%|▉         | 3543/37963 [7:59:15<75:18:23,  7.88s/it]
  9%|▉         | 3544/37963 [7:59:22<74:47:55,  7.82s/it]
  9%|▉         | 3545/37963 [7:59:30<74:05:25,  7.75s/it]
  9%|▉         | 3546/37963 [7:59:38<74:26:09,  7.79s/it]
  9%|▉         | 3547/37963 [7:59:45<73:42:13,  7.71s/it]
  9%|▉         | 3548/37963 [7:59:53<74:01:25,  7.74s/it]
  9%|▉         | 3549/37963 [8:00:01<73:54:53,  7.73s/it]
  9%|▉         | 3550/37963 [8:00:11<80:53:39,  8.46s/it]
                                                         
{'loss': '0.1857', 'grad_norm': '2.07', 'learning_rate': '1.979e-05', 'epoch': '0.09351'}
+
  9%|▉         | 3550/37963 [8:00:11<80:53:39,  8.46s/it]
  9%|▉         | 3551/37963 [8:00:19<78:53:06,  8.25s/it]
  9%|▉         | 3552/37963 [8:00:27<77:12:10,  8.08s/it]
  9%|▉         | 3553/37963 [8:00:34<76:20:43,  7.99s/it]
  9%|▉         | 3554/37963 [8:00:42<75:47:25,  7.93s/it]
  9%|▉         | 3555/37963 [8:00:50<75:10:13,  7.86s/it]
  9%|▉         | 3556/37963 [8:00:58<74:52:19,  7.83s/it]
  9%|▉         | 3557/37963 [8:01:05<74:23:58,  7.78s/it]
  9%|▉         | 3558/37963 [8:01:13<72:57:46,  7.63s/it]
  9%|▉         | 3559/37963 [8:01:23<79:56:56,  8.37s/it]
  9%|▉         | 3560/37963 [8:01:30<78:06:57,  8.17s/it]
                                                         
{'loss': '0.1893', 'grad_norm': '3.551', 'learning_rate': '1.979e-05', 'epoch': '0.09378'}
+
  9%|▉         | 3560/37963 [8:01:30<78:06:57,  8.17s/it]
  9%|▉         | 3561/37963 [8:01:38<76:21:41,  7.99s/it]
  9%|▉         | 3562/37963 [8:01:48<82:27:09,  8.63s/it]
  9%|▉         | 3563/37963 [8:01:56<79:34:08,  8.33s/it]
  9%|▉         | 3564/37963 [8:02:03<78:12:29,  8.18s/it]
  9%|▉         | 3565/37963 [8:02:11<76:41:46,  8.03s/it]
  9%|▉         | 3566/37963 [8:02:19<75:12:11,  7.87s/it]
  9%|▉         | 3567/37963 [8:02:29<82:41:54,  8.66s/it]
  9%|▉         | 3568/37963 [8:02:39<86:56:36,  9.10s/it]
  9%|▉         | 3569/37963 [8:02:50<90:12:57,  9.44s/it]
  9%|▉         | 3570/37963 [8:02:57<84:52:10,  8.88s/it]
                                                         
{'loss': '0.1923', 'grad_norm': '3.178', 'learning_rate': '1.979e-05', 'epoch': '0.09404'}
+
  9%|▉         | 3570/37963 [8:02:57<84:52:10,  8.88s/it]
  9%|▉         | 3571/37963 [8:03:05<80:44:50,  8.45s/it]
  9%|▉         | 3572/37963 [8:03:12<78:32:52,  8.22s/it]
  9%|▉         | 3573/37963 [8:03:20<77:11:24,  8.08s/it]
  9%|▉         | 3574/37963 [8:03:28<75:44:44,  7.93s/it]
  9%|▉         | 3575/37963 [8:03:35<75:17:30,  7.88s/it]
  9%|▉         | 3576/37963 [8:03:43<74:40:50,  7.82s/it]
  9%|▉         | 3577/37963 [8:03:50<73:15:05,  7.67s/it]
  9%|▉         | 3578/37963 [8:03:58<72:43:34,  7.61s/it]
  9%|▉         | 3579/37963 [8:04:05<72:21:54,  7.58s/it]
  9%|▉         | 3580/37963 [8:04:13<72:07:11,  7.55s/it]
                                                         
{'loss': '0.1887', 'grad_norm': '1.978', 'learning_rate': '1.978e-05', 'epoch': '0.0943'}
+
  9%|▉         | 3580/37963 [8:04:13<72:07:11,  7.55s/it]
  9%|▉         | 3581/37963 [8:04:20<72:17:55,  7.57s/it]
  9%|▉         | 3582/37963 [8:04:28<72:54:14,  7.63s/it]
  9%|▉         | 3583/37963 [8:04:36<73:47:17,  7.73s/it]
  9%|▉         | 3584/37963 [8:04:46<80:34:29,  8.44s/it]
  9%|▉         | 3585/37963 [8:04:56<85:45:41,  8.98s/it]
  9%|▉         | 3586/37963 [8:05:04<81:58:21,  8.58s/it]
  9%|▉         | 3587/37963 [8:05:12<79:45:28,  8.35s/it]
  9%|▉         | 3588/37963 [8:05:19<77:19:35,  8.10s/it]
  9%|▉         | 3589/37963 [8:05:27<76:20:17,  7.99s/it]
  9%|▉         | 3590/37963 [8:05:35<74:52:54,  7.84s/it]
                                                         
{'loss': '0.1749', 'grad_norm': '3.069', 'learning_rate': '1.978e-05', 'epoch': '0.09457'}
+
  9%|▉         | 3590/37963 [8:05:35<74:52:54,  7.84s/it]
  9%|▉         | 3591/37963 [8:05:42<74:07:06,  7.76s/it]
  9%|▉         | 3592/37963 [8:05:50<73:41:36,  7.72s/it]
  9%|▉         | 3593/37963 [8:05:57<72:27:30,  7.59s/it]
  9%|▉         | 3594/37963 [8:06:05<72:29:30,  7.59s/it]
  9%|▉         | 3595/37963 [8:06:12<72:49:19,  7.63s/it]
  9%|▉         | 3596/37963 [8:06:20<72:25:48,  7.59s/it]
  9%|▉         | 3597/37963 [8:06:28<73:06:57,  7.66s/it]
  9%|▉         | 3598/37963 [8:06:36<73:44:58,  7.73s/it]
  9%|▉         | 3599/37963 [8:06:44<74:10:25,  7.77s/it]
  9%|▉         | 3600/37963 [8:06:52<75:09:15,  7.87s/it]
                                                         
{'loss': '0.1773', 'grad_norm': '4.024', 'learning_rate': '1.978e-05', 'epoch': '0.09483'}
+
  9%|▉         | 3600/37963 [8:06:52<75:09:15,  7.87s/it]
  9%|▉         | 3601/37963 [8:06:59<74:03:16,  7.76s/it]
  9%|▉         | 3602/37963 [8:07:07<73:36:16,  7.71s/it]
  9%|▉         | 3603/37963 [8:07:14<73:23:05,  7.69s/it]
  9%|▉         | 3604/37963 [8:07:25<80:44:10,  8.46s/it]
  9%|▉         | 3605/37963 [8:07:32<78:21:53,  8.21s/it]
  9%|▉         | 3606/37963 [8:07:42<84:02:45,  8.81s/it]
 10%|▉         | 3607/37963 [8:07:50<80:29:59,  8.44s/it]
 10%|▉         | 3608/37963 [8:07:58<78:26:42,  8.22s/it]
 10%|▉         | 3609/37963 [8:08:05<76:42:22,  8.04s/it]
 10%|▉         | 3610/37963 [8:08:16<82:51:13,  8.68s/it]
                                                         
{'loss': '0.1795', 'grad_norm': '4.107', 'learning_rate': '1.978e-05', 'epoch': '0.09509'}
+
 10%|▉         | 3610/37963 [8:08:16<82:51:13,  8.68s/it]
 10%|▉         | 3611/37963 [8:08:23<79:29:28,  8.33s/it]
 10%|▉         | 3612/37963 [8:08:31<78:12:24,  8.20s/it]
 10%|▉         | 3613/37963 [8:08:38<76:19:17,  8.00s/it]
 10%|▉         | 3614/37963 [8:08:46<75:14:43,  7.89s/it]
 10%|▉         | 3615/37963 [8:08:54<74:25:22,  7.80s/it]
 10%|▉         | 3616/37963 [8:09:06<87:33:55,  9.18s/it]
 10%|▉         | 3617/37963 [8:09:16<89:55:52,  9.43s/it]
 10%|▉         | 3618/37963 [8:09:24<85:15:51,  8.94s/it]
 10%|▉         | 3619/37963 [8:09:31<81:13:07,  8.51s/it]
 10%|▉         | 3620/37963 [8:09:39<78:47:28,  8.26s/it]
                                                         
{'loss': '0.1813', 'grad_norm': '7.878', 'learning_rate': '1.978e-05', 'epoch': '0.09536'}
+
 10%|▉         | 3620/37963 [8:09:39<78:47:28,  8.26s/it]
 10%|▉         | 3621/37963 [8:09:47<76:57:34,  8.07s/it]
 10%|▉         | 3622/37963 [8:09:54<75:10:55,  7.88s/it]
 10%|▉         | 3623/37963 [8:10:02<74:42:51,  7.83s/it]
 10%|▉         | 3624/37963 [8:10:09<73:58:47,  7.76s/it]
 10%|▉         | 3625/37963 [8:10:17<73:14:05,  7.68s/it]
 10%|▉         | 3626/37963 [8:10:25<73:25:02,  7.70s/it]
 10%|▉         | 3627/37963 [8:10:32<73:00:28,  7.65s/it]
 10%|▉         | 3628/37963 [8:10:43<80:58:58,  8.49s/it]
 10%|▉         | 3629/37963 [8:10:50<78:58:18,  8.28s/it]
 10%|▉         | 3630/37963 [8:10:58<77:10:59,  8.09s/it]
                                                         
{'loss': '0.1641', 'grad_norm': '2.343', 'learning_rate': '1.978e-05', 'epoch': '0.09562'}
+
 10%|▉         | 3630/37963 [8:10:58<77:10:59,  8.09s/it]
 10%|▉         | 3631/37963 [8:11:06<75:19:27,  7.90s/it]
 10%|▉         | 3632/37963 [8:11:13<73:31:11,  7.71s/it]
 10%|▉         | 3633/37963 [8:11:23<80:53:47,  8.48s/it]
 10%|▉         | 3634/37963 [8:11:31<77:48:31,  8.16s/it]
 10%|▉         | 3635/37963 [8:11:38<76:23:12,  8.01s/it]
 10%|▉         | 3636/37963 [8:11:46<75:47:40,  7.95s/it]
 10%|▉         | 3637/37963 [8:11:53<74:12:26,  7.78s/it]
 10%|▉         | 3638/37963 [8:12:01<73:15:54,  7.68s/it]
 10%|▉         | 3639/37963 [8:12:09<73:13:45,  7.68s/it]
 10%|▉         | 3640/37963 [8:12:16<71:52:27,  7.54s/it]
                                                         
{'loss': '0.1937', 'grad_norm': '1.771', 'learning_rate': '1.977e-05', 'epoch': '0.09588'}
+
 10%|▉         | 3640/37963 [8:12:16<71:52:27,  7.54s/it]
 10%|▉         | 3641/37963 [8:12:23<71:05:29,  7.46s/it]
 10%|▉         | 3642/37963 [8:12:31<71:46:44,  7.53s/it]
 10%|▉         | 3643/37963 [8:12:38<71:54:48,  7.54s/it]
 10%|▉         | 3644/37963 [8:12:46<71:47:55,  7.53s/it]
 10%|▉         | 3645/37963 [8:12:53<72:10:54,  7.57s/it]
 10%|▉         | 3646/37963 [8:13:01<71:56:31,  7.55s/it]
 10%|▉         | 3647/37963 [8:13:09<72:00:48,  7.55s/it]
 10%|▉         | 3648/37963 [8:13:16<72:21:12,  7.59s/it]
 10%|▉         | 3649/37963 [8:13:26<79:46:06,  8.37s/it]
 10%|▉         | 3650/37963 [8:13:34<77:17:31,  8.11s/it]
                                                         
{'loss': '0.1891', 'grad_norm': '4.035', 'learning_rate': '1.977e-05', 'epoch': '0.09615'}
+
 10%|▉         | 3650/37963 [8:13:34<77:17:31,  8.11s/it]
 10%|▉         | 3651/37963 [8:13:41<75:52:13,  7.96s/it]
 10%|▉         | 3652/37963 [8:13:49<74:38:02,  7.83s/it]
 10%|▉         | 3653/37963 [8:13:57<74:18:20,  7.80s/it]
 10%|▉         | 3654/37963 [8:14:04<73:50:36,  7.75s/it]
 10%|▉         | 3655/37963 [8:14:12<73:20:36,  7.70s/it]
 10%|▉         | 3656/37963 [8:14:19<72:05:19,  7.56s/it]
 10%|▉         | 3657/37963 [8:14:26<71:13:10,  7.47s/it]
 10%|▉         | 3658/37963 [8:14:37<79:33:40,  8.35s/it]
 10%|▉         | 3659/37963 [8:14:44<77:25:02,  8.12s/it]
 10%|▉         | 3660/37963 [8:14:55<83:02:02,  8.71s/it]
                                                         
{'loss': '0.1693', 'grad_norm': '2.637', 'learning_rate': '1.977e-05', 'epoch': '0.09641'}
+
 10%|▉         | 3660/37963 [8:14:55<83:02:02,  8.71s/it]
 10%|▉         | 3661/37963 [8:15:05<88:06:40,  9.25s/it]
 10%|▉         | 3662/37963 [8:15:13<83:50:21,  8.80s/it]
 10%|▉         | 3663/37963 [8:15:20<79:26:45,  8.34s/it]
 10%|▉         | 3664/37963 [8:15:28<77:02:04,  8.09s/it]
 10%|▉         | 3665/37963 [8:15:38<83:32:37,  8.77s/it]
 10%|▉         | 3666/37963 [8:15:48<87:31:44,  9.19s/it]
 10%|▉         | 3667/37963 [8:15:56<83:38:41,  8.78s/it]
 10%|▉         | 3668/37963 [8:16:03<79:49:44,  8.38s/it]
 10%|▉         | 3669/37963 [8:16:11<77:14:21,  8.11s/it]
 10%|▉         | 3670/37963 [8:16:18<75:44:39,  7.95s/it]
                                                         
{'loss': '0.1892', 'grad_norm': '9.411', 'learning_rate': '1.977e-05', 'epoch': '0.09667'}
+
 10%|▉         | 3670/37963 [8:16:18<75:44:39,  7.95s/it]
 10%|▉         | 3671/37963 [8:16:26<74:33:16,  7.83s/it]
 10%|▉         | 3672/37963 [8:16:36<81:14:50,  8.53s/it]
 10%|▉         | 3673/37963 [8:16:44<79:26:24,  8.34s/it]
 10%|▉         | 3674/37963 [8:16:52<77:54:24,  8.18s/it]
 10%|▉         | 3675/37963 [8:16:59<76:17:43,  8.01s/it]
 10%|▉         | 3676/37963 [8:17:07<74:38:35,  7.84s/it]
 10%|▉         | 3677/37963 [8:17:15<74:18:25,  7.80s/it]
 10%|▉         | 3678/37963 [8:17:22<74:13:56,  7.79s/it]
 10%|▉         | 3679/37963 [8:17:30<74:02:43,  7.78s/it]
 10%|▉         | 3680/37963 [8:17:38<73:53:06,  7.76s/it]
                                                         
{'loss': '0.2002', 'grad_norm': '6.149', 'learning_rate': '1.977e-05', 'epoch': '0.09694'}
+
 10%|▉         | 3680/37963 [8:17:38<73:53:06,  7.76s/it]
 10%|▉         | 3681/37963 [8:17:45<73:27:31,  7.71s/it]
 10%|▉         | 3682/37963 [8:17:53<72:59:55,  7.67s/it]
 10%|▉         | 3683/37963 [8:18:00<72:03:09,  7.57s/it]
 10%|▉         | 3684/37963 [8:18:08<72:28:23,  7.61s/it]
 10%|▉         | 3685/37963 [8:18:16<73:05:58,  7.68s/it]
 10%|▉         | 3686/37963 [8:18:24<73:08:16,  7.68s/it]
 10%|▉         | 3687/37963 [8:18:34<80:24:06,  8.44s/it]
 10%|▉         | 3688/37963 [8:18:41<78:05:02,  8.20s/it]
 10%|▉         | 3689/37963 [8:18:49<76:59:59,  8.09s/it]
 10%|▉         | 3690/37963 [8:18:57<75:46:46,  7.96s/it]
                                                         
{'loss': '0.1952', 'grad_norm': '5.165', 'learning_rate': '1.976e-05', 'epoch': '0.0972'}
+
 10%|▉         | 3690/37963 [8:18:57<75:46:46,  7.96s/it]
 10%|▉         | 3691/37963 [8:19:05<76:02:52,  7.99s/it]
 10%|▉         | 3692/37963 [8:19:13<75:05:49,  7.89s/it]
 10%|▉         | 3693/37963 [8:19:20<74:12:51,  7.80s/it]
 10%|▉         | 3694/37963 [8:19:28<74:08:16,  7.79s/it]
 10%|▉         | 3695/37963 [8:19:36<73:26:05,  7.71s/it]
 10%|▉         | 3696/37963 [8:19:43<72:51:27,  7.65s/it]
 10%|▉         | 3697/37963 [8:19:53<80:05:18,  8.41s/it]
 10%|▉         | 3698/37963 [8:20:01<77:50:15,  8.18s/it]
 10%|▉         | 3699/37963 [8:20:08<76:18:10,  8.02s/it]
 10%|▉         | 3700/37963 [8:20:16<75:25:28,  7.92s/it]
                                                         
{'loss': '0.1738', 'grad_norm': '3.472', 'learning_rate': '1.976e-05', 'epoch': '0.09746'}
+
 10%|▉         | 3700/37963 [8:20:16<75:25:28,  7.92s/it]
 10%|▉         | 3701/37963 [8:20:24<74:43:21,  7.85s/it]
 10%|▉         | 3702/37963 [8:20:31<73:24:25,  7.71s/it]
 10%|▉         | 3703/37963 [8:20:39<72:47:36,  7.65s/it]
 10%|▉         | 3704/37963 [8:20:46<72:41:44,  7.64s/it]
 10%|▉         | 3705/37963 [8:20:54<72:36:45,  7.63s/it]
 10%|▉         | 3706/37963 [8:21:04<80:41:08,  8.48s/it]
 10%|▉         | 3707/37963 [8:21:15<85:26:51,  8.98s/it]
 10%|▉         | 3708/37963 [8:21:22<82:16:48,  8.65s/it]
 10%|▉         | 3709/37963 [8:21:30<78:24:36,  8.24s/it]
 10%|▉         | 3710/37963 [8:21:38<77:06:31,  8.10s/it]
                                                         
{'loss': '0.1976', 'grad_norm': '3.481', 'learning_rate': '1.976e-05', 'epoch': '0.09773'}
+
 10%|▉         | 3710/37963 [8:21:38<77:06:31,  8.10s/it]
 10%|▉         | 3711/37963 [8:21:45<75:39:23,  7.95s/it]
 10%|▉         | 3712/37963 [8:21:53<74:37:06,  7.84s/it]
 10%|▉         | 3713/37963 [8:22:03<81:22:37,  8.55s/it]
 10%|▉         | 3714/37963 [8:22:11<78:40:26,  8.27s/it]
 10%|▉         | 3715/37963 [8:22:18<77:02:39,  8.10s/it]
 10%|▉         | 3716/37963 [8:22:26<75:20:43,  7.92s/it]
 10%|▉         | 3717/37963 [8:22:33<74:29:19,  7.83s/it]
 10%|▉         | 3718/37963 [8:22:46<87:33:33,  9.20s/it]
 10%|▉         | 3719/37963 [8:22:53<83:12:18,  8.75s/it]
 10%|▉         | 3720/37963 [8:23:04<87:08:19,  9.16s/it]
                                                         
{'loss': '0.1681', 'grad_norm': '1.644', 'learning_rate': '1.976e-05', 'epoch': '0.09799'}
+
 10%|▉         | 3720/37963 [8:23:04<87:08:19,  9.16s/it]
 10%|▉         | 3721/37963 [8:23:11<82:51:52,  8.71s/it]
 10%|▉         | 3722/37963 [8:23:19<80:01:04,  8.41s/it]
 10%|▉         | 3723/37963 [8:23:27<77:31:28,  8.15s/it]
 10%|▉         | 3724/37963 [8:23:34<75:56:36,  7.98s/it]
 10%|▉         | 3725/37963 [8:23:42<74:35:36,  7.84s/it]
 10%|▉         | 3726/37963 [8:23:49<73:51:45,  7.77s/it]
 10%|▉         | 3727/37963 [8:23:57<72:53:09,  7.66s/it]
 10%|▉         | 3728/37963 [8:24:04<73:21:54,  7.71s/it]
 10%|▉         | 3729/37963 [8:24:12<72:53:08,  7.66s/it]
 10%|▉         | 3730/37963 [8:24:19<71:54:12,  7.56s/it]
                                                         
{'loss': '0.1733', 'grad_norm': '3.23', 'learning_rate': '1.976e-05', 'epoch': '0.09825'}
+
 10%|▉         | 3730/37963 [8:24:19<71:54:12,  7.56s/it]
 10%|▉         | 3731/37963 [8:24:27<72:30:06,  7.62s/it]
 10%|▉         | 3732/37963 [8:24:35<72:25:34,  7.62s/it]
 10%|▉         | 3733/37963 [8:24:42<71:57:51,  7.57s/it]
 10%|▉         | 3734/37963 [8:24:50<71:47:10,  7.55s/it]
 10%|▉         | 3735/37963 [8:24:58<72:57:41,  7.67s/it]
 10%|▉         | 3736/37963 [8:25:05<72:23:14,  7.61s/it]
 10%|▉         | 3737/37963 [8:25:13<72:53:14,  7.67s/it]
 10%|▉         | 3738/37963 [8:25:21<73:17:05,  7.71s/it]
 10%|▉         | 3739/37963 [8:25:28<72:34:55,  7.63s/it]
 10%|▉         | 3740/37963 [8:25:36<72:58:53,  7.68s/it]
                                                         
{'loss': '0.1709', 'grad_norm': '2.743', 'learning_rate': '1.975e-05', 'epoch': '0.09852'}
+
 10%|▉         | 3740/37963 [8:25:36<72:58:53,  7.68s/it]
 10%|▉         | 3741/37963 [8:25:46<80:14:36,  8.44s/it]
 10%|▉         | 3742/37963 [8:25:54<78:14:24,  8.23s/it]
 10%|▉         | 3743/37963 [8:26:02<76:57:24,  8.10s/it]
 10%|▉         | 3744/37963 [8:26:09<75:51:55,  7.98s/it]
 10%|▉         | 3745/37963 [8:26:17<74:24:14,  7.83s/it]
 10%|▉         | 3746/37963 [8:26:24<72:55:14,  7.67s/it]
 10%|▉         | 3747/37963 [8:26:32<72:48:22,  7.66s/it]
 10%|▉         | 3748/37963 [8:26:39<72:42:41,  7.65s/it]
 10%|▉         | 3749/37963 [8:26:50<80:05:27,  8.43s/it]
 10%|▉         | 3750/37963 [8:26:57<77:49:51,  8.19s/it]
                                                         
{'loss': '0.1739', 'grad_norm': '2.486', 'learning_rate': '1.975e-05', 'epoch': '0.09878'}
+
 10%|▉         | 3750/37963 [8:26:57<77:49:51,  8.19s/it]
 10%|▉         | 3751/37963 [8:27:05<76:43:48,  8.07s/it]
 10%|▉         | 3752/37963 [8:27:13<75:36:04,  7.96s/it]
 10%|▉         | 3753/37963 [8:27:20<74:48:30,  7.87s/it]
 10%|▉         | 3754/37963 [8:27:31<81:02:21,  8.53s/it]
 10%|▉         | 3755/37963 [8:27:41<86:20:52,  9.09s/it]
 10%|▉         | 3756/37963 [8:27:49<82:39:11,  8.70s/it]
 10%|▉         | 3757/37963 [8:27:56<80:03:29,  8.43s/it]
 10%|▉         | 3758/37963 [8:28:04<78:04:12,  8.22s/it]
 10%|▉         | 3759/37963 [8:28:12<76:10:35,  8.02s/it]
 10%|▉         | 3760/37963 [8:28:19<74:36:40,  7.85s/it]
                                                         
{'loss': '0.1701', 'grad_norm': '1.969', 'learning_rate': '1.975e-05', 'epoch': '0.09904'}
+
 10%|▉         | 3760/37963 [8:28:19<74:36:40,  7.85s/it]
 10%|▉         | 3761/37963 [8:28:29<80:58:09,  8.52s/it]
 10%|▉         | 3762/37963 [8:28:37<78:35:03,  8.27s/it]
 10%|▉         | 3763/37963 [8:28:47<84:39:13,  8.91s/it]
 10%|▉         | 3764/37963 [8:28:55<81:09:53,  8.54s/it]
 10%|▉         | 3765/37963 [8:29:02<77:40:27,  8.18s/it]
 10%|▉         | 3766/37963 [8:29:10<76:10:52,  8.02s/it]
 10%|▉         | 3767/37963 [8:29:20<82:04:22,  8.64s/it]
 10%|▉         | 3768/37963 [8:29:28<79:44:27,  8.40s/it]
 10%|▉         | 3769/37963 [8:29:38<85:26:52,  9.00s/it]
 10%|▉         | 3770/37963 [8:29:46<82:24:49,  8.68s/it]
                                                         
{'loss': '0.1744', 'grad_norm': '2.129', 'learning_rate': '1.975e-05', 'epoch': '0.09931'}
+
 10%|▉         | 3770/37963 [8:29:46<82:24:49,  8.68s/it]
 10%|▉         | 3771/37963 [8:29:54<79:52:02,  8.41s/it]
 10%|▉         | 3772/37963 [8:30:02<77:43:18,  8.18s/it]
 10%|▉         | 3773/37963 [8:30:09<76:10:59,  8.02s/it]
 10%|▉         | 3774/37963 [8:30:17<76:12:21,  8.02s/it]
 10%|▉         | 3775/37963 [8:30:25<74:42:51,  7.87s/it]
 10%|▉         | 3776/37963 [8:30:33<74:38:52,  7.86s/it]
 10%|▉         | 3777/37963 [8:30:40<74:01:07,  7.79s/it]
 10%|▉         | 3778/37963 [8:30:48<73:43:18,  7.76s/it]
 10%|▉         | 3779/37963 [8:30:56<73:28:09,  7.74s/it]
 10%|▉         | 3780/37963 [8:31:03<73:20:08,  7.72s/it]
                                                         
{'loss': '0.1744', 'grad_norm': '2.741', 'learning_rate': '1.975e-05', 'epoch': '0.09957'}
+
 10%|▉         | 3780/37963 [8:31:03<73:20:08,  7.72s/it]
 10%|▉         | 3781/37963 [8:31:11<72:55:49,  7.68s/it]
 10%|▉         | 3782/37963 [8:31:19<72:57:04,  7.68s/it]
 10%|▉         | 3783/37963 [8:31:26<72:33:33,  7.64s/it]
 10%|▉         | 3784/37963 [8:31:34<73:12:58,  7.71s/it]
 10%|▉         | 3785/37963 [8:31:42<72:52:32,  7.68s/it]
 10%|▉         | 3786/37963 [8:31:50<73:24:23,  7.73s/it]
 10%|▉         | 3787/37963 [8:31:57<73:37:14,  7.75s/it]
 10%|▉         | 3788/37963 [8:32:05<72:57:45,  7.69s/it]
 10%|▉         | 3789/37963 [8:32:13<72:59:07,  7.69s/it]
 10%|▉         | 3790/37963 [8:32:20<73:24:32,  7.73s/it]
                                                         
{'loss': '0.1817', 'grad_norm': '3.384', 'learning_rate': '1.975e-05', 'epoch': '0.09983'}
+
 10%|▉         | 3790/37963 [8:32:20<73:24:32,  7.73s/it]
 10%|▉         | 3791/37963 [8:32:28<73:37:24,  7.76s/it]
 10%|▉         | 3792/37963 [8:32:38<79:34:32,  8.38s/it]
 10%|▉         | 3793/37963 [8:32:46<77:30:49,  8.17s/it]
 10%|▉         | 3794/37963 [8:32:53<76:01:15,  8.01s/it]
 10%|▉         | 3795/37963 [8:33:04<82:27:50,  8.69s/it]
 10%|▉         | 3796/37963 [8:33:11<79:06:30,  8.34s/it]
 10%|█         | 3797/37963 [8:33:19<76:31:40,  8.06s/it]
 10%|█         | 3798/37963 [8:33:29<82:00:02,  8.64s/it]
 10%|█         | 3799/37963 [8:33:36<79:13:46,  8.35s/it]
 10%|█         | 3800/37963 [8:33:44<77:26:11,  8.16s/it]
                                                         
{'loss': '0.1839', 'grad_norm': '3.213', 'learning_rate': '1.974e-05', 'epoch': '0.1001'}
+
 10%|█         | 3800/37963 [8:33:44<77:26:11,  8.16s/it]
 10%|█         | 3801/37963 [8:33:51<74:54:34,  7.89s/it]
 10%|█         | 3802/37963 [8:33:59<74:26:11,  7.84s/it]
 10%|█         | 3803/37963 [8:34:07<73:38:40,  7.76s/it]
 10%|█         | 3804/37963 [8:34:14<72:49:01,  7.67s/it]
 10%|█         | 3805/37963 [8:34:21<71:53:18,  7.58s/it]
 10%|█         | 3806/37963 [8:34:29<72:33:33,  7.65s/it]
 10%|█         | 3807/37963 [8:34:40<80:07:56,  8.45s/it]
 10%|█         | 3808/37963 [8:34:47<77:48:15,  8.20s/it]
 10%|█         | 3809/37963 [8:34:57<83:06:04,  8.76s/it]
 10%|█         | 3810/37963 [8:35:05<79:49:27,  8.41s/it]
                                                         
{'loss': '0.1785', 'grad_norm': '2.321', 'learning_rate': '1.974e-05', 'epoch': '0.1004'}
+
 10%|█         | 3810/37963 [8:35:05<79:49:27,  8.41s/it]
 10%|█         | 3811/37963 [8:35:12<77:14:57,  8.14s/it]
 10%|█         | 3812/37963 [8:35:20<76:05:23,  8.02s/it]
 10%|█         | 3813/37963 [8:35:28<75:08:41,  7.92s/it]
 10%|█         | 3814/37963 [8:35:35<73:50:24,  7.78s/it]
 10%|█         | 3815/37963 [8:35:43<73:45:03,  7.78s/it]
 10%|█         | 3816/37963 [8:35:51<72:56:44,  7.69s/it]
 10%|█         | 3817/37963 [8:36:00<79:16:17,  8.36s/it]
 10%|█         | 3818/37963 [8:36:10<84:09:55,  8.87s/it]
 10%|█         | 3819/37963 [8:36:18<79:45:37,  8.41s/it]
 10%|█         | 3820/37963 [8:36:26<77:47:50,  8.20s/it]
                                                         
{'loss': '0.1773', 'grad_norm': '3.824', 'learning_rate': '1.974e-05', 'epoch': '0.1006'}
+
 10%|█         | 3820/37963 [8:36:26<77:47:50,  8.20s/it]
 10%|█         | 3821/37963 [8:36:33<76:43:13,  8.09s/it]
 10%|█         | 3822/37963 [8:36:44<82:59:03,  8.75s/it]
 10%|█         | 3823/37963 [8:36:51<80:14:37,  8.46s/it]
 10%|█         | 3824/37963 [8:36:59<77:33:16,  8.18s/it]
 10%|█         | 3825/37963 [8:37:07<76:25:58,  8.06s/it]
 10%|█         | 3826/37963 [8:37:14<74:20:35,  7.84s/it]
 10%|█         | 3827/37963 [8:37:22<73:28:52,  7.75s/it]
 10%|█         | 3828/37963 [8:37:29<73:45:52,  7.78s/it]
 10%|█         | 3829/37963 [8:37:37<73:20:01,  7.73s/it]
 10%|█         | 3830/37963 [8:37:45<72:31:08,  7.65s/it]
                                                         
{'loss': '0.1857', 'grad_norm': '4.809', 'learning_rate': '1.974e-05', 'epoch': '0.1009'}
+
 10%|█         | 3830/37963 [8:37:45<72:31:08,  7.65s/it]
 10%|█         | 3831/37963 [8:37:52<71:45:26,  7.57s/it]
 10%|█         | 3832/37963 [8:38:00<72:02:06,  7.60s/it]
 10%|█         | 3833/37963 [8:38:07<71:51:21,  7.58s/it]
 10%|█         | 3834/37963 [8:38:15<71:39:11,  7.56s/it]
 10%|█         | 3835/37963 [8:38:22<71:57:19,  7.59s/it]
 10%|█         | 3836/37963 [8:38:30<71:24:07,  7.53s/it]
 10%|█         | 3837/37963 [8:38:37<71:48:22,  7.57s/it]
 10%|█         | 3838/37963 [8:38:45<72:04:31,  7.60s/it]
 10%|█         | 3839/37963 [8:38:53<71:49:20,  7.58s/it]
 10%|█         | 3840/37963 [8:39:00<71:58:04,  7.59s/it]
                                                         
{'loss': '0.1677', 'grad_norm': '3.283', 'learning_rate': '1.974e-05', 'epoch': '0.1012'}
+
 10%|█         | 3840/37963 [8:39:00<71:58:04,  7.59s/it]
 10%|█         | 3841/37963 [8:39:08<72:17:43,  7.63s/it]
 10%|█         | 3842/37963 [8:39:15<71:49:19,  7.58s/it]
 10%|█         | 3843/37963 [8:39:23<72:38:32,  7.66s/it]
 10%|█         | 3844/37963 [8:39:31<72:24:47,  7.64s/it]
 10%|█         | 3845/37963 [8:39:38<72:21:30,  7.63s/it]
 10%|█         | 3846/37963 [8:39:49<79:35:29,  8.40s/it]
 10%|█         | 3847/37963 [8:39:59<83:53:17,  8.85s/it]
 10%|█         | 3848/37963 [8:40:06<80:35:18,  8.50s/it]
 10%|█         | 3849/37963 [8:40:16<85:22:33,  9.01s/it]
 10%|█         | 3850/37963 [8:40:24<81:55:14,  8.65s/it]
                                                         
{'loss': '0.1798', 'grad_norm': '2.668', 'learning_rate': '1.973e-05', 'epoch': '0.1014'}
+
 10%|█         | 3850/37963 [8:40:24<81:55:14,  8.65s/it]
 10%|█         | 3851/37963 [8:40:32<79:23:56,  8.38s/it]
 10%|█         | 3852/37963 [8:40:40<77:07:49,  8.14s/it]
 10%|█         | 3853/37963 [8:40:50<82:43:20,  8.73s/it]
 10%|█         | 3854/37963 [8:40:57<80:07:57,  8.46s/it]
 10%|█         | 3855/37963 [8:41:05<78:17:22,  8.26s/it]
 10%|█         | 3856/37963 [8:41:13<76:46:45,  8.10s/it]
 10%|█         | 3857/37963 [8:41:23<82:48:18,  8.74s/it]
 10%|█         | 3858/37963 [8:41:31<79:32:53,  8.40s/it]
 10%|█         | 3859/37963 [8:41:39<77:29:51,  8.18s/it]
 10%|█         | 3860/37963 [8:41:46<76:14:16,  8.05s/it]
                                                         
{'loss': '0.1764', 'grad_norm': '2.3', 'learning_rate': '1.973e-05', 'epoch': '0.1017'}
+
 10%|█         | 3860/37963 [8:41:46<76:14:16,  8.05s/it]
 10%|█         | 3861/37963 [8:41:54<75:05:32,  7.93s/it]
 10%|█         | 3862/37963 [8:42:04<81:18:46,  8.58s/it]
 10%|█         | 3863/37963 [8:42:12<78:42:16,  8.31s/it]
 10%|█         | 3864/37963 [8:42:19<76:40:55,  8.10s/it]
 10%|█         | 3865/37963 [8:42:27<75:10:08,  7.94s/it]
 10%|█         | 3866/37963 [8:42:39<88:15:18,  9.32s/it]
 10%|█         | 3867/37963 [8:42:47<83:32:56,  8.82s/it]
 10%|█         | 3868/37963 [8:42:55<80:01:49,  8.45s/it]
 10%|█         | 3869/37963 [8:43:02<77:57:16,  8.23s/it]
 10%|█         | 3870/37963 [8:43:10<77:05:30,  8.14s/it]
                                                         
{'loss': '0.1899', 'grad_norm': '3.489', 'learning_rate': '1.973e-05', 'epoch': '0.1019'}
+
 10%|█         | 3870/37963 [8:43:10<77:05:30,  8.14s/it]
 10%|█         | 3871/37963 [8:43:18<76:14:12,  8.05s/it]
 10%|█         | 3872/37963 [8:43:26<74:53:14,  7.91s/it]
 10%|█         | 3873/37963 [8:43:33<74:24:49,  7.86s/it]
 10%|█         | 3874/37963 [8:43:41<73:51:34,  7.80s/it]
 10%|█         | 3875/37963 [8:43:49<74:04:13,  7.82s/it]
 10%|█         | 3876/37963 [8:43:57<73:50:38,  7.80s/it]
 10%|█         | 3877/37963 [8:44:04<73:21:30,  7.75s/it]
 10%|█         | 3878/37963 [8:44:12<73:17:32,  7.74s/it]
 10%|█         | 3879/37963 [8:44:20<72:46:10,  7.69s/it]
 10%|█         | 3880/37963 [8:44:27<72:35:03,  7.67s/it]
                                                         
{'loss': '0.1879', 'grad_norm': '2.887', 'learning_rate': '1.973e-05', 'epoch': '0.1022'}
+
 10%|█         | 3880/37963 [8:44:27<72:35:03,  7.67s/it]
 10%|█         | 3881/37963 [8:44:35<73:10:14,  7.73s/it]
 10%|█         | 3882/37963 [8:44:43<72:50:15,  7.69s/it]
 10%|█         | 3883/37963 [8:44:50<72:27:37,  7.65s/it]
 10%|█         | 3884/37963 [8:44:58<71:41:25,  7.57s/it]
 10%|█         | 3885/37963 [8:45:05<72:05:10,  7.62s/it]
 10%|█         | 3886/37963 [8:45:13<73:16:28,  7.74s/it]
 10%|█         | 3887/37963 [8:45:21<72:42:39,  7.68s/it]
 10%|█         | 3888/37963 [8:45:28<72:13:11,  7.63s/it]
 10%|█         | 3889/37963 [8:45:36<71:57:31,  7.60s/it]
 10%|█         | 3890/37963 [8:45:46<79:30:07,  8.40s/it]
                                                         
{'loss': '0.1826', 'grad_norm': '1.787', 'learning_rate': '1.973e-05', 'epoch': '0.1025'}
+
 10%|█         | 3890/37963 [8:45:46<79:30:07,  8.40s/it]
 10%|█         | 3891/37963 [8:45:54<77:19:38,  8.17s/it]
 10%|█         | 3892/37963 [8:46:02<75:51:03,  8.01s/it]
 10%|█         | 3893/37963 [8:46:12<82:09:39,  8.68s/it]
 10%|█         | 3894/37963 [8:46:20<80:00:38,  8.45s/it]
 10%|█         | 3895/37963 [8:46:27<77:31:25,  8.19s/it]
 10%|█         | 3896/37963 [8:46:37<82:28:32,  8.72s/it]
 10%|█         | 3897/37963 [8:46:45<80:12:49,  8.48s/it]
 10%|█         | 3898/37963 [8:46:55<85:28:39,  9.03s/it]
 10%|█         | 3899/37963 [8:47:03<81:27:49,  8.61s/it]
 10%|█         | 3900/37963 [8:47:11<78:18:59,  8.28s/it]
                                                         
{'loss': '0.1894', 'grad_norm': '6.162', 'learning_rate': '1.972e-05', 'epoch': '0.1027'}
+
 10%|█         | 3900/37963 [8:47:11<78:18:59,  8.28s/it]
 10%|█         | 3901/37963 [8:47:18<76:43:45,  8.11s/it]
 10%|█         | 3902/37963 [8:47:26<74:44:00,  7.90s/it]
 10%|█         | 3903/37963 [8:47:33<73:47:18,  7.80s/it]
 10%|█         | 3904/37963 [8:47:43<80:19:38,  8.49s/it]
 10%|█         | 3905/37963 [8:47:51<78:37:02,  8.31s/it]
 10%|█         | 3906/37963 [8:48:02<84:37:55,  8.95s/it]
 10%|█         | 3907/37963 [8:48:09<80:31:39,  8.51s/it]
 10%|█         | 3908/37963 [8:48:17<78:01:10,  8.25s/it]
 10%|█         | 3909/37963 [8:48:24<76:08:50,  8.05s/it]
 10%|█         | 3910/37963 [8:48:35<82:15:50,  8.70s/it]
                                                         
{'loss': '0.1873', 'grad_norm': '2.355', 'learning_rate': '1.972e-05', 'epoch': '0.103'}
+
 10%|█         | 3910/37963 [8:48:35<82:15:50,  8.70s/it]
 10%|█         | 3911/37963 [8:48:42<79:41:12,  8.42s/it]
 10%|█         | 3912/37963 [8:48:50<77:24:44,  8.18s/it]
 10%|█         | 3913/37963 [8:48:58<75:51:54,  8.02s/it]
 10%|█         | 3914/37963 [8:49:08<82:08:42,  8.69s/it]
 10%|█         | 3915/37963 [8:49:15<78:49:26,  8.33s/it]
 10%|█         | 3916/37963 [8:49:23<77:22:29,  8.18s/it]
 10%|█         | 3917/37963 [8:49:31<74:56:51,  7.92s/it]
 10%|█         | 3918/37963 [8:49:39<74:57:10,  7.93s/it]
 10%|█         | 3919/37963 [8:49:46<73:53:27,  7.81s/it]
 10%|█         | 3920/37963 [8:49:54<73:12:45,  7.74s/it]
                                                         
{'loss': '0.1853', 'grad_norm': '3.222', 'learning_rate': '1.972e-05', 'epoch': '0.1033'}
+
 10%|█         | 3920/37963 [8:49:54<73:12:45,  7.74s/it]
 10%|█         | 3921/37963 [8:50:02<73:30:46,  7.77s/it]
 10%|█         | 3922/37963 [8:50:09<71:58:24,  7.61s/it]
 10%|█         | 3923/37963 [8:50:17<72:35:09,  7.68s/it]
 10%|█         | 3924/37963 [8:50:24<72:37:22,  7.68s/it]
 10%|█         | 3925/37963 [8:50:32<71:58:35,  7.61s/it]
 10%|█         | 3926/37963 [8:50:39<71:20:21,  7.55s/it]
 10%|█         | 3927/37963 [8:50:47<71:43:47,  7.59s/it]
 10%|█         | 3928/37963 [8:50:54<71:47:30,  7.59s/it]
 10%|█         | 3929/37963 [8:51:02<71:13:18,  7.53s/it]
 10%|█         | 3930/37963 [8:51:10<71:46:09,  7.59s/it]
                                                         
{'loss': '0.178', 'grad_norm': '2.043', 'learning_rate': '1.972e-05', 'epoch': '0.1035'}
+
 10%|█         | 3930/37963 [8:51:10<71:46:09,  7.59s/it]
 10%|█         | 3931/37963 [8:51:17<71:51:58,  7.60s/it]
 10%|█         | 3932/37963 [8:51:25<71:40:47,  7.58s/it]
 10%|█         | 3933/37963 [8:51:32<71:22:02,  7.55s/it]
 10%|█         | 3934/37963 [8:51:40<71:12:41,  7.53s/it]
 10%|█         | 3935/37963 [8:51:47<71:26:06,  7.56s/it]
 10%|█         | 3936/37963 [8:51:55<71:54:27,  7.61s/it]
 10%|█         | 3937/37963 [8:52:03<72:37:47,  7.68s/it]
 10%|█         | 3938/37963 [8:52:13<79:45:52,  8.44s/it]
 10%|█         | 3939/37963 [8:52:21<77:05:21,  8.16s/it]
 10%|█         | 3940/37963 [8:52:28<74:15:32,  7.86s/it]
                                                         
{'loss': '0.1757', 'grad_norm': '2.049', 'learning_rate': '1.972e-05', 'epoch': '0.1038'}
+
 10%|█         | 3940/37963 [8:52:28<74:15:32,  7.86s/it]
 10%|█         | 3941/37963 [8:52:38<81:18:05,  8.60s/it]
 10%|█         | 3942/37963 [8:52:48<85:50:26,  9.08s/it]
 10%|█         | 3943/37963 [8:52:56<81:58:27,  8.67s/it]
 10%|█         | 3944/37963 [8:53:04<79:24:16,  8.40s/it]
 10%|█         | 3945/37963 [8:53:14<83:35:43,  8.85s/it]
 10%|█         | 3946/37963 [8:53:21<80:07:11,  8.48s/it]
 10%|█         | 3947/37963 [8:53:29<77:51:05,  8.24s/it]
 10%|█         | 3948/37963 [8:53:37<76:00:28,  8.04s/it]
 10%|█         | 3949/37963 [8:53:46<80:38:52,  8.54s/it]
 10%|█         | 3950/37963 [8:53:54<78:03:10,  8.26s/it]
                                                         
{'loss': '0.2018', 'grad_norm': '2.355', 'learning_rate': '1.971e-05', 'epoch': '0.104'}
+
 10%|█         | 3950/37963 [8:53:54<78:03:10,  8.26s/it]
 10%|█         | 3951/37963 [8:54:02<76:44:59,  8.12s/it]
 10%|█         | 3952/37963 [8:54:09<75:33:41,  8.00s/it]
 10%|█         | 3953/37963 [8:54:19<81:33:11,  8.63s/it]
 10%|█         | 3954/37963 [8:54:27<78:51:23,  8.35s/it]
 10%|█         | 3955/37963 [8:54:35<76:30:07,  8.10s/it]
 10%|█         | 3956/37963 [8:54:42<75:25:00,  7.98s/it]
 10%|█         | 3957/37963 [8:54:50<74:48:37,  7.92s/it]
 10%|█         | 3958/37963 [8:54:58<73:55:46,  7.83s/it]
 10%|█         | 3959/37963 [8:55:08<80:55:06,  8.57s/it]
 10%|█         | 3960/37963 [8:55:15<77:44:51,  8.23s/it]
                                                         
{'loss': '0.1915', 'grad_norm': '2.21', 'learning_rate': '1.971e-05', 'epoch': '0.1043'}
+
 10%|█         | 3960/37963 [8:55:15<77:44:51,  8.23s/it]
 10%|█         | 3961/37963 [8:55:23<76:50:20,  8.14s/it]
 10%|█         | 3962/37963 [8:55:34<83:00:02,  8.79s/it]
 10%|█         | 3963/37963 [8:55:41<80:05:24,  8.48s/it]
 10%|█         | 3964/37963 [8:55:49<77:57:03,  8.25s/it]
 10%|█         | 3965/37963 [8:55:57<75:57:40,  8.04s/it]
 10%|█         | 3966/37963 [8:56:05<75:24:35,  7.99s/it]
 10%|█         | 3967/37963 [8:56:12<74:02:44,  7.84s/it]
 10%|█         | 3968/37963 [8:56:20<73:43:46,  7.81s/it]
 10%|█         | 3969/37963 [8:56:27<73:15:14,  7.76s/it]
 10%|█         | 3970/37963 [8:56:35<73:01:40,  7.73s/it]
                                                         
{'loss': '0.188', 'grad_norm': '5.259', 'learning_rate': '1.971e-05', 'epoch': '0.1046'}
+
 10%|█         | 3970/37963 [8:56:35<73:01:40,  7.73s/it]
 10%|█         | 3971/37963 [8:56:43<72:49:23,  7.71s/it]
 10%|█         | 3972/37963 [8:56:50<72:16:28,  7.65s/it]
 10%|█         | 3973/37963 [8:56:58<72:07:05,  7.64s/it]
 10%|█         | 3974/37963 [8:57:06<72:40:03,  7.70s/it]
 10%|█         | 3975/37963 [8:57:13<72:04:24,  7.63s/it]
 10%|█         | 3976/37963 [8:57:21<72:26:55,  7.67s/it]
 10%|█         | 3977/37963 [8:57:29<72:47:13,  7.71s/it]
 10%|█         | 3978/37963 [8:57:37<73:11:20,  7.75s/it]
 10%|█         | 3979/37963 [8:57:44<72:32:25,  7.68s/it]
 10%|█         | 3980/37963 [8:57:51<71:27:48,  7.57s/it]
                                                         
{'loss': '0.1817', 'grad_norm': '2.522', 'learning_rate': '1.971e-05', 'epoch': '0.1048'}
+
 10%|█         | 3980/37963 [8:57:51<71:27:48,  7.57s/it]
 10%|█         | 3981/37963 [8:57:59<71:57:55,  7.62s/it]
 10%|█         | 3982/37963 [8:58:07<72:28:49,  7.68s/it]
 10%|█         | 3983/37963 [8:58:15<71:52:53,  7.62s/it]
 10%|█         | 3984/37963 [8:58:24<78:31:39,  8.32s/it]
 10%|█         | 3985/37963 [8:58:32<76:23:41,  8.09s/it]
 10%|█         | 3986/37963 [8:58:40<74:35:27,  7.90s/it]
 11%|█         | 3987/37963 [8:58:47<72:31:22,  7.68s/it]
 11%|█         | 3988/37963 [8:58:54<72:06:21,  7.64s/it]
 11%|█         | 3989/37963 [8:59:02<71:36:05,  7.59s/it]
 11%|█         | 3990/37963 [8:59:14<86:04:02,  9.12s/it]
                                                         
{'loss': '0.1847', 'grad_norm': '3.155', 'learning_rate': '1.971e-05', 'epoch': '0.1051'}
+
 11%|█         | 3990/37963 [8:59:14<86:04:02,  9.12s/it]
 11%|█         | 3991/37963 [8:59:22<81:21:42,  8.62s/it]
 11%|█         | 3992/37963 [8:59:32<86:07:49,  9.13s/it]
 11%|█         | 3993/37963 [8:59:42<88:49:31,  9.41s/it]
 11%|█         | 3994/37963 [8:59:50<83:42:51,  8.87s/it]
 11%|█         | 3995/37963 [8:59:57<79:46:28,  8.45s/it]
 11%|█         | 3996/37963 [9:00:08<84:43:55,  8.98s/it]
 11%|█         | 3997/37963 [9:00:15<81:04:21,  8.59s/it]
 11%|█         | 3998/37963 [9:00:23<78:10:44,  8.29s/it]
 11%|█         | 3999/37963 [9:00:31<77:01:10,  8.16s/it]
 11%|█         | 4000/37963 [9:00:38<75:13:35,  7.97s/it]
                                                         
{'loss': '0.1702', 'grad_norm': '3.542', 'learning_rate': '1.97e-05', 'epoch': '0.1054'}
+
 11%|█         | 4000/37963 [9:00:38<75:13:35,  7.97s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.62s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.62s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 11%|█         | 4001/37963 [9:01:41<230:35:37, 24.44s/it]
 11%|█         | 4002/37963 [9:01:49<182:52:57, 19.39s/it]
 11%|█         | 4003/37963 [9:01:59<156:42:18, 16.61s/it]
 11%|█         | 4004/37963 [9:02:06<131:20:13, 13.92s/it]
 11%|█         | 4005/37963 [9:02:14<113:27:13, 12.03s/it]
 11%|█         | 4006/37963 [9:02:22<101:00:56, 10.71s/it]
 11%|█         | 4007/37963 [9:02:29<92:33:57,  9.81s/it] 
 11%|█         | 4008/37963 [9:02:37<86:06:32,  9.13s/it]
 11%|█         | 4009/37963 [9:02:45<81:57:41,  8.69s/it]
 11%|█         | 4010/37963 [9:02:55<86:24:29,  9.16s/it]
                                                         
{'loss': '0.1934', 'grad_norm': '2.482', 'learning_rate': '1.97e-05', 'epoch': '0.1056'}
+
 11%|█         | 4010/37963 [9:02:55<86:24:29,  9.16s/it]
 11%|█         | 4011/37963 [9:03:03<82:29:48,  8.75s/it]
 11%|█         | 4012/37963 [9:03:10<79:38:46,  8.45s/it]
 11%|█         | 4013/37963 [9:03:18<77:21:58,  8.20s/it]
 11%|█         | 4014/37963 [9:03:25<75:18:35,  7.99s/it]
 11%|█         | 4015/37963 [9:03:33<74:13:42,  7.87s/it]
 11%|█         | 4016/37963 [9:03:41<73:14:53,  7.77s/it]
 11%|█         | 4017/37963 [9:03:48<72:52:10,  7.73s/it]
 11%|█         | 4018/37963 [9:03:56<72:32:39,  7.69s/it]
 11%|█         | 4019/37963 [9:04:04<72:26:13,  7.68s/it]
 11%|█         | 4020/37963 [9:04:11<72:59:24,  7.74s/it]
                                                         
{'loss': '0.1764', 'grad_norm': '4.966', 'learning_rate': '1.97e-05', 'epoch': '0.1059'}
+
 11%|█         | 4020/37963 [9:04:11<72:59:24,  7.74s/it]
 11%|█         | 4021/37963 [9:04:19<72:34:01,  7.70s/it]
 11%|█         | 4022/37963 [9:04:27<72:56:28,  7.74s/it]
 11%|█         | 4023/37963 [9:04:34<72:37:58,  7.70s/it]
 11%|█         | 4024/37963 [9:04:42<72:19:05,  7.67s/it]
 11%|█         | 4025/37963 [9:04:50<71:52:06,  7.62s/it]
 11%|█         | 4026/37963 [9:04:57<70:56:43,  7.53s/it]
 11%|█         | 4027/37963 [9:05:05<72:34:20,  7.70s/it]
 11%|█         | 4028/37963 [9:05:13<73:13:54,  7.77s/it]
 11%|█         | 4029/37963 [9:05:20<72:00:33,  7.64s/it]
 11%|█         | 4030/37963 [9:05:28<72:05:28,  7.65s/it]
                                                         
{'loss': '0.1869', 'grad_norm': '1.673', 'learning_rate': '1.97e-05', 'epoch': '0.1062'}
+
 11%|█         | 4030/37963 [9:05:28<72:05:28,  7.65s/it]
 11%|█         | 4031/37963 [9:05:36<72:49:39,  7.73s/it]
 11%|█         | 4032/37963 [9:05:44<72:59:11,  7.74s/it]
 11%|█         | 4033/37963 [9:05:51<73:14:06,  7.77s/it]
 11%|█         | 4034/37963 [9:05:59<73:01:28,  7.75s/it]
 11%|█         | 4035/37963 [9:06:09<80:20:49,  8.53s/it]
 11%|█         | 4036/37963 [9:06:17<77:58:38,  8.27s/it]
 11%|█         | 4037/37963 [9:06:25<75:51:58,  8.05s/it]
 11%|█         | 4038/37963 [9:06:36<84:53:50,  9.01s/it]
 11%|█         | 4039/37963 [9:06:44<81:30:22,  8.65s/it]
 11%|█         | 4040/37963 [9:06:51<78:44:50,  8.36s/it]
                                                         
{'loss': '0.1921', 'grad_norm': '1.251', 'learning_rate': '1.97e-05', 'epoch': '0.1064'}
+
 11%|█         | 4040/37963 [9:06:51<78:44:50,  8.36s/it]
 11%|█         | 4041/37963 [9:07:04<91:29:41,  9.71s/it]
 11%|█         | 4042/37963 [9:07:12<86:22:04,  9.17s/it]
 11%|█         | 4043/37963 [9:07:20<83:25:39,  8.85s/it]
 11%|█         | 4044/37963 [9:07:34<95:42:09, 10.16s/it]
 11%|█         | 4045/37963 [9:07:41<87:57:57,  9.34s/it]
 11%|█         | 4046/37963 [9:07:49<83:59:01,  8.91s/it]
 11%|█         | 4047/37963 [9:07:59<88:27:30,  9.39s/it]
 11%|█         | 4048/37963 [9:08:07<83:18:26,  8.84s/it]
 11%|█         | 4049/37963 [9:08:15<80:06:22,  8.50s/it]
 11%|█         | 4050/37963 [9:08:22<78:06:37,  8.29s/it]
                                                         
{'loss': '0.1583', 'grad_norm': '3.694', 'learning_rate': '1.969e-05', 'epoch': '0.1067'}
+
 11%|█         | 4050/37963 [9:08:22<78:06:37,  8.29s/it]
 11%|█         | 4051/37963 [9:08:30<76:24:24,  8.11s/it]
 11%|█         | 4052/37963 [9:08:38<75:07:03,  7.97s/it]
 11%|█         | 4053/37963 [9:08:45<73:47:10,  7.83s/it]
 11%|█         | 4054/37963 [9:08:56<80:46:27,  8.58s/it]
 11%|█         | 4055/37963 [9:09:03<77:54:16,  8.27s/it]
 11%|█         | 4056/37963 [9:09:11<76:23:42,  8.11s/it]
 11%|█         | 4057/37963 [9:09:19<75:07:35,  7.98s/it]
 11%|█         | 4058/37963 [9:09:26<73:37:45,  7.82s/it]
 11%|█         | 4059/37963 [9:09:34<73:30:40,  7.81s/it]
 11%|█         | 4060/37963 [9:09:42<73:27:48,  7.80s/it]
                                                         
{'loss': '0.1939', 'grad_norm': '3.744', 'learning_rate': '1.969e-05', 'epoch': '0.1069'}
+
 11%|█         | 4060/37963 [9:09:42<73:27:48,  7.80s/it]
 11%|█         | 4061/37963 [9:09:49<72:13:47,  7.67s/it]
 11%|█         | 4062/37963 [9:09:57<72:39:28,  7.72s/it]
 11%|█         | 4063/37963 [9:10:04<72:06:01,  7.66s/it]
 11%|█         | 4064/37963 [9:10:12<71:36:36,  7.60s/it]
 11%|█         | 4065/37963 [9:10:20<72:02:06,  7.65s/it]
 11%|█         | 4066/37963 [9:10:27<70:18:01,  7.47s/it]
 11%|█         | 4067/37963 [9:10:34<70:56:37,  7.53s/it]
 11%|█         | 4068/37963 [9:10:42<71:43:42,  7.62s/it]
 11%|█         | 4069/37963 [9:10:50<71:25:38,  7.59s/it]
 11%|█         | 4070/37963 [9:10:57<71:45:14,  7.62s/it]
                                                         
{'loss': '0.1851', 'grad_norm': '3.276', 'learning_rate': '1.969e-05', 'epoch': '0.1072'}
+
 11%|█         | 4070/37963 [9:10:57<71:45:14,  7.62s/it]
 11%|█         | 4071/37963 [9:11:05<70:45:23,  7.52s/it]
 11%|█         | 4072/37963 [9:11:12<71:09:06,  7.56s/it]
 11%|█         | 4073/37963 [9:11:20<71:06:12,  7.55s/it]
 11%|█         | 4074/37963 [9:11:27<71:11:03,  7.56s/it]
 11%|█         | 4075/37963 [9:11:35<71:31:55,  7.60s/it]
 11%|█         | 4076/37963 [9:11:43<71:28:17,  7.59s/it]
 11%|█         | 4077/37963 [9:11:50<71:38:48,  7.61s/it]
 11%|█         | 4078/37963 [9:11:58<71:36:13,  7.61s/it]
 11%|█         | 4079/37963 [9:12:05<71:45:56,  7.62s/it]
 11%|█         | 4080/37963 [9:12:13<71:06:39,  7.56s/it]
                                                         
{'loss': '0.1758', 'grad_norm': '2.78', 'learning_rate': '1.969e-05', 'epoch': '0.1075'}
+
 11%|█         | 4080/37963 [9:12:13<71:06:39,  7.56s/it]
 11%|█         | 4081/37963 [9:12:20<70:11:04,  7.46s/it]
 11%|█         | 4082/37963 [9:12:28<70:23:52,  7.48s/it]
 11%|█         | 4083/37963 [9:12:35<71:03:17,  7.55s/it]
 11%|█         | 4084/37963 [9:12:43<71:42:08,  7.62s/it]
 11%|█         | 4085/37963 [9:12:51<71:52:58,  7.64s/it]
 11%|█         | 4086/37963 [9:13:02<81:37:04,  8.67s/it]
 11%|█         | 4087/37963 [9:13:10<79:32:31,  8.45s/it]
 11%|█         | 4088/37963 [9:13:17<76:58:43,  8.18s/it]
 11%|█         | 4089/37963 [9:13:28<83:15:52,  8.85s/it]
 11%|█         | 4090/37963 [9:13:38<86:49:47,  9.23s/it]
                                                         
{'loss': '0.169', 'grad_norm': '1.608', 'learning_rate': '1.968e-05', 'epoch': '0.1077'}
+
 11%|█         | 4090/37963 [9:13:38<86:49:47,  9.23s/it]
 11%|█         | 4091/37963 [9:13:46<83:11:46,  8.84s/it]
 11%|█         | 4092/37963 [9:13:54<79:50:12,  8.49s/it]
 11%|█         | 4093/37963 [9:14:01<76:58:47,  8.18s/it]
 11%|█         | 4094/37963 [9:14:09<76:38:46,  8.15s/it]
 11%|█         | 4095/37963 [9:14:22<89:44:47,  9.54s/it]
 11%|█         | 4096/37963 [9:14:29<84:19:29,  8.96s/it]
 11%|█         | 4097/37963 [9:14:40<88:05:43,  9.36s/it]
 11%|█         | 4098/37963 [9:14:53<97:48:14, 10.40s/it]
 11%|█         | 4099/37963 [9:15:00<89:56:53,  9.56s/it]
 11%|█         | 4100/37963 [9:15:08<84:08:06,  8.94s/it]
                                                         
{'loss': '0.2037', 'grad_norm': '3.754', 'learning_rate': '1.968e-05', 'epoch': '0.108'}
+
 11%|█         | 4100/37963 [9:15:08<84:08:06,  8.94s/it]
 11%|█         | 4101/37963 [9:15:15<80:13:44,  8.53s/it]
 11%|█         | 4102/37963 [9:15:23<77:15:22,  8.21s/it]
 11%|█         | 4103/37963 [9:15:30<75:24:13,  8.02s/it]
 11%|█         | 4104/37963 [9:15:38<74:51:20,  7.96s/it]
 11%|█         | 4105/37963 [9:15:46<73:25:13,  7.81s/it]
 11%|█         | 4106/37963 [9:15:53<73:28:43,  7.81s/it]
 11%|█         | 4107/37963 [9:16:01<72:44:57,  7.74s/it]
 11%|█         | 4108/37963 [9:16:09<72:21:13,  7.69s/it]
 11%|█         | 4109/37963 [9:16:16<72:46:37,  7.74s/it]
 11%|█         | 4110/37963 [9:16:24<72:32:25,  7.71s/it]
                                                         
{'loss': '0.1627', 'grad_norm': '5.63', 'learning_rate': '1.968e-05', 'epoch': '0.1083'}
+
 11%|█         | 4110/37963 [9:16:24<72:32:25,  7.71s/it]
 11%|█         | 4111/37963 [9:16:32<72:08:05,  7.67s/it]
 11%|█         | 4112/37963 [9:16:39<72:01:13,  7.66s/it]
 11%|█         | 4113/37963 [9:16:47<72:26:39,  7.70s/it]
 11%|█         | 4114/37963 [9:16:55<73:05:16,  7.77s/it]
 11%|█         | 4115/37963 [9:17:03<73:16:21,  7.79s/it]
 11%|█         | 4116/37963 [9:17:11<73:12:20,  7.79s/it]
 11%|█         | 4117/37963 [9:17:18<72:38:57,  7.73s/it]
 11%|█         | 4118/37963 [9:17:26<71:43:20,  7.63s/it]
 11%|█         | 4119/37963 [9:17:33<71:39:05,  7.62s/it]
 11%|█         | 4120/37963 [9:17:41<72:37:42,  7.73s/it]
                                                         
{'loss': '0.1766', 'grad_norm': '1.282', 'learning_rate': '1.968e-05', 'epoch': '0.1085'}
+
 11%|█         | 4120/37963 [9:17:41<72:37:42,  7.73s/it]
 11%|█         | 4121/37963 [9:17:48<71:30:28,  7.61s/it]
 11%|█         | 4122/37963 [9:17:56<71:10:33,  7.57s/it]
 11%|█         | 4123/37963 [9:18:04<71:37:12,  7.62s/it]
 11%|█         | 4124/37963 [9:18:11<71:27:06,  7.60s/it]
 11%|█         | 4125/37963 [9:18:19<71:23:18,  7.59s/it]
 11%|█         | 4126/37963 [9:18:26<71:15:52,  7.58s/it]
 11%|█         | 4127/37963 [9:18:34<70:34:02,  7.51s/it]
 11%|█         | 4128/37963 [9:18:41<70:48:19,  7.53s/it]
 11%|█         | 4129/37963 [9:18:49<71:14:26,  7.58s/it]
 11%|█         | 4130/37963 [9:18:57<71:59:19,  7.66s/it]
                                                         
{'loss': '0.1749', 'grad_norm': '5.423', 'learning_rate': '1.968e-05', 'epoch': '0.1088'}
+
 11%|█         | 4130/37963 [9:18:57<71:59:19,  7.66s/it]
 11%|█         | 4131/37963 [9:19:05<72:04:47,  7.67s/it]
 11%|█         | 4132/37963 [9:19:12<71:50:51,  7.65s/it]
 11%|█         | 4133/37963 [9:19:20<71:31:01,  7.61s/it]
 11%|█         | 4134/37963 [9:19:30<79:12:17,  8.43s/it]
 11%|█         | 4135/37963 [9:19:38<77:44:38,  8.27s/it]
 11%|█         | 4136/37963 [9:19:46<75:54:29,  8.08s/it]
 11%|█         | 4137/37963 [9:19:53<75:19:14,  8.02s/it]
 11%|█         | 4138/37963 [9:20:01<74:25:38,  7.92s/it]
 11%|█         | 4139/37963 [9:20:11<80:43:55,  8.59s/it]
 11%|█         | 4140/37963 [9:20:19<78:21:05,  8.34s/it]
                                                         
{'loss': '0.1826', 'grad_norm': '6.129', 'learning_rate': '1.967e-05', 'epoch': '0.1091'}
+
 11%|█         | 4140/37963 [9:20:19<78:21:05,  8.34s/it]
 11%|█         | 4141/37963 [9:20:27<76:36:03,  8.15s/it]
 11%|█         | 4142/37963 [9:20:37<82:14:29,  8.75s/it]
 11%|█         | 4143/37963 [9:20:47<86:38:01,  9.22s/it]
 11%|█         | 4144/37963 [9:20:55<82:16:43,  8.76s/it]
 11%|█         | 4145/37963 [9:21:03<79:40:21,  8.48s/it]
 11%|█         | 4146/37963 [9:21:10<76:46:13,  8.17s/it]
 11%|█         | 4147/37963 [9:21:18<74:34:03,  7.94s/it]
 11%|█         | 4148/37963 [9:21:25<74:03:45,  7.88s/it]
 11%|█         | 4149/37963 [9:21:35<79:36:58,  8.48s/it]
 11%|█         | 4150/37963 [9:21:43<77:12:33,  8.22s/it]
                                                         
{'loss': '0.1812', 'grad_norm': '2.01', 'learning_rate': '1.967e-05', 'epoch': '0.1093'}
+
 11%|█         | 4150/37963 [9:21:43<77:12:33,  8.22s/it]
 11%|█         | 4151/37963 [9:21:53<82:37:43,  8.80s/it]
 11%|█         | 4152/37963 [9:22:01<79:24:10,  8.45s/it]
 11%|█         | 4153/37963 [9:22:09<78:03:39,  8.31s/it]
 11%|█         | 4154/37963 [9:22:16<76:29:44,  8.15s/it]
 11%|█         | 4155/37963 [9:22:24<74:50:13,  7.97s/it]
 11%|█         | 4156/37963 [9:22:31<73:42:16,  7.85s/it]
 11%|█         | 4157/37963 [9:22:39<73:06:05,  7.78s/it]
 11%|█         | 4158/37963 [9:22:47<72:30:44,  7.72s/it]
 11%|█         | 4159/37963 [9:22:55<72:52:04,  7.76s/it]
 11%|█         | 4160/37963 [9:23:02<73:14:10,  7.80s/it]
                                                         
{'loss': '0.1851', 'grad_norm': '5.627', 'learning_rate': '1.967e-05', 'epoch': '0.1096'}
+
 11%|█         | 4160/37963 [9:23:02<73:14:10,  7.80s/it]
 11%|█         | 4161/37963 [9:23:10<72:43:43,  7.75s/it]
 11%|█         | 4162/37963 [9:23:18<72:53:15,  7.76s/it]
 11%|█         | 4163/37963 [9:23:25<71:11:27,  7.58s/it]
 11%|█         | 4164/37963 [9:23:33<72:06:17,  7.68s/it]
 11%|█         | 4165/37963 [9:23:40<71:47:16,  7.65s/it]
 11%|█         | 4166/37963 [9:23:48<71:23:33,  7.60s/it]
 11%|█         | 4167/37963 [9:23:56<71:18:59,  7.60s/it]
 11%|█         | 4168/37963 [9:24:03<70:59:11,  7.56s/it]
 11%|█         | 4169/37963 [9:24:11<72:02:15,  7.67s/it]
 11%|█         | 4170/37963 [9:24:19<71:48:09,  7.65s/it]
                                                         
{'loss': '0.1814', 'grad_norm': '1.693', 'learning_rate': '1.967e-05', 'epoch': '0.1098'}
+
 11%|█         | 4170/37963 [9:24:19<71:48:09,  7.65s/it]
 11%|█         | 4171/37963 [9:24:26<71:18:27,  7.60s/it]
 11%|█         | 4172/37963 [9:24:34<71:07:23,  7.58s/it]
 11%|█         | 4173/37963 [9:24:41<71:55:41,  7.66s/it]
 11%|█         | 4174/37963 [9:24:49<71:41:26,  7.64s/it]
 11%|█         | 4175/37963 [9:24:57<71:15:04,  7.59s/it]
 11%|█         | 4176/37963 [9:25:04<71:31:53,  7.62s/it]
 11%|█         | 4177/37963 [9:25:12<71:11:51,  7.59s/it]
 11%|█         | 4178/37963 [9:25:20<72:11:36,  7.69s/it]
 11%|█         | 4179/37963 [9:25:27<72:13:37,  7.70s/it]
 11%|█         | 4180/37963 [9:25:35<72:21:15,  7.71s/it]
                                                         
{'loss': '0.1698', 'grad_norm': '2.927', 'learning_rate': '1.967e-05', 'epoch': '0.1101'}
+
 11%|█         | 4180/37963 [9:25:35<72:21:15,  7.71s/it]
 11%|█         | 4181/37963 [9:25:43<72:00:52,  7.67s/it]
 11%|█         | 4182/37963 [9:25:53<78:29:47,  8.37s/it]
 11%|█         | 4183/37963 [9:26:00<76:35:32,  8.16s/it]
 11%|█         | 4184/37963 [9:26:11<82:29:27,  8.79s/it]
 11%|█         | 4185/37963 [9:26:21<86:25:39,  9.21s/it]
 11%|█         | 4186/37963 [9:26:29<82:21:38,  8.78s/it]
 11%|█         | 4187/37963 [9:26:36<78:53:51,  8.41s/it]
 11%|█         | 4188/37963 [9:26:44<76:42:23,  8.18s/it]
 11%|█         | 4189/37963 [9:26:51<74:56:01,  7.99s/it]
 11%|█         | 4190/37963 [9:27:02<81:50:52,  8.72s/it]
                                                         
{'loss': '0.1767', 'grad_norm': '1.433', 'learning_rate': '1.966e-05', 'epoch': '0.1104'}
+
 11%|█         | 4190/37963 [9:27:02<81:50:52,  8.72s/it]
 11%|█         | 4191/37963 [9:27:12<85:57:30,  9.16s/it]
 11%|█         | 4192/37963 [9:27:19<81:18:18,  8.67s/it]
 11%|█         | 4193/37963 [9:27:27<78:22:27,  8.35s/it]
 11%|█         | 4194/37963 [9:27:35<76:51:51,  8.19s/it]
 11%|█         | 4195/37963 [9:27:43<75:22:25,  8.04s/it]
 11%|█         | 4196/37963 [9:27:50<74:05:32,  7.90s/it]
 11%|█         | 4197/37963 [9:28:00<80:45:29,  8.61s/it]
 11%|█         | 4198/37963 [9:28:08<77:49:00,  8.30s/it]
 11%|█         | 4199/37963 [9:28:16<76:22:34,  8.14s/it]
 11%|█         | 4200/37963 [9:28:26<81:33:49,  8.70s/it]
                                                         
{'loss': '0.1839', 'grad_norm': '1.841', 'learning_rate': '1.966e-05', 'epoch': '0.1106'}
+
 11%|█         | 4200/37963 [9:28:26<81:33:49,  8.70s/it]
 11%|█         | 4201/37963 [9:28:33<78:17:38,  8.35s/it]
 11%|█         | 4202/37963 [9:28:41<76:28:57,  8.16s/it]
 11%|█         | 4203/37963 [9:28:51<82:12:43,  8.77s/it]
 11%|█         | 4204/37963 [9:28:59<79:08:42,  8.44s/it]
 11%|█         | 4205/37963 [9:29:06<76:51:25,  8.20s/it]
 11%|█         | 4206/37963 [9:29:14<75:19:38,  8.03s/it]
 11%|█         | 4207/37963 [9:29:22<74:22:58,  7.93s/it]
 11%|█         | 4208/37963 [9:29:30<74:07:40,  7.91s/it]
 11%|█         | 4209/37963 [9:29:37<73:11:40,  7.81s/it]
 11%|█         | 4210/37963 [9:29:45<72:52:58,  7.77s/it]
                                                         
{'loss': '0.1729', 'grad_norm': '2.194', 'learning_rate': '1.966e-05', 'epoch': '0.1109'}
+
 11%|█         | 4210/37963 [9:29:45<72:52:58,  7.77s/it]
 11%|█         | 4211/37963 [9:29:52<71:37:04,  7.64s/it]
 11%|█         | 4212/37963 [9:30:00<71:56:05,  7.67s/it]
 11%|█         | 4213/37963 [9:30:08<72:46:32,  7.76s/it]
 11%|█         | 4214/37963 [9:30:16<72:50:40,  7.77s/it]
 11%|█         | 4215/37963 [9:30:23<71:40:30,  7.65s/it]
 11%|█         | 4216/37963 [9:30:31<72:00:29,  7.68s/it]
 11%|█         | 4217/37963 [9:30:38<71:42:27,  7.65s/it]
 11%|█         | 4218/37963 [9:30:46<71:14:40,  7.60s/it]
 11%|█         | 4219/37963 [9:30:53<71:02:00,  7.58s/it]
 11%|█         | 4220/37963 [9:31:01<71:56:29,  7.68s/it]
                                                         
{'loss': '0.1601', 'grad_norm': '2.056', 'learning_rate': '1.966e-05', 'epoch': '0.1112'}
+
 11%|█         | 4220/37963 [9:31:01<71:56:29,  7.68s/it]
 11%|█         | 4221/37963 [9:31:09<71:08:45,  7.59s/it]
 11%|█         | 4222/37963 [9:31:16<71:28:13,  7.63s/it]
 11%|█         | 4223/37963 [9:31:24<71:19:14,  7.61s/it]
 11%|█         | 4224/37963 [9:31:32<72:22:32,  7.72s/it]
 11%|█         | 4225/37963 [9:31:40<71:58:58,  7.68s/it]
 11%|█         | 4226/37963 [9:31:47<71:24:00,  7.62s/it]
 11%|█         | 4227/37963 [9:31:55<71:01:29,  7.58s/it]
 11%|█         | 4228/37963 [9:32:02<71:36:50,  7.64s/it]
 11%|█         | 4229/37963 [9:32:13<79:14:11,  8.46s/it]
 11%|█         | 4230/37963 [9:32:23<84:31:30,  9.02s/it]
                                                         
{'loss': '0.1831', 'grad_norm': '3.557', 'learning_rate': '1.965e-05', 'epoch': '0.1114'}
+
 11%|█         | 4230/37963 [9:32:23<84:31:30,  9.02s/it]
 11%|█         | 4231/37963 [9:32:31<81:02:26,  8.65s/it]
 11%|█         | 4232/37963 [9:32:38<78:03:02,  8.33s/it]
 11%|█         | 4233/37963 [9:32:46<75:08:48,  8.02s/it]
 11%|█         | 4234/37963 [9:32:53<73:38:03,  7.86s/it]
 11%|█         | 4235/37963 [9:33:01<72:53:03,  7.78s/it]
 11%|█         | 4236/37963 [9:33:08<72:14:39,  7.71s/it]
 11%|█         | 4237/37963 [9:33:16<72:15:42,  7.71s/it]
 11%|█         | 4238/37963 [9:33:29<86:30:11,  9.23s/it]
 11%|█         | 4239/37963 [9:33:36<81:54:12,  8.74s/it]
 11%|█         | 4240/37963 [9:33:44<77:16:44,  8.25s/it]
                                                         
{'loss': '0.1887', 'grad_norm': '4.347', 'learning_rate': '1.965e-05', 'epoch': '0.1117'}
+
 11%|█         | 4240/37963 [9:33:44<77:16:44,  8.25s/it]
 11%|█         | 4241/37963 [9:33:52<76:35:37,  8.18s/it]
 11%|█         | 4242/37963 [9:34:02<82:09:46,  8.77s/it]
 11%|█         | 4243/37963 [9:34:09<78:57:16,  8.43s/it]
 11%|█         | 4244/37963 [9:34:17<76:30:06,  8.17s/it]
 11%|█         | 4245/37963 [9:34:27<82:11:20,  8.78s/it]
 11%|█         | 4246/37963 [9:34:35<79:45:47,  8.52s/it]
 11%|█         | 4247/37963 [9:34:43<77:19:15,  8.26s/it]
 11%|█         | 4248/37963 [9:34:53<82:30:22,  8.81s/it]
 11%|█         | 4249/37963 [9:35:01<79:59:46,  8.54s/it]
 11%|█         | 4250/37963 [9:35:09<78:19:23,  8.36s/it]
                                                         
{'loss': '0.1724', 'grad_norm': '2.112', 'learning_rate': '1.965e-05', 'epoch': '0.112'}
+
 11%|█         | 4250/37963 [9:35:09<78:19:23,  8.36s/it]
 11%|█         | 4251/37963 [9:35:16<75:52:59,  8.10s/it]
 11%|█         | 4252/37963 [9:35:24<74:14:02,  7.93s/it]
 11%|█         | 4253/37963 [9:35:31<73:21:45,  7.83s/it]
 11%|█         | 4254/37963 [9:35:39<72:55:27,  7.79s/it]
 11%|█         | 4255/37963 [9:35:47<72:32:41,  7.75s/it]
 11%|█         | 4256/37963 [9:35:54<71:50:02,  7.67s/it]
 11%|█         | 4257/37963 [9:36:04<79:17:32,  8.47s/it]
 11%|█         | 4258/37963 [9:36:12<76:49:58,  8.21s/it]
 11%|█         | 4259/37963 [9:36:20<74:54:28,  8.00s/it]
 11%|█         | 4260/37963 [9:36:27<74:07:02,  7.92s/it]
                                                         
{'loss': '0.1808', 'grad_norm': '1.59', 'learning_rate': '1.965e-05', 'epoch': '0.1122'}
+
 11%|█         | 4260/37963 [9:36:27<74:07:02,  7.92s/it]
 11%|█         | 4261/37963 [9:36:35<72:48:03,  7.78s/it]
 11%|█         | 4262/37963 [9:36:42<72:47:46,  7.78s/it]
 11%|█         | 4263/37963 [9:36:50<72:33:25,  7.75s/it]
 11%|█         | 4264/37963 [9:36:58<71:41:42,  7.66s/it]
 11%|█         | 4265/37963 [9:37:06<72:20:02,  7.73s/it]
 11%|█         | 4266/37963 [9:37:13<71:59:39,  7.69s/it]
 11%|█         | 4267/37963 [9:37:21<71:24:48,  7.63s/it]
 11%|█         | 4268/37963 [9:37:28<70:47:21,  7.56s/it]
 11%|█         | 4269/37963 [9:37:35<70:06:07,  7.49s/it]
 11%|█         | 4270/37963 [9:37:43<70:08:07,  7.49s/it]
                                                         
{'loss': '0.1892', 'grad_norm': '2.277', 'learning_rate': '1.965e-05', 'epoch': '0.1125'}
+
 11%|█         | 4270/37963 [9:37:43<70:08:07,  7.49s/it]
 11%|█▏        | 4271/37963 [9:37:50<70:24:36,  7.52s/it]
 11%|█▏        | 4272/37963 [9:37:58<69:57:01,  7.47s/it]
 11%|█▏        | 4273/37963 [9:38:05<70:17:37,  7.51s/it]
 11%|█▏        | 4274/37963 [9:38:13<70:42:14,  7.56s/it]
 11%|█▏        | 4275/37963 [9:38:21<70:42:54,  7.56s/it]
 11%|█▏        | 4276/37963 [9:38:31<77:23:22,  8.27s/it]
 11%|█▏        | 4277/37963 [9:38:38<75:53:36,  8.11s/it]
 11%|█▏        | 4278/37963 [9:38:46<73:56:20,  7.90s/it]
 11%|█▏        | 4279/37963 [9:38:54<73:49:01,  7.89s/it]
 11%|█▏        | 4280/37963 [9:39:01<72:27:32,  7.74s/it]
                                                         
{'loss': '0.1906', 'grad_norm': '6.822', 'learning_rate': '1.964e-05', 'epoch': '0.1127'}
+
 11%|█▏        | 4280/37963 [9:39:01<72:27:32,  7.74s/it]
 11%|█▏        | 4281/37963 [9:39:09<71:57:42,  7.69s/it]
 11%|█▏        | 4282/37963 [9:39:16<71:16:13,  7.62s/it]
 11%|█▏        | 4283/37963 [9:39:26<78:21:01,  8.37s/it]
 11%|█▏        | 4284/37963 [9:39:36<82:28:00,  8.82s/it]
 11%|█▏        | 4285/37963 [9:39:44<79:25:10,  8.49s/it]
 11%|█▏        | 4286/37963 [9:39:51<76:41:33,  8.20s/it]
 11%|█▏        | 4287/37963 [9:39:59<75:28:11,  8.07s/it]
 11%|█▏        | 4288/37963 [9:40:07<74:35:23,  7.97s/it]
 11%|█▏        | 4289/37963 [9:40:14<73:51:51,  7.90s/it]
 11%|█▏        | 4290/37963 [9:40:22<72:43:26,  7.77s/it]
                                                         
{'loss': '0.183', 'grad_norm': '3.522', 'learning_rate': '1.964e-05', 'epoch': '0.113'}
+
 11%|█▏        | 4290/37963 [9:40:22<72:43:26,  7.77s/it]
 11%|█▏        | 4291/37963 [9:40:30<72:16:32,  7.73s/it]
 11%|█▏        | 4292/37963 [9:40:40<79:57:06,  8.55s/it]
 11%|█▏        | 4293/37963 [9:40:50<85:03:49,  9.10s/it]
 11%|█▏        | 4294/37963 [9:40:58<81:50:47,  8.75s/it]
 11%|█▏        | 4295/37963 [9:41:06<78:30:37,  8.39s/it]
 11%|█▏        | 4296/37963 [9:41:16<83:35:49,  8.94s/it]
 11%|█▏        | 4297/37963 [9:41:24<80:15:02,  8.58s/it]
 11%|█▏        | 4298/37963 [9:41:31<77:02:14,  8.24s/it]
 11%|█▏        | 4299/37963 [9:41:39<76:14:42,  8.15s/it]
 11%|█▏        | 4300/37963 [9:41:47<75:15:26,  8.05s/it]
                                                         
{'loss': '0.1588', 'grad_norm': '2.331', 'learning_rate': '1.964e-05', 'epoch': '0.1133'}
+
 11%|█▏        | 4300/37963 [9:41:47<75:15:26,  8.05s/it]
 11%|█▏        | 4301/37963 [9:41:55<75:11:15,  8.04s/it]
 11%|█▏        | 4302/37963 [9:42:05<80:35:04,  8.62s/it]
 11%|█▏        | 4303/37963 [9:42:13<77:56:06,  8.34s/it]
 11%|█▏        | 4304/37963 [9:42:20<75:46:06,  8.10s/it]
 11%|█▏        | 4305/37963 [9:42:30<81:23:35,  8.71s/it]
 11%|█▏        | 4306/37963 [9:42:38<77:52:55,  8.33s/it]
 11%|█▏        | 4307/37963 [9:42:45<76:00:05,  8.13s/it]
 11%|█▏        | 4308/37963 [9:42:53<74:47:24,  8.00s/it]
 11%|█▏        | 4309/37963 [9:43:01<74:05:31,  7.93s/it]
 11%|█▏        | 4310/37963 [9:43:09<73:20:17,  7.85s/it]
                                                         
{'loss': '0.1985', 'grad_norm': '4.983', 'learning_rate': '1.964e-05', 'epoch': '0.1135'}
+
 11%|█▏        | 4310/37963 [9:43:09<73:20:17,  7.85s/it]
 11%|█▏        | 4311/37963 [9:43:16<72:19:17,  7.74s/it]
 11%|█▏        | 4312/37963 [9:43:24<71:48:49,  7.68s/it]
 11%|█▏        | 4313/37963 [9:43:31<71:55:26,  7.69s/it]
 11%|█▏        | 4314/37963 [9:43:39<71:03:26,  7.60s/it]
 11%|█▏        | 4315/37963 [9:43:46<71:12:51,  7.62s/it]
 11%|█▏        | 4316/37963 [9:43:54<71:33:31,  7.66s/it]
 11%|█▏        | 4317/37963 [9:44:02<71:31:41,  7.65s/it]
 11%|█▏        | 4318/37963 [9:44:09<71:26:13,  7.64s/it]
 11%|█▏        | 4319/37963 [9:44:17<70:51:55,  7.58s/it]
 11%|█▏        | 4320/37963 [9:44:24<71:00:10,  7.60s/it]
                                                         
{'loss': '0.1903', 'grad_norm': '3.53', 'learning_rate': '1.963e-05', 'epoch': '0.1138'}
+
 11%|█▏        | 4320/37963 [9:44:24<71:00:10,  7.60s/it]
 11%|█▏        | 4321/37963 [9:44:35<78:06:32,  8.36s/it]
 11%|█▏        | 4322/37963 [9:44:42<76:21:27,  8.17s/it]
 11%|█▏        | 4323/37963 [9:44:50<75:05:09,  8.04s/it]
 11%|█▏        | 4324/37963 [9:44:58<73:31:22,  7.87s/it]
 11%|█▏        | 4325/37963 [9:45:06<73:57:56,  7.92s/it]
 11%|█▏        | 4326/37963 [9:45:14<74:17:35,  7.95s/it]
 11%|█▏        | 4327/37963 [9:45:21<72:24:54,  7.75s/it]
 11%|█▏        | 4328/37963 [9:45:29<72:21:41,  7.74s/it]
 11%|█▏        | 4329/37963 [9:45:36<72:17:09,  7.74s/it]
 11%|█▏        | 4330/37963 [9:45:44<72:25:48,  7.75s/it]
                                                         
{'loss': '0.1826', 'grad_norm': '2.072', 'learning_rate': '1.963e-05', 'epoch': '0.1141'}
+
 11%|█▏        | 4330/37963 [9:45:44<72:25:48,  7.75s/it]
 11%|█▏        | 4331/37963 [9:45:55<79:57:21,  8.56s/it]
 11%|█▏        | 4332/37963 [9:46:03<78:10:46,  8.37s/it]
 11%|█▏        | 4333/37963 [9:46:10<76:31:31,  8.19s/it]
 11%|█▏        | 4334/37963 [9:46:18<74:41:41,  8.00s/it]
 11%|���▏        | 4335/37963 [9:46:25<72:52:59,  7.80s/it]
 11%|█▏        | 4336/37963 [9:46:33<72:40:50,  7.78s/it]
 11%|█▏        | 4337/37963 [9:46:41<72:34:39,  7.77s/it]
 11%|█▏        | 4338/37963 [9:46:51<79:24:35,  8.50s/it]
 11%|█▏        | 4339/37963 [9:46:59<77:40:19,  8.32s/it]
 11%|█▏        | 4340/37963 [9:47:09<82:54:45,  8.88s/it]
                                                         
{'loss': '0.1918', 'grad_norm': '3.866', 'learning_rate': '1.963e-05', 'epoch': '0.1143'}
+
 11%|█▏        | 4340/37963 [9:47:09<82:54:45,  8.88s/it]
 11%|█▏        | 4341/37963 [9:47:17<79:45:09,  8.54s/it]
 11%|█▏        | 4342/37963 [9:47:24<77:23:30,  8.29s/it]
 11%|█▏        | 4343/37963 [9:47:32<75:44:36,  8.11s/it]
 11%|█▏        | 4344/37963 [9:47:40<73:54:47,  7.91s/it]
 11%|█▏        | 4345/37963 [9:47:47<73:08:07,  7.83s/it]
 11%|█▏        | 4346/37963 [9:47:55<72:14:15,  7.74s/it]
 11%|█▏        | 4347/37963 [9:48:05<79:30:15,  8.51s/it]
 11%|█▏        | 4348/37963 [9:48:13<76:38:22,  8.21s/it]
 11%|█▏        | 4349/37963 [9:48:20<74:29:51,  7.98s/it]
 11%|█▏        | 4350/37963 [9:48:30<81:03:56,  8.68s/it]
                                                         
{'loss': '0.1905', 'grad_norm': '3.961', 'learning_rate': '1.963e-05', 'epoch': '0.1146'}
+
 11%|█▏        | 4350/37963 [9:48:30<81:03:56,  8.68s/it]
 11%|█▏        | 4351/37963 [9:48:38<78:07:24,  8.37s/it]
 11%|█▏        | 4352/37963 [9:48:45<74:51:09,  8.02s/it]
 11%|█▏        | 4353/37963 [9:48:53<73:41:26,  7.89s/it]
 11%|█▏        | 4354/37963 [9:49:03<80:05:24,  8.58s/it]
 11%|█▏        | 4355/37963 [9:49:11<79:02:43,  8.47s/it]
 11%|█▏        | 4356/37963 [9:49:21<83:14:29,  8.92s/it]
 11%|█▏        | 4357/37963 [9:49:29<79:49:17,  8.55s/it]
 11%|█▏        | 4358/37963 [9:49:37<77:49:27,  8.34s/it]
 11%|█▏        | 4359/37963 [9:49:44<75:38:22,  8.10s/it]
 11%|█▏        | 4360/37963 [9:49:52<74:51:22,  8.02s/it]
                                                         
{'loss': '0.1839', 'grad_norm': '3.525', 'learning_rate': '1.963e-05', 'epoch': '0.1148'}
+
 11%|█▏        | 4360/37963 [9:49:52<74:51:22,  8.02s/it]
 11%|█▏        | 4361/37963 [9:49:59<73:14:26,  7.85s/it]
 11%|█▏        | 4362/37963 [9:50:07<73:00:34,  7.82s/it]
 11%|█▏        | 4363/37963 [9:50:15<72:38:09,  7.78s/it]
 11%|█▏        | 4364/37963 [9:50:23<72:52:51,  7.81s/it]
 11%|█▏        | 4365/37963 [9:50:30<72:27:23,  7.76s/it]
 12%|█▏        | 4366/37963 [9:50:38<72:21:33,  7.75s/it]
 12%|█▏        | 4367/37963 [9:50:46<71:45:00,  7.69s/it]
 12%|█▏        | 4368/37963 [9:50:53<71:42:23,  7.68s/it]
 12%|█▏        | 4369/37963 [9:51:01<71:40:46,  7.68s/it]
 12%|█▏        | 4370/37963 [9:51:09<71:53:26,  7.70s/it]
                                                         
{'loss': '0.1935', 'grad_norm': '6.385', 'learning_rate': '1.962e-05', 'epoch': '0.1151'}
+
 12%|█▏        | 4370/37963 [9:51:09<71:53:26,  7.70s/it]
 12%|█▏        | 4371/37963 [9:51:17<72:53:04,  7.81s/it]
 12%|█▏        | 4372/37963 [9:51:25<72:45:31,  7.80s/it]
 12%|█▏        | 4373/37963 [9:51:32<72:17:31,  7.75s/it]
 12%|█▏        | 4374/37963 [9:51:43<79:28:00,  8.52s/it]
 12%|█▏        | 4375/37963 [9:51:50<76:19:40,  8.18s/it]
 12%|█▏        | 4376/37963 [9:51:58<74:59:21,  8.04s/it]
 12%|█▏        | 4377/37963 [9:52:05<73:32:30,  7.88s/it]
 12%|█▏        | 4378/37963 [9:52:13<72:37:28,  7.78s/it]
 12%|█▏        | 4379/37963 [9:52:21<73:10:04,  7.84s/it]
 12%|█▏        | 4380/37963 [9:52:31<79:46:41,  8.55s/it]
                                                         
{'loss': '0.1973', 'grad_norm': '3.854', 'learning_rate': '1.962e-05', 'epoch': '0.1154'}
+
 12%|█▏        | 4380/37963 [9:52:31<79:46:41,  8.55s/it]
 12%|█▏        | 4381/37963 [9:52:38<76:50:45,  8.24s/it]
 12%|█▏        | 4382/37963 [9:52:46<75:20:52,  8.08s/it]
 12%|█▏        | 4383/37963 [9:52:54<74:17:23,  7.96s/it]
 12%|█▏        | 4384/37963 [9:53:01<72:43:09,  7.80s/it]
 12%|█▏        | 4385/37963 [9:53:09<72:00:37,  7.72s/it]
 12%|█▏        | 4386/37963 [9:53:16<71:41:50,  7.69s/it]
 12%|█▏        | 4387/37963 [9:53:27<78:44:16,  8.44s/it]
 12%|█▏        | 4388/37963 [9:53:37<84:40:52,  9.08s/it]
 12%|█▏        | 4389/37963 [9:53:45<80:35:41,  8.64s/it]
 12%|█▏        | 4390/37963 [9:53:53<78:16:01,  8.39s/it]
                                                         
{'loss': '0.1675', 'grad_norm': '2.323', 'learning_rate': '1.962e-05', 'epoch': '0.1156'}
+
 12%|█▏        | 4390/37963 [9:53:53<78:16:01,  8.39s/it]
 12%|█▏        | 4391/37963 [9:54:03<82:56:37,  8.89s/it]
 12%|█▏        | 4392/37963 [9:54:10<80:00:56,  8.58s/it]
 12%|█▏        | 4393/37963 [9:54:18<76:36:10,  8.21s/it]
 12%|█▏        | 4394/37963 [9:54:28<82:05:15,  8.80s/it]
 12%|█▏        | 4395/37963 [9:54:36<79:10:48,  8.49s/it]
 12%|█▏        | 4396/37963 [9:54:43<76:24:50,  8.20s/it]
 12%|█��        | 4397/37963 [9:54:51<74:30:45,  7.99s/it]
 12%|█▏        | 4398/37963 [9:54:58<73:32:52,  7.89s/it]
 12%|█▏        | 4399/37963 [9:55:06<72:48:04,  7.81s/it]
 12%|█▏        | 4400/37963 [9:55:16<79:33:08,  8.53s/it]
                                                         
{'loss': '0.1914', 'grad_norm': '2.933', 'learning_rate': '1.962e-05', 'epoch': '0.1159'}
+
 12%|█▏        | 4400/37963 [9:55:16<79:33:08,  8.53s/it]
 12%|█▏        | 4401/37963 [9:55:24<77:19:29,  8.29s/it]
 12%|█▏        | 4402/37963 [9:55:32<75:35:39,  8.11s/it]
 12%|█▏        | 4403/37963 [9:55:39<74:04:58,  7.95s/it]
 12%|█▏        | 4404/37963 [9:55:47<72:57:00,  7.83s/it]
 12%|█▏        | 4405/37963 [9:55:55<72:34:59,  7.79s/it]
 12%|█▏        | 4406/37963 [9:56:02<72:58:02,  7.83s/it]
 12%|█▏        | 4407/37963 [9:56:10<71:55:56,  7.72s/it]
 12%|█▏        | 4408/37963 [9:56:20<78:46:02,  8.45s/it]
 12%|█▏        | 4409/37963 [9:56:28<76:58:38,  8.26s/it]
 12%|█▏        | 4410/37963 [9:56:36<75:51:18,  8.14s/it]
                                                         
{'loss': '0.176', 'grad_norm': '3.381', 'learning_rate': '1.961e-05', 'epoch': '0.1162'}
+
 12%|█▏        | 4410/37963 [9:56:36<75:51:18,  8.14s/it]
 12%|█▏        | 4411/37963 [9:56:43<73:40:58,  7.91s/it]
 12%|█▏        | 4412/37963 [9:56:51<72:40:26,  7.80s/it]
 12%|█▏        | 4413/37963 [9:56:58<72:27:26,  7.77s/it]
 12%|█▏        | 4414/37963 [9:57:06<72:12:56,  7.75s/it]
 12%|█▏        | 4415/37963 [9:57:14<71:46:52,  7.70s/it]
 12%|█▏        | 4416/37963 [9:57:21<71:20:29,  7.66s/it]
 12%|█▏        | 4417/37963 [9:57:29<71:09:29,  7.64s/it]
 12%|█▏        | 4418/37963 [9:57:36<70:23:42,  7.55s/it]
 12%|█▏        | 4419/37963 [9:57:44<71:23:19,  7.66s/it]
 12%|█▏        | 4420/37963 [9:57:52<70:51:48,  7.61s/it]
                                                         
{'loss': '0.1873', 'grad_norm': '2.367', 'learning_rate': '1.961e-05', 'epoch': '0.1164'}
+
 12%|█▏        | 4420/37963 [9:57:52<70:51:48,  7.61s/it]
 12%|█▏        | 4421/37963 [9:57:59<71:15:34,  7.65s/it]
 12%|█▏        | 4422/37963 [9:58:10<79:12:47,  8.50s/it]
 12%|█▏        | 4423/37963 [9:58:17<76:33:03,  8.22s/it]
 12%|█▏        | 4424/37963 [9:58:25<74:41:08,  8.02s/it]
 12%|█▏        | 4425/37963 [9:58:33<73:57:05,  7.94s/it]
 12%|█▏        | 4426/37963 [9:58:40<72:52:29,  7.82s/it]
 12%|█▏        | 4427/37963 [9:58:48<71:51:27,  7.71s/it]
 12%|█▏        | 4428/37963 [9:58:55<71:43:31,  7.70s/it]
 12%|█▏        | 4429/37963 [9:59:03<71:14:07,  7.65s/it]
 12%|█▏        | 4430/37963 [9:59:10<70:42:10,  7.59s/it]
                                                         
{'loss': '0.1672', 'grad_norm': '3.64', 'learning_rate': '1.961e-05', 'epoch': '0.1167'}
+
 12%|█▏        | 4430/37963 [9:59:10<70:42:10,  7.59s/it]
 12%|█▏        | 4431/37963 [9:59:18<71:11:59,  7.64s/it]
 12%|█▏        | 4432/37963 [9:59:26<71:41:18,  7.70s/it]
 12%|█▏        | 4433/37963 [9:59:36<78:49:14,  8.46s/it]
 12%|█▏        | 4434/37963 [9:59:46<84:00:09,  9.02s/it]
 12%|█▏        | 4435/37963 [9:59:54<80:02:41,  8.59s/it]
 12%|█▏        | 4436/37963 [10:00:04<84:51:25,  9.11s/it]
 12%|█▏        | 4437/37963 [10:00:17<95:22:44, 10.24s/it]
 12%|█▏        | 4438/37963 [10:00:25<88:53:08,  9.54s/it]
 12%|█▏        | 4439/37963 [10:00:33<84:04:30,  9.03s/it]
 12%|█▏        | 4440/37963 [10:00:40<79:41:27,  8.56s/it]
                                                          
{'loss': '0.1697', 'grad_norm': '3.956', 'learning_rate': '1.961e-05', 'epoch': '0.117'}
+
 12%|█▏        | 4440/37963 [10:00:40<79:41:27,  8.56s/it]
 12%|█▏        | 4441/37963 [10:00:48<77:39:05,  8.34s/it]
 12%|█▏        | 4442/37963 [10:00:56<75:44:57,  8.14s/it]
 12%|█▏        | 4443/37963 [10:01:06<82:26:16,  8.85s/it]
 12%|█▏        | 4444/37963 [10:01:14<79:14:11,  8.51s/it]
 12%|█▏        | 4445/37963 [10:01:22<76:48:46,  8.25s/it]
 12%|█▏        | 4446/37963 [10:01:29<74:54:47,  8.05s/it]
 12%|█▏        | 4447/37963 [10:01:37<73:52:46,  7.94s/it]
 12%|█▏        | 4448/37963 [10:01:45<73:37:14,  7.91s/it]
 12%|█▏        | 4449/37963 [10:01:53<73:08:48,  7.86s/it]
 12%|█▏        | 4450/37963 [10:02:00<72:13:06,  7.76s/it]
                                                          
{'loss': '0.1927', 'grad_norm': '2.186', 'learning_rate': '1.96e-05', 'epoch': '0.1172'}
+
 12%|█▏        | 4450/37963 [10:02:00<72:13:06,  7.76s/it]
 12%|█▏        | 4451/37963 [10:02:08<71:20:15,  7.66s/it]
 12%|█▏        | 4452/37963 [10:02:15<70:49:20,  7.61s/it]
 12%|█▏        | 4453/37963 [10:02:23<70:37:21,  7.59s/it]
 12%|█▏        | 4454/37963 [10:02:30<71:02:10,  7.63s/it]
 12%|█▏        | 4455/37963 [10:02:38<70:51:05,  7.61s/it]
 12%|█▏        | 4456/37963 [10:02:48<77:59:17,  8.38s/it]
 12%|█▏        | 4457/37963 [10:02:56<75:46:03,  8.14s/it]
 12%|█▏        | 4458/37963 [10:03:04<74:53:12,  8.05s/it]
 12%|█▏        | 4459/37963 [10:03:11<73:29:39,  7.90s/it]
 12%|█▏        | 4460/37963 [10:03:19<72:58:40,  7.84s/it]
                                                          
{'loss': '0.1917', 'grad_norm': '1.891', 'learning_rate': '1.96e-05', 'epoch': '0.1175'}
+
 12%|█▏        | 4460/37963 [10:03:19<72:58:40,  7.84s/it]
 12%|█▏        | 4461/37963 [10:03:26<72:18:44,  7.77s/it]
 12%|█▏        | 4462/37963 [10:03:34<72:32:54,  7.80s/it]
 12%|█▏        | 4463/37963 [10:03:42<71:01:38,  7.63s/it]
 12%|█▏        | 4464/37963 [10:03:49<70:33:44,  7.58s/it]
 12%|█▏        | 4465/37963 [10:03:57<71:03:25,  7.64s/it]
 12%|█▏        | 4466/37963 [10:04:04<70:45:54,  7.61s/it]
 12%|█▏        | 4467/37963 [10:04:12<70:30:09,  7.58s/it]
 12%|█▏        | 4468/37963 [10:04:20<71:15:30,  7.66s/it]
 12%|█▏        | 4469/37963 [10:04:27<69:49:35,  7.51s/it]
 12%|█▏        | 4470/37963 [10:04:37<77:45:18,  8.36s/it]
                                                          
{'loss': '0.1743', 'grad_norm': '3.424', 'learning_rate': '1.96e-05', 'epoch': '0.1177'}
+
 12%|█▏        | 4470/37963 [10:04:37<77:45:18,  8.36s/it]
 12%|█▏        | 4471/37963 [10:04:45<75:34:05,  8.12s/it]
 12%|█▏        | 4472/37963 [10:04:52<73:55:39,  7.95s/it]
 12%|█▏        | 4473/37963 [10:05:00<72:41:20,  7.81s/it]
 12%|█▏        | 4474/37963 [10:05:07<72:05:15,  7.75s/it]
 12%|█▏        | 4475/37963 [10:05:15<71:38:12,  7.70s/it]
 12%|█▏        | 4476/37963 [10:05:23<72:18:50,  7.77s/it]
 12%|█▏        | 4477/37963 [10:05:30<71:30:59,  7.69s/it]
 12%|█▏        | 4478/37963 [10:05:38<70:58:53,  7.63s/it]
 12%|█▏        | 4479/37963 [10:05:48<77:45:26,  8.36s/it]
 12%|█▏        | 4480/37963 [10:05:55<75:02:26,  8.07s/it]
                                                          
{'loss': '0.1782', 'grad_norm': '2.079', 'learning_rate': '1.96e-05', 'epoch': '0.118'}
+
 12%|█▏        | 4480/37963 [10:05:55<75:02:26,  8.07s/it]
 12%|█▏        | 4481/37963 [10:06:06<81:57:33,  8.81s/it]
 12%|█▏        | 4482/37963 [10:06:16<86:12:48,  9.27s/it]
 12%|█▏        | 4483/37963 [10:06:24<82:15:54,  8.85s/it]
 12%|█▏        | 4484/37963 [10:06:32<79:11:57,  8.52s/it]
 12%|█▏        | 4485/37963 [10:06:39<76:44:36,  8.25s/it]
 12%|█▏        | 4486/37963 [10:06:47<74:30:22,  8.01s/it]
 12%|█▏        | 4487/37963 [10:06:57<80:41:18,  8.68s/it]
 12%|█▏        | 4488/37963 [10:07:07<84:21:06,  9.07s/it]
 12%|█▏        | 4489/37963 [10:07:15<79:52:56,  8.59s/it]
 12%|█▏        | 4490/37963 [10:07:24<82:25:57,  8.87s/it]
                                                          
{'loss': '0.1791', 'grad_norm': '3.523', 'learning_rate': '1.959e-05', 'epoch': '0.1183'}
+
 12%|█▏        | 4490/37963 [10:07:24<82:25:57,  8.87s/it]
 12%|█▏        | 4491/37963 [10:07:32<78:47:35,  8.47s/it]
 12%|█▏        | 4492/37963 [10:07:39<75:34:09,  8.13s/it]
 12%|█▏        | 4493/37963 [10:07:46<73:53:36,  7.95s/it]
 12%|█▏        | 4494/37963 [10:07:54<72:51:56,  7.84s/it]
 12%|█▏        | 4495/37963 [10:08:02<71:55:13,  7.74s/it]
 12%|█▏        | 4496/37963 [10:08:09<71:28:33,  7.69s/it]
 12%|█▏        | 4497/37963 [10:08:17<71:07:02,  7.65s/it]
 12%|█▏        | 4498/37963 [10:08:24<70:10:17,  7.55s/it]
 12%|█▏        | 4499/37963 [10:08:32<70:17:31,  7.56s/it]
 12%|█▏        | 4500/37963 [10:08:42<77:37:59,  8.35s/it]
                                                          
{'loss': '0.1743', 'grad_norm': '2.439', 'learning_rate': '1.959e-05', 'epoch': '0.1185'}
+
 12%|█▏        | 4500/37963 [10:08:42<77:37:59,  8.35s/it]
 12%|█▏        | 4501/37963 [10:08:49<75:41:09,  8.14s/it]
 12%|█▏        | 4502/37963 [10:08:57<74:48:16,  8.05s/it]
 12%|█▏        | 4503/37963 [10:09:05<73:24:47,  7.90s/it]
 12%|█▏        | 4504/37963 [10:09:12<72:43:56,  7.83s/it]
 12%|█▏        | 4505/37963 [10:09:20<71:26:54,  7.69s/it]
 12%|█▏        | 4506/37963 [10:09:27<70:30:30,  7.59s/it]
 12%|█▏        | 4507/37963 [10:09:35<71:03:09,  7.65s/it]
 12%|█▏        | 4508/37963 [10:09:43<70:46:15,  7.62s/it]
 12%|█▏        | 4509/37963 [10:09:50<70:48:56,  7.62s/it]
 12%|█▏        | 4510/37963 [10:09:58<70:36:06,  7.60s/it]
                                                          
{'loss': '0.1679', 'grad_norm': '3.44', 'learning_rate': '1.959e-05', 'epoch': '0.1188'}
+
 12%|█▏        | 4510/37963 [10:09:58<70:36:06,  7.60s/it]
 12%|█▏        | 4511/37963 [10:10:05<71:00:17,  7.64s/it]
 12%|█▏        | 4512/37963 [10:10:13<70:59:14,  7.64s/it]
 12%|█▏        | 4513/37963 [10:10:21<70:37:29,  7.60s/it]
 12%|█▏        | 4514/37963 [10:10:28<70:53:58,  7.63s/it]
 12%|█▏        | 4515/37963 [10:10:36<71:00:37,  7.64s/it]
 12%|█▏        | 4516/37963 [10:10:44<70:54:19,  7.63s/it]
 12%|█▏        | 4517/37963 [10:10:51<71:39:23,  7.71s/it]
 12%|█▏        | 4518/37963 [10:10:59<70:48:22,  7.62s/it]
 12%|█▏        | 4519/37963 [10:11:07<71:05:01,  7.65s/it]
 12%|█▏        | 4520/37963 [10:11:14<71:24:39,  7.69s/it]
                                                          
{'loss': '0.1846', 'grad_norm': '2.041', 'learning_rate': '1.959e-05', 'epoch': '0.1191'}
+
 12%|█▏        | 4520/37963 [10:11:14<71:24:39,  7.69s/it]
 12%|█▏        | 4521/37963 [10:11:22<71:41:43,  7.72s/it]
 12%|█▏        | 4522/37963 [10:11:30<71:18:35,  7.68s/it]
 12%|█▏        | 4523/37963 [10:11:37<71:16:25,  7.67s/it]
 12%|█▏        | 4524/37963 [10:11:48<78:06:00,  8.41s/it]
 12%|█▏        | 4525/37963 [10:11:58<82:57:29,  8.93s/it]
 12%|█▏        | 4526/37963 [10:12:05<78:41:21,  8.47s/it]
 12%|█▏        | 4527/37963 [10:12:13<76:09:30,  8.20s/it]
 12%|█▏        | 4528/37963 [10:12:20<74:47:18,  8.05s/it]
 12%|█▏        | 4529/37963 [10:12:28<73:57:43,  7.96s/it]
 12%|█▏        | 4530/37963 [10:12:38<80:01:28,  8.62s/it]
                                                          
{'loss': '0.1867', 'grad_norm': '3.682', 'learning_rate': '1.958e-05', 'epoch': '0.1193'}
+
 12%|█▏        | 4530/37963 [10:12:38<80:01:28,  8.62s/it]
 12%|█▏        | 4531/37963 [10:12:46<77:09:23,  8.31s/it]
 12%|█▏        | 4532/37963 [10:12:56<83:04:38,  8.95s/it]
 12%|█▏        | 4533/37963 [10:13:04<79:56:18,  8.61s/it]
 12%|█▏        | 4534/37963 [10:13:14<84:46:17,  9.13s/it]
 12%|█▏        | 4535/37963 [10:13:25<88:04:03,  9.48s/it]
 12%|█▏        | 4536/37963 [10:13:35<90:52:30,  9.79s/it]
 12%|█▏        | 4537/37963 [10:13:43<85:17:57,  9.19s/it]
 12%|█▏        | 4538/37963 [10:13:51<80:44:46,  8.70s/it]
 12%|█▏        | 4539/37963 [10:13:58<77:21:01,  8.33s/it]
 12%|█▏        | 4540/37963 [10:14:06<75:27:29,  8.13s/it]
                                                          
{'loss': '0.1884', 'grad_norm': '2.551', 'learning_rate': '1.958e-05', 'epoch': '0.1196'}
+
 12%|█▏        | 4540/37963 [10:14:06<75:27:29,  8.13s/it]
 12%|█▏        | 4541/37963 [10:14:13<73:46:50,  7.95s/it]
 12%|█▏        | 4542/37963 [10:14:21<72:52:28,  7.85s/it]
 12%|█▏        | 4543/37963 [10:14:31<78:49:05,  8.49s/it]
 12%|█▏        | 4544/37963 [10:14:39<76:58:01,  8.29s/it]
 12%|█▏        | 4545/37963 [10:14:46<75:15:02,  8.11s/it]
 12%|█▏        | 4546/37963 [10:14:54<73:17:48,  7.90s/it]
 12%|█▏        | 4547/37963 [10:15:02<73:35:13,  7.93s/it]
 12%|█▏        | 4548/37963 [10:15:09<72:52:38,  7.85s/it]
 12%|█▏        | 4549/37963 [10:15:17<73:10:57,  7.88s/it]
 12%|█▏        | 4550/37963 [10:15:25<72:30:46,  7.81s/it]
                                                          
{'loss': '0.1645', 'grad_norm': '1.907', 'learning_rate': '1.958e-05', 'epoch': '0.1199'}
+
 12%|█▏        | 4550/37963 [10:15:25<72:30:46,  7.81s/it]
 12%|█▏        | 4551/37963 [10:15:33<71:33:45,  7.71s/it]
 12%|█▏        | 4552/37963 [10:15:40<71:16:37,  7.68s/it]
 12%|█▏        | 4553/37963 [10:15:48<71:10:12,  7.67s/it]
 12%|█▏        | 4554/37963 [10:15:55<70:57:15,  7.65s/it]
 12%|█▏        | 4555/37963 [10:16:03<70:36:17,  7.61s/it]
 12%|█▏        | 4556/37963 [10:16:10<70:29:26,  7.60s/it]
 12%|█▏        | 4557/37963 [10:16:18<70:38:30,  7.61s/it]
 12%|█▏        | 4558/37963 [10:16:26<71:10:26,  7.67s/it]
 12%|█▏        | 4559/37963 [10:16:33<70:53:13,  7.64s/it]
 12%|█▏        | 4560/37963 [10:16:41<70:58:52,  7.65s/it]
                                                          
{'loss': '0.1931', 'grad_norm': '2.465', 'learning_rate': '1.958e-05', 'epoch': '0.1201'}
+
 12%|█▏        | 4560/37963 [10:16:41<70:58:52,  7.65s/it]
 12%|█▏        | 4561/37963 [10:16:49<70:21:35,  7.58s/it]
 12%|█▏        | 4562/37963 [10:16:56<70:54:13,  7.64s/it]
 12%|█▏        | 4563/37963 [10:17:04<70:58:36,  7.65s/it]
 12%|█▏        | 4564/37963 [10:17:12<71:34:43,  7.72s/it]
 12%|█▏        | 4565/37963 [10:17:20<71:28:54,  7.71s/it]
 12%|█▏        | 4566/37963 [10:17:27<70:53:43,  7.64s/it]
 12%|█▏        | 4567/37963 [10:17:35<71:05:45,  7.66s/it]
 12%|█▏        | 4568/37963 [10:17:43<72:00:23,  7.76s/it]
 12%|█▏        | 4569/37963 [10:17:50<71:19:16,  7.69s/it]
 12%|█▏        | 4570/37963 [10:17:58<71:29:23,  7.71s/it]
                                                          
{'loss': '0.1918', 'grad_norm': '1.953', 'learning_rate': '1.957e-05', 'epoch': '0.1204'}
+
 12%|█▏        | 4570/37963 [10:17:58<71:29:23,  7.71s/it]
 12%|█▏        | 4571/37963 [10:18:06<71:21:22,  7.69s/it]
 12%|█▏        | 4572/37963 [10:18:13<71:33:08,  7.71s/it]
 12%|█▏        | 4573/37963 [10:18:23<77:26:02,  8.35s/it]
 12%|█▏        | 4574/37963 [10:18:31<75:29:06,  8.14s/it]
 12%|█▏        | 4575/37963 [10:18:38<73:50:43,  7.96s/it]
 12%|█▏        | 4576/37963 [10:18:46<73:06:46,  7.88s/it]
 12%|█▏        | 4577/37963 [10:18:54<73:15:39,  7.90s/it]
 12%|█▏        | 4578/37963 [10:19:04<79:07:31,  8.53s/it]
 12%|█▏        | 4579/37963 [10:19:12<76:37:29,  8.26s/it]
 12%|█▏        | 4580/37963 [10:19:19<75:04:32,  8.10s/it]
                                                          
{'loss': '0.1859', 'grad_norm': '2.128', 'learning_rate': '1.957e-05', 'epoch': '0.1206'}
+
 12%|█▏        | 4580/37963 [10:19:19<75:04:32,  8.10s/it]
 12%|█▏        | 4581/37963 [10:19:30<81:50:00,  8.83s/it]
 12%|█▏        | 4582/37963 [10:19:40<85:59:23,  9.27s/it]
 12%|█▏        | 4583/37963 [10:19:51<88:45:30,  9.57s/it]
 12%|█▏        | 4584/37963 [10:20:01<90:48:34,  9.79s/it]
 12%|█▏        | 4585/37963 [10:20:08<84:15:25,  9.09s/it]
 12%|█▏        | 4586/37963 [10:20:16<79:57:41,  8.62s/it]
 12%|█▏        | 4587/37963 [10:20:24<77:39:55,  8.38s/it]
 12%|█▏        | 4588/37963 [10:20:34<82:42:28,  8.92s/it]
 12%|█▏        | 4589/37963 [10:20:41<78:51:33,  8.51s/it]
 12%|█▏        | 4590/37963 [10:20:49<76:21:22,  8.24s/it]
                                                          
{'loss': '0.1709', 'grad_norm': '2.173', 'learning_rate': '1.957e-05', 'epoch': '0.1209'}
+
 12%|█▏        | 4590/37963 [10:20:49<76:21:22,  8.24s/it]
 12%|█▏        | 4591/37963 [10:20:57<74:35:02,  8.05s/it]
 12%|█▏        | 4592/37963 [10:21:04<73:12:00,  7.90s/it]
 12%|█▏        | 4593/37963 [10:21:14<79:05:24,  8.53s/it]
 12%|█▏        | 4594/37963 [10:21:22<76:27:53,  8.25s/it]
 12%|█▏        | 4595/37963 [10:21:29<74:47:29,  8.07s/it]
 12%|█▏        | 4596/37963 [10:21:37<73:16:11,  7.91s/it]
 12%|█▏        | 4597/37963 [10:21:44<71:39:12,  7.73s/it]
 12%|█▏        | 4598/37963 [10:21:52<71:24:11,  7.70s/it]
 12%|█▏        | 4599/37963 [10:21:59<70:56:42,  7.66s/it]
 12%|█▏        | 4600/37963 [10:22:07<70:25:51,  7.60s/it]
                                                          
{'loss': '0.1891', 'grad_norm': '3.31', 'learning_rate': '1.957e-05', 'epoch': '0.1212'}
+
 12%|█▏        | 4600/37963 [10:22:07<70:25:51,  7.60s/it]
 12%|█▏        | 4601/37963 [10:22:15<70:48:23,  7.64s/it]
 12%|█▏        | 4602/37963 [10:22:22<70:15:33,  7.58s/it]
 12%|█▏        | 4603/37963 [10:22:30<69:57:19,  7.55s/it]
 12%|█▏        | 4604/37963 [10:22:38<71:00:36,  7.66s/it]
 12%|█▏        | 4605/37963 [10:22:45<70:42:49,  7.63s/it]
 12%|█▏        | 4606/37963 [10:22:53<71:19:11,  7.70s/it]
 12%|█▏        | 4607/37963 [10:23:01<71:17:47,  7.69s/it]
 12%|█▏        | 4608/37963 [10:23:08<71:36:51,  7.73s/it]
 12%|█▏        | 4609/37963 [10:23:16<70:33:14,  7.62s/it]
 12%|█▏        | 4610/37963 [10:23:23<70:15:53,  7.58s/it]
                                                          
{'loss': '0.1851', 'grad_norm': '4.594', 'learning_rate': '1.956e-05', 'epoch': '0.1214'}
+
 12%|█▏        | 4610/37963 [10:23:23<70:15:53,  7.58s/it]
 12%|█▏        | 4611/37963 [10:23:31<70:08:26,  7.57s/it]
 12%|█▏        | 4612/37963 [10:23:38<69:55:41,  7.55s/it]
 12%|█▏        | 4613/37963 [10:23:46<70:14:29,  7.58s/it]
 12%|█▏        | 4614/37963 [10:23:54<70:23:43,  7.60s/it]
 12%|█▏        | 4615/37963 [10:24:01<70:21:06,  7.59s/it]
 12%|█▏        | 4616/37963 [10:24:08<68:58:12,  7.45s/it]
 12%|█▏        | 4617/37963 [10:24:16<69:59:32,  7.56s/it]
 12%|█▏        | 4618/37963 [10:24:24<69:53:24,  7.55s/it]
 12%|█▏        | 4619/37963 [10:24:31<70:04:27,  7.57s/it]
 12%|█▏        | 4620/37963 [10:24:39<70:14:45,  7.58s/it]
                                                          
{'loss': '0.1793', 'grad_norm': '2.433', 'learning_rate': '1.956e-05', 'epoch': '0.1217'}
+
 12%|█▏        | 4620/37963 [10:24:39<70:14:45,  7.58s/it]
 12%|█▏        | 4621/37963 [10:24:49<77:38:13,  8.38s/it]
 12%|█▏        | 4622/37963 [10:24:57<76:09:21,  8.22s/it]
 12%|█▏        | 4623/37963 [10:25:05<75:10:59,  8.12s/it]
 12%|█▏        | 4624/37963 [10:25:12<73:41:10,  7.96s/it]
 12%|█▏        | 4625/37963 [10:25:20<72:35:53,  7.84s/it]
 12%|█▏        | 4626/37963 [10:25:27<71:25:05,  7.71s/it]
 12%|█▏        | 4627/37963 [10:25:38<78:43:35,  8.50s/it]
 12%|█▏        | 4628/37963 [10:25:45<75:48:05,  8.19s/it]
 12%|█▏        | 4629/37963 [10:25:58<87:42:22,  9.47s/it]
 12%|█▏        | 4630/37963 [10:26:08<89:55:30,  9.71s/it]
                                                          
{'loss': '0.181', 'grad_norm': '4.164', 'learning_rate': '1.956e-05', 'epoch': '0.122'}
+
 12%|█▏        | 4630/37963 [10:26:08<89:55:30,  9.71s/it]
 12%|█▏        | 4631/37963 [10:26:16<85:01:08,  9.18s/it]
 12%|█▏        | 4632/37963 [10:26:23<79:59:52,  8.64s/it]
 12%|█▏        | 4633/37963 [10:26:31<78:02:04,  8.43s/it]
 12%|█▏        | 4634/37963 [10:26:39<75:27:03,  8.15s/it]
 12%|█▏        | 4635/37963 [10:26:47<74:37:03,  8.06s/it]
 12%|█▏        | 4636/37963 [10:26:54<73:14:25,  7.91s/it]
 12%|█▏        | 4637/37963 [10:27:02<72:22:28,  7.82s/it]
 12%|█▏        | 4638/37963 [10:27:12<79:36:20,  8.60s/it]
 12%|█▏        | 4639/37963 [10:27:20<77:09:54,  8.34s/it]
 12%|█▏        | 4640/37963 [10:27:27<74:43:28,  8.07s/it]
                                                          
{'loss': '0.1759', 'grad_norm': '3.2', 'learning_rate': '1.956e-05', 'epoch': '0.1222'}
+
 12%|█▏        | 4640/37963 [10:27:27<74:43:28,  8.07s/it]
 12%|█▏        | 4641/37963 [10:27:35<73:14:37,  7.91s/it]
 12%|█▏        | 4642/37963 [10:27:45<79:27:30,  8.58s/it]
 12%|█▏        | 4643/37963 [10:27:53<77:31:33,  8.38s/it]
 12%|█▏        | 4644/37963 [10:28:01<75:23:11,  8.15s/it]
 12%|█▏        | 4645/37963 [10:28:08<74:21:57,  8.04s/it]
 12%|█▏        | 4646/37963 [10:28:16<73:29:07,  7.94s/it]
 12%|█▏        | 4647/37963 [10:28:26<79:45:37,  8.62s/it]
 12%|█▏        | 4648/37963 [10:28:34<77:25:19,  8.37s/it]
 12%|█▏        | 4649/37963 [10:28:41<74:44:30,  8.08s/it]
 12%|█▏        | 4650/37963 [10:28:49<73:30:50,  7.94s/it]
                                                          
{'loss': '0.1749', 'grad_norm': '4.122', 'learning_rate': '1.955e-05', 'epoch': '0.1225'}
+
 12%|█▏        | 4650/37963 [10:28:49<73:30:50,  7.94s/it]
 12%|█▏        | 4651/37963 [10:28:57<73:11:15,  7.91s/it]
 12%|█▏        | 4652/37963 [10:29:05<72:42:49,  7.86s/it]
 12%|█▏        | 4653/37963 [10:29:12<72:36:26,  7.85s/it]
 12%|█▏        | 4654/37963 [10:29:20<71:18:19,  7.71s/it]
 12%|█▏        | 4655/37963 [10:29:28<71:28:04,  7.72s/it]
 12%|█▏        | 4656/37963 [10:29:35<70:51:24,  7.66s/it]
 12%|█▏        | 4657/37963 [10:29:43<70:43:30,  7.64s/it]
 12%|█▏        | 4658/37963 [10:29:50<70:18:03,  7.60s/it]
 12%|█▏        | 4659/37963 [10:29:58<70:20:17,  7.60s/it]
 12%|█▏        | 4660/37963 [10:30:06<70:46:17,  7.65s/it]
                                                          
{'loss': '0.198', 'grad_norm': '1.234', 'learning_rate': '1.955e-05', 'epoch': '0.1228'}
+
 12%|█▏        | 4660/37963 [10:30:06<70:46:17,  7.65s/it]
 12%|█▏        | 4661/37963 [10:30:13<70:54:07,  7.66s/it]
 12%|█▏        | 4662/37963 [10:30:21<71:31:26,  7.73s/it]
 12%|█▏        | 4663/37963 [10:30:29<71:06:31,  7.69s/it]
 12%|█▏        | 4664/37963 [10:30:37<71:35:48,  7.74s/it]
 12%|█▏        | 4665/37963 [10:30:47<78:25:37,  8.48s/it]
 12%|█▏        | 4666/37963 [10:30:54<75:39:06,  8.18s/it]
 12%|█▏        | 4667/37963 [10:31:02<73:59:32,  8.00s/it]
 12%|█▏        | 4668/37963 [10:31:09<73:02:16,  7.90s/it]
 12%|█▏        | 4669/37963 [10:31:17<72:10:43,  7.80s/it]
 12%|█▏        | 4670/37963 [10:31:25<71:24:49,  7.72s/it]
                                                          
{'loss': '0.1865', 'grad_norm': '1.691', 'learning_rate': '1.955e-05', 'epoch': '0.123'}
+
 12%|█▏        | 4670/37963 [10:31:25<71:24:49,  7.72s/it]
 12%|█▏        | 4671/37963 [10:31:35<78:31:58,  8.49s/it]
 12%|█▏        | 4672/37963 [10:31:43<77:00:03,  8.33s/it]
 12%|█▏        | 4673/37963 [10:31:50<75:00:50,  8.11s/it]
 12%|█▏        | 4674/37963 [10:31:58<73:53:27,  7.99s/it]
 12%|█▏        | 4675/37963 [10:32:06<72:59:24,  7.89s/it]
 12%|█▏        | 4676/37963 [10:32:14<72:35:04,  7.85s/it]
 12%|█▏        | 4677/37963 [10:32:24<79:26:49,  8.59s/it]
 12%|█▏        | 4678/37963 [10:32:32<77:13:21,  8.35s/it]
 12%|█▏        | 4679/37963 [10:32:45<89:52:33,  9.72s/it]
 12%|█▏        | 4680/37963 [10:32:53<84:54:38,  9.18s/it]
                                                          
{'loss': '0.1735', 'grad_norm': '7.091', 'learning_rate': '1.955e-05', 'epoch': '0.1233'}
+
 12%|█▏        | 4680/37963 [10:32:53<84:54:38,  9.18s/it]
 12%|█▏        | 4681/37963 [10:33:00<80:31:29,  8.71s/it]
 12%|█▏        | 4682/37963 [10:33:08<77:58:09,  8.43s/it]
 12%|█▏        | 4683/37963 [10:33:16<75:36:43,  8.18s/it]
 12%|█▏        | 4684/37963 [10:33:25<80:36:58,  8.72s/it]
 12%|█▏        | 4685/37963 [10:33:33<77:51:03,  8.42s/it]
 12%|█▏        | 4686/37963 [10:33:41<75:19:10,  8.15s/it]
 12%|█▏        | 4687/37963 [10:33:48<73:06:33,  7.91s/it]
 12%|█▏        | 4688/37963 [10:33:56<72:20:39,  7.83s/it]
 12%|█▏        | 4689/37963 [10:34:03<71:23:23,  7.72s/it]
 12%|█▏        | 4690/37963 [10:34:11<71:13:35,  7.71s/it]
                                                          
{'loss': '0.173', 'grad_norm': '1.848', 'learning_rate': '1.954e-05', 'epoch': '0.1235'}
+
 12%|█▏        | 4690/37963 [10:34:11<71:13:35,  7.71s/it]
 12%|█▏        | 4691/37963 [10:34:19<71:22:42,  7.72s/it]
 12%|█▏        | 4692/37963 [10:34:26<70:45:49,  7.66s/it]
 12%|█▏        | 4693/37963 [10:34:34<70:52:20,  7.67s/it]
 12%|█▏        | 4694/37963 [10:34:41<70:20:18,  7.61s/it]
 12%|█▏        | 4695/37963 [10:34:51<77:28:09,  8.38s/it]
 12%|█▏        | 4696/37963 [10:35:01<81:55:09,  8.86s/it]
 12%|█▏        | 4697/37963 [10:35:09<78:52:51,  8.54s/it]
 12%|█▏        | 4698/37963 [10:35:17<75:42:23,  8.19s/it]
 12%|█▏        | 4699/37963 [10:35:24<73:45:43,  7.98s/it]
 12%|█▏        | 4700/37963 [10:35:32<73:28:00,  7.95s/it]
                                                          
{'loss': '0.1644', 'grad_norm': '2.073', 'learning_rate': '1.954e-05', 'epoch': '0.1238'}
+
 12%|█▏        | 4700/37963 [10:35:32<73:28:00,  7.95s/it]
 12%|█▏        | 4701/37963 [10:35:39<72:05:57,  7.80s/it]
 12%|█▏        | 4702/37963 [10:35:47<71:12:44,  7.71s/it]
 12%|█▏        | 4703/37963 [10:35:54<70:26:12,  7.62s/it]
 12%|█▏        | 4704/37963 [10:36:02<70:41:15,  7.65s/it]
 12%|█▏        | 4705/37963 [10:36:10<71:02:48,  7.69s/it]
 12%|█▏        | 4706/37963 [10:36:17<70:06:15,  7.59s/it]
 12%|█▏        | 4707/37963 [10:36:25<70:33:34,  7.64s/it]
 12%|█▏        | 4708/37963 [10:36:33<70:36:43,  7.64s/it]
 12%|█▏        | 4709/37963 [10:36:40<70:47:41,  7.66s/it]
 12%|█▏        | 4710/37963 [10:36:51<78:16:45,  8.47s/it]
                                                          
{'loss': '0.1852', 'grad_norm': '2.209', 'learning_rate': '1.954e-05', 'epoch': '0.1241'}
+
 12%|█▏        | 4710/37963 [10:36:51<78:16:45,  8.47s/it]
 12%|█▏        | 4711/37963 [10:36:58<76:05:08,  8.24s/it]
 12%|█▏        | 4712/37963 [10:37:06<74:01:41,  8.01s/it]
 12%|█▏        | 4713/37963 [10:37:14<73:27:48,  7.95s/it]
 12%|█▏        | 4714/37963 [10:37:21<71:54:20,  7.79s/it]
 12%|█▏        | 4715/37963 [10:37:29<71:11:22,  7.71s/it]
 12%|█▏        | 4716/37963 [10:37:36<70:53:05,  7.68s/it]
 12%|█▏        | 4717/37963 [10:37:44<70:41:02,  7.65s/it]
 12%|█▏        | 4718/37963 [10:37:51<70:06:45,  7.59s/it]
 12%|█▏        | 4719/37963 [10:38:02<77:44:58,  8.42s/it]
 12%|█▏        | 4720/37963 [10:38:09<75:27:03,  8.17s/it]
                                                          
{'loss': '0.1891', 'grad_norm': '3.572', 'learning_rate': '1.954e-05', 'epoch': '0.1243'}
+
 12%|█▏        | 4720/37963 [10:38:09<75:27:03,  8.17s/it]
 12%|█▏        | 4721/37963 [10:38:17<73:43:48,  7.98s/it]
 12%|█▏        | 4722/37963 [10:38:24<72:26:18,  7.85s/it]
 12%|█▏        | 4723/37963 [10:38:32<71:30:55,  7.75s/it]
 12%|█▏        | 4724/37963 [10:38:39<70:51:34,  7.67s/it]
 12%|█▏        | 4725/37963 [10:38:50<78:36:18,  8.51s/it]
 12%|█▏        | 4726/37963 [10:38:58<76:33:26,  8.29s/it]
 12%|█▏        | 4727/37963 [10:39:11<89:55:07,  9.74s/it]
 12%|█▏        | 4728/37963 [10:39:18<84:13:04,  9.12s/it]
 12%|█▏        | 4729/37963 [10:39:26<79:37:08,  8.62s/it]
 12%|█▏        | 4730/37963 [10:39:33<76:39:39,  8.30s/it]
                                                          
{'loss': '0.1961', 'grad_norm': '4.74', 'learning_rate': '1.953e-05', 'epoch': '0.1246'}
+
 12%|█▏        | 4730/37963 [10:39:33<76:39:39,  8.30s/it]
 12%|█▏        | 4731/37963 [10:39:41<74:34:49,  8.08s/it]
 12%|█▏        | 4732/37963 [10:39:49<74:22:49,  8.06s/it]
 12%|█▏        | 4733/37963 [10:39:57<73:34:59,  7.97s/it]
 12%|█▏        | 4734/37963 [10:40:04<72:46:59,  7.89s/it]
 12%|█▏        | 4735/37963 [10:40:12<71:57:21,  7.80s/it]
 12%|█▏        | 4736/37963 [10:40:19<70:41:41,  7.66s/it]
 12%|█▏        | 4737/37963 [10:40:27<70:15:18,  7.61s/it]
 12%|█▏        | 4738/37963 [10:40:37<76:51:08,  8.33s/it]
 12%|█▏        | 4739/37963 [10:40:45<75:33:36,  8.19s/it]
 12%|█▏        | 4740/37963 [10:40:52<74:10:13,  8.04s/it]
                                                          
{'loss': '0.1926', 'grad_norm': '1.808', 'learning_rate': '1.953e-05', 'epoch': '0.1249'}
+
 12%|█▏        | 4740/37963 [10:40:52<74:10:13,  8.04s/it]
 12%|█▏        | 4741/37963 [10:41:02<79:39:48,  8.63s/it]
 12%|█▏        | 4742/37963 [10:41:10<76:08:40,  8.25s/it]
 12%|█▏        | 4743/37963 [10:41:20<81:16:44,  8.81s/it]
 12%|█▏        | 4744/37963 [10:41:28<78:36:58,  8.52s/it]
 12%|█▏        | 4745/37963 [10:41:35<76:32:48,  8.30s/it]
 13%|█▎        | 4746/37963 [10:41:43<74:25:35,  8.07s/it]
 13%|█▎        | 4747/37963 [10:41:50<72:34:45,  7.87s/it]
 13%|█▎        | 4748/37963 [10:41:58<71:30:54,  7.75s/it]
 13%|█▎        | 4749/37963 [10:42:05<70:25:39,  7.63s/it]
 13%|█▎        | 4750/37963 [10:42:13<70:26:36,  7.64s/it]
                                                          
{'loss': '0.1951', 'grad_norm': '3.04', 'learning_rate': '1.953e-05', 'epoch': '0.1251'}
+
 13%|█▎        | 4750/37963 [10:42:13<70:26:36,  7.64s/it]
 13%|█▎        | 4751/37963 [10:42:21<71:09:22,  7.71s/it]
 13%|█▎        | 4752/37963 [10:42:28<70:54:04,  7.69s/it]
 13%|█▎        | 4753/37963 [10:42:39<77:47:40,  8.43s/it]
 13%|█▎        | 4754/37963 [10:42:46<75:06:10,  8.14s/it]
 13%|█▎        | 4755/37963 [10:42:54<73:26:06,  7.96s/it]
 13%|█▎        | 4756/37963 [10:43:01<72:06:37,  7.82s/it]
 13%|█▎        | 4757/37963 [10:43:09<72:07:20,  7.82s/it]
 13%|█▎        | 4758/37963 [10:43:17<71:48:45,  7.79s/it]
 13%|█▎        | 4759/37963 [10:43:24<71:08:41,  7.71s/it]
 13%|█▎        | 4760/37963 [10:43:32<70:42:46,  7.67s/it]
                                                          
{'loss': '0.1682', 'grad_norm': '4.393', 'learning_rate': '1.953e-05', 'epoch': '0.1254'}
+
 13%|█���        | 4760/37963 [10:43:32<70:42:46,  7.67s/it]
 13%|█▎        | 4761/37963 [10:43:39<70:25:54,  7.64s/it]
 13%|█▎        | 4762/37963 [10:43:49<77:27:38,  8.40s/it]
 13%|█▎        | 4763/37963 [10:43:57<75:26:18,  8.18s/it]
 13%|█▎        | 4764/37963 [10:44:05<73:43:58,  8.00s/it]
 13%|█▎        | 4765/37963 [10:44:12<72:33:07,  7.87s/it]
 13%|█▎        | 4766/37963 [10:44:20<72:44:39,  7.89s/it]
 13%|█▎        | 4767/37963 [10:44:28<72:13:21,  7.83s/it]
 13%|█▎        | 4768/37963 [10:44:36<72:07:28,  7.82s/it]
 13%|█▎        | 4769/37963 [10:44:43<71:15:11,  7.73s/it]
 13%|█▎        | 4770/37963 [10:44:51<71:03:39,  7.71s/it]
                                                          
{'loss': '0.1905', 'grad_norm': '2.146', 'learning_rate': '1.952e-05', 'epoch': '0.1256'}
+
 13%|█▎        | 4770/37963 [10:44:51<71:03:39,  7.71s/it]
 13%|█▎        | 4771/37963 [10:45:01<78:07:22,  8.47s/it]
 13%|█▎        | 4772/37963 [10:45:09<75:46:53,  8.22s/it]
 13%|█▎        | 4773/37963 [10:45:19<81:40:21,  8.86s/it]
 13%|█▎        | 4774/37963 [10:45:27<78:25:03,  8.51s/it]
 13%|█▎        | 4775/37963 [10:45:35<76:39:06,  8.31s/it]
 13%|█▎        | 4776/37963 [10:45:42<73:07:20,  7.93s/it]
 13%|█▎        | 4777/37963 [10:45:49<72:10:40,  7.83s/it]
 13%|█▎        | 4778/37963 [10:45:57<71:07:59,  7.72s/it]
 13%|█▎        | 4779/37963 [10:46:04<70:29:23,  7.65s/it]
 13%|█▎        | 4780/37963 [10:46:12<70:41:03,  7.67s/it]
                                                          
{'loss': '0.1877', 'grad_norm': '2.932', 'learning_rate': '1.952e-05', 'epoch': '0.1259'}
+
 13%|█▎        | 4780/37963 [10:46:12<70:41:03,  7.67s/it]
 13%|█▎        | 4781/37963 [10:46:19<70:21:12,  7.63s/it]
 13%|█▎        | 4782/37963 [10:46:27<69:13:17,  7.51s/it]
 13%|█▎        | 4783/37963 [10:46:34<69:21:38,  7.53s/it]
 13%|█▎        | 4784/37963 [10:46:42<69:17:20,  7.52s/it]
 13%|█▎        | 4785/37963 [10:46:52<76:29:41,  8.30s/it]
 13%|█▎        | 4786/37963 [10:47:02<81:48:00,  8.88s/it]
 13%|█▎        | 4787/37963 [10:47:09<77:06:55,  8.37s/it]
 13%|█▎        | 4788/37963 [10:47:17<74:25:46,  8.08s/it]
 13%|█▎        | 4789/37963 [10:47:24<73:11:11,  7.94s/it]
 13%|█▎        | 4790/37963 [10:47:32<72:32:57,  7.87s/it]
                                                          
{'loss': '0.1895', 'grad_norm': '2.095', 'learning_rate': '1.952e-05', 'epoch': '0.1262'}
+
 13%|█▎        | 4790/37963 [10:47:32<72:32:57,  7.87s/it]
 13%|█▎        | 4791/37963 [10:47:40<71:26:42,  7.75s/it]
 13%|█▎        | 4792/37963 [10:47:47<70:46:12,  7.68s/it]
 13%|█▎        | 4793/37963 [10:47:55<70:32:42,  7.66s/it]
 13%|█▎        | 4794/37963 [10:48:02<70:12:56,  7.62s/it]
 13%|█▎        | 4795/37963 [10:48:10<70:00:06,  7.60s/it]
 13%|█▎        | 4796/37963 [10:48:20<77:23:49,  8.40s/it]
 13%|█▎        | 4797/37963 [10:48:28<75:19:40,  8.18s/it]
 13%|█▎        | 4798/37963 [10:48:35<73:45:25,  8.01s/it]
 13%|█▎        | 4799/37963 [10:48:43<72:30:09,  7.87s/it]
 13%|█▎        | 4800/37963 [10:48:51<72:40:20,  7.89s/it]
                                                          
{'loss': '0.1768', 'grad_norm': '1.532', 'learning_rate': '1.952e-05', 'epoch': '0.1264'}
+
 13%|█▎        | 4800/37963 [10:48:51<72:40:20,  7.89s/it]
 13%|█▎        | 4801/37963 [10:48:58<71:24:48,  7.75s/it]
 13%|█▎        | 4802/37963 [10:49:08<77:58:37,  8.47s/it]
 13%|█▎        | 4803/37963 [10:49:16<75:43:45,  8.22s/it]
 13%|█▎        | 4804/37963 [10:49:24<74:12:18,  8.06s/it]
 13%|█▎        | 4805/37963 [10:49:31<73:11:32,  7.95s/it]
 13%|█▎        | 4806/37963 [10:49:39<72:20:54,  7.86s/it]
 13%|█▎        | 4807/37963 [10:49:47<71:46:36,  7.79s/it]
 13%|█▎        | 4808/37963 [10:49:54<70:57:01,  7.70s/it]
 13%|█▎        | 4809/37963 [10:50:02<70:37:38,  7.67s/it]
 13%|█▎        | 4810/37963 [10:50:09<69:43:19,  7.57s/it]
                                                          
{'loss': '0.1741', 'grad_norm': '1.129', 'learning_rate': '1.951e-05', 'epoch': '0.1267'}
+
 13%|█▎        | 4810/37963 [10:50:09<69:43:19,  7.57s/it]
 13%|█▎        | 4811/37963 [10:50:16<69:22:31,  7.53s/it]
 13%|█▎        | 4812/37963 [10:50:24<69:24:01,  7.54s/it]
 13%|█▎        | 4813/37963 [10:50:32<69:44:49,  7.57s/it]
 13%|█▎        | 4814/37963 [10:50:39<69:52:48,  7.59s/it]
 13%|█▎        | 4815/37963 [10:50:49<77:03:40,  8.37s/it]
 13%|█▎        | 4816/37963 [10:51:00<82:15:33,  8.93s/it]
 13%|█▎        | 4817/37963 [10:51:08<79:09:31,  8.60s/it]
 13%|█▎        | 4818/37963 [10:51:15<76:18:18,  8.29s/it]
 13%|█▎        | 4819/37963 [10:51:23<74:03:36,  8.04s/it]
 13%|█▎        | 4820/37963 [10:51:30<72:48:02,  7.91s/it]
                                                          
{'loss': '0.2002', 'grad_norm': '2.374', 'learning_rate': '1.951e-05', 'epoch': '0.127'}
+
 13%|█▎        | 4820/37963 [10:51:30<72:48:02,  7.91s/it]
 13%|█▎        | 4821/37963 [10:51:38<72:38:53,  7.89s/it]
 13%|█▎        | 4822/37963 [10:51:46<72:22:38,  7.86s/it]
 13%|█▎        | 4823/37963 [10:51:54<72:38:11,  7.89s/it]
 13%|█▎        | 4824/37963 [10:52:02<72:27:54,  7.87s/it]
 13%|█▎        | 4825/37963 [10:52:09<70:58:17,  7.71s/it]
 13%|█▎        | 4826/37963 [10:52:17<70:37:54,  7.67s/it]
 13%|█▎        | 4827/37963 [10:52:29<83:24:39,  9.06s/it]
 13%|█▎        | 4828/37963 [10:52:39<86:43:35,  9.42s/it]
 13%|█▎        | 4829/37963 [10:52:47<81:49:43,  8.89s/it]
 13%|█▎        | 4830/37963 [10:52:55<78:50:22,  8.57s/it]
                                                          
{'loss': '0.1702', 'grad_norm': '2.498', 'learning_rate': '1.951e-05', 'epoch': '0.1272'}
+
 13%|█▎        | 4830/37963 [10:52:55<78:50:22,  8.57s/it]
 13%|█▎        | 4831/37963 [10:53:02<76:27:51,  8.31s/it]
 13%|█▎        | 4832/37963 [10:53:10<74:34:05,  8.10s/it]
 13%|█▎        | 4833/37963 [10:53:18<73:53:53,  8.03s/it]
 13%|█▎        | 4834/37963 [10:53:25<72:10:16,  7.84s/it]
 13%|█▎        | 4835/37963 [10:53:35<77:57:03,  8.47s/it]
 13%|█▎        | 4836/37963 [10:53:43<75:04:29,  8.16s/it]
 13%|█▎        | 4837/37963 [10:53:50<73:27:20,  7.98s/it]
 13%|█▎        | 4838/37963 [10:53:58<72:15:05,  7.85s/it]
 13%|█▎        | 4839/37963 [10:54:05<70:42:38,  7.69s/it]
 13%|█▎        | 4840/37963 [10:54:15<77:30:48,  8.42s/it]
                                                          
{'loss': '0.1774', 'grad_norm': '1.165', 'learning_rate': '1.951e-05', 'epoch': '0.1275'}
+
 13%|█▎        | 4840/37963 [10:54:15<77:30:48,  8.42s/it]
 13%|█▎        | 4841/37963 [10:54:23<75:24:41,  8.20s/it]
 13%|█▎        | 4842/37963 [10:54:31<74:51:42,  8.14s/it]
 13%|█▎        | 4843/37963 [10:54:38<73:35:04,  8.00s/it]
 13%|█▎        | 4844/37963 [10:54:46<71:59:09,  7.82s/it]
 13%|█▎        | 4845/37963 [10:54:53<71:04:31,  7.73s/it]
 13%|█▎        | 4846/37963 [10:55:03<77:10:20,  8.39s/it]
 13%|█▎        | 4847/37963 [10:55:11<74:32:45,  8.10s/it]
 13%|█▎        | 4848/37963 [10:55:18<72:48:28,  7.92s/it]
 13%|█▎        | 4849/37963 [10:55:26<71:47:46,  7.81s/it]
 13%|█▎        | 4850/37963 [10:55:33<71:08:40,  7.73s/it]
                                                          
{'loss': '0.1855', 'grad_norm': '1.617', 'learning_rate': '1.95e-05', 'epoch': '0.1278'}
+
 13%|█▎        | 4850/37963 [10:55:33<71:08:40,  7.73s/it]
 13%|█▎        | 4851/37963 [10:55:41<71:14:14,  7.75s/it]
 13%|█▎        | 4852/37963 [10:55:49<71:01:16,  7.72s/it]
 13%|█▎        | 4853/37963 [10:55:56<70:43:22,  7.69s/it]
 13%|█▎        | 4854/37963 [10:56:04<71:29:07,  7.77s/it]
 13%|█▎        | 4855/37963 [10:56:12<71:47:54,  7.81s/it]
 13%|█▎        | 4856/37963 [10:56:20<72:22:35,  7.87s/it]
 13%|█▎        | 4857/37963 [10:56:28<71:56:39,  7.82s/it]
 13%|█▎        | 4858/37963 [10:56:36<71:59:21,  7.83s/it]
 13%|█▎        | 4859/37963 [10:56:43<71:38:37,  7.79s/it]
 13%|█▎        | 4860/37963 [10:56:51<71:28:25,  7.77s/it]
                                                          
{'loss': '0.1729', 'grad_norm': '3.264', 'learning_rate': '1.95e-05', 'epoch': '0.128'}
+
 13%|█▎        | 4860/37963 [10:56:51<71:28:25,  7.77s/it]
 13%|█▎        | 4861/37963 [10:56:59<71:58:43,  7.83s/it]
 13%|█▎        | 4862/37963 [10:57:07<71:40:00,  7.79s/it]
 13%|█▎        | 4863/37963 [10:57:17<78:00:44,  8.48s/it]
 13%|█▎        | 4864/37963 [10:57:25<75:45:09,  8.24s/it]
 13%|█▎        | 4865/37963 [10:57:32<74:35:20,  8.11s/it]
 13%|█▎        | 4866/37963 [10:57:40<73:17:37,  7.97s/it]
 13%|█▎        | 4867/37963 [10:57:48<72:12:48,  7.85s/it]
 13%|█▎        | 4868/37963 [10:57:55<71:18:43,  7.76s/it]
 13%|█▎        | 4869/37963 [10:58:03<71:40:52,  7.80s/it]
 13%|█▎        | 4870/37963 [10:58:11<71:46:21,  7.81s/it]
                                                          
{'loss': '0.1861', 'grad_norm': '1.444', 'learning_rate': '1.95e-05', 'epoch': '0.1283'}
+
 13%|█▎        | 4870/37963 [10:58:11<71:46:21,  7.81s/it]
 13%|█▎        | 4871/37963 [10:58:21<78:57:03,  8.59s/it]
 13%|█▎        | 4872/37963 [10:58:29<77:05:46,  8.39s/it]
 13%|█▎        | 4873/37963 [10:58:37<75:41:37,  8.24s/it]
 13%|█▎        | 4874/37963 [10:58:45<73:51:18,  8.04s/it]
 13%|█▎        | 4875/37963 [10:58:52<72:14:05,  7.86s/it]
 13%|█▎        | 4876/37963 [10:59:04<81:56:55,  8.92s/it]
 13%|█▎        | 4877/37963 [10:59:14<86:05:25,  9.37s/it]
 13%|█▎        | 4878/37963 [10:59:22<81:58:54,  8.92s/it]
 13%|█▎        | 4879/37963 [10:59:30<78:42:09,  8.56s/it]
 13%|█▎        | 4880/37963 [10:59:37<76:19:50,  8.31s/it]
                                                          
{'loss': '0.172', 'grad_norm': '5.041', 'learning_rate': '1.95e-05', 'epoch': '0.1285'}
+
 13%|█▎        | 4880/37963 [10:59:37<76:19:50,  8.31s/it]
 13%|█▎        | 4881/37963 [10:59:45<75:26:46,  8.21s/it]
 13%|█▎        | 4882/37963 [10:59:55<80:47:45,  8.79s/it]
 13%|█▎        | 4883/37963 [11:00:05<83:57:18,  9.14s/it]
 13%|█▎        | 4884/37963 [11:00:13<79:41:30,  8.67s/it]
 13%|█▎        | 4885/37963 [11:00:21<76:42:41,  8.35s/it]
 13%|█▎        | 4886/37963 [11:00:28<74:28:46,  8.11s/it]
 13%|█▎        | 4887/37963 [11:00:36<73:24:43,  7.99s/it]
 13%|█▎        | 4888/37963 [11:00:43<71:50:36,  7.82s/it]
 13%|█▎        | 4889/37963 [11:00:53<77:34:11,  8.44s/it]
 13%|█▎        | 4890/37963 [11:01:01<75:26:58,  8.21s/it]
                                                          
{'loss': '0.1967', 'grad_norm': '2.036', 'learning_rate': '1.949e-05', 'epoch': '0.1288'}
+
 13%|█▎        | 4890/37963 [11:01:01<75:26:58,  8.21s/it]
 13%|█▎        | 4891/37963 [11:01:08<73:58:12,  8.05s/it]
 13%|█▎        | 4892/37963 [11:01:16<73:00:06,  7.95s/it]
 13%|█▎        | 4893/37963 [11:01:24<72:05:11,  7.85s/it]
 13%|█▎        | 4894/37963 [11:01:31<71:15:15,  7.76s/it]
 13%|█▎        | 4895/37963 [11:01:39<71:04:20,  7.74s/it]
 13%|█▎        | 4896/37963 [11:01:47<70:53:59,  7.72s/it]
 13%|█▎        | 4897/37963 [11:01:55<71:12:59,  7.75s/it]
 13%|█▎        | 4898/37963 [11:02:02<70:36:02,  7.69s/it]
 13%|█▎        | 4899/37963 [11:02:10<70:38:07,  7.69s/it]
 13%|█▎        | 4900/37963 [11:02:17<70:35:09,  7.69s/it]
                                                          
{'loss': '0.1849', 'grad_norm': '3.914', 'learning_rate': '1.949e-05', 'epoch': '0.1291'}
+
 13%|█▎        | 4900/37963 [11:02:17<70:35:09,  7.69s/it]
 13%|█▎        | 4901/37963 [11:02:25<69:56:56,  7.62s/it]
 13%|█▎        | 4902/37963 [11:02:33<70:00:45,  7.62s/it]
 13%|█▎        | 4903/37963 [11:02:40<70:07:18,  7.64s/it]
 13%|█▎        | 4904/37963 [11:02:48<70:08:46,  7.64s/it]
 13%|█▎        | 4905/37963 [11:02:56<70:27:22,  7.67s/it]
 13%|█▎        | 4906/37963 [11:03:03<70:52:50,  7.72s/it]
 13%|█▎        | 4907/37963 [11:03:11<70:44:11,  7.70s/it]
 13%|█▎        | 4908/37963 [11:03:19<70:41:09,  7.70s/it]
 13%|█▎        | 4909/37963 [11:03:27<71:02:09,  7.74s/it]
 13%|█▎        | 4910/37963 [11:03:34<70:05:50,  7.63s/it]
                                                          
{'loss': '0.178', 'grad_norm': '6.425', 'learning_rate': '1.949e-05', 'epoch': '0.1293'}
+
 13%|█▎        | 4910/37963 [11:03:34<70:05:50,  7.63s/it]
 13%|█▎        | 4911/37963 [11:03:42<70:05:28,  7.63s/it]
 13%|█▎        | 4912/37963 [11:03:49<70:35:28,  7.69s/it]
 13%|█▎        | 4913/37963 [11:03:57<70:35:38,  7.69s/it]
 13%|█▎        | 4914/37963 [11:04:08<78:03:48,  8.50s/it]
 13%|█▎        | 4915/37963 [11:04:15<76:03:06,  8.28s/it]
 13%|█▎        | 4916/37963 [11:04:23<74:26:14,  8.11s/it]
 13%|█▎        | 4917/37963 [11:04:31<73:41:01,  8.03s/it]
 13%|█▎        | 4918/37963 [11:04:39<72:38:19,  7.91s/it]
 13%|█▎        | 4919/37963 [11:04:49<79:40:15,  8.68s/it]
 13%|█▎        | 4920/37963 [11:04:59<84:24:32,  9.20s/it]
                                                          
{'loss': '0.1852', 'grad_norm': '5.477', 'learning_rate': '1.948e-05', 'epoch': '0.1296'}
+
 13%|█▎        | 4920/37963 [11:04:59<84:24:32,  9.20s/it]
 13%|█▎        | 4921/37963 [11:05:07<79:10:08,  8.63s/it]
 13%|█▎        | 4922/37963 [11:05:14<76:43:10,  8.36s/it]
 13%|█▎        | 4923/37963 [11:05:22<74:44:09,  8.14s/it]
 13%|█▎        | 4924/37963 [11:05:30<74:05:09,  8.07s/it]
 13%|█▎        | 4925/37963 [11:05:40<80:23:22,  8.76s/it]
 13%|█▎        | 4926/37963 [11:05:51<85:16:09,  9.29s/it]
 13%|█▎        | 4927/37963 [11:06:01<88:57:51,  9.69s/it]
 13%|█▎        | 4928/37963 [11:06:09<84:12:50,  9.18s/it]
 13%|█▎        | 4929/37963 [11:06:20<87:26:06,  9.53s/it]
 13%|█▎        | 4930/37963 [11:06:27<81:57:34,  8.93s/it]
                                                          
{'loss': '0.181', 'grad_norm': '6.762', 'learning_rate': '1.948e-05', 'epoch': '0.1299'}
+
 13%|█▎        | 4930/37963 [11:06:27<81:57:34,  8.93s/it]
 13%|█▎        | 4931/37963 [11:06:35<78:44:21,  8.58s/it]
 13%|█▎        | 4932/37963 [11:06:43<76:40:03,  8.36s/it]
 13%|█▎        | 4933/37963 [11:06:53<82:09:41,  8.95s/it]
 13%|█▎        | 4934/37963 [11:07:01<77:59:56,  8.50s/it]
 13%|█▎        | 4935/37963 [11:07:08<75:35:19,  8.24s/it]
 13%|█▎        | 4936/37963 [11:07:16<74:09:01,  8.08s/it]
 13%|█▎        | 4937/37963 [11:07:24<72:47:16,  7.93s/it]
 13%|█▎        | 4938/37963 [11:07:31<71:58:48,  7.85s/it]
 13%|█▎        | 4939/37963 [11:07:39<71:45:29,  7.82s/it]
 13%|█▎        | 4940/37963 [11:07:47<71:18:12,  7.77s/it]
                                                          
{'loss': '0.1738', 'grad_norm': '2.412', 'learning_rate': '1.948e-05', 'epoch': '0.1301'}
+
 13%|█▎        | 4940/37963 [11:07:47<71:18:12,  7.77s/it]
 13%|█▎        | 4941/37963 [11:07:54<70:47:16,  7.72s/it]
 13%|█▎        | 4942/37963 [11:08:02<70:55:52,  7.73s/it]
 13%|█▎        | 4943/37963 [11:08:10<71:16:17,  7.77s/it]
 13%|█▎        | 4944/37963 [11:08:18<71:24:57,  7.79s/it]
 13%|█▎        | 4945/37963 [11:08:25<70:56:20,  7.73s/it]
 13%|█▎        | 4946/37963 [11:08:33<71:25:53,  7.79s/it]
 13%|█▎        | 4947/37963 [11:08:41<71:25:25,  7.79s/it]
 13%|█▎        | 4948/37963 [11:08:49<71:44:14,  7.82s/it]
 13%|█▎        | 4949/37963 [11:08:57<71:18:30,  7.78s/it]
 13%|█▎        | 4950/37963 [11:09:05<71:35:41,  7.81s/it]
                                                          
{'loss': '0.1815', 'grad_norm': '1.135', 'learning_rate': '1.948e-05', 'epoch': '0.1304'}
+
 13%|█▎        | 4950/37963 [11:09:05<71:35:41,  7.81s/it]
 13%|█▎        | 4951/37963 [11:09:12<71:20:30,  7.78s/it]
 13%|█▎        | 4952/37963 [11:09:20<71:12:55,  7.77s/it]
 13%|█▎        | 4953/37963 [11:09:28<70:53:43,  7.73s/it]
 13%|█▎        | 4954/37963 [11:09:35<70:38:36,  7.70s/it]
 13%|█▎        | 4955/37963 [11:09:43<70:17:57,  7.67s/it]
 13%|█▎        | 4956/37963 [11:09:50<70:06:16,  7.65s/it]
 13%|█▎        | 4957/37963 [11:09:58<70:53:27,  7.73s/it]
 13%|█▎        | 4958/37963 [11:10:09<77:51:15,  8.49s/it]
 13%|█▎        | 4959/37963 [11:10:16<75:39:51,  8.25s/it]
 13%|█▎        | 4960/37963 [11:10:24<73:54:50,  8.06s/it]
                                                          
{'loss': '0.1907', 'grad_norm': '1.728', 'learning_rate': '1.947e-05', 'epoch': '0.1307'}
+
 13%|█▎        | 4960/37963 [11:10:24<73:54:50,  8.06s/it]
 13%|█▎        | 4961/37963 [11:10:32<72:40:34,  7.93s/it]
 13%|█▎        | 4962/37963 [11:10:39<72:05:49,  7.86s/it]
 13%|█▎        | 4963/37963 [11:10:49<77:57:07,  8.50s/it]
 13%|█▎        | 4964/37963 [11:10:59<82:20:00,  8.98s/it]
 13%|█▎        | 4965/37963 [11:11:07<79:22:27,  8.66s/it]
 13%|█▎        | 4966/37963 [11:11:15<77:05:26,  8.41s/it]
 13%|█▎        | 4967/37963 [11:11:23<74:25:34,  8.12s/it]
 13%|█▎        | 4968/37963 [11:11:30<72:58:10,  7.96s/it]
 13%|█▎        | 4969/37963 [11:11:38<72:05:38,  7.87s/it]
 13%|█▎        | 4970/37963 [11:11:46<72:24:07,  7.90s/it]
                                                          
{'loss': '0.1863', 'grad_norm': '5.192', 'learning_rate': '1.947e-05', 'epoch': '0.1309'}
+
 13%|█▎        | 4970/37963 [11:11:46<72:24:07,  7.90s/it]
 13%|█▎        | 4971/37963 [11:11:53<71:29:17,  7.80s/it]
 13%|█▎        | 4972/37963 [11:12:01<71:20:17,  7.78s/it]
 13%|█▎        | 4973/37963 [11:12:11<77:53:12,  8.50s/it]
 13%|█▎        | 4974/37963 [11:12:19<75:59:55,  8.29s/it]
 13%|█▎        | 4975/37963 [11:12:27<74:05:40,  8.09s/it]
 13%|█▎        | 4976/37963 [11:12:34<72:49:35,  7.95s/it]
 13%|█▎        | 4977/37963 [11:12:42<71:59:46,  7.86s/it]
 13%|█▎        | 4978/37963 [11:12:49<70:25:05,  7.69s/it]
 13%|█▎        | 4979/37963 [11:12:59<77:17:51,  8.44s/it]
 13%|█▎        | 4980/37963 [11:13:09<81:12:58,  8.86s/it]
                                                          
{'loss': '0.1924', 'grad_norm': '2.701', 'learning_rate': '1.947e-05', 'epoch': '0.1312'}
+
 13%|█▎        | 4980/37963 [11:13:09<81:12:58,  8.86s/it]
 13%|█▎        | 4981/37963 [11:13:20<85:17:26,  9.31s/it]
 13%|█▎        | 4982/37963 [11:13:27<80:27:02,  8.78s/it]
 13%|█▎        | 4983/37963 [11:13:37<84:35:10,  9.23s/it]
 13%|█▎        | 4984/37963 [11:13:45<80:12:01,  8.75s/it]
 13%|█▎        | 4985/37963 [11:13:53<77:42:43,  8.48s/it]
 13%|█▎        | 4986/37963 [11:14:00<74:52:14,  8.17s/it]
 13%|█▎        | 4987/37963 [11:14:08<72:59:35,  7.97s/it]
 13%|█▎        | 4988/37963 [11:14:16<72:31:02,  7.92s/it]
 13%|█▎        | 4989/37963 [11:14:24<72:15:23,  7.89s/it]
 13%|█▎        | 4990/37963 [11:14:31<71:46:09,  7.84s/it]
                                                          
{'loss': '0.1715', 'grad_norm': '4.05', 'learning_rate': '1.947e-05', 'epoch': '0.1314'}
+
 13%|█▎        | 4990/37963 [11:14:31<71:46:09,  7.84s/it]
 13%|█▎        | 4991/37963 [11:14:39<70:56:15,  7.75s/it]
 13%|█▎        | 4992/37963 [11:14:46<70:25:44,  7.69s/it]
 13%|█▎        | 4993/37963 [11:14:54<70:19:12,  7.68s/it]
 13%|█▎        | 4994/37963 [11:15:01<69:31:56,  7.59s/it]
 13%|█▎        | 4995/37963 [11:15:09<70:10:56,  7.66s/it]
 13%|█▎        | 4996/37963 [11:15:17<69:46:13,  7.62s/it]
 13%|█▎        | 4997/37963 [11:15:24<69:46:00,  7.62s/it]
 13%|█▎        | 4998/37963 [11:15:32<69:48:40,  7.62s/it]
 13%|█▎        | 4999/37963 [11:15:40<70:46:49,  7.73s/it]
 13%|█▎        | 5000/37963 [11:15:48<70:36:38,  7.71s/it]
                                                          
{'loss': '0.1843', 'grad_norm': '1.417', 'learning_rate': '1.946e-05', 'epoch': '0.1317'}
+
 13%|█▎        | 5000/37963 [11:15:48<70:36:38,  7.71s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.54s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.54s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 13%|█▎        | 5001/37963 [11:16:51<222:45:37, 24.33s/it]
 13%|█▎        | 5002/37963 [11:16:59<177:40:48, 19.41s/it]
 13%|█▎        | 5003/37963 [11:17:09<152:38:26, 16.67s/it]
 13%|█▎        | 5004/37963 [11:17:17<128:51:31, 14.07s/it]
 13%|█▎        | 5005/37963 [11:17:24<110:48:08, 12.10s/it]
 13%|█▎        | 5006/37963 [11:17:32<98:14:43, 10.73s/it] 
 13%|█▎        | 5007/37963 [11:17:40<89:52:24,  9.82s/it]
 13%|█▎        | 5008/37963 [11:17:47<84:01:34,  9.18s/it]
 13%|█▎        | 5009/37963 [11:17:55<80:06:15,  8.75s/it]
 13%|█▎        | 5010/37963 [11:18:05<84:14:35,  9.20s/it]
                                                          
{'loss': '0.1767', 'grad_norm': '3.235', 'learning_rate': '1.946e-05', 'epoch': '0.132'}
+
 13%|█▎        | 5010/37963 [11:18:05<84:14:35,  9.20s/it]
 13%|█▎        | 5011/37963 [11:18:16<87:32:21,  9.56s/it]
 13%|█▎        | 5012/37963 [11:18:24<82:58:35,  9.07s/it]
 13%|█▎        | 5013/37963 [11:18:31<79:02:08,  8.64s/it]
 13%|█▎        | 5014/37963 [11:18:39<76:16:44,  8.33s/it]
 13%|█▎        | 5015/37963 [11:18:46<73:37:56,  8.05s/it]
 13%|█▎        | 5016/37963 [11:18:54<72:25:58,  7.91s/it]
 13%|█▎        | 5017/37963 [11:19:02<71:39:41,  7.83s/it]
 13%|█▎        | 5018/37963 [11:19:09<70:18:46,  7.68s/it]
 13%|█▎        | 5019/37963 [11:19:17<70:26:49,  7.70s/it]
 13%|█▎        | 5020/37963 [11:19:24<70:47:58,  7.74s/it]
                                                          
{'loss': '0.1657', 'grad_norm': '2.032', 'learning_rate': '1.946e-05', 'epoch': '0.1322'}
+
 13%|█▎        | 5020/37963 [11:19:24<70:47:58,  7.74s/it]
 13%|█▎        | 5021/37963 [11:19:32<70:40:52,  7.72s/it]
 13%|█▎        | 5022/37963 [11:19:42<77:43:31,  8.49s/it]
 13%|█▎        | 5023/37963 [11:19:50<75:32:26,  8.26s/it]
 13%|█▎        | 5024/37963 [11:19:58<74:16:01,  8.12s/it]
 13%|█▎        | 5025/37963 [11:20:06<72:58:07,  7.98s/it]
 13%|█▎        | 5026/37963 [11:20:13<72:10:40,  7.89s/it]
 13%|█▎        | 5027/37963 [11:20:21<72:03:27,  7.88s/it]
 13%|█▎        | 5028/37963 [11:20:31<78:02:51,  8.53s/it]
 13%|█▎        | 5029/37963 [11:20:39<75:45:36,  8.28s/it]
 13%|█▎        | 5030/37963 [11:20:49<80:19:34,  8.78s/it]
                                                          
{'loss': '0.1816', 'grad_norm': '4.816', 'learning_rate': '1.945e-05', 'epoch': '0.1325'}
+
 13%|█▎        | 5030/37963 [11:20:49<80:19:34,  8.78s/it]
 13%|█▎        | 5031/37963 [11:20:56<76:54:56,  8.41s/it]
 13%|█▎        | 5032/37963 [11:21:04<75:24:55,  8.24s/it]
 13%|█▎        | 5033/37963 [11:21:15<81:03:44,  8.86s/it]
 13%|█▎        | 5034/37963 [11:21:23<78:51:11,  8.62s/it]
 13%|█▎        | 5035/37963 [11:21:30<76:27:38,  8.36s/it]
 13%|█▎        | 5036/37963 [11:21:41<82:35:34,  9.03s/it]
 13%|█▎        | 5037/37963 [11:21:49<79:07:43,  8.65s/it]
 13%|█▎        | 5038/37963 [11:21:57<77:07:51,  8.43s/it]
 13%|█▎        | 5039/37963 [11:22:04<75:26:06,  8.25s/it]
 13%|█▎        | 5040/37963 [11:22:12<72:32:47,  7.93s/it]
                                                          
{'loss': '0.1908', 'grad_norm': '1.712', 'learning_rate': '1.945e-05', 'epoch': '0.1328'}
+
 13%|█▎        | 5040/37963 [11:22:12<72:32:47,  7.93s/it]
 13%|█▎        | 5041/37963 [11:22:19<71:54:48,  7.86s/it]
 13%|█▎        | 5042/37963 [11:22:27<71:23:53,  7.81s/it]
 13%|█▎        | 5043/37963 [11:22:35<70:53:54,  7.75s/it]
 13%|█▎        | 5044/37963 [11:22:42<70:36:48,  7.72s/it]
 13%|█▎        | 5045/37963 [11:22:50<69:20:49,  7.58s/it]
 13%|█▎        | 5046/37963 [11:22:57<68:58:14,  7.54s/it]
 13%|█▎        | 5047/37963 [11:23:05<69:36:53,  7.61s/it]
 13%|█▎        | 5048/37963 [11:23:12<69:32:56,  7.61s/it]
 13%|█▎        | 5049/37963 [11:23:20<69:50:30,  7.64s/it]
 13%|█▎        | 5050/37963 [11:23:28<69:58:53,  7.65s/it]
                                                          
{'loss': '0.193', 'grad_norm': '3.378', 'learning_rate': '1.945e-05', 'epoch': '0.133'}
+
 13%|█▎        | 5050/37963 [11:23:28<69:58:53,  7.65s/it]
 13%|█▎        | 5051/37963 [11:23:36<71:04:27,  7.77s/it]
 13%|█▎        | 5052/37963 [11:23:44<71:02:59,  7.77s/it]
 13%|█▎        | 5053/37963 [11:23:51<71:16:36,  7.80s/it]
 13%|█▎        | 5054/37963 [11:24:02<78:16:16,  8.56s/it]
 13%|█▎        | 5055/37963 [11:24:10<76:15:34,  8.34s/it]
 13%|█▎        | 5056/37963 [11:24:17<73:28:38,  8.04s/it]
 13%|█▎        | 5057/37963 [11:24:27<79:45:51,  8.73s/it]
 13%|█▎        | 5058/37963 [11:24:35<77:26:33,  8.47s/it]
 13%|█▎        | 5059/37963 [11:24:46<83:11:16,  9.10s/it]
 13%|█▎        | 5060/37963 [11:24:53<79:19:33,  8.68s/it]
                                                          
{'loss': '0.1724', 'grad_norm': '3.33', 'learning_rate': '1.945e-05', 'epoch': '0.1333'}
+
 13%|█▎        | 5060/37963 [11:24:53<79:19:33,  8.68s/it]
 13%|█▎        | 5061/37963 [11:25:01<76:30:12,  8.37s/it]
 13%|█▎        | 5062/37963 [11:25:09<74:59:56,  8.21s/it]
 13%|█▎        | 5063/37963 [11:25:17<73:44:27,  8.07s/it]
 13%|█▎        | 5064/37963 [11:25:24<72:32:16,  7.94s/it]
 13%|█▎        | 5065/37963 [11:25:34<78:39:19,  8.61s/it]
 13%|█▎        | 5066/37963 [11:25:42<75:17:54,  8.24s/it]
 13%|█▎        | 5067/37963 [11:25:50<73:57:34,  8.09s/it]
 13%|█▎        | 5068/37963 [11:25:57<72:52:48,  7.98s/it]
 13%|█▎        | 5069/37963 [11:26:05<72:58:19,  7.99s/it]
 13%|█▎        | 5070/37963 [11:26:13<72:48:42,  7.97s/it]
                                                          
{'loss': '0.1622', 'grad_norm': '2.465', 'learning_rate': '1.944e-05', 'epoch': '0.1336'}
+
 13%|█▎        | 5070/37963 [11:26:13<72:48:42,  7.97s/it]
 13%|█▎        | 5071/37963 [11:26:21<72:11:32,  7.90s/it]
 13%|█▎        | 5072/37963 [11:26:29<71:27:00,  7.82s/it]
 13%|█▎        | 5073/37963 [11:26:36<70:38:37,  7.73s/it]
 13%|█▎        | 5074/37963 [11:26:47<78:09:47,  8.56s/it]
 13%|█▎        | 5075/37963 [11:26:54<75:52:53,  8.31s/it]
 13%|█▎        | 5076/37963 [11:27:02<73:52:59,  8.09s/it]
 13%|█▎        | 5077/37963 [11:27:10<73:04:57,  8.00s/it]
 13%|█▎        | 5078/37963 [11:27:17<72:06:58,  7.89s/it]
 13%|█▎        | 5079/37963 [11:27:25<71:02:38,  7.78s/it]
 13%|█▎        | 5080/37963 [11:27:32<70:21:30,  7.70s/it]
                                                          
{'loss': '0.1848', 'grad_norm': '3.676', 'learning_rate': '1.944e-05', 'epoch': '0.1338'}
+
 13%|█▎        | 5080/37963 [11:27:32<70:21:30,  7.70s/it]
 13%|█▎        | 5081/37963 [11:27:42<76:36:39,  8.39s/it]
 13%|█▎        | 5082/37963 [11:27:53<81:44:27,  8.95s/it]
 13%|█▎        | 5083/37963 [11:28:00<78:22:02,  8.58s/it]
 13%|█▎        | 5084/37963 [11:28:10<82:21:22,  9.02s/it]
 13%|█▎        | 5085/37963 [11:28:18<78:29:35,  8.59s/it]
 13%|█▎        | 5086/37963 [11:28:26<76:31:08,  8.38s/it]
 13%|█▎        | 5087/37963 [11:28:34<74:43:24,  8.18s/it]
 13%|█▎        | 5088/37963 [11:28:41<73:43:10,  8.07s/it]
 13%|█▎        | 5089/37963 [11:28:49<72:05:53,  7.90s/it]
 13%|█▎        | 5090/37963 [11:28:57<71:25:06,  7.82s/it]
                                                          
{'loss': '0.1709', 'grad_norm': '1.683', 'learning_rate': '1.944e-05', 'epoch': '0.1341'}
+
 13%|█▎        | 5090/37963 [11:28:57<71:25:06,  7.82s/it]
 13%|█▎        | 5091/37963 [11:29:04<71:08:28,  7.79s/it]
 13%|█▎        | 5092/37963 [11:29:12<70:59:59,  7.78s/it]
 13%|█▎        | 5093/37963 [11:29:19<70:11:42,  7.69s/it]
 13%|█▎        | 5094/37963 [11:29:27<70:13:54,  7.69s/it]
 13%|█▎        | 5095/37963 [11:29:35<70:11:51,  7.69s/it]
 13%|█▎        | 5096/37963 [11:29:43<70:08:21,  7.68s/it]
 13%|█▎        | 5097/37963 [11:29:50<69:58:38,  7.67s/it]
 13%|█▎        | 5098/37963 [11:29:58<70:17:01,  7.70s/it]
 13%|█▎        | 5099/37963 [11:30:06<70:20:12,  7.70s/it]
 13%|█▎        | 5100/37963 [11:30:13<70:00:18,  7.67s/it]
                                                          
{'loss': '0.1823', 'grad_norm': '4.072', 'learning_rate': '1.943e-05', 'epoch': '0.1343'}
+
 13%|█▎        | 5100/37963 [11:30:13<70:00:18,  7.67s/it]
 13%|█▎        | 5101/37963 [11:30:23<77:00:59,  8.44s/it]
 13%|█▎        | 5102/37963 [11:30:34<82:22:16,  9.02s/it]
 13%|█▎        | 5103/37963 [11:30:42<78:42:27,  8.62s/it]
 13%|█▎        | 5104/37963 [11:30:49<76:15:39,  8.36s/it]
 13%|█▎        | 5105/37963 [11:30:57<74:26:34,  8.16s/it]
 13%|█▎        | 5106/37963 [11:31:05<73:47:18,  8.08s/it]
 13%|█▎        | 5107/37963 [11:31:15<79:34:02,  8.72s/it]
 13%|█▎        | 5108/37963 [11:31:23<77:01:24,  8.44s/it]
 13%|█▎        | 5109/37963 [11:31:31<75:19:01,  8.25s/it]
 13%|█▎        | 5110/37963 [11:31:38<73:33:58,  8.06s/it]
                                                          
{'loss': '0.19', 'grad_norm': '2.911', 'learning_rate': '1.943e-05', 'epoch': '0.1346'}
+
 13%|█▎        | 5110/37963 [11:31:38<73:33:58,  8.06s/it]
 13%|█▎        | 5111/37963 [11:31:46<72:37:17,  7.96s/it]
 13%|█▎        | 5112/37963 [11:31:54<71:29:28,  7.83s/it]
 13%|█▎        | 5113/37963 [11:32:01<70:56:51,  7.78s/it]
 13%|█▎        | 5114/37963 [11:32:09<70:53:20,  7.77s/it]
 13%|█▎        | 5115/37963 [11:32:17<70:44:13,  7.75s/it]
 13%|█▎        | 5116/37963 [11:32:24<70:06:35,  7.68s/it]
 13%|█▎        | 5117/37963 [11:32:32<70:20:52,  7.71s/it]
 13%|█▎        | 5118/37963 [11:32:42<76:44:51,  8.41s/it]
 13%|█▎        | 5119/37963 [11:32:50<74:55:36,  8.21s/it]
 13%|█▎        | 5120/37963 [11:32:59<79:04:10,  8.67s/it]
                                                          
{'loss': '0.1758', 'grad_norm': '5.123', 'learning_rate': '1.943e-05', 'epoch': '0.1349'}
+
 13%|█▎        | 5120/37963 [11:32:59<79:04:10,  8.67s/it]
 13%|█▎        | 5121/37963 [11:33:07<76:18:29,  8.36s/it]
 13%|█▎        | 5122/37963 [11:33:15<74:28:49,  8.16s/it]
 13%|█▎        | 5123/37963 [11:33:22<73:04:41,  8.01s/it]
 13%|█▎        | 5124/37963 [11:33:30<71:50:40,  7.88s/it]
 13%|█▎        | 5125/37963 [11:33:40<78:44:05,  8.63s/it]
 14%|█▎        | 5126/37963 [11:33:51<82:42:23,  9.07s/it]
 14%|█▎        | 5127/37963 [11:33:58<79:05:32,  8.67s/it]
 14%|█▎        | 5128/37963 [11:34:06<75:50:00,  8.31s/it]
 14%|█▎        | 5129/37963 [11:34:14<74:37:24,  8.18s/it]
 14%|█▎        | 5130/37963 [11:34:21<72:45:13,  7.98s/it]
                                                          
{'loss': '0.1821', 'grad_norm': '5.559', 'learning_rate': '1.943e-05', 'epoch': '0.1351'}
+
 14%|█▎        | 5130/37963 [11:34:21<72:45:13,  7.98s/it]
 14%|█▎        | 5131/37963 [11:34:29<72:00:31,  7.90s/it]
 14%|█▎        | 5132/37963 [11:34:37<71:54:57,  7.89s/it]
 14%|█▎        | 5133/37963 [11:34:44<71:16:53,  7.82s/it]
 14%|█▎        | 5134/37963 [11:34:52<71:15:54,  7.81s/it]
 14%|█▎        | 5135/37963 [11:35:00<70:38:21,  7.75s/it]
 14%|█▎        | 5136/37963 [11:35:07<70:26:43,  7.73s/it]
 14%|█▎        | 5137/37963 [11:35:15<70:24:09,  7.72s/it]
 14%|█▎        | 5138/37963 [11:35:26<78:05:28,  8.56s/it]
 14%|█▎        | 5139/37963 [11:35:33<75:36:28,  8.29s/it]
 14%|█▎        | 5140/37963 [11:35:41<74:30:50,  8.17s/it]
                                                          
{'loss': '0.1861', 'grad_norm': '1.322', 'learning_rate': '1.942e-05', 'epoch': '0.1354'}
+
 14%|█▎        | 5140/37963 [11:35:41<74:30:50,  8.17s/it]
 14%|█▎        | 5141/37963 [11:35:49<72:59:27,  8.01s/it]
 14%|█▎        | 5142/37963 [11:35:57<72:16:01,  7.93s/it]
 14%|█▎        | 5143/37963 [11:36:04<72:11:58,  7.92s/it]
 14%|█▎        | 5144/37963 [11:36:12<71:29:31,  7.84s/it]
 14%|█▎        | 5145/37963 [11:36:20<70:57:08,  7.78s/it]
 14%|█▎        | 5146/37963 [11:36:30<77:55:47,  8.55s/it]
 14%|█▎        | 5147/37963 [11:36:38<75:13:09,  8.25s/it]
 14%|█▎        | 5148/37963 [11:36:45<73:51:03,  8.10s/it]
 14%|█▎        | 5149/37963 [11:36:56<80:09:43,  8.79s/it]
 14%|█▎        | 5150/37963 [11:37:04<77:03:17,  8.45s/it]
                                                          
{'loss': '0.1753', 'grad_norm': '2.607', 'learning_rate': '1.942e-05', 'epoch': '0.1357'}
+
 14%|█▎        | 5150/37963 [11:37:04<77:03:17,  8.45s/it]
 14%|█▎        | 5151/37963 [11:37:11<74:16:40,  8.15s/it]
 14%|█▎        | 5152/37963 [11:37:19<73:36:06,  8.08s/it]
 14%|█▎        | 5153/37963 [11:37:27<72:36:23,  7.97s/it]
 14%|█▎        | 5154/37963 [11:37:34<71:51:03,  7.88s/it]
 14%|█▎        | 5155/37963 [11:37:42<71:41:27,  7.87s/it]
 14%|█▎        | 5156/37963 [11:37:50<71:30:03,  7.85s/it]
 14%|█▎        | 5157/37963 [11:37:58<71:10:16,  7.81s/it]
 14%|█▎        | 5158/37963 [11:38:06<71:24:52,  7.84s/it]
 14%|█▎        | 5159/37963 [11:38:13<70:52:38,  7.78s/it]
 14%|█▎        | 5160/37963 [11:38:21<70:22:01,  7.72s/it]
                                                          
{'loss': '0.1817', 'grad_norm': '1.608', 'learning_rate': '1.942e-05', 'epoch': '0.1359'}
+
 14%|█▎        | 5160/37963 [11:38:21<70:22:01,  7.72s/it]
 14%|█▎        | 5161/37963 [11:38:31<77:44:19,  8.53s/it]
 14%|█▎        | 5162/37963 [11:38:42<83:21:41,  9.15s/it]
 14%|█▎        | 5163/37963 [11:38:49<79:25:51,  8.72s/it]
 14%|█▎        | 5164/37963 [11:38:57<75:49:54,  8.32s/it]
 14%|█▎        | 5165/37963 [11:39:05<74:03:53,  8.13s/it]
 14%|█▎        | 5166/37963 [11:39:12<72:47:37,  7.99s/it]
 14%|█▎        | 5167/37963 [11:39:20<72:06:59,  7.92s/it]
 14%|█▎        | 5168/37963 [11:39:28<72:05:26,  7.91s/it]
 14%|█▎        | 5169/37963 [11:39:38<77:49:52,  8.54s/it]
 14%|█▎        | 5170/37963 [11:39:46<76:03:13,  8.35s/it]
                                                          
{'loss': '0.1996', 'grad_norm': '3.506', 'learning_rate': '1.941e-05', 'epoch': '0.1362'}
+
 14%|█▎        | 5170/37963 [11:39:46<76:03:13,  8.35s/it]
 14%|█▎        | 5171/37963 [11:39:53<73:48:28,  8.10s/it]
 14%|█▎        | 5172/37963 [11:40:01<72:40:39,  7.98s/it]
 14%|█▎        | 5173/37963 [11:40:11<79:27:15,  8.72s/it]
 14%|█▎        | 5174/37963 [11:40:22<83:48:51,  9.20s/it]
 14%|█▎        | 5175/37963 [11:40:29<79:40:05,  8.75s/it]
 14%|█▎        | 5176/37963 [11:40:37<76:59:09,  8.45s/it]
 14%|█▎        | 5177/37963 [11:40:45<75:05:27,  8.25s/it]
 14%|█▎        | 5178/37963 [11:40:53<73:14:48,  8.04s/it]
 14%|█▎        | 5179/37963 [11:41:00<72:21:05,  7.94s/it]
 14%|█▎        | 5180/37963 [11:41:08<72:15:16,  7.93s/it]
                                                          
{'loss': '0.179', 'grad_norm': '3.813', 'learning_rate': '1.941e-05', 'epoch': '0.1364'}
+
 14%|█▎        | 5180/37963 [11:41:08<72:15:16,  7.93s/it]
 14%|█▎        | 5181/37963 [11:41:16<71:17:03,  7.83s/it]
 14%|█▎        | 5182/37963 [11:41:24<71:20:18,  7.83s/it]
 14%|█▎        | 5183/37963 [11:41:31<70:57:52,  7.79s/it]
 14%|█▎        | 5184/37963 [11:41:39<71:23:05,  7.84s/it]
 14%|█▎        | 5185/37963 [11:41:47<70:50:18,  7.78s/it]
 14%|█▎        | 5186/37963 [11:41:57<77:14:28,  8.48s/it]
 14%|█▎        | 5187/37963 [11:42:05<74:54:27,  8.23s/it]
 14%|█▎        | 5188/37963 [11:42:12<73:17:21,  8.05s/it]
 14%|█▎        | 5189/37963 [11:42:23<79:42:34,  8.76s/it]
 14%|█▎        | 5190/37963 [11:42:30<76:53:55,  8.45s/it]
                                                          
{'loss': '0.1793', 'grad_norm': '3.19', 'learning_rate': '1.941e-05', 'epoch': '0.1367'}
+
 14%|█▎        | 5190/37963 [11:42:30<76:53:55,  8.45s/it]
 14%|█▎        | 5191/37963 [11:42:38<73:59:49,  8.13s/it]
 14%|█▎        | 5192/37963 [11:42:45<72:38:07,  7.98s/it]
 14%|█▎        | 5193/37963 [11:42:53<71:57:16,  7.90s/it]
 14%|█▎        | 5194/37963 [11:43:01<71:43:19,  7.88s/it]
 14%|█▎        | 5195/37963 [11:43:11<78:32:39,  8.63s/it]
 14%|█▎        | 5196/37963 [11:43:19<75:48:18,  8.33s/it]
 14%|█▎        | 5197/37963 [11:43:26<73:32:18,  8.08s/it]
 14%|█▎        | 5198/37963 [11:43:34<72:34:39,  7.97s/it]
 14%|█▎        | 5199/37963 [11:43:42<71:32:04,  7.86s/it]
 14%|█▎        | 5200/37963 [11:43:50<71:58:23,  7.91s/it]
                                                          
{'loss': '0.1812', 'grad_norm': '1.684', 'learning_rate': '1.941e-05', 'epoch': '0.137'}
+
 14%|█▎        | 5200/37963 [11:43:50<71:58:23,  7.91s/it]
 14%|█▎        | 5201/37963 [11:43:58<71:51:30,  7.90s/it]
 14%|█▎        | 5202/37963 [11:44:05<71:02:59,  7.81s/it]
 14%|█▎        | 5203/37963 [11:44:13<70:10:59,  7.71s/it]
 14%|█▎        | 5204/37963 [11:44:21<70:26:51,  7.74s/it]
 14%|█▎        | 5205/37963 [11:44:34<84:49:11,  9.32s/it]
 14%|█▎        | 5206/37963 [11:44:42<81:16:34,  8.93s/it]
 14%|█▎        | 5207/37963 [11:44:49<77:01:58,  8.47s/it]
 14%|█▎        | 5208/37963 [11:44:57<74:51:10,  8.23s/it]
 14%|█▎        | 5209/37963 [11:45:04<72:34:53,  7.98s/it]
 14%|█▎        | 5210/37963 [11:45:12<72:14:18,  7.94s/it]
                                                          
{'loss': '0.1838', 'grad_norm': '7.751', 'learning_rate': '1.94e-05', 'epoch': '0.1372'}
+
 14%|█▎        | 5210/37963 [11:45:12<72:14:18,  7.94s/it]
 14%|█▎        | 5211/37963 [11:45:20<71:31:11,  7.86s/it]
 14%|█▎        | 5212/37963 [11:45:27<70:45:52,  7.78s/it]
 14%|█▎        | 5213/37963 [11:45:37<77:14:15,  8.49s/it]
 14%|█▎        | 5214/37963 [11:45:45<74:52:11,  8.23s/it]
 14%|█▎        | 5215/37963 [11:45:53<73:15:32,  8.05s/it]
 14%|█▎        | 5216/37963 [11:46:00<72:41:56,  7.99s/it]
 14%|█▎        | 5217/37963 [11:46:08<71:17:40,  7.84s/it]
 14%|█▎        | 5218/37963 [11:46:16<70:42:47,  7.77s/it]
 14%|█▎        | 5219/37963 [11:46:23<70:22:05,  7.74s/it]
 14%|█▍        | 5220/37963 [11:46:31<69:15:55,  7.62s/it]
                                                          
{'loss': '0.1857', 'grad_norm': '2.632', 'learning_rate': '1.94e-05', 'epoch': '0.1375'}
+
 14%|█▍        | 5220/37963 [11:46:31<69:15:55,  7.62s/it]
 14%|█▍        | 5221/37963 [11:46:41<76:51:55,  8.45s/it]
 14%|█▍        | 5222/37963 [11:46:49<75:18:58,  8.28s/it]
 14%|█▍        | 5223/37963 [11:46:59<79:31:56,  8.75s/it]
 14%|█▍        | 5224/37963 [11:47:06<76:34:08,  8.42s/it]
 14%|█▍        | 5225/37963 [11:47:14<75:02:06,  8.25s/it]
 14%|█▍        | 5226/37963 [11:47:22<73:21:18,  8.07s/it]
 14%|█▍        | 5227/37963 [11:47:30<72:55:15,  8.02s/it]
 14%|█▍        | 5228/37963 [11:47:37<72:09:21,  7.94s/it]
 14%|█▍        | 5229/37963 [11:47:45<71:26:06,  7.86s/it]
 14%|█▍        | 5230/37963 [11:47:53<71:10:15,  7.83s/it]
                                                          
{'loss': '0.1823', 'grad_norm': '1.334', 'learning_rate': '1.94e-05', 'epoch': '0.1378'}
+
 14%|█▍        | 5230/37963 [11:47:53<71:10:15,  7.83s/it]
 14%|█▍        | 5231/37963 [11:48:01<70:57:06,  7.80s/it]
 14%|█▍        | 5232/37963 [11:48:08<70:34:26,  7.76s/it]
 14%|█▍        | 5233/37963 [11:48:16<70:36:06,  7.77s/it]
 14%|█▍        | 5234/37963 [11:48:24<70:14:16,  7.73s/it]
 14%|█▍        | 5235/37963 [11:48:34<77:51:19,  8.56s/it]
 14%|█▍        | 5236/37963 [11:48:42<74:24:55,  8.19s/it]
 14%|█▍        | 5237/37963 [11:48:52<80:26:51,  8.85s/it]
 14%|█▍        | 5238/37963 [11:49:00<77:41:24,  8.55s/it]
 14%|█▍        | 5239/37963 [11:49:08<75:29:42,  8.31s/it]
 14%|█▍        | 5240/37963 [11:49:15<73:06:45,  8.04s/it]
                                                          
{'loss': '0.1778', 'grad_norm': '4.267', 'learning_rate': '1.939e-05', 'epoch': '0.138'}
+
 14%|█▍        | 5240/37963 [11:49:15<73:06:45,  8.04s/it]
 14%|█▍        | 5241/37963 [11:49:23<72:11:24,  7.94s/it]
 14%|█▍        | 5242/37963 [11:49:30<71:42:13,  7.89s/it]
 14%|█▍        | 5243/37963 [11:49:38<71:09:11,  7.83s/it]
 14%|█▍        | 5244/37963 [11:49:48<78:04:39,  8.59s/it]
 14%|█▍        | 5245/37963 [11:49:56<75:45:56,  8.34s/it]
 14%|█▍        | 5246/37963 [11:50:04<73:50:59,  8.13s/it]
 14%|█▍        | 5247/37963 [11:50:11<72:33:28,  7.98s/it]
 14%|█▍        | 5248/37963 [11:50:19<71:59:19,  7.92s/it]
 14%|█▍        | 5249/37963 [11:50:29<78:07:08,  8.60s/it]
 14%|█▍        | 5250/37963 [11:50:37<76:11:44,  8.39s/it]
                                                          
{'loss': '0.1834', 'grad_norm': '1.945', 'learning_rate': '1.939e-05', 'epoch': '0.1383'}
+
 14%|█▍        | 5250/37963 [11:50:37<76:11:44,  8.39s/it]
 14%|█▍        | 5251/37963 [11:50:45<74:08:34,  8.16s/it]
 14%|█▍        | 5252/37963 [11:50:53<72:34:41,  7.99s/it]
 14%|█▍        | 5253/37963 [11:51:00<72:13:21,  7.95s/it]
 14%|█▍        | 5254/37963 [11:51:08<71:21:55,  7.85s/it]
 14%|█▍        | 5255/37963 [11:51:16<70:53:55,  7.80s/it]
 14%|█▍        | 5256/37963 [11:51:24<70:55:39,  7.81s/it]
 14%|█▍        | 5257/37963 [11:51:31<70:26:17,  7.75s/it]
 14%|█▍        | 5258/37963 [11:51:39<70:21:15,  7.74s/it]
 14%|█▍        | 5259/37963 [11:51:49<77:05:34,  8.49s/it]
 14%|█▍        | 5260/37963 [11:51:57<75:27:08,  8.31s/it]
                                                          
{'loss': '0.1901', 'grad_norm': '2.556', 'learning_rate': '1.939e-05', 'epoch': '0.1386'}
+
 14%|█▍        | 5260/37963 [11:51:57<75:27:08,  8.31s/it]
 14%|█▍        | 5261/37963 [11:52:05<74:09:42,  8.16s/it]
 14%|█▍        | 5262/37963 [11:52:12<72:39:23,  8.00s/it]
 14%|█▍        | 5263/37963 [11:52:20<72:11:30,  7.95s/it]
 14%|█▍        | 5264/37963 [11:52:28<71:17:41,  7.85s/it]
 14%|█▍        | 5265/37963 [11:52:41<84:22:55,  9.29s/it]
 14%|█▍        | 5266/37963 [11:52:48<79:36:46,  8.77s/it]
 14%|█▍        | 5267/37963 [11:52:56<77:08:07,  8.49s/it]
 14%|█▍        | 5268/37963 [11:53:04<74:50:37,  8.24s/it]
 14%|█▍        | 5269/37963 [11:53:11<73:18:33,  8.07s/it]
 14%|█▍        | 5270/37963 [11:53:19<71:35:57,  7.88s/it]
                                                          
{'loss': '0.1793', 'grad_norm': '3.036', 'learning_rate': '1.939e-05', 'epoch': '0.1388'}
+
 14%|█▍        | 5270/37963 [11:53:19<71:35:57,  7.88s/it]
 14%|█▍        | 5271/37963 [11:53:27<71:18:49,  7.85s/it]
 14%|█▍        | 5272/37963 [11:53:37<78:08:04,  8.60s/it]
 14%|█▍        | 5273/37963 [11:53:45<75:44:42,  8.34s/it]
 14%|█▍        | 5274/37963 [11:53:52<73:58:02,  8.15s/it]
 14%|█▍        | 5275/37963 [11:54:00<73:21:18,  8.08s/it]
 14%|█▍        | 5276/37963 [11:54:08<72:39:53,  8.00s/it]
 14%|█▍        | 5277/37963 [11:54:16<71:52:39,  7.92s/it]
 14%|█▍        | 5278/37963 [11:54:26<77:35:03,  8.55s/it]
 14%|█▍        | 5279/37963 [11:54:34<75:46:53,  8.35s/it]
 14%|█▍        | 5280/37963 [11:54:41<74:18:33,  8.19s/it]
                                                          
{'loss': '0.1759', 'grad_norm': '2.191', 'learning_rate': '1.938e-05', 'epoch': '0.1391'}
+
 14%|█▍        | 5280/37963 [11:54:41<74:18:33,  8.19s/it]
 14%|█▍        | 5281/37963 [11:54:49<73:04:33,  8.05s/it]
 14%|█▍        | 5282/37963 [11:54:57<72:00:12,  7.93s/it]
 14%|█▍        | 5283/37963 [11:55:05<71:49:37,  7.91s/it]
 14%|█▍        | 5284/37963 [11:55:13<72:07:23,  7.95s/it]
 14%|█▍        | 5285/37963 [11:55:21<71:42:51,  7.90s/it]
 14%|█▍        | 5286/37963 [11:55:31<78:40:51,  8.67s/it]
 14%|█▍        | 5287/37963 [11:55:41<83:22:23,  9.19s/it]
 14%|█▍        | 5288/37963 [11:55:49<79:47:57,  8.79s/it]
 14%|█▍        | 5289/37963 [11:55:57<76:18:08,  8.41s/it]
 14%|█▍        | 5290/37963 [11:56:05<74:56:03,  8.26s/it]
                                                          
{'loss': '0.176', 'grad_norm': '2.957', 'learning_rate': '1.938e-05', 'epoch': '0.1393'}
+
 14%|█▍        | 5290/37963 [11:56:05<74:56:03,  8.26s/it]
 14%|█▍        | 5291/37963 [11:56:12<73:32:44,  8.10s/it]
 14%|█▍        | 5292/37963 [11:56:20<72:38:27,  8.00s/it]
 14%|█▍        | 5293/37963 [11:56:30<78:43:58,  8.68s/it]
 14%|█▍        | 5294/37963 [11:56:38<76:53:31,  8.47s/it]
 14%|█▍        | 5295/37963 [11:56:46<74:58:50,  8.26s/it]
 14%|█▍        | 5296/37963 [11:56:54<73:35:53,  8.11s/it]
 14%|█▍        | 5297/37963 [11:57:02<72:37:28,  8.00s/it]
 14%|█▍        | 5298/37963 [11:57:09<71:41:10,  7.90s/it]
 14%|█▍        | 5299/37963 [11:57:17<71:38:48,  7.90s/it]
 14%|█▍        | 5300/37963 [11:57:25<71:14:17,  7.85s/it]
                                                          
{'loss': '0.1823', 'grad_norm': '2.291', 'learning_rate': '1.938e-05', 'epoch': '0.1396'}
+
 14%|█▍        | 5300/37963 [11:57:25<71:14:17,  7.85s/it]
 14%|█▍        | 5301/37963 [11:57:33<70:20:12,  7.75s/it]
 14%|█▍        | 5302/37963 [11:57:40<70:05:14,  7.73s/it]
 14%|█▍        | 5303/37963 [11:57:48<70:16:33,  7.75s/it]
 14%|█▍        | 5304/37963 [11:57:56<70:08:30,  7.73s/it]
 14%|█▍        | 5305/37963 [11:58:03<69:44:32,  7.69s/it]
 14%|█▍        | 5306/37963 [11:58:11<70:39:17,  7.79s/it]
 14%|█▍        | 5307/37963 [11:58:19<70:45:21,  7.80s/it]
 14%|█▍        | 5308/37963 [11:58:32<84:22:26,  9.30s/it]
 14%|█▍        | 5309/37963 [11:58:40<79:59:20,  8.82s/it]
 14%|█▍        | 5310/37963 [11:58:47<77:03:26,  8.50s/it]
                                                          
{'loss': '0.1788', 'grad_norm': '1.875', 'learning_rate': '1.937e-05', 'epoch': '0.1399'}
+
 14%|█▍        | 5310/37963 [11:58:47<77:03:26,  8.50s/it]
 14%|█▍        | 5311/37963 [11:58:55<74:52:12,  8.25s/it]
 14%|█▍        | 5312/37963 [11:59:03<74:08:16,  8.17s/it]
 14%|█▍        | 5313/37963 [11:59:13<79:50:25,  8.80s/it]
 14%|█▍        | 5314/37963 [11:59:21<76:43:52,  8.46s/it]
 14%|█▍        | 5315/37963 [11:59:29<74:51:02,  8.25s/it]
 14%|█▍        | 5316/37963 [11:59:36<73:22:19,  8.09s/it]
 14%|█▍        | 5317/37963 [11:59:44<72:41:47,  8.02s/it]
 14%|█▍        | 5318/37963 [11:59:52<71:50:37,  7.92s/it]
 14%|█▍        | 5319/37963 [12:00:00<71:19:10,  7.87s/it]
 14%|█▍        | 5320/37963 [12:00:10<77:26:05,  8.54s/it]
                                                          
{'loss': '0.1809', 'grad_norm': '2.627', 'learning_rate': '1.937e-05', 'epoch': '0.1401'}
+
 14%|█▍        | 5320/37963 [12:00:10<77:26:05,  8.54s/it]
 14%|█▍        | 5321/37963 [12:00:18<75:05:42,  8.28s/it]
 14%|█▍        | 5322/37963 [12:00:25<73:39:04,  8.12s/it]
 14%|█▍        | 5323/37963 [12:00:33<72:33:25,  8.00s/it]
 14%|█▍        | 5324/37963 [12:00:41<72:34:22,  8.00s/it]
 14%|█▍        | 5325/37963 [12:00:48<70:53:50,  7.82s/it]
 14%|█▍        | 5326/37963 [12:00:56<70:11:50,  7.74s/it]
 14%|█▍        | 5327/37963 [12:01:06<77:19:29,  8.53s/it]
 14%|█▍        | 5328/37963 [12:01:14<74:52:29,  8.26s/it]
 14%|█▍        | 5329/37963 [12:01:22<73:10:36,  8.07s/it]
 14%|█▍        | 5330/37963 [12:01:29<72:15:40,  7.97s/it]
                                                          
{'loss': '0.1921', 'grad_norm': '5.169', 'learning_rate': '1.937e-05', 'epoch': '0.1404'}
+
 14%|█▍        | 5330/37963 [12:01:29<72:15:40,  7.97s/it]
 14%|█▍        | 5331/37963 [12:01:37<71:42:38,  7.91s/it]
 14%|█▍        | 5332/37963 [12:01:45<71:01:34,  7.84s/it]
 14%|█▍        | 5333/37963 [12:01:52<70:05:58,  7.73s/it]
 14%|█▍        | 5334/37963 [12:02:03<77:00:33,  8.50s/it]
 14%|█▍        | 5335/37963 [12:02:10<74:56:25,  8.27s/it]
 14%|█▍        | 5336/37963 [12:02:20<79:56:26,  8.82s/it]
 14%|█▍        | 5337/37963 [12:02:28<77:31:58,  8.56s/it]
 14%|█▍        | 5338/37963 [12:02:36<75:53:07,  8.37s/it]
 14%|█▍        | 5339/37963 [12:02:44<74:08:09,  8.18s/it]
 14%|█▍        | 5340/37963 [12:02:52<72:27:33,  8.00s/it]
                                                          
{'loss': '0.1802', 'grad_norm': '1.431', 'learning_rate': '1.936e-05', 'epoch': '0.1407'}
+
 14%|█▍        | 5340/37963 [12:02:52<72:27:33,  8.00s/it]
 14%|█▍        | 5341/37963 [12:03:02<78:16:44,  8.64s/it]
 14%|█▍        | 5342/37963 [12:03:09<75:52:21,  8.37s/it]
 14%|█▍        | 5343/37963 [12:03:17<73:45:52,  8.14s/it]
 14%|█▍        | 5344/37963 [12:03:25<72:53:52,  8.05s/it]
 14%|█▍        | 5345/37963 [12:03:33<71:59:08,  7.94s/it]
 14%|█▍        | 5346/37963 [12:03:40<71:09:09,  7.85s/it]
 14%|█▍        | 5347/37963 [12:03:48<71:00:32,  7.84s/it]
 14%|█▍        | 5348/37963 [12:03:56<71:08:41,  7.85s/it]
 14%|█▍        | 5349/37963 [12:04:04<70:29:04,  7.78s/it]
 14%|█▍        | 5350/37963 [12:04:11<69:46:00,  7.70s/it]
                                                          
{'loss': '0.1757', 'grad_norm': '3.942', 'learning_rate': '1.936e-05', 'epoch': '0.1409'}
+
 14%|█▍        | 5350/37963 [12:04:11<69:46:00,  7.70s/it]
 14%|█▍        | 5351/37963 [12:04:19<69:32:50,  7.68s/it]
 14%|█▍        | 5352/37963 [12:04:26<69:32:38,  7.68s/it]
 14%|█▍        | 5353/37963 [12:04:34<69:22:31,  7.66s/it]
 14%|█▍        | 5354/37963 [12:04:41<68:36:47,  7.57s/it]
 14%|█▍        | 5355/37963 [12:04:49<68:09:56,  7.53s/it]
 14%|█▍        | 5356/37963 [12:04:56<67:40:20,  7.47s/it]
 14%|█▍        | 5357/37963 [12:05:06<74:27:38,  8.22s/it]
 14%|█▍        | 5358/37963 [12:05:14<73:33:49,  8.12s/it]
 14%|█▍        | 5359/37963 [12:05:22<73:08:34,  8.08s/it]
 14%|█▍        | 5360/37963 [12:05:30<72:24:14,  7.99s/it]
                                                          
{'loss': '0.1841', 'grad_norm': '1.671', 'learning_rate': '1.936e-05', 'epoch': '0.1412'}
+
 14%|█▍        | 5360/37963 [12:05:30<72:24:14,  7.99s/it]
 14%|█▍        | 5361/37963 [12:05:40<78:09:40,  8.63s/it]
 14%|█▍        | 5362/37963 [12:05:50<82:40:01,  9.13s/it]
 14%|█▍        | 5363/37963 [12:05:58<78:40:16,  8.69s/it]
 14%|█▍        | 5364/37963 [12:06:05<75:48:37,  8.37s/it]
 14%|█▍        | 5365/37963 [12:06:13<74:08:11,  8.19s/it]
 14%|█▍        | 5366/37963 [12:06:21<72:23:52,  8.00s/it]
 14%|█▍        | 5367/37963 [12:06:29<72:01:31,  7.95s/it]
 14%|█▍        | 5368/37963 [12:06:39<78:26:41,  8.66s/it]
 14%|█▍        | 5369/37963 [12:06:46<75:21:56,  8.32s/it]
 14%|█▍        | 5370/37963 [12:06:54<73:58:39,  8.17s/it]
                                                          
{'loss': '0.1749', 'grad_norm': '2.431', 'learning_rate': '1.936e-05', 'epoch': '0.1415'}
+
 14%|█▍        | 5370/37963 [12:06:54<73:58:39,  8.17s/it]
 14%|█▍        | 5371/37963 [12:07:02<72:37:48,  8.02s/it]
 14%|█▍        | 5372/37963 [12:07:09<71:03:59,  7.85s/it]
 14%|█▍        | 5373/37963 [12:07:17<70:50:47,  7.83s/it]
 14%|█▍        | 5374/37963 [12:07:27<77:13:53,  8.53s/it]
 14%|█▍        | 5375/37963 [12:07:35<75:33:56,  8.35s/it]
 14%|█▍        | 5376/37963 [12:07:42<72:19:11,  7.99s/it]
 14%|█▍        | 5377/37963 [12:07:53<78:09:14,  8.63s/it]
 14%|█▍        | 5378/37963 [12:08:00<75:29:58,  8.34s/it]
 14%|█▍        | 5379/37963 [12:08:08<73:50:38,  8.16s/it]
 14%|█▍        | 5380/37963 [12:08:16<72:25:46,  8.00s/it]
                                                          
{'loss': '0.1629', 'grad_norm': '2.362', 'learning_rate': '1.935e-05', 'epoch': '0.1417'}
+
 14%|█▍        | 5380/37963 [12:08:16<72:25:46,  8.00s/it]
 14%|█▍        | 5381/37963 [12:08:23<70:15:44,  7.76s/it]
 14%|█▍        | 5382/37963 [12:08:30<69:57:02,  7.73s/it]
 14%|█▍        | 5383/37963 [12:08:38<70:10:07,  7.75s/it]
 14%|█▍        | 5384/37963 [12:08:46<70:03:29,  7.74s/it]
 14%|█▍        | 5385/37963 [12:08:59<83:46:42,  9.26s/it]
 14%|█▍        | 5386/37963 [12:09:07<80:20:47,  8.88s/it]
 14%|█▍        | 5387/37963 [12:09:15<77:24:11,  8.55s/it]
 14%|█▍        | 5388/37963 [12:09:22<75:45:48,  8.37s/it]
 14%|█▍        | 5389/37963 [12:09:30<74:18:34,  8.21s/it]
 14%|█▍        | 5390/37963 [12:09:38<73:11:41,  8.09s/it]
                                                          
{'loss': '0.1771', 'grad_norm': '2.062', 'learning_rate': '1.935e-05', 'epoch': '0.142'}
+
 14%|█▍        | 5390/37963 [12:09:38<73:11:41,  8.09s/it]
 14%|█▍        | 5391/37963 [12:09:46<72:39:33,  8.03s/it]
 14%|█▍        | 5392/37963 [12:09:54<71:39:04,  7.92s/it]
 14%|█▍        | 5393/37963 [12:10:01<71:22:57,  7.89s/it]
 14%|█▍        | 5394/37963 [12:10:09<70:57:51,  7.84s/it]
 14%|█▍        | 5395/37963 [12:10:17<70:12:17,  7.76s/it]
 14%|█▍        | 5396/37963 [12:10:25<70:17:40,  7.77s/it]
 14%|█▍        | 5397/37963 [12:10:32<70:13:38,  7.76s/it]
 14%|█▍        | 5398/37963 [12:10:40<69:46:06,  7.71s/it]
 14%|█▍        | 5399/37963 [12:10:47<68:45:33,  7.60s/it]
 14%|█▍        | 5400/37963 [12:10:57<74:18:57,  8.22s/it]
                                                          
{'loss': '0.1756', 'grad_norm': '3.356', 'learning_rate': '1.935e-05', 'epoch': '0.1422'}
+
 14%|█▍        | 5400/37963 [12:10:57<74:18:57,  8.22s/it]
 14%|█▍        | 5401/37963 [12:11:05<73:24:28,  8.12s/it]
 14%|█▍        | 5402/37963 [12:11:12<71:18:39,  7.88s/it]
 14%|█▍        | 5403/37963 [12:11:20<70:31:02,  7.80s/it]
 14%|█▍        | 5404/37963 [12:11:27<70:01:38,  7.74s/it]
 14%|█▍        | 5405/37963 [12:11:35<69:44:15,  7.71s/it]
 14%|█▍        | 5406/37963 [12:11:43<70:02:20,  7.74s/it]
 14%|█▍        | 5407/37963 [12:11:50<69:31:02,  7.69s/it]
 14%|█▍        | 5408/37963 [12:11:58<69:11:00,  7.65s/it]
 14%|█▍        | 5409/37963 [12:12:06<69:00:45,  7.63s/it]
 14%|█▍        | 5410/37963 [12:12:13<69:21:54,  7.67s/it]
                                                          
{'loss': '0.1757', 'grad_norm': '7.118', 'learning_rate': '1.934e-05', 'epoch': '0.1425'}
+
 14%|█▍        | 5410/37963 [12:12:13<69:21:54,  7.67s/it]
 14%|█▍        | 5411/37963 [12:12:24<77:08:02,  8.53s/it]
 14%|█▍        | 5412/37963 [12:12:32<74:54:21,  8.28s/it]
 14%|█▍        | 5413/37963 [12:12:39<73:03:31,  8.08s/it]
 14%|█▍        | 5414/37963 [12:12:47<72:11:21,  7.98s/it]
 14%|█▍        | 5415/37963 [12:12:57<78:05:05,  8.64s/it]
 14%|█▍        | 5416/37963 [12:13:05<75:33:03,  8.36s/it]
 14%|█▍        | 5417/37963 [12:13:15<80:40:28,  8.92s/it]
 14%|█▍        | 5418/37963 [12:13:23<77:26:16,  8.57s/it]
 14%|█▍        | 5419/37963 [12:13:31<75:38:03,  8.37s/it]
 14%|█▍        | 5420/37963 [12:13:38<73:14:05,  8.10s/it]
                                                          
{'loss': '0.194', 'grad_norm': '1.667', 'learning_rate': '1.934e-05', 'epoch': '0.1428'}
+
 14%|█▍        | 5420/37963 [12:13:38<73:14:05,  8.10s/it]
 14%|█▍        | 5421/37963 [12:13:48<78:33:49,  8.69s/it]
 14%|█���        | 5422/37963 [12:13:59<83:32:08,  9.24s/it]
 14%|█▍        | 5423/37963 [12:14:07<79:48:38,  8.83s/it]
 14%|█▍        | 5424/37963 [12:14:14<76:12:20,  8.43s/it]
 14%|█▍        | 5425/37963 [12:14:22<73:42:02,  8.15s/it]
 14%|█▍        | 5426/37963 [12:14:29<72:44:29,  8.05s/it]
 14%|█▍        | 5427/37963 [12:14:37<72:02:43,  7.97s/it]
 14%|█▍        | 5428/37963 [12:14:45<71:05:54,  7.87s/it]
 14%|█▍        | 5429/37963 [12:14:52<70:16:53,  7.78s/it]
 14%|█▍        | 5430/37963 [12:15:03<77:35:27,  8.59s/it]
                                                          
{'loss': '0.1829', 'grad_norm': '2.088', 'learning_rate': '1.934e-05', 'epoch': '0.143'}
+
 14%|█▍        | 5430/37963 [12:15:03<77:35:27,  8.59s/it]
 14%|█▍        | 5431/37963 [12:15:11<75:15:35,  8.33s/it]
 14%|█▍        | 5432/37963 [12:15:18<73:06:21,  8.09s/it]
 14%|█▍        | 5433/37963 [12:15:28<79:09:33,  8.76s/it]
 14%|█▍        | 5434/37963 [12:15:36<76:35:56,  8.48s/it]
 14%|█▍        | 5435/37963 [12:15:44<74:16:13,  8.22s/it]
 14%|█▍        | 5436/37963 [12:15:52<73:05:50,  8.09s/it]
 14%|█▍        | 5437/37963 [12:16:00<72:28:53,  8.02s/it]
 14%|█▍        | 5438/37963 [12:16:07<71:22:32,  7.90s/it]
 14%|█▍        | 5439/37963 [12:16:14<69:46:47,  7.72s/it]
 14%|█▍        | 5440/37963 [12:16:22<69:43:47,  7.72s/it]
                                                          
{'loss': '0.1821', 'grad_norm': '3.065', 'learning_rate': '1.933e-05', 'epoch': '0.1433'}
+
 14%|█▍        | 5440/37963 [12:16:22<69:43:47,  7.72s/it]
 14%|█▍        | 5441/37963 [12:16:30<69:37:37,  7.71s/it]
 14%|█▍        | 5442/37963 [12:16:38<70:04:32,  7.76s/it]
 14%|█▍        | 5443/37963 [12:16:46<70:44:50,  7.83s/it]
 14%|█▍        | 5444/37963 [12:16:53<70:27:25,  7.80s/it]
 14%|█▍        | 5445/37963 [12:17:01<70:20:59,  7.79s/it]
 14%|█▍        | 5446/37963 [12:17:09<69:59:44,  7.75s/it]
 14%|█▍        | 5447/37963 [12:17:16<69:41:32,  7.72s/it]
 14%|█▍        | 5448/37963 [12:17:24<68:54:06,  7.63s/it]
 14%|█▍        | 5449/37963 [12:17:34<76:43:46,  8.50s/it]
 14%|█▍        | 5450/37963 [12:17:42<73:56:03,  8.19s/it]
                                                          
{'loss': '0.1824', 'grad_norm': '1.453', 'learning_rate': '1.933e-05', 'epoch': '0.1436'}
+
 14%|█▍        | 5450/37963 [12:17:42<73:56:03,  8.19s/it]
 14%|█▍        | 5451/37963 [12:17:50<72:31:01,  8.03s/it]
 14%|█▍        | 5452/37963 [12:17:57<70:54:37,  7.85s/it]
 14%|█▍        | 5453/37963 [12:18:05<71:02:53,  7.87s/it]
 14%|█▍        | 5454/37963 [12:18:15<77:45:28,  8.61s/it]
 14%|█▍        | 5455/37963 [12:18:23<75:47:59,  8.39s/it]
 14%|█▍        | 5456/37963 [12:18:31<73:25:23,  8.13s/it]
 14%|█▍        | 5457/37963 [12:18:39<72:42:49,  8.05s/it]
 14%|█▍        | 5458/37963 [12:18:46<71:37:46,  7.93s/it]
 14%|█▍        | 5459/37963 [12:18:54<71:05:19,  7.87s/it]
 14%|█▍        | 5460/37963 [12:19:01<69:32:58,  7.70s/it]
                                                          
{'loss': '0.1859', 'grad_norm': '2.658', 'learning_rate': '1.933e-05', 'epoch': '0.1438'}
+
 14%|█▍        | 5460/37963 [12:19:01<69:32:58,  7.70s/it]
 14%|█▍        | 5461/37963 [12:19:09<69:51:11,  7.74s/it]
 14%|█▍        | 5462/37963 [12:19:17<69:44:04,  7.72s/it]
 14%|█▍        | 5463/37963 [12:19:25<69:53:28,  7.74s/it]
 14%|█▍        | 5464/37963 [12:19:32<69:31:16,  7.70s/it]
 14%|█▍        | 5465/37963 [12:19:42<76:29:04,  8.47s/it]
 14%|█▍        | 5466/37963 [12:19:50<74:34:02,  8.26s/it]
 14%|█▍        | 5467/37963 [12:19:58<73:17:28,  8.12s/it]
 14%|█▍        | 5468/37963 [12:20:06<71:57:11,  7.97s/it]
 14%|█▍        | 5469/37963 [12:20:16<77:28:01,  8.58s/it]
 14%|█▍        | 5470/37963 [12:20:23<75:00:17,  8.31s/it]
                                                          
{'loss': '0.186', 'grad_norm': '3.955', 'learning_rate': '1.933e-05', 'epoch': '0.1441'}
+
 14%|█▍        | 5470/37963 [12:20:23<75:00:17,  8.31s/it]
 14%|█▍        | 5471/37963 [12:20:31<73:39:32,  8.16s/it]
 14%|█▍        | 5472/37963 [12:20:39<72:05:22,  7.99s/it]
 14%|█▍        | 5473/37963 [12:20:46<71:09:22,  7.88s/it]
 14%|█▍        | 5474/37963 [12:20:54<71:08:01,  7.88s/it]
 14%|█▍        | 5475/37963 [12:21:02<70:59:17,  7.87s/it]
 14%|█▍        | 5476/37963 [12:21:15<84:06:50,  9.32s/it]
 14%|█▍        | 5477/37963 [12:21:22<79:36:23,  8.82s/it]
 14%|█▍        | 5478/37963 [12:21:33<83:49:02,  9.29s/it]
 14%|█▍        | 5479/37963 [12:21:41<80:15:20,  8.89s/it]
 14%|█▍        | 5480/37963 [12:21:48<76:59:34,  8.53s/it]
                                                          
{'loss': '0.1811', 'grad_norm': '1.553', 'learning_rate': '1.932e-05', 'epoch': '0.1444'}
+
 14%|█▍        | 5480/37963 [12:21:48<76:59:34,  8.53s/it]
 14%|█▍        | 5481/37963 [12:21:56<74:30:55,  8.26s/it]
 14%|█▍        | 5482/37963 [12:22:04<72:47:29,  8.07s/it]
 14%|█▍        | 5483/37963 [12:22:11<71:38:03,  7.94s/it]
 14%|█▍        | 5484/37963 [12:22:19<70:37:09,  7.83s/it]
 14%|█▍        | 5485/37963 [12:22:26<69:11:52,  7.67s/it]
 14%|█▍        | 5486/37963 [12:22:34<69:41:14,  7.72s/it]
 14%|█▍        | 5487/37963 [12:22:42<69:46:23,  7.73s/it]
 14%|█▍        | 5488/37963 [12:22:50<69:49:02,  7.74s/it]
 14%|█▍        | 5489/37963 [12:22:57<70:19:22,  7.80s/it]
 14%|█▍        | 5490/37963 [12:23:05<70:18:58,  7.80s/it]
                                                          
{'loss': '0.1746', 'grad_norm': '2.024', 'learning_rate': '1.932e-05', 'epoch': '0.1446'}
+
 14%|█▍        | 5490/37963 [12:23:05<70:18:58,  7.80s/it]
 14%|█▍        | 5491/37963 [12:23:13<70:23:41,  7.80s/it]
 14%|█▍        | 5492/37963 [12:23:21<69:49:36,  7.74s/it]
 14%|█▍        | 5493/37963 [12:23:28<69:57:15,  7.76s/it]
 14%|█▍        | 5494/37963 [12:23:36<70:10:56,  7.78s/it]
 14%|█▍        | 5495/37963 [12:23:44<70:08:20,  7.78s/it]
 14%|█▍        | 5496/37963 [12:23:52<69:18:06,  7.68s/it]
 14%|█▍        | 5497/37963 [12:23:59<68:36:36,  7.61s/it]
 14%|█▍        | 5498/37963 [12:24:09<75:29:42,  8.37s/it]
 14%|█▍        | 5499/37963 [12:24:17<74:37:41,  8.28s/it]
 14%|█▍        | 5500/37963 [12:24:25<72:44:46,  8.07s/it]
                                                          
{'loss': '0.1803', 'grad_norm': '0.8831', 'learning_rate': '1.932e-05', 'epoch': '0.1449'}
+
 14%|█▍        | 5500/37963 [12:24:25<72:44:46,  8.07s/it]
 14%|█▍        | 5501/37963 [12:24:32<71:32:37,  7.93s/it]
 14%|█▍        | 5502/37963 [12:24:42<75:57:12,  8.42s/it]
 14%|█▍        | 5503/37963 [12:24:49<73:05:29,  8.11s/it]
 14%|█▍        | 5504/37963 [12:24:57<70:57:38,  7.87s/it]
 15%|█▍        | 5505/37963 [12:25:04<70:09:41,  7.78s/it]
 15%|█▍        | 5506/37963 [12:25:12<70:02:58,  7.77s/it]
 15%|█▍        | 5507/37963 [12:25:19<68:57:04,  7.65s/it]
 15%|█▍        | 5508/37963 [12:25:27<68:49:21,  7.63s/it]
 15%|█▍        | 5509/37963 [12:25:35<69:51:43,  7.75s/it]
 15%|█▍        | 5510/37963 [12:25:43<70:14:26,  7.79s/it]
                                                          
{'loss': '0.1885', 'grad_norm': '3.118', 'learning_rate': '1.931e-05', 'epoch': '0.1451'}
+
 15%|█▍        | 5510/37963 [12:25:43<70:14:26,  7.79s/it]
 15%|█▍        | 5511/37963 [12:25:51<70:07:28,  7.78s/it]
 15%|█▍        | 5512/37963 [12:25:58<69:54:43,  7.76s/it]
 15%|█▍        | 5513/37963 [12:26:09<76:49:43,  8.52s/it]
 15%|█▍        | 5514/37963 [12:26:16<75:09:55,  8.34s/it]
 15%|█▍        | 5515/37963 [12:26:24<73:12:18,  8.12s/it]
 15%|█▍        | 5516/37963 [12:26:32<72:50:56,  8.08s/it]
 15%|█▍        | 5517/37963 [12:26:40<71:56:53,  7.98s/it]
 15%|█▍        | 5518/37963 [12:26:47<70:05:50,  7.78s/it]
 15%|█▍        | 5519/37963 [12:26:57<76:48:52,  8.52s/it]
 15%|█▍        | 5520/37963 [12:27:05<74:09:38,  8.23s/it]
                                                          
{'loss': '0.1776', 'grad_norm': '1.541', 'learning_rate': '1.931e-05', 'epoch': '0.1454'}
+
 15%|█▍        | 5520/37963 [12:27:05<74:09:38,  8.23s/it]
 15%|█▍        | 5521/37963 [12:27:13<72:39:56,  8.06s/it]
 15%|█▍        | 5522/37963 [12:27:20<71:24:16,  7.92s/it]
 15%|█▍        | 5523/37963 [12:27:30<77:25:19,  8.59s/it]
 15%|█▍        | 5524/37963 [12:27:38<75:05:48,  8.33s/it]
 15%|█▍        | 5525/37963 [12:27:48<80:36:40,  8.95s/it]
 15%|█▍        | 5526/37963 [12:27:56<77:36:17,  8.61s/it]
 15%|█▍        | 5527/37963 [12:28:04<74:54:32,  8.31s/it]
 15%|█▍        | 5528/37963 [12:28:14<80:25:12,  8.93s/it]
 15%|█▍        | 5529/37963 [12:28:22<77:17:33,  8.58s/it]
 15%|█▍        | 5530/37963 [12:28:33<82:25:28,  9.15s/it]
                                                          
{'loss': '0.1837', 'grad_norm': '3.579', 'learning_rate': '1.931e-05', 'epoch': '0.1457'}
+
 15%|█▍        | 5530/37963 [12:28:33<82:25:28,  9.15s/it]
 15%|█▍        | 5531/37963 [12:28:40<78:21:01,  8.70s/it]
 15%|█▍        | 5532/37963 [12:28:47<74:28:50,  8.27s/it]
 15%|█▍        | 5533/37963 [12:28:55<72:10:23,  8.01s/it]
 15%|█▍        | 5534/37963 [12:29:03<71:15:46,  7.91s/it]
 15%|█▍        | 5535/37963 [12:29:10<69:44:19,  7.74s/it]
 15%|█▍        | 5536/37963 [12:29:18<69:27:26,  7.71s/it]
 15%|█▍        | 5537/37963 [12:29:25<69:16:32,  7.69s/it]
 15%|█▍        | 5538/37963 [12:29:33<69:24:10,  7.71s/it]
 15%|█▍        | 5539/37963 [12:29:41<69:13:41,  7.69s/it]
 15%|█▍        | 5540/37963 [12:29:48<69:05:07,  7.67s/it]
                                                          
{'loss': '0.1932', 'grad_norm': '2.781', 'learning_rate': '1.93e-05', 'epoch': '0.1459'}
+
 15%|█▍        | 5540/37963 [12:29:48<69:05:07,  7.67s/it]
 15%|█▍        | 5541/37963 [12:29:56<69:32:24,  7.72s/it]
 15%|█▍        | 5542/37963 [12:30:04<69:19:12,  7.70s/it]
 15%|█▍        | 5543/37963 [12:30:11<69:34:01,  7.72s/it]
 15%|█▍        | 5544/37963 [12:30:19<69:51:15,  7.76s/it]
 15%|█▍        | 5545/37963 [12:30:27<69:42:30,  7.74s/it]
 15%|█▍        | 5546/37963 [12:30:37<76:30:14,  8.50s/it]
 15%|█▍        | 5547/37963 [12:30:47<81:06:54,  9.01s/it]
 15%|█▍        | 5548/37963 [12:30:55<77:48:11,  8.64s/it]
 15%|█▍        | 5549/37963 [12:31:03<75:10:19,  8.35s/it]
 15%|█▍        | 5550/37963 [12:31:11<73:40:35,  8.18s/it]
                                                          
{'loss': '0.1779', 'grad_norm': '1.734', 'learning_rate': '1.93e-05', 'epoch': '0.1462'}
+
 15%|█▍        | 5550/37963 [12:31:11<73:40:35,  8.18s/it]
 15%|█▍        | 5551/37963 [12:31:19<72:40:03,  8.07s/it]
 15%|█▍        | 5552/37963 [12:31:26<71:44:06,  7.97s/it]
 15%|█▍        | 5553/37963 [12:31:34<71:54:24,  7.99s/it]
 15%|█▍        | 5554/37963 [12:31:42<71:03:28,  7.89s/it]
 15%|█▍        | 5555/37963 [12:31:50<70:14:53,  7.80s/it]
 15%|█▍        | 5556/37963 [12:31:57<69:23:02,  7.71s/it]
 15%|█▍        | 5557/37963 [12:32:05<69:02:53,  7.67s/it]
 15%|█▍        | 5558/37963 [12:32:12<69:28:25,  7.72s/it]
 15%|█▍        | 5559/37963 [12:32:20<69:17:06,  7.70s/it]
 15%|█▍        | 5560/37963 [12:32:28<70:03:23,  7.78s/it]
                                                          
{'loss': '0.166', 'grad_norm': '5.132', 'learning_rate': '1.93e-05', 'epoch': '0.1465'}
+
 15%|█▍        | 5560/37963 [12:32:28<70:03:23,  7.78s/it]
 15%|█▍        | 5561/37963 [12:32:36<69:58:59,  7.78s/it]
 15%|█▍        | 5562/37963 [12:32:44<69:59:14,  7.78s/it]
 15%|█▍        | 5563/37963 [12:32:51<70:07:29,  7.79s/it]
 15%|█▍        | 5564/37963 [12:32:59<70:20:18,  7.82s/it]
 15%|█▍        | 5565/37963 [12:33:07<70:38:48,  7.85s/it]
 15%|█▍        | 5566/37963 [12:33:15<70:18:05,  7.81s/it]
 15%|█▍        | 5567/37963 [12:33:25<76:57:42,  8.55s/it]
 15%|█▍        | 5568/37963 [12:33:33<74:40:06,  8.30s/it]
 15%|█▍        | 5569/37963 [12:33:41<72:49:00,  8.09s/it]
 15%|█▍        | 5570/37963 [12:33:48<70:26:46,  7.83s/it]
                                                          
{'loss': '0.1735', 'grad_norm': '4.076', 'learning_rate': '1.929e-05', 'epoch': '0.1467'}
+
 15%|█▍        | 5570/37963 [12:33:48<70:26:46,  7.83s/it]
 15%|█▍        | 5571/37963 [12:33:55<69:54:01,  7.77s/it]
 15%|█▍        | 5572/37963 [12:34:03<69:31:15,  7.73s/it]
 15%|█▍        | 5573/37963 [12:34:16<83:18:43,  9.26s/it]
 15%|█▍        | 5574/37963 [12:34:24<79:04:38,  8.79s/it]
 15%|█▍        | 5575/37963 [12:34:31<76:04:03,  8.46s/it]
 15%|█▍        | 5576/37963 [12:34:39<73:35:49,  8.18s/it]
 15%|█▍        | 5577/37963 [12:34:49<79:13:29,  8.81s/it]
 15%|█▍        | 5578/37963 [12:34:57<75:43:16,  8.42s/it]
 15%|█▍        | 5579/37963 [12:35:07<80:43:25,  8.97s/it]
 15%|█▍        | 5580/37963 [12:35:14<76:36:26,  8.52s/it]
                                                          
{'loss': '0.1919', 'grad_norm': '2.974', 'learning_rate': '1.929e-05', 'epoch': '0.147'}
+
 15%|█▍        | 5580/37963 [12:35:14<76:36:26,  8.52s/it]
 15%|█▍        | 5581/37963 [12:35:22<75:00:45,  8.34s/it]
 15%|█▍        | 5582/37963 [12:35:30<73:24:55,  8.16s/it]
 15%|█▍        | 5583/37963 [12:35:38<72:24:50,  8.05s/it]
 15%|█▍        | 5584/37963 [12:35:48<79:04:42,  8.79s/it]
 15%|█▍        | 5585/37963 [12:35:56<76:24:12,  8.50s/it]
 15%|█▍        | 5586/37963 [12:36:04<73:53:32,  8.22s/it]
 15%|█▍        | 5587/37963 [12:36:11<72:40:01,  8.08s/it]
 15%|█▍        | 5588/37963 [12:36:19<71:56:59,  8.00s/it]
 15%|█▍        | 5589/37963 [12:36:27<71:16:16,  7.93s/it]
 15%|█▍        | 5590/37963 [12:36:40<84:03:32,  9.35s/it]
                                                          
{'loss': '0.1787', 'grad_norm': '1.182', 'learning_rate': '1.929e-05', 'epoch': '0.1472'}
+
 15%|█▍        | 5590/37963 [12:36:40<84:03:32,  9.35s/it]
 15%|█▍        | 5591/37963 [12:36:47<79:07:38,  8.80s/it]
 15%|█▍        | 5592/37963 [12:36:55<76:05:04,  8.46s/it]
 15%|█▍        | 5593/37963 [12:37:02<73:29:00,  8.17s/it]
 15%|█▍        | 5594/37963 [12:37:10<71:49:53,  7.99s/it]
 15%|█▍        | 5595/37963 [12:37:17<70:49:20,  7.88s/it]
 15%|█▍        | 5596/37963 [12:37:25<70:41:50,  7.86s/it]
 15%|█▍        | 5597/37963 [12:37:33<70:41:37,  7.86s/it]
 15%|█▍        | 5598/37963 [12:37:41<70:13:45,  7.81s/it]
 15%|█▍        | 5599/37963 [12:37:48<69:37:23,  7.74s/it]
 15%|█▍        | 5600/37963 [12:37:56<69:48:51,  7.77s/it]
                                                          
{'loss': '0.1803', 'grad_norm': '3.285', 'learning_rate': '1.928e-05', 'epoch': '0.1475'}
+
 15%|█▍        | 5600/37963 [12:37:56<69:48:51,  7.77s/it]
 15%|█▍        | 5601/37963 [12:38:04<69:25:50,  7.72s/it]
 15%|█▍        | 5602/37963 [12:38:12<69:22:23,  7.72s/it]
 15%|█▍        | 5603/37963 [12:38:19<69:05:26,  7.69s/it]
 15%|█▍        | 5604/37963 [12:38:27<68:50:02,  7.66s/it]
 15%|█▍        | 5605/37963 [12:38:34<68:32:05,  7.62s/it]
 15%|█▍        | 5606/37963 [12:38:42<67:31:29,  7.51s/it]
 15%|█▍        | 5607/37963 [12:38:49<68:01:51,  7.57s/it]
 15%|█▍        | 5608/37963 [12:38:57<68:11:15,  7.59s/it]
 15%|█▍        | 5609/37963 [12:39:05<68:15:30,  7.60s/it]
 15%|█▍        | 5610/37963 [12:39:12<68:47:13,  7.65s/it]
                                                          
{'loss': '0.1789', 'grad_norm': '3.822', 'learning_rate': '1.928e-05', 'epoch': '0.1478'}
+
 15%|█▍        | 5610/37963 [12:39:12<68:47:13,  7.65s/it]
 15%|█▍        | 5611/37963 [12:39:23<75:44:32,  8.43s/it]
 15%|█▍        | 5612/37963 [12:39:30<74:23:01,  8.28s/it]
 15%|█▍        | 5613/37963 [12:39:38<73:15:07,  8.15s/it]
 15%|█▍        | 5614/37963 [12:39:46<71:55:12,  8.00s/it]
 15%|█▍        | 5615/37963 [12:39:54<71:18:18,  7.94s/it]
 15%|█▍        | 5616/37963 [12:40:04<77:15:31,  8.60s/it]
 15%|█▍        | 5617/37963 [12:40:14<81:33:54,  9.08s/it]
 15%|█▍        | 5618/37963 [12:40:22<77:32:43,  8.63s/it]
 15%|█▍        | 5619/37963 [12:40:29<75:04:00,  8.36s/it]
 15%|█▍        | 5620/37963 [12:40:37<73:48:58,  8.22s/it]
                                                          
{'loss': '0.1632', 'grad_norm': '1.318', 'learning_rate': '1.928e-05', 'epoch': '0.148'}
+
 15%|█▍        | 5620/37963 [12:40:37<73:48:58,  8.22s/it]
 15%|█▍        | 5621/37963 [12:40:45<72:31:08,  8.07s/it]
 15%|█▍        | 5622/37963 [12:40:53<71:03:28,  7.91s/it]
 15%|█▍        | 5623/37963 [12:41:00<70:36:47,  7.86s/it]
 15%|█▍        | 5624/37963 [12:41:08<70:14:49,  7.82s/it]
 15%|█▍        | 5625/37963 [12:41:19<77:40:00,  8.65s/it]
 15%|█▍        | 5626/37963 [12:41:26<75:32:35,  8.41s/it]
 15%|█▍        | 5627/37963 [12:41:37<80:25:20,  8.95s/it]
 15%|█▍        | 5628/37963 [12:41:44<76:53:15,  8.56s/it]
 15%|█▍        | 5629/37963 [12:41:52<74:21:48,  8.28s/it]
 15%|█▍        | 5630/37963 [12:42:00<72:39:43,  8.09s/it]
                                                          
{'loss': '0.1754', 'grad_norm': '3.064', 'learning_rate': '1.928e-05', 'epoch': '0.1483'}
+
 15%|█▍        | 5630/37963 [12:42:00<72:39:43,  8.09s/it]
 15%|█▍        | 5631/37963 [12:42:07<71:18:58,  7.94s/it]
 15%|█▍        | 5632/37963 [12:42:15<69:42:59,  7.76s/it]
 15%|█▍        | 5633/37963 [12:42:25<76:25:50,  8.51s/it]
 15%|█▍        | 5634/37963 [12:42:35<81:48:28,  9.11s/it]
 15%|█▍        | 5635/37963 [12:42:43<78:55:18,  8.79s/it]
 15%|█▍        | 5636/37963 [12:42:51<75:43:11,  8.43s/it]
 15%|█▍        | 5637/37963 [12:42:59<73:46:56,  8.22s/it]
 15%|█▍        | 5638/37963 [12:43:06<72:37:34,  8.09s/it]
 15%|█▍        | 5639/37963 [12:43:15<72:32:26,  8.08s/it]
 15%|█▍        | 5640/37963 [12:43:22<70:31:53,  7.86s/it]
                                                          
{'loss': '0.1746', 'grad_norm': '3.62', 'learning_rate': '1.927e-05', 'epoch': '0.1486'}
+
 15%|█▍        | 5640/37963 [12:43:22<70:31:53,  7.86s/it]
 15%|█▍        | 5641/37963 [12:43:30<70:12:58,  7.82s/it]
 15%|█▍        | 5642/37963 [12:43:37<69:45:57,  7.77s/it]
 15%|█▍        | 5643/37963 [12:43:45<69:06:08,  7.70s/it]
 15%|█▍        | 5644/37963 [12:43:55<75:31:58,  8.41s/it]
 15%|█▍        | 5645/37963 [12:44:03<74:57:39,  8.35s/it]
 15%|█▍        | 5646/37963 [12:44:11<73:36:37,  8.20s/it]
 15%|█▍        | 5647/37963 [12:44:18<71:55:19,  8.01s/it]
 15%|█▍        | 5648/37963 [12:44:26<71:23:45,  7.95s/it]
 15%|█▍        | 5649/37963 [12:44:34<70:29:37,  7.85s/it]
 15%|█▍        | 5650/37963 [12:44:42<70:43:57,  7.88s/it]
                                                          
{'loss': '0.1728', 'grad_norm': '5.259', 'learning_rate': '1.927e-05', 'epoch': '0.1488'}
+
 15%|█▍        | 5650/37963 [12:44:42<70:43:57,  7.88s/it]
 15%|█▍        | 5651/37963 [12:44:49<69:19:45,  7.72s/it]
 15%|█▍        | 5652/37963 [12:44:57<69:16:51,  7.72s/it]
 15%|█▍        | 5653/37963 [12:45:05<69:23:37,  7.73s/it]
 15%|█▍        | 5654/37963 [12:45:13<70:01:10,  7.80s/it]
 15%|█▍        | 5655/37963 [12:45:20<69:36:09,  7.76s/it]
 15%|█▍        | 5656/37963 [12:45:28<69:11:44,  7.71s/it]
 15%|█▍        | 5657/37963 [12:45:36<69:08:23,  7.70s/it]
 15%|█▍        | 5658/37963 [12:45:43<69:05:09,  7.70s/it]
 15%|█▍        | 5659/37963 [12:45:51<68:53:28,  7.68s/it]
 15%|█▍        | 5660/37963 [12:45:58<68:32:00,  7.64s/it]
                                                          
{'loss': '0.1946', 'grad_norm': '2.362', 'learning_rate': '1.927e-05', 'epoch': '0.1491'}
+
 15%|█▍        | 5660/37963 [12:45:58<68:32:00,  7.64s/it]
 15%|█▍        | 5661/37963 [12:46:09<75:01:24,  8.36s/it]
 15%|█▍        | 5662/37963 [12:46:16<73:24:36,  8.18s/it]
 15%|█▍        | 5663/37963 [12:46:24<72:09:58,  8.04s/it]
 15%|█▍        | 5664/37963 [12:46:34<78:22:21,  8.74s/it]
 15%|█▍        | 5665/37963 [12:46:42<75:54:53,  8.46s/it]
 15%|█▍        | 5666/37963 [12:46:50<73:28:10,  8.19s/it]
 15%|█▍        | 5667/37963 [12:46:57<72:18:55,  8.06s/it]
 15%|█▍        | 5668/37963 [12:47:05<71:20:34,  7.95s/it]
 15%|█▍        | 5669/37963 [12:47:13<70:30:49,  7.86s/it]
 15%|█▍        | 5670/37963 [12:47:23<77:07:59,  8.60s/it]
                                                          
{'loss': '0.1906', 'grad_norm': '6.162', 'learning_rate': '1.926e-05', 'epoch': '0.1494'}
+
 15%|█▍        | 5670/37963 [12:47:23<77:07:59,  8.60s/it]
 15%|█▍        | 5671/37963 [12:47:31<74:35:12,  8.32s/it]
 15%|█▍        | 5672/37963 [12:47:39<73:21:09,  8.18s/it]
 15%|█▍        | 5673/37963 [12:47:46<71:57:29,  8.02s/it]
 15%|█▍        | 5674/37963 [12:47:57<78:06:43,  8.71s/it]
 15%|█▍        | 5675/37963 [12:48:07<82:31:29,  9.20s/it]
 15%|█▍        | 5676/37963 [12:48:15<78:18:53,  8.73s/it]
 15%|█▍        | 5677/37963 [12:48:22<75:37:47,  8.43s/it]
 15%|█▍        | 5678/37963 [12:48:30<73:04:21,  8.15s/it]
 15%|█▍        | 5679/37963 [12:48:38<71:51:12,  8.01s/it]
 15%|█▍        | 5680/37963 [12:48:45<71:28:28,  7.97s/it]
                                                          
{'loss': '0.1794', 'grad_norm': '1.571', 'learning_rate': '1.926e-05', 'epoch': '0.1496'}
+
 15%|█▍        | 5680/37963 [12:48:45<71:28:28,  7.97s/it]
 15%|█▍        | 5681/37963 [12:48:55<76:19:28,  8.51s/it]
 15%|█▍        | 5682/37963 [12:49:06<81:35:55,  9.10s/it]
 15%|█▍        | 5683/37963 [12:49:13<77:58:42,  8.70s/it]
 15%|█▍        | 5684/37963 [12:49:21<75:02:29,  8.37s/it]
 15%|█▍        | 5685/37963 [12:49:29<73:16:09,  8.17s/it]
 15%|█▍        | 5686/37963 [12:49:36<71:29:35,  7.97s/it]
 15%|█▍        | 5687/37963 [12:49:44<70:34:02,  7.87s/it]
 15%|█▍        | 5688/37963 [12:49:52<70:20:21,  7.85s/it]
 15%|█▍        | 5689/37963 [12:49:59<69:52:15,  7.79s/it]
 15%|█▍        | 5690/37963 [12:50:07<69:43:28,  7.78s/it]
                                                          
{'loss': '0.1752', 'grad_norm': '1.626', 'learning_rate': '1.926e-05', 'epoch': '0.1499'}
+
 15%|█▍        | 5690/37963 [12:50:07<69:43:28,  7.78s/it]
 15%|█▍        | 5691/37963 [12:50:15<70:07:10,  7.82s/it]
 15%|█▍        | 5692/37963 [12:50:23<70:27:29,  7.86s/it]
 15%|█▍        | 5693/37963 [12:50:33<76:05:07,  8.49s/it]
 15%|█▍        | 5694/37963 [12:50:41<73:57:53,  8.25s/it]
 15%|█▌        | 5695/37963 [12:50:48<72:24:53,  8.08s/it]
 15%|█▌        | 5696/37963 [12:50:56<71:14:29,  7.95s/it]
 15%|█▌        | 5697/37963 [12:51:03<69:39:04,  7.77s/it]
 15%|█▌        | 5698/37963 [12:51:11<69:08:55,  7.72s/it]
 15%|█▌        | 5699/37963 [12:51:19<69:25:40,  7.75s/it]
 15%|█▌        | 5700/37963 [12:51:26<69:10:56,  7.72s/it]
                                                          
{'loss': '0.1587', 'grad_norm': '3.525', 'learning_rate': '1.925e-05', 'epoch': '0.1501'}
+
 15%|█▌        | 5700/37963 [12:51:26<69:10:56,  7.72s/it]
 15%|█▌        | 5701/37963 [12:51:34<69:10:53,  7.72s/it]
 15%|█▌        | 5702/37963 [12:51:42<69:10:56,  7.72s/it]
 15%|█▌        | 5703/37963 [12:51:50<69:20:57,  7.74s/it]
 15%|█▌        | 5704/37963 [12:51:57<69:05:35,  7.71s/it]
 15%|█▌        | 5705/37963 [12:52:05<69:07:37,  7.71s/it]
 15%|█▌        | 5706/37963 [12:52:13<69:01:04,  7.70s/it]
 15%|█▌        | 5707/37963 [12:52:20<68:43:18,  7.67s/it]
 15%|█▌        | 5708/37963 [12:52:28<68:09:27,  7.61s/it]
 15%|█▌        | 5709/37963 [12:52:38<75:04:14,  8.38s/it]
 15%|█▌        | 5710/37963 [12:52:46<74:15:51,  8.29s/it]
                                                          
{'loss': '0.1754', 'grad_norm': '6.939', 'learning_rate': '1.925e-05', 'epoch': '0.1504'}
+
 15%|█▌        | 5710/37963 [12:52:46<74:15:51,  8.29s/it]
 15%|█▌        | 5711/37963 [12:52:54<72:44:06,  8.12s/it]
 15%|█▌        | 5712/37963 [12:53:01<71:38:17,  8.00s/it]
 15%|█▌        | 5713/37963 [12:53:12<77:33:50,  8.66s/it]
 15%|█▌        | 5714/37963 [12:53:19<74:57:54,  8.37s/it]
 15%|█▌        | 5715/37963 [12:53:27<73:40:07,  8.22s/it]
 15%|█▌        | 5716/37963 [12:53:35<72:05:06,  8.05s/it]
 15%|█▌        | 5717/37963 [12:53:42<71:14:06,  7.95s/it]
 15%|█▌        | 5718/37963 [12:53:50<70:52:18,  7.91s/it]
 15%|█▌        | 5719/37963 [12:53:58<69:23:49,  7.75s/it]
 15%|█▌        | 5720/37963 [12:54:05<69:23:11,  7.75s/it]
                                                          
{'loss': '0.1762', 'grad_norm': '5.428', 'learning_rate': '1.925e-05', 'epoch': '0.1507'}
+
 15%|█▌        | 5720/37963 [12:54:05<69:23:11,  7.75s/it]
 15%|█▌        | 5721/37963 [12:54:13<69:41:30,  7.78s/it]
 15%|█▌        | 5722/37963 [12:54:24<76:43:21,  8.57s/it]
 15%|█▌        | 5723/37963 [12:54:32<74:53:11,  8.36s/it]
 15%|█▌        | 5724/37963 [12:54:42<80:27:30,  8.98s/it]
 15%|█▌        | 5725/37963 [12:54:50<77:04:42,  8.61s/it]
 15%|█▌        | 5726/37963 [12:54:58<75:30:01,  8.43s/it]
 15%|█▌        | 5727/37963 [12:55:05<73:10:47,  8.17s/it]
 15%|█▌        | 5728/37963 [12:55:13<71:37:50,  8.00s/it]
 15%|█▌        | 5729/37963 [12:55:26<84:39:56,  9.46s/it]
 15%|█▌        | 5730/37963 [12:55:37<88:19:59,  9.87s/it]
                                                          
{'loss': '0.1824', 'grad_norm': '3.78', 'learning_rate': '1.924e-05', 'epoch': '0.1509'}
+
 15%|█▌        | 5730/37963 [12:55:37<88:19:59,  9.87s/it]
 15%|█▌        | 5731/37963 [12:55:44<82:27:32,  9.21s/it]
 15%|█▌        | 5732/37963 [12:55:52<78:37:31,  8.78s/it]
 15%|█▌        | 5733/37963 [12:56:00<75:51:37,  8.47s/it]
 15%|█▌        | 5734/37963 [12:56:08<74:13:52,  8.29s/it]
 15%|█▌        | 5735/37963 [12:56:16<73:15:58,  8.18s/it]
 15%|█▌        | 5736/37963 [12:56:23<72:06:35,  8.06s/it]
 15%|█▌        | 5737/37963 [12:56:31<71:47:44,  8.02s/it]
 15%|█▌        | 5738/37963 [12:56:39<70:28:14,  7.87s/it]
 15%|█▌        | 5739/37963 [12:56:46<69:13:27,  7.73s/it]
 15%|█▌        | 5740/37963 [12:56:54<69:07:20,  7.72s/it]
                                                          
{'loss': '0.1812', 'grad_norm': '4.406', 'learning_rate': '1.924e-05', 'epoch': '0.1512'}
+
 15%|█▌        | 5740/37963 [12:56:54<69:07:20,  7.72s/it]
 15%|█▌        | 5741/37963 [12:57:02<69:16:40,  7.74s/it]
 15%|█▌        | 5742/37963 [12:57:09<68:57:57,  7.71s/it]
 15%|█▌        | 5743/37963 [12:57:17<68:35:35,  7.66s/it]
 15%|█▌        | 5744/37963 [12:57:25<68:26:34,  7.65s/it]
 15%|█▌        | 5745/37963 [12:57:32<68:14:51,  7.63s/it]
 15%|█▌        | 5746/37963 [12:57:42<74:56:10,  8.37s/it]
 15%|█▌        | 5747/37963 [12:57:50<72:56:42,  8.15s/it]
 15%|█▌        | 5748/37963 [12:57:58<72:20:09,  8.08s/it]
 15%|█▌        | 5749/37963 [12:58:05<70:42:33,  7.90s/it]
 15%|█▌        | 5750/37963 [12:58:13<70:02:11,  7.83s/it]
                                                          
{'loss': '0.1723', 'grad_norm': '5.304', 'learning_rate': '1.924e-05', 'epoch': '0.1515'}
+
 15%|█▌        | 5750/37963 [12:58:13<70:02:11,  7.83s/it]
 15%|█▌        | 5751/37963 [12:58:21<69:40:06,  7.79s/it]
 15%|█▌        | 5752/37963 [12:58:28<69:38:10,  7.78s/it]
 15%|█▌        | 5753/37963 [12:58:36<68:40:38,  7.68s/it]
 15%|█▌        | 5754/37963 [12:58:44<68:59:16,  7.71s/it]
 15%|█▌        | 5755/37963 [12:58:51<69:02:52,  7.72s/it]
 15%|█▌        | 5756/37963 [12:58:59<68:39:57,  7.68s/it]
 15%|█▌        | 5757/37963 [12:59:09<75:17:18,  8.42s/it]
 15%|█▌        | 5758/37963 [12:59:17<73:03:36,  8.17s/it]
 15%|█▌        | 5759/37963 [12:59:24<71:35:12,  8.00s/it]
 15%|█▌        | 5760/37963 [12:59:32<70:36:10,  7.89s/it]
                                                          
{'loss': '0.1721', 'grad_norm': '3.532', 'learning_rate': '1.923e-05', 'epoch': '0.1517'}
+
 15%|█▌        | 5760/37963 [12:59:32<70:36:10,  7.89s/it]
 15%|█▌        | 5761/37963 [12:59:40<70:22:24,  7.87s/it]
 15%|█▌        | 5762/37963 [12:59:47<69:09:26,  7.73s/it]
 15%|█▌        | 5763/37963 [12:59:55<69:18:45,  7.75s/it]
 15%|█▌        | 5764/37963 [13:00:03<69:12:30,  7.74s/it]
 15%|█▌        | 5765/37963 [13:00:10<68:30:51,  7.66s/it]
 15%|█▌        | 5766/37963 [13:00:20<75:01:26,  8.39s/it]
 15%|█▌        | 5767/37963 [13:00:28<73:26:43,  8.21s/it]
 15%|█▌        | 5768/37963 [13:00:38<79:17:38,  8.87s/it]
 15%|█▌        | 5769/37963 [13:00:46<76:35:15,  8.56s/it]
 15%|█▌        | 5770/37963 [13:00:57<81:26:55,  9.11s/it]
                                                          
{'loss': '0.1722', 'grad_norm': '1.685', 'learning_rate': '1.923e-05', 'epoch': '0.152'}
+
 15%|█▌        | 5770/37963 [13:00:57<81:26:55,  9.11s/it]
 15%|█▌        | 5771/37963 [13:01:04<77:17:25,  8.64s/it]
 15%|█▌        | 5772/37963 [13:01:12<75:09:17,  8.40s/it]
 15%|█▌        | 5773/37963 [13:01:20<73:15:26,  8.19s/it]
 15%|█▌        | 5774/37963 [13:01:28<72:44:56,  8.14s/it]
 15%|█▌        | 5775/37963 [13:01:38<78:19:07,  8.76s/it]
 15%|█▌        | 5776/37963 [13:01:46<76:00:11,  8.50s/it]
 15%|█▌        | 5777/37963 [13:01:56<80:37:53,  9.02s/it]
 15%|█▌        | 5778/37963 [13:02:07<84:53:39,  9.50s/it]
 15%|█▌        | 5779/37963 [13:02:14<79:53:25,  8.94s/it]
 15%|█▌        | 5780/37963 [13:02:22<76:27:04,  8.55s/it]
                                                          
{'loss': '0.1751', 'grad_norm': '2.34', 'learning_rate': '1.923e-05', 'epoch': '0.1523'}
+
 15%|█▌        | 5780/37963 [13:02:22<76:27:04,  8.55s/it]
 15%|█▌        | 5781/37963 [13:02:30<74:30:02,  8.33s/it]
 15%|█▌        | 5782/37963 [13:02:37<72:34:02,  8.12s/it]
 15%|█▌        | 5783/37963 [13:02:45<71:36:35,  8.01s/it]
 15%|█▌        | 5784/37963 [13:02:53<70:59:26,  7.94s/it]
 15%|█▌        | 5785/37963 [13:03:01<70:15:57,  7.86s/it]
 15%|█▌        | 5786/37963 [13:03:08<70:08:25,  7.85s/it]
 15%|█▌        | 5787/37963 [13:03:16<70:11:27,  7.85s/it]
 15%|█▌        | 5788/37963 [13:03:24<70:11:57,  7.85s/it]
 15%|█▌        | 5789/37963 [13:03:32<69:46:38,  7.81s/it]
 15%|█▌        | 5790/37963 [13:03:40<69:58:29,  7.83s/it]
                                                          
{'loss': '0.1688', 'grad_norm': '2.42', 'learning_rate': '1.922e-05', 'epoch': '0.1525'}
+
 15%|█▌        | 5790/37963 [13:03:40<69:58:29,  7.83s/it]
 15%|█▌        | 5791/37963 [13:03:47<69:40:35,  7.80s/it]
 15%|█▌        | 5792/37963 [13:03:55<69:17:52,  7.75s/it]
 15%|█▌        | 5793/37963 [13:04:03<69:23:35,  7.77s/it]
 15%|█▌        | 5794/37963 [13:04:11<69:25:15,  7.77s/it]
 15%|█▌        | 5795/37963 [13:04:18<68:55:15,  7.71s/it]
 15%|█▌        | 5796/37963 [13:04:26<69:05:22,  7.73s/it]
 15%|█▌        | 5797/37963 [13:04:34<69:12:29,  7.75s/it]
 15%|█▌        | 5798/37963 [13:04:44<76:08:54,  8.52s/it]
 15%|█▌        | 5799/37963 [13:04:52<74:20:49,  8.32s/it]
 15%|█▌        | 5800/37963 [13:05:00<72:26:26,  8.11s/it]
                                                          
{'loss': '0.1848', 'grad_norm': '8.276', 'learning_rate': '1.922e-05', 'epoch': '0.1528'}
+
 15%|█▌        | 5800/37963 [13:05:00<72:26:26,  8.11s/it]
 15%|█▌        | 5801/37963 [13:05:07<71:20:29,  7.99s/it]
 15%|█▌        | 5802/37963 [13:05:15<69:59:22,  7.83s/it]
 15%|█▌        | 5803/37963 [13:05:22<69:33:51,  7.79s/it]
 15%|█▌        | 5804/37963 [13:05:30<68:31:18,  7.67s/it]
 15%|█▌        | 5805/37963 [13:05:37<68:16:16,  7.64s/it]
 15%|█▌        | 5806/37963 [13:05:45<67:47:27,  7.59s/it]
 15%|█▌        | 5807/37963 [13:05:53<67:55:09,  7.60s/it]
 15%|█▌        | 5808/37963 [13:06:00<68:16:21,  7.64s/it]
 15%|█▌        | 5809/37963 [13:06:08<68:14:06,  7.64s/it]
 15%|█▌        | 5810/37963 [13:06:18<75:24:45,  8.44s/it]
                                                          
{'loss': '0.1793', 'grad_norm': '4.375', 'learning_rate': '1.922e-05', 'epoch': '0.153'}
+
 15%|█▌        | 5810/37963 [13:06:18<75:24:45,  8.44s/it]
 15%|█▌        | 5811/37963 [13:06:28<80:09:14,  8.97s/it]
 15%|█▌        | 5812/37963 [13:06:36<76:22:05,  8.55s/it]
 15%|█▌        | 5813/37963 [13:06:44<74:29:42,  8.34s/it]
 15%|█▌        | 5814/37963 [13:06:52<72:46:33,  8.15s/it]
 15%|█▌        | 5815/37963 [13:06:59<71:29:28,  8.01s/it]
 15%|█▌        | 5816/37963 [13:07:07<70:12:45,  7.86s/it]
 15%|█▌        | 5817/37963 [13:07:17<76:42:18,  8.59s/it]
 15%|█▌        | 5818/37963 [13:07:25<74:21:19,  8.33s/it]
 15%|█▌        | 5819/37963 [13:07:32<72:34:27,  8.13s/it]
 15%|█▌        | 5820/37963 [13:07:40<71:23:17,  8.00s/it]
                                                          
{'loss': '0.1691', 'grad_norm': '1.042', 'learning_rate': '1.921e-05', 'epoch': '0.1533'}
+
 15%|█▌        | 5820/37963 [13:07:40<71:23:17,  8.00s/it]
 15%|█▌        | 5821/37963 [13:07:51<78:08:34,  8.75s/it]
 15%|█▌        | 5822/37963 [13:08:01<81:51:38,  9.17s/it]
 15%|█▌        | 5823/37963 [13:08:08<77:50:41,  8.72s/it]
 15%|█▌        | 5824/37963 [13:08:16<75:20:33,  8.44s/it]
 15%|█▌        | 5825/37963 [13:08:24<73:31:02,  8.24s/it]
 15%|█▌        | 5826/37963 [13:08:37<86:30:18,  9.69s/it]
 15%|█▌        | 5827/37963 [13:08:45<81:09:26,  9.09s/it]
 15%|█▌        | 5828/37963 [13:08:53<77:39:20,  8.70s/it]
 15%|█▌        | 5829/37963 [13:09:00<75:34:57,  8.47s/it]
 15%|█▌        | 5830/37963 [13:09:08<73:28:57,  8.23s/it]
                                                          
{'loss': '0.1812', 'grad_norm': '2.56', 'learning_rate': '1.921e-05', 'epoch': '0.1536'}
+
 15%|█▌        | 5830/37963 [13:09:08<73:28:57,  8.23s/it]
 15%|█▌        | 5831/37963 [13:09:16<72:35:32,  8.13s/it]
 15%|█▌        | 5832/37963 [13:09:24<71:19:50,  7.99s/it]
 15%|█▌        | 5833/37963 [13:09:31<69:44:28,  7.81s/it]
 15%|█▌        | 5834/37963 [13:09:39<69:42:40,  7.81s/it]
 15%|█▌        | 5835/37963 [13:09:47<69:16:53,  7.76s/it]
 15%|█▌        | 5836/37963 [13:09:54<68:37:03,  7.69s/it]
 15%|█▌        | 5837/37963 [13:10:02<69:05:48,  7.74s/it]
 15%|█▌        | 5838/37963 [13:10:10<68:55:36,  7.72s/it]
 15%|█▌        | 5839/37963 [13:10:17<68:50:07,  7.71s/it]
 15%|█▌        | 5840/37963 [13:10:25<69:19:26,  7.77s/it]
                                                          
{'loss': '0.1637', 'grad_norm': '3.543', 'learning_rate': '1.921e-05', 'epoch': '0.1538'}
+
 15%|█▌        | 5840/37963 [13:10:25<69:19:26,  7.77s/it]
 15%|█▌        | 5841/37963 [13:10:33<69:46:40,  7.82s/it]
 15%|█▌        | 5842/37963 [13:10:43<76:16:00,  8.55s/it]
 15%|█▌        | 5843/37963 [13:10:51<74:20:12,  8.33s/it]
 15%|█▌        | 5844/37963 [13:10:59<72:46:23,  8.16s/it]
 15%|█▌        | 5845/37963 [13:11:06<70:46:29,  7.93s/it]
 15%|█▌        | 5846/37963 [13:11:14<69:34:28,  7.80s/it]
 15%|█▌        | 5847/37963 [13:11:21<68:21:24,  7.66s/it]
 15%|█▌        | 5848/37963 [13:11:29<68:38:56,  7.70s/it]
 15%|█▌        | 5849/37963 [13:11:37<68:48:04,  7.71s/it]
 15%|█▌        | 5850/37963 [13:11:44<68:46:45,  7.71s/it]
                                                          
{'loss': '0.1737', 'grad_norm': '1.405', 'learning_rate': '1.92e-05', 'epoch': '0.1541'}
+
 15%|█▌        | 5850/37963 [13:11:44<68:46:45,  7.71s/it]
 15%|█▌        | 5851/37963 [13:11:52<68:18:47,  7.66s/it]
 15%|█▌        | 5852/37963 [13:12:00<68:03:29,  7.63s/it]
 15%|█▌        | 5853/37963 [13:12:07<68:48:43,  7.71s/it]
 15%|█▌        | 5854/37963 [13:12:18<75:07:53,  8.42s/it]
 15%|█▌        | 5855/37963 [13:12:25<73:39:20,  8.26s/it]
 15%|█▌        | 5856/37963 [13:12:33<73:05:09,  8.19s/it]
 15%|█▌        | 5857/37963 [13:12:41<71:08:15,  7.98s/it]
 15%|█▌        | 5858/37963 [13:12:48<69:30:56,  7.79s/it]
 15%|█▌        | 5859/37963 [13:12:56<69:58:26,  7.85s/it]
 15%|█▌        | 5860/37963 [13:13:04<69:58:54,  7.85s/it]
                                                          
{'loss': '0.1758', 'grad_norm': '1.487', 'learning_rate': '1.92e-05', 'epoch': '0.1544'}
+
 15%|█▌        | 5860/37963 [13:13:04<69:58:54,  7.85s/it]
 15%|█▌        | 5861/37963 [13:13:12<69:45:12,  7.82s/it]
 15%|█▌        | 5862/37963 [13:13:20<69:49:44,  7.83s/it]
 15%|█▌        | 5863/37963 [13:13:27<69:22:00,  7.78s/it]
 15%|█▌        | 5864/37963 [13:13:35<68:43:31,  7.71s/it]
 15%|█▌        | 5865/37963 [13:13:48<82:13:32,  9.22s/it]
 15%|█▌        | 5866/37963 [13:13:55<78:10:10,  8.77s/it]
 15%|█▌        | 5867/37963 [13:14:03<74:31:56,  8.36s/it]
 15%|█▌        | 5868/37963 [13:14:15<85:58:54,  9.64s/it]
 15%|█▌        | 5869/37963 [13:14:23<81:00:13,  9.09s/it]
 15%|█▌        | 5870/37963 [13:14:31<78:03:30,  8.76s/it]
                                                          
{'loss': '0.1698', 'grad_norm': '1.569', 'learning_rate': '1.92e-05', 'epoch': '0.1546'}
+
 15%|█▌        | 5870/37963 [13:14:31<78:03:30,  8.76s/it]
 15%|█▌        | 5871/37963 [13:14:39<74:59:33,  8.41s/it]
 15%|█▌        | 5872/37963 [13:14:46<72:27:12,  8.13s/it]
 15%|█▌        | 5873/37963 [13:14:54<70:29:35,  7.91s/it]
 15%|█▌        | 5874/37963 [13:15:06<82:54:49,  9.30s/it]
 15%|█▌        | 5875/37963 [13:15:14<77:39:16,  8.71s/it]
 15%|█▌        | 5876/37963 [13:15:21<74:39:55,  8.38s/it]
 15%|█▌        | 5877/37963 [13:15:29<72:54:35,  8.18s/it]
 15%|█▌        | 5878/37963 [13:15:37<71:33:55,  8.03s/it]
 15%|█▌        | 5879/37963 [13:15:44<70:27:52,  7.91s/it]
 15%|█▌        | 5880/37963 [13:15:52<70:09:52,  7.87s/it]
                                                          
{'loss': '0.167', 'grad_norm': '5.11', 'learning_rate': '1.919e-05', 'epoch': '0.1549'}
+
 15%|█▌        | 5880/37963 [13:15:52<70:09:52,  7.87s/it]
 15%|█▌        | 5881/37963 [13:16:00<69:28:22,  7.80s/it]
 15%|█▌        | 5882/37963 [13:16:07<69:16:30,  7.77s/it]
 15%|█▌        | 5883/37963 [13:16:15<69:04:04,  7.75s/it]
 15%|█▌        | 5884/37963 [13:16:23<68:43:12,  7.71s/it]
 16%|█▌        | 5885/37963 [13:16:30<68:50:04,  7.73s/it]
 16%|█▌        | 5886/37963 [13:16:38<68:51:06,  7.73s/it]
 16%|█▌        | 5887/37963 [13:16:48<75:41:35,  8.50s/it]
 16%|█▌        | 5888/37963 [13:16:56<72:48:21,  8.17s/it]
 16%|█▌        | 5889/37963 [13:17:04<71:32:55,  8.03s/it]
 16%|█▌        | 5890/37963 [13:17:11<71:15:52,  8.00s/it]
                                                          
{'loss': '0.1777', 'grad_norm': '4.644', 'learning_rate': '1.919e-05', 'epoch': '0.1552'}
+
 16%|█▌        | 5890/37963 [13:17:11<71:15:52,  8.00s/it]
 16%|█▌        | 5891/37963 [13:17:19<70:46:28,  7.94s/it]
 16%|█▌        | 5892/37963 [13:17:27<69:49:42,  7.84s/it]
 16%|█▌        | 5893/37963 [13:17:35<70:20:53,  7.90s/it]
 16%|█▌        | 5894/37963 [13:17:43<70:03:11,  7.86s/it]
 16%|█▌        | 5895/37963 [13:17:50<69:05:50,  7.76s/it]
 16%|█▌        | 5896/37963 [13:17:58<68:48:30,  7.72s/it]
 16%|█▌        | 5897/37963 [13:18:08<75:45:25,  8.51s/it]
 16%|█▌        | 5898/37963 [13:18:16<73:23:21,  8.24s/it]
 16%|█▌        | 5899/37963 [13:18:23<71:38:22,  8.04s/it]
 16%|█▌        | 5900/37963 [13:18:31<70:49:53,  7.95s/it]
                                                          
{'loss': '0.1731', 'grad_norm': '1.653', 'learning_rate': '1.919e-05', 'epoch': '0.1554'}
+
 16%|█▌        | 5900/37963 [13:18:31<70:49:53,  7.95s/it]
 16%|█▌        | 5901/37963 [13:18:39<69:54:55,  7.85s/it]
 16%|█▌        | 5902/37963 [13:18:46<69:10:25,  7.77s/it]
 16%|█▌        | 5903/37963 [13:18:54<69:13:05,  7.77s/it]
 16%|█▌        | 5904/37963 [13:19:02<69:14:21,  7.78s/it]
 16%|█▌        | 5905/37963 [13:19:09<68:39:26,  7.71s/it]
 16%|█▌        | 5906/37963 [13:19:17<69:13:31,  7.77s/it]
 16%|█▌        | 5907/37963 [13:19:25<68:47:43,  7.73s/it]
 16%|█▌        | 5908/37963 [13:19:35<75:44:16,  8.51s/it]
 16%|█▌        | 5909/37963 [13:19:43<73:21:51,  8.24s/it]
 16%|█▌        | 5910/37963 [13:19:51<72:02:44,  8.09s/it]
                                                          
{'loss': '0.1783', 'grad_norm': '4.182', 'learning_rate': '1.918e-05', 'epoch': '0.1557'}
+
 16%|█▌        | 5910/37963 [13:19:51<72:02:44,  8.09s/it]
 16%|█▌        | 5911/37963 [13:19:58<71:21:26,  8.01s/it]
 16%|█▌        | 5912/37963 [13:20:06<70:08:38,  7.88s/it]
 16%|█▌        | 5913/37963 [13:20:14<69:10:12,  7.77s/it]
 16%|█▌        | 5914/37963 [13:20:24<76:36:09,  8.60s/it]
 16%|█▌        | 5915/37963 [13:20:32<74:20:05,  8.35s/it]
 16%|█▌        | 5916/37963 [13:20:40<72:46:28,  8.18s/it]
 16%|█▌        | 5917/37963 [13:20:50<78:40:42,  8.84s/it]
 16%|█▌        | 5918/37963 [13:20:58<75:50:52,  8.52s/it]
 16%|█▌        | 5919/37963 [13:21:08<80:12:38,  9.01s/it]
 16%|█▌        | 5920/37963 [13:21:16<76:54:27,  8.64s/it]
                                                          
{'loss': '0.1789', 'grad_norm': '1.66', 'learning_rate': '1.918e-05', 'epoch': '0.1559'}
+
 16%|█▌        | 5920/37963 [13:21:16<76:54:27,  8.64s/it]
 16%|█▌        | 5921/37963 [13:21:23<74:29:38,  8.37s/it]
 16%|█▌        | 5922/37963 [13:21:33<78:31:44,  8.82s/it]
 16%|█▌        | 5923/37963 [13:21:41<75:45:00,  8.51s/it]
 16%|█▌        | 5924/37963 [13:21:49<74:36:55,  8.38s/it]
 16%|█▌        | 5925/37963 [13:21:57<72:12:02,  8.11s/it]
 16%|█▌        | 5926/37963 [13:22:04<70:47:58,  7.96s/it]
 16%|█▌        | 5927/37963 [13:22:15<77:15:09,  8.68s/it]
 16%|█▌        | 5928/37963 [13:22:22<74:47:16,  8.40s/it]
 16%|█▌        | 5929/37963 [13:22:30<72:43:28,  8.17s/it]
 16%|█▌        | 5930/37963 [13:22:38<71:10:37,  8.00s/it]
                                                          
{'loss': '0.1801', 'grad_norm': '2.045', 'learning_rate': '1.918e-05', 'epoch': '0.1562'}
+
 16%|█▌        | 5930/37963 [13:22:38<71:10:37,  8.00s/it]
 16%|█▌        | 5931/37963 [13:22:48<77:08:50,  8.67s/it]
 16%|█▌        | 5932/37963 [13:22:56<74:20:42,  8.36s/it]
 16%|█▌        | 5933/37963 [13:23:03<73:02:17,  8.21s/it]
 16%|█▌        | 5934/37963 [13:23:11<71:38:47,  8.05s/it]
 16%|█▌        | 5935/37963 [13:23:18<69:52:22,  7.85s/it]
 16%|█▌        | 5936/37963 [13:23:26<69:13:25,  7.78s/it]
 16%|█▌        | 5937/37963 [13:23:34<69:18:19,  7.79s/it]
 16%|█▌        | 5938/37963 [13:23:42<68:56:24,  7.75s/it]
 16%|█▌        | 5939/37963 [13:23:49<68:51:41,  7.74s/it]
 16%|█▌        | 5940/37963 [13:23:57<68:49:21,  7.74s/it]
                                                          
{'loss': '0.1815', 'grad_norm': '2.953', 'learning_rate': '1.917e-05', 'epoch': '0.1565'}
+
 16%|█▌        | 5940/37963 [13:23:57<68:49:21,  7.74s/it]
 16%|█▌        | 5941/37963 [13:24:04<68:11:16,  7.67s/it]
 16%|█▌        | 5942/37963 [13:24:12<68:06:31,  7.66s/it]
 16%|█▌        | 5943/37963 [13:24:20<68:06:44,  7.66s/it]
 16%|█▌        | 5944/37963 [13:24:28<68:34:35,  7.71s/it]
 16%|█▌        | 5945/37963 [13:24:35<68:16:08,  7.68s/it]
 16%|█▌        | 5946/37963 [13:24:43<68:11:30,  7.67s/it]
 16%|█▌        | 5947/37963 [13:24:51<68:34:36,  7.71s/it]
 16%|█▌        | 5948/37963 [13:24:58<68:42:50,  7.73s/it]
 16%|█▌        | 5949/37963 [13:25:06<69:00:00,  7.76s/it]
 16%|█▌        | 5950/37963 [13:25:14<68:35:19,  7.71s/it]
                                                          
{'loss': '0.1766', 'grad_norm': '1.933', 'learning_rate': '1.917e-05', 'epoch': '0.1567'}
+
 16%|█▌        | 5950/37963 [13:25:14<68:35:19,  7.71s/it]
 16%|█▌        | 5951/37963 [13:25:24<75:50:34,  8.53s/it]
 16%|█▌        | 5952/37963 [13:25:32<73:39:09,  8.28s/it]
 16%|█▌        | 5953/37963 [13:25:39<71:19:44,  8.02s/it]
 16%|█▌        | 5954/37963 [13:25:47<70:27:54,  7.93s/it]
 16%|█▌        | 5955/37963 [13:25:55<69:22:16,  7.80s/it]
 16%|█▌        | 5956/37963 [13:26:02<69:08:51,  7.78s/it]
 16%|█▌        | 5957/37963 [13:26:13<75:41:52,  8.51s/it]
 16%|█▌        | 5958/37963 [13:26:20<73:48:11,  8.30s/it]
 16%|█▌        | 5959/37963 [13:26:28<72:26:09,  8.15s/it]
 16%|█▌        | 5960/37963 [13:26:36<71:07:39,  8.00s/it]
                                                          
{'loss': '0.1676', 'grad_norm': '2.476', 'learning_rate': '1.917e-05', 'epoch': '0.157'}
+
 16%|█▌        | 5960/37963 [13:26:36<71:07:39,  8.00s/it]
 16%|█▌        | 5961/37963 [13:26:44<70:18:02,  7.91s/it]
 16%|█▌        | 5962/37963 [13:26:54<77:45:23,  8.75s/it]
 16%|█▌        | 5963/37963 [13:27:02<75:15:05,  8.47s/it]
 16%|█▌        | 5964/37963 [13:27:10<72:55:42,  8.20s/it]
 16%|█▌        | 5965/37963 [13:27:17<71:22:56,  8.03s/it]
 16%|█▌        | 5966/37963 [13:27:30<84:09:20,  9.47s/it]
 16%|█▌        | 5967/37963 [13:27:38<79:44:28,  8.97s/it]
 16%|█▌        | 5968/37963 [13:27:48<83:12:26,  9.36s/it]
 16%|█▌        | 5969/37963 [13:27:56<79:22:06,  8.93s/it]
 16%|█▌        | 5970/37963 [13:28:04<76:15:47,  8.58s/it]
                                                          
{'loss': '0.1835', 'grad_norm': '2.014', 'learning_rate': '1.916e-05', 'epoch': '0.1573'}
+
 16%|█▌        | 5970/37963 [13:28:04<76:15:47,  8.58s/it]
 16%|█▌        | 5971/37963 [13:28:11<73:35:41,  8.28s/it]
 16%|█▌        | 5972/37963 [13:28:19<71:48:08,  8.08s/it]
 16%|█▌        | 5973/37963 [13:28:27<70:33:40,  7.94s/it]
 16%|█▌        | 5974/37963 [13:28:34<69:52:04,  7.86s/it]
 16%|█▌        | 5975/37963 [13:28:45<76:49:14,  8.65s/it]
 16%|█▌        | 5976/37963 [13:28:53<75:02:27,  8.45s/it]
 16%|█▌        | 5977/37963 [13:29:00<72:50:33,  8.20s/it]
 16%|█▌        | 5978/37963 [13:29:08<71:15:33,  8.02s/it]
 16%|█▌        | 5979/37963 [13:29:18<76:52:10,  8.65s/it]
 16%|█▌        | 5980/37963 [13:29:26<74:07:25,  8.34s/it]
                                                          
{'loss': '0.1818', 'grad_norm': '1.461', 'learning_rate': '1.916e-05', 'epoch': '0.1575'}
+
 16%|█▌        | 5980/37963 [13:29:26<74:07:25,  8.34s/it]
 16%|█▌        | 5981/37963 [13:29:34<73:04:00,  8.22s/it]
 16%|█▌        | 5982/37963 [13:29:41<70:44:50,  7.96s/it]
 16%|█▌        | 5983/37963 [13:29:49<69:54:52,  7.87s/it]
 16%|█▌        | 5984/37963 [13:29:57<69:40:08,  7.84s/it]
 16%|█▌        | 5985/37963 [13:30:04<69:20:29,  7.81s/it]
 16%|█▌        | 5986/37963 [13:30:12<68:43:10,  7.74s/it]
 16%|█▌        | 5987/37963 [13:30:19<68:25:18,  7.70s/it]
 16%|█▌        | 5988/37963 [13:30:28<69:33:16,  7.83s/it]
 16%|█▌        | 5989/37963 [13:30:35<69:10:33,  7.79s/it]
 16%|█▌        | 5990/37963 [13:30:43<68:46:29,  7.74s/it]
                                                          
{'loss': '0.1854', 'grad_norm': '4.397', 'learning_rate': '1.916e-05', 'epoch': '0.1578'}
+
 16%|█▌        | 5990/37963 [13:30:43<68:46:29,  7.74s/it]
 16%|█▌        | 5991/37963 [13:30:51<68:57:26,  7.76s/it]
 16%|█▌        | 5992/37963 [13:30:58<68:50:34,  7.75s/it]
 16%|█▌        | 5993/37963 [13:31:06<68:04:33,  7.67s/it]
 16%|█▌        | 5994/37963 [13:31:14<68:17:05,  7.69s/it]
 16%|█▌        | 5995/37963 [13:31:21<68:25:00,  7.70s/it]
 16%|█▌        | 5996/37963 [13:31:29<67:30:50,  7.60s/it]
 16%|█▌        | 5997/37963 [13:31:36<67:42:01,  7.62s/it]
 16%|█▌        | 5998/37963 [13:31:44<67:20:01,  7.58s/it]
 16%|█▌        | 5999/37963 [13:31:54<74:31:40,  8.39s/it]
 16%|█▌        | 6000/37963 [13:32:02<72:52:51,  8.21s/it]
                                                          
{'loss': '0.1834', 'grad_norm': '1.507', 'learning_rate': '1.915e-05', 'epoch': '0.158'}
+
 16%|█▌        | 6000/37963 [13:32:02<72:52:51,  8.21s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.58s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.58s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 16%|█▌        | 6001/37963 [13:33:05<219:15:04, 24.70s/it]
 16%|█▌        | 6002/37963 [13:33:13<173:59:45, 19.60s/it]
 16%|█▌        | 6003/37963 [13:33:21<142:20:45, 16.03s/it]
 16%|█▌        | 6004/37963 [13:33:31<126:33:58, 14.26s/it]
 16%|█▌        | 6005/37963 [13:33:38<109:23:52, 12.32s/it]
 16%|█▌        | 6006/37963 [13:33:49<103:43:36, 11.68s/it]
 16%|█▌        | 6007/37963 [13:33:56<92:49:25, 10.46s/it] 
 16%|█▌        | 6008/37963 [13:34:04<85:33:32,  9.64s/it]
 16%|█▌        | 6009/37963 [13:34:12<80:42:47,  9.09s/it]
 16%|█▌        | 6010/37963 [13:34:20<77:29:50,  8.73s/it]
                                                          
{'loss': '2.733', 'grad_norm': '15.86', 'learning_rate': '1.915e-05', 'epoch': '0.1583'}
+
 16%|█▌        | 6010/37963 [13:34:20<77:29:50,  8.73s/it]
 16%|█▌        | 6011/37963 [13:34:27<74:28:54,  8.39s/it]
 16%|█▌        | 6012/37963 [13:34:35<72:28:42,  8.17s/it]
 16%|█▌        | 6013/37963 [13:34:43<70:54:12,  7.99s/it]
 16%|█▌        | 6014/37963 [13:34:50<70:03:53,  7.89s/it]
 16%|█▌        | 6015/37963 [13:35:00<76:05:51,  8.57s/it]
 16%|█▌        | 6016/37963 [13:35:08<74:12:34,  8.36s/it]
 16%|█▌        | 6017/37963 [13:35:19<79:40:24,  8.98s/it]
 16%|█▌        | 6018/37963 [13:35:29<82:06:42,  9.25s/it]
 16%|█▌        | 6019/37963 [13:35:36<78:00:59,  8.79s/it]
 16%|█▌        | 6020/37963 [13:35:44<75:07:20,  8.47s/it]
                                                          
{'loss': '0.3128', 'grad_norm': '7.436', 'learning_rate': '1.915e-05', 'epoch': '0.1586'}
+
 16%|█▌        | 6020/37963 [13:35:44<75:07:20,  8.47s/it]
 16%|█▌        | 6021/37963 [13:35:52<73:05:10,  8.24s/it]
 16%|█▌        | 6022/37963 [13:35:59<71:36:54,  8.07s/it]
 16%|█▌        | 6023/37963 [13:36:07<70:25:58,  7.94s/it]
 16%|█▌        | 6024/37963 [13:36:15<69:40:46,  7.85s/it]
 16%|█▌        | 6025/37963 [13:36:24<74:51:32,  8.44s/it]
 16%|█▌        | 6026/37963 [13:36:32<73:16:20,  8.26s/it]
 16%|█▌        | 6027/37963 [13:36:40<70:40:08,  7.97s/it]
 16%|█▌        | 6028/37963 [13:36:50<76:09:11,  8.58s/it]
 16%|█▌        | 6029/37963 [13:36:57<73:42:55,  8.31s/it]
 16%|█▌        | 6030/37963 [13:37:05<71:41:53,  8.08s/it]
                                                          
{'loss': '0.2338', 'grad_norm': '4.073', 'learning_rate': '1.914e-05', 'epoch': '0.1588'}
+
 16%|█▌        | 6030/37963 [13:37:05<71:41:53,  8.08s/it]
 16%|█▌        | 6031/37963 [13:37:13<70:43:58,  7.97s/it]
 16%|█▌        | 6032/37963 [13:37:20<69:48:10,  7.87s/it]
 16%|█▌        | 6033/37963 [13:37:28<69:03:09,  7.79s/it]
 16%|█▌        | 6034/37963 [13:37:35<68:22:22,  7.71s/it]
 16%|█▌        | 6035/37963 [13:37:43<68:57:31,  7.78s/it]
 16%|█▌        | 6036/37963 [13:37:51<69:18:08,  7.81s/it]
 16%|█▌        | 6037/37963 [13:37:59<68:18:56,  7.70s/it]
 16%|█▌        | 6038/37963 [13:38:06<68:35:16,  7.73s/it]
 16%|█▌        | 6039/37963 [13:38:14<69:06:48,  7.79s/it]
 16%|█▌        | 6040/37963 [13:38:22<69:08:56,  7.80s/it]
                                                          
{'loss': '0.2045', 'grad_norm': '5.53', 'learning_rate': '1.914e-05', 'epoch': '0.1591'}
+
 16%|█▌        | 6040/37963 [13:38:22<69:08:56,  7.80s/it]
 16%|█▌        | 6041/37963 [13:38:29<68:02:33,  7.67s/it]
 16%|█▌        | 6042/37963 [13:38:37<68:22:32,  7.71s/it]
 16%|█▌        | 6043/37963 [13:38:47<74:45:50,  8.43s/it]
 16%|█▌        | 6044/37963 [13:38:55<72:44:44,  8.20s/it]
 16%|█▌        | 6045/37963 [13:39:03<71:51:33,  8.10s/it]
 16%|█▌        | 6046/37963 [13:39:10<69:48:39,  7.87s/it]
 16%|█▌        | 6047/37963 [13:39:18<68:48:05,  7.76s/it]
 16%|█▌        | 6048/37963 [13:39:25<68:11:06,  7.69s/it]
 16%|█▌        | 6049/37963 [13:39:33<68:01:38,  7.67s/it]
 16%|█▌        | 6050/37963 [13:39:41<67:44:00,  7.64s/it]
                                                          
{'loss': '0.2175', 'grad_norm': '3.463', 'learning_rate': '1.914e-05', 'epoch': '0.1594'}
+
 16%|█▌        | 6050/37963 [13:39:41<67:44:00,  7.64s/it]
 16%|█▌        | 6051/37963 [13:39:48<67:15:01,  7.59s/it]
 16%|█▌        | 6052/37963 [13:39:58<74:56:55,  8.46s/it]
 16%|█▌        | 6053/37963 [13:40:06<73:38:22,  8.31s/it]
 16%|█▌        | 6054/37963 [13:40:14<72:01:26,  8.13s/it]
 16%|█▌        | 6055/37963 [13:40:22<71:22:50,  8.05s/it]
 16%|█▌        | 6056/37963 [13:40:30<70:31:50,  7.96s/it]
 16%|█▌        | 6057/37963 [13:40:37<69:50:22,  7.88s/it]
 16%|█▌        | 6058/37963 [13:40:48<76:13:21,  8.60s/it]
 16%|█▌        | 6059/37963 [13:40:55<73:36:59,  8.31s/it]
 16%|█▌        | 6060/37963 [13:41:03<71:59:08,  8.12s/it]
                                                          
{'loss': '0.1977', 'grad_norm': '1.754', 'learning_rate': '1.913e-05', 'epoch': '0.1596'}
+
 16%|█▌        | 6060/37963 [13:41:03<71:59:08,  8.12s/it]
 16%|█▌        | 6061/37963 [13:41:11<70:24:28,  7.95s/it]
 16%|█▌        | 6062/37963 [13:41:21<76:22:08,  8.62s/it]
 16%|█▌        | 6063/37963 [13:41:28<73:41:22,  8.32s/it]
 16%|█▌        | 6064/37963 [13:41:36<72:17:08,  8.16s/it]
 16%|█▌        | 6065/37963 [13:41:46<78:04:49,  8.81s/it]
 16%|█▌        | 6066/37963 [13:41:54<75:29:53,  8.52s/it]
 16%|█▌        | 6067/37963 [13:42:02<73:14:34,  8.27s/it]
 16%|█▌        | 6068/37963 [13:42:10<72:01:46,  8.13s/it]
 16%|█▌        | 6069/37963 [13:42:17<70:48:45,  7.99s/it]
 16%|█▌        | 6070/37963 [13:42:28<76:46:49,  8.67s/it]
                                                          
{'loss': '0.2001', 'grad_norm': '1.401', 'learning_rate': '1.913e-05', 'epoch': '0.1599'}
+
 16%|█▌        | 6070/37963 [13:42:28<76:46:49,  8.67s/it]
 16%|█▌        | 6071/37963 [13:42:35<73:54:53,  8.34s/it]
 16%|█▌        | 6072/37963 [13:42:43<73:10:12,  8.26s/it]
 16%|█▌        | 6073/37963 [13:42:51<71:15:03,  8.04s/it]
 16%|█▌        | 6074/37963 [13:43:04<83:59:22,  9.48s/it]
 16%|█▌        | 6075/37963 [13:43:11<79:16:42,  8.95s/it]
 16%|█▌        | 6076/37963 [13:43:19<75:43:32,  8.55s/it]
 16%|█▌        | 6077/37963 [13:43:27<73:42:49,  8.32s/it]
 16%|█▌        | 6078/37963 [13:43:35<72:10:04,  8.15s/it]
 16%|█▌        | 6079/37963 [13:43:42<70:45:47,  7.99s/it]
 16%|█▌        | 6080/37963 [13:43:50<70:09:25,  7.92s/it]
                                                          
{'loss': '0.1903', 'grad_norm': '4.443', 'learning_rate': '1.912e-05', 'epoch': '0.1602'}
+
 16%|█▌        | 6080/37963 [13:43:50<70:09:25,  7.92s/it]
 16%|█▌        | 6081/37963 [13:43:58<69:22:01,  7.83s/it]
 16%|█▌        | 6082/37963 [13:44:05<69:09:23,  7.81s/it]
 16%|█▌        | 6083/37963 [13:44:13<69:27:16,  7.84s/it]
 16%|���▌        | 6084/37963 [13:44:21<69:17:17,  7.82s/it]
 16%|█▌        | 6085/37963 [13:44:29<68:30:50,  7.74s/it]
 16%|█▌        | 6086/37963 [13:44:36<68:32:20,  7.74s/it]
 16%|█▌        | 6087/37963 [13:44:44<68:23:18,  7.72s/it]
 16%|█▌        | 6088/37963 [13:44:52<68:40:40,  7.76s/it]
 16%|█▌        | 6089/37963 [13:45:00<68:53:45,  7.78s/it]
 16%|█▌        | 6090/37963 [13:45:08<69:02:44,  7.80s/it]
                                                          
{'loss': '0.1851', 'grad_norm': '3.077', 'learning_rate': '1.912e-05', 'epoch': '0.1604'}
+
 16%|█▌        | 6090/37963 [13:45:08<69:02:44,  7.80s/it]
 16%|█▌        | 6091/37963 [13:45:18<75:17:37,  8.50s/it]
 16%|█▌        | 6092/37963 [13:45:25<73:00:15,  8.25s/it]
 16%|█▌        | 6093/37963 [13:45:33<71:11:20,  8.04s/it]
 16%|█▌        | 6094/37963 [13:45:41<70:02:26,  7.91s/it]
 16%|█▌        | 6095/37963 [13:45:48<69:39:23,  7.87s/it]
 16%|█▌        | 6096/37963 [13:45:56<69:51:24,  7.89s/it]
 16%|█▌        | 6097/37963 [13:46:04<69:29:29,  7.85s/it]
 16%|█▌        | 6098/37963 [13:46:12<69:06:53,  7.81s/it]
 16%|█▌        | 6099/37963 [13:46:19<68:59:31,  7.79s/it]
 16%|█▌        | 6100/37963 [13:46:27<69:10:35,  7.82s/it]
                                                          
{'loss': '0.187', 'grad_norm': '2.5', 'learning_rate': '1.912e-05', 'epoch': '0.1607'}
+
 16%|█▌        | 6100/37963 [13:46:27<69:10:35,  7.82s/it]
 16%|█▌        | 6101/37963 [13:46:35<69:15:08,  7.82s/it]
 16%|█▌        | 6102/37963 [13:46:46<76:05:53,  8.60s/it]
 16%|█▌        | 6103/37963 [13:46:56<81:27:08,  9.20s/it]
 16%|█▌        | 6104/37963 [13:47:04<77:37:45,  8.77s/it]
 16%|█▌        | 6105/37963 [13:47:12<74:38:46,  8.44s/it]
 16%|█▌        | 6106/37963 [13:47:19<73:06:51,  8.26s/it]
 16%|█▌        | 6107/37963 [13:47:27<71:58:17,  8.13s/it]
 16%|█▌        | 6108/37963 [13:47:37<77:17:58,  8.74s/it]
 16%|█▌        | 6109/37963 [13:47:45<74:34:15,  8.43s/it]
 16%|█▌        | 6110/37963 [13:47:53<72:21:34,  8.18s/it]
                                                          
{'loss': '0.2', 'grad_norm': '6.033', 'learning_rate': '1.911e-05', 'epoch': '0.1609'}
+
 16%|█▌        | 6110/37963 [13:47:53<72:21:34,  8.18s/it]
 16%|█▌        | 6111/37963 [13:48:00<70:33:04,  7.97s/it]
 16%|█▌        | 6112/37963 [13:48:08<69:36:59,  7.87s/it]
 16%|█▌        | 6113/37963 [13:48:15<68:57:51,  7.80s/it]
 16%|█▌        | 6114/37963 [13:48:23<69:17:20,  7.83s/it]
 16%|█▌        | 6115/37963 [13:48:31<68:43:43,  7.77s/it]
 16%|█▌        | 6116/37963 [13:48:39<69:03:43,  7.81s/it]
 16%|█▌        | 6117/37963 [13:48:46<68:01:55,  7.69s/it]
 16%|█▌        | 6118/37963 [13:48:54<68:20:10,  7.73s/it]
 16%|█▌        | 6119/37963 [13:49:05<75:26:51,  8.53s/it]
 16%|█▌        | 6120/37963 [13:49:12<73:34:57,  8.32s/it]
                                                          
{'loss': '0.2021', 'grad_norm': '2.262', 'learning_rate': '1.911e-05', 'epoch': '0.1612'}
+
 16%|█▌        | 6120/37963 [13:49:12<73:34:57,  8.32s/it]
 16%|█▌        | 6121/37963 [13:49:20<72:04:32,  8.15s/it]
 16%|█▌        | 6122/37963 [13:49:33<83:42:18,  9.46s/it]
 16%|█▌        | 6123/37963 [13:49:40<78:44:25,  8.90s/it]
 16%|█▌        | 6124/37963 [13:49:50<82:13:30,  9.30s/it]
 16%|█▌        | 6125/37963 [13:49:58<78:22:58,  8.86s/it]
 16%|█▌        | 6126/37963 [13:50:06<75:35:17,  8.55s/it]
 16%|█▌        | 6127/37963 [13:50:14<73:02:31,  8.26s/it]
 16%|█▌        | 6128/37963 [13:50:21<71:38:16,  8.10s/it]
 16%|█▌        | 6129/37963 [13:50:29<70:48:42,  8.01s/it]
 16%|█▌        | 6130/37963 [13:50:37<69:52:10,  7.90s/it]
                                                          
{'loss': '0.1847', 'grad_norm': '2.814', 'learning_rate': '1.911e-05', 'epoch': '0.1615'}
+
 16%|█▌        | 6130/37963 [13:50:37<69:52:10,  7.90s/it]
 16%|█▌        | 6131/37963 [13:50:44<69:02:36,  7.81s/it]
 16%|█▌        | 6132/37963 [13:50:52<67:52:34,  7.68s/it]
 16%|█▌        | 6133/37963 [13:51:00<68:11:49,  7.71s/it]
 16%|█▌        | 6134/37963 [13:51:07<68:03:21,  7.70s/it]
 16%|█▌        | 6135/37963 [13:51:18<74:57:02,  8.48s/it]
 16%|█▌        | 6136/37963 [13:51:26<73:39:21,  8.33s/it]
 16%|█▌        | 6137/37963 [13:51:34<72:30:27,  8.20s/it]
 16%|█▌        | 6138/37963 [13:51:41<70:34:29,  7.98s/it]
 16%|█▌        | 6139/37963 [13:51:48<68:45:37,  7.78s/it]
 16%|█▌        | 6140/37963 [13:51:56<67:48:53,  7.67s/it]
                                                          
{'loss': '0.1884', 'grad_norm': '2.465', 'learning_rate': '1.91e-05', 'epoch': '0.1617'}
+
 16%|█▌        | 6140/37963 [13:51:56<67:48:53,  7.67s/it]
 16%|█▌        | 6141/37963 [13:52:03<67:35:39,  7.65s/it]
 16%|█▌        | 6142/37963 [13:52:11<67:11:24,  7.60s/it]
 16%|█▌        | 6143/37963 [13:52:18<67:23:17,  7.62s/it]
 16%|█▌        | 6144/37963 [13:52:26<67:42:50,  7.66s/it]
 16%|���▌        | 6145/37963 [13:52:34<67:53:41,  7.68s/it]
 16%|█▌        | 6146/37963 [13:52:44<74:23:39,  8.42s/it]
 16%|█▌        | 6147/37963 [13:52:52<72:27:26,  8.20s/it]
 16%|█▌        | 6148/37963 [13:52:59<70:45:49,  8.01s/it]
 16%|█▌        | 6149/37963 [13:53:07<68:59:15,  7.81s/it]
 16%|█▌        | 6150/37963 [13:53:15<69:03:15,  7.81s/it]
                                                          
{'loss': '0.1643', 'grad_norm': '3.701', 'learning_rate': '1.91e-05', 'epoch': '0.162'}
+
 16%|█▌        | 6150/37963 [13:53:15<69:03:15,  7.81s/it]
 16%|█▌        | 6151/37963 [13:53:22<68:00:30,  7.70s/it]
 16%|█▌        | 6152/37963 [13:53:29<66:58:44,  7.58s/it]
 16%|█▌        | 6153/37963 [13:53:37<67:16:26,  7.61s/it]
 16%|█▌        | 6154/37963 [13:53:45<67:33:04,  7.65s/it]
 16%|█▌        | 6155/37963 [13:53:52<67:37:39,  7.65s/it]
 16%|█▌        | 6156/37963 [13:54:00<67:17:07,  7.62s/it]
 16%|█▌        | 6157/37963 [13:54:10<74:50:19,  8.47s/it]
 16%|█▌        | 6158/37963 [13:54:18<72:39:12,  8.22s/it]
 16%|█▌        | 6159/37963 [13:54:26<71:01:55,  8.04s/it]
 16%|█▌        | 6160/37963 [13:54:36<76:43:13,  8.68s/it]
                                                          
{'loss': '0.1823', 'grad_norm': '3.952', 'learning_rate': '1.91e-05', 'epoch': '0.1623'}
+
 16%|█▌        | 6160/37963 [13:54:36<76:43:13,  8.68s/it]
 16%|█▌        | 6161/37963 [13:54:43<72:59:24,  8.26s/it]
 16%|█▌        | 6162/37963 [13:54:50<70:41:05,  8.00s/it]
 16%|█▌        | 6163/37963 [13:54:58<69:32:45,  7.87s/it]
 16%|█▌        | 6164/37963 [13:55:06<69:19:16,  7.85s/it]
 16%|█▌        | 6165/37963 [13:55:13<68:42:27,  7.78s/it]
 16%|█▌        | 6166/37963 [13:55:23<74:23:22,  8.42s/it]
 16%|█▌        | 6167/37963 [13:55:31<72:15:10,  8.18s/it]
 16%|█▌        | 6168/37963 [13:55:41<76:35:45,  8.67s/it]
 16%|█▋        | 6169/37963 [13:55:48<73:29:41,  8.32s/it]
 16%|█▋        | 6170/37963 [13:55:58<78:27:30,  8.88s/it]
                                                          
{'loss': '0.1806', 'grad_norm': '4.153', 'learning_rate': '1.909e-05', 'epoch': '0.1625'}
+
 16%|█▋        | 6170/37963 [13:55:58<78:27:30,  8.88s/it]
 16%|█▋        | 6171/37963 [13:56:06<75:17:24,  8.53s/it]
 16%|█▋        | 6172/37963 [13:56:16<79:46:40,  9.03s/it]
 16%|█▋        | 6173/37963 [13:56:24<75:55:20,  8.60s/it]
 16%|█▋        | 6174/37963 [13:56:32<73:16:43,  8.30s/it]
 16%|█▋        | 6175/37963 [13:56:39<71:09:48,  8.06s/it]
 16%|█▋        | 6176/37963 [13:56:47<70:20:27,  7.97s/it]
 16%|█▋        | 6177/37963 [13:56:55<69:47:29,  7.90s/it]
 16%|█▋        | 6178/37963 [13:57:05<75:40:49,  8.57s/it]
 16%|█▋        | 6179/37963 [13:57:13<74:05:58,  8.39s/it]
 16%|█▋        | 6180/37963 [13:57:20<72:18:12,  8.19s/it]
                                                          
{'loss': '0.1929', 'grad_norm': '2.189', 'learning_rate': '1.909e-05', 'epoch': '0.1628'}
+
 16%|█▋        | 6180/37963 [13:57:20<72:18:12,  8.19s/it]
 16%|█▋        | 6181/37963 [13:57:28<71:33:02,  8.10s/it]
 16%|█▋        | 6182/37963 [13:57:36<70:14:13,  7.96s/it]
 16%|█▋        | 6183/37963 [13:57:43<68:56:23,  7.81s/it]
 16%|█▋        | 6184/37963 [13:57:51<69:05:41,  7.83s/it]
 16%|█▋        | 6185/37963 [13:57:59<68:04:43,  7.71s/it]
 16%|█▋        | 6186/37963 [13:58:06<68:12:14,  7.73s/it]
 16%|█▋        | 6187/37963 [13:58:14<68:20:35,  7.74s/it]
 16%|█▋        | 6188/37963 [13:58:22<68:14:27,  7.73s/it]
 16%|█▋        | 6189/37963 [13:58:30<67:52:53,  7.69s/it]
 16%|█▋        | 6190/37963 [13:58:37<67:43:26,  7.67s/it]
                                                          
{'loss': '0.1782', 'grad_norm': '2.527', 'learning_rate': '1.909e-05', 'epoch': '0.1631'}
+
 16%|█▋        | 6190/37963 [13:58:37<67:43:26,  7.67s/it]
 16%|█▋        | 6191/37963 [13:58:45<68:38:04,  7.78s/it]
 16%|█▋        | 6192/37963 [13:58:55<74:58:10,  8.49s/it]
 16%|█▋        | 6193/37963 [13:59:03<72:33:12,  8.22s/it]
 16%|█▋        | 6194/37963 [13:59:11<71:22:09,  8.09s/it]
 16%|█▋        | 6195/37963 [13:59:18<70:29:51,  7.99s/it]
 16%|█▋        | 6196/37963 [13:59:26<69:55:59,  7.93s/it]
 16%|█▋        | 6197/37963 [13:59:34<69:41:10,  7.90s/it]
 16%|█▋        | 6198/37963 [13:59:42<69:21:24,  7.86s/it]
 16%|█▋        | 6199/37963 [13:59:50<69:09:20,  7.84s/it]
 16%|█▋        | 6200/37963 [13:59:58<69:49:59,  7.91s/it]
                                                          
{'loss': '0.1872', 'grad_norm': '9.565', 'learning_rate': '1.908e-05', 'epoch': '0.1633'}
+
 16%|█▋        | 6200/37963 [13:59:58<69:49:59,  7.91s/it]
 16%|█▋        | 6201/37963 [14:00:06<70:08:06,  7.95s/it]
 16%|█▋        | 6202/37963 [14:00:14<69:40:06,  7.90s/it]
 16%|█▋        | 6203/37963 [14:00:21<69:12:03,  7.84s/it]
 16%|█▋        | 6204/37963 [14:00:32<76:31:42,  8.67s/it]
 16%|█▋        | 6205/37963 [14:00:40<74:11:22,  8.41s/it]
 16%|█▋        | 6206/37963 [14:00:47<72:28:55,  8.22s/it]
 16%|█▋        | 6207/37963 [14:00:55<70:08:09,  7.95s/it]
 16%|█▋        | 6208/37963 [14:01:05<75:31:04,  8.56s/it]
 16%|█▋        | 6209/37963 [14:01:13<73:25:04,  8.32s/it]
 16%|█▋        | 6210/37963 [14:01:20<72:22:30,  8.21s/it]
                                                          
{'loss': '0.1841', 'grad_norm': '1.744', 'learning_rate': '1.908e-05', 'epoch': '0.1636'}
+
 16%|█▋        | 6210/37963 [14:01:20<72:22:30,  8.21s/it]
 16%|█▋        | 6211/37963 [14:01:28<70:52:29,  8.04s/it]
 16%|█▋        | 6212/37963 [14:01:36<70:07:58,  7.95s/it]
 16%|█▋        | 6213/37963 [14:01:46<76:01:49,  8.62s/it]
 16%|█▋        | 6214/37963 [14:01:54<74:20:13,  8.43s/it]
 16%|█▋        | 6215/37963 [14:02:02<72:38:48,  8.24s/it]
 16%|█▋        | 6216/37963 [14:02:09<71:03:33,  8.06s/it]
 16%|█▋        | 6217/37963 [14:02:17<69:47:12,  7.91s/it]
 16%|█▋        | 6218/37963 [14:02:27<76:26:14,  8.67s/it]
 16%|█▋        | 6219/37963 [14:02:35<73:43:37,  8.36s/it]
 16%|█▋        | 6220/37963 [14:02:45<78:33:20,  8.91s/it]
                                                          
{'loss': '0.1894', 'grad_norm': '1.914', 'learning_rate': '1.908e-05', 'epoch': '0.1638'}
+
 16%|█▋        | 6220/37963 [14:02:45<78:33:20,  8.91s/it]
 16%|█▋        | 6221/37963 [14:02:53<75:56:23,  8.61s/it]
 16%|█▋        | 6222/37963 [14:03:03<79:36:04,  9.03s/it]
 16%|█▋        | 6223/37963 [14:03:13<82:54:01,  9.40s/it]
 16%|█▋        | 6224/37963 [14:03:21<78:14:02,  8.87s/it]
 16%|█▋        | 6225/37963 [14:03:29<75:01:13,  8.51s/it]
 16%|█▋        | 6226/37963 [14:03:36<72:59:07,  8.28s/it]
 16%|█▋        | 6227/37963 [14:03:44<71:43:18,  8.14s/it]
 16%|█▋        | 6228/37963 [14:03:52<70:34:22,  8.01s/it]
 16%|█▋        | 6229/37963 [14:04:00<69:55:48,  7.93s/it]
 16%|█▋        | 6230/37963 [14:04:08<69:37:51,  7.90s/it]
                                                          
{'loss': '0.1729', 'grad_norm': '3.171', 'learning_rate': '1.907e-05', 'epoch': '0.1641'}
+
 16%|█▋        | 6230/37963 [14:04:08<69:37:51,  7.90s/it]
 16%|█▋        | 6231/37963 [14:04:15<69:06:22,  7.84s/it]
 16%|█▋        | 6232/37963 [14:04:23<68:39:47,  7.79s/it]
 16%|█▋        | 6233/37963 [14:04:31<68:14:29,  7.74s/it]
 16%|█▋        | 6234/37963 [14:04:39<68:50:48,  7.81s/it]
 16%|█▋        | 6235/37963 [14:04:46<68:29:26,  7.77s/it]
 16%|█▋        | 6236/37963 [14:04:54<67:46:09,  7.69s/it]
 16%|█▋        | 6237/37963 [14:05:01<67:44:36,  7.69s/it]
 16%|█▋        | 6238/37963 [14:05:09<66:34:00,  7.55s/it]
 16%|█▋        | 6239/37963 [14:05:16<66:39:23,  7.56s/it]
 16%|█▋        | 6240/37963 [14:05:26<73:24:40,  8.33s/it]
                                                          
{'loss': '0.1687', 'grad_norm': '1.351', 'learning_rate': '1.907e-05', 'epoch': '0.1644'}
+
 16%|█▋        | 6240/37963 [14:05:26<73:24:40,  8.33s/it]
 16%|█▋        | 6241/37963 [14:05:34<71:41:12,  8.14s/it]
 16%|█▋        | 6242/37963 [14:05:42<70:40:53,  8.02s/it]
 16%|█▋        | 6243/37963 [14:05:49<69:25:44,  7.88s/it]
 16%|█▋        | 6244/37963 [14:05:57<68:55:45,  7.82s/it]
 16%|█▋        | 6245/37963 [14:06:05<68:53:37,  7.82s/it]
 16%|█▋        | 6246/37963 [14:06:12<68:14:14,  7.75s/it]
 16%|█▋        | 6247/37963 [14:06:20<67:54:37,  7.71s/it]
 16%|█▋        | 6248/37963 [14:06:28<67:36:11,  7.67s/it]
 16%|█▋        | 6249/37963 [14:06:35<66:29:48,  7.55s/it]
 16%|█▋        | 6250/37963 [14:06:43<67:02:46,  7.61s/it]
                                                          
{'loss': '0.1821', 'grad_norm': '5.984', 'learning_rate': '1.906e-05', 'epoch': '0.1646'}
+
 16%|█▋        | 6250/37963 [14:06:43<67:02:46,  7.61s/it]
 16%|█▋        | 6251/37963 [14:06:50<67:03:27,  7.61s/it]
 16%|█▋        | 6252/37963 [14:07:01<74:30:24,  8.46s/it]
 16%|█▋        | 6253/37963 [14:07:08<72:11:55,  8.20s/it]
 16%|█▋        | 6254/37963 [14:07:16<70:45:11,  8.03s/it]
 16%|█▋        | 6255/37963 [14:07:24<70:41:17,  8.03s/it]
 16%|█▋        | 6256/37963 [14:07:32<69:31:15,  7.89s/it]
 16%|█▋        | 6257/37963 [14:07:39<68:49:35,  7.81s/it]
 16%|█▋        | 6258/37963 [14:07:47<67:59:18,  7.72s/it]
 16%|█▋        | 6259/37963 [14:07:54<67:52:20,  7.71s/it]
 16%|█▋        | 6260/37963 [14:08:02<68:19:42,  7.76s/it]
                                                          
{'loss': '0.183', 'grad_norm': '3.06', 'learning_rate': '1.906e-05', 'epoch': '0.1649'}
+
 16%|█▋        | 6260/37963 [14:08:02<68:19:42,  7.76s/it]
 16%|█▋        | 6261/37963 [14:08:13<75:15:07,  8.55s/it]
 16%|█▋        | 6262/37963 [14:08:23<79:20:11,  9.01s/it]
 16%|█▋        | 6263/37963 [14:08:30<76:08:05,  8.65s/it]
 17%|█▋        | 6264/37963 [14:08:38<73:53:32,  8.39s/it]
 17%|█▋        | 6265/37963 [14:08:46<72:22:01,  8.22s/it]
 17%|█▋        | 6266/37963 [14:08:54<70:50:30,  8.05s/it]
 17%|█▋        | 6267/37963 [14:09:02<70:10:38,  7.97s/it]
 17%|█▋        | 6268/37963 [14:09:09<69:18:56,  7.87s/it]
 17%|█▋        | 6269/37963 [14:09:19<74:38:49,  8.48s/it]
 17%|█▋        | 6270/37963 [14:09:27<72:37:08,  8.25s/it]
                                                          
{'loss': '0.1925', 'grad_norm': '1.486', 'learning_rate': '1.906e-05', 'epoch': '0.1652'}
+
 17%|█▋        | 6270/37963 [14:09:27<72:37:08,  8.25s/it]
 17%|█▋        | 6271/37963 [14:09:34<71:01:47,  8.07s/it]
 17%|█▋        | 6272/37963 [14:09:42<69:50:53,  7.93s/it]
 17%|█▋        | 6273/37963 [14:09:50<69:34:57,  7.90s/it]
 17%|█▋        | 6274/37963 [14:09:57<67:56:47,  7.72s/it]
 17%|█▋        | 6275/37963 [14:10:05<67:45:59,  7.70s/it]
 17%|█▋        | 6276/37963 [14:10:15<74:33:04,  8.47s/it]
 17%|█▋        | 6277/37963 [14:10:26<80:17:57,  9.12s/it]
 17%|█▋        | 6278/37963 [14:10:33<76:38:37,  8.71s/it]
 17%|█▋        | 6279/37963 [14:10:41<74:11:21,  8.43s/it]
 17%|█▋        | 6280/37963 [14:10:49<72:14:24,  8.21s/it]
                                                          
{'loss': '0.1909', 'grad_norm': '2.734', 'learning_rate': '1.905e-05', 'epoch': '0.1654'}
+
 17%|█▋        | 6280/37963 [14:10:49<72:14:24,  8.21s/it]
 17%|█▋        | 6281/37963 [14:10:56<70:11:31,  7.98s/it]
 17%|█▋        | 6282/37963 [14:11:04<69:29:29,  7.90s/it]
 17%|█▋        | 6283/37963 [14:11:12<69:00:21,  7.84s/it]
 17%|█▋        | 6284/37963 [14:11:22<75:38:02,  8.60s/it]
 17%|█▋        | 6285/37963 [14:11:30<73:20:35,  8.33s/it]
 17%|█▋        | 6286/37963 [14:11:37<71:20:43,  8.11s/it]
 17%|█▋        | 6287/37963 [14:11:44<68:03:07,  7.73s/it]
 17%|█▋        | 6288/37963 [14:11:52<67:14:11,  7.64s/it]
 17%|█▋        | 6289/37963 [14:11:59<66:08:06,  7.52s/it]
 17%|█▋        | 6290/37963 [14:12:07<66:48:14,  7.59s/it]
                                                          
{'loss': '0.1753', 'grad_norm': '5.099', 'learning_rate': '1.905e-05', 'epoch': '0.1657'}
+
 17%|█▋        | 6290/37963 [14:12:07<66:48:14,  7.59s/it]
 17%|█▋        | 6291/37963 [14:12:15<67:59:17,  7.73s/it]
 17%|█▋        | 6292/37963 [14:12:23<68:18:12,  7.76s/it]
 17%|█▋        | 6293/37963 [14:12:30<68:07:18,  7.74s/it]
 17%|█▋        | 6294/37963 [14:12:38<68:01:05,  7.73s/it]
 17%|█▋        | 6295/37963 [14:12:46<68:00:58,  7.73s/it]
 17%|█▋        | 6296/37963 [14:12:53<67:20:23,  7.66s/it]
 17%|█▋        | 6297/37963 [14:13:01<67:06:58,  7.63s/it]
 17%|█▋        | 6298/37963 [14:13:09<67:22:40,  7.66s/it]
 17%|█▋        | 6299/37963 [14:13:16<67:07:31,  7.63s/it]
 17%|█▋        | 6300/37963 [14:13:24<67:04:12,  7.63s/it]
                                                          
{'loss': '0.1703', 'grad_norm': '5.266', 'learning_rate': '1.905e-05', 'epoch': '0.166'}
+
 17%|█▋        | 6300/37963 [14:13:24<67:04:12,  7.63s/it]
 17%|█▋        | 6301/37963 [14:13:31<67:17:19,  7.65s/it]
 17%|█▋        | 6302/37963 [14:13:39<67:16:30,  7.65s/it]
 17%|█▋        | 6303/37963 [14:13:47<66:45:00,  7.59s/it]
 17%|█▋        | 6304/37963 [14:13:54<67:31:31,  7.68s/it]
 17%|█▋        | 6305/37963 [14:14:02<67:44:18,  7.70s/it]
 17%|█▋        | 6306/37963 [14:14:16<83:31:29,  9.50s/it]
 17%|█▋        | 6307/37963 [14:14:24<78:42:45,  8.95s/it]
 17%|█▋        | 6308/37963 [14:14:31<75:37:32,  8.60s/it]
 17%|█▋        | 6309/37963 [14:14:41<79:22:33,  9.03s/it]
 17%|█▋        | 6310/37963 [14:14:52<82:44:11,  9.41s/it]
                                                          
{'loss': '0.1715', 'grad_norm': '4.103', 'learning_rate': '1.904e-05', 'epoch': '0.1662'}
+
 17%|█▋        | 6310/37963 [14:14:52<82:44:11,  9.41s/it]
 17%|█▋        | 6311/37963 [14:14:59<77:53:30,  8.86s/it]
 17%|█▋        | 6312/37963 [14:15:07<74:54:56,  8.52s/it]
 17%|█▋        | 6313/37963 [14:15:15<72:51:53,  8.29s/it]
 17%|█▋        | 6314/37963 [14:15:22<71:19:43,  8.11s/it]
 17%|█▋        | 6315/37963 [14:15:30<70:26:12,  8.01s/it]
 17%|█▋        | 6316/37963 [14:15:38<69:32:22,  7.91s/it]
 17%|█▋        | 6317/37963 [14:15:46<69:36:16,  7.92s/it]
 17%|█▋        | 6318/37963 [14:15:54<69:11:58,  7.87s/it]
 17%|█▋        | 6319/37963 [14:16:01<68:30:40,  7.79s/it]
 17%|█▋        | 6320/37963 [14:16:09<68:23:39,  7.78s/it]
                                                          
{'loss': '0.1692', 'grad_norm': '2.986', 'learning_rate': '1.904e-05', 'epoch': '0.1665'}
+
 17%|█▋        | 6320/37963 [14:16:09<68:23:39,  7.78s/it]
 17%|█▋        | 6321/37963 [14:16:17<68:27:09,  7.79s/it]
 17%|█▋        | 6322/37963 [14:16:24<68:06:54,  7.75s/it]
 17%|█▋        | 6323/37963 [14:16:35<74:46:47,  8.51s/it]
 17%|█▋        | 6324/37963 [14:16:45<79:51:32,  9.09s/it]
 17%|█▋        | 6325/37963 [14:16:53<76:20:20,  8.69s/it]
 17%|█▋        | 6326/37963 [14:17:01<73:42:48,  8.39s/it]
 17%|█▋        | 6327/37963 [14:17:08<71:35:44,  8.15s/it]
 17%|█▋        | 6328/37963 [14:17:18<77:17:41,  8.80s/it]
 17%|█▋        | 6329/37963 [14:17:26<73:41:57,  8.39s/it]
 17%|█▋        | 6330/37963 [14:17:34<71:52:00,  8.18s/it]
                                                          
{'loss': '0.1814', 'grad_norm': '3.373', 'learning_rate': '1.904e-05', 'epoch': '0.1667'}
+
 17%|█▋        | 6330/37963 [14:17:34<71:52:00,  8.18s/it]
 17%|█▋        | 6331/37963 [14:17:44<77:10:01,  8.78s/it]
 17%|█▋        | 6332/37963 [14:17:51<73:55:04,  8.41s/it]
 17%|█▋        | 6333/37963 [14:17:59<71:21:31,  8.12s/it]
 17%|█▋        | 6334/37963 [14:18:07<70:45:20,  8.05s/it]
 17%|█▋        | 6335/37963 [14:18:14<69:54:06,  7.96s/it]
 17%|█▋        | 6336/37963 [14:18:22<69:40:45,  7.93s/it]
 17%|█▋        | 6337/37963 [14:18:30<68:29:56,  7.80s/it]
 17%|█▋        | 6338/37963 [14:18:38<68:40:21,  7.82s/it]
 17%|█▋        | 6339/37963 [14:18:45<68:17:22,  7.77s/it]
 17%|█▋        | 6340/37963 [14:18:53<68:22:47,  7.78s/it]
                                                          
{'loss': '0.1664', 'grad_norm': '3.341', 'learning_rate': '1.903e-05', 'epoch': '0.167'}
+
 17%|█▋        | 6340/37963 [14:18:53<68:22:47,  7.78s/it]
 17%|█▋        | 6341/37963 [14:19:01<68:09:03,  7.76s/it]
 17%|█▋        | 6342/37963 [14:19:08<67:36:14,  7.70s/it]
 17%|█▋        | 6343/37963 [14:19:16<68:31:55,  7.80s/it]
 17%|█▋        | 6344/37963 [14:19:24<68:01:28,  7.74s/it]
 17%|█▋        | 6345/37963 [14:19:32<67:57:31,  7.74s/it]
 17%|█▋        | 6346/37963 [14:19:39<66:20:00,  7.55s/it]
 17%|█▋        | 6347/37963 [14:19:47<66:59:05,  7.63s/it]
 17%|█▋        | 6348/37963 [14:19:55<67:47:58,  7.72s/it]
 17%|█▋        | 6349/37963 [14:20:02<67:50:00,  7.72s/it]
 17%|█▋        | 6350/37963 [14:20:10<68:10:04,  7.76s/it]
                                                          
{'loss': '0.1619', 'grad_norm': '1.531', 'learning_rate': '1.903e-05', 'epoch': '0.1673'}
+
 17%|█▋        | 6350/37963 [14:20:10<68:10:04,  7.76s/it]
 17%|█▋        | 6351/37963 [14:20:18<68:07:32,  7.76s/it]
 17%|█▋        | 6352/37963 [14:20:25<66:54:59,  7.62s/it]
 17%|█▋        | 6353/37963 [14:20:35<72:55:09,  8.30s/it]
 17%|█▋        | 6354/37963 [14:20:43<71:44:15,  8.17s/it]
 17%|█▋        | 6355/37963 [14:20:53<77:14:35,  8.80s/it]
 17%|█▋        | 6356/37963 [14:21:03<80:26:01,  9.16s/it]
 17%|█▋        | 6357/37963 [14:21:11<75:35:20,  8.61s/it]
 17%|█▋        | 6358/37963 [14:21:21<79:56:07,  9.11s/it]
 17%|█▋        | 6359/37963 [14:21:29<76:31:22,  8.72s/it]
 17%|█▋        | 6360/37963 [14:21:36<73:34:36,  8.38s/it]
                                                          
{'loss': '0.1554', 'grad_norm': '2.64', 'learning_rate': '1.902e-05', 'epoch': '0.1675'}
+
 17%|█▋        | 6360/37963 [14:21:36<73:34:36,  8.38s/it]
 17%|█▋        | 6361/37963 [14:21:44<70:54:05,  8.08s/it]
 17%|█▋        | 6362/37963 [14:21:51<69:53:49,  7.96s/it]
 17%|█▋        | 6363/37963 [14:21:59<69:25:40,  7.91s/it]
 17%|█▋        | 6364/37963 [14:22:07<69:00:59,  7.86s/it]
 17%|█▋        | 6365/37963 [14:22:15<69:05:08,  7.87s/it]
 17%|█▋        | 6366/37963 [14:22:23<68:49:34,  7.84s/it]
 17%|█▋        | 6367/37963 [14:22:33<75:20:23,  8.58s/it]
 17%|█▋        | 6368/37963 [14:22:41<73:28:14,  8.37s/it]
 17%|█▋        | 6369/37963 [14:22:49<72:15:49,  8.23s/it]
 17%|█▋        | 6370/37963 [14:22:57<71:24:05,  8.14s/it]
                                                          
{'loss': '0.1692', 'grad_norm': '1.864', 'learning_rate': '1.902e-05', 'epoch': '0.1678'}
+
 17%|█▋        | 6370/37963 [14:22:57<71:24:05,  8.14s/it]
 17%|█▋        | 6371/37963 [14:23:07<77:31:08,  8.83s/it]
 17%|█▋        | 6372/37963 [14:23:18<82:33:35,  9.41s/it]
 17%|█▋        | 6373/37963 [14:23:25<78:01:55,  8.89s/it]
 17%|█▋        | 6374/37963 [14:23:33<74:56:26,  8.54s/it]
 17%|█▋        | 6375/37963 [14:23:41<72:30:07,  8.26s/it]
 17%|█▋        | 6376/37963 [14:23:48<70:27:11,  8.03s/it]
 17%|█▋        | 6377/37963 [14:23:56<70:15:18,  8.01s/it]
 17%|█▋        | 6378/37963 [14:24:04<69:43:53,  7.95s/it]
 17%|█▋        | 6379/37963 [14:24:14<75:58:25,  8.66s/it]
 17%|█▋        | 6380/37963 [14:24:22<73:40:05,  8.40s/it]
                                                          
{'loss': '0.1624', 'grad_norm': '4.572', 'learning_rate': '1.902e-05', 'epoch': '0.1681'}
+
 17%|█▋        | 6380/37963 [14:24:22<73:40:05,  8.40s/it]
 17%|█▋        | 6381/37963 [14:24:30<71:56:33,  8.20s/it]
 17%|█▋        | 6382/37963 [14:24:38<70:35:10,  8.05s/it]
 17%|█▋        | 6383/37963 [14:24:45<69:54:23,  7.97s/it]
 17%|█▋        | 6384/37963 [14:24:53<69:17:55,  7.90s/it]
 17%|█▋        | 6385/37963 [14:25:01<69:13:31,  7.89s/it]
 17%|█▋        | 6386/37963 [14:25:09<68:38:18,  7.83s/it]
 17%|█▋        | 6387/37963 [14:25:16<67:48:23,  7.73s/it]
 17%|█▋        | 6388/37963 [14:25:24<68:02:38,  7.76s/it]
 17%|█▋        | 6389/37963 [14:25:32<68:10:21,  7.77s/it]
 17%|█▋        | 6390/37963 [14:25:39<67:48:48,  7.73s/it]
                                                          
{'loss': '0.1613', 'grad_norm': '2.798', 'learning_rate': '1.901e-05', 'epoch': '0.1683'}
+
 17%|█▋        | 6390/37963 [14:25:39<67:48:48,  7.73s/it]
 17%|█▋        | 6391/37963 [14:25:47<67:40:47,  7.72s/it]
 17%|█▋        | 6392/37963 [14:25:55<67:14:27,  7.67s/it]
 17%|█▋        | 6393/37963 [14:26:03<68:01:16,  7.76s/it]
 17%|█▋        | 6394/37963 [14:26:10<67:51:58,  7.74s/it]
 17%|█▋        | 6395/37963 [14:26:18<68:09:38,  7.77s/it]
 17%|█▋        | 6396/37963 [14:26:26<67:09:04,  7.66s/it]
 17%|█▋        | 6397/37963 [14:26:33<66:39:04,  7.60s/it]
 17%|█▋        | 6398/37963 [14:26:41<67:04:38,  7.65s/it]
 17%|█▋        | 6399/37963 [14:26:48<66:56:12,  7.63s/it]
 17%|█▋        | 6400/37963 [14:26:56<67:45:24,  7.73s/it]
                                                          
{'loss': '0.1708', 'grad_norm': '5.526', 'learning_rate': '1.901e-05', 'epoch': '0.1686'}
+
 17%|█▋        | 6400/37963 [14:26:56<67:45:24,  7.73s/it]
 17%|█▋        | 6401/37963 [14:27:06<73:57:33,  8.44s/it]
 17%|█▋        | 6402/37963 [14:27:16<77:49:47,  8.88s/it]
 17%|█▋        | 6403/37963 [14:27:24<74:58:46,  8.55s/it]
 17%|█▋        | 6404/37963 [14:27:32<72:55:04,  8.32s/it]
 17%|█▋        | 6405/37963 [14:27:40<71:29:44,  8.16s/it]
 17%|█▋        | 6406/37963 [14:27:53<84:45:00,  9.67s/it]
 17%|█▋        | 6407/37963 [14:28:00<79:17:59,  9.05s/it]
 17%|█▋        | 6408/37963 [14:28:08<76:00:05,  8.67s/it]
 17%|█▋        | 6409/37963 [14:28:16<73:40:04,  8.40s/it]
 17%|█▋        | 6410/37963 [14:28:26<78:38:24,  8.97s/it]
                                                          
{'loss': '0.1499', 'grad_norm': '2.334', 'learning_rate': '1.901e-05', 'epoch': '0.1688'}
+
 17%|█▋        | 6410/37963 [14:28:26<78:38:24,  8.97s/it]
 17%|█▋        | 6411/37963 [14:28:34<75:38:06,  8.63s/it]
 17%|█▋        | 6412/37963 [14:28:42<72:57:20,  8.32s/it]
 17%|█▋        | 6413/37963 [14:28:49<70:59:52,  8.10s/it]
 17%|█▋        | 6414/37963 [14:28:57<69:41:19,  7.95s/it]
 17%|█▋        | 6415/37963 [14:29:05<68:44:41,  7.84s/it]
 17%|█▋        | 6416/37963 [14:29:12<68:28:28,  7.81s/it]
 17%|█▋        | 6417/37963 [14:29:20<68:09:46,  7.78s/it]
 17%|█▋        | 6418/37963 [14:29:28<68:11:54,  7.78s/it]
 17%|█▋        | 6419/37963 [14:29:35<68:04:37,  7.77s/it]
 17%|█▋        | 6420/37963 [14:29:43<67:11:03,  7.67s/it]
                                                          
{'loss': '0.1686', 'grad_norm': '1.569', 'learning_rate': '1.9e-05', 'epoch': '0.1691'}
+
 17%|█▋        | 6420/37963 [14:29:43<67:11:03,  7.67s/it]
 17%|█▋        | 6421/37963 [14:29:53<74:36:55,  8.52s/it]
 17%|█▋        | 6422/37963 [14:30:01<72:00:20,  8.22s/it]
 17%|█▋        | 6423/37963 [14:30:09<70:46:07,  8.08s/it]
 17%|█▋        | 6424/37963 [14:30:17<70:21:18,  8.03s/it]
 17%|█▋        | 6425/37963 [14:30:27<76:47:22,  8.77s/it]
 17%|█▋        | 6426/37963 [14:30:35<73:51:53,  8.43s/it]
 17%|█▋        | 6427/37963 [14:30:42<71:41:20,  8.18s/it]
 17%|█▋        | 6428/37963 [14:30:50<70:18:11,  8.03s/it]
 17%|█▋        | 6429/37963 [14:30:58<69:08:55,  7.89s/it]
 17%|█▋        | 6430/37963 [14:31:05<68:59:40,  7.88s/it]
                                                          
{'loss': '0.1759', 'grad_norm': '4.644', 'learning_rate': '1.9e-05', 'epoch': '0.1694'}
+
 17%|█▋        | 6430/37963 [14:31:05<68:59:40,  7.88s/it]
 17%|█▋        | 6431/37963 [14:31:13<68:50:00,  7.86s/it]
 17%|█▋        | 6432/37963 [14:31:21<68:10:57,  7.78s/it]
 17%|█▋        | 6433/37963 [14:31:31<74:31:32,  8.51s/it]
 17%|█▋        | 6434/37963 [14:31:39<72:05:50,  8.23s/it]
 17%|█▋        | 6435/37963 [14:31:46<70:22:28,  8.04s/it]
 17%|█▋        | 6436/37963 [14:31:54<69:41:55,  7.96s/it]
 17%|█▋        | 6437/37963 [14:32:02<68:32:01,  7.83s/it]
 17%|█▋        | 6438/37963 [14:32:09<67:58:37,  7.76s/it]
 17%|█▋        | 6439/37963 [14:32:17<67:20:28,  7.69s/it]
 17%|█▋        | 6440/37963 [14:32:24<67:05:55,  7.66s/it]
                                                          
{'loss': '0.1783', 'grad_norm': '2.765', 'learning_rate': '1.9e-05', 'epoch': '0.1696'}
+
 17%|█▋        | 6440/37963 [14:32:24<67:05:55,  7.66s/it]
 17%|█▋        | 6441/37963 [14:32:32<67:37:07,  7.72s/it]
 17%|█▋        | 6442/37963 [14:32:40<67:07:29,  7.67s/it]
 17%|█▋        | 6443/37963 [14:32:47<66:23:02,  7.58s/it]
 17%|█▋        | 6444/37963 [14:32:55<66:49:56,  7.63s/it]
 17%|█▋        | 6445/37963 [14:33:02<66:46:28,  7.63s/it]
 17%|█▋        | 6446/37963 [14:33:13<73:57:38,  8.45s/it]
 17%|█▋        | 6447/37963 [14:33:20<71:41:08,  8.19s/it]
 17%|█▋        | 6448/37963 [14:33:28<70:12:52,  8.02s/it]
 17%|█▋        | 6449/37963 [14:33:36<69:35:01,  7.95s/it]
 17%|█▋        | 6450/37963 [14:33:49<82:18:35,  9.40s/it]
                                                          
{'loss': '0.1763', 'grad_norm': '4.272', 'learning_rate': '1.899e-05', 'epoch': '0.1699'}
+
 17%|█▋        | 6450/37963 [14:33:49<82:18:35,  9.40s/it]
 17%|█▋        | 6451/37963 [14:33:56<78:01:19,  8.91s/it]
 17%|█▋        | 6452/37963 [14:34:04<74:57:06,  8.56s/it]
 17%|█▋        | 6453/37963 [14:34:12<72:31:40,  8.29s/it]
 17%|█▋        | 6454/37963 [14:34:22<77:48:19,  8.89s/it]
 17%|█▋        | 6455/37963 [14:34:30<74:44:53,  8.54s/it]
 17%|█▋        | 6456/37963 [14:34:37<72:29:36,  8.28s/it]
 17%|█▋        | 6457/37963 [14:34:45<70:56:42,  8.11s/it]
 17%|█▋        | 6458/37963 [14:34:52<68:53:03,  7.87s/it]
 17%|█▋        | 6459/37963 [14:35:00<67:54:44,  7.76s/it]
 17%|█▋        | 6460/37963 [14:35:10<74:44:01,  8.54s/it]
                                                          
{'loss': '0.1979', 'grad_norm': '1.772', 'learning_rate': '1.899e-05', 'epoch': '0.1702'}
+
 17%|█▋        | 6460/37963 [14:35:10<74:44:01,  8.54s/it]
 17%|█▋        | 6461/37963 [14:35:18<72:39:34,  8.30s/it]
 17%|█▋        | 6462/37963 [14:35:26<70:44:23,  8.08s/it]
 17%|█▋        | 6463/37963 [14:35:33<69:44:42,  7.97s/it]
 17%|█▋        | 6464/37963 [14:35:41<68:48:23,  7.86s/it]
 17%|█▋        | 6465/37963 [14:35:49<68:26:58,  7.82s/it]
 17%|█▋        | 6466/37963 [14:35:56<68:13:29,  7.80s/it]
 17%|█▋        | 6467/37963 [14:36:04<68:25:56,  7.82s/it]
 17%|█▋        | 6468/37963 [14:36:12<68:05:30,  7.78s/it]
 17%|█▋        | 6469/37963 [14:36:23<76:12:01,  8.71s/it]
 17%|█▋        | 6470/37963 [14:36:30<73:14:19,  8.37s/it]
                                                          
{'loss': '0.189', 'grad_norm': '4.908', 'learning_rate': '1.898e-05', 'epoch': '0.1704'}
+
 17%|█▋        | 6470/37963 [14:36:30<73:14:19,  8.37s/it]
 17%|█▋        | 6471/37963 [14:36:38<71:53:26,  8.22s/it]
 17%|█▋        | 6472/37963 [14:36:46<70:50:30,  8.10s/it]
 17%|█▋        | 6473/37963 [14:36:54<69:35:41,  7.96s/it]
 17%|█▋        | 6474/37963 [14:37:01<68:24:29,  7.82s/it]
 17%|█▋        | 6475/37963 [14:37:09<67:56:32,  7.77s/it]
 17%|█▋        | 6476/37963 [14:37:16<67:19:29,  7.70s/it]
 17%|█▋        | 6477/37963 [14:37:24<67:47:16,  7.75s/it]
 17%|█▋        | 6478/37963 [14:37:31<66:17:58,  7.58s/it]
 17%|█▋        | 6479/37963 [14:37:42<73:17:43,  8.38s/it]
 17%|█▋        | 6480/37963 [14:37:49<70:28:43,  8.06s/it]
                                                          
{'loss': '0.1754', 'grad_norm': '2.553', 'learning_rate': '1.898e-05', 'epoch': '0.1707'}
+
 17%|█▋        | 6480/37963 [14:37:49<70:28:43,  8.06s/it]
 17%|█▋        | 6481/37963 [14:37:57<69:38:39,  7.96s/it]
 17%|█▋        | 6482/37963 [14:38:04<68:59:14,  7.89s/it]
 17%|█▋        | 6483/37963 [14:38:12<68:19:32,  7.81s/it]
 17%|█▋        | 6484/37963 [14:38:20<67:53:39,  7.76s/it]
 17%|█▋        | 6485/37963 [14:38:27<66:23:59,  7.59s/it]
 17%|█▋        | 6486/37963 [14:38:37<73:09:00,  8.37s/it]
 17%|█▋        | 6487/37963 [14:38:45<70:43:43,  8.09s/it]
 17%|█▋        | 6488/37963 [14:38:52<68:32:19,  7.84s/it]
 17%|█▋        | 6489/37963 [14:38:59<67:14:21,  7.69s/it]
 17%|█▋        | 6490/37963 [14:39:07<67:45:39,  7.75s/it]
                                                          
{'loss': '0.1849', 'grad_norm': '4.437', 'learning_rate': '1.898e-05', 'epoch': '0.171'}
+
 17%|█▋        | 6490/37963 [14:39:07<67:45:39,  7.75s/it]
 17%|█▋        | 6491/37963 [14:39:15<67:30:53,  7.72s/it]
 17%|█▋        | 6492/37963 [14:39:22<67:36:16,  7.73s/it]
 17%|█▋        | 6493/37963 [14:39:30<66:46:14,  7.64s/it]
 17%|█▋        | 6494/37963 [14:39:40<73:34:02,  8.42s/it]
 17%|█▋        | 6495/37963 [14:39:48<71:44:12,  8.21s/it]
 17%|█▋        | 6496/37963 [14:39:58<77:47:23,  8.90s/it]
 17%|█▋        | 6497/37963 [14:40:06<74:23:26,  8.51s/it]
 17%|█▋        | 6498/37963 [14:40:19<85:08:55,  9.74s/it]
 17%|█▋        | 6499/37963 [14:40:26<79:47:13,  9.13s/it]
 17%|█▋        | 6500/37963 [14:40:34<75:51:25,  8.68s/it]
                                                          
{'loss': '0.1766', 'grad_norm': '2.771', 'learning_rate': '1.897e-05', 'epoch': '0.1712'}
+
 17%|█▋        | 6500/37963 [14:40:34<75:51:25,  8.68s/it]
 17%|█▋        | 6501/37963 [14:40:42<73:05:44,  8.36s/it]
 17%|█▋        | 6502/37963 [14:40:49<71:05:10,  8.13s/it]
 17%|█▋        | 6503/37963 [14:40:57<69:42:17,  7.98s/it]
 17%|█▋        | 6504/37963 [14:41:05<69:05:10,  7.91s/it]
 17%|█▋        | 6505/37963 [14:41:12<68:27:07,  7.83s/it]
 17%|█▋        | 6506/37963 [14:41:19<67:01:51,  7.67s/it]
 17%|█▋        | 6507/37963 [14:41:27<66:06:50,  7.57s/it]
 17%|█▋        | 6508/37963 [14:41:34<66:26:25,  7.60s/it]
 17%|█▋        | 6509/37963 [14:41:42<66:38:59,  7.63s/it]
 17%|█▋        | 6510/37963 [14:41:50<67:06:14,  7.68s/it]
                                                          
{'loss': '0.1733', 'grad_norm': '6.788', 'learning_rate': '1.897e-05', 'epoch': '0.1715'}
+
 17%|█▋        | 6510/37963 [14:41:50<67:06:14,  7.68s/it]
 17%|█▋        | 6511/37963 [14:41:58<66:52:16,  7.65s/it]
 17%|█▋        | 6512/37963 [14:42:05<67:37:15,  7.74s/it]
 17%|█▋        | 6513/37963 [14:42:16<74:17:30,  8.50s/it]
 17%|█▋        | 6514/37963 [14:42:26<79:51:27,  9.14s/it]
 17%|█▋        | 6515/37963 [14:42:34<75:39:48,  8.66s/it]
 17%|█▋        | 6516/37963 [14:42:42<73:49:49,  8.45s/it]
 17%|█▋        | 6517/37963 [14:42:50<72:20:41,  8.28s/it]
 17%|█▋        | 6518/37963 [14:42:57<70:38:39,  8.09s/it]
 17%|█▋        | 6519/37963 [14:43:05<68:37:53,  7.86s/it]
 17%|█▋        | 6520/37963 [14:43:13<68:23:58,  7.83s/it]
                                                          
{'loss': '0.1679', 'grad_norm': '2.429', 'learning_rate': '1.897e-05', 'epoch': '0.1717'}
+
 17%|█▋        | 6520/37963 [14:43:13<68:23:58,  7.83s/it]
 17%|█▋        | 6521/37963 [14:43:20<68:01:37,  7.79s/it]
 17%|█▋        | 6522/37963 [14:43:28<67:06:15,  7.68s/it]
 17%|█▋        | 6523/37963 [14:43:35<67:13:18,  7.70s/it]
 17%|█▋        | 6524/37963 [14:43:43<67:18:30,  7.71s/it]
 17%|█▋        | 6525/37963 [14:43:51<67:42:41,  7.75s/it]
 17%|█▋        | 6526/37963 [14:43:58<66:37:10,  7.63s/it]
 17%|█▋        | 6527/37963 [14:44:06<66:51:08,  7.66s/it]
 17%|█▋        | 6528/37963 [14:44:13<65:56:22,  7.55s/it]
 17%|█▋        | 6529/37963 [14:44:21<66:37:59,  7.63s/it]
 17%|█▋        | 6530/37963 [14:44:29<67:01:34,  7.68s/it]
                                                          
{'loss': '0.1837', 'grad_norm': '2.337', 'learning_rate': '1.896e-05', 'epoch': '0.172'}
+
 17%|█▋        | 6530/37963 [14:44:29<67:01:34,  7.68s/it]
 17%|█▋        | 6531/37963 [14:44:37<67:31:44,  7.73s/it]
 17%|█▋        | 6532/37963 [14:44:44<67:04:15,  7.68s/it]
 17%|█▋        | 6533/37963 [14:44:54<73:21:06,  8.40s/it]
 17%|█▋        | 6534/37963 [14:45:02<71:34:07,  8.20s/it]
 17%|█▋        | 6535/37963 [14:45:10<69:27:21,  7.96s/it]
 17%|█▋        | 6536/37963 [14:45:17<68:00:02,  7.79s/it]
 17%|█▋        | 6537/37963 [14:45:27<74:27:01,  8.53s/it]
 17%|█▋        | 6538/37963 [14:45:35<73:19:49,  8.40s/it]
 17%|█▋        | 6539/37963 [14:45:43<70:27:53,  8.07s/it]
 17%|█▋        | 6540/37963 [14:45:50<69:27:59,  7.96s/it]
                                                          
{'loss': '0.1862', 'grad_norm': '2.558', 'learning_rate': '1.896e-05', 'epoch': '0.1723'}
+
 17%|█▋        | 6540/37963 [14:45:50<69:27:59,  7.96s/it]
 17%|█▋        | 6541/37963 [14:45:58<68:15:36,  7.82s/it]
 17%|█▋        | 6542/37963 [14:46:06<68:20:04,  7.83s/it]
 17%|█▋        | 6543/37963 [14:46:13<67:35:39,  7.74s/it]
 17%|█▋        | 6544/37963 [14:46:23<73:04:21,  8.37s/it]
 17%|█▋        | 6545/37963 [14:46:31<71:43:40,  8.22s/it]
 17%|█▋        | 6546/37963 [14:46:39<70:26:21,  8.07s/it]
 17%|█▋        | 6547/37963 [14:46:46<69:52:05,  8.01s/it]
 17%|█▋        | 6548/37963 [14:46:57<75:40:52,  8.67s/it]
 17%|█▋        | 6549/37963 [14:47:04<72:41:14,  8.33s/it]
 17%|█▋        | 6550/37963 [14:47:12<71:27:57,  8.19s/it]
                                                          
{'loss': '0.167', 'grad_norm': '1.411', 'learning_rate': '1.895e-05', 'epoch': '0.1725'}
+
 17%|█▋        | 6550/37963 [14:47:12<71:27:57,  8.19s/it]
 17%|█▋        | 6551/37963 [14:47:25<82:58:20,  9.51s/it]
 17%|█▋        | 6552/37963 [14:47:32<78:16:09,  8.97s/it]
 17%|█▋        | 6553/37963 [14:47:40<75:07:55,  8.61s/it]
 17%|█▋        | 6554/37963 [14:47:48<72:59:02,  8.37s/it]
 17%|█▋        | 6555/37963 [14:47:56<70:59:37,  8.14s/it]
 17%|█▋        | 6556/37963 [14:48:03<69:57:14,  8.02s/it]
 17%|█▋        | 6557/37963 [14:48:11<69:31:46,  7.97s/it]
 17%|█▋        | 6558/37963 [14:48:19<68:36:38,  7.86s/it]
 17%|█▋        | 6559/37963 [14:48:26<67:58:52,  7.79s/it]
 17%|█▋        | 6560/37963 [14:48:34<67:45:17,  7.77s/it]
                                                          
{'loss': '0.1916', 'grad_norm': '1.949', 'learning_rate': '1.895e-05', 'epoch': '0.1728'}
+
 17%|█▋        | 6560/37963 [14:48:34<67:45:17,  7.77s/it]
 17%|█▋        | 6561/37963 [14:48:42<67:48:41,  7.77s/it]
 17%|█▋        | 6562/37963 [14:48:53<75:44:52,  8.68s/it]
 17%|█▋        | 6563/37963 [14:49:01<73:35:50,  8.44s/it]
 17%|█▋        | 6564/37963 [14:49:08<71:37:49,  8.21s/it]
 17%|█▋        | 6565/37963 [14:49:16<70:16:58,  8.06s/it]
 17%|█▋        | 6566/37963 [14:49:26<76:09:39,  8.73s/it]
 17%|█▋        | 6567/37963 [14:49:34<73:15:32,  8.40s/it]
 17%|█▋        | 6568/37963 [14:49:42<71:08:14,  8.16s/it]
 17%|█▋        | 6569/37963 [14:49:49<69:49:03,  8.01s/it]
 17%|█▋        | 6570/37963 [14:49:57<69:18:46,  7.95s/it]
                                                          
{'loss': '0.1677', 'grad_norm': '2.176', 'learning_rate': '1.895e-05', 'epoch': '0.1731'}
+
 17%|█▋        | 6570/37963 [14:49:57<69:18:46,  7.95s/it]
 17%|█▋        | 6571/37963 [14:50:05<69:09:25,  7.93s/it]
 17%|█▋        | 6572/37963 [14:50:13<68:38:02,  7.87s/it]
 17%|█▋        | 6573/37963 [14:50:20<67:53:08,  7.79s/it]
 17%|█▋        | 6574/37963 [14:50:28<67:31:18,  7.74s/it]
 17%|█▋        | 6575/37963 [14:50:35<67:05:21,  7.69s/it]
 17%|█▋        | 6576/37963 [14:50:43<67:11:52,  7.71s/it]
 17%|█▋        | 6577/37963 [14:50:51<66:54:45,  7.67s/it]
 17%|█▋        | 6578/37963 [14:50:58<67:05:41,  7.70s/it]
 17%|█▋        | 6579/37963 [14:51:06<67:11:25,  7.71s/it]
 17%|█▋        | 6580/37963 [14:51:16<73:45:35,  8.46s/it]
                                                          
{'loss': '0.1807', 'grad_norm': '2.493', 'learning_rate': '1.894e-05', 'epoch': '0.1733'}
+
 17%|█▋        | 6580/37963 [14:51:16<73:45:35,  8.46s/it]
 17%|█▋        | 6581/37963 [14:51:24<72:16:21,  8.29s/it]
 17%|█▋        | 6582/37963 [14:51:32<70:47:30,  8.12s/it]
 17%|█▋        | 6583/37963 [14:51:39<68:58:38,  7.91s/it]
 17%|█▋        | 6584/37963 [14:51:47<69:06:32,  7.93s/it]
 17%|█▋        | 6585/37963 [14:51:55<68:27:26,  7.85s/it]
 17%|█▋        | 6586/37963 [14:52:03<68:42:47,  7.88s/it]
 17%|█▋        | 6587/37963 [14:52:13<74:53:45,  8.59s/it]
 17%|█▋        | 6588/37963 [14:52:21<72:28:25,  8.32s/it]
 17%|█▋        | 6589/37963 [14:52:31<78:03:02,  8.96s/it]
 17%|█▋        | 6590/37963 [14:52:39<75:10:47,  8.63s/it]
                                                          
{'loss': '0.1796', 'grad_norm': '3.855', 'learning_rate': '1.894e-05', 'epoch': '0.1736'}
+
 17%|█▋        | 6590/37963 [14:52:39<75:10:47,  8.63s/it]
 17%|█▋        | 6591/37963 [14:52:47<72:46:13,  8.35s/it]
 17%|█▋        | 6592/37963 [14:52:57<77:51:15,  8.93s/it]
 17%|█▋        | 6593/37963 [14:53:05<74:42:11,  8.57s/it]
 17%|█▋        | 6594/37963 [14:53:13<72:39:22,  8.34s/it]
 17%|█▋        | 6595/37963 [14:53:23<77:00:33,  8.84s/it]
 17%|█▋        | 6596/37963 [14:53:30<73:41:54,  8.46s/it]
 17%|█▋        | 6597/37963 [14:53:38<72:33:06,  8.33s/it]
 17%|█▋        | 6598/37963 [14:53:46<70:37:01,  8.11s/it]
 17%|█▋        | 6599/37963 [14:53:54<69:30:24,  7.98s/it]
 17%|█▋        | 6600/37963 [14:54:02<69:06:18,  7.93s/it]
                                                          
{'loss': '0.1949', 'grad_norm': '1.896', 'learning_rate': '1.893e-05', 'epoch': '0.1739'}
+
 17%|█▋        | 6600/37963 [14:54:02<69:06:18,  7.93s/it]
 17%|█▋        | 6601/37963 [14:54:09<69:02:03,  7.92s/it]
 17%|█▋        | 6602/37963 [14:54:17<68:46:37,  7.90s/it]
 17%|█▋        | 6603/37963 [14:54:25<68:10:18,  7.83s/it]
 17%|█▋        | 6604/37963 [14:54:32<67:22:40,  7.73s/it]
 17%|█▋        | 6605/37963 [14:54:43<73:42:22,  8.46s/it]
 17%|█▋        | 6606/37963 [14:54:53<79:18:51,  9.11s/it]
 17%|█▋        | 6607/37963 [14:55:01<74:59:58,  8.61s/it]
 17%|█▋        | 6608/37963 [14:55:09<73:10:32,  8.40s/it]
 17%|█▋        | 6609/37963 [14:55:16<71:01:32,  8.16s/it]
 17%|█▋        | 6610/37963 [14:55:27<76:50:23,  8.82s/it]
                                                          
{'loss': '0.1701', 'grad_norm': '2.747', 'learning_rate': '1.893e-05', 'epoch': '0.1741'}
+
 17%|█▋        | 6610/37963 [14:55:27<76:50:23,  8.82s/it]
 17%|█▋        | 6611/37963 [14:55:34<74:05:23,  8.51s/it]
 17%|█▋        | 6612/37963 [14:55:42<72:17:21,  8.30s/it]
 17%|█▋        | 6613/37963 [14:55:50<70:31:35,  8.10s/it]
 17%|█▋        | 6614/37963 [14:55:57<69:13:45,  7.95s/it]
 17%|█▋        | 6615/37963 [14:56:05<68:30:17,  7.87s/it]
 17%|█▋        | 6616/37963 [14:56:13<68:16:46,  7.84s/it]
 17%|█▋        | 6617/37963 [14:56:21<68:46:44,  7.90s/it]
 17%|█▋        | 6618/37963 [14:56:28<68:05:50,  7.82s/it]
 17%|█▋        | 6619/37963 [14:56:36<68:08:17,  7.83s/it]
 17%|█▋        | 6620/37963 [14:56:44<67:46:01,  7.78s/it]
                                                          
{'loss': '0.172', 'grad_norm': '3.675', 'learning_rate': '1.893e-05', 'epoch': '0.1744'}
+
 17%|█▋        | 6620/37963 [14:56:44<67:46:01,  7.78s/it]
 17%|█▋        | 6621/37963 [14:56:52<67:43:45,  7.78s/it]
 17%|█▋        | 6622/37963 [14:56:59<67:18:14,  7.73s/it]
 17%|█▋        | 6623/37963 [14:57:07<67:23:34,  7.74s/it]
 17%|█▋        | 6624/37963 [14:57:15<67:16:03,  7.73s/it]
 17%|█▋        | 6625/37963 [14:57:22<66:51:22,  7.68s/it]
 17%|█▋        | 6626/37963 [14:57:30<66:59:48,  7.70s/it]
 17%|█▋        | 6627/37963 [14:57:38<67:18:18,  7.73s/it]
 17%|█▋        | 6628/37963 [14:57:46<67:07:57,  7.71s/it]
 17%|█▋        | 6629/37963 [14:57:53<66:34:57,  7.65s/it]
 17%|█▋        | 6630/37963 [14:58:01<66:43:27,  7.67s/it]
                                                          
{'loss': '0.1774', 'grad_norm': '3.359', 'learning_rate': '1.892e-05', 'epoch': '0.1746'}
+
 17%|█▋        | 6630/37963 [14:58:01<66:43:27,  7.67s/it]
 17%|█▋        | 6631/37963 [14:58:08<66:31:25,  7.64s/it]
 17%|█▋        | 6632/37963 [14:58:18<72:38:10,  8.35s/it]
 17%|█▋        | 6633/37963 [14:58:26<71:20:41,  8.20s/it]
 17%|█▋        | 6634/37963 [14:58:36<76:07:46,  8.75s/it]
 17%|█▋        | 6635/37963 [14:58:44<73:06:20,  8.40s/it]
 17%|█▋        | 6636/37963 [14:58:52<71:18:18,  8.19s/it]
 17%|█▋        | 6637/37963 [14:58:59<70:05:41,  8.06s/it]
 17%|█▋        | 6638/37963 [14:59:10<75:43:41,  8.70s/it]
 17%|█▋        | 6639/37963 [14:59:18<73:48:27,  8.48s/it]
 17%|█▋        | 6640/37963 [14:59:25<71:49:20,  8.25s/it]
                                                          
{'loss': '0.182', 'grad_norm': '7.174', 'learning_rate': '1.892e-05', 'epoch': '0.1749'}
+
 17%|█▋        | 6640/37963 [14:59:25<71:49:20,  8.25s/it]
 17%|█▋        | 6641/37963 [14:59:36<77:42:42,  8.93s/it]
 17%|█▋        | 6642/37963 [14:59:43<73:37:12,  8.46s/it]
 17%|█▋        | 6643/37963 [14:59:51<72:22:07,  8.32s/it]
 18%|█▊        | 6644/37963 [15:00:01<76:37:22,  8.81s/it]
 18%|█▊        | 6645/37963 [15:00:08<72:56:00,  8.38s/it]
 18%|█▊        | 6646/37963 [15:00:16<71:02:32,  8.17s/it]
 18%|█▊        | 6647/37963 [15:00:24<69:42:55,  8.01s/it]
 18%|█▊        | 6648/37963 [15:00:31<68:20:22,  7.86s/it]
 18%|█▊        | 6649/37963 [15:00:39<68:35:46,  7.89s/it]
 18%|█▊        | 6650/37963 [15:00:47<68:11:41,  7.84s/it]
                                                          
{'loss': '0.1589', 'grad_norm': '1.809', 'learning_rate': '1.892e-05', 'epoch': '0.1752'}
+
 18%|█▊        | 6650/37963 [15:00:47<68:11:41,  7.84s/it]
 18%|█▊        | 6651/37963 [15:00:55<67:56:20,  7.81s/it]
 18%|█▊        | 6652/37963 [15:01:02<67:08:37,  7.72s/it]
 18%|█▊        | 6653/37963 [15:01:12<73:02:04,  8.40s/it]
 18%|█▊        | 6654/37963 [15:01:23<78:53:45,  9.07s/it]
 18%|█▊        | 6655/37963 [15:01:30<75:00:58,  8.63s/it]
 18%|█▊        | 6656/37963 [15:01:38<72:40:19,  8.36s/it]
 18%|█▊        | 6657/37963 [15:01:46<70:49:05,  8.14s/it]
 18%|█▊        | 6658/37963 [15:01:54<70:02:27,  8.05s/it]
 18%|█▊        | 6659/37963 [15:02:01<69:30:17,  7.99s/it]
 18%|█▊        | 6660/37963 [15:02:09<68:32:45,  7.88s/it]
                                                          
{'loss': '0.1832', 'grad_norm': '4.872', 'learning_rate': '1.891e-05', 'epoch': '0.1754'}
+
 18%|█▊        | 6660/37963 [15:02:09<68:32:45,  7.88s/it]
 18%|█▊        | 6661/37963 [15:02:17<68:12:48,  7.85s/it]
 18%|█▊        | 6662/37963 [15:02:25<68:04:01,  7.83s/it]
 18%|█▊        | 6663/37963 [15:02:35<75:07:25,  8.64s/it]
 18%|█▊        | 6664/37963 [15:02:43<72:30:52,  8.34s/it]
 18%|█▊        | 6665/37963 [15:02:50<70:37:08,  8.12s/it]
 18%|█▊        | 6666/37963 [15:02:58<69:28:55,  7.99s/it]
 18%|█▊        | 6667/37963 [15:03:06<68:42:17,  7.90s/it]
 18%|█▊        | 6668/37963 [15:03:14<68:33:57,  7.89s/it]
 18%|█▊        | 6669/37963 [15:03:21<67:05:11,  7.72s/it]
 18%|█▊        | 6670/37963 [15:03:29<67:23:18,  7.75s/it]
                                                          
{'loss': '0.1746', 'grad_norm': '4.008', 'learning_rate': '1.891e-05', 'epoch': '0.1757'}
+
 18%|█▊        | 6670/37963 [15:03:29<67:23:18,  7.75s/it]
 18%|█▊        | 6671/37963 [15:03:37<67:31:55,  7.77s/it]
 18%|█▊        | 6672/37963 [15:03:44<66:53:52,  7.70s/it]
 18%|█▊        | 6673/37963 [15:03:52<66:41:01,  7.67s/it]
 18%|█▊        | 6674/37963 [15:04:00<67:03:07,  7.71s/it]
 18%|█▊        | 6675/37963 [15:04:07<66:51:30,  7.69s/it]
 18%|█▊        | 6676/37963 [15:04:15<66:45:25,  7.68s/it]
 18%|█▊        | 6677/37963 [15:04:23<66:49:34,  7.69s/it]
 18%|█▊        | 6678/37963 [15:04:33<73:35:03,  8.47s/it]
 18%|█▊        | 6679/37963 [15:04:41<71:47:51,  8.26s/it]
 18%|█▊        | 6680/37963 [15:04:48<70:11:49,  8.08s/it]
                                                          
{'loss': '0.1749', 'grad_norm': '2.548', 'learning_rate': '1.89e-05', 'epoch': '0.176'}
+
 18%|█▊        | 6680/37963 [15:04:48<70:11:49,  8.08s/it]
 18%|█▊        | 6681/37963 [15:04:56<69:14:25,  7.97s/it]
 18%|█▊        | 6682/37963 [15:05:06<75:30:53,  8.69s/it]
 18%|█▊        | 6683/37963 [15:05:14<73:13:04,  8.43s/it]
 18%|█▊        | 6684/37963 [15:05:22<70:30:49,  8.12s/it]
 18%|█▊        | 6685/37963 [15:05:29<68:43:03,  7.91s/it]
 18%|█▊        | 6686/37963 [15:05:37<67:57:57,  7.82s/it]
 18%|█▊        | 6687/37963 [15:05:47<74:41:09,  8.60s/it]
 18%|█▊        | 6688/37963 [15:05:57<78:15:50,  9.01s/it]
 18%|█▊        | 6689/37963 [15:06:05<75:09:42,  8.65s/it]
 18%|█▊        | 6690/37963 [15:06:12<72:23:45,  8.33s/it]
                                                          
{'loss': '0.1916', 'grad_norm': '4.547', 'learning_rate': '1.89e-05', 'epoch': '0.1762'}
+
 18%|█▊        | 6690/37963 [15:06:12<72:23:45,  8.33s/it]
 18%|█▊        | 6691/37963 [15:06:20<71:03:53,  8.18s/it]
 18%|█▊        | 6692/37963 [15:06:28<69:52:52,  8.04s/it]
 18%|█▊        | 6693/37963 [15:06:36<69:04:50,  7.95s/it]
 18%|█▊        | 6694/37963 [15:06:43<68:04:19,  7.84s/it]
 18%|█▊        | 6695/37963 [15:06:53<73:49:19,  8.50s/it]
 18%|█▊        | 6696/37963 [15:07:01<71:51:24,  8.27s/it]
 18%|█▊        | 6697/37963 [15:07:11<76:13:13,  8.78s/it]
 18%|█▊        | 6698/37963 [15:07:19<73:32:13,  8.47s/it]
 18%|█▊        | 6699/37963 [15:07:27<72:16:01,  8.32s/it]
 18%|█▊        | 6700/37963 [15:07:35<70:58:17,  8.17s/it]
                                                          
{'loss': '0.1812', 'grad_norm': '4.144', 'learning_rate': '1.89e-05', 'epoch': '0.1765'}
+
 18%|█▊        | 6700/37963 [15:07:35<70:58:17,  8.17s/it]
 18%|█▊        | 6701/37963 [15:07:42<69:59:57,  8.06s/it]
 18%|█▊        | 6702/37963 [15:07:50<68:36:10,  7.90s/it]
 18%|█▊        | 6703/37963 [15:07:57<67:22:33,  7.76s/it]
 18%|█▊        | 6704/37963 [15:08:05<67:01:27,  7.72s/it]
 18%|█▊        | 6705/37963 [15:08:13<67:14:19,  7.74s/it]
 18%|█▊        | 6706/37963 [15:08:23<74:30:07,  8.58s/it]
 18%|█▊        | 6707/37963 [15:08:31<72:16:42,  8.32s/it]
 18%|█▊        | 6708/37963 [15:08:39<70:16:43,  8.09s/it]
 18%|█▊        | 6709/37963 [15:08:46<69:32:35,  8.01s/it]
 18%|█▊        | 6710/37963 [15:08:54<68:43:36,  7.92s/it]
                                                          
{'loss': '0.1863', 'grad_norm': '3.531', 'learning_rate': '1.889e-05', 'epoch': '0.1768'}
+
 18%|█▊        | 6710/37963 [15:08:54<68:43:36,  7.92s/it]
 18%|█▊        | 6711/37963 [15:09:02<67:49:29,  7.81s/it]
 18%|█▊        | 6712/37963 [15:09:09<67:17:39,  7.75s/it]
 18%|█▊        | 6713/37963 [15:09:17<66:43:48,  7.69s/it]
 18%|█▊        | 6714/37963 [15:09:24<66:29:37,  7.66s/it]
 18%|█▊        | 6715/37963 [15:09:32<66:00:51,  7.61s/it]
 18%|█▊        | 6716/37963 [15:09:40<66:15:03,  7.63s/it]
 18%|█▊        | 6717/37963 [15:09:49<72:02:16,  8.30s/it]
 18%|█▊        | 6718/37963 [15:09:57<70:41:59,  8.15s/it]
 18%|█▊        | 6719/37963 [15:10:05<69:28:21,  8.00s/it]
 18%|█▊        | 6720/37963 [15:10:13<68:50:43,  7.93s/it]
                                                          
{'loss': '0.1689', 'grad_norm': '5.809', 'learning_rate': '1.889e-05', 'epoch': '0.177'}
+
 18%|█▊        | 6720/37963 [15:10:13<68:50:43,  7.93s/it]
 18%|█▊        | 6721/37963 [15:10:21<68:53:47,  7.94s/it]
 18%|█▊        | 6722/37963 [15:10:28<67:48:43,  7.81s/it]
 18%|█▊        | 6723/37963 [15:10:36<67:31:04,  7.78s/it]
 18%|█▊        | 6724/37963 [15:10:44<67:28:04,  7.78s/it]
 18%|█▊        | 6725/37963 [15:10:51<66:59:44,  7.72s/it]
 18%|█▊        | 6726/37963 [15:10:59<66:45:52,  7.69s/it]
 18%|█▊        | 6727/37963 [15:11:06<65:53:19,  7.59s/it]
 18%|█▊        | 6728/37963 [15:11:14<65:32:40,  7.55s/it]
 18%|█▊        | 6729/37963 [15:11:21<66:12:45,  7.63s/it]
 18%|█▊        | 6730/37963 [15:11:29<66:21:51,  7.65s/it]
                                                          
{'loss': '0.1771', 'grad_norm': '3.853', 'learning_rate': '1.888e-05', 'epoch': '0.1773'}
+
 18%|█▊        | 6730/37963 [15:11:29<66:21:51,  7.65s/it]
 18%|█▊        | 6731/37963 [15:11:42<79:33:48,  9.17s/it]
 18%|█▊        | 6732/37963 [15:11:50<75:35:04,  8.71s/it]
 18%|█▊        | 6733/37963 [15:11:58<73:39:18,  8.49s/it]
 18%|█▊        | 6734/37963 [15:12:05<70:55:56,  8.18s/it]
 18%|█▊        | 6735/37963 [15:12:12<68:26:49,  7.89s/it]
 18%|█▊        | 6736/37963 [15:12:22<74:39:58,  8.61s/it]
 18%|█▊        | 6737/37963 [15:12:30<72:40:49,  8.38s/it]
 18%|█▊        | 6738/37963 [15:12:38<70:40:17,  8.15s/it]
 18%|█▊        | 6739/37963 [15:12:46<69:41:59,  8.04s/it]
 18%|█▊        | 6740/37963 [15:12:53<68:06:39,  7.85s/it]
                                                          
{'loss': '0.1673', 'grad_norm': '2.725', 'learning_rate': '1.888e-05', 'epoch': '0.1775'}
+
 18%|█▊        | 6740/37963 [15:12:53<68:06:39,  7.85s/it]
 18%|█▊        | 6741/37963 [15:13:03<74:24:16,  8.58s/it]
 18%|█▊        | 6742/37963 [15:13:14<78:50:49,  9.09s/it]
 18%|█▊        | 6743/37963 [15:13:24<81:26:54,  9.39s/it]
 18%|█▊        | 6744/37963 [15:13:31<76:50:22,  8.86s/it]
 18%|█▊        | 6745/37963 [15:13:39<74:10:48,  8.55s/it]
 18%|█▊        | 6746/37963 [15:13:47<71:56:46,  8.30s/it]
 18%|█▊        | 6747/37963 [15:13:55<70:10:31,  8.09s/it]
 18%|█▊        | 6748/37963 [15:14:02<69:14:06,  7.98s/it]
 18%|█▊        | 6749/37963 [15:14:10<68:34:05,  7.91s/it]
 18%|█▊        | 6750/37963 [15:14:18<67:31:43,  7.79s/it]
                                                          
{'loss': '0.1848', 'grad_norm': '5.378', 'learning_rate': '1.888e-05', 'epoch': '0.1778'}
+
 18%|█▊        | 6750/37963 [15:14:18<67:31:43,  7.79s/it]
 18%|█▊        | 6751/37963 [15:14:25<67:06:28,  7.74s/it]
 18%|█▊        | 6752/37963 [15:14:33<66:42:56,  7.70s/it]
 18%|█▊        | 6753/37963 [15:14:40<66:12:10,  7.64s/it]
 18%|█▊        | 6754/37963 [15:14:48<65:51:45,  7.60s/it]
 18%|█▊        | 6755/37963 [15:14:56<66:36:50,  7.68s/it]
 18%|█▊        | 6756/37963 [15:15:04<67:19:21,  7.77s/it]
 18%|█▊        | 6757/37963 [15:15:11<67:13:35,  7.76s/it]
 18%|█▊        | 6758/37963 [15:15:19<67:13:37,  7.76s/it]
 18%|█▊        | 6759/37963 [15:15:27<66:58:30,  7.73s/it]
 18%|█▊        | 6760/37963 [15:15:37<74:37:02,  8.61s/it]
                                                          
{'loss': '0.1798', 'grad_norm': '3.704', 'learning_rate': '1.887e-05', 'epoch': '0.1781'}
+
 18%|█▊        | 6760/37963 [15:15:37<74:37:02,  8.61s/it]
 18%|█▊        | 6761/37963 [15:15:45<72:50:06,  8.40s/it]
 18%|█▊        | 6762/37963 [15:15:53<70:36:28,  8.15s/it]
 18%|█▊        | 6763/37963 [15:16:00<69:02:24,  7.97s/it]
 18%|█▊        | 6764/37963 [15:16:08<68:15:05,  7.88s/it]
 18%|█▊        | 6765/37963 [15:16:16<67:52:41,  7.83s/it]
 18%|█▊        | 6766/37963 [15:16:23<67:08:59,  7.75s/it]
 18%|█▊        | 6767/37963 [15:16:31<66:48:38,  7.71s/it]
 18%|█▊        | 6768/37963 [15:16:39<66:48:48,  7.71s/it]
 18%|█▊        | 6769/37963 [15:16:47<67:16:33,  7.76s/it]
 18%|█▊        | 6770/37963 [15:16:57<74:08:01,  8.56s/it]
                                                          
{'loss': '0.1669', 'grad_norm': '1.6', 'learning_rate': '1.887e-05', 'epoch': '0.1783'}
+
 18%|█▊        | 6770/37963 [15:16:57<74:08:01,  8.56s/it]
 18%|█▊        | 6771/37963 [15:17:05<72:05:29,  8.32s/it]
 18%|█▊        | 6772/37963 [15:17:12<70:19:01,  8.12s/it]
 18%|█▊        | 6773/37963 [15:17:20<69:18:13,  8.00s/it]
 18%|█▊        | 6774/37963 [15:17:31<75:34:51,  8.72s/it]
 18%|█▊        | 6775/37963 [15:17:38<71:56:51,  8.30s/it]
 18%|█▊        | 6776/37963 [15:17:46<70:36:41,  8.15s/it]
 18%|█▊        | 6777/37963 [15:17:53<68:46:22,  7.94s/it]
 18%|█▊        | 6778/37963 [15:18:01<68:03:33,  7.86s/it]
 18%|█▊        | 6779/37963 [15:18:11<74:19:32,  8.58s/it]
 18%|█▊        | 6780/37963 [15:18:19<71:44:26,  8.28s/it]
                                                          
{'loss': '0.175', 'grad_norm': '2.547', 'learning_rate': '1.886e-05', 'epoch': '0.1786'}
+
 18%|█▊        | 6780/37963 [15:18:19<71:44:26,  8.28s/it]
 18%|█▊        | 6781/37963 [15:18:26<69:49:02,  8.06s/it]
 18%|█▊        | 6782/37963 [15:18:34<69:24:31,  8.01s/it]
 18%|█▊        | 6783/37963 [15:18:42<68:39:15,  7.93s/it]
 18%|█▊        | 6784/37963 [15:18:49<67:51:49,  7.84s/it]
 18%|█▊        | 6785/37963 [15:18:57<67:41:18,  7.82s/it]
 18%|█▊        | 6786/37963 [15:19:05<67:20:32,  7.78s/it]
 18%|█▊        | 6787/37963 [15:19:13<67:15:15,  7.77s/it]
 18%|█▊        | 6788/37963 [15:19:20<67:20:17,  7.78s/it]
 18%|█▊        | 6789/37963 [15:19:31<73:38:19,  8.50s/it]
 18%|█▊        | 6790/37963 [15:19:41<77:57:39,  9.00s/it]
                                                          
{'loss': '0.1699', 'grad_norm': '6.103', 'learning_rate': '1.886e-05', 'epoch': '0.1789'}
+
 18%|█▊        | 6790/37963 [15:19:41<77:57:39,  9.00s/it]
 18%|█▊        | 6791/37963 [15:19:51<81:47:09,  9.45s/it]
 18%|█▊        | 6792/37963 [15:19:59<77:00:55,  8.89s/it]
 18%|█▊        | 6793/37963 [15:20:07<73:48:24,  8.52s/it]
 18%|█▊        | 6794/37963 [15:20:14<71:13:31,  8.23s/it]
 18%|█▊        | 6795/37963 [15:20:22<70:00:37,  8.09s/it]
 18%|█▊        | 6796/37963 [15:20:32<75:14:42,  8.69s/it]
 18%|█▊        | 6797/37963 [15:20:40<72:25:17,  8.37s/it]
 18%|█▊        | 6798/37963 [15:20:47<70:31:43,  8.15s/it]
 18%|█▊        | 6799/37963 [15:20:55<69:35:33,  8.04s/it]
 18%|█▊        | 6800/37963 [15:21:03<68:27:22,  7.91s/it]
                                                          
{'loss': '0.1743', 'grad_norm': '2.633', 'learning_rate': '1.886e-05', 'epoch': '0.1791'}
+
 18%|█▊        | 6800/37963 [15:21:03<68:27:22,  7.91s/it]
 18%|█▊        | 6801/37963 [15:21:10<67:38:44,  7.81s/it]
 18%|█▊        | 6802/37963 [15:21:18<67:30:37,  7.80s/it]
 18%|█▊        | 6803/37963 [15:21:26<67:26:46,  7.79s/it]
 18%|█▊        | 6804/37963 [15:21:34<67:33:56,  7.81s/it]
 18%|█▊        | 6805/37963 [15:21:41<66:14:25,  7.65s/it]
 18%|█▊        | 6806/37963 [15:21:49<66:28:28,  7.68s/it]
 18%|█▊        | 6807/37963 [15:21:56<66:19:32,  7.66s/it]
 18%|█▊        | 6808/37963 [15:22:04<66:09:10,  7.64s/it]
 18%|█▊        | 6809/37963 [15:22:11<65:48:59,  7.61s/it]
 18%|█▊        | 6810/37963 [15:22:19<66:14:21,  7.65s/it]
                                                          
{'loss': '0.1745', 'grad_norm': '1.5', 'learning_rate': '1.885e-05', 'epoch': '0.1794'}
+
 18%|█▊        | 6810/37963 [15:22:19<66:14:21,  7.65s/it]
 18%|█▊        | 6811/37963 [15:22:27<66:06:43,  7.64s/it]
 18%|█▊        | 6812/37963 [15:22:34<66:07:34,  7.64s/it]
 18%|█▊        | 6813/37963 [15:22:42<65:47:00,  7.60s/it]
 18%|█▊        | 6814/37963 [15:22:53<73:50:49,  8.53s/it]
 18%|█▊        | 6815/37963 [15:23:00<70:49:45,  8.19s/it]
 18%|█▊        | 6816/37963 [15:23:07<69:15:37,  8.01s/it]
 18%|█▊        | 6817/37963 [15:23:15<67:38:29,  7.82s/it]
 18%|█▊        | 6818/37963 [15:23:25<73:50:23,  8.54s/it]
 18%|█▊        | 6819/37963 [15:23:33<71:34:04,  8.27s/it]
 18%|█▊        | 6820/37963 [15:23:40<70:05:52,  8.10s/it]
                                                          
{'loss': '0.1788', 'grad_norm': '2.408', 'learning_rate': '1.885e-05', 'epoch': '0.1796'}
+
 18%|█▊        | 6820/37963 [15:23:40<70:05:52,  8.10s/it]
 18%|█▊        | 6821/37963 [15:23:48<68:16:43,  7.89s/it]
 18%|█▊        | 6822/37963 [15:23:56<68:16:52,  7.89s/it]
 18%|█▊        | 6823/37963 [15:24:03<67:20:00,  7.78s/it]
 18%|█▊        | 6824/37963 [15:24:14<74:10:53,  8.58s/it]
 18%|█▊        | 6825/37963 [15:24:21<71:44:52,  8.30s/it]
 18%|█▊        | 6826/37963 [15:24:29<70:08:18,  8.11s/it]
 18%|█▊        | 6827/37963 [15:24:37<68:43:10,  7.95s/it]
 18%|█▊        | 6828/37963 [15:24:44<66:51:38,  7.73s/it]
 18%|█▊        | 6829/37963 [15:24:52<67:15:05,  7.78s/it]
 18%|█▊        | 6830/37963 [15:24:59<66:57:31,  7.74s/it]
                                                          
{'loss': '0.1676', 'grad_norm': '3.155', 'learning_rate': '1.884e-05', 'epoch': '0.1799'}
+
 18%|█▊        | 6830/37963 [15:24:59<66:57:31,  7.74s/it]
 18%|█▊        | 6831/37963 [15:25:07<66:51:22,  7.73s/it]
 18%|█▊        | 6832/37963 [15:25:15<67:07:32,  7.76s/it]
 18%|█▊        | 6833/37963 [15:25:25<73:59:01,  8.56s/it]
 18%|█▊        | 6834/37963 [15:25:33<71:50:18,  8.31s/it]
 18%|█▊        | 6835/37963 [15:25:41<70:18:42,  8.13s/it]
 18%|█▊        | 6836/37963 [15:25:48<69:02:59,  7.99s/it]
 18%|█▊        | 6837/37963 [15:25:59<75:23:05,  8.72s/it]
 18%|█▊        | 6838/37963 [15:26:07<72:59:08,  8.44s/it]
 18%|█▊        | 6839/37963 [15:26:17<78:30:32,  9.08s/it]
 18%|█▊        | 6840/37963 [15:26:25<74:43:16,  8.64s/it]
                                                          
{'loss': '0.1699', 'grad_norm': '2.986', 'learning_rate': '1.884e-05', 'epoch': '0.1802'}
+
 18%|█▊        | 6840/37963 [15:26:25<74:43:16,  8.64s/it]
 18%|█▊        | 6841/37963 [15:26:35<77:50:09,  9.00s/it]
 18%|█▊        | 6842/37963 [15:26:43<75:00:13,  8.68s/it]
 18%|█▊        | 6843/37963 [15:26:50<72:13:54,  8.36s/it]
 18%|█▊        | 6844/37963 [15:27:00<77:00:48,  8.91s/it]
 18%|█▊        | 6845/37963 [15:27:08<73:07:37,  8.46s/it]
 18%|█▊        | 6846/37963 [15:27:15<70:34:12,  8.16s/it]
 18%|█▊        | 6847/37963 [15:27:23<68:48:22,  7.96s/it]
 18%|█▊        | 6848/37963 [15:27:31<68:29:42,  7.92s/it]
 18%|█▊        | 6849/37963 [15:27:38<67:52:09,  7.85s/it]
 18%|█▊        | 6850/37963 [15:27:46<66:34:38,  7.70s/it]
                                                          
{'loss': '0.1755', 'grad_norm': '4.855', 'learning_rate': '1.884e-05', 'epoch': '0.1804'}
+
 18%|█▊        | 6850/37963 [15:27:46<66:34:38,  7.70s/it]
 18%|█▊        | 6851/37963 [15:27:54<67:11:07,  7.77s/it]
 18%|█▊        | 6852/37963 [15:28:01<66:52:34,  7.74s/it]
 18%|█▊        | 6853/37963 [15:28:09<66:01:52,  7.64s/it]
 18%|█▊        | 6854/37963 [15:28:16<65:32:13,  7.58s/it]
 18%|█▊        | 6855/37963 [15:28:24<65:54:57,  7.63s/it]
 18%|█▊        | 6856/37963 [15:28:32<66:10:50,  7.66s/it]
 18%|█▊        | 6857/37963 [15:28:39<66:22:20,  7.68s/it]
 18%|█▊        | 6858/37963 [15:28:47<66:44:43,  7.72s/it]
 18%|█▊        | 6859/37963 [15:28:55<66:46:06,  7.73s/it]
 18%|█▊        | 6860/37963 [15:29:02<65:46:03,  7.61s/it]
                                                          
{'loss': '0.1778', 'grad_norm': '2.18', 'learning_rate': '1.883e-05', 'epoch': '0.1807'}
+
 18%|█▊        | 6860/37963 [15:29:02<65:46:03,  7.61s/it]
 18%|█▊        | 6861/37963 [15:29:10<65:35:38,  7.59s/it]
 18%|█▊        | 6862/37963 [15:29:20<72:21:34,  8.38s/it]
 18%|█▊        | 6863/37963 [15:29:27<69:42:56,  8.07s/it]
 18%|█▊        | 6864/37963 [15:29:35<67:50:21,  7.85s/it]
 18%|█▊        | 6865/37963 [15:29:42<67:48:29,  7.85s/it]
 18%|█▊        | 6866/37963 [15:29:53<73:43:29,  8.53s/it]
 18%|█▊        | 6867/37963 [15:30:00<71:14:04,  8.25s/it]
 18%|█▊        | 6868/37963 [15:30:10<76:20:32,  8.84s/it]
 18%|█▊        | 6869/37963 [15:30:18<73:09:41,  8.47s/it]
 18%|█▊        | 6870/37963 [15:30:26<71:07:24,  8.23s/it]
                                                          
{'loss': '0.1754', 'grad_norm': '2.269', 'learning_rate': '1.883e-05', 'epoch': '0.181'}
+
 18%|█▊        | 6870/37963 [15:30:26<71:07:24,  8.23s/it]
 18%|█▊        | 6871/37963 [15:30:33<69:33:14,  8.05s/it]
 18%|█▊        | 6872/37963 [15:30:41<68:48:53,  7.97s/it]
 18%|█▊        | 6873/37963 [15:30:48<67:12:25,  7.78s/it]
 18%|█▊        | 6874/37963 [15:30:56<67:10:22,  7.78s/it]
 18%|█▊        | 6875/37963 [15:31:04<67:05:01,  7.77s/it]
 18%|█▊        | 6876/37963 [15:31:12<66:47:30,  7.73s/it]
 18%|█▊        | 6877/37963 [15:31:19<66:43:16,  7.73s/it]
 18%|█▊        | 6878/37963 [15:31:27<65:59:54,  7.64s/it]
 18%|█▊        | 6879/37963 [15:31:34<65:52:14,  7.63s/it]
 18%|█▊        | 6880/37963 [15:31:42<65:50:24,  7.63s/it]
                                                          
{'loss': '0.1729', 'grad_norm': '1.429', 'learning_rate': '1.882e-05', 'epoch': '0.1812'}
+
 18%|█▊        | 6880/37963 [15:31:42<65:50:24,  7.63s/it]
 18%|█▊        | 6881/37963 [15:31:50<66:08:21,  7.66s/it]
 18%|█▊        | 6882/37963 [15:31:57<66:16:17,  7.68s/it]
 18%|█▊        | 6883/37963 [15:32:05<66:36:44,  7.72s/it]
 18%|█▊        | 6884/37963 [15:32:13<66:36:20,  7.72s/it]
 18%|█▊        | 6885/37963 [15:32:23<73:01:43,  8.46s/it]
 18%|█▊        | 6886/37963 [15:32:31<71:25:00,  8.27s/it]
 18%|█▊        | 6887/37963 [15:32:44<83:32:42,  9.68s/it]
 18%|█▊        | 6888/37963 [15:32:55<85:53:05,  9.95s/it]
 18%|█▊        | 6889/37963 [15:33:02<79:00:47,  9.15s/it]
 18%|█▊        | 6890/37963 [15:33:09<74:46:19,  8.66s/it]
                                                          
{'loss': '0.1678', 'grad_norm': '2.94', 'learning_rate': '1.882e-05', 'epoch': '0.1815'}
+
 18%|█▊        | 6890/37963 [15:33:09<74:46:19,  8.66s/it]
 18%|█▊        | 6891/37963 [15:33:20<78:55:16,  9.14s/it]
 18%|█▊        | 6892/37963 [15:33:27<75:29:29,  8.75s/it]
 18%|█▊        | 6893/37963 [15:33:35<72:52:01,  8.44s/it]
 18%|█▊        | 6894/37963 [15:33:43<71:03:00,  8.23s/it]
 18%|█▊        | 6895/37963 [15:33:51<69:44:07,  8.08s/it]
 18%|█▊        | 6896/37963 [15:33:58<68:48:35,  7.97s/it]
 18%|█▊        | 6897/37963 [15:34:06<68:03:14,  7.89s/it]
 18%|█▊        | 6898/37963 [15:34:14<67:11:43,  7.79s/it]
 18%|█▊        | 6899/37963 [15:34:21<66:22:10,  7.69s/it]
 18%|█▊        | 6900/37963 [15:34:29<66:24:16,  7.70s/it]
                                                          
{'loss': '0.1811', 'grad_norm': '3.773', 'learning_rate': '1.882e-05', 'epoch': '0.1818'}
+
 18%|█▊        | 6900/37963 [15:34:29<66:24:16,  7.70s/it]
 18%|█▊        | 6901/37963 [15:34:36<66:18:27,  7.68s/it]
 18%|█▊        | 6902/37963 [15:34:44<65:37:06,  7.61s/it]
 18%|█▊        | 6903/37963 [15:34:52<66:03:54,  7.66s/it]
 18%|█▊        | 6904/37963 [15:34:59<66:17:37,  7.68s/it]
 18%|█▊        | 6905/37963 [15:35:07<66:37:08,  7.72s/it]
 18%|█▊        | 6906/37963 [15:35:15<66:45:55,  7.74s/it]
 18%|█▊        | 6907/37963 [15:35:23<67:03:20,  7.77s/it]
 18%|█▊        | 6908/37963 [15:35:30<66:05:55,  7.66s/it]
 18%|█▊        | 6909/37963 [15:35:40<72:42:53,  8.43s/it]
 18%|█▊        | 6910/37963 [15:35:48<70:55:19,  8.22s/it]
                                                          
{'loss': '0.1713', 'grad_norm': '2.556', 'learning_rate': '1.881e-05', 'epoch': '0.182'}
+
 18%|█▊        | 6910/37963 [15:35:48<70:55:19,  8.22s/it]
 18%|█▊        | 6911/37963 [15:35:56<68:39:25,  7.96s/it]
 18%|█▊        | 6912/37963 [15:36:06<75:10:43,  8.72s/it]
 18%|█▊        | 6913/37963 [15:36:14<72:36:56,  8.42s/it]
 18%|█▊        | 6914/37963 [15:36:24<77:45:38,  9.02s/it]
 18%|█▊        | 6915/37963 [15:36:32<74:19:39,  8.62s/it]
 18%|█▊        | 6916/37963 [15:36:39<71:34:53,  8.30s/it]
 18%|█▊        | 6917/37963 [15:36:47<70:11:21,  8.14s/it]
 18%|█▊        | 6918/37963 [15:36:55<69:18:23,  8.04s/it]
 18%|█▊        | 6919/37963 [15:37:03<68:39:00,  7.96s/it]
 18%|█▊        | 6920/37963 [15:37:10<67:26:48,  7.82s/it]
                                                          
{'loss': '0.1756', 'grad_norm': '1.515', 'learning_rate': '1.881e-05', 'epoch': '0.1823'}
+
 18%|█▊        | 6920/37963 [15:37:10<67:26:48,  7.82s/it]
 18%|█▊        | 6921/37963 [15:37:18<67:18:18,  7.81s/it]
 18%|█▊        | 6922/37963 [15:37:26<66:36:58,  7.73s/it]
 18%|█▊        | 6923/37963 [15:37:33<66:18:25,  7.69s/it]
 18%|█▊        | 6924/37963 [15:37:41<66:08:31,  7.67s/it]
 18%|█▊        | 6925/37963 [15:37:48<65:27:11,  7.59s/it]
 18%|█▊        | 6926/37963 [15:37:56<65:48:28,  7.63s/it]
 18%|█▊        | 6927/37963 [15:38:04<66:35:13,  7.72s/it]
 18%|█▊        | 6928/37963 [15:38:12<67:12:46,  7.80s/it]
 18%|█▊        | 6929/37963 [15:38:20<67:13:53,  7.80s/it]
 18%|█▊        | 6930/37963 [15:38:27<66:47:45,  7.75s/it]
                                                          
{'loss': '0.1722', 'grad_norm': '1.469', 'learning_rate': '1.88e-05', 'epoch': '0.1825'}
+
 18%|█▊        | 6930/37963 [15:38:27<66:47:45,  7.75s/it]
 18%|█▊        | 6931/37963 [15:38:38<74:18:06,  8.62s/it]
 18%|█▊        | 6932/37963 [15:38:46<72:08:47,  8.37s/it]
 18%|█▊        | 6933/37963 [15:38:54<70:41:25,  8.20s/it]
 18%|█▊        | 6934/37963 [15:39:01<69:26:14,  8.06s/it]
 18%|█▊        | 6935/37963 [15:39:16<88:00:16, 10.21s/it]
 18%|█▊        | 6936/37963 [15:39:24<81:48:03,  9.49s/it]
 18%|█▊        | 6937/37963 [15:39:35<84:05:05,  9.76s/it]
 18%|█▊        | 6938/37963 [15:39:43<79:21:25,  9.21s/it]
 18%|█▊        | 6939/37963 [15:39:50<75:22:56,  8.75s/it]
 18%|█▊        | 6940/37963 [15:39:58<72:49:38,  8.45s/it]
                                                          
{'loss': '0.1689', 'grad_norm': '3.094', 'learning_rate': '1.88e-05', 'epoch': '0.1828'}
+
 18%|█▊        | 6940/37963 [15:39:58<72:49:38,  8.45s/it]
 18%|█▊        | 6941/37963 [15:40:06<71:10:04,  8.26s/it]
 18%|█▊        | 6942/37963 [15:40:14<69:53:03,  8.11s/it]
 18%|█▊        | 6943/37963 [15:40:21<68:22:21,  7.93s/it]
 18%|█▊        | 6944/37963 [15:40:29<67:55:22,  7.88s/it]
 18%|█▊        | 6945/37963 [15:40:37<67:40:54,  7.86s/it]
 18%|█▊        | 6946/37963 [15:40:44<67:21:25,  7.82s/it]
 18%|█▊        | 6947/37963 [15:40:52<66:06:01,  7.67s/it]
 18%|█▊        | 6948/37963 [15:41:00<66:30:12,  7.72s/it]
 18%|█▊        | 6949/37963 [15:41:07<66:21:57,  7.70s/it]
 18%|█▊        | 6950/37963 [15:41:15<65:26:07,  7.60s/it]
                                                          
{'loss': '0.169', 'grad_norm': '3.54', 'learning_rate': '1.88e-05', 'epoch': '0.1831'}
+
 18%|█▊        | 6950/37963 [15:41:15<65:26:07,  7.60s/it]
 18%|█▊        | 6951/37963 [15:41:22<65:46:25,  7.64s/it]
 18%|█▊        | 6952/37963 [15:41:30<65:09:17,  7.56s/it]
 18%|█▊        | 6953/37963 [15:41:37<65:34:37,  7.61s/it]
 18%|█▊        | 6954/37963 [15:41:45<65:41:54,  7.63s/it]
 18%|█▊        | 6955/37963 [15:41:53<66:54:13,  7.77s/it]
 18%|█▊        | 6956/37963 [15:42:01<66:33:47,  7.73s/it]
 18%|█▊        | 6957/37963 [15:42:09<66:44:00,  7.75s/it]
 18%|█▊        | 6958/37963 [15:42:19<74:23:38,  8.64s/it]
 18%|█▊        | 6959/37963 [15:42:27<72:08:56,  8.38s/it]
 18%|█▊        | 6960/37963 [15:42:37<76:33:45,  8.89s/it]
                                                          
{'loss': '0.1739', 'grad_norm': '3.389', 'learning_rate': '1.879e-05', 'epoch': '0.1833'}
+
 18%|█▊        | 6960/37963 [15:42:37<76:33:45,  8.89s/it]
 18%|█▊        | 6961/37963 [15:42:45<73:42:12,  8.56s/it]
 18%|█▊        | 6962/37963 [15:42:52<70:30:07,  8.19s/it]
 18%|█▊        | 6963/37963 [15:43:00<69:07:06,  8.03s/it]
 18%|█▊        | 6964/37963 [15:43:10<74:30:23,  8.65s/it]
 18%|█▊        | 6965/37963 [15:43:18<72:29:16,  8.42s/it]
 18%|█▊        | 6966/37963 [15:43:26<70:35:05,  8.20s/it]
 18%|█▊        | 6967/37963 [15:43:33<69:24:10,  8.06s/it]
 18%|█▊        | 6968/37963 [15:43:41<68:03:01,  7.90s/it]
 18%|█▊        | 6969/37963 [15:43:49<67:45:41,  7.87s/it]
 18%|█▊        | 6970/37963 [15:43:56<67:13:15,  7.81s/it]
                                                          
{'loss': '0.172', 'grad_norm': '5.651', 'learning_rate': '1.879e-05', 'epoch': '0.1836'}
+
 18%|█▊        | 6970/37963 [15:43:56<67:13:15,  7.81s/it]
 18%|█▊        | 6971/37963 [15:44:04<66:10:52,  7.69s/it]
 18%|█▊        | 6972/37963 [15:44:11<66:07:36,  7.68s/it]
 18%|█▊        | 6973/37963 [15:44:19<66:47:33,  7.76s/it]
 18%|█▊        | 6974/37963 [15:44:27<66:04:58,  7.68s/it]
 18%|█▊        | 6975/37963 [15:44:35<66:13:07,  7.69s/it]
 18%|█▊        | 6976/37963 [15:44:42<66:33:21,  7.73s/it]
 18%|█▊        | 6977/37963 [15:44:50<66:10:15,  7.69s/it]
 18%|█▊        | 6978/37963 [15:44:58<66:05:36,  7.68s/it]
 18%|█▊        | 6979/37963 [15:45:08<72:51:58,  8.47s/it]
 18%|█▊        | 6980/37963 [15:45:16<70:54:06,  8.24s/it]
                                                          
{'loss': '0.1924', 'grad_norm': '2.367', 'learning_rate': '1.878e-05', 'epoch': '0.1839'}
+
 18%|█▊        | 6980/37963 [15:45:16<70:54:06,  8.24s/it]
 18%|█▊        | 6981/37963 [15:45:23<69:41:22,  8.10s/it]
 18%|█▊        | 6982/37963 [15:45:31<69:19:37,  8.06s/it]
 18%|█▊        | 6983/37963 [15:45:44<81:42:59,  9.50s/it]
 18%|█▊        | 6984/37963 [15:45:52<77:05:04,  8.96s/it]
 18%|█▊        | 6985/37963 [15:46:02<81:07:20,  9.43s/it]
 18%|█▊        | 6986/37963 [15:46:10<76:57:34,  8.94s/it]
 18%|█▊        | 6987/37963 [15:46:18<73:17:34,  8.52s/it]
 18%|█▊        | 6988/37963 [15:46:25<71:00:00,  8.25s/it]
 18%|█▊        | 6989/37963 [15:46:36<76:44:00,  8.92s/it]
 18%|█▊        | 6990/37963 [15:46:43<73:13:08,  8.51s/it]
                                                          
{'loss': '0.1824', 'grad_norm': '4.674', 'learning_rate': '1.878e-05', 'epoch': '0.1841'}
+
 18%|█▊        | 6990/37963 [15:46:43<73:13:08,  8.51s/it]
 18%|█▊        | 6991/37963 [15:46:51<71:26:01,  8.30s/it]
 18%|█▊        | 6992/37963 [15:46:59<69:41:43,  8.10s/it]
 18%|█▊        | 6993/37963 [15:47:07<68:58:43,  8.02s/it]
 18%|█▊        | 6994/37963 [15:47:15<68:31:14,  7.97s/it]
 18%|█▊        | 6995/37963 [15:47:22<67:41:40,  7.87s/it]
 18%|█▊        | 6996/37963 [15:47:30<67:08:57,  7.81s/it]
 18%|█▊        | 6997/37963 [15:47:38<66:47:34,  7.77s/it]
 18%|█▊        | 6998/37963 [15:47:45<66:46:58,  7.76s/it]
 18%|█▊        | 6999/37963 [15:47:53<66:51:50,  7.77s/it]
 18%|█▊        | 7000/37963 [15:48:01<66:04:01,  7.68s/it]
                                                          
{'loss': '0.1792', 'grad_norm': '2.472', 'learning_rate': '1.878e-05', 'epoch': '0.1844'}
+
 18%|█▊        | 7000/37963 [15:48:01<66:04:01,  7.68s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.60s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.60s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 18%|█▊        | 7001/37963 [15:49:03<207:25:38, 24.12s/it]
 18%|█▊        | 7002/37963 [15:49:11<165:08:41, 19.20s/it]
 18%|█▊        | 7003/37963 [15:49:19<135:34:17, 15.76s/it]
 18%|█▊        | 7004/37963 [15:49:26<113:45:52, 13.23s/it]
 18%|█▊        | 7005/37963 [15:49:33<98:51:01, 11.49s/it] 
 18%|█▊        | 7006/37963 [15:49:41<88:25:50, 10.28s/it]
 18%|█▊        | 7007/37963 [15:49:48<81:08:36,  9.44s/it]
 18%|█▊        | 7008/37963 [15:49:59<83:27:14,  9.71s/it]
 18%|█▊        | 7009/37963 [15:50:09<85:42:32,  9.97s/it]
 18%|█▊        | 7010/37963 [15:50:17<80:30:49,  9.36s/it]
                                                          
{'loss': '0.1679', 'grad_norm': '4.439', 'learning_rate': '1.877e-05', 'epoch': '0.1847'}
+
 18%|█▊        | 7010/37963 [15:50:17<80:30:49,  9.36s/it]
 18%|█▊        | 7011/37963 [15:50:25<76:45:35,  8.93s/it]
 18%|█▊        | 7012/37963 [15:50:33<73:23:43,  8.54s/it]
 18%|█▊        | 7013/37963 [15:50:40<70:59:25,  8.26s/it]
 18%|█▊        | 7014/37963 [15:50:50<75:56:21,  8.83s/it]
 18%|█▊        | 7015/37963 [15:50:58<73:28:56,  8.55s/it]
 18%|█▊        | 7016/37963 [15:51:06<71:34:49,  8.33s/it]
 18%|█▊        | 7017/37963 [15:51:14<69:45:09,  8.11s/it]
 18%|█▊        | 7018/37963 [15:51:21<68:48:53,  8.01s/it]
 18%|█▊        | 7019/37963 [15:51:29<68:03:04,  7.92s/it]
 18%|█▊        | 7020/37963 [15:51:39<73:48:12,  8.59s/it]
                                                          
{'loss': '0.173', 'grad_norm': '4.13', 'learning_rate': '1.877e-05', 'epoch': '0.1849'}
+
 18%|█▊        | 7020/37963 [15:51:39<73:48:12,  8.59s/it]
 18%|█▊        | 7021/37963 [15:51:47<71:37:01,  8.33s/it]
 18%|█▊        | 7022/37963 [15:51:55<69:49:12,  8.12s/it]
 18%|█▊        | 7023/37963 [15:52:02<68:33:37,  7.98s/it]
 19%|█▊        | 7024/37963 [15:52:10<68:30:37,  7.97s/it]
 19%|█▊        | 7025/37963 [15:52:18<69:06:54,  8.04s/it]
 19%|█▊        | 7026/37963 [15:52:26<68:55:35,  8.02s/it]
 19%|█▊        | 7027/37963 [15:52:34<67:48:14,  7.89s/it]
 19%|█▊        | 7028/37963 [15:52:44<73:45:26,  8.58s/it]
 19%|█▊        | 7029/37963 [15:52:52<72:01:54,  8.38s/it]
 19%|█▊        | 7030/37963 [15:53:02<76:36:54,  8.92s/it]
                                                          
{'loss': '0.1816', 'grad_norm': '3.196', 'learning_rate': '1.876e-05', 'epoch': '0.1852'}
+
 19%|█▊        | 7030/37963 [15:53:02<76:36:54,  8.92s/it]
 19%|█▊        | 7031/37963 [15:53:10<73:26:33,  8.55s/it]
 19%|█▊        | 7032/37963 [15:53:17<70:02:03,  8.15s/it]
 19%|█▊        | 7033/37963 [15:53:25<68:45:39,  8.00s/it]
 19%|█▊        | 7034/37963 [15:53:33<68:17:51,  7.95s/it]
 19%|█▊        | 7035/37963 [15:53:43<74:29:14,  8.67s/it]
 19%|█▊        | 7036/37963 [15:53:51<72:02:12,  8.39s/it]
 19%|█▊        | 7037/37963 [15:53:58<70:10:11,  8.17s/it]
 19%|█▊        | 7038/37963 [15:54:06<68:52:12,  8.02s/it]
 19%|█▊        | 7039/37963 [15:54:14<67:48:30,  7.89s/it]
 19%|█▊        | 7040/37963 [15:54:21<67:15:35,  7.83s/it]
                                                          
{'loss': '0.1782', 'grad_norm': '2.623', 'learning_rate': '1.876e-05', 'epoch': '0.1854'}
+
 19%|█▊        | 7040/37963 [15:54:21<67:15:35,  7.83s/it]
 19%|█▊        | 7041/37963 [15:54:29<66:52:13,  7.79s/it]
 19%|█▊        | 7042/37963 [15:54:40<73:45:53,  8.59s/it]
 19%|█▊        | 7043/37963 [15:54:48<72:11:20,  8.40s/it]
 19%|█▊        | 7044/37963 [15:54:55<69:44:09,  8.12s/it]
 19%|█▊        | 7045/37963 [15:55:03<69:22:32,  8.08s/it]
 19%|█▊        | 7046/37963 [15:55:11<68:10:09,  7.94s/it]
 19%|█▊        | 7047/37963 [15:55:18<66:50:59,  7.78s/it]
 19%|█▊        | 7048/37963 [15:55:26<66:18:20,  7.72s/it]
 19%|█▊        | 7049/37963 [15:55:33<66:09:26,  7.70s/it]
 19%|█▊        | 7050/37963 [15:55:41<66:20:16,  7.73s/it]
                                                          
{'loss': '0.1621', 'grad_norm': '2.263', 'learning_rate': '1.876e-05', 'epoch': '0.1857'}
+
 19%|█▊        | 7050/37963 [15:55:41<66:20:16,  7.73s/it]
 19%|█▊        | 7051/37963 [15:55:48<64:57:22,  7.56s/it]
 19%|█▊        | 7052/37963 [15:55:56<65:36:17,  7.64s/it]
 19%|█▊        | 7053/37963 [15:56:04<65:46:17,  7.66s/it]
 19%|█▊        | 7054/37963 [15:56:12<66:22:36,  7.73s/it]
 19%|█▊        | 7055/37963 [15:56:19<66:26:58,  7.74s/it]
 19%|█▊        | 7056/37963 [15:56:27<66:13:39,  7.71s/it]
 19%|█▊        | 7057/37963 [15:56:37<72:29:23,  8.44s/it]
 19%|█▊        | 7058/37963 [15:56:45<70:20:23,  8.19s/it]
 19%|█▊        | 7059/37963 [15:56:53<69:34:56,  8.11s/it]
 19%|█▊        | 7060/37963 [15:57:00<67:48:43,  7.90s/it]
                                                          
{'loss': '0.1898', 'grad_norm': '1.758', 'learning_rate': '1.875e-05', 'epoch': '0.186'}
+
 19%|█▊        | 7060/37963 [15:57:00<67:48:43,  7.90s/it]
 19%|█▊        | 7061/37963 [15:57:08<67:02:44,  7.81s/it]
 19%|█▊        | 7062/37963 [15:57:21<80:07:01,  9.33s/it]
 19%|█▊        | 7063/37963 [15:57:28<76:06:20,  8.87s/it]
 19%|█▊        | 7064/37963 [15:57:39<79:58:25,  9.32s/it]
 19%|█▊        | 7065/37963 [15:57:46<75:47:16,  8.83s/it]
 19%|█▊        | 7066/37963 [15:57:54<73:08:37,  8.52s/it]
 19%|█▊        | 7067/37963 [15:58:02<70:53:18,  8.26s/it]
 19%|█▊        | 7068/37963 [15:58:10<69:27:07,  8.09s/it]
 19%|█▊        | 7069/37963 [15:58:17<68:34:42,  7.99s/it]
 19%|█▊        | 7070/37963 [15:58:25<67:39:53,  7.89s/it]
                                                          
{'loss': '0.1752', 'grad_norm': '4.686', 'learning_rate': '1.875e-05', 'epoch': '0.1862'}
+
 19%|█▊        | 7070/37963 [15:58:25<67:39:53,  7.89s/it]
 19%|█▊        | 7071/37963 [15:58:33<67:06:51,  7.82s/it]
 19%|█▊        | 7072/37963 [15:58:40<66:49:04,  7.79s/it]
 19%|█▊        | 7073/37963 [15:58:48<66:55:45,  7.80s/it]
 19%|█▊        | 7074/37963 [15:58:55<65:37:29,  7.65s/it]
 19%|█▊        | 7075/37963 [15:59:03<66:02:02,  7.70s/it]
 19%|█▊        | 7076/37963 [15:59:14<72:50:22,  8.49s/it]
 19%|█▊        | 7077/37963 [15:59:21<69:48:07,  8.14s/it]
 19%|█▊        | 7078/37963 [15:59:28<68:12:01,  7.95s/it]
 19%|█▊        | 7079/37963 [15:59:39<74:12:08,  8.65s/it]
 19%|█▊        | 7080/37963 [15:59:46<71:45:19,  8.36s/it]
                                                          
{'loss': '0.1634', 'grad_norm': '1.393', 'learning_rate': '1.874e-05', 'epoch': '0.1865'}
+
 19%|█▊        | 7080/37963 [15:59:46<71:45:19,  8.36s/it]
 19%|█▊        | 7081/37963 [15:59:54<70:29:13,  8.22s/it]
 19%|█▊        | 7082/37963 [16:00:02<68:54:32,  8.03s/it]
 19%|█▊        | 7083/37963 [16:00:10<68:05:02,  7.94s/it]
 19%|█▊        | 7084/37963 [16:00:20<74:32:03,  8.69s/it]
 19%|█▊        | 7085/37963 [16:00:28<71:46:06,  8.37s/it]
 19%|█▊        | 7086/37963 [16:00:38<76:49:27,  8.96s/it]
 19%|█▊        | 7087/37963 [16:00:46<73:14:52,  8.54s/it]
 19%|█▊        | 7088/37963 [16:00:53<71:08:48,  8.30s/it]
 19%|█▊        | 7089/37963 [16:01:01<69:53:32,  8.15s/it]
 19%|█▊        | 7090/37963 [16:01:09<67:57:09,  7.92s/it]
                                                          
{'loss': '0.1806', 'grad_norm': '1.747', 'learning_rate': '1.874e-05', 'epoch': '0.1868'}
+
 19%|█▊        | 7090/37963 [16:01:09<67:57:09,  7.92s/it]
 19%|█▊        | 7091/37963 [16:01:16<67:31:34,  7.87s/it]
 19%|█▊        | 7092/37963 [16:01:24<67:00:05,  7.81s/it]
 19%|█▊        | 7093/37963 [16:01:32<66:40:44,  7.78s/it]
 19%|█▊        | 7094/37963 [16:01:39<65:51:33,  7.68s/it]
 19%|█▊        | 7095/37963 [16:01:47<65:59:41,  7.70s/it]
 19%|█▊        | 7096/37963 [16:01:54<64:35:51,  7.53s/it]
 19%|█▊        | 7097/37963 [16:02:02<64:37:00,  7.54s/it]
 19%|█▊        | 7098/37963 [16:02:09<65:12:43,  7.61s/it]
 19%|█▊        | 7099/37963 [16:02:17<65:55:29,  7.69s/it]
 19%|█▊        | 7100/37963 [16:02:25<66:20:41,  7.74s/it]
                                                          
{'loss': '0.1701', 'grad_norm': '5.285', 'learning_rate': '1.873e-05', 'epoch': '0.187'}
+
 19%|█▊        | 7100/37963 [16:02:25<66:20:41,  7.74s/it]
 19%|█▊        | 7101/37963 [16:02:33<66:10:28,  7.72s/it]
 19%|█▊        | 7102/37963 [16:02:40<66:03:03,  7.70s/it]
 19%|█▊        | 7103/37963 [16:02:48<66:17:00,  7.73s/it]
 19%|█▊        | 7104/37963 [16:02:56<65:55:26,  7.69s/it]
 19%|█▊        | 7105/37963 [16:03:04<66:01:22,  7.70s/it]
 19%|█▊        | 7106/37963 [16:03:11<65:47:43,  7.68s/it]
 19%|█▊        | 7107/37963 [16:03:19<65:30:08,  7.64s/it]
 19%|█▊        | 7108/37963 [16:03:29<72:45:30,  8.49s/it]
 19%|█▊        | 7109/37963 [16:03:37<70:42:36,  8.25s/it]
 19%|█▊        | 7110/37963 [16:03:50<82:27:35,  9.62s/it]
                                                          
{'loss': '0.1765', 'grad_norm': '4.988', 'learning_rate': '1.873e-05', 'epoch': '0.1873'}
+
 19%|█▊        | 7110/37963 [16:03:50<82:27:35,  9.62s/it]
 19%|█▊        | 7111/37963 [16:04:00<83:31:58,  9.75s/it]
 19%|█▊        | 7112/37963 [16:04:07<78:03:11,  9.11s/it]
 19%|█▊        | 7113/37963 [16:04:15<74:18:23,  8.67s/it]
 19%|█▊        | 7114/37963 [16:04:23<71:55:42,  8.39s/it]
 19%|█▊        | 7115/37963 [16:04:30<70:01:25,  8.17s/it]
 19%|█▊        | 7116/37963 [16:04:38<67:55:50,  7.93s/it]
 19%|█▊        | 7117/37963 [16:04:46<67:33:34,  7.88s/it]
 19%|█▊        | 7118/37963 [16:04:53<66:41:19,  7.78s/it]
 19%|█▉        | 7119/37963 [16:05:01<66:36:33,  7.77s/it]
 19%|█▉        | 7120/37963 [16:05:11<72:56:15,  8.51s/it]
                                                          
{'loss': '0.2031', 'grad_norm': '4.006', 'learning_rate': '1.873e-05', 'epoch': '0.1876'}
+
 19%|█▉        | 7120/37963 [16:05:11<72:56:15,  8.51s/it]
 19%|█▉        | 7121/37963 [16:05:19<71:23:29,  8.33s/it]
 19%|█▉        | 7122/37963 [16:05:27<70:34:40,  8.24s/it]
 19%|█▉        | 7123/37963 [16:05:35<69:53:53,  8.16s/it]
 19%|█▉        | 7124/37963 [16:05:43<68:24:36,  7.99s/it]
 19%|█▉        | 7125/37963 [16:05:50<67:50:10,  7.92s/it]
 19%|█▉        | 7126/37963 [16:05:58<67:38:13,  7.90s/it]
 19%|█▉        | 7127/37963 [16:06:09<74:02:13,  8.64s/it]
 19%|█▉        | 7128/37963 [16:06:16<72:05:24,  8.42s/it]
 19%|█▉        | 7129/37963 [16:06:24<70:50:21,  8.27s/it]
 19%|█▉        | 7130/37963 [16:06:35<76:28:40,  8.93s/it]
                                                          
{'loss': '0.1803', 'grad_norm': '2.244', 'learning_rate': '1.872e-05', 'epoch': '0.1878'}
+
 19%|█▉        | 7130/37963 [16:06:35<76:28:40,  8.93s/it]
 19%|█▉        | 7131/37963 [16:06:42<72:59:38,  8.52s/it]
 19%|█▉        | 7132/37963 [16:06:50<71:18:08,  8.33s/it]
 19%|█▉        | 7133/37963 [16:06:58<69:17:30,  8.09s/it]
 19%|█▉        | 7134/37963 [16:07:05<68:15:50,  7.97s/it]
 19%|█▉        | 7135/37963 [16:07:13<67:29:08,  7.88s/it]
 19%|█▉        | 7136/37963 [16:07:21<67:13:18,  7.85s/it]
 19%|█▉        | 7137/37963 [16:07:29<66:48:22,  7.80s/it]
 19%|█▉        | 7138/37963 [16:07:39<72:38:09,  8.48s/it]
 19%|█▉        | 7139/37963 [16:07:46<70:43:06,  8.26s/it]
 19%|█▉        | 7140/37963 [16:07:54<69:15:02,  8.09s/it]
                                                          
{'loss': '0.1899', 'grad_norm': '1.814', 'learning_rate': '1.872e-05', 'epoch': '0.1881'}
+
 19%|█▉        | 7140/37963 [16:07:54<69:15:02,  8.09s/it]
 19%|█▉        | 7141/37963 [16:08:02<68:09:16,  7.96s/it]
 19%|█▉        | 7142/37963 [16:08:10<67:55:27,  7.93s/it]
 19%|█▉        | 7143/37963 [16:08:17<67:36:41,  7.90s/it]
 19%|█▉        | 7144/37963 [16:08:25<67:20:11,  7.87s/it]
 19%|█▉        | 7145/37963 [16:08:33<67:30:51,  7.89s/it]
 19%|█▉        | 7146/37963 [16:08:41<66:31:41,  7.77s/it]
 19%|█▉        | 7147/37963 [16:08:48<66:09:18,  7.73s/it]
 19%|█▉        | 7148/37963 [16:08:56<66:24:38,  7.76s/it]
 19%|█▉        | 7149/37963 [16:09:04<65:51:07,  7.69s/it]
 19%|█▉        | 7150/37963 [16:09:11<65:10:26,  7.61s/it]
                                                          
{'loss': '0.1675', 'grad_norm': '3.287', 'learning_rate': '1.871e-05', 'epoch': '0.1883'}
+
 19%|█▉        | 7150/37963 [16:09:11<65:10:26,  7.61s/it]
 19%|█▉        | 7151/37963 [16:09:19<64:37:42,  7.55s/it]
 19%|█▉        | 7152/37963 [16:09:26<64:44:59,  7.57s/it]
 19%|█▉        | 7153/37963 [16:09:34<64:51:38,  7.58s/it]
 19%|█▉        | 7154/37963 [16:09:44<72:24:53,  8.46s/it]
 19%|█▉        | 7155/37963 [16:09:52<71:03:05,  8.30s/it]
 19%|█▉        | 7156/37963 [16:10:03<76:22:53,  8.93s/it]
 19%|█▉        | 7157/37963 [16:10:10<73:28:29,  8.59s/it]
 19%|█▉        | 7158/37963 [16:10:18<71:21:53,  8.34s/it]
 19%|█▉        | 7159/37963 [16:10:26<69:53:15,  8.17s/it]
 19%|█▉        | 7160/37963 [16:10:36<75:40:09,  8.84s/it]
                                                          
{'loss': '0.1896', 'grad_norm': '1.958', 'learning_rate': '1.871e-05', 'epoch': '0.1886'}
+
 19%|█▉        | 7160/37963 [16:10:36<75:40:09,  8.84s/it]
 19%|█▉        | 7161/37963 [16:10:44<73:01:50,  8.54s/it]
 19%|█▉        | 7162/37963 [16:10:52<70:49:03,  8.28s/it]
 19%|█▉        | 7163/37963 [16:11:02<75:56:45,  8.88s/it]
 19%|█▉        | 7164/37963 [16:11:12<79:06:41,  9.25s/it]
 19%|█▉        | 7165/37963 [16:11:20<74:21:06,  8.69s/it]
 19%|█▉        | 7166/37963 [16:11:27<71:48:13,  8.39s/it]
 19%|█▉        | 7167/37963 [16:11:35<69:28:46,  8.12s/it]
 19%|█▉        | 7168/37963 [16:11:42<67:53:18,  7.94s/it]
 19%|█▉        | 7169/37963 [16:11:50<67:11:11,  7.85s/it]
 19%|█▉        | 7170/37963 [16:11:57<66:24:19,  7.76s/it]
                                                          
{'loss': '0.1755', 'grad_norm': '5.091', 'learning_rate': '1.871e-05', 'epoch': '0.1889'}
+
 19%|█▉        | 7170/37963 [16:11:57<66:24:19,  7.76s/it]
 19%|█▉        | 7171/37963 [16:12:05<65:46:52,  7.69s/it]
 19%|█▉        | 7172/37963 [16:12:13<66:05:44,  7.73s/it]
 19%|█▉        | 7173/37963 [16:12:23<72:51:11,  8.52s/it]
 19%|█▉        | 7174/37963 [16:12:34<78:02:34,  9.13s/it]
 19%|█▉        | 7175/37963 [16:12:41<74:32:38,  8.72s/it]
 19%|█▉        | 7176/37963 [16:12:49<71:56:54,  8.41s/it]
 19%|█▉        | 7177/37963 [16:12:57<69:52:00,  8.17s/it]
 19%|█▉        | 7178/37963 [16:13:04<68:15:57,  7.98s/it]
 19%|█▉        | 7179/37963 [16:13:12<67:30:25,  7.89s/it]
 19%|█▉        | 7180/37963 [16:13:20<67:26:22,  7.89s/it]
                                                          
{'loss': '0.17', 'grad_norm': '2.574', 'learning_rate': '1.87e-05', 'epoch': '0.1891'}
+
 19%|█▉        | 7180/37963 [16:13:20<67:26:22,  7.89s/it]
 19%|█▉        | 7181/37963 [16:13:28<67:03:11,  7.84s/it]
 19%|█▉        | 7182/37963 [16:13:35<66:55:43,  7.83s/it]
 19%|█▉        | 7183/37963 [16:13:43<66:40:45,  7.80s/it]
 19%|█▉        | 7184/37963 [16:13:51<65:53:55,  7.71s/it]
 19%|█▉        | 7185/37963 [16:13:58<65:53:58,  7.71s/it]
 19%|█▉        | 7186/37963 [16:14:06<65:08:25,  7.62s/it]
 19%|█▉        | 7187/37963 [16:14:13<64:54:50,  7.59s/it]
 19%|█▉        | 7188/37963 [16:14:21<65:13:30,  7.63s/it]
 19%|█▉        | 7189/37963 [16:14:29<65:15:31,  7.63s/it]
 19%|█▉        | 7190/37963 [16:14:37<66:18:31,  7.76s/it]
                                                          
{'loss': '0.1742', 'grad_norm': '2.51', 'learning_rate': '1.87e-05', 'epoch': '0.1894'}
+
 19%|█▉        | 7190/37963 [16:14:37<66:18:31,  7.76s/it]
 19%|█▉        | 7191/37963 [16:14:44<65:36:07,  7.67s/it]
 19%|█▉        | 7192/37963 [16:14:54<72:16:59,  8.46s/it]
 19%|█▉        | 7193/37963 [16:15:02<69:44:06,  8.16s/it]
 19%|█▉        | 7194/37963 [16:15:10<68:11:16,  7.98s/it]
 19%|█▉        | 7195/37963 [16:15:17<67:26:44,  7.89s/it]
 19%|█▉        | 7196/37963 [16:15:25<66:59:47,  7.84s/it]
 19%|█▉        | 7197/37963 [16:15:33<66:56:59,  7.83s/it]
 19%|█▉        | 7198/37963 [16:15:40<66:27:33,  7.78s/it]
 19%|█▉        | 7199/37963 [16:15:48<66:06:20,  7.74s/it]
 19%|█▉        | 7200/37963 [16:15:58<72:19:52,  8.46s/it]
                                                          
{'loss': '0.1611', 'grad_norm': '3.935', 'learning_rate': '1.869e-05', 'epoch': '0.1897'}
+
 19%|█▉        | 7200/37963 [16:15:58<72:19:52,  8.46s/it]
 19%|█▉        | 7201/37963 [16:16:06<70:16:47,  8.22s/it]
 19%|█▉        | 7202/37963 [16:16:16<76:13:24,  8.92s/it]
 19%|█▉        | 7203/37963 [16:16:24<73:39:38,  8.62s/it]
 19%|█▉        | 7204/37963 [16:16:35<77:40:06,  9.09s/it]
 19%|█▉        | 7205/37963 [16:16:43<75:02:30,  8.78s/it]
 19%|█▉        | 7206/37963 [16:16:50<72:13:11,  8.45s/it]
 19%|█▉        | 7207/37963 [16:16:58<70:18:27,  8.23s/it]
 19%|█▉        | 7208/37963 [16:17:06<68:38:25,  8.03s/it]
 19%|█▉        | 7209/37963 [16:17:13<67:44:50,  7.93s/it]
 19%|█▉        | 7210/37963 [16:17:21<66:11:01,  7.75s/it]
                                                          
{'loss': '0.1726', 'grad_norm': '1.891', 'learning_rate': '1.869e-05', 'epoch': '0.1899'}
+
 19%|█▉        | 7210/37963 [16:17:21<66:11:01,  7.75s/it]
 19%|█▉        | 7211/37963 [16:17:28<66:00:32,  7.73s/it]
 19%|█▉        | 7212/37963 [16:17:36<65:48:45,  7.70s/it]
 19%|█▉        | 7213/37963 [16:17:44<65:38:16,  7.68s/it]
 19%|█▉        | 7214/37963 [16:17:51<65:25:18,  7.66s/it]
 19%|█▉        | 7215/37963 [16:17:59<65:24:38,  7.66s/it]
 19%|█▉        | 7216/37963 [16:18:07<65:36:55,  7.68s/it]
 19%|█▉        | 7217/37963 [16:18:17<72:01:30,  8.43s/it]
 19%|█▉        | 7218/37963 [16:18:29<83:12:50,  9.74s/it]
 19%|█▉        | 7219/37963 [16:18:37<78:01:51,  9.14s/it]
 19%|█▉        | 7220/37963 [16:18:45<74:15:10,  8.69s/it]
                                                          
{'loss': '0.1834', 'grad_norm': '1.439', 'learning_rate': '1.868e-05', 'epoch': '0.1902'}
+
 19%|█▉        | 7220/37963 [16:18:45<74:15:10,  8.69s/it]
 19%|█▉        | 7221/37963 [16:18:55<77:56:54,  9.13s/it]
 19%|█▉        | 7222/37963 [16:19:03<73:45:24,  8.64s/it]
 19%|█▉        | 7223/37963 [16:19:10<71:29:24,  8.37s/it]
 19%|█▉        | 7224/37963 [16:19:18<69:44:43,  8.17s/it]
 19%|█▉        | 7225/37963 [16:19:26<69:14:21,  8.11s/it]
 19%|█▉        | 7226/37963 [16:19:33<67:48:11,  7.94s/it]
 19%|█▉        | 7227/37963 [16:19:41<67:04:13,  7.86s/it]
 19%|█▉        | 7228/37963 [16:19:49<66:34:41,  7.80s/it]
 19%|█▉        | 7229/37963 [16:19:57<66:59:57,  7.85s/it]
 19%|█▉        | 7230/37963 [16:20:04<66:26:18,  7.78s/it]
                                                          
{'loss': '0.1717', 'grad_norm': '2.502', 'learning_rate': '1.868e-05', 'epoch': '0.1904'}
+
 19%|█▉        | 7230/37963 [16:20:04<66:26:18,  7.78s/it]
 19%|█▉        | 7231/37963 [16:20:12<66:33:20,  7.80s/it]
 19%|█▉        | 7232/37963 [16:20:19<64:55:59,  7.61s/it]
 19%|█▉        | 7233/37963 [16:20:27<64:42:58,  7.58s/it]
 19%|█▉        | 7234/37963 [16:20:35<65:05:13,  7.63s/it]
 19%|█▉        | 7235/37963 [16:20:42<65:27:53,  7.67s/it]
 19%|█▉        | 7236/37963 [16:20:50<65:24:17,  7.66s/it]
 19%|█▉        | 7237/37963 [16:20:57<64:43:25,  7.58s/it]
 19%|█▉        | 7238/37963 [16:21:05<64:53:38,  7.60s/it]
 19%|█▉        | 7239/37963 [16:21:12<64:10:40,  7.52s/it]
 19%|█▉        | 7240/37963 [16:21:20<65:04:25,  7.63s/it]
                                                          
{'loss': '0.1715', 'grad_norm': '2.831', 'learning_rate': '1.868e-05', 'epoch': '0.1907'}
+
 19%|█▉        | 7240/37963 [16:21:20<65:04:25,  7.63s/it]
 19%|█▉        | 7241/37963 [16:21:28<64:47:51,  7.59s/it]
 19%|█▉        | 7242/37963 [16:21:36<65:52:10,  7.72s/it]
 19%|█▉        | 7243/37963 [16:21:44<65:58:07,  7.73s/it]
 19%|█▉        | 7244/37963 [16:21:54<72:57:27,  8.55s/it]
 19%|█▉        | 7245/37963 [16:22:02<70:49:51,  8.30s/it]
 19%|█▉        | 7246/37963 [16:22:12<75:16:55,  8.82s/it]
 19%|█▉        | 7247/37963 [16:22:19<72:17:17,  8.47s/it]
 19%|█▉        | 7248/37963 [16:22:27<70:10:50,  8.23s/it]
 19%|█▉        | 7249/37963 [16:22:35<69:16:47,  8.12s/it]
 19%|█▉        | 7250/37963 [16:22:45<74:55:59,  8.78s/it]
                                                          
{'loss': '0.1661', 'grad_norm': '2.166', 'learning_rate': '1.867e-05', 'epoch': '0.191'}
+
 19%|█▉        | 7250/37963 [16:22:45<74:55:59,  8.78s/it]
 19%|█▉        | 7251/37963 [16:22:53<72:46:09,  8.53s/it]
 19%|█▉        | 7252/37963 [16:23:01<69:39:12,  8.16s/it]
 19%|█▉        | 7253/37963 [16:23:08<68:13:08,  8.00s/it]
 19%|█▉        | 7254/37963 [16:23:16<67:14:31,  7.88s/it]
 19%|█▉        | 7255/37963 [16:23:23<66:38:33,  7.81s/it]
 19%|█▉        | 7256/37963 [16:23:31<66:29:26,  7.80s/it]
 19%|█▉        | 7257/37963 [16:23:42<72:56:45,  8.55s/it]
 19%|█▉        | 7258/37963 [16:23:49<70:59:01,  8.32s/it]
 19%|█▉        | 7259/37963 [16:23:57<69:06:19,  8.10s/it]
 19%|█▉        | 7260/37963 [16:24:05<68:22:12,  8.02s/it]
                                                          
{'loss': '0.1794', 'grad_norm': '4.481', 'learning_rate': '1.867e-05', 'epoch': '0.1912'}
+
 19%|█▉        | 7260/37963 [16:24:05<68:22:12,  8.02s/it]
 19%|█▉        | 7261/37963 [16:24:15<74:05:14,  8.69s/it]
 19%|█▉        | 7262/37963 [16:24:25<77:59:31,  9.15s/it]
 19%|█▉        | 7263/37963 [16:24:33<74:35:18,  8.75s/it]
 19%|█▉        | 7264/37963 [16:24:41<72:35:34,  8.51s/it]
 19%|█▉        | 7265/37963 [16:24:51<76:59:13,  9.03s/it]
 19%|█▉        | 7266/37963 [16:25:01<78:58:20,  9.26s/it]
 19%|█▉        | 7267/37963 [16:25:09<75:05:07,  8.81s/it]
 19%|█▉        | 7268/37963 [16:25:16<72:06:27,  8.46s/it]
 19%|█▉        | 7269/37963 [16:25:24<69:57:41,  8.21s/it]
 19%|█▉        | 7270/37963 [16:25:32<68:17:10,  8.01s/it]
                                                          
{'loss': '0.1788', 'grad_norm': '2.491', 'learning_rate': '1.866e-05', 'epoch': '0.1915'}
+
 19%|█▉        | 7270/37963 [16:25:32<68:17:10,  8.01s/it]
 19%|█▉        | 7271/37963 [16:25:39<67:34:01,  7.93s/it]
 19%|█▉        | 7272/37963 [16:25:47<66:33:55,  7.81s/it]
 19%|█▉        | 7273/37963 [16:25:54<65:17:16,  7.66s/it]
 19%|█▉        | 7274/37963 [16:26:02<64:34:22,  7.57s/it]
 19%|█▉        | 7275/37963 [16:26:09<65:03:47,  7.63s/it]
 19%|█▉        | 7276/37963 [16:26:17<65:07:04,  7.64s/it]
 19%|█▉        | 7277/37963 [16:26:25<65:10:57,  7.65s/it]
 19%|█▉        | 7278/37963 [16:26:32<65:46:04,  7.72s/it]
 19%|█▉        | 7279/37963 [16:26:40<65:23:39,  7.67s/it]
 19%|█▉        | 7280/37963 [16:26:48<65:20:26,  7.67s/it]
                                                          
{'loss': '0.1697', 'grad_norm': '1.525', 'learning_rate': '1.866e-05', 'epoch': '0.1918'}
+
 19%|█▉        | 7280/37963 [16:26:48<65:20:26,  7.67s/it]
 19%|█▉        | 7281/37963 [16:26:55<65:29:39,  7.68s/it]
 19%|█▉        | 7282/37963 [16:27:03<65:57:18,  7.74s/it]
 19%|█▉        | 7283/37963 [16:27:11<65:28:48,  7.68s/it]
 19%|█▉        | 7284/37963 [16:27:18<65:20:20,  7.67s/it]
 19%|█▉        | 7285/37963 [16:27:26<65:24:57,  7.68s/it]
 19%|█▉        | 7286/37963 [16:27:34<65:04:36,  7.64s/it]
 19%|█▉        | 7287/37963 [16:27:44<71:34:00,  8.40s/it]
 19%|█▉        | 7288/37963 [16:27:52<69:45:16,  8.19s/it]
 19%|█▉        | 7289/37963 [16:27:59<68:37:42,  8.05s/it]
 19%|█▉        | 7290/37963 [16:28:07<67:19:55,  7.90s/it]
                                                          
{'loss': '0.1812', 'grad_norm': '2.386', 'learning_rate': '1.865e-05', 'epoch': '0.192'}
+
 19%|█▉        | 7290/37963 [16:28:07<67:19:55,  7.90s/it]
 19%|█▉        | 7291/37963 [16:28:15<66:51:41,  7.85s/it]
 19%|█▉        | 7292/37963 [16:28:22<66:16:49,  7.78s/it]
 19%|█▉        | 7293/37963 [16:28:30<65:58:05,  7.74s/it]
 19%|█▉        | 7294/37963 [16:28:38<65:55:00,  7.74s/it]
 19%|█▉        | 7295/37963 [16:28:45<65:56:01,  7.74s/it]
 19%|█▉        | 7296/37963 [16:28:53<65:43:45,  7.72s/it]
 19%|█▉        | 7297/37963 [16:29:01<65:23:30,  7.68s/it]
 19%|█▉        | 7298/37963 [16:29:11<71:39:07,  8.41s/it]
 19%|█▉        | 7299/37963 [16:29:19<70:40:58,  8.30s/it]
 19%|█▉        | 7300/37963 [16:29:29<75:36:35,  8.88s/it]
                                                          
{'loss': '0.1734', 'grad_norm': '2.351', 'learning_rate': '1.865e-05', 'epoch': '0.1923'}
+
 19%|█▉        | 7300/37963 [16:29:29<75:36:35,  8.88s/it]
 19%|█▉        | 7301/37963 [16:29:37<73:36:54,  8.64s/it]
 19%|█▉        | 7302/37963 [16:29:44<70:26:00,  8.27s/it]
 19%|█▉        | 7303/37963 [16:29:52<68:49:22,  8.08s/it]
 19%|█▉        | 7304/37963 [16:30:00<67:45:03,  7.96s/it]
 19%|█▉        | 7305/37963 [16:30:10<73:25:58,  8.62s/it]
 19%|█▉        | 7306/37963 [16:30:20<77:32:32,  9.11s/it]
 19%|█▉        | 7307/37963 [16:30:28<73:30:00,  8.63s/it]
 19%|█▉        | 7308/37963 [16:30:35<70:29:31,  8.28s/it]
 19%|█▉        | 7309/37963 [16:30:46<76:07:43,  8.94s/it]
 19%|█▉        | 7310/37963 [16:30:56<79:43:46,  9.36s/it]
                                                          
{'loss': '0.1673', 'grad_norm': '1.439', 'learning_rate': '1.865e-05', 'epoch': '0.1926'}
+
 19%|█▉        | 7310/37963 [16:30:56<79:43:46,  9.36s/it]
 19%|█▉        | 7311/37963 [16:31:04<75:24:00,  8.86s/it]
 19%|█▉        | 7312/37963 [16:31:11<72:17:06,  8.49s/it]
 19%|█▉        | 7313/37963 [16:31:19<70:16:59,  8.26s/it]
 19%|█▉        | 7314/37963 [16:31:29<74:26:49,  8.74s/it]
 19%|█▉        | 7315/37963 [16:31:37<71:39:17,  8.42s/it]
 19%|█▉        | 7316/37963 [16:31:44<69:34:11,  8.17s/it]
 19%|█▉        | 7317/37963 [16:31:52<68:16:54,  8.02s/it]
 19%|█▉        | 7318/37963 [16:31:59<67:11:06,  7.89s/it]
 19%|█▉        | 7319/37963 [16:32:07<66:55:34,  7.86s/it]
 19%|█▉        | 7320/37963 [16:32:15<66:42:06,  7.84s/it]
                                                          
{'loss': '0.1571', 'grad_norm': '6.182', 'learning_rate': '1.864e-05', 'epoch': '0.1928'}
+
 19%|█▉        | 7320/37963 [16:32:15<66:42:06,  7.84s/it]
 19%|█▉        | 7321/37963 [16:32:23<66:55:10,  7.86s/it]
 19%|█▉        | 7322/37963 [16:32:31<66:27:29,  7.81s/it]
 19%|█▉        | 7323/37963 [16:32:38<66:29:56,  7.81s/it]
 19%|█▉        | 7324/37963 [16:32:46<66:05:55,  7.77s/it]
 19%|█▉        | 7325/37963 [16:32:54<66:03:37,  7.76s/it]
 19%|█▉        | 7326/37963 [16:33:01<65:47:26,  7.73s/it]
 19%|█▉        | 7327/37963 [16:33:09<65:46:07,  7.73s/it]
 19%|█▉        | 7328/37963 [16:33:17<65:22:55,  7.68s/it]
 19%|█▉        | 7329/37963 [16:33:25<65:50:06,  7.74s/it]
 19%|█▉        | 7330/37963 [16:33:33<66:14:16,  7.78s/it]
                                                          
{'loss': '0.181', 'grad_norm': '1.665', 'learning_rate': '1.864e-05', 'epoch': '0.1931'}
+
 19%|█▉        | 7330/37963 [16:33:33<66:14:16,  7.78s/it]
 19%|█▉        | 7331/37963 [16:33:40<65:54:46,  7.75s/it]
 19%|█▉        | 7332/37963 [16:33:48<65:31:33,  7.70s/it]
 19%|█▉        | 7333/37963 [16:33:55<65:24:29,  7.69s/it]
 19%|█▉        | 7334/37963 [16:34:03<65:11:59,  7.66s/it]
 19%|█▉        | 7335/37963 [16:34:11<65:33:27,  7.71s/it]
 19%|█▉        | 7336/37963 [16:34:19<66:04:32,  7.77s/it]
 19%|█▉        | 7337/37963 [16:34:27<66:06:07,  7.77s/it]
 19%|█▉        | 7338/37963 [16:34:34<65:41:39,  7.72s/it]
 19%|█▉        | 7339/37963 [16:34:42<65:27:09,  7.69s/it]
 19%|█▉        | 7340/37963 [16:34:50<65:46:23,  7.73s/it]
                                                          
{'loss': '0.1746', 'grad_norm': '1.256', 'learning_rate': '1.863e-05', 'epoch': '0.1933'}
+
 19%|█▉        | 7340/37963 [16:34:50<65:46:23,  7.73s/it]
 19%|█▉        | 7341/37963 [16:35:00<72:06:42,  8.48s/it]
 19%|█▉        | 7342/37963 [16:35:08<70:49:00,  8.33s/it]
 19%|█▉        | 7343/37963 [16:35:15<69:06:36,  8.13s/it]
 19%|█▉        | 7344/37963 [16:35:23<67:45:19,  7.97s/it]
 19%|█▉        | 7345/37963 [16:35:31<67:09:48,  7.90s/it]
 19%|█▉        | 7346/37963 [16:35:39<67:09:00,  7.90s/it]
 19%|█▉        | 7347/37963 [16:35:49<73:52:07,  8.69s/it]
 19%|█▉        | 7348/37963 [16:35:59<76:42:19,  9.02s/it]
 19%|█▉        | 7349/37963 [16:36:07<73:55:14,  8.69s/it]
 19%|█▉        | 7350/37963 [16:36:15<71:05:28,  8.36s/it]
                                                          
{'loss': '0.1733', 'grad_norm': '3.208', 'learning_rate': '1.863e-05', 'epoch': '0.1936'}
+
 19%|█▉        | 7350/37963 [16:36:15<71:05:28,  8.36s/it]
 19%|█▉        | 7351/37963 [16:36:22<69:29:44,  8.17s/it]
 19%|█▉        | 7352/37963 [16:36:33<74:59:30,  8.82s/it]
 19%|█▉        | 7353/37963 [16:36:43<78:46:08,  9.26s/it]
 19%|█▉        | 7354/37963 [16:36:53<81:13:08,  9.55s/it]
 19%|█▉        | 7355/37963 [16:37:01<76:47:01,  9.03s/it]
 19%|█▉        | 7356/37963 [16:37:09<74:11:07,  8.73s/it]
 19%|█▉        | 7357/37963 [16:37:19<77:04:44,  9.07s/it]
 19%|█▉        | 7358/37963 [16:37:27<73:51:39,  8.69s/it]
 19%|█▉        | 7359/37963 [16:37:37<77:48:08,  9.15s/it]
 19%|█▉        | 7360/37963 [16:37:45<74:34:26,  8.77s/it]
                                                          
{'loss': '0.1519', 'grad_norm': '3.357', 'learning_rate': '1.862e-05', 'epoch': '0.1939'}
+
 19%|█▉        | 7360/37963 [16:37:45<74:34:26,  8.77s/it]
 19%|█▉        | 7361/37963 [16:37:53<72:11:51,  8.49s/it]
 19%|█▉        | 7362/37963 [16:38:00<70:15:28,  8.27s/it]
 19%|█▉        | 7363/37963 [16:38:08<67:59:13,  8.00s/it]
 19%|█▉        | 7364/37963 [16:38:15<67:09:54,  7.90s/it]
 19%|█▉        | 7365/37963 [16:38:23<66:25:52,  7.82s/it]
 19%|█▉        | 7366/37963 [16:38:31<66:43:00,  7.85s/it]
 19%|█▉        | 7367/37963 [16:38:39<66:13:45,  7.79s/it]
 19%|█▉        | 7368/37963 [16:38:46<66:09:17,  7.78s/it]
 19%|█▉        | 7369/37963 [16:38:54<65:39:41,  7.73s/it]
 19%|█▉        | 7370/37963 [16:39:02<65:48:53,  7.74s/it]
                                                          
{'loss': '0.174', 'grad_norm': '3.833', 'learning_rate': '1.862e-05', 'epoch': '0.1941'}
+
 19%|█▉        | 7370/37963 [16:39:02<65:48:53,  7.74s/it]
 19%|█▉        | 7371/37963 [16:39:09<65:40:09,  7.73s/it]
 19%|█▉        | 7372/37963 [16:39:17<65:55:15,  7.76s/it]
 19%|█▉        | 7373/37963 [16:39:25<65:10:55,  7.67s/it]
 19%|█▉        | 7374/37963 [16:39:33<65:34:04,  7.72s/it]
 19%|█▉        | 7375/37963 [16:39:40<64:58:15,  7.65s/it]
 19%|█▉        | 7376/37963 [16:39:48<65:07:25,  7.66s/it]
 19%|█▉        | 7377/37963 [16:39:55<64:43:13,  7.62s/it]
 19%|█▉        | 7378/37963 [16:40:03<64:29:50,  7.59s/it]
 19%|█▉        | 7379/37963 [16:40:10<64:39:04,  7.61s/it]
 19%|█▉        | 7380/37963 [16:40:18<65:11:39,  7.67s/it]
                                                          
{'loss': '0.1779', 'grad_norm': '2.723', 'learning_rate': '1.862e-05', 'epoch': '0.1944'}
+
 19%|█▉        | 7380/37963 [16:40:18<65:11:39,  7.67s/it]
 19%|█▉        | 7381/37963 [16:40:26<65:01:08,  7.65s/it]
 19%|█▉        | 7382/37963 [16:40:33<64:53:31,  7.64s/it]
 19%|█▉        | 7383/37963 [16:40:41<64:10:42,  7.56s/it]
 19%|█▉        | 7384/37963 [16:40:49<64:41:23,  7.62s/it]
 19%|█▉        | 7385/37963 [16:40:56<64:45:19,  7.62s/it]
 19%|█▉        | 7386/37963 [16:41:04<65:02:19,  7.66s/it]
 19%|█▉        | 7387/37963 [16:41:12<65:32:32,  7.72s/it]
 19%|█▉        | 7388/37963 [16:41:20<65:54:40,  7.76s/it]
 19%|█▉        | 7389/37963 [16:41:27<65:50:43,  7.75s/it]
 19%|█▉        | 7390/37963 [16:41:35<65:23:18,  7.70s/it]
                                                          
{'loss': '0.1761', 'grad_norm': '1.679', 'learning_rate': '1.861e-05', 'epoch': '0.1947'}
+
 19%|█▉        | 7390/37963 [16:41:35<65:23:18,  7.70s/it]
 19%|█▉        | 7391/37963 [16:41:42<64:25:57,  7.59s/it]
 19%|█▉        | 7392/37963 [16:41:50<64:40:06,  7.62s/it]
 19%|█▉        | 7393/37963 [16:41:58<64:41:08,  7.62s/it]
 19%|█▉        | 7394/37963 [16:42:05<64:52:47,  7.64s/it]
 19%|█▉        | 7395/37963 [16:42:18<78:37:20,  9.26s/it]
 19%|█▉        | 7396/37963 [16:42:26<74:46:41,  8.81s/it]
 19%|█▉        | 7397/37963 [16:42:36<78:32:14,  9.25s/it]
 19%|█▉        | 7398/37963 [16:42:44<74:32:20,  8.78s/it]
 19%|█▉        | 7399/37963 [16:42:52<71:34:23,  8.43s/it]
 19%|█▉        | 7400/37963 [16:43:02<76:17:29,  8.99s/it]
                                                          
{'loss': '0.1679', 'grad_norm': '1.434', 'learning_rate': '1.861e-05', 'epoch': '0.1949'}
+
 19%|█▉        | 7400/37963 [16:43:02<76:17:29,  8.99s/it]
 19%|█▉        | 7401/37963 [16:43:12<79:15:56,  9.34s/it]
 19%|█▉        | 7402/37963 [16:43:22<80:27:51,  9.48s/it]
 20%|█▉        | 7403/37963 [16:43:32<82:34:42,  9.73s/it]
 20%|█▉        | 7404/37963 [16:43:40<77:34:26,  9.14s/it]
 20%|█▉        | 7405/37963 [16:43:48<73:50:37,  8.70s/it]
 20%|█▉        | 7406/37963 [16:43:55<71:05:54,  8.38s/it]
 20%|█▉        | 7407/37963 [16:44:03<69:06:29,  8.14s/it]
 20%|█▉        | 7408/37963 [16:44:13<74:48:07,  8.81s/it]
 20%|█▉        | 7409/37963 [16:44:21<70:55:34,  8.36s/it]
 20%|█▉        | 7410/37963 [16:44:28<68:54:09,  8.12s/it]
                                                          
{'loss': '0.1768', 'grad_norm': '1.574', 'learning_rate': '1.86e-05', 'epoch': '0.1952'}
+
 20%|█▉        | 7410/37963 [16:44:28<68:54:09,  8.12s/it]
 20%|█▉        | 7411/37963 [16:44:36<67:38:13,  7.97s/it]
 20%|█▉        | 7412/37963 [16:44:43<66:47:16,  7.87s/it]
 20%|█▉        | 7413/37963 [16:44:51<66:07:29,  7.79s/it]
 20%|█▉        | 7414/37963 [16:44:59<65:57:55,  7.77s/it]
 20%|█▉        | 7415/37963 [16:45:06<65:56:23,  7.77s/it]
 20%|█▉        | 7416/37963 [16:45:14<65:39:31,  7.74s/it]
 20%|█▉        | 7417/37963 [16:45:21<64:22:21,  7.59s/it]
 20%|█▉        | 7418/37963 [16:45:29<63:49:47,  7.52s/it]
 20%|█▉        | 7419/37963 [16:45:37<65:09:21,  7.68s/it]
 20%|█▉        | 7420/37963 [16:45:44<64:08:47,  7.56s/it]
                                                          
{'loss': '0.163', 'grad_norm': '3.664', 'learning_rate': '1.86e-05', 'epoch': '0.1955'}
+
 20%|█▉        | 7420/37963 [16:45:44<64:08:47,  7.56s/it]
 20%|█▉        | 7421/37963 [16:45:52<64:19:00,  7.58s/it]
 20%|█▉        | 7422/37963 [16:46:00<65:07:48,  7.68s/it]
 20%|█▉        | 7423/37963 [16:46:07<64:53:14,  7.65s/it]
 20%|█▉        | 7424/37963 [16:46:15<64:46:50,  7.64s/it]
 20%|█▉        | 7425/37963 [16:46:22<64:54:22,  7.65s/it]
 20%|█▉        | 7426/37963 [16:46:30<63:56:15,  7.54s/it]
 20%|█▉        | 7427/37963 [16:46:38<64:52:05,  7.65s/it]
 20%|█▉        | 7428/37963 [16:46:45<65:12:42,  7.69s/it]
 20%|█▉        | 7429/37963 [16:46:53<65:29:31,  7.72s/it]
 20%|█▉        | 7430/37963 [16:47:00<64:17:26,  7.58s/it]
                                                          
{'loss': '0.1768', 'grad_norm': '1.431', 'learning_rate': '1.859e-05', 'epoch': '0.1957'}
+
 20%|█▉        | 7430/37963 [16:47:00<64:17:26,  7.58s/it]
 20%|█▉        | 7431/37963 [16:47:08<64:08:04,  7.56s/it]
 20%|█▉        | 7432/37963 [16:47:16<64:35:57,  7.62s/it]
 20%|█▉        | 7433/37963 [16:47:23<64:15:27,  7.58s/it]
 20%|█▉        | 7434/37963 [16:47:31<64:49:51,  7.64s/it]
 20%|█▉        | 7435/37963 [16:47:39<65:41:57,  7.75s/it]
 20%|█▉        | 7436/37963 [16:47:47<65:36:30,  7.74s/it]
 20%|█▉        | 7437/37963 [16:47:54<65:30:53,  7.73s/it]
 20%|█▉        | 7438/37963 [16:48:05<73:06:55,  8.62s/it]
 20%|█▉        | 7439/37963 [16:48:13<70:49:39,  8.35s/it]
 20%|█▉        | 7440/37963 [16:48:21<69:17:19,  8.17s/it]
                                                          
{'loss': '0.1818', 'grad_norm': '1.722', 'learning_rate': '1.859e-05', 'epoch': '0.196'}
+
 20%|█▉        | 7440/37963 [16:48:21<69:17:19,  8.17s/it]
 20%|█▉        | 7441/37963 [16:48:28<67:49:51,  8.00s/it]
 20%|█▉        | 7442/37963 [16:48:36<66:57:07,  7.90s/it]
 20%|█▉        | 7443/37963 [16:48:43<66:02:14,  7.79s/it]
 20%|█▉        | 7444/37963 [16:48:51<65:29:57,  7.73s/it]
 20%|█▉        | 7445/37963 [16:49:01<71:58:50,  8.49s/it]
 20%|█▉        | 7446/37963 [16:49:09<70:36:46,  8.33s/it]
 20%|█▉        | 7447/37963 [16:49:17<68:25:08,  8.07s/it]
 20%|█▉        | 7448/37963 [16:49:25<67:58:15,  8.02s/it]
 20%|█▉        | 7449/37963 [16:49:32<67:04:37,  7.91s/it]
 20%|█▉        | 7450/37963 [16:49:43<73:08:28,  8.63s/it]
                                                          
{'loss': '0.1647', 'grad_norm': '1.051', 'learning_rate': '1.859e-05', 'epoch': '0.1962'}
+
 20%|█▉        | 7450/37963 [16:49:43<73:08:28,  8.63s/it]
 20%|█▉        | 7451/37963 [16:49:55<83:56:13,  9.90s/it]
 20%|█▉        | 7452/37963 [16:50:06<84:29:32,  9.97s/it]
 20%|█▉        | 7453/37963 [16:50:15<84:21:55,  9.95s/it]
 20%|█▉        | 7454/37963 [16:50:23<78:03:22,  9.21s/it]
 20%|█▉        | 7455/37963 [16:50:31<74:16:52,  8.77s/it]
 20%|█▉        | 7456/37963 [16:50:41<77:23:28,  9.13s/it]
 20%|█▉        | 7457/37963 [16:50:48<73:50:35,  8.71s/it]
 20%|█▉        | 7458/37963 [16:50:56<71:17:12,  8.41s/it]
 20%|█▉        | 7459/37963 [16:51:04<69:29:29,  8.20s/it]
 20%|█▉        | 7460/37963 [16:51:12<68:14:24,  8.05s/it]
                                                          
{'loss': '0.1734', 'grad_norm': '1.844', 'learning_rate': '1.858e-05', 'epoch': '0.1965'}
+
 20%|█▉        | 7460/37963 [16:51:12<68:14:24,  8.05s/it]
 20%|█▉        | 7461/37963 [16:51:19<67:07:51,  7.92s/it]
 20%|█▉        | 7462/37963 [16:51:27<66:31:51,  7.85s/it]
 20%|█▉        | 7463/37963 [16:51:35<66:30:51,  7.85s/it]
 20%|█▉        | 7464/37963 [16:51:42<65:10:52,  7.69s/it]
 20%|█▉        | 7465/37963 [16:51:50<65:27:52,  7.73s/it]
 20%|█▉        | 7466/37963 [16:51:57<64:59:11,  7.67s/it]
 20%|█▉        | 7467/37963 [16:52:05<64:56:47,  7.67s/it]
 20%|█▉        | 7468/37963 [16:52:12<64:23:47,  7.60s/it]
 20%|█▉        | 7469/37963 [16:52:20<64:48:30,  7.65s/it]
 20%|█▉        | 7470/37963 [16:52:28<64:57:43,  7.67s/it]
                                                          
{'loss': '0.1826', 'grad_norm': '5.036', 'learning_rate': '1.858e-05', 'epoch': '0.1968'}
+
 20%|█▉        | 7470/37963 [16:52:28<64:57:43,  7.67s/it]
 20%|█▉        | 7471/37963 [16:52:35<64:37:32,  7.63s/it]
 20%|█▉        | 7472/37963 [16:52:43<64:29:54,  7.62s/it]
 20%|█▉        | 7473/37963 [16:52:51<64:34:21,  7.62s/it]
 20%|█▉        | 7474/37963 [16:52:58<64:43:08,  7.64s/it]
 20%|█▉        | 7475/37963 [16:53:06<64:40:46,  7.64s/it]
 20%|█▉        | 7476/37963 [16:53:13<64:02:19,  7.56s/it]
 20%|█▉        | 7477/37963 [16:53:21<63:46:02,  7.53s/it]
 20%|█▉        | 7478/37963 [16:53:29<64:50:06,  7.66s/it]
 20%|█▉        | 7479/37963 [16:53:36<64:51:54,  7.66s/it]
 20%|█▉        | 7480/37963 [16:53:44<64:08:46,  7.58s/it]
                                                          
{'loss': '0.1705', 'grad_norm': '3.112', 'learning_rate': '1.857e-05', 'epoch': '0.197'}
+
 20%|█▉        | 7480/37963 [16:53:44<64:08:46,  7.58s/it]
 20%|█▉        | 7481/37963 [16:53:51<64:16:01,  7.59s/it]
 20%|█▉        | 7482/37963 [16:54:02<72:09:30,  8.52s/it]
 20%|█▉        | 7483/37963 [16:54:10<70:43:00,  8.35s/it]
 20%|█▉        | 7484/37963 [16:54:18<68:50:19,  8.13s/it]
 20%|█▉        | 7485/37963 [16:54:25<66:42:03,  7.88s/it]
 20%|█▉        | 7486/37963 [16:54:33<66:15:36,  7.83s/it]
 20%|█▉        | 7487/37963 [16:54:40<65:42:12,  7.76s/it]
 20%|█▉        | 7488/37963 [16:54:48<65:22:37,  7.72s/it]
 20%|█▉        | 7489/37963 [16:54:55<64:20:55,  7.60s/it]
 20%|█▉        | 7490/37963 [16:55:03<64:48:46,  7.66s/it]
                                                          
{'loss': '0.1608', 'grad_norm': '1.293', 'learning_rate': '1.857e-05', 'epoch': '0.1973'}
+
 20%|█▉        | 7490/37963 [16:55:03<64:48:46,  7.66s/it]
 20%|█▉        | 7491/37963 [16:55:11<64:30:06,  7.62s/it]
 20%|█▉        | 7492/37963 [16:55:19<65:18:19,  7.72s/it]
 20%|█▉        | 7493/37963 [16:55:29<71:33:33,  8.45s/it]
 20%|█▉        | 7494/37963 [16:55:36<69:06:00,  8.16s/it]
 20%|█▉        | 7495/37963 [16:55:44<67:45:28,  8.01s/it]
 20%|█▉        | 7496/37963 [16:55:52<66:50:59,  7.90s/it]
 20%|█▉        | 7497/37963 [16:55:59<66:41:45,  7.88s/it]
 20%|█▉        | 7498/37963 [16:56:07<66:05:59,  7.81s/it]
 20%|█▉        | 7499/37963 [16:56:17<72:16:45,  8.54s/it]
 20%|█▉        | 7500/37963 [16:56:30<83:26:03,  9.86s/it]
                                                          
{'loss': '0.1845', 'grad_norm': '2.848', 'learning_rate': '1.856e-05', 'epoch': '0.1976'}
+
 20%|█▉        | 7500/37963 [16:56:30<83:26:03,  9.86s/it]
 20%|█▉        | 7501/37963 [16:56:38<78:09:16,  9.24s/it]
 20%|█▉        | 7502/37963 [16:56:46<74:13:28,  8.77s/it]
 20%|█▉        | 7503/37963 [16:56:53<71:18:17,  8.43s/it]
 20%|█▉        | 7504/37963 [16:57:04<76:12:09,  9.01s/it]
 20%|█▉        | 7505/37963 [16:57:14<79:29:09,  9.39s/it]
 20%|█▉        | 7506/37963 [16:57:22<75:27:59,  8.92s/it]
 20%|█▉        | 7507/37963 [16:57:32<79:01:38,  9.34s/it]
 20%|█▉        | 7508/37963 [16:57:40<74:58:40,  8.86s/it]
 20%|█▉        | 7509/37963 [16:57:47<71:59:56,  8.51s/it]
 20%|█▉        | 7510/37963 [16:57:55<69:49:20,  8.25s/it]
                                                          
{'loss': '0.184', 'grad_norm': '5.049', 'learning_rate': '1.856e-05', 'epoch': '0.1978'}
+
 20%|█▉        | 7510/37963 [16:57:55<69:49:20,  8.25s/it]
 20%|█▉        | 7511/37963 [16:58:03<68:48:41,  8.13s/it]
 20%|█▉        | 7512/37963 [16:58:11<67:55:54,  8.03s/it]
 20%|█▉        | 7513/37963 [16:58:19<67:06:45,  7.93s/it]
 20%|█▉        | 7514/37963 [16:58:26<66:38:42,  7.88s/it]
 20%|█▉        | 7515/37963 [16:58:34<66:05:57,  7.82s/it]
 20%|█▉        | 7516/37963 [16:58:42<65:41:52,  7.77s/it]
 20%|█▉        | 7517/37963 [16:58:49<65:35:49,  7.76s/it]
 20%|█▉        | 7518/37963 [16:58:57<65:17:48,  7.72s/it]
 20%|█▉        | 7519/37963 [16:59:05<65:31:36,  7.75s/it]
 20%|█▉        | 7520/37963 [16:59:12<65:22:06,  7.73s/it]
                                                          
{'loss': '0.1648', 'grad_norm': '2.899', 'learning_rate': '1.855e-05', 'epoch': '0.1981'}
+
 20%|█▉        | 7520/37963 [16:59:12<65:22:06,  7.73s/it]
 20%|█▉        | 7521/37963 [16:59:20<64:29:23,  7.63s/it]
 20%|█▉        | 7522/37963 [16:59:28<64:38:16,  7.64s/it]
 20%|█▉        | 7523/37963 [16:59:35<65:01:43,  7.69s/it]
 20%|█▉        | 7524/37963 [16:59:43<64:52:21,  7.67s/it]
 20%|█▉        | 7525/37963 [16:59:51<64:47:17,  7.66s/it]
 20%|█▉        | 7526/37963 [17:00:01<71:34:36,  8.47s/it]
 20%|█▉        | 7527/37963 [17:00:09<69:28:45,  8.22s/it]
 20%|█▉        | 7528/37963 [17:00:16<67:20:31,  7.97s/it]
 20%|█▉        | 7529/37963 [17:00:24<66:19:57,  7.85s/it]
 20%|█▉        | 7530/37963 [17:00:31<66:37:58,  7.88s/it]
                                                          
{'loss': '0.1708', 'grad_norm': '1.533', 'learning_rate': '1.855e-05', 'epoch': '0.1984'}
+
 20%|█▉        | 7530/37963 [17:00:31<66:37:58,  7.88s/it]
 20%|█▉        | 7531/37963 [17:00:39<66:26:14,  7.86s/it]
 20%|█▉        | 7532/37963 [17:00:47<66:03:22,  7.81s/it]
 20%|█▉        | 7533/37963 [17:00:55<65:21:06,  7.73s/it]
 20%|█▉        | 7534/37963 [17:01:02<65:51:40,  7.79s/it]
 20%|█▉        | 7535/37963 [17:01:10<65:26:00,  7.74s/it]
 20%|█▉        | 7536/37963 [17:01:18<65:22:16,  7.73s/it]
 20%|█▉        | 7537/37963 [17:01:26<65:28:32,  7.75s/it]
 20%|█▉        | 7538/37963 [17:01:34<66:17:26,  7.84s/it]
 20%|█▉        | 7539/37963 [17:01:41<64:49:24,  7.67s/it]
 20%|█▉        | 7540/37963 [17:01:48<63:56:28,  7.57s/it]
                                                          
{'loss': '0.1763', 'grad_norm': '2.409', 'learning_rate': '1.855e-05', 'epoch': '0.1986'}
+
 20%|█▉        | 7540/37963 [17:01:48<63:56:28,  7.57s/it]
 20%|█▉        | 7541/37963 [17:01:58<70:42:37,  8.37s/it]
 20%|█▉        | 7542/37963 [17:02:06<69:23:17,  8.21s/it]
 20%|█▉        | 7543/37963 [17:02:17<75:05:49,  8.89s/it]
 20%|█▉        | 7544/37963 [17:02:25<72:42:32,  8.60s/it]
 20%|█▉        | 7545/37963 [17:02:33<70:58:31,  8.40s/it]
 20%|█▉        | 7546/37963 [17:02:40<69:27:17,  8.22s/it]
 20%|█▉        | 7547/37963 [17:02:48<68:50:58,  8.15s/it]
 20%|█▉        | 7548/37963 [17:03:01<80:38:22,  9.54s/it]
 20%|█▉        | 7549/37963 [17:03:09<76:00:47,  9.00s/it]
 20%|█▉        | 7550/37963 [17:03:17<72:22:20,  8.57s/it]
                                                          
{'loss': '0.1835', 'grad_norm': '2.03', 'learning_rate': '1.854e-05', 'epoch': '0.1989'}
+
 20%|█▉        | 7550/37963 [17:03:17<72:22:20,  8.57s/it]
 20%|█▉        | 7551/37963 [17:03:24<70:18:24,  8.32s/it]
 20%|█▉        | 7552/37963 [17:03:32<69:19:00,  8.21s/it]
 20%|█▉        | 7553/37963 [17:03:40<68:16:09,  8.08s/it]
 20%|█▉        | 7554/37963 [17:03:48<67:14:07,  7.96s/it]
 20%|█▉        | 7555/37963 [17:03:55<66:24:51,  7.86s/it]
 20%|█▉        | 7556/37963 [17:04:03<65:47:28,  7.79s/it]
 20%|█▉        | 7557/37963 [17:04:11<66:06:10,  7.83s/it]
 20%|█▉        | 7558/37963 [17:04:21<71:52:49,  8.51s/it]
 20%|█▉        | 7559/37963 [17:04:31<75:58:09,  9.00s/it]
 20%|█▉        | 7560/37963 [17:04:39<72:39:37,  8.60s/it]
                                                          
{'loss': '0.1804', 'grad_norm': '2.194', 'learning_rate': '1.854e-05', 'epoch': '0.1991'}
+
 20%|█▉        | 7560/37963 [17:04:39<72:39:37,  8.60s/it]
 20%|█▉        | 7561/37963 [17:04:49<76:21:04,  9.04s/it]
 20%|█▉        | 7562/37963 [17:04:57<73:00:23,  8.65s/it]
 20%|█▉        | 7563/37963 [17:05:04<70:34:32,  8.36s/it]
 20%|█▉        | 7564/37963 [17:05:12<68:50:23,  8.15s/it]
 20%|█▉        | 7565/37963 [17:05:20<67:39:52,  8.01s/it]
 20%|█▉        | 7566/37963 [17:05:27<66:03:49,  7.82s/it]
 20%|█▉        | 7567/37963 [17:05:35<65:44:18,  7.79s/it]
 20%|█▉        | 7568/37963 [17:05:42<65:23:57,  7.75s/it]
 20%|█▉        | 7569/37963 [17:05:53<72:19:12,  8.57s/it]
 20%|█▉        | 7570/37963 [17:06:00<69:40:40,  8.25s/it]
                                                          
{'loss': '0.1791', 'grad_norm': '2.396', 'learning_rate': '1.853e-05', 'epoch': '0.1994'}
+
 20%|█▉        | 7570/37963 [17:06:00<69:40:40,  8.25s/it]
 20%|█▉        | 7571/37963 [17:06:08<69:23:22,  8.22s/it]
 20%|█▉        | 7572/37963 [17:06:16<68:03:05,  8.06s/it]
 20%|█▉        | 7573/37963 [17:06:24<67:01:24,  7.94s/it]
 20%|█▉        | 7574/37963 [17:06:32<66:29:30,  7.88s/it]
 20%|█▉        | 7575/37963 [17:06:39<66:18:12,  7.85s/it]
 20%|█▉        | 7576/37963 [17:06:47<65:50:34,  7.80s/it]
 20%|█▉        | 7577/37963 [17:06:55<65:35:18,  7.77s/it]
 20%|█▉        | 7578/37963 [17:07:02<65:27:36,  7.76s/it]
 20%|█▉        | 7579/37963 [17:07:10<65:38:34,  7.78s/it]
 20%|█▉        | 7580/37963 [17:07:18<65:59:25,  7.82s/it]
                                                          
{'loss': '0.1651', 'grad_norm': '1.733', 'learning_rate': '1.853e-05', 'epoch': '0.1997'}
+
 20%|█▉        | 7580/37963 [17:07:18<65:59:25,  7.82s/it]
 20%|█▉        | 7581/37963 [17:07:26<65:20:04,  7.74s/it]
 20%|█▉        | 7582/37963 [17:07:34<65:36:12,  7.77s/it]
 20%|█▉        | 7583/37963 [17:07:41<65:35:08,  7.77s/it]
 20%|█▉        | 7584/37963 [17:07:49<65:51:43,  7.80s/it]
 20%|█▉        | 7585/37963 [17:07:57<65:43:12,  7.79s/it]
 20%|█▉        | 7586/37963 [17:08:07<71:52:31,  8.52s/it]
 20%|█▉        | 7587/37963 [17:08:15<70:02:01,  8.30s/it]
 20%|█▉        | 7588/37963 [17:08:23<68:40:47,  8.14s/it]
 20%|█▉        | 7589/37963 [17:08:30<67:20:01,  7.98s/it]
 20%|█▉        | 7590/37963 [17:08:40<72:15:32,  8.56s/it]
                                                          
{'loss': '0.169', 'grad_norm': '1.825', 'learning_rate': '1.852e-05', 'epoch': '0.1999'}
+
 20%|█▉        | 7590/37963 [17:08:40<72:15:32,  8.56s/it]
 20%|█▉        | 7591/37963 [17:08:48<70:25:07,  8.35s/it]
 20%|█▉        | 7592/37963 [17:08:56<68:36:19,  8.13s/it]
 20%|██        | 7593/37963 [17:09:03<67:14:44,  7.97s/it]
 20%|██        | 7594/37963 [17:09:11<67:18:45,  7.98s/it]
 20%|██        | 7595/37963 [17:09:19<67:09:06,  7.96s/it]
 20%|██        | 7596/37963 [17:09:30<72:58:54,  8.65s/it]
 20%|██        | 7597/37963 [17:09:37<70:37:50,  8.37s/it]
 20%|██        | 7598/37963 [17:09:45<69:08:56,  8.20s/it]
 20%|██        | 7599/37963 [17:09:53<68:30:33,  8.12s/it]
 20%|██        | 7600/37963 [17:10:01<67:34:15,  8.01s/it]
                                                          
{'loss': '0.1677', 'grad_norm': '1.294', 'learning_rate': '1.852e-05', 'epoch': '0.2002'}
+
 20%|██        | 7600/37963 [17:10:01<67:34:15,  8.01s/it]
 20%|██        | 7601/37963 [17:10:08<66:47:58,  7.92s/it]
 20%|██        | 7602/37963 [17:10:19<72:47:20,  8.63s/it]
 20%|██        | 7603/37963 [17:10:26<70:12:46,  8.33s/it]
 20%|██        | 7604/37963 [17:10:34<67:53:00,  8.05s/it]
 20%|██        | 7605/37963 [17:10:44<73:55:37,  8.77s/it]
 20%|██        | 7606/37963 [17:10:52<71:40:59,  8.50s/it]
 20%|██        | 7607/37963 [17:11:00<69:39:18,  8.26s/it]
 20%|██        | 7608/37963 [17:11:08<68:20:28,  8.11s/it]
 20%|██        | 7609/37963 [17:11:15<67:21:56,  7.99s/it]
 20%|██        | 7610/37963 [17:11:23<66:25:37,  7.88s/it]
                                                          
{'loss': '0.1886', 'grad_norm': '1.424', 'learning_rate': '1.851e-05', 'epoch': '0.2005'}
+
 20%|██        | 7610/37963 [17:11:23<66:25:37,  7.88s/it]
 20%|██        | 7611/37963 [17:11:31<65:50:54,  7.81s/it]
 20%|██        | 7612/37963 [17:11:41<71:19:52,  8.46s/it]
 20%|██        | 7613/37963 [17:11:51<76:02:11,  9.02s/it]
 20%|██        | 7614/37963 [17:11:59<72:43:46,  8.63s/it]
 20%|██        | 7615/37963 [17:12:07<71:33:28,  8.49s/it]
 20%|██        | 7616/37963 [17:12:14<69:33:31,  8.25s/it]
 20%|██        | 7617/37963 [17:12:22<67:58:37,  8.06s/it]
 20%|██        | 7618/37963 [17:12:30<67:07:14,  7.96s/it]
 20%|██        | 7619/37963 [17:12:37<66:18:51,  7.87s/it]
 20%|██        | 7620/37963 [17:12:45<66:10:53,  7.85s/it]
                                                          
{'loss': '0.174', 'grad_norm': '2.571', 'learning_rate': '1.851e-05', 'epoch': '0.2007'}
+
 20%|██        | 7620/37963 [17:12:45<66:10:53,  7.85s/it]
 20%|██        | 7621/37963 [17:12:53<66:15:45,  7.86s/it]
 20%|██        | 7622/37963 [17:13:01<65:25:56,  7.76s/it]
 20%|██        | 7623/37963 [17:13:11<72:27:11,  8.60s/it]
 20%|██        | 7624/37963 [17:13:19<70:21:57,  8.35s/it]
 20%|██        | 7625/37963 [17:13:27<70:00:14,  8.31s/it]
 20%|██        | 7626/37963 [17:13:35<68:15:51,  8.10s/it]
 20%|██        | 7627/37963 [17:13:43<67:27:25,  8.01s/it]
 20%|██        | 7628/37963 [17:13:50<66:22:04,  7.88s/it]
 20%|██        | 7629/37963 [17:13:58<65:42:41,  7.80s/it]
 20%|██        | 7630/37963 [17:14:06<65:34:15,  7.78s/it]
                                                          
{'loss': '0.1626', 'grad_norm': '5.352', 'learning_rate': '1.851e-05', 'epoch': '0.201'}
+
 20%|██        | 7630/37963 [17:14:06<65:34:15,  7.78s/it]
 20%|██        | 7631/37963 [17:14:13<65:35:39,  7.79s/it]
 20%|██        | 7632/37963 [17:14:21<65:33:09,  7.78s/it]
 20%|██        | 7633/37963 [17:14:29<66:14:51,  7.86s/it]
 20%|██        | 7634/37963 [17:14:39<71:48:38,  8.52s/it]
 20%|██        | 7635/37963 [17:14:47<69:37:38,  8.26s/it]
 20%|██        | 7636/37963 [17:14:55<68:55:44,  8.18s/it]
 20%|██        | 7637/37963 [17:15:03<67:49:01,  8.05s/it]
 20%|██        | 7638/37963 [17:15:10<67:01:01,  7.96s/it]
 20%|██        | 7639/37963 [17:15:18<66:28:55,  7.89s/it]
 20%|██        | 7640/37963 [17:15:26<65:52:33,  7.82s/it]
                                                          
{'loss': '0.1675', 'grad_norm': '2.988', 'learning_rate': '1.85e-05', 'epoch': '0.2012'}
+
 20%|██        | 7640/37963 [17:15:26<65:52:33,  7.82s/it]
 20%|██        | 7641/37963 [17:15:34<65:57:07,  7.83s/it]
 20%|██        | 7642/37963 [17:15:41<65:27:18,  7.77s/it]
 20%|██        | 7643/37963 [17:15:52<71:52:01,  8.53s/it]
 20%|██        | 7644/37963 [17:16:02<76:18:59,  9.06s/it]
 20%|██        | 7645/37963 [17:16:10<73:46:02,  8.76s/it]
 20%|██        | 7646/37963 [17:16:20<77:34:08,  9.21s/it]
 20%|██        | 7647/37963 [17:16:28<74:03:19,  8.79s/it]
 20%|██        | 7648/37963 [17:16:36<71:51:44,  8.53s/it]
 20%|██        | 7649/37963 [17:16:46<75:25:32,  8.96s/it]
 20%|██        | 7650/37963 [17:16:54<72:17:42,  8.59s/it]
                                                          
{'loss': '0.1666', 'grad_norm': '3.143', 'learning_rate': '1.85e-05', 'epoch': '0.2015'}
+
 20%|██        | 7650/37963 [17:16:54<72:17:42,  8.59s/it]
 20%|██        | 7651/37963 [17:17:01<70:24:46,  8.36s/it]
 20%|██        | 7652/37963 [17:17:09<69:08:56,  8.21s/it]
 20%|██        | 7653/37963 [17:17:17<66:55:09,  7.95s/it]
 20%|██        | 7654/37963 [17:17:24<66:18:38,  7.88s/it]
 20%|██        | 7655/37963 [17:17:32<65:47:30,  7.81s/it]
 20%|██        | 7656/37963 [17:17:40<65:20:03,  7.76s/it]
 20%|██        | 7657/37963 [17:17:47<64:56:22,  7.71s/it]
 20%|██        | 7658/37963 [17:17:55<64:53:21,  7.71s/it]
 20%|██        | 7659/37963 [17:18:02<64:11:04,  7.62s/it]
 20%|██        | 7660/37963 [17:18:10<63:52:05,  7.59s/it]
                                                          
{'loss': '0.176', 'grad_norm': '1.9', 'learning_rate': '1.849e-05', 'epoch': '0.2018'}
+
 20%|██        | 7660/37963 [17:18:10<63:52:05,  7.59s/it]
 20%|██        | 7661/37963 [17:18:17<63:31:04,  7.55s/it]
 20%|██        | 7662/37963 [17:18:25<64:06:51,  7.62s/it]
 20%|██        | 7663/37963 [17:18:32<63:05:49,  7.50s/it]
 20%|██        | 7664/37963 [17:18:40<63:36:45,  7.56s/it]
 20%|██        | 7665/37963 [17:18:48<63:31:52,  7.55s/it]
 20%|██        | 7666/37963 [17:19:00<76:42:22,  9.11s/it]
 20%|██        | 7667/37963 [17:19:08<72:47:04,  8.65s/it]
 20%|██        | 7668/37963 [17:19:16<70:26:10,  8.37s/it]
 20%|██        | 7669/37963 [17:19:23<68:51:28,  8.18s/it]
 20%|██        | 7670/37963 [17:19:31<67:14:18,  7.99s/it]
                                                          
{'loss': '0.1679', 'grad_norm': '1.628', 'learning_rate': '1.849e-05', 'epoch': '0.202'}
+
 20%|██        | 7670/37963 [17:19:31<67:14:18,  7.99s/it]
 20%|██        | 7671/37963 [17:19:39<66:37:27,  7.92s/it]
 20%|██        | 7672/37963 [17:19:46<66:20:16,  7.88s/it]
 20%|██        | 7673/37963 [17:19:54<65:42:48,  7.81s/it]
 20%|██        | 7674/37963 [17:20:02<65:04:28,  7.73s/it]
 20%|██        | 7675/37963 [17:20:09<63:58:14,  7.60s/it]
 20%|██        | 7676/37963 [17:20:17<64:36:05,  7.68s/it]
 20%|██        | 7677/37963 [17:20:27<71:07:12,  8.45s/it]
 20%|██        | 7678/37963 [17:20:35<69:27:26,  8.26s/it]
 20%|██        | 7679/37963 [17:20:42<67:58:54,  8.08s/it]
 20%|██        | 7680/37963 [17:20:50<66:20:02,  7.89s/it]
                                                          
{'loss': '0.1575', 'grad_norm': '1.379', 'learning_rate': '1.848e-05', 'epoch': '0.2023'}
+
 20%|██        | 7680/37963 [17:20:50<66:20:02,  7.89s/it]
 20%|██        | 7681/37963 [17:20:58<66:04:08,  7.85s/it]
 20%|██        | 7682/37963 [17:21:05<65:34:02,  7.80s/it]
 20%|██        | 7683/37963 [17:21:13<65:03:35,  7.73s/it]
 20%|██        | 7684/37963 [17:21:21<64:56:43,  7.72s/it]
 20%|██        | 7685/37963 [17:21:28<64:56:27,  7.72s/it]
 20%|██        | 7686/37963 [17:21:36<64:41:53,  7.69s/it]
 20%|██        | 7687/37963 [17:21:43<63:59:29,  7.61s/it]
 20%|██        | 7688/37963 [17:21:56<77:44:06,  9.24s/it]
 20%|██        | 7689/37963 [17:22:07<80:01:27,  9.52s/it]
 20%|██        | 7690/37963 [17:22:14<75:31:15,  8.98s/it]
                                                          
{'loss': '0.1825', 'grad_norm': '1.131', 'learning_rate': '1.848e-05', 'epoch': '0.2026'}
+
 20%|██        | 7690/37963 [17:22:14<75:31:15,  8.98s/it]
 20%|██        | 7691/37963 [17:22:22<72:03:28,  8.57s/it]
 20%|██        | 7692/37963 [17:22:30<69:47:46,  8.30s/it]
 20%|██        | 7693/37963 [17:22:40<74:32:38,  8.87s/it]
 20%|██        | 7694/37963 [17:22:50<78:33:28,  9.34s/it]
 20%|██        | 7695/37963 [17:22:58<74:50:03,  8.90s/it]
 20%|██        | 7696/37963 [17:23:06<71:42:07,  8.53s/it]
 20%|██        | 7697/37963 [17:23:14<69:44:25,  8.30s/it]
 20%|██        | 7698/37963 [17:23:21<68:03:57,  8.10s/it]
 20%|██        | 7699/37963 [17:23:29<66:51:03,  7.95s/it]
 20%|██        | 7700/37963 [17:23:36<66:02:34,  7.86s/it]
                                                          
{'loss': '0.1746', 'grad_norm': '1.512', 'learning_rate': '1.847e-05', 'epoch': '0.2028'}
+
 20%|██        | 7700/37963 [17:23:36<66:02:34,  7.86s/it]
 20%|██        | 7701/37963 [17:23:44<65:08:39,  7.75s/it]
 20%|██        | 7702/37963 [17:23:52<65:09:56,  7.75s/it]
 20%|██        | 7703/37963 [17:24:00<65:27:15,  7.79s/it]
 20%|██        | 7704/37963 [17:24:07<65:33:29,  7.80s/it]
 20%|██        | 7705/37963 [17:24:15<64:42:29,  7.70s/it]
 20%|██        | 7706/37963 [17:24:22<64:26:56,  7.67s/it]
 20%|██        | 7707/37963 [17:24:30<64:20:51,  7.66s/it]
 20%|██        | 7708/37963 [17:24:38<64:21:12,  7.66s/it]
 20%|██        | 7709/37963 [17:24:48<70:28:09,  8.39s/it]
 20%|██        | 7710/37963 [17:24:56<68:52:06,  8.20s/it]
                                                          
{'loss': '0.1829', 'grad_norm': '4.292', 'learning_rate': '1.847e-05', 'epoch': '0.2031'}
+
 20%|██        | 7710/37963 [17:24:56<68:52:06,  8.20s/it]
 20%|██        | 7711/37963 [17:25:03<67:08:44,  7.99s/it]
 20%|██        | 7712/37963 [17:25:11<67:03:04,  7.98s/it]
 20%|██        | 7713/37963 [17:25:19<66:22:23,  7.90s/it]
 20%|██        | 7714/37963 [17:25:27<66:17:49,  7.89s/it]
 20%|██        | 7715/37963 [17:25:37<73:31:30,  8.75s/it]
 20%|██        | 7716/37963 [17:25:45<71:07:53,  8.47s/it]
 20%|██        | 7717/37963 [17:25:52<68:14:27,  8.12s/it]
 20%|██        | 7718/37963 [17:26:00<66:55:49,  7.97s/it]
 20%|██        | 7719/37963 [17:26:08<66:35:05,  7.93s/it]
 20%|██        | 7720/37963 [17:26:16<66:34:35,  7.92s/it]
                                                          
{'loss': '0.1736', 'grad_norm': '2.943', 'learning_rate': '1.847e-05', 'epoch': '0.2034'}
+
 20%|██        | 7720/37963 [17:26:16<66:34:35,  7.92s/it]
 20%|██        | 7721/37963 [17:26:23<65:17:29,  7.77s/it]
 20%|██        | 7722/37963 [17:26:31<65:03:15,  7.74s/it]
 20%|██        | 7723/37963 [17:26:39<65:00:35,  7.74s/it]
 20%|██        | 7724/37963 [17:26:46<64:01:46,  7.62s/it]
 20%|██        | 7725/37963 [17:26:54<64:23:40,  7.67s/it]
 20%|██        | 7726/37963 [17:27:04<71:07:12,  8.47s/it]
 20%|██        | 7727/37963 [17:27:12<69:22:47,  8.26s/it]
 20%|██        | 7728/37963 [17:27:20<68:18:30,  8.13s/it]
 20%|██        | 7729/37963 [17:27:27<66:55:04,  7.97s/it]
 20%|██        | 7730/37963 [17:27:35<66:05:07,  7.87s/it]
                                                          
{'loss': '0.1832', 'grad_norm': '2.431', 'learning_rate': '1.846e-05', 'epoch': '0.2036'}
+
 20%|██        | 7730/37963 [17:27:35<66:05:07,  7.87s/it]
 20%|██        | 7731/37963 [17:27:43<65:45:06,  7.83s/it]
 20%|██        | 7732/37963 [17:27:53<72:41:53,  8.66s/it]
 20%|██        | 7733/37963 [17:28:04<77:13:03,  9.20s/it]
 20%|██        | 7734/37963 [17:28:12<73:47:25,  8.79s/it]
 20%|██        | 7735/37963 [17:28:19<71:27:06,  8.51s/it]
 20%|██        | 7736/37963 [17:28:30<75:45:53,  9.02s/it]
 20%|██        | 7737/37963 [17:28:37<72:46:23,  8.67s/it]
 20%|██        | 7738/37963 [17:28:45<70:40:32,  8.42s/it]
 20%|██        | 7739/37963 [17:28:53<68:53:05,  8.20s/it]
 20%|██        | 7740/37963 [17:29:01<67:26:28,  8.03s/it]
                                                          
{'loss': '0.1835', 'grad_norm': '2.923', 'learning_rate': '1.846e-05', 'epoch': '0.2039'}
+
 20%|██        | 7740/37963 [17:29:01<67:26:28,  8.03s/it]
 20%|██        | 7741/37963 [17:29:11<72:18:13,  8.61s/it]
 20%|██        | 7742/37963 [17:29:18<70:07:46,  8.35s/it]
 20%|██        | 7743/37963 [17:29:28<74:31:20,  8.88s/it]
 20%|██        | 7744/37963 [17:29:36<70:51:53,  8.44s/it]
 20%|██        | 7745/37963 [17:29:43<68:15:18,  8.13s/it]
 20%|██        | 7746/37963 [17:29:51<67:22:52,  8.03s/it]
 20%|██        | 7747/37963 [17:29:59<65:53:23,  7.85s/it]
 20%|██        | 7748/37963 [17:30:06<65:40:07,  7.82s/it]
 20%|██        | 7749/37963 [17:30:14<65:28:35,  7.80s/it]
 20%|██        | 7750/37963 [17:30:22<65:05:33,  7.76s/it]
                                                          
{'loss': '0.1665', 'grad_norm': '3.32', 'learning_rate': '1.845e-05', 'epoch': '0.2041'}
+
 20%|██        | 7750/37963 [17:30:22<65:05:33,  7.76s/it]
 20%|██        | 7751/37963 [17:30:30<65:19:03,  7.78s/it]
 20%|██        | 7752/37963 [17:30:37<64:20:10,  7.67s/it]
 20%|██        | 7753/37963 [17:30:47<70:54:40,  8.45s/it]
 20%|██        | 7754/37963 [17:30:55<68:47:22,  8.20s/it]
 20%|██        | 7755/37963 [17:31:02<67:20:49,  8.03s/it]
 20%|██        | 7756/37963 [17:31:10<66:15:12,  7.90s/it]
 20%|██        | 7757/37963 [17:31:18<65:44:33,  7.84s/it]
 20%|██        | 7758/37963 [17:31:26<66:03:21,  7.87s/it]
 20%|██        | 7759/37963 [17:31:33<65:47:56,  7.84s/it]
 20%|██        | 7760/37963 [17:31:41<65:27:41,  7.80s/it]
                                                          
{'loss': '0.1783', 'grad_norm': '2.002', 'learning_rate': '1.845e-05', 'epoch': '0.2044'}
+
 20%|██        | 7760/37963 [17:31:41<65:27:41,  7.80s/it]
 20%|██        | 7761/37963 [17:31:49<65:18:52,  7.79s/it]
 20%|██        | 7762/37963 [17:31:57<65:34:02,  7.82s/it]
 20%|██        | 7763/37963 [17:32:07<71:43:13,  8.55s/it]
 20%|██        | 7764/37963 [17:32:15<69:03:27,  8.23s/it]
 20%|██        | 7765/37963 [17:32:22<68:00:52,  8.11s/it]
 20%|██        | 7766/37963 [17:32:30<66:55:10,  7.98s/it]
 20%|██        | 7767/37963 [17:32:38<66:06:16,  7.88s/it]
 20%|██        | 7768/37963 [17:32:45<64:58:15,  7.75s/it]
 20%|██        | 7769/37963 [17:32:53<64:37:38,  7.71s/it]
 20%|██        | 7770/37963 [17:33:01<64:46:03,  7.72s/it]
                                                          
{'loss': '0.1676', 'grad_norm': '2.993', 'learning_rate': '1.844e-05', 'epoch': '0.2047'}
+
 20%|██        | 7770/37963 [17:33:01<64:46:03,  7.72s/it]
 20%|██        | 7771/37963 [17:33:08<65:08:02,  7.77s/it]
 20%|██        | 7772/37963 [17:33:16<64:12:31,  7.66s/it]
 20%|██        | 7773/37963 [17:33:24<64:29:14,  7.69s/it]
 20%|██        | 7774/37963 [17:33:34<71:41:37,  8.55s/it]
 20%|██        | 7775/37963 [17:33:42<70:04:51,  8.36s/it]
 20%|██        | 7776/37963 [17:33:52<75:18:45,  8.98s/it]
 20%|██        | 7777/37963 [17:34:00<72:16:17,  8.62s/it]
 20%|██        | 7778/37963 [17:34:08<69:55:37,  8.34s/it]
 20%|██        | 7779/37963 [17:34:16<68:16:57,  8.14s/it]
 20%|██        | 7780/37963 [17:34:26<73:33:52,  8.77s/it]
                                                          
{'loss': '0.1835', 'grad_norm': '2.197', 'learning_rate': '1.844e-05', 'epoch': '0.2049'}
+
 20%|██        | 7780/37963 [17:34:26<73:33:52,  8.77s/it]
 20%|██        | 7781/37963 [17:34:34<71:06:06,  8.48s/it]
 20%|██        | 7782/37963 [17:34:41<68:50:31,  8.21s/it]
 21%|██        | 7783/37963 [17:34:49<67:36:46,  8.07s/it]
 21%|██        | 7784/37963 [17:34:57<67:00:09,  7.99s/it]
 21%|██        | 7785/37963 [17:35:04<65:44:03,  7.84s/it]
 21%|██        | 7786/37963 [17:35:12<65:15:39,  7.79s/it]
 21%|██        | 7787/37963 [17:35:20<65:06:44,  7.77s/it]
 21%|██        | 7788/37963 [17:35:27<64:00:30,  7.64s/it]
 21%|██        | 7789/37963 [17:35:37<70:52:43,  8.46s/it]
 21%|██        | 7790/37963 [17:35:47<74:54:59,  8.94s/it]
                                                          
{'loss': '0.1722', 'grad_norm': '1.745', 'learning_rate': '1.843e-05', 'epoch': '0.2052'}
+
 21%|██        | 7790/37963 [17:35:47<74:54:59,  8.94s/it]
 21%|██        | 7791/37963 [17:35:57<77:48:07,  9.28s/it]
 21%|██        | 7792/37963 [17:36:05<73:13:12,  8.74s/it]
 21%|██        | 7793/37963 [17:36:13<71:22:08,  8.52s/it]
 21%|██        | 7794/37963 [17:36:21<68:57:09,  8.23s/it]
 21%|██        | 7795/37963 [17:36:28<67:55:43,  8.11s/it]
 21%|██        | 7796/37963 [17:36:36<66:12:39,  7.90s/it]
 21%|██        | 7797/37963 [17:36:46<72:34:40,  8.66s/it]
 21%|██        | 7798/37963 [17:36:54<70:42:31,  8.44s/it]
 21%|██        | 7799/37963 [17:37:02<68:40:41,  8.20s/it]
 21%|██        | 7800/37963 [17:37:09<67:20:18,  8.04s/it]
                                                          
{'loss': '0.1789', 'grad_norm': '5.763', 'learning_rate': '1.843e-05', 'epoch': '0.2055'}
+
 21%|██        | 7800/37963 [17:37:09<67:20:18,  8.04s/it]
 21%|██        | 7801/37963 [17:37:17<66:18:19,  7.91s/it]
 21%|██        | 7802/37963 [17:37:25<66:25:52,  7.93s/it]
 21%|██        | 7803/37963 [17:37:33<65:31:46,  7.82s/it]
 21%|██        | 7804/37963 [17:37:40<64:58:31,  7.76s/it]
 21%|██        | 7805/37963 [17:37:48<64:46:42,  7.73s/it]
 21%|██        | 7806/37963 [17:37:55<63:45:32,  7.61s/it]
 21%|██        | 7807/37963 [17:38:03<63:47:17,  7.61s/it]
 21%|██        | 7808/37963 [17:38:10<63:37:18,  7.60s/it]
 21%|██        | 7809/37963 [17:38:18<63:35:47,  7.59s/it]
 21%|██        | 7810/37963 [17:38:26<63:46:03,  7.61s/it]
                                                          
{'loss': '0.1742', 'grad_norm': '5.842', 'learning_rate': '1.842e-05', 'epoch': '0.2057'}
+
 21%|██        | 7810/37963 [17:38:26<63:46:03,  7.61s/it]
 21%|██        | 7811/37963 [17:38:33<64:11:24,  7.66s/it]
 21%|██        | 7812/37963 [17:38:41<64:29:21,  7.70s/it]
 21%|██        | 7813/37963 [17:38:49<64:24:19,  7.69s/it]
 21%|██        | 7814/37963 [17:38:57<64:32:26,  7.71s/it]
 21%|██        | 7815/37963 [17:39:04<63:31:03,  7.58s/it]
 21%|██        | 7816/37963 [17:39:12<63:51:06,  7.62s/it]
 21%|██        | 7817/37963 [17:39:24<76:47:16,  9.17s/it]
 21%|██        | 7818/37963 [17:39:32<73:23:49,  8.77s/it]
 21%|██        | 7819/37963 [17:39:40<70:40:51,  8.44s/it]
 21%|██        | 7820/37963 [17:39:48<68:46:37,  8.21s/it]
                                                          
{'loss': '0.1689', 'grad_norm': '3.543', 'learning_rate': '1.842e-05', 'epoch': '0.206'}
+
 21%|██        | 7820/37963 [17:39:48<68:46:37,  8.21s/it]
 21%|██        | 7821/37963 [17:39:55<68:02:06,  8.13s/it]
 21%|██        | 7822/37963 [17:40:03<67:09:55,  8.02s/it]
 21%|██        | 7823/37963 [17:40:13<72:11:47,  8.62s/it]
 21%|██        | 7824/37963 [17:40:24<76:46:09,  9.17s/it]
 21%|██        | 7825/37963 [17:40:32<73:35:25,  8.79s/it]
 21%|██        | 7826/37963 [17:40:40<71:16:34,  8.51s/it]
 21%|██        | 7827/37963 [17:40:47<68:38:03,  8.20s/it]
 21%|██        | 7828/37963 [17:40:54<66:46:24,  7.98s/it]
 21%|██        | 7829/37963 [17:41:02<66:05:16,  7.90s/it]
 21%|██        | 7830/37963 [17:41:10<65:22:59,  7.81s/it]
                                                          
{'loss': '0.1829', 'grad_norm': '1.679', 'learning_rate': '1.841e-05', 'epoch': '0.2063'}
+
 21%|██        | 7830/37963 [17:41:10<65:22:59,  7.81s/it]
 21%|██        | 7831/37963 [17:41:17<64:15:11,  7.68s/it]
 21%|██        | 7832/37963 [17:41:25<63:54:15,  7.64s/it]
 21%|██        | 7833/37963 [17:41:35<70:21:45,  8.41s/it]
 21%|██        | 7834/37963 [17:41:45<75:11:14,  8.98s/it]
 21%|██        | 7835/37963 [17:41:53<71:45:48,  8.58s/it]
 21%|██        | 7836/37963 [17:42:01<69:38:51,  8.32s/it]
 21%|██        | 7837/37963 [17:42:08<68:01:00,  8.13s/it]
 21%|██        | 7838/37963 [17:42:19<73:46:12,  8.82s/it]
 21%|██        | 7839/37963 [17:42:26<70:47:21,  8.46s/it]
 21%|██        | 7840/37963 [17:42:34<68:56:50,  8.24s/it]
                                                          
{'loss': '0.1661', 'grad_norm': '6.365', 'learning_rate': '1.841e-05', 'epoch': '0.2065'}
+
 21%|██        | 7840/37963 [17:42:34<68:56:50,  8.24s/it]
 21%|██        | 7841/37963 [17:42:44<74:06:01,  8.86s/it]
 21%|██        | 7842/37963 [17:42:52<71:34:28,  8.55s/it]
 21%|██        | 7843/37963 [17:43:00<70:15:18,  8.40s/it]
 21%|██        | 7844/37963 [17:43:08<68:56:11,  8.24s/it]
 21%|██        | 7845/37963 [17:43:16<67:34:28,  8.08s/it]
 21%|██        | 7846/37963 [17:43:23<66:43:49,  7.98s/it]
 21%|██        | 7847/37963 [17:43:31<66:09:18,  7.91s/it]
 21%|██        | 7848/37963 [17:43:39<65:35:42,  7.84s/it]
 21%|██        | 7849/37963 [17:43:46<64:43:44,  7.74s/it]
 21%|██        | 7850/37963 [17:43:54<64:47:20,  7.75s/it]
                                                          
{'loss': '0.1743', 'grad_norm': '1.58', 'learning_rate': '1.841e-05', 'epoch': '0.2068'}
+
 21%|██        | 7850/37963 [17:43:54<64:47:20,  7.75s/it]
 21%|██        | 7851/37963 [17:44:02<64:30:15,  7.71s/it]
 21%|██        | 7852/37963 [17:44:09<63:59:19,  7.65s/it]
 21%|██        | 7853/37963 [17:44:17<63:56:00,  7.64s/it]
 21%|██        | 7854/37963 [17:44:25<64:08:50,  7.67s/it]
 21%|██        | 7855/37963 [17:44:32<64:01:12,  7.65s/it]
 21%|██        | 7856/37963 [17:44:40<64:06:34,  7.67s/it]
 21%|██        | 7857/37963 [17:44:48<64:00:43,  7.65s/it]
 21%|██        | 7858/37963 [17:44:55<63:55:27,  7.64s/it]
 21%|██        | 7859/37963 [17:45:03<64:21:43,  7.70s/it]
 21%|██        | 7860/37963 [17:45:11<64:53:29,  7.76s/it]
                                                          
{'loss': '0.1836', 'grad_norm': '1.93', 'learning_rate': '1.84e-05', 'epoch': '0.207'}
+
 21%|██        | 7860/37963 [17:45:11<64:53:29,  7.76s/it]
 21%|██        | 7861/37963 [17:45:24<78:13:30,  9.36s/it]
 21%|██        | 7862/37963 [17:45:32<73:47:24,  8.83s/it]
 21%|██        | 7863/37963 [17:45:39<70:58:43,  8.49s/it]
 21%|██        | 7864/37963 [17:45:47<69:07:28,  8.27s/it]
 21%|██        | 7865/37963 [17:45:55<67:58:03,  8.13s/it]
 21%|██        | 7866/37963 [17:46:02<66:16:50,  7.93s/it]
 21%|██        | 7867/37963 [17:46:12<71:30:39,  8.55s/it]
 21%|██        | 7868/37963 [17:46:23<75:41:40,  9.05s/it]
 21%|██        | 7869/37963 [17:46:30<72:15:05,  8.64s/it]
 21%|██        | 7870/37963 [17:46:38<69:07:50,  8.27s/it]
                                                          
{'loss': '0.1724', 'grad_norm': '3.916', 'learning_rate': '1.84e-05', 'epoch': '0.2073'}
+
 21%|██        | 7870/37963 [17:46:38<69:07:50,  8.27s/it]
 21%|██        | 7871/37963 [17:46:45<67:16:22,  8.05s/it]
 21%|██        | 7872/37963 [17:46:53<66:44:20,  7.98s/it]
 21%|██        | 7873/37963 [17:47:01<66:25:26,  7.95s/it]
 21%|██        | 7874/37963 [17:47:09<65:55:25,  7.89s/it]
 21%|██        | 7875/37963 [17:47:16<65:33:54,  7.84s/it]
 21%|██        | 7876/37963 [17:47:26<70:35:31,  8.45s/it]
 21%|██        | 7877/37963 [17:47:34<68:24:40,  8.19s/it]
 21%|██        | 7878/37963 [17:47:42<67:10:02,  8.04s/it]
 21%|██        | 7879/37963 [17:47:49<66:25:39,  7.95s/it]
 21%|██        | 7880/37963 [17:47:57<66:04:36,  7.91s/it]
                                                          
{'loss': '0.174', 'grad_norm': '2.641', 'learning_rate': '1.839e-05', 'epoch': '0.2076'}
+
 21%|██        | 7880/37963 [17:47:57<66:04:36,  7.91s/it]
 21%|██        | 7881/37963 [17:48:04<64:24:42,  7.71s/it]
 21%|██        | 7882/37963 [17:48:12<64:19:04,  7.70s/it]
 21%|██        | 7883/37963 [17:48:23<71:25:14,  8.55s/it]
 21%|██        | 7884/37963 [17:48:30<69:19:04,  8.30s/it]
 21%|██        | 7885/37963 [17:48:38<67:48:04,  8.12s/it]
 21%|██        | 7886/37963 [17:48:46<67:12:32,  8.04s/it]
 21%|██        | 7887/37963 [17:48:53<65:35:38,  7.85s/it]
 21%|██        | 7888/37963 [17:49:01<64:55:56,  7.77s/it]
 21%|██        | 7889/37963 [17:49:08<64:02:17,  7.67s/it]
 21%|██        | 7890/37963 [17:49:16<63:58:02,  7.66s/it]
                                                          
{'loss': '0.1701', 'grad_norm': '1.448', 'learning_rate': '1.839e-05', 'epoch': '0.2078'}
+
 21%|██        | 7890/37963 [17:49:16<63:58:02,  7.66s/it]
 21%|██        | 7891/37963 [17:49:23<63:55:59,  7.65s/it]
 21%|██        | 7892/37963 [17:49:33<69:51:08,  8.36s/it]
 21%|██        | 7893/37963 [17:49:41<67:05:48,  8.03s/it]
 21%|██        | 7894/37963 [17:49:48<66:18:47,  7.94s/it]
 21%|██        | 7895/37963 [17:49:59<71:56:59,  8.61s/it]
 21%|██        | 7896/37963 [17:50:07<70:08:51,  8.40s/it]
 21%|██        | 7897/37963 [17:50:14<67:47:06,  8.12s/it]
 21%|██        | 7898/37963 [17:50:22<66:22:29,  7.95s/it]
 21%|██        | 7899/37963 [17:50:29<65:33:59,  7.85s/it]
 21%|██        | 7900/37963 [17:50:37<65:20:56,  7.83s/it]
                                                          
{'loss': '0.1614', 'grad_norm': '5.495', 'learning_rate': '1.838e-05', 'epoch': '0.2081'}
+
 21%|██        | 7900/37963 [17:50:37<65:20:56,  7.83s/it]
 21%|██        | 7901/37963 [17:50:45<64:38:36,  7.74s/it]
 21%|██        | 7902/37963 [17:50:52<64:13:16,  7.69s/it]
 21%|██        | 7903/37963 [17:51:00<64:43:27,  7.75s/it]
 21%|██        | 7904/37963 [17:51:10<71:13:05,  8.53s/it]
 21%|██        | 7905/37963 [17:51:18<69:14:30,  8.29s/it]
 21%|██        | 7906/37963 [17:51:26<67:39:27,  8.10s/it]
 21%|██        | 7907/37963 [17:51:33<66:22:15,  7.95s/it]
 21%|██        | 7908/37963 [17:51:41<65:39:27,  7.86s/it]
 21%|██        | 7909/37963 [17:51:51<72:17:28,  8.66s/it]
 21%|██        | 7910/37963 [17:51:59<69:14:33,  8.29s/it]
                                                          
{'loss': '0.1705', 'grad_norm': '2.021', 'learning_rate': '1.838e-05', 'epoch': '0.2084'}
+
 21%|██        | 7910/37963 [17:51:59<69:14:33,  8.29s/it]
 21%|██        | 7911/37963 [17:52:09<74:07:40,  8.88s/it]
 21%|██        | 7912/37963 [17:52:17<71:17:08,  8.54s/it]
 21%|██        | 7913/37963 [17:52:25<69:13:54,  8.29s/it]
 21%|██        | 7914/37963 [17:52:35<74:06:36,  8.88s/it]
 21%|██        | 7915/37963 [17:52:43<71:23:13,  8.55s/it]
 21%|██        | 7916/37963 [17:52:50<69:29:24,  8.33s/it]
 21%|██        | 7917/37963 [17:52:58<67:33:22,  8.09s/it]
 21%|██        | 7918/37963 [17:53:05<65:52:55,  7.89s/it]
 21%|██        | 7919/37963 [17:53:13<65:29:40,  7.85s/it]
 21%|██        | 7920/37963 [17:53:24<71:55:58,  8.62s/it]
                                                          
{'loss': '0.1615', 'grad_norm': '5.545', 'learning_rate': '1.837e-05', 'epoch': '0.2086'}
+
 21%|██        | 7920/37963 [17:53:24<71:55:58,  8.62s/it]
 21%|██        | 7921/37963 [17:53:31<69:13:06,  8.29s/it]
 21%|██        | 7922/37963 [17:53:39<67:38:59,  8.11s/it]
 21%|██        | 7923/37963 [17:53:46<66:28:35,  7.97s/it]
 21%|██        | 7924/37963 [17:53:54<65:37:09,  7.86s/it]
 21%|██        | 7925/37963 [17:54:02<64:59:36,  7.79s/it]
 21%|██        | 7926/37963 [17:54:09<64:48:32,  7.77s/it]
 21%|██        | 7927/37963 [17:54:17<65:01:04,  7.79s/it]
 21%|██        | 7928/37963 [17:54:25<64:30:15,  7.73s/it]
 21%|██        | 7929/37963 [17:54:33<64:30:12,  7.73s/it]
 21%|██        | 7930/37963 [17:54:40<64:09:22,  7.69s/it]
                                                          
{'loss': '0.1719', 'grad_norm': '4.052', 'learning_rate': '1.837e-05', 'epoch': '0.2089'}
+
 21%|██        | 7930/37963 [17:54:40<64:09:22,  7.69s/it]
 21%|██        | 7931/37963 [17:54:50<70:28:29,  8.45s/it]
 21%|██        | 7932/37963 [17:54:58<68:37:42,  8.23s/it]
 21%|██        | 7933/37963 [17:55:06<67:11:38,  8.06s/it]
 21%|██        | 7934/37963 [17:55:14<66:45:59,  8.00s/it]
 21%|██        | 7935/37963 [17:55:21<64:59:39,  7.79s/it]
 21%|██        | 7936/37963 [17:55:29<64:46:23,  7.77s/it]
 21%|██        | 7937/37963 [17:55:36<64:34:00,  7.74s/it]
 21%|██        | 7938/37963 [17:55:44<63:54:45,  7.66s/it]
 21%|██        | 7939/37963 [17:55:51<63:22:18,  7.60s/it]
 21%|██        | 7940/37963 [17:55:59<64:00:39,  7.68s/it]
                                                          
{'loss': '0.1741', 'grad_norm': '2.412', 'learning_rate': '1.836e-05', 'epoch': '0.2092'}
+
 21%|██        | 7940/37963 [17:55:59<64:00:39,  7.68s/it]
 21%|██        | 7941/37963 [17:56:07<64:23:01,  7.72s/it]
 21%|██        | 7942/37963 [17:56:15<64:24:21,  7.72s/it]
 21%|██        | 7943/37963 [17:56:25<70:50:32,  8.50s/it]
 21%|██        | 7944/37963 [17:56:33<69:13:46,  8.30s/it]
 21%|██        | 7945/37963 [17:56:40<67:28:07,  8.09s/it]
 21%|██        | 7946/37963 [17:56:51<73:13:00,  8.78s/it]
 21%|██        | 7947/37963 [17:56:58<70:27:09,  8.45s/it]
 21%|██        | 7948/37963 [17:57:06<68:46:30,  8.25s/it]
 21%|██        | 7949/37963 [17:57:14<67:30:06,  8.10s/it]
 21%|██        | 7950/37963 [17:57:22<66:31:59,  7.98s/it]
                                                          
{'loss': '0.1667', 'grad_norm': '6.207', 'learning_rate': '1.836e-05', 'epoch': '0.2094'}
+
 21%|██        | 7950/37963 [17:57:22<66:31:59,  7.98s/it]
 21%|██        | 7951/37963 [17:57:29<65:28:50,  7.85s/it]
 21%|██        | 7952/37963 [17:57:37<65:33:38,  7.86s/it]
 21%|██        | 7953/37963 [17:57:47<71:21:38,  8.56s/it]
 21%|██        | 7954/37963 [17:57:55<68:39:48,  8.24s/it]
 21%|██        | 7955/37963 [17:58:03<67:51:46,  8.14s/it]
 21%|██        | 7956/37963 [17:58:10<66:30:43,  7.98s/it]
 21%|██        | 7957/37963 [17:58:18<64:46:34,  7.77s/it]
 21%|██        | 7958/37963 [17:58:25<64:15:39,  7.71s/it]
 21%|██        | 7959/37963 [17:58:36<70:57:20,  8.51s/it]
 21%|██        | 7960/37963 [17:58:43<69:07:22,  8.29s/it]
                                                          
{'loss': '0.1778', 'grad_norm': '1.249', 'learning_rate': '1.835e-05', 'epoch': '0.2097'}
+
 21%|██        | 7960/37963 [17:58:43<69:07:22,  8.29s/it]
 21%|██        | 7961/37963 [17:58:54<73:55:36,  8.87s/it]
 21%|██        | 7962/37963 [17:59:01<71:21:50,  8.56s/it]
 21%|██        | 7963/37963 [17:59:12<75:41:38,  9.08s/it]
 21%|██        | 7964/37963 [17:59:19<72:10:53,  8.66s/it]
 21%|██        | 7965/37963 [17:59:27<69:14:11,  8.31s/it]
 21%|██        | 7966/37963 [17:59:34<67:25:05,  8.09s/it]
 21%|██        | 7967/37963 [17:59:42<66:08:11,  7.94s/it]
 21%|██        | 7968/37963 [17:59:52<71:32:19,  8.59s/it]
 21%|██        | 7969/37963 [18:00:00<68:45:27,  8.25s/it]
 21%|██        | 7970/37963 [18:00:07<67:19:42,  8.08s/it]
                                                          
{'loss': '0.1588', 'grad_norm': '3.615', 'learning_rate': '1.835e-05', 'epoch': '0.2099'}
+
 21%|██        | 7970/37963 [18:00:07<67:19:42,  8.08s/it]
 21%|██        | 7971/37963 [18:00:15<65:09:47,  7.82s/it]
 21%|██        | 7972/37963 [18:00:22<64:37:19,  7.76s/it]
 21%|██        | 7973/37963 [18:00:30<63:59:59,  7.68s/it]
 21%|██        | 7974/37963 [18:00:37<64:11:07,  7.71s/it]
 21%|██        | 7975/37963 [18:00:45<64:11:22,  7.71s/it]
 21%|██        | 7976/37963 [18:00:53<64:25:20,  7.73s/it]
 21%|██        | 7977/37963 [18:01:00<64:01:13,  7.69s/it]
 21%|██        | 7978/37963 [18:01:08<63:42:35,  7.65s/it]
 21%|██        | 7979/37963 [18:01:16<63:57:45,  7.68s/it]
 21%|██        | 7980/37963 [18:01:23<63:03:47,  7.57s/it]
                                                          
{'loss': '0.1736', 'grad_norm': '1.478', 'learning_rate': '1.835e-05', 'epoch': '0.2102'}
+
 21%|██        | 7980/37963 [18:01:23<63:03:47,  7.57s/it]
 21%|██        | 7981/37963 [18:01:31<63:47:55,  7.66s/it]
 21%|██        | 7982/37963 [18:01:39<63:36:04,  7.64s/it]
 21%|██        | 7983/37963 [18:01:46<63:43:16,  7.65s/it]
 21%|██        | 7984/37963 [18:01:54<63:52:18,  7.67s/it]
 21%|██        | 7985/37963 [18:02:04<70:27:08,  8.46s/it]
 21%|██        | 7986/37963 [18:02:12<68:10:23,  8.19s/it]
 21%|██        | 7987/37963 [18:02:20<67:27:25,  8.10s/it]
 21%|██        | 7988/37963 [18:02:28<66:38:32,  8.00s/it]
 21%|██        | 7989/37963 [18:02:35<65:57:40,  7.92s/it]
 21%|██        | 7990/37963 [18:02:43<65:47:57,  7.90s/it]
                                                          
{'loss': '0.1726', 'grad_norm': '3.646', 'learning_rate': '1.834e-05', 'epoch': '0.2105'}
+
 21%|██        | 7990/37963 [18:02:43<65:47:57,  7.90s/it]
 21%|██        | 7991/37963 [18:02:53<71:50:04,  8.63s/it]
 21%|██        | 7992/37963 [18:03:01<69:08:17,  8.30s/it]
 21%|██        | 7993/37963 [18:03:09<67:37:02,  8.12s/it]
 21%|██        | 7994/37963 [18:03:16<66:21:59,  7.97s/it]
 21%|██        | 7995/37963 [18:03:24<65:21:27,  7.85s/it]
 21%|██        | 7996/37963 [18:03:31<63:38:50,  7.65s/it]
 21%|██        | 7997/37963 [18:03:38<62:59:46,  7.57s/it]
 21%|██        | 7998/37963 [18:03:46<63:05:31,  7.58s/it]
 21%|██        | 7999/37963 [18:03:54<63:18:01,  7.61s/it]
 21%|██        | 8000/37963 [18:04:04<70:09:34,  8.43s/it]
                                                          
{'loss': '0.1763', 'grad_norm': '3.334', 'learning_rate': '1.834e-05', 'epoch': '0.2107'}
+
 21%|██        | 8000/37963 [18:04:04<70:09:34,  8.43s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.10s/it]
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.10s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 21%|██        | 8001/37963 [18:05:07<205:46:32, 24.72s/it]
 21%|██        | 8002/37963 [18:05:14<162:16:40, 19.50s/it]
 21%|██        | 8003/37963 [18:05:22<132:39:10, 15.94s/it]
 21%|██        | 8004/37963 [18:05:32<117:24:39, 14.11s/it]
 21%|██        | 8005/37963 [18:05:40<102:04:59, 12.27s/it]
 21%|██        | 8006/37963 [18:05:50<97:22:31, 11.70s/it] 
 21%|██        | 8007/37963 [18:05:58<87:23:41, 10.50s/it]
 21%|██        | 8008/37963 [18:06:05<80:23:21,  9.66s/it]
 21%|██        | 8009/37963 [18:06:16<82:57:01,  9.97s/it]
 21%|██        | 8010/37963 [18:06:24<77:15:12,  9.28s/it]
                                                          
{'loss': '0.1761', 'grad_norm': '1.215', 'learning_rate': '1.833e-05', 'epoch': '0.211'}
+
 21%|██        | 8010/37963 [18:06:24<77:15:12,  9.28s/it]
 21%|██        | 8011/37963 [18:06:31<73:19:49,  8.81s/it]
 21%|██        | 8012/37963 [18:06:39<69:47:47,  8.39s/it]
 21%|██        | 8013/37963 [18:06:47<68:07:27,  8.19s/it]
 21%|██        | 8014/37963 [18:06:57<72:47:48,  8.75s/it]
 21%|██        | 8015/37963 [18:07:04<70:16:12,  8.45s/it]
 21%|██        | 8016/37963 [18:07:12<68:11:32,  8.20s/it]
 21%|██        | 8017/37963 [18:07:20<66:56:47,  8.05s/it]
 21%|██        | 8018/37963 [18:07:27<65:53:25,  7.92s/it]
 21%|██        | 8019/37963 [18:07:35<64:48:48,  7.79s/it]
 21%|██        | 8020/37963 [18:07:43<64:50:17,  7.80s/it]
                                                          
{'loss': '0.1799', 'grad_norm': '4.999', 'learning_rate': '1.833e-05', 'epoch': '0.2113'}
+
 21%|██        | 8020/37963 [18:07:43<64:50:17,  7.80s/it]
 21%|██        | 8021/37963 [18:07:50<64:23:25,  7.74s/it]
 21%|██        | 8022/37963 [18:07:58<64:07:06,  7.71s/it]
 21%|██        | 8023/37963 [18:08:05<63:51:42,  7.68s/it]
 21%|██        | 8024/37963 [18:08:13<64:03:15,  7.70s/it]
 21%|██        | 8025/37963 [18:08:21<64:09:01,  7.71s/it]
 21%|██        | 8026/37963 [18:08:29<64:00:36,  7.70s/it]
 21%|██        | 8027/37963 [18:08:36<64:09:37,  7.72s/it]
 21%|██        | 8028/37963 [18:08:44<64:23:10,  7.74s/it]
 21%|██        | 8029/37963 [18:08:52<63:29:24,  7.64s/it]
 21%|██        | 8030/37963 [18:08:59<63:31:41,  7.64s/it]
                                                          
{'loss': '0.1883', 'grad_norm': '2.186', 'learning_rate': '1.832e-05', 'epoch': '0.2115'}
+
 21%|██        | 8030/37963 [18:08:59<63:31:41,  7.64s/it]
 21%|██        | 8031/37963 [18:09:07<63:56:40,  7.69s/it]
 21%|██        | 8032/37963 [18:09:15<64:27:38,  7.75s/it]
 21%|██        | 8033/37963 [18:09:22<63:50:39,  7.68s/it]
 21%|██        | 8034/37963 [18:09:33<70:37:01,  8.49s/it]
 21%|██        | 8035/37963 [18:09:41<68:52:30,  8.28s/it]
 21%|██        | 8036/37963 [18:09:48<67:13:59,  8.09s/it]
 21%|██        | 8037/37963 [18:09:56<66:27:59,  8.00s/it]
 21%|██        | 8038/37963 [18:10:04<65:58:50,  7.94s/it]
 21%|██        | 8039/37963 [18:10:11<65:12:17,  7.84s/it]
 21%|██        | 8040/37963 [18:10:19<64:47:27,  7.79s/it]
                                                          
{'loss': '0.1724', 'grad_norm': '2.71', 'learning_rate': '1.832e-05', 'epoch': '0.2118'}
+
 21%|██        | 8040/37963 [18:10:19<64:47:27,  7.79s/it]
 21%|██        | 8041/37963 [18:10:27<64:15:52,  7.73s/it]
 21%|██        | 8042/37963 [18:10:34<64:07:32,  7.72s/it]
 21%|██        | 8043/37963 [18:10:44<70:01:51,  8.43s/it]
 21%|██        | 8044/37963 [18:10:52<68:01:46,  8.19s/it]
 21%|██        | 8045/37963 [18:11:00<66:46:54,  8.04s/it]
 21%|██        | 8046/37963 [18:11:07<65:52:17,  7.93s/it]
 21%|██        | 8047/37963 [18:11:15<65:16:50,  7.86s/it]
 21%|██        | 8048/37963 [18:11:26<71:45:15,  8.63s/it]
 21%|██        | 8049/37963 [18:11:33<69:30:42,  8.37s/it]
 21%|██        | 8050/37963 [18:11:41<68:12:20,  8.21s/it]
                                                          
{'loss': '0.1789', 'grad_norm': '3.219', 'learning_rate': '1.831e-05', 'epoch': '0.212'}
+
 21%|██        | 8050/37963 [18:11:41<68:12:20,  8.21s/it]
 21%|██        | 8051/37963 [18:11:49<66:37:26,  8.02s/it]
 21%|██        | 8052/37963 [18:12:04<85:13:50, 10.26s/it]
 21%|██        | 8053/37963 [18:12:12<78:27:16,  9.44s/it]
 21%|██        | 8054/37963 [18:12:19<73:25:30,  8.84s/it]
 21%|██        | 8055/37963 [18:12:26<69:33:23,  8.37s/it]
 21%|██        | 8056/37963 [18:12:34<67:05:40,  8.08s/it]
 21%|██        | 8057/37963 [18:12:42<66:20:55,  7.99s/it]
 21%|██        | 8058/37963 [18:12:49<65:30:31,  7.89s/it]
 21%|██        | 8059/37963 [18:12:57<65:06:31,  7.84s/it]
 21%|██        | 8060/37963 [18:13:05<64:17:36,  7.74s/it]
                                                          
{'loss': '0.1595', 'grad_norm': '1.62', 'learning_rate': '1.831e-05', 'epoch': '0.2123'}
+
 21%|██        | 8060/37963 [18:13:05<64:17:36,  7.74s/it]
 21%|██        | 8061/37963 [18:13:12<64:19:30,  7.74s/it]
 21%|██        | 8062/37963 [18:13:20<64:00:12,  7.71s/it]
 21%|██        | 8063/37963 [18:13:30<70:47:13,  8.52s/it]
 21%|██        | 8064/37963 [18:13:38<69:00:03,  8.31s/it]
 21%|██        | 8065/37963 [18:13:46<67:09:37,  8.09s/it]
 21%|██        | 8066/37963 [18:13:54<66:48:24,  8.04s/it]
 21%|██        | 8067/37963 [18:14:01<66:10:56,  7.97s/it]
 21%|██▏       | 8068/37963 [18:14:12<71:57:12,  8.66s/it]
 21%|██▏       | 8069/37963 [18:14:19<69:15:14,  8.34s/it]
 21%|██▏       | 8070/37963 [18:14:27<67:01:49,  8.07s/it]
                                                          
{'loss': '0.1543', 'grad_norm': '2.837', 'learning_rate': '1.83e-05', 'epoch': '0.2126'}
+
 21%|██▏       | 8070/37963 [18:14:27<67:01:49,  8.07s/it]
 21%|██▏       | 8071/37963 [18:14:34<66:11:31,  7.97s/it]
 21%|██▏       | 8072/37963 [18:14:42<65:24:49,  7.88s/it]
 21%|██▏       | 8073/37963 [18:14:50<64:39:55,  7.79s/it]
 21%|██▏       | 8074/37963 [18:14:58<64:59:54,  7.83s/it]
 21%|██▏       | 8075/37963 [18:15:05<65:01:52,  7.83s/it]
 21%|██▏       | 8076/37963 [18:15:13<64:31:56,  7.77s/it]
 21%|██▏       | 8077/37963 [18:15:21<64:35:54,  7.78s/it]
 21%|██▏       | 8078/37963 [18:15:31<70:14:38,  8.46s/it]
 21%|██▏       | 8079/37963 [18:15:39<68:47:18,  8.29s/it]
 21%|██▏       | 8080/37963 [18:15:47<67:31:50,  8.14s/it]
                                                          
{'loss': '0.1782', 'grad_norm': '1.432', 'learning_rate': '1.83e-05', 'epoch': '0.2128'}
+
 21%|██▏       | 8080/37963 [18:15:47<67:31:50,  8.14s/it]
 21%|██▏       | 8081/37963 [18:15:54<66:15:36,  7.98s/it]
 21%|██▏       | 8082/37963 [18:16:02<65:38:05,  7.91s/it]
 21%|██▏       | 8083/37963 [18:16:09<64:38:50,  7.79s/it]
 21%|██▏       | 8084/37963 [18:16:17<64:55:44,  7.82s/it]
 21%|██▏       | 8085/37963 [18:16:25<64:17:04,  7.75s/it]
 21%|██▏       | 8086/37963 [18:16:33<63:55:57,  7.70s/it]
 21%|██▏       | 8087/37963 [18:16:40<63:40:04,  7.67s/it]
 21%|██▏       | 8088/37963 [18:16:48<63:33:21,  7.66s/it]
 21%|██▏       | 8089/37963 [18:16:56<63:52:28,  7.70s/it]
 21%|██▏       | 8090/37963 [18:17:03<63:47:32,  7.69s/it]
                                                          
{'loss': '0.1749', 'grad_norm': '1.169', 'learning_rate': '1.829e-05', 'epoch': '0.2131'}
+
 21%|██▏       | 8090/37963 [18:17:03<63:47:32,  7.69s/it]
 21%|██▏       | 8091/37963 [18:17:11<63:57:07,  7.71s/it]
 21%|██▏       | 8092/37963 [18:17:19<64:41:42,  7.80s/it]
 21%|██▏       | 8093/37963 [18:17:27<64:21:25,  7.76s/it]
 21%|██▏       | 8094/37963 [18:17:34<64:26:23,  7.77s/it]
 21%|██▏       | 8095/37963 [18:17:44<69:38:58,  8.39s/it]
 21%|██▏       | 8096/37963 [18:17:57<80:45:08,  9.73s/it]
 21%|██▏       | 8097/37963 [18:18:05<76:13:07,  9.19s/it]
 21%|██▏       | 8098/37963 [18:18:13<72:24:06,  8.73s/it]
 21%|██▏       | 8099/37963 [18:18:20<69:52:48,  8.42s/it]
 21%|██▏       | 8100/37963 [18:18:28<67:08:17,  8.09s/it]
                                                          
{'loss': '0.1896', 'grad_norm': '1.554', 'learning_rate': '1.829e-05', 'epoch': '0.2134'}
+
 21%|██▏       | 8100/37963 [18:18:28<67:08:17,  8.09s/it]
 21%|██▏       | 8101/37963 [18:18:38<73:03:16,  8.81s/it]
 21%|██▏       | 8102/37963 [18:18:46<69:32:08,  8.38s/it]
 21%|██▏       | 8103/37963 [18:18:53<67:07:36,  8.09s/it]
 21%|██▏       | 8104/37963 [18:19:01<66:03:50,  7.97s/it]
 21%|██▏       | 8105/37963 [18:19:08<65:14:53,  7.87s/it]
 21%|██▏       | 8106/37963 [18:19:19<71:58:33,  8.68s/it]
 21%|██▏       | 8107/37963 [18:19:27<70:08:43,  8.46s/it]
 21%|██▏       | 8108/37963 [18:19:35<68:05:28,  8.21s/it]
 21%|██▏       | 8109/37963 [18:19:42<66:46:13,  8.05s/it]
 21%|██▏       | 8110/37963 [18:19:50<65:05:17,  7.85s/it]
                                                          
{'loss': '0.1736', 'grad_norm': '2.519', 'learning_rate': '1.828e-05', 'epoch': '0.2136'}
+
 21%|██▏       | 8110/37963 [18:19:50<65:05:17,  7.85s/it]
 21%|██▏       | 8111/37963 [18:19:57<64:41:48,  7.80s/it]
 21%|██▏       | 8112/37963 [18:20:05<64:16:49,  7.75s/it]
 21%|██▏       | 8113/37963 [18:20:13<64:05:19,  7.73s/it]
 21%|██▏       | 8114/37963 [18:20:20<64:06:32,  7.73s/it]
 21%|██▏       | 8115/37963 [18:20:28<64:08:34,  7.74s/it]
 21%|██▏       | 8116/37963 [18:20:36<64:24:35,  7.77s/it]
 21%|██▏       | 8117/37963 [18:20:49<76:56:08,  9.28s/it]
 21%|██▏       | 8118/37963 [18:20:57<73:20:57,  8.85s/it]
 21%|██▏       | 8119/37963 [18:21:04<70:56:12,  8.56s/it]
 21%|██▏       | 8120/37963 [18:21:12<68:15:32,  8.23s/it]
                                                          
{'loss': '0.1543', 'grad_norm': '1.45', 'learning_rate': '1.828e-05', 'epoch': '0.2139'}
+
 21%|██▏       | 8120/37963 [18:21:12<68:15:32,  8.23s/it]
 21%|██▏       | 8121/37963 [18:21:20<66:57:43,  8.08s/it]
 21%|██▏       | 8122/37963 [18:21:27<65:24:17,  7.89s/it]
 21%|██▏       | 8123/37963 [18:21:34<64:06:46,  7.73s/it]
 21%|██▏       | 8124/37963 [18:21:42<63:52:54,  7.71s/it]
 21%|██▏       | 8125/37963 [18:21:50<63:40:54,  7.68s/it]
 21%|██▏       | 8126/37963 [18:21:58<63:57:54,  7.72s/it]
 21%|██▏       | 8127/37963 [18:22:05<64:14:05,  7.75s/it]
 21%|██▏       | 8128/37963 [18:22:13<64:18:38,  7.76s/it]
 21%|██▏       | 8129/37963 [18:22:21<63:50:46,  7.70s/it]
 21%|██▏       | 8130/37963 [18:22:28<63:27:47,  7.66s/it]
                                                          
{'loss': '0.1733', 'grad_norm': '1.527', 'learning_rate': '1.827e-05', 'epoch': '0.2142'}
+
 21%|██▏       | 8130/37963 [18:22:28<63:27:47,  7.66s/it]
 21%|██▏       | 8131/37963 [18:22:36<63:40:47,  7.68s/it]
 21%|██▏       | 8132/37963 [18:22:46<70:05:48,  8.46s/it]
 21%|██▏       | 8133/37963 [18:22:54<68:56:06,  8.32s/it]
 21%|██▏       | 8134/37963 [18:23:02<66:38:01,  8.04s/it]
 21%|██▏       | 8135/37963 [18:23:09<64:49:36,  7.82s/it]
 21%|██▏       | 8136/37963 [18:23:17<64:23:55,  7.77s/it]
 21%|██▏       | 8137/37963 [18:23:24<63:56:01,  7.72s/it]
 21%|██▏       | 8138/37963 [18:23:32<64:04:17,  7.73s/it]
 21%|██▏       | 8139/37963 [18:23:42<70:20:28,  8.49s/it]
 21%|██▏       | 8140/37963 [18:23:50<68:11:22,  8.23s/it]
                                                          
{'loss': '0.1875', 'grad_norm': '3.974', 'learning_rate': '1.827e-05', 'epoch': '0.2144'}
+
 21%|██▏       | 8140/37963 [18:23:50<68:11:22,  8.23s/it]
 21%|██▏       | 8141/37963 [18:23:58<67:02:15,  8.09s/it]
 21%|██▏       | 8142/37963 [18:24:05<65:56:31,  7.96s/it]
 21%|██▏       | 8143/37963 [18:24:13<65:03:41,  7.85s/it]
 21%|██▏       | 8144/37963 [18:24:23<71:03:17,  8.58s/it]
 21%|██▏       | 8145/37963 [18:24:31<68:20:44,  8.25s/it]
 21%|██▏       | 8146/37963 [18:24:39<67:45:51,  8.18s/it]
 21%|██▏       | 8147/37963 [18:24:47<67:08:02,  8.11s/it]
 21%|██▏       | 8148/37963 [18:24:54<66:34:47,  8.04s/it]
 21%|██▏       | 8149/37963 [18:25:07<78:56:01,  9.53s/it]
 21%|██▏       | 8150/37963 [18:25:15<74:43:04,  9.02s/it]
                                                          
{'loss': '0.1682', 'grad_norm': '3.653', 'learning_rate': '1.826e-05', 'epoch': '0.2147'}
+
 21%|██▏       | 8150/37963 [18:25:15<74:43:04,  9.02s/it]
 21%|██▏       | 8151/37963 [18:25:23<71:38:58,  8.65s/it]
 21%|██▏       | 8152/37963 [18:25:31<69:26:17,  8.39s/it]
 21%|██▏       | 8153/37963 [18:25:38<67:14:57,  8.12s/it]
 21%|██▏       | 8154/37963 [18:25:48<71:47:49,  8.67s/it]
 21%|██▏       | 8155/37963 [18:25:56<68:14:54,  8.24s/it]
 21%|██▏       | 8156/37963 [18:26:03<66:37:21,  8.05s/it]
 21%|██▏       | 8157/37963 [18:26:11<65:47:05,  7.95s/it]
 21%|██▏       | 8158/37963 [18:26:19<65:19:47,  7.89s/it]
 21%|██▏       | 8159/37963 [18:26:26<64:50:29,  7.83s/it]
 21%|██▏       | 8160/37963 [18:26:34<64:15:42,  7.76s/it]
                                                          
{'loss': '0.1604', 'grad_norm': '1.331', 'learning_rate': '1.826e-05', 'epoch': '0.2149'}
+
 21%|██▏       | 8160/37963 [18:26:34<64:15:42,  7.76s/it]
 21%|██▏       | 8161/37963 [18:26:44<69:17:30,  8.37s/it]
 21%|██▏       | 8162/37963 [18:26:51<67:41:42,  8.18s/it]
 22%|██▏       | 8163/37963 [18:27:02<73:45:47,  8.91s/it]
 22%|██▏       | 8164/37963 [18:27:10<70:35:36,  8.53s/it]
 22%|██▏       | 8165/37963 [18:27:17<68:41:23,  8.30s/it]
 22%|██▏       | 8166/37963 [18:27:25<67:00:55,  8.10s/it]
 22%|██▏       | 8167/37963 [18:27:33<65:56:25,  7.97s/it]
 22%|██▏       | 8168/37963 [18:27:40<65:04:58,  7.86s/it]
 22%|██▏       | 8169/37963 [18:27:48<64:28:48,  7.79s/it]
 22%|██▏       | 8170/37963 [18:27:56<64:27:48,  7.79s/it]
                                                          
{'loss': '0.167', 'grad_norm': '3.295', 'learning_rate': '1.825e-05', 'epoch': '0.2152'}
+
 22%|██▏       | 8170/37963 [18:27:56<64:27:48,  7.79s/it]
 22%|██▏       | 8171/37963 [18:28:03<63:58:19,  7.73s/it]
 22%|██▏       | 8172/37963 [18:28:11<64:07:33,  7.75s/it]
 22%|██▏       | 8173/37963 [18:28:19<64:07:45,  7.75s/it]
 22%|██▏       | 8174/37963 [18:28:27<63:55:22,  7.73s/it]
 22%|██▏       | 8175/37963 [18:28:34<62:57:18,  7.61s/it]
 22%|██▏       | 8176/37963 [18:28:42<63:11:55,  7.64s/it]
 22%|██▏       | 8177/37963 [18:28:49<63:18:44,  7.65s/it]
 22%|██▏       | 8178/37963 [18:28:57<63:07:18,  7.63s/it]
 22%|██▏       | 8179/37963 [18:29:05<63:15:49,  7.65s/it]
 22%|██▏       | 8180/37963 [18:29:12<63:31:13,  7.68s/it]
                                                          
{'loss': '0.1646', 'grad_norm': '2.373', 'learning_rate': '1.825e-05', 'epoch': '0.2155'}
+
 22%|██▏       | 8180/37963 [18:29:12<63:31:13,  7.68s/it]
 22%|██▏       | 8181/37963 [18:29:20<63:50:01,  7.72s/it]
 22%|██▏       | 8182/37963 [18:29:28<63:54:08,  7.72s/it]
 22%|██▏       | 8183/37963 [18:29:36<63:49:24,  7.72s/it]
 22%|██▏       | 8184/37963 [18:29:43<63:48:37,  7.71s/it]
 22%|██▏       | 8185/37963 [18:29:51<63:59:21,  7.74s/it]
 22%|██▏       | 8186/37963 [18:30:01<70:07:56,  8.48s/it]
 22%|██▏       | 8187/37963 [18:30:11<74:21:00,  8.99s/it]
 22%|██▏       | 8188/37963 [18:30:19<71:08:07,  8.60s/it]
 22%|██▏       | 8189/37963 [18:30:27<69:08:25,  8.36s/it]
 22%|██▏       | 8190/37963 [18:30:35<67:23:22,  8.15s/it]
                                                          
{'loss': '0.175', 'grad_norm': '3.638', 'learning_rate': '1.825e-05', 'epoch': '0.2157'}
+
 22%|██▏       | 8190/37963 [18:30:35<67:23:22,  8.15s/it]
 22%|██▏       | 8191/37963 [18:30:42<65:35:11,  7.93s/it]
 22%|██▏       | 8192/37963 [18:30:49<64:08:03,  7.76s/it]
 22%|██▏       | 8193/37963 [18:31:00<70:46:33,  8.56s/it]
 22%|██▏       | 8194/37963 [18:31:08<68:46:15,  8.32s/it]
 22%|██▏       | 8195/37963 [18:31:15<66:57:35,  8.10s/it]
 22%|██▏       | 8196/37963 [18:31:23<65:48:18,  7.96s/it]
 22%|██▏       | 8197/37963 [18:31:33<71:14:54,  8.62s/it]
 22%|██▏       | 8198/37963 [18:31:43<75:28:43,  9.13s/it]
 22%|██▏       | 8199/37963 [18:31:53<77:55:37,  9.43s/it]
 22%|██▏       | 8200/37963 [18:32:01<73:49:47,  8.93s/it]
                                                          
{'loss': '0.1888', 'grad_norm': '5.536', 'learning_rate': '1.824e-05', 'epoch': '0.216'}
+
 22%|██▏       | 8200/37963 [18:32:01<73:49:47,  8.93s/it]
 22%|██▏       | 8201/37963 [18:32:09<70:33:10,  8.53s/it]
 22%|██▏       | 8202/37963 [18:32:16<67:20:30,  8.15s/it]
 22%|██▏       | 8203/37963 [18:32:24<66:25:53,  8.04s/it]
 22%|██▏       | 8204/37963 [18:32:31<65:06:09,  7.88s/it]
 22%|██▏       | 8205/37963 [18:32:39<64:55:23,  7.85s/it]
 22%|██▏       | 8206/37963 [18:32:47<64:09:19,  7.76s/it]
 22%|██▏       | 8207/37963 [18:32:54<63:45:13,  7.71s/it]
 22%|██▏       | 8208/37963 [18:33:05<70:58:45,  8.59s/it]
 22%|██▏       | 8209/37963 [18:33:12<68:32:16,  8.29s/it]
 22%|██▏       | 8210/37963 [18:33:20<66:26:56,  8.04s/it]
                                                          
{'loss': '0.179', 'grad_norm': '2.885', 'learning_rate': '1.824e-05', 'epoch': '0.2163'}
+
 22%|██▏       | 8210/37963 [18:33:20<66:26:56,  8.04s/it]
 22%|██▏       | 8211/37963 [18:33:27<65:06:38,  7.88s/it]
 22%|██▏       | 8212/37963 [18:33:38<71:50:56,  8.69s/it]
 22%|██▏       | 8213/37963 [18:33:46<69:29:01,  8.41s/it]
 22%|██▏       | 8214/37963 [18:33:54<68:08:11,  8.25s/it]
 22%|██▏       | 8215/37963 [18:34:01<66:22:13,  8.03s/it]
 22%|██▏       | 8216/37963 [18:34:09<65:33:30,  7.93s/it]
 22%|██▏       | 8217/37963 [18:34:17<64:47:55,  7.84s/it]
 22%|██▏       | 8218/37963 [18:34:24<64:42:37,  7.83s/it]
 22%|██▏       | 8219/37963 [18:34:32<64:15:26,  7.78s/it]
 22%|██▏       | 8220/37963 [18:34:40<63:49:05,  7.72s/it]
                                                          
{'loss': '0.1767', 'grad_norm': '2.346', 'learning_rate': '1.823e-05', 'epoch': '0.2165'}
+
 22%|██▏       | 8220/37963 [18:34:40<63:49:05,  7.72s/it]
 22%|██▏       | 8221/37963 [18:34:47<63:43:17,  7.71s/it]
 22%|██▏       | 8222/37963 [18:34:55<63:21:42,  7.67s/it]
 22%|██▏       | 8223/37963 [18:35:03<63:25:59,  7.68s/it]
 22%|██▏       | 8224/37963 [18:35:10<62:35:43,  7.58s/it]
 22%|██▏       | 8225/37963 [18:35:18<63:07:49,  7.64s/it]
 22%|██▏       | 8226/37963 [18:35:25<63:20:43,  7.67s/it]
 22%|██▏       | 8227/37963 [18:35:33<63:04:57,  7.64s/it]
 22%|██▏       | 8228/37963 [18:35:41<63:00:07,  7.63s/it]
 22%|██▏       | 8229/37963 [18:35:48<63:35:06,  7.70s/it]
 22%|██▏       | 8230/37963 [18:35:56<63:17:18,  7.66s/it]
                                                          
{'loss': '0.1604', 'grad_norm': '2.338', 'learning_rate': '1.823e-05', 'epoch': '0.2168'}
+
 22%|██▏       | 8230/37963 [18:35:56<63:17:18,  7.66s/it]
 22%|██▏       | 8231/37963 [18:36:06<69:51:01,  8.46s/it]
 22%|██▏       | 8232/37963 [18:36:14<68:44:28,  8.32s/it]
 22%|██▏       | 8233/37963 [18:36:22<67:26:03,  8.17s/it]
 22%|██▏       | 8234/37963 [18:36:30<66:12:51,  8.02s/it]
 22%|██▏       | 8235/37963 [18:36:38<65:31:45,  7.94s/it]
 22%|██▏       | 8236/37963 [18:36:48<71:07:46,  8.61s/it]
 22%|██▏       | 8237/37963 [18:36:56<69:21:35,  8.40s/it]
 22%|██▏       | 8238/37963 [18:37:04<68:32:16,  8.30s/it]
 22%|██▏       | 8239/37963 [18:37:12<67:29:53,  8.17s/it]
 22%|██▏       | 8240/37963 [18:37:22<72:23:51,  8.77s/it]
                                                          
{'loss': '0.1631', 'grad_norm': '1.208', 'learning_rate': '1.822e-05', 'epoch': '0.2171'}
+
 22%|██▏       | 8240/37963 [18:37:22<72:23:51,  8.77s/it]
 22%|██▏       | 8241/37963 [18:37:32<76:34:17,  9.27s/it]
 22%|██▏       | 8242/37963 [18:37:40<72:47:43,  8.82s/it]
 22%|██▏       | 8243/37963 [18:37:48<70:15:58,  8.51s/it]
 22%|██▏       | 8244/37963 [18:37:55<68:07:54,  8.25s/it]
 22%|██▏       | 8245/37963 [18:38:03<67:20:30,  8.16s/it]
 22%|██▏       | 8246/37963 [18:38:14<72:30:26,  8.78s/it]
 22%|██▏       | 8247/37963 [18:38:21<70:02:19,  8.48s/it]
 22%|██▏       | 8248/37963 [18:38:29<68:53:32,  8.35s/it]
 22%|██▏       | 8249/37963 [18:38:37<67:50:55,  8.22s/it]
 22%|██▏       | 8250/37963 [18:38:45<65:51:42,  7.98s/it]
                                                          
{'loss': '0.1662', 'grad_norm': '2.002', 'learning_rate': '1.822e-05', 'epoch': '0.2173'}
+
 22%|██▏       | 8250/37963 [18:38:45<65:51:42,  7.98s/it]
 22%|██▏       | 8251/37963 [18:38:52<64:33:00,  7.82s/it]
 22%|██▏       | 8252/37963 [18:39:00<63:49:36,  7.73s/it]
 22%|██▏       | 8253/37963 [18:39:10<69:39:48,  8.44s/it]
 22%|██▏       | 8254/37963 [18:39:17<67:42:00,  8.20s/it]
 22%|██▏       | 8255/37963 [18:39:28<73:12:24,  8.87s/it]
 22%|██▏       | 8256/37963 [18:39:36<70:23:09,  8.53s/it]
 22%|██▏       | 8257/37963 [18:39:43<68:00:40,  8.24s/it]
 22%|██▏       | 8258/37963 [18:39:51<66:27:04,  8.05s/it]
 22%|██▏       | 8259/37963 [18:39:59<65:46:30,  7.97s/it]
 22%|██▏       | 8260/37963 [18:40:06<64:12:54,  7.78s/it]
                                                          
{'loss': '0.1809', 'grad_norm': '1.694', 'learning_rate': '1.821e-05', 'epoch': '0.2176'}
+
 22%|██▏       | 8260/37963 [18:40:06<64:12:54,  7.78s/it]
 22%|██▏       | 8261/37963 [18:40:14<64:06:22,  7.77s/it]
 22%|██▏       | 8262/37963 [18:40:24<69:50:42,  8.47s/it]
 22%|██▏       | 8263/37963 [18:40:31<67:53:06,  8.23s/it]
 22%|██▏       | 8264/37963 [18:40:39<66:46:36,  8.09s/it]
 22%|██▏       | 8265/37963 [18:40:47<65:41:30,  7.96s/it]
 22%|██▏       | 8266/37963 [18:40:54<64:50:16,  7.86s/it]
 22%|██▏       | 8267/37963 [18:41:02<64:13:13,  7.79s/it]
 22%|██▏       | 8268/37963 [18:41:10<64:19:54,  7.80s/it]
 22%|██▏       | 8269/37963 [18:41:17<63:21:59,  7.68s/it]
 22%|██▏       | 8270/37963 [18:41:25<62:45:22,  7.61s/it]
                                                          
{'loss': '0.1635', 'grad_norm': '2.489', 'learning_rate': '1.821e-05', 'epoch': '0.2178'}
+
 22%|██▏       | 8270/37963 [18:41:25<62:45:22,  7.61s/it]
 22%|██▏       | 8271/37963 [18:41:32<62:27:49,  7.57s/it]
 22%|██▏       | 8272/37963 [18:41:40<63:07:46,  7.65s/it]
 22%|██▏       | 8273/37963 [18:41:48<62:57:19,  7.63s/it]
 22%|██▏       | 8274/37963 [18:41:55<62:56:11,  7.63s/it]
 22%|██▏       | 8275/37963 [18:42:06<69:28:51,  8.43s/it]
 22%|██▏       | 8276/37963 [18:42:13<67:54:14,  8.23s/it]
 22%|██▏       | 8277/37963 [18:42:21<66:58:35,  8.12s/it]
 22%|██▏       | 8278/37963 [18:42:29<65:53:19,  7.99s/it]
 22%|██▏       | 8279/37963 [18:42:37<65:21:56,  7.93s/it]
 22%|██▏       | 8280/37963 [18:42:47<70:55:27,  8.60s/it]
                                                          
{'loss': '0.1673', 'grad_norm': '1.337', 'learning_rate': '1.82e-05', 'epoch': '0.2181'}
+
 22%|██▏       | 8280/37963 [18:42:47<70:55:27,  8.60s/it]
 22%|██▏       | 8281/37963 [18:42:54<68:06:27,  8.26s/it]
 22%|██▏       | 8282/37963 [18:43:02<67:14:49,  8.16s/it]
 22%|██▏       | 8283/37963 [18:43:10<65:43:58,  7.97s/it]
 22%|██▏       | 8284/37963 [18:43:18<65:20:42,  7.93s/it]
 22%|██▏       | 8285/37963 [18:43:28<71:47:44,  8.71s/it]
 22%|██▏       | 8286/37963 [18:43:36<68:57:37,  8.37s/it]
 22%|██▏       | 8287/37963 [18:43:43<67:11:18,  8.15s/it]
 22%|██▏       | 8288/37963 [18:43:51<66:11:50,  8.03s/it]
 22%|██▏       | 8289/37963 [18:44:01<71:29:12,  8.67s/it]
 22%|██▏       | 8290/37963 [18:44:09<69:04:14,  8.38s/it]
                                                          
{'loss': '0.1763', 'grad_norm': '1.717', 'learning_rate': '1.82e-05', 'epoch': '0.2184'}
+
 22%|██▏       | 8290/37963 [18:44:09<69:04:14,  8.38s/it]
 22%|██▏       | 8291/37963 [18:44:17<67:34:20,  8.20s/it]
 22%|██▏       | 8292/37963 [18:44:24<65:42:13,  7.97s/it]
 22%|██▏       | 8293/37963 [18:44:32<65:25:42,  7.94s/it]
 22%|██▏       | 8294/37963 [18:44:42<71:00:15,  8.62s/it]
 22%|██▏       | 8295/37963 [18:44:50<68:32:35,  8.32s/it]
 22%|██▏       | 8296/37963 [18:44:57<66:42:34,  8.09s/it]
 22%|██▏       | 8297/37963 [18:45:05<66:25:06,  8.06s/it]
 22%|██▏       | 8298/37963 [18:45:13<65:40:48,  7.97s/it]
 22%|██▏       | 8299/37963 [18:45:24<71:32:12,  8.68s/it]
 22%|██▏       | 8300/37963 [18:45:32<69:46:23,  8.47s/it]
                                                          
{'loss': '0.1611', 'grad_norm': '1.847', 'learning_rate': '1.819e-05', 'epoch': '0.2186'}
+
 22%|██▏       | 8300/37963 [18:45:32<69:46:23,  8.47s/it]
 22%|██▏       | 8301/37963 [18:45:39<67:46:39,  8.23s/it]
 22%|██▏       | 8302/37963 [18:45:47<66:21:25,  8.05s/it]
 22%|██▏       | 8303/37963 [18:45:57<71:58:53,  8.74s/it]
 22%|██▏       | 8304/37963 [18:46:05<68:56:42,  8.37s/it]
 22%|██▏       | 8305/37963 [18:46:12<67:15:08,  8.16s/it]
 22%|██▏       | 8306/37963 [18:46:20<65:58:03,  8.01s/it]
 22%|██▏       | 8307/37963 [18:46:28<65:28:49,  7.95s/it]
 22%|██▏       | 8308/37963 [18:46:35<64:27:18,  7.82s/it]
 22%|██▏       | 8309/37963 [18:46:43<63:52:07,  7.75s/it]
 22%|██▏       | 8310/37963 [18:46:51<63:32:09,  7.71s/it]
                                                          
{'loss': '0.1741', 'grad_norm': '1.671', 'learning_rate': '1.819e-05', 'epoch': '0.2189'}
+
 22%|██▏       | 8310/37963 [18:46:51<63:32:09,  7.71s/it]
 22%|██▏       | 8311/37963 [18:46:58<63:29:29,  7.71s/it]
 22%|██▏       | 8312/37963 [18:47:06<63:41:34,  7.73s/it]
 22%|██▏       | 8313/37963 [18:47:14<63:39:26,  7.73s/it]
 22%|██▏       | 8314/37963 [18:47:21<63:23:26,  7.70s/it]
 22%|██▏       | 8315/37963 [18:47:29<63:22:26,  7.70s/it]
 22%|██▏       | 8316/37963 [18:47:39<69:51:56,  8.48s/it]
 22%|██▏       | 8317/37963 [18:47:47<67:52:26,  8.24s/it]
 22%|██▏       | 8318/37963 [18:47:57<72:36:14,  8.82s/it]
 22%|██▏       | 8319/37963 [18:48:05<69:40:10,  8.46s/it]
 22%|██▏       | 8320/37963 [18:48:12<67:30:00,  8.20s/it]
                                                          
{'loss': '0.167', 'grad_norm': '0.9242', 'learning_rate': '1.818e-05', 'epoch': '0.2192'}
+
 22%|██▏       | 8320/37963 [18:48:12<67:30:00,  8.20s/it]
 22%|██▏       | 8321/37963 [18:48:20<65:56:15,  8.01s/it]
 22%|██▏       | 8322/37963 [18:48:28<65:24:03,  7.94s/it]
 22%|██▏       | 8323/37963 [18:48:35<64:38:41,  7.85s/it]
 22%|██▏       | 8324/37963 [18:48:46<70:46:20,  8.60s/it]
 22%|██▏       | 8325/37963 [18:48:54<68:50:46,  8.36s/it]
 22%|██▏       | 8326/37963 [18:49:01<67:20:54,  8.18s/it]
 22%|██▏       | 8327/37963 [18:49:09<64:53:56,  7.88s/it]
 22%|██▏       | 8328/37963 [18:49:16<64:01:25,  7.78s/it]
 22%|██▏       | 8329/37963 [18:49:24<64:08:22,  7.79s/it]
 22%|██▏       | 8330/37963 [18:49:31<62:53:01,  7.64s/it]
                                                          
{'loss': '0.1651', 'grad_norm': '3.339', 'learning_rate': '1.818e-05', 'epoch': '0.2194'}
+
 22%|██▏       | 8330/37963 [18:49:31<62:53:01,  7.64s/it]
 22%|██▏       | 8331/37963 [18:49:39<63:16:14,  7.69s/it]
 22%|██▏       | 8332/37963 [18:49:46<62:44:49,  7.62s/it]
 22%|██▏       | 8333/37963 [18:49:57<69:50:27,  8.49s/it]
 22%|██▏       | 8334/37963 [18:50:05<68:22:17,  8.31s/it]
 22%|██▏       | 8335/37963 [18:50:13<67:03:32,  8.15s/it]
 22%|██▏       | 8336/37963 [18:50:20<65:40:01,  7.98s/it]
 22%|██▏       | 8337/37963 [18:50:31<71:43:21,  8.72s/it]
 22%|██▏       | 8338/37963 [18:50:38<69:31:18,  8.45s/it]
 22%|██▏       | 8339/37963 [18:50:46<68:10:26,  8.28s/it]
 22%|██▏       | 8340/37963 [18:50:54<67:05:27,  8.15s/it]
                                                          
{'loss': '0.1911', 'grad_norm': '4.204', 'learning_rate': '1.817e-05', 'epoch': '0.2197'}
+
 22%|██▏       | 8340/37963 [18:50:54<67:05:27,  8.15s/it]
 22%|██▏       | 8341/37963 [18:51:02<66:11:21,  8.04s/it]
 22%|██▏       | 8342/37963 [18:51:09<64:41:01,  7.86s/it]
 22%|██▏       | 8343/37963 [18:51:22<77:12:56,  9.38s/it]
 22%|██▏       | 8344/37963 [18:51:30<72:32:33,  8.82s/it]
 22%|██▏       | 8345/37963 [18:51:37<69:31:37,  8.45s/it]
 22%|██▏       | 8346/37963 [18:51:45<66:56:01,  8.14s/it]
 22%|██▏       | 8347/37963 [18:51:52<65:43:22,  7.99s/it]
 22%|██▏       | 8348/37963 [18:52:00<64:30:19,  7.84s/it]
 22%|██▏       | 8349/37963 [18:52:08<64:06:21,  7.79s/it]
 22%|██▏       | 8350/37963 [18:52:15<63:30:56,  7.72s/it]
                                                          
{'loss': '0.188', 'grad_norm': '1.235', 'learning_rate': '1.817e-05', 'epoch': '0.22'}
+
 22%|██▏       | 8350/37963 [18:52:15<63:30:56,  7.72s/it]
 22%|██▏       | 8351/37963 [18:52:23<63:20:33,  7.70s/it]
 22%|██▏       | 8352/37963 [18:52:31<63:14:29,  7.69s/it]
 22%|██▏       | 8353/37963 [18:52:39<64:03:15,  7.79s/it]
 22%|██▏       | 8354/37963 [18:52:46<64:25:01,  7.83s/it]
 22%|██▏       | 8355/37963 [18:52:54<63:38:23,  7.74s/it]
 22%|██▏       | 8356/37963 [18:53:02<63:42:14,  7.75s/it]
 22%|██▏       | 8357/37963 [18:53:12<70:17:05,  8.55s/it]
 22%|██▏       | 8358/37963 [18:53:20<68:12:00,  8.29s/it]
 22%|██▏       | 8359/37963 [18:53:28<66:39:04,  8.11s/it]
 22%|██▏       | 8360/37963 [18:53:35<65:54:38,  8.02s/it]
                                                          
{'loss': '0.1756', 'grad_norm': '2.232', 'learning_rate': '1.816e-05', 'epoch': '0.2202'}
+
 22%|██▏       | 8360/37963 [18:53:35<65:54:38,  8.02s/it]
 22%|██▏       | 8361/37963 [18:53:43<64:55:20,  7.90s/it]
 22%|██▏       | 8362/37963 [18:53:53<70:41:10,  8.60s/it]
 22%|██▏       | 8363/37963 [18:54:01<68:58:26,  8.39s/it]
 22%|██▏       | 8364/37963 [18:54:09<67:27:17,  8.20s/it]
 22%|██▏       | 8365/37963 [18:54:17<66:35:14,  8.10s/it]
 22%|██▏       | 8366/37963 [18:54:24<64:29:38,  7.84s/it]
 22%|██▏       | 8367/37963 [18:54:34<70:14:14,  8.54s/it]
 22%|██▏       | 8368/37963 [18:54:42<68:43:26,  8.36s/it]
 22%|██▏       | 8369/37963 [18:54:50<66:34:37,  8.10s/it]
 22%|██▏       | 8370/37963 [18:55:00<71:51:46,  8.74s/it]
                                                          
{'loss': '0.1579', 'grad_norm': '2.313', 'learning_rate': '1.816e-05', 'epoch': '0.2205'}
+
 22%|██▏       | 8370/37963 [18:55:00<71:51:46,  8.74s/it]
 22%|██▏       | 8371/37963 [18:55:08<69:48:37,  8.49s/it]
 22%|██▏       | 8372/37963 [18:55:15<67:49:55,  8.25s/it]
 22%|██▏       | 8373/37963 [18:55:23<65:51:47,  8.01s/it]
 22%|██▏       | 8374/37963 [18:55:31<65:15:14,  7.94s/it]
 22%|██▏       | 8375/37963 [18:55:38<64:06:03,  7.80s/it]
 22%|██▏       | 8376/37963 [18:55:46<64:06:47,  7.80s/it]
 22%|██▏       | 8377/37963 [18:55:54<64:07:27,  7.80s/it]
 22%|██▏       | 8378/37963 [18:56:01<63:04:22,  7.67s/it]
 22%|██▏       | 8379/37963 [18:56:09<62:52:58,  7.65s/it]
 22%|██▏       | 8380/37963 [18:56:16<61:48:25,  7.52s/it]
                                                          
{'loss': '0.1778', 'grad_norm': '2.075', 'learning_rate': '1.815e-05', 'epoch': '0.2207'}
+
 22%|██▏       | 8380/37963 [18:56:16<61:48:25,  7.52s/it]
 22%|██▏       | 8381/37963 [18:56:26<68:38:34,  8.35s/it]
 22%|██▏       | 8382/37963 [18:56:34<66:59:04,  8.15s/it]
 22%|██▏       | 8383/37963 [18:56:42<65:35:38,  7.98s/it]
 22%|██▏       | 8384/37963 [18:56:49<64:57:28,  7.91s/it]
 22%|██▏       | 8385/37963 [18:56:59<70:38:12,  8.60s/it]
 22%|██▏       | 8386/37963 [18:57:07<68:16:22,  8.31s/it]
 22%|██▏       | 8387/37963 [18:57:15<66:28:08,  8.09s/it]
 22%|██▏       | 8388/37963 [18:57:23<66:03:29,  8.04s/it]
 22%|██▏       | 8389/37963 [18:57:30<65:42:14,  8.00s/it]
 22%|██▏       | 8390/37963 [18:57:38<65:12:17,  7.94s/it]
                                                          
{'loss': '0.187', 'grad_norm': '1.304', 'learning_rate': '1.815e-05', 'epoch': '0.221'}
+
 22%|██▏       | 8390/37963 [18:57:38<65:12:17,  7.94s/it]
 22%|██▏       | 8391/37963 [18:57:46<64:28:28,  7.85s/it]
 22%|██▏       | 8392/37963 [18:57:56<70:16:33,  8.56s/it]
 22%|██▏       | 8393/37963 [18:58:04<68:09:33,  8.30s/it]
 22%|██▏       | 8394/37963 [18:58:12<66:50:38,  8.14s/it]
 22%|██▏       | 8395/37963 [18:58:19<65:40:27,  8.00s/it]
 22%|██▏       | 8396/37963 [18:58:29<71:00:51,  8.65s/it]
 22%|██▏       | 8397/37963 [18:58:37<68:21:11,  8.32s/it]
 22%|██▏       | 8398/37963 [18:58:45<66:32:15,  8.10s/it]
 22%|██▏       | 8399/37963 [18:58:52<65:24:00,  7.96s/it]
 22%|██▏       | 8400/37963 [18:59:00<64:38:35,  7.87s/it]
                                                          
{'loss': '0.1663', 'grad_norm': '1.459', 'learning_rate': '1.814e-05', 'epoch': '0.2213'}
+
 22%|██▏       | 8400/37963 [18:59:00<64:38:35,  7.87s/it]
 22%|██▏       | 8401/37963 [18:59:10<70:47:21,  8.62s/it]
 22%|██▏       | 8402/37963 [18:59:18<68:38:02,  8.36s/it]
 22%|██▏       | 8403/37963 [18:59:26<66:44:10,  8.13s/it]
 22%|██▏       | 8404/37963 [18:59:33<65:52:13,  8.02s/it]
 22%|██▏       | 8405/37963 [18:59:43<70:44:39,  8.62s/it]
 22%|██▏       | 8406/37963 [18:59:51<68:48:50,  8.38s/it]
 22%|██▏       | 8407/37963 [18:59:59<66:25:43,  8.09s/it]
 22%|██▏       | 8408/37963 [19:00:06<65:42:52,  8.00s/it]
 22%|██▏       | 8409/37963 [19:00:14<65:01:13,  7.92s/it]
 22%|██▏       | 8410/37963 [19:00:22<64:42:52,  7.88s/it]
                                                          
{'loss': '0.1929', 'grad_norm': '2.198', 'learning_rate': '1.814e-05', 'epoch': '0.2215'}
+
 22%|██▏       | 8410/37963 [19:00:22<64:42:52,  7.88s/it]
 22%|██▏       | 8411/37963 [19:00:30<64:19:44,  7.84s/it]
 22%|██▏       | 8412/37963 [19:00:37<63:53:04,  7.78s/it]
 22%|██▏       | 8413/37963 [19:00:45<63:29:48,  7.74s/it]
 22%|██▏       | 8414/37963 [19:00:53<63:58:16,  7.79s/it]
 22%|██▏       | 8415/37963 [19:01:00<63:23:14,  7.72s/it]
 22%|██▏       | 8416/37963 [19:01:11<69:55:32,  8.52s/it]
 22%|██▏       | 8417/37963 [19:01:19<68:38:20,  8.36s/it]
 22%|██▏       | 8418/37963 [19:01:26<66:00:40,  8.04s/it]
 22%|██▏       | 8419/37963 [19:01:34<65:14:53,  7.95s/it]
 22%|██▏       | 8420/37963 [19:01:41<64:28:11,  7.86s/it]
                                                          
{'loss': '0.1675', 'grad_norm': '1.616', 'learning_rate': '1.813e-05', 'epoch': '0.2218'}
+
 22%|██▏       | 8420/37963 [19:01:41<64:28:11,  7.86s/it]
 22%|██▏       | 8421/37963 [19:01:49<64:02:04,  7.80s/it]
 22%|██▏       | 8422/37963 [19:01:57<63:31:57,  7.74s/it]
 22%|██▏       | 8423/37963 [19:02:04<63:13:30,  7.71s/it]
 22%|██▏       | 8424/37963 [19:02:15<69:34:04,  8.48s/it]
 22%|██▏       | 8425/37963 [19:02:23<68:16:47,  8.32s/it]
 22%|██▏       | 8426/37963 [19:02:30<66:27:59,  8.10s/it]
 22%|██▏       | 8427/37963 [19:02:38<65:13:10,  7.95s/it]
 22%|██▏       | 8428/37963 [19:02:45<64:03:11,  7.81s/it]
 22%|██▏       | 8429/37963 [19:02:56<70:20:29,  8.57s/it]
 22%|██▏       | 8430/37963 [19:03:03<68:07:56,  8.31s/it]
                                                          
{'loss': '0.184', 'grad_norm': '2.206', 'learning_rate': '1.813e-05', 'epoch': '0.2221'}
+
 22%|██▏       | 8430/37963 [19:03:03<68:07:56,  8.31s/it]
 22%|██▏       | 8431/37963 [19:03:11<66:58:34,  8.16s/it]
 22%|██▏       | 8432/37963 [19:03:19<66:07:11,  8.06s/it]
 22%|██▏       | 8433/37963 [19:03:27<64:56:01,  7.92s/it]
 22%|██▏       | 8434/37963 [19:03:34<64:18:38,  7.84s/it]
 22%|██▏       | 8435/37963 [19:03:44<69:26:00,  8.47s/it]
 22%|██▏       | 8436/37963 [19:03:51<66:28:56,  8.11s/it]
 22%|██▏       | 8437/37963 [19:03:59<65:13:22,  7.95s/it]
 22%|██▏       | 8438/37963 [19:04:07<64:56:54,  7.92s/it]
 22%|██▏       | 8439/37963 [19:04:14<63:40:27,  7.76s/it]
 22%|██▏       | 8440/37963 [19:04:22<63:31:26,  7.75s/it]
                                                          
{'loss': '0.1828', 'grad_norm': '2.34', 'learning_rate': '1.812e-05', 'epoch': '0.2223'}
+
 22%|██▏       | 8440/37963 [19:04:22<63:31:26,  7.75s/it]
 22%|██▏       | 8441/37963 [19:04:29<62:57:46,  7.68s/it]
 22%|██▏       | 8442/37963 [19:04:37<63:03:56,  7.69s/it]
 22%|██▏       | 8443/37963 [19:04:45<63:34:00,  7.75s/it]
 22%|██▏       | 8444/37963 [19:04:53<63:49:30,  7.78s/it]
 22%|██▏       | 8445/37963 [19:05:01<63:30:16,  7.74s/it]
 22%|██▏       | 8446/37963 [19:05:11<70:25:52,  8.59s/it]
 22%|██▏       | 8447/37963 [19:05:19<68:05:25,  8.30s/it]
 22%|██▏       | 8448/37963 [19:05:26<66:19:37,  8.09s/it]
 22%|██▏       | 8449/37963 [19:05:37<71:21:39,  8.70s/it]
 22%|██▏       | 8450/37963 [19:05:47<75:45:24,  9.24s/it]
                                                          
{'loss': '0.1732', 'grad_norm': '3.702', 'learning_rate': '1.812e-05', 'epoch': '0.2226'}
+
 22%|██▏       | 8450/37963 [19:05:47<75:45:24,  9.24s/it]
 22%|██▏       | 8451/37963 [19:05:55<72:31:17,  8.85s/it]
 22%|██▏       | 8452/37963 [19:06:03<69:44:45,  8.51s/it]
 22%|██▏       | 8453/37963 [19:06:11<68:15:32,  8.33s/it]
 22%|██▏       | 8454/37963 [19:06:18<66:39:13,  8.13s/it]
 22%|██▏       | 8455/37963 [19:06:26<65:25:27,  7.98s/it]
 22%|██▏       | 8456/37963 [19:06:34<64:36:49,  7.88s/it]
 22%|██▏       | 8457/37963 [19:06:41<64:13:44,  7.84s/it]
 22%|██▏       | 8458/37963 [19:06:49<64:08:24,  7.83s/it]
 22%|██▏       | 8459/37963 [19:06:57<63:52:49,  7.79s/it]
 22%|██▏       | 8460/37963 [19:07:04<63:33:50,  7.76s/it]
                                                          
{'loss': '0.1693', 'grad_norm': '1.718', 'learning_rate': '1.811e-05', 'epoch': '0.2228'}
+
 22%|██▏       | 8460/37963 [19:07:04<63:33:50,  7.76s/it]
 22%|██▏       | 8461/37963 [19:07:12<63:53:10,  7.80s/it]
 22%|██▏       | 8462/37963 [19:07:20<64:17:50,  7.85s/it]
 22%|██▏       | 8463/37963 [19:07:28<64:20:37,  7.85s/it]
 22%|██▏       | 8464/37963 [19:07:38<69:45:06,  8.51s/it]
 22%|██▏       | 8465/37963 [19:07:46<67:31:44,  8.24s/it]
 22%|██▏       | 8466/37963 [19:07:53<65:54:17,  8.04s/it]
 22%|██▏       | 8467/37963 [19:08:01<64:57:53,  7.93s/it]
 22%|██▏       | 8468/37963 [19:08:09<63:59:07,  7.81s/it]
 22%|██▏       | 8469/37963 [19:08:16<63:44:38,  7.78s/it]
 22%|██▏       | 8470/37963 [19:08:24<63:17:40,  7.73s/it]
                                                          
{'loss': '0.1731', 'grad_norm': '0.8623', 'learning_rate': '1.811e-05', 'epoch': '0.2231'}
+
 22%|██▏       | 8470/37963 [19:08:24<63:17:40,  7.73s/it]
 22%|██▏       | 8471/37963 [19:08:32<63:15:49,  7.72s/it]
 22%|██▏       | 8472/37963 [19:08:44<74:46:22,  9.13s/it]
 22%|██▏       | 8473/37963 [19:08:52<71:22:38,  8.71s/it]
 22%|██▏       | 8474/37963 [19:08:59<68:32:24,  8.37s/it]
 22%|██▏       | 8475/37963 [19:09:07<67:12:30,  8.21s/it]
 22%|██▏       | 8476/37963 [19:09:15<65:31:59,  8.00s/it]
 22%|██▏       | 8477/37963 [19:09:22<64:55:43,  7.93s/it]
 22%|██▏       | 8478/37963 [19:09:33<70:19:29,  8.59s/it]
 22%|██▏       | 8479/37963 [19:09:40<68:38:15,  8.38s/it]
 22%|██▏       | 8480/37963 [19:09:48<66:35:14,  8.13s/it]
                                                          
{'loss': '0.1757', 'grad_norm': '3.819', 'learning_rate': '1.81e-05', 'epoch': '0.2234'}
+
 22%|██▏       | 8480/37963 [19:09:48<66:35:14,  8.13s/it]
 22%|██▏       | 8481/37963 [19:09:56<65:37:13,  8.01s/it]
 22%|██▏       | 8482/37963 [19:10:03<64:53:37,  7.92s/it]
 22%|██▏       | 8483/37963 [19:10:11<63:52:11,  7.80s/it]
 22%|██▏       | 8484/37963 [19:10:21<69:41:05,  8.51s/it]
 22%|██▏       | 8485/37963 [19:10:29<67:09:15,  8.20s/it]
 22%|██▏       | 8486/37963 [19:10:36<65:03:54,  7.95s/it]
 22%|██▏       | 8487/37963 [19:10:44<64:33:36,  7.88s/it]
 22%|██▏       | 8488/37963 [19:10:51<63:43:56,  7.78s/it]
 22%|██▏       | 8489/37963 [19:10:59<63:37:37,  7.77s/it]
 22%|██��       | 8490/37963 [19:11:07<63:19:17,  7.73s/it]
                                                          
{'loss': '0.1704', 'grad_norm': '2.825', 'learning_rate': '1.81e-05', 'epoch': '0.2236'}
+
 22%|██▏       | 8490/37963 [19:11:07<63:19:17,  7.73s/it]
 22%|██▏       | 8491/37963 [19:11:14<63:09:17,  7.71s/it]
 22%|██▏       | 8492/37963 [19:11:22<62:34:44,  7.64s/it]
 22%|██▏       | 8493/37963 [19:11:30<62:51:08,  7.68s/it]
 22%|██▏       | 8494/37963 [19:11:37<63:19:32,  7.74s/it]
 22%|██▏       | 8495/37963 [19:11:45<63:04:46,  7.71s/it]
 22%|██▏       | 8496/37963 [19:11:53<62:38:15,  7.65s/it]
 22%|██▏       | 8497/37963 [19:12:03<68:14:00,  8.34s/it]
 22%|██▏       | 8498/37963 [19:12:10<66:49:08,  8.16s/it]
 22%|██▏       | 8499/37963 [19:12:18<64:51:06,  7.92s/it]
 22%|██▏       | 8500/37963 [19:12:28<71:03:31,  8.68s/it]
                                                          
{'loss': '0.1694', 'grad_norm': '4.785', 'learning_rate': '1.809e-05', 'epoch': '0.2239'}
+
 22%|██▏       | 8500/37963 [19:12:28<71:03:31,  8.68s/it]
 22%|██▏       | 8501/37963 [19:12:36<68:05:35,  8.32s/it]
 22%|██▏       | 8502/37963 [19:12:43<67:07:24,  8.20s/it]
 22%|██▏       | 8503/37963 [19:12:51<66:29:50,  8.13s/it]
 22%|██▏       | 8504/37963 [19:13:02<72:19:43,  8.84s/it]
 22%|██▏       | 8505/37963 [19:13:10<69:54:13,  8.54s/it]
 22%|██▏       | 8506/37963 [19:13:18<67:56:47,  8.30s/it]
 22%|██▏       | 8507/37963 [19:13:25<66:17:57,  8.10s/it]
 22%|██▏       | 8508/37963 [19:13:33<65:38:33,  8.02s/it]
 22%|██▏       | 8509/37963 [19:13:41<64:38:46,  7.90s/it]
 22%|██▏       | 8510/37963 [19:13:48<64:06:19,  7.84s/it]
                                                          
{'loss': '0.1753', 'grad_norm': '2.692', 'learning_rate': '1.809e-05', 'epoch': '0.2242'}
+
 22%|██▏       | 8510/37963 [19:13:48<64:06:19,  7.84s/it]
 22%|██▏       | 8511/37963 [19:13:56<63:56:54,  7.82s/it]
 22%|██▏       | 8512/37963 [19:14:06<70:06:36,  8.57s/it]
 22%|██▏       | 8513/37963 [19:14:14<68:53:16,  8.42s/it]
 22%|██▏       | 8514/37963 [19:14:22<66:34:39,  8.14s/it]
 22%|██▏       | 8515/37963 [19:14:30<65:48:24,  8.04s/it]
 22%|██▏       | 8516/37963 [19:14:37<64:23:40,  7.87s/it]
 22%|██▏       | 8517/37963 [19:14:45<64:18:57,  7.86s/it]
 22%|██▏       | 8518/37963 [19:14:53<64:33:29,  7.89s/it]
 22%|██▏       | 8519/37963 [19:15:01<64:21:25,  7.87s/it]
 22%|██▏       | 8520/37963 [19:15:08<62:55:52,  7.69s/it]
                                                          
{'loss': '0.1802', 'grad_norm': '3.574', 'learning_rate': '1.808e-05', 'epoch': '0.2244'}
+
 22%|██▏       | 8520/37963 [19:15:08<62:55:52,  7.69s/it]
 22%|██▏       | 8521/37963 [19:15:16<62:13:43,  7.61s/it]
 22%|██▏       | 8522/37963 [19:15:23<62:39:28,  7.66s/it]
 22%|██▏       | 8523/37963 [19:15:31<62:32:12,  7.65s/it]
 22%|██▏       | 8524/37963 [19:15:39<62:36:02,  7.66s/it]
 22%|██▏       | 8525/37963 [19:15:46<62:31:08,  7.65s/it]
 22%|██▏       | 8526/37963 [19:15:59<75:41:32,  9.26s/it]
 22%|██▏       | 8527/37963 [19:16:07<71:54:33,  8.79s/it]
 22%|██▏       | 8528/37963 [19:16:15<69:03:00,  8.45s/it]
 22%|██▏       | 8529/37963 [19:16:22<66:08:30,  8.09s/it]
 22%|██▏       | 8530/37963 [19:16:29<64:53:34,  7.94s/it]
                                                          
{'loss': '0.1799', 'grad_norm': '1.244', 'learning_rate': '1.808e-05', 'epoch': '0.2247'}
+
 22%|██▏       | 8530/37963 [19:16:29<64:53:34,  7.94s/it]
 22%|██▏       | 8531/37963 [19:16:37<64:07:00,  7.84s/it]
 22%|██▏       | 8532/37963 [19:16:50<76:23:06,  9.34s/it]
 22%|██▏       | 8533/37963 [19:16:57<71:55:10,  8.80s/it]
 22%|██▏       | 8534/37963 [19:17:05<68:28:51,  8.38s/it]
 22%|██▏       | 8535/37963 [19:17:12<66:33:14,  8.14s/it]
 22%|██▏       | 8536/37963 [19:17:20<65:20:42,  7.99s/it]
 22%|██▏       | 8537/37963 [19:17:28<64:06:30,  7.84s/it]
 22%|██▏       | 8538/37963 [19:17:35<64:10:06,  7.85s/it]
 22%|██▏       | 8539/37963 [19:17:43<63:10:48,  7.73s/it]
 22%|██▏       | 8540/37963 [19:17:50<62:46:13,  7.68s/it]
                                                          
{'loss': '0.1653', 'grad_norm': '3.111', 'learning_rate': '1.807e-05', 'epoch': '0.225'}
+
 22%|██▏       | 8540/37963 [19:17:50<62:46:13,  7.68s/it]
 22%|██▏       | 8541/37963 [19:18:01<69:14:01,  8.47s/it]
 23%|██▎       | 8542/37963 [19:18:08<66:56:17,  8.19s/it]
 23%|██▎       | 8543/37963 [19:18:16<65:11:06,  7.98s/it]
 23%|██▎       | 8544/37963 [19:18:23<64:19:31,  7.87s/it]
 23%|██▎       | 8545/37963 [19:18:31<64:03:29,  7.84s/it]
 23%|██▎       | 8546/37963 [19:18:39<63:50:48,  7.81s/it]
 23%|██▎       | 8547/37963 [19:18:47<63:25:41,  7.76s/it]
 23%|██▎       | 8548/37963 [19:18:59<75:36:02,  9.25s/it]
 23%|██▎       | 8549/37963 [19:19:07<71:59:14,  8.81s/it]
 23%|██▎       | 8550/37963 [19:19:15<69:08:20,  8.46s/it]
                                                          
{'loss': '0.1782', 'grad_norm': '2.487', 'learning_rate': '1.807e-05', 'epoch': '0.2252'}
+
 23%|██▎       | 8550/37963 [19:19:15<69:08:20,  8.46s/it]
 23%|██▎       | 8551/37963 [19:19:22<67:00:54,  8.20s/it]
 23%|██▎       | 8552/37963 [19:19:30<65:42:12,  8.04s/it]
 23%|██▎       | 8553/37963 [19:19:38<65:18:39,  7.99s/it]
 23%|██▎       | 8554/37963 [19:19:46<64:44:15,  7.92s/it]
 23%|██▎       | 8555/37963 [19:19:53<63:52:19,  7.82s/it]
 23%|██▎       | 8556/37963 [19:20:01<63:25:57,  7.77s/it]
 23%|██▎       | 8557/37963 [19:20:09<63:34:07,  7.78s/it]
 23%|██▎       | 8558/37963 [19:20:17<64:03:17,  7.84s/it]
 23%|██▎       | 8559/37963 [19:20:24<63:40:13,  7.80s/it]
 23%|██▎       | 8560/37963 [19:20:32<63:19:48,  7.75s/it]
                                                          
{'loss': '0.1774', 'grad_norm': '2.515', 'learning_rate': '1.806e-05', 'epoch': '0.2255'}
+
 23%|██▎       | 8560/37963 [19:20:32<63:19:48,  7.75s/it]
 23%|██▎       | 8561/37963 [19:20:42<69:52:27,  8.56s/it]
 23%|██▎       | 8562/37963 [19:20:50<68:14:18,  8.36s/it]
 23%|██▎       | 8563/37963 [19:20:58<66:15:49,  8.11s/it]
 23%|██▎       | 8564/37963 [19:21:06<65:05:38,  7.97s/it]
 23%|██▎       | 8565/37963 [19:21:13<64:31:28,  7.90s/it]
 23%|██▎       | 8566/37963 [19:21:21<64:16:46,  7.87s/it]
 23%|██▎       | 8567/37963 [19:21:29<63:39:34,  7.80s/it]
 23%|██▎       | 8568/37963 [19:21:37<63:43:44,  7.80s/it]
 23%|██▎       | 8569/37963 [19:21:44<63:42:48,  7.80s/it]
 23%|██▎       | 8570/37963 [19:21:52<63:22:37,  7.76s/it]
                                                          
{'loss': '0.1559', 'grad_norm': '1.56', 'learning_rate': '1.806e-05', 'epoch': '0.2257'}
+
 23%|██▎       | 8570/37963 [19:21:52<63:22:37,  7.76s/it]
 23%|██▎       | 8571/37963 [19:22:00<63:04:27,  7.73s/it]
 23%|██▎       | 8572/37963 [19:22:07<63:24:01,  7.77s/it]
 23%|██▎       | 8573/37963 [19:22:15<63:19:34,  7.76s/it]
 23%|██▎       | 8574/37963 [19:22:23<63:09:20,  7.74s/it]
 23%|██▎       | 8575/37963 [19:22:33<69:30:50,  8.52s/it]
 23%|██▎       | 8576/37963 [19:22:41<67:33:08,  8.28s/it]
 23%|██▎       | 8577/37963 [19:22:48<65:33:28,  8.03s/it]
 23%|██▎       | 8578/37963 [19:22:56<65:17:09,  8.00s/it]
 23%|██▎       | 8579/37963 [19:23:04<63:40:07,  7.80s/it]
 23%|██▎       | 8580/37963 [19:23:17<76:21:34,  9.36s/it]
                                                          
{'loss': '0.1809', 'grad_norm': '1.633', 'learning_rate': '1.805e-05', 'epoch': '0.226'}
+
 23%|██▎       | 8580/37963 [19:23:17<76:21:34,  9.36s/it]
 23%|██▎       | 8581/37963 [19:23:24<72:35:41,  8.89s/it]
 23%|██▎       | 8582/37963 [19:23:32<69:44:40,  8.55s/it]
 23%|██▎       | 8583/37963 [19:23:40<67:48:24,  8.31s/it]
 23%|██▎       | 8584/37963 [19:23:48<66:04:02,  8.10s/it]
 23%|██▎       | 8585/37963 [19:23:55<64:49:27,  7.94s/it]
 23%|██▎       | 8586/37963 [19:24:05<70:38:33,  8.66s/it]
 23%|██▎       | 8587/37963 [19:24:13<68:17:44,  8.37s/it]
 23%|██▎       | 8588/37963 [19:24:21<66:16:40,  8.12s/it]
 23%|██▎       | 8589/37963 [19:24:29<65:31:05,  8.03s/it]
 23%|██▎       | 8590/37963 [19:24:36<64:30:13,  7.91s/it]
                                                          
{'loss': '0.1698', 'grad_norm': '2.253', 'learning_rate': '1.805e-05', 'epoch': '0.2263'}
+
 23%|██▎       | 8590/37963 [19:24:36<64:30:13,  7.91s/it]
 23%|██▎       | 8591/37963 [19:24:44<64:20:55,  7.89s/it]
 23%|██▎       | 8592/37963 [19:24:52<63:41:50,  7.81s/it]
 23%|██▎       | 8593/37963 [19:24:59<63:43:33,  7.81s/it]
 23%|██▎       | 8594/37963 [19:25:10<69:53:14,  8.57s/it]
 23%|██▎       | 8595/37963 [19:25:17<67:45:16,  8.31s/it]
 23%|██▎       | 8596/37963 [19:25:28<73:40:25,  9.03s/it]
 23%|██▎       | 8597/37963 [19:25:36<70:03:40,  8.59s/it]
 23%|██▎       | 8598/37963 [19:25:43<68:00:35,  8.34s/it]
 23%|██▎       | 8599/37963 [19:25:54<72:37:15,  8.90s/it]
 23%|██▎       | 8600/37963 [19:26:02<70:31:05,  8.65s/it]
                                                          
{'loss': '0.1844', 'grad_norm': '2.625', 'learning_rate': '1.804e-05', 'epoch': '0.2265'}
+
 23%|██▎       | 8600/37963 [19:26:02<70:31:05,  8.65s/it]
 23%|██▎       | 8601/37963 [19:26:10<68:37:12,  8.41s/it]
 23%|██▎       | 8602/37963 [19:26:17<66:30:19,  8.15s/it]
 23%|██▎       | 8603/37963 [19:26:25<65:17:22,  8.01s/it]
 23%|██▎       | 8604/37963 [19:26:35<70:17:30,  8.62s/it]
 23%|██▎       | 8605/37963 [19:26:43<68:07:05,  8.35s/it]
 23%|██▎       | 8606/37963 [19:26:50<66:14:21,  8.12s/it]
 23%|██▎       | 8607/37963 [19:26:58<64:51:51,  7.95s/it]
 23%|██▎       | 8608/37963 [19:27:06<64:21:19,  7.89s/it]
 23%|██▎       | 8609/37963 [19:27:13<64:01:09,  7.85s/it]
 23%|██▎       | 8610/37963 [19:27:21<63:46:34,  7.82s/it]
                                                          
{'loss': '0.1651', 'grad_norm': '0.9207', 'learning_rate': '1.804e-05', 'epoch': '0.2268'}
+
 23%|██▎       | 8610/37963 [19:27:21<63:46:34,  7.82s/it]
 23%|██▎       | 8611/37963 [19:27:29<63:38:02,  7.80s/it]
 23%|██▎       | 8612/37963 [19:27:37<63:32:47,  7.79s/it]
 23%|██▎       | 8613/37963 [19:27:44<63:01:53,  7.73s/it]
 23%|██▎       | 8614/37963 [19:27:52<62:36:53,  7.68s/it]
 23%|██▎       | 8615/37963 [19:27:59<62:50:14,  7.71s/it]
 23%|██▎       | 8616/37963 [19:28:07<63:06:31,  7.74s/it]
 23%|██▎       | 8617/37963 [19:28:15<62:48:25,  7.70s/it]
 23%|██▎       | 8618/37963 [19:28:23<62:54:42,  7.72s/it]
 23%|██▎       | 8619/37963 [19:28:30<61:43:02,  7.57s/it]
 23%|██▎       | 8620/37963 [19:28:38<62:18:25,  7.64s/it]
                                                          
{'loss': '0.1662', 'grad_norm': '1.971', 'learning_rate': '1.803e-05', 'epoch': '0.2271'}
+
 23%|██▎       | 8620/37963 [19:28:38<62:18:25,  7.64s/it]
 23%|██▎       | 8621/37963 [19:28:45<61:49:09,  7.58s/it]
 23%|██▎       | 8622/37963 [19:28:53<61:52:19,  7.59s/it]
 23%|██▎       | 8623/37963 [19:29:03<67:54:24,  8.33s/it]
 23%|██▎       | 8624/37963 [19:29:11<66:20:18,  8.14s/it]
 23%|██▎       | 8625/37963 [19:29:21<71:23:25,  8.76s/it]
 23%|██▎       | 8626/37963 [19:29:28<68:39:55,  8.43s/it]
 23%|██▎       | 8627/37963 [19:29:36<66:18:37,  8.14s/it]
 23%|██▎       | 8628/37963 [19:29:43<63:57:21,  7.85s/it]
 23%|██▎       | 8629/37963 [19:29:51<63:36:34,  7.81s/it]
 23%|██▎       | 8630/37963 [19:30:01<69:43:27,  8.56s/it]
                                                          
{'loss': '0.1664', 'grad_norm': '3.328', 'learning_rate': '1.803e-05', 'epoch': '0.2273'}
+
 23%|██▎       | 8630/37963 [19:30:01<69:43:27,  8.56s/it]
 23%|██▎       | 8631/37963 [19:30:09<67:31:14,  8.29s/it]
 23%|██▎       | 8632/37963 [19:30:16<65:17:25,  8.01s/it]
 23%|██▎       | 8633/37963 [19:30:23<63:50:24,  7.84s/it]
 23%|██▎       | 8634/37963 [19:30:31<63:29:00,  7.79s/it]
 23%|██▎       | 8635/37963 [19:30:38<62:22:44,  7.66s/it]
 23%|██▎       | 8636/37963 [19:30:46<62:14:10,  7.64s/it]
 23%|██▎       | 8637/37963 [19:30:54<62:32:12,  7.68s/it]
 23%|██▎       | 8638/37963 [19:31:01<62:25:32,  7.66s/it]
 23%|██▎       | 8639/37963 [19:31:09<62:48:20,  7.71s/it]
 23%|██▎       | 8640/37963 [19:31:20<69:40:22,  8.55s/it]
                                                          
{'loss': '0.167', 'grad_norm': '2.159', 'learning_rate': '1.802e-05', 'epoch': '0.2276'}
+
 23%|██▎       | 8640/37963 [19:31:20<69:40:22,  8.55s/it]
 23%|██▎       | 8641/37963 [19:31:28<67:50:44,  8.33s/it]
 23%|██▎       | 8642/37963 [19:31:36<66:43:50,  8.19s/it]
 23%|██▎       | 8643/37963 [19:31:46<71:53:50,  8.83s/it]
 23%|██▎       | 8644/37963 [19:31:54<69:35:21,  8.54s/it]
 23%|██▎       | 8645/37963 [19:32:02<67:51:50,  8.33s/it]
 23%|██▎       | 8646/37963 [19:32:09<65:41:01,  8.07s/it]
 23%|██▎       | 8647/37963 [19:32:16<64:02:35,  7.86s/it]
 23%|██▎       | 8648/37963 [19:32:29<75:33:09,  9.28s/it]
 23%|██▎       | 8649/37963 [19:32:37<71:26:21,  8.77s/it]
 23%|██▎       | 8650/37963 [19:32:44<67:30:31,  8.29s/it]
                                                          
{'loss': '0.1851', 'grad_norm': '3.215', 'learning_rate': '1.802e-05', 'epoch': '0.2279'}
+
 23%|██▎       | 8650/37963 [19:32:44<67:30:31,  8.29s/it]
 23%|██▎       | 8651/37963 [19:32:52<66:41:15,  8.19s/it]
 23%|██▎       | 8652/37963 [19:32:59<64:56:23,  7.98s/it]
 23%|██▎       | 8653/37963 [19:33:07<64:30:53,  7.92s/it]
 23%|██▎       | 8654/37963 [19:33:15<63:42:57,  7.83s/it]
 23%|██▎       | 8655/37963 [19:33:22<63:24:04,  7.79s/it]
 23%|██▎       | 8656/37963 [19:33:30<63:30:16,  7.80s/it]
 23%|██▎       | 8657/37963 [19:33:38<63:11:05,  7.76s/it]
 23%|██▎       | 8658/37963 [19:33:45<62:52:21,  7.72s/it]
 23%|██▎       | 8659/37963 [19:33:53<62:50:39,  7.72s/it]
 23%|██▎       | 8660/37963 [19:34:01<62:41:05,  7.70s/it]
                                                          
{'loss': '0.1798', 'grad_norm': '1.94', 'learning_rate': '1.801e-05', 'epoch': '0.2281'}
+
 23%|██▎       | 8660/37963 [19:34:01<62:41:05,  7.70s/it]
 23%|██▎       | 8661/37963 [19:34:08<62:39:19,  7.70s/it]
 23%|██▎       | 8662/37963 [19:34:16<62:47:01,  7.71s/it]
 23%|██▎       | 8663/37963 [19:34:24<62:11:45,  7.64s/it]
 23%|██▎       | 8664/37963 [19:34:31<62:11:45,  7.64s/it]
 23%|██▎       | 8665/37963 [19:34:39<62:03:15,  7.62s/it]
 23%|██▎       | 8666/37963 [19:34:49<67:51:16,  8.34s/it]
 23%|██▎       | 8667/37963 [19:34:57<66:54:11,  8.22s/it]
 23%|██▎       | 8668/37963 [19:35:05<65:50:33,  8.09s/it]
 23%|██▎       | 8669/37963 [19:35:12<64:50:19,  7.97s/it]
 23%|██▎       | 8670/37963 [19:35:20<63:17:10,  7.78s/it]
                                                          
{'loss': '0.1672', 'grad_norm': '2.026', 'learning_rate': '1.801e-05', 'epoch': '0.2284'}
+
 23%|██▎       | 8670/37963 [19:35:20<63:17:10,  7.78s/it]
 23%|██▎       | 8671/37963 [19:35:27<63:07:58,  7.76s/it]
 23%|██▎       | 8672/37963 [19:35:35<62:50:00,  7.72s/it]
 23%|██▎       | 8673/37963 [19:35:45<69:15:37,  8.51s/it]
 23%|██▎       | 8674/37963 [19:35:56<74:16:24,  9.13s/it]
 23%|██▎       | 8675/37963 [19:36:04<71:03:54,  8.74s/it]
 23%|██▎       | 8676/37963 [19:36:12<68:57:41,  8.48s/it]
 23%|██▎       | 8677/37963 [19:36:19<67:05:35,  8.25s/it]
 23%|██▎       | 8678/37963 [19:36:27<65:28:07,  8.05s/it]
 23%|██▎       | 8679/37963 [19:36:35<64:35:03,  7.94s/it]
 23%|██▎       | 8680/37963 [19:36:42<64:19:12,  7.91s/it]
                                                          
{'loss': '0.171', 'grad_norm': '2.681', 'learning_rate': '1.8e-05', 'epoch': '0.2286'}
+
 23%|██▎       | 8680/37963 [19:36:42<64:19:12,  7.91s/it]
 23%|██▎       | 8681/37963 [19:36:50<64:01:17,  7.87s/it]
 23%|██▎       | 8682/37963 [19:36:58<63:56:49,  7.86s/it]
 23%|██▎       | 8683/37963 [19:37:06<63:39:12,  7.83s/it]
 23%|██▎       | 8684/37963 [19:37:19<76:46:41,  9.44s/it]
 23%|██▎       | 8685/37963 [19:37:27<72:26:52,  8.91s/it]
 23%|██▎       | 8686/37963 [19:37:35<70:21:43,  8.65s/it]
 23%|██▎       | 8687/37963 [19:37:45<74:18:40,  9.14s/it]
 23%|██▎       | 8688/37963 [19:37:53<71:31:43,  8.80s/it]
 23%|██▎       | 8689/37963 [19:38:01<69:07:09,  8.50s/it]
 23%|██▎       | 8690/37963 [19:38:08<67:00:52,  8.24s/it]
                                                          
{'loss': '0.1773', 'grad_norm': '2.998', 'learning_rate': '1.8e-05', 'epoch': '0.2289'}
+
 23%|██▎       | 8690/37963 [19:38:08<67:00:52,  8.24s/it]
 23%|██▎       | 8691/37963 [19:38:16<65:36:18,  8.07s/it]
 23%|██▎       | 8692/37963 [19:38:26<70:48:15,  8.71s/it]
 23%|██▎       | 8693/37963 [19:38:34<69:06:56,  8.50s/it]
 23%|██▎       | 8694/37963 [19:38:42<67:23:53,  8.29s/it]
 23%|██▎       | 8695/37963 [19:38:49<65:07:29,  8.01s/it]
 23%|██▎       | 8696/37963 [19:38:57<64:46:06,  7.97s/it]
 23%|██▎       | 8697/37963 [19:39:05<64:09:40,  7.89s/it]
 23%|██▎       | 8698/37963 [19:39:12<62:51:35,  7.73s/it]
 23%|██▎       | 8699/37963 [19:39:20<62:21:48,  7.67s/it]
 23%|██▎       | 8700/37963 [19:39:28<62:10:46,  7.65s/it]
                                                          
{'loss': '0.1698', 'grad_norm': '1.861', 'learning_rate': '1.799e-05', 'epoch': '0.2292'}
+
 23%|██▎       | 8700/37963 [19:39:28<62:10:46,  7.65s/it]
 23%|██▎       | 8701/37963 [19:39:35<62:21:24,  7.67s/it]
 23%|██▎       | 8702/37963 [19:39:45<68:30:01,  8.43s/it]
 23%|██▎       | 8703/37963 [19:39:53<66:41:40,  8.21s/it]
 23%|██▎       | 8704/37963 [19:40:01<65:13:15,  8.02s/it]
 23%|██▎       | 8705/37963 [19:40:08<64:24:45,  7.93s/it]
 23%|██▎       | 8706/37963 [19:40:16<63:34:58,  7.82s/it]
 23%|██▎       | 8707/37963 [19:40:24<63:00:10,  7.75s/it]
 23%|██▎       | 8708/37963 [19:40:31<62:14:44,  7.66s/it]
 23%|██▎       | 8709/37963 [19:40:39<61:58:00,  7.63s/it]
 23%|██▎       | 8710/37963 [19:40:46<61:56:56,  7.62s/it]
                                                          
{'loss': '0.1675', 'grad_norm': '2.116', 'learning_rate': '1.799e-05', 'epoch': '0.2294'}
+
 23%|██▎       | 8710/37963 [19:40:46<61:56:56,  7.62s/it]
 23%|██▎       | 8711/37963 [19:40:54<62:07:19,  7.65s/it]
 23%|██▎       | 8712/37963 [19:41:02<62:11:03,  7.65s/it]
 23%|██▎       | 8713/37963 [19:41:09<61:58:49,  7.63s/it]
 23%|██▎       | 8714/37963 [19:41:16<60:48:57,  7.49s/it]
 23%|██▎       | 8715/37963 [19:41:24<61:08:31,  7.53s/it]
 23%|██▎       | 8716/37963 [19:41:32<61:19:56,  7.55s/it]
 23%|██▎       | 8717/37963 [19:41:42<67:52:48,  8.36s/it]
 23%|██▎       | 8718/37963 [19:41:50<66:57:15,  8.24s/it]
 23%|██▎       | 8719/37963 [19:41:57<65:29:53,  8.06s/it]
 23%|██▎       | 8720/37963 [19:42:08<70:50:49,  8.72s/it]
                                                          
{'loss': '0.1587', 'grad_norm': '1.554', 'learning_rate': '1.798e-05', 'epoch': '0.2297'}
+
 23%|██▎       | 8720/37963 [19:42:08<70:50:49,  8.72s/it]
 23%|██▎       | 8721/37963 [19:42:15<68:21:09,  8.41s/it]
 23%|██▎       | 8722/37963 [19:42:23<66:03:15,  8.13s/it]
 23%|██▎       | 8723/37963 [19:42:30<64:35:23,  7.95s/it]
 23%|██▎       | 8724/37963 [19:42:41<71:03:43,  8.75s/it]
 23%|██▎       | 8725/37963 [19:42:49<68:26:20,  8.43s/it]
 23%|██▎       | 8726/37963 [19:42:56<66:42:46,  8.21s/it]
 23%|██▎       | 8727/37963 [19:43:07<71:53:50,  8.85s/it]
 23%|██▎       | 8728/37963 [19:43:14<69:00:27,  8.50s/it]
 23%|██▎       | 8729/37963 [19:43:22<67:27:00,  8.31s/it]
 23%|██▎       | 8730/37963 [19:43:33<72:22:36,  8.91s/it]
                                                          
{'loss': '0.1728', 'grad_norm': '1.175', 'learning_rate': '1.798e-05', 'epoch': '0.23'}
+
 23%|██▎       | 8730/37963 [19:43:33<72:22:36,  8.91s/it]
 23%|██▎       | 8731/37963 [19:43:40<69:35:38,  8.57s/it]
 23%|██▎       | 8732/37963 [19:43:51<74:20:28,  9.16s/it]
 23%|██▎       | 8733/37963 [19:43:59<71:12:58,  8.77s/it]
 23%|██▎       | 8734/37963 [19:44:06<67:47:47,  8.35s/it]
 23%|██▎       | 8735/37963 [19:44:14<65:50:09,  8.11s/it]
 23%|██▎       | 8736/37963 [19:44:21<64:48:43,  7.98s/it]
 23%|██▎       | 8737/37963 [19:44:29<64:20:13,  7.92s/it]
 23%|██▎       | 8738/37963 [19:44:37<64:59:10,  8.01s/it]
 23%|██▎       | 8739/37963 [19:44:45<64:51:41,  7.99s/it]
 23%|██▎       | 8740/37963 [19:44:56<70:20:35,  8.67s/it]
                                                          
{'loss': '0.1702', 'grad_norm': '2.505', 'learning_rate': '1.797e-05', 'epoch': '0.2302'}
+
 23%|██▎       | 8740/37963 [19:44:56<70:20:35,  8.67s/it]
 23%|██▎       | 8741/37963 [19:45:03<68:23:56,  8.43s/it]
 23%|██▎       | 8742/37963 [19:45:11<67:03:10,  8.26s/it]
 23%|██▎       | 8743/37963 [19:45:19<66:02:15,  8.14s/it]
 23%|██▎       | 8744/37963 [19:45:27<65:12:04,  8.03s/it]
 23%|██▎       | 8745/37963 [19:45:35<64:14:48,  7.92s/it]
 23%|██▎       | 8746/37963 [19:45:45<70:05:37,  8.64s/it]
 23%|██▎       | 8747/37963 [19:45:53<68:10:12,  8.40s/it]
 23%|██▎       | 8748/37963 [19:46:00<66:07:33,  8.15s/it]
 23%|██▎       | 8749/37963 [19:46:08<64:36:33,  7.96s/it]
 23%|██▎       | 8750/37963 [19:46:15<63:39:24,  7.84s/it]
                                                          
{'loss': '0.1691', 'grad_norm': '2.454', 'learning_rate': '1.797e-05', 'epoch': '0.2305'}
+
 23%|██▎       | 8750/37963 [19:46:15<63:39:24,  7.84s/it]
 23%|██▎       | 8751/37963 [19:46:23<62:42:16,  7.73s/it]
 23%|██▎       | 8752/37963 [19:46:31<62:38:28,  7.72s/it]
 23%|██▎       | 8753/37963 [19:46:38<63:07:48,  7.78s/it]
 23%|██▎       | 8754/37963 [19:46:46<63:16:14,  7.80s/it]
 23%|██▎       | 8755/37963 [19:46:54<63:06:44,  7.78s/it]
 23%|██▎       | 8756/37963 [19:47:02<63:13:28,  7.79s/it]
 23%|██▎       | 8757/37963 [19:47:10<63:27:33,  7.82s/it]
 23%|██▎       | 8758/37963 [19:47:18<63:34:12,  7.84s/it]
 23%|██▎       | 8759/37963 [19:47:25<63:14:42,  7.80s/it]
 23%|██▎       | 8760/37963 [19:47:33<63:14:33,  7.80s/it]
                                                          
{'loss': '0.1709', 'grad_norm': '0.9701', 'learning_rate': '1.796e-05', 'epoch': '0.2308'}
+
 23%|██▎       | 8760/37963 [19:47:33<63:14:33,  7.80s/it]
 23%|██▎       | 8761/37963 [19:47:43<69:00:25,  8.51s/it]
 23%|██▎       | 8762/37963 [19:47:51<67:09:35,  8.28s/it]
 23%|██▎       | 8763/37963 [19:47:59<65:48:48,  8.11s/it]
 23%|██▎       | 8764/37963 [19:48:06<64:36:52,  7.97s/it]
 23%|██▎       | 8765/37963 [19:48:14<63:22:11,  7.81s/it]
 23%|██▎       | 8766/37963 [19:48:22<63:25:22,  7.82s/it]
 23%|██▎       | 8767/37963 [19:48:29<63:17:06,  7.80s/it]
 23%|██▎       | 8768/37963 [19:48:37<62:57:14,  7.76s/it]
 23%|██▎       | 8769/37963 [19:48:47<68:21:52,  8.43s/it]
 23%|██▎       | 8770/37963 [19:48:55<66:47:19,  8.24s/it]
                                                          
{'loss': '0.1677', 'grad_norm': '1.774', 'learning_rate': '1.796e-05', 'epoch': '0.231'}
+
 23%|██▎       | 8770/37963 [19:48:55<66:47:19,  8.24s/it]
 23%|██▎       | 8771/37963 [19:49:03<66:01:19,  8.14s/it]
 23%|██▎       | 8772/37963 [19:49:10<64:35:24,  7.97s/it]
 23%|██▎       | 8773/37963 [19:49:20<69:50:55,  8.61s/it]
 23%|██▎       | 8774/37963 [19:49:28<67:29:18,  8.32s/it]
 23%|██▎       | 8775/37963 [19:49:41<79:03:32,  9.75s/it]
 23%|██▎       | 8776/37963 [19:49:49<74:14:09,  9.16s/it]
 23%|██▎       | 8777/37963 [19:49:57<71:22:40,  8.80s/it]
 23%|██▎       | 8778/37963 [19:50:07<75:09:26,  9.27s/it]
 23%|██▎       | 8779/37963 [19:50:15<71:25:17,  8.81s/it]
 23%|██▎       | 8780/37963 [19:50:23<68:48:13,  8.49s/it]
                                                          
{'loss': '0.1584', 'grad_norm': '1.522', 'learning_rate': '1.795e-05', 'epoch': '0.2313'}
+
 23%|██▎       | 8780/37963 [19:50:23<68:48:13,  8.49s/it]
 23%|██▎       | 8781/37963 [19:50:31<67:05:07,  8.28s/it]
 23%|██▎       | 8782/37963 [19:50:38<65:32:39,  8.09s/it]
 23%|██▎       | 8783/37963 [19:50:46<64:03:39,  7.90s/it]
 23%|██▎       | 8784/37963 [19:50:53<63:38:07,  7.85s/it]
 23%|██▎       | 8785/37963 [19:51:01<63:27:54,  7.83s/it]
 23%|██▎       | 8786/37963 [19:51:09<62:17:37,  7.69s/it]
 23%|██▎       | 8787/37963 [19:51:16<61:25:51,  7.58s/it]
 23%|██▎       | 8788/37963 [19:51:26<68:03:01,  8.40s/it]
 23%|██▎       | 8789/37963 [19:51:34<67:04:35,  8.28s/it]
 23%|██▎       | 8790/37963 [19:51:41<64:43:58,  7.99s/it]
                                                          
{'loss': '0.1794', 'grad_norm': '1.602', 'learning_rate': '1.794e-05', 'epoch': '0.2315'}
+
 23%|██▎       | 8790/37963 [19:51:41<64:43:58,  7.99s/it]
 23%|██▎       | 8791/37963 [19:51:49<63:52:56,  7.88s/it]
 23%|██▎       | 8792/37963 [19:51:57<63:41:15,  7.86s/it]
 23%|██▎       | 8793/37963 [19:52:05<64:06:10,  7.91s/it]
 23%|██▎       | 8794/37963 [19:52:13<64:07:04,  7.91s/it]
 23%|██▎       | 8795/37963 [19:52:21<63:42:47,  7.86s/it]
 23%|██▎       | 8796/37963 [19:52:28<63:17:26,  7.81s/it]
 23%|██▎       | 8797/37963 [19:52:36<63:13:04,  7.80s/it]
 23%|██▎       | 8798/37963 [19:52:44<62:43:53,  7.74s/it]
 23%|██▎       | 8799/37963 [19:52:51<62:36:49,  7.73s/it]
 23%|██▎       | 8800/37963 [19:53:02<68:52:11,  8.50s/it]
                                                          
{'loss': '0.1687', 'grad_norm': '3.138', 'learning_rate': '1.794e-05', 'epoch': '0.2318'}
+
 23%|██▎       | 8800/37963 [19:53:02<68:52:11,  8.50s/it]
 23%|██▎       | 8801/37963 [19:53:09<67:02:10,  8.28s/it]
 23%|██▎       | 8802/37963 [19:53:17<65:26:16,  8.08s/it]
 23%|██▎       | 8803/37963 [19:53:25<64:23:54,  7.95s/it]
 23%|██▎       | 8804/37963 [19:53:32<63:41:26,  7.86s/it]
 23%|██▎       | 8805/37963 [19:53:40<63:04:21,  7.79s/it]
 23%|██▎       | 8806/37963 [19:53:47<62:15:46,  7.69s/it]
 23%|██▎       | 8807/37963 [19:53:55<62:11:59,  7.68s/it]
 23%|██▎       | 8808/37963 [19:54:03<61:53:48,  7.64s/it]
 23%|██▎       | 8809/37963 [19:54:10<62:17:09,  7.69s/it]
 23%|██▎       | 8810/37963 [19:54:18<62:05:59,  7.67s/it]
                                                          
{'loss': '0.2005', 'grad_norm': '4.938', 'learning_rate': '1.793e-05', 'epoch': '0.2321'}
+
 23%|██▎       | 8810/37963 [19:54:18<62:05:59,  7.67s/it]
 23%|██▎       | 8811/37963 [19:54:26<62:05:12,  7.67s/it]
 23%|██▎       | 8812/37963 [19:54:34<63:28:53,  7.84s/it]
 23%|██▎       | 8813/37963 [19:54:42<62:52:27,  7.76s/it]
 23%|██▎       | 8814/37963 [19:54:52<68:20:41,  8.44s/it]
 23%|██▎       | 8815/37963 [19:54:59<66:51:40,  8.26s/it]
 23%|██▎       | 8816/37963 [19:55:10<72:01:45,  8.90s/it]
 23%|██▎       | 8817/37963 [19:55:18<69:18:17,  8.56s/it]
 23%|██▎       | 8818/37963 [19:55:25<67:05:11,  8.29s/it]
 23%|██▎       | 8819/37963 [19:55:33<65:50:03,  8.13s/it]
 23%|██▎       | 8820/37963 [19:55:41<65:27:08,  8.09s/it]
                                                          
{'loss': '0.1709', 'grad_norm': '1.147', 'learning_rate': '1.793e-05', 'epoch': '0.2323'}
+
 23%|██▎       | 8820/37963 [19:55:41<65:27:08,  8.09s/it]
 23%|██▎       | 8821/37963 [19:55:49<64:33:52,  7.98s/it]
 23%|██▎       | 8822/37963 [19:55:59<70:05:55,  8.66s/it]
 23%|██▎       | 8823/37963 [19:56:12<80:07:42,  9.90s/it]
 23%|██▎       | 8824/37963 [19:56:20<75:37:40,  9.34s/it]
 23%|██▎       | 8825/37963 [19:56:28<71:39:50,  8.85s/it]
 23%|██▎       | 8826/37963 [19:56:35<69:24:26,  8.58s/it]
 23%|██▎       | 8827/37963 [19:56:43<66:44:14,  8.25s/it]
 23%|██▎       | 8828/37963 [19:56:51<65:31:13,  8.10s/it]
 23%|██▎       | 8829/37963 [19:57:01<70:24:32,  8.70s/it]
 23%|██▎       | 8830/37963 [19:57:08<67:54:49,  8.39s/it]
                                                          
{'loss': '0.1643', 'grad_norm': '2.329', 'learning_rate': '1.792e-05', 'epoch': '0.2326'}
+
 23%|██▎       | 8830/37963 [19:57:08<67:54:49,  8.39s/it]
 23%|██▎       | 8831/37963 [19:57:16<65:46:46,  8.13s/it]
 23%|██▎       | 8832/37963 [19:57:24<65:02:59,  8.04s/it]
 23%|██▎       | 8833/37963 [19:57:32<64:47:33,  8.01s/it]
 23%|██▎       | 8834/37963 [19:57:40<64:17:57,  7.95s/it]
 23%|██▎       | 8835/37963 [19:57:47<64:01:48,  7.91s/it]
 23%|██▎       | 8836/37963 [19:57:55<63:02:28,  7.79s/it]
 23%|██▎       | 8837/37963 [19:58:03<62:58:32,  7.78s/it]
 23%|██▎       | 8838/37963 [19:58:10<62:05:13,  7.67s/it]
 23%|██▎       | 8839/37963 [19:58:18<61:59:16,  7.66s/it]
 23%|██▎       | 8840/37963 [19:58:25<61:55:46,  7.66s/it]
                                                          
{'loss': '0.1704', 'grad_norm': '7.317', 'learning_rate': '1.792e-05', 'epoch': '0.2329'}
+
 23%|██▎       | 8840/37963 [19:58:25<61:55:46,  7.66s/it]
 23%|██▎       | 8841/37963 [19:58:33<61:53:21,  7.65s/it]
 23%|██▎       | 8842/37963 [19:58:43<68:19:47,  8.45s/it]
 23%|██▎       | 8843/37963 [19:58:51<66:17:11,  8.19s/it]
 23%|██▎       | 8844/37963 [19:58:59<65:12:47,  8.06s/it]
 23%|██▎       | 8845/37963 [19:59:06<64:20:05,  7.95s/it]
 23%|██▎       | 8846/37963 [19:59:14<63:32:17,  7.86s/it]
 23%|██▎       | 8847/37963 [19:59:22<62:45:27,  7.76s/it]
 23%|██▎       | 8848/37963 [19:59:29<63:00:32,  7.79s/it]
 23%|██▎       | 8849/37963 [19:59:37<63:23:36,  7.84s/it]
 23%|██▎       | 8850/37963 [19:59:45<63:43:24,  7.88s/it]
                                                          
{'loss': '0.1733', 'grad_norm': '1.222', 'learning_rate': '1.791e-05', 'epoch': '0.2331'}
+
 23%|██▎       | 8850/37963 [19:59:45<63:43:24,  7.88s/it]
 23%|██▎       | 8851/37963 [19:59:53<63:05:40,  7.80s/it]
 23%|██▎       | 8852/37963 [20:00:01<63:13:46,  7.82s/it]
 23%|██▎       | 8853/37963 [20:00:09<63:44:29,  7.88s/it]
 23%|██▎       | 8854/37963 [20:00:19<69:56:18,  8.65s/it]
 23%|██▎       | 8855/37963 [20:00:27<67:29:48,  8.35s/it]
 23%|██▎       | 8856/37963 [20:00:35<66:03:32,  8.17s/it]
 23%|██▎       | 8857/37963 [20:00:42<64:53:05,  8.03s/it]
 23%|██▎       | 8858/37963 [20:00:50<63:59:42,  7.92s/it]
 23%|██▎       | 8859/37963 [20:00:58<63:33:20,  7.86s/it]
 23%|██▎       | 8860/37963 [20:01:08<69:35:31,  8.61s/it]
                                                          
{'loss': '0.1788', 'grad_norm': '4.459', 'learning_rate': '1.791e-05', 'epoch': '0.2334'}
+
 23%|██▎       | 8860/37963 [20:01:08<69:35:31,  8.61s/it]
 23%|██▎       | 8861/37963 [20:01:16<67:05:55,  8.30s/it]
 23%|██▎       | 8862/37963 [20:01:23<65:36:19,  8.12s/it]
 23%|██▎       | 8863/37963 [20:01:34<71:18:55,  8.82s/it]
 23%|██▎       | 8864/37963 [20:01:42<69:09:45,  8.56s/it]
 23%|██▎       | 8865/37963 [20:01:50<67:17:51,  8.33s/it]
 23%|██▎       | 8866/37963 [20:01:59<71:06:17,  8.80s/it]
 23%|██▎       | 8867/37963 [20:02:08<69:20:15,  8.58s/it]
 23%|██▎       | 8868/37963 [20:02:15<67:01:45,  8.29s/it]
 23%|██▎       | 8869/37963 [20:02:23<66:04:33,  8.18s/it]
 23%|██▎       | 8870/37963 [20:02:31<65:09:32,  8.06s/it]
                                                          
{'loss': '0.1716', 'grad_norm': '2.184', 'learning_rate': '1.79e-05', 'epoch': '0.2336'}
+
 23%|██▎       | 8870/37963 [20:02:31<65:09:32,  8.06s/it]
 23%|██▎       | 8871/37963 [20:02:41<70:39:42,  8.74s/it]
 23%|██▎       | 8872/37963 [20:02:49<67:39:16,  8.37s/it]
 23%|██▎       | 8873/37963 [20:02:56<65:54:40,  8.16s/it]
 23%|██▎       | 8874/37963 [20:03:06<70:32:08,  8.73s/it]
 23%|██▎       | 8875/37963 [20:03:14<68:45:31,  8.51s/it]
 23%|██▎       | 8876/37963 [20:03:25<73:40:36,  9.12s/it]
 23%|██▎       | 8877/37963 [20:03:33<71:00:49,  8.79s/it]
 23%|██▎       | 8878/37963 [20:03:41<68:34:17,  8.49s/it]
 23%|██▎       | 8879/37963 [20:03:48<66:48:11,  8.27s/it]
 23%|██▎       | 8880/37963 [20:03:56<64:58:59,  8.04s/it]
                                                          
{'loss': '0.1743', 'grad_norm': '4.039', 'learning_rate': '1.79e-05', 'epoch': '0.2339'}
+
 23%|██▎       | 8880/37963 [20:03:56<64:58:59,  8.04s/it]
 23%|██▎       | 8881/37963 [20:04:04<64:58:41,  8.04s/it]
 23%|██▎       | 8882/37963 [20:04:12<63:40:25,  7.88s/it]
 23%|██▎       | 8883/37963 [20:04:19<63:16:37,  7.83s/it]
 23%|██▎       | 8884/37963 [20:04:27<62:34:22,  7.75s/it]
 23%|██▎       | 8885/37963 [20:04:35<62:43:27,  7.77s/it]
 23%|██▎       | 8886/37963 [20:04:42<61:29:40,  7.61s/it]
 23%|██▎       | 8887/37963 [20:04:49<61:26:01,  7.61s/it]
 23%|██▎       | 8888/37963 [20:04:57<61:56:51,  7.67s/it]
 23%|██▎       | 8889/37963 [20:05:05<61:48:49,  7.65s/it]
 23%|██▎       | 8890/37963 [20:05:12<61:36:38,  7.63s/it]
                                                          
{'loss': '0.159', 'grad_norm': '5.854', 'learning_rate': '1.789e-05', 'epoch': '0.2342'}
+
 23%|██▎       | 8890/37963 [20:05:12<61:36:38,  7.63s/it]
 23%|██▎       | 8891/37963 [20:05:20<61:24:15,  7.60s/it]
 23%|██▎       | 8892/37963 [20:05:28<61:25:41,  7.61s/it]
 23%|██▎       | 8893/37963 [20:05:35<60:25:38,  7.48s/it]
 23%|██▎       | 8894/37963 [20:05:42<60:20:25,  7.47s/it]
 23%|██▎       | 8895/37963 [20:05:50<60:44:55,  7.52s/it]
 23%|██▎       | 8896/37963 [20:06:00<67:14:10,  8.33s/it]
 23%|██▎       | 8897/37963 [20:06:08<65:50:03,  8.15s/it]
 23%|██▎       | 8898/37963 [20:06:18<70:48:42,  8.77s/it]
 23%|██▎       | 8899/37963 [20:06:26<68:49:26,  8.52s/it]
 23%|██▎       | 8900/37963 [20:06:34<66:47:42,  8.27s/it]
                                                          
{'loss': '0.1835', 'grad_norm': '2.721', 'learning_rate': '1.789e-05', 'epoch': '0.2344'}
+
 23%|██▎       | 8900/37963 [20:06:34<66:47:42,  8.27s/it]
 23%|██▎       | 8901/37963 [20:06:41<65:24:54,  8.10s/it]
 23%|██▎       | 8902/37963 [20:06:49<64:20:17,  7.97s/it]
 23%|██▎       | 8903/37963 [20:06:57<63:42:14,  7.89s/it]
 23%|██▎       | 8904/37963 [20:07:05<63:27:15,  7.86s/it]
 23%|██▎       | 8905/37963 [20:07:12<63:04:06,  7.81s/it]
 23%|██▎       | 8906/37963 [20:07:20<63:03:15,  7.81s/it]
 23%|██▎       | 8907/37963 [20:07:28<62:43:31,  7.77s/it]
 23%|██▎       | 8908/37963 [20:07:36<62:54:40,  7.79s/it]
 23%|██▎       | 8909/37963 [20:07:43<62:36:38,  7.76s/it]
 23%|██▎       | 8910/37963 [20:07:54<69:06:34,  8.56s/it]
                                                          
{'loss': '0.1768', 'grad_norm': '4.438', 'learning_rate': '1.788e-05', 'epoch': '0.2347'}
+
 23%|██▎       | 8910/37963 [20:07:54<69:06:34,  8.56s/it]
 23%|██▎       | 8911/37963 [20:08:04<73:02:49,  9.05s/it]
 23%|██▎       | 8912/37963 [20:08:12<69:46:48,  8.65s/it]
 23%|██▎       | 8913/37963 [20:08:20<67:52:26,  8.41s/it]
 23%|██▎       | 8914/37963 [20:08:33<79:07:07,  9.81s/it]
 23%|██▎       | 8915/37963 [20:08:41<74:37:30,  9.25s/it]
 23%|██▎       | 8916/37963 [20:08:48<71:05:16,  8.81s/it]
 23%|██▎       | 8917/37963 [20:08:56<67:41:12,  8.39s/it]
 23%|██▎       | 8918/37963 [20:09:03<66:01:09,  8.18s/it]
 23%|██▎       | 8919/37963 [20:09:14<71:18:36,  8.84s/it]
 23%|██▎       | 8920/37963 [20:09:24<75:08:13,  9.31s/it]
                                                          
{'loss': '0.1675', 'grad_norm': '2.833', 'learning_rate': '1.788e-05', 'epoch': '0.235'}
+
 23%|██▎       | 8920/37963 [20:09:24<75:08:13,  9.31s/it]
 23%|██▎       | 8921/37963 [20:09:32<71:44:37,  8.89s/it]
 24%|██▎       | 8922/37963 [20:09:40<69:17:26,  8.59s/it]
 24%|██▎       | 8923/37963 [20:09:48<67:24:17,  8.36s/it]
 24%|██▎       | 8924/37963 [20:09:55<64:58:22,  8.05s/it]
 24%|██▎       | 8925/37963 [20:10:02<63:09:02,  7.83s/it]
 24%|██▎       | 8926/37963 [20:10:10<62:39:05,  7.77s/it]
 24%|██▎       | 8927/37963 [20:10:18<61:58:52,  7.68s/it]
 24%|██▎       | 8928/37963 [20:10:25<62:27:13,  7.74s/it]
 24%|██▎       | 8929/37963 [20:10:33<62:30:56,  7.75s/it]
 24%|██▎       | 8930/37963 [20:10:41<62:11:22,  7.71s/it]
                                                          
{'loss': '0.1683', 'grad_norm': '1.989', 'learning_rate': '1.787e-05', 'epoch': '0.2352'}
+
 24%|██▎       | 8930/37963 [20:10:41<62:11:22,  7.71s/it]
 24%|██▎       | 8931/37963 [20:10:49<62:29:25,  7.75s/it]
 24%|██▎       | 8932/37963 [20:10:56<62:36:35,  7.76s/it]
 24%|██▎       | 8933/37963 [20:11:04<62:54:37,  7.80s/it]
 24%|██▎       | 8934/37963 [20:11:12<61:33:20,  7.63s/it]
 24%|██▎       | 8935/37963 [20:11:19<61:48:47,  7.67s/it]
 24%|██▎       | 8936/37963 [20:11:27<61:37:49,  7.64s/it]
 24%|██▎       | 8937/37963 [20:11:35<61:44:39,  7.66s/it]
 24%|██▎       | 8938/37963 [20:11:42<60:55:33,  7.56s/it]
 24%|██▎       | 8939/37963 [20:11:49<60:49:14,  7.54s/it]
 24%|██▎       | 8940/37963 [20:12:00<67:28:53,  8.37s/it]
                                                          
{'loss': '0.1649', 'grad_norm': '6.181', 'learning_rate': '1.787e-05', 'epoch': '0.2355'}
+
 24%|██▎       | 8940/37963 [20:12:00<67:28:53,  8.37s/it]
 24%|██▎       | 8941/37963 [20:12:07<65:54:06,  8.17s/it]
 24%|██▎       | 8942/37963 [20:12:15<64:07:30,  7.95s/it]
 24%|██▎       | 8943/37963 [20:12:23<63:39:54,  7.90s/it]
 24%|██▎       | 8944/37963 [20:12:30<62:53:21,  7.80s/it]
 24%|██▎       | 8945/37963 [20:12:38<63:05:46,  7.83s/it]
 24%|██▎       | 8946/37963 [20:12:46<62:13:21,  7.72s/it]
 24%|██▎       | 8947/37963 [20:12:53<62:10:42,  7.71s/it]
 24%|██▎       | 8948/37963 [20:13:01<61:53:28,  7.68s/it]
 24%|██▎       | 8949/37963 [20:13:09<62:04:44,  7.70s/it]
 24%|██▎       | 8950/37963 [20:13:16<60:45:48,  7.54s/it]
                                                          
{'loss': '0.1864', 'grad_norm': '2.099', 'learning_rate': '1.786e-05', 'epoch': '0.2358'}
+
 24%|██▎       | 8950/37963 [20:13:16<60:45:48,  7.54s/it]
 24%|██▎       | 8951/37963 [20:13:24<61:34:17,  7.64s/it]
 24%|██▎       | 8952/37963 [20:13:34<67:22:11,  8.36s/it]
 24%|██▎       | 8953/37963 [20:13:42<66:18:16,  8.23s/it]
 24%|██▎       | 8954/37963 [20:13:49<64:54:11,  8.05s/it]
 24%|██▎       | 8955/37963 [20:14:00<70:36:14,  8.76s/it]
 24%|██▎       | 8956/37963 [20:14:08<68:25:21,  8.49s/it]
 24%|██▎       | 8957/37963 [20:14:15<66:15:04,  8.22s/it]
 24%|██▎       | 8958/37963 [20:14:23<64:49:18,  8.05s/it]
 24%|██▎       | 8959/37963 [20:14:33<69:59:41,  8.69s/it]
 24%|██▎       | 8960/37963 [20:14:41<68:27:07,  8.50s/it]
                                                          
{'loss': '0.1619', 'grad_norm': '2.335', 'learning_rate': '1.786e-05', 'epoch': '0.236'}
+
 24%|██▎       | 8960/37963 [20:14:41<68:27:07,  8.50s/it]
 24%|��█▎       | 8961/37963 [20:14:49<66:01:21,  8.20s/it]
 24%|██▎       | 8962/37963 [20:14:59<70:59:01,  8.81s/it]
 24%|██▎       | 8963/37963 [20:15:09<75:22:08,  9.36s/it]
 24%|██▎       | 8964/37963 [20:15:17<71:01:45,  8.82s/it]
 24%|██▎       | 8965/37963 [20:15:25<68:43:24,  8.53s/it]
 24%|██▎       | 8966/37963 [20:15:33<66:44:36,  8.29s/it]
 24%|██▎       | 8967/37963 [20:15:40<65:05:20,  8.08s/it]
 24%|██▎       | 8968/37963 [20:15:50<69:25:13,  8.62s/it]
 24%|██▎       | 8969/37963 [20:15:58<67:38:26,  8.40s/it]
 24%|██▎       | 8970/37963 [20:16:06<65:59:41,  8.19s/it]
                                                          
{'loss': '0.1784', 'grad_norm': '2.879', 'learning_rate': '1.785e-05', 'epoch': '0.2363'}
+
 24%|██▎       | 8970/37963 [20:16:06<65:59:41,  8.19s/it]
 24%|██▎       | 8971/37963 [20:16:13<64:43:49,  8.04s/it]
 24%|██▎       | 8972/37963 [20:16:21<63:37:12,  7.90s/it]
 24%|██▎       | 8973/37963 [20:16:29<63:02:48,  7.83s/it]
 24%|██▎       | 8974/37963 [20:16:36<62:58:47,  7.82s/it]
 24%|██▎       | 8975/37963 [20:16:44<62:49:28,  7.80s/it]
 24%|██▎       | 8976/37963 [20:16:52<62:19:20,  7.74s/it]
 24%|██▎       | 8977/37963 [20:16:59<61:32:45,  7.64s/it]
 24%|██▎       | 8978/37963 [20:17:07<61:27:57,  7.63s/it]
 24%|██▎       | 8979/37963 [20:17:15<61:50:39,  7.68s/it]
 24%|██▎       | 8980/37963 [20:17:22<62:04:19,  7.71s/it]
                                                          
{'loss': '0.19', 'grad_norm': '4.385', 'learning_rate': '1.785e-05', 'epoch': '0.2365'}
+
 24%|██▎       | 8980/37963 [20:17:22<62:04:19,  7.71s/it]
 24%|██▎       | 8981/37963 [20:17:30<62:12:12,  7.73s/it]
 24%|██▎       | 8982/37963 [20:17:38<62:01:45,  7.71s/it]
 24%|██▎       | 8983/37963 [20:17:46<62:24:25,  7.75s/it]
 24%|██▎       | 8984/37963 [20:17:56<68:20:16,  8.49s/it]
 24%|██▎       | 8985/37963 [20:18:03<66:21:40,  8.24s/it]
 24%|██▎       | 8986/37963 [20:18:11<64:55:27,  8.07s/it]
 24%|██▎       | 8987/37963 [20:18:18<62:44:57,  7.80s/it]
 24%|██▎       | 8988/37963 [20:18:26<62:32:48,  7.77s/it]
 24%|██▎       | 8989/37963 [20:18:34<62:13:14,  7.73s/it]
 24%|██▎       | 8990/37963 [20:18:41<61:52:32,  7.69s/it]
                                                          
{'loss': '0.1696', 'grad_norm': '2.506', 'learning_rate': '1.784e-05', 'epoch': '0.2368'}
+
 24%|██▎       | 8990/37963 [20:18:41<61:52:32,  7.69s/it]
 24%|██▎       | 8991/37963 [20:18:48<60:49:13,  7.56s/it]
 24%|██▎       | 8992/37963 [20:18:56<60:42:57,  7.54s/it]
 24%|██▎       | 8993/37963 [20:19:04<60:41:07,  7.54s/it]
 24%|██▎       | 8994/37963 [20:19:11<61:04:51,  7.59s/it]
 24%|██▎       | 8995/37963 [20:19:19<61:03:04,  7.59s/it]
 24%|██▎       | 8996/37963 [20:19:26<60:45:07,  7.55s/it]
 24%|██▎       | 8997/37963 [20:19:34<61:08:40,  7.60s/it]
 24%|██▎       | 8998/37963 [20:19:44<66:56:24,  8.32s/it]
 24%|██▎       | 8999/37963 [20:19:52<65:47:27,  8.18s/it]
 24%|██▎       | 9000/37963 [20:20:00<64:37:37,  8.03s/it]
                                                          
{'loss': '0.1696', 'grad_norm': '5.674', 'learning_rate': '1.783e-05', 'epoch': '0.2371'}
+
 24%|██▎       | 9000/37963 [20:20:00<64:37:37,  8.03s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.82s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.82s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 24%|██▎       | 9001/37963 [20:21:00<190:47:06, 23.71s/it]
 24%|██▎       | 9002/37963 [20:21:08<152:40:37, 18.98s/it]
 24%|██▎       | 9003/37963 [20:21:18<131:35:59, 16.36s/it]
 24%|██▎       | 9004/37963 [20:21:26<110:46:24, 13.77s/it]
 24%|██▎       | 9005/37963 [20:21:36<102:07:01, 12.69s/it]
 24%|██▎       | 9006/37963 [20:21:44<90:20:41, 11.23s/it] 
 24%|██▎       | 9007/37963 [20:21:51<81:33:06, 10.14s/it]
 24%|██▎       | 9008/37963 [20:21:59<74:43:09,  9.29s/it]
 24%|██▎       | 9009/37963 [20:22:09<76:46:02,  9.54s/it]
 24%|██▎       | 9010/37963 [20:22:19<79:07:23,  9.84s/it]
                                                          
{'loss': '0.1812', 'grad_norm': '0.8849', 'learning_rate': '1.783e-05', 'epoch': '0.2373'}
+
 24%|██▎       | 9010/37963 [20:22:19<79:07:23,  9.84s/it]
 24%|██▎       | 9011/37963 [20:22:27<73:48:50,  9.18s/it]
 24%|██▎       | 9012/37963 [20:22:34<69:35:24,  8.65s/it]
 24%|██▎       | 9013/37963 [20:22:42<67:25:56,  8.39s/it]
 24%|██▎       | 9014/37963 [20:22:50<65:02:26,  8.09s/it]
 24%|██▎       | 9015/37963 [20:23:00<70:27:03,  8.76s/it]
 24%|██▎       | 9016/37963 [20:23:08<68:27:46,  8.51s/it]
 24%|██▍       | 9017/37963 [20:23:16<66:43:50,  8.30s/it]
 24%|██▍       | 9018/37963 [20:23:23<65:25:08,  8.14s/it]
 24%|██▍       | 9019/37963 [20:23:31<63:50:54,  7.94s/it]
 24%|██▍       | 9020/37963 [20:23:41<69:23:41,  8.63s/it]
                                                          
{'loss': '0.1794', 'grad_norm': '2.502', 'learning_rate': '1.782e-05', 'epoch': '0.2376'}
+
 24%|██▍       | 9020/37963 [20:23:41<69:23:41,  8.63s/it]
 24%|██▍       | 9021/37963 [20:23:49<67:20:50,  8.38s/it]
 24%|██▍       | 9022/37963 [20:23:56<64:48:51,  8.06s/it]
 24%|██▍       | 9023/37963 [20:24:04<63:50:38,  7.94s/it]
 24%|██▍       | 9024/37963 [20:24:12<63:30:04,  7.90s/it]
 24%|██▍       | 9025/37963 [20:24:19<63:09:51,  7.86s/it]
 24%|██▍       | 9026/37963 [20:24:27<62:13:42,  7.74s/it]
 24%|██▍       | 9027/37963 [20:24:35<61:58:09,  7.71s/it]
 24%|██▍       | 9028/37963 [20:24:45<67:46:57,  8.43s/it]
 24%|██▍       | 9029/37963 [20:24:52<66:19:19,  8.25s/it]
 24%|██▍       | 9030/37963 [20:25:00<64:59:11,  8.09s/it]
                                                          
{'loss': '0.1826', 'grad_norm': '4.979', 'learning_rate': '1.782e-05', 'epoch': '0.2379'}
+
 24%|██▍       | 9030/37963 [20:25:00<64:59:11,  8.09s/it]
 24%|██▍       | 9031/37963 [20:25:08<63:53:33,  7.95s/it]
 24%|██▍       | 9032/37963 [20:25:16<63:40:32,  7.92s/it]
 24%|██▍       | 9033/37963 [20:25:24<63:48:19,  7.94s/it]
 24%|██▍       | 9034/37963 [20:25:31<63:29:36,  7.90s/it]
 24%|██▍       | 9035/37963 [20:25:39<63:13:12,  7.87s/it]
 24%|██▍       | 9036/37963 [20:25:47<61:54:56,  7.71s/it]
 24%|██▍       | 9037/37963 [20:25:54<61:41:12,  7.68s/it]
 24%|██▍       | 9038/37963 [20:26:02<61:43:40,  7.68s/it]
 24%|██▍       | 9039/37963 [20:26:10<61:41:52,  7.68s/it]
 24%|██▍       | 9040/37963 [20:26:17<61:55:49,  7.71s/it]
                                                          
{'loss': '0.1467', 'grad_norm': '1.752', 'learning_rate': '1.781e-05', 'epoch': '0.2381'}
+
 24%|██▍       | 9040/37963 [20:26:17<61:55:49,  7.71s/it]
 24%|██▍       | 9041/37963 [20:26:25<61:10:28,  7.61s/it]
 24%|██▍       | 9042/37963 [20:26:32<60:42:05,  7.56s/it]
 24%|██▍       | 9043/37963 [20:26:40<60:39:56,  7.55s/it]
 24%|██▍       | 9044/37963 [20:26:48<61:20:09,  7.64s/it]
 24%|██▍       | 9045/37963 [20:26:55<61:10:20,  7.62s/it]
 24%|██▍       | 9046/37963 [20:27:03<61:29:06,  7.65s/it]
 24%|██▍       | 9047/37963 [20:27:11<62:10:11,  7.74s/it]
 24%|██▍       | 9048/37963 [20:27:18<62:04:22,  7.73s/it]
 24%|██▍       | 9049/37963 [20:27:26<61:12:45,  7.62s/it]
 24%|██▍       | 9050/37963 [20:27:34<61:37:59,  7.67s/it]
                                                          
{'loss': '0.1749', 'grad_norm': '2.302', 'learning_rate': '1.781e-05', 'epoch': '0.2384'}
+
 24%|██▍       | 9050/37963 [20:27:34<61:37:59,  7.67s/it]
 24%|██▍       | 9051/37963 [20:27:41<61:49:05,  7.70s/it]
 24%|██▍       | 9052/37963 [20:27:52<67:38:26,  8.42s/it]
 24%|██▍       | 9053/37963 [20:27:59<65:16:52,  8.13s/it]
 24%|██▍       | 9054/37963 [20:28:07<64:37:10,  8.05s/it]
 24%|██▍       | 9055/37963 [20:28:15<64:02:15,  7.97s/it]
 24%|██▍       | 9056/37963 [20:28:22<63:40:17,  7.93s/it]
 24%|██▍       | 9057/37963 [20:28:33<69:05:46,  8.61s/it]
 24%|██▍       | 9058/37963 [20:28:40<67:19:29,  8.39s/it]
 24%|██▍       | 9059/37963 [20:28:51<71:19:08,  8.88s/it]
 24%|██▍       | 9060/37963 [20:28:58<69:04:35,  8.60s/it]
                                                          
{'loss': '0.168', 'grad_norm': '1.591', 'learning_rate': '1.78e-05', 'epoch': '0.2387'}
+
 24%|██▍       | 9060/37963 [20:28:58<69:04:35,  8.60s/it]
 24%|██▍       | 9061/37963 [20:29:09<73:21:27,  9.14s/it]
 24%|██▍       | 9062/37963 [20:29:16<69:40:11,  8.68s/it]
 24%|██▍       | 9063/37963 [20:29:27<73:06:23,  9.11s/it]
 24%|██▍       | 9064/37963 [20:29:34<69:40:45,  8.68s/it]
 24%|██▍       | 9065/37963 [20:29:42<67:20:55,  8.39s/it]
 24%|██▍       | 9066/37963 [20:29:50<65:43:59,  8.19s/it]
 24%|██▍       | 9067/37963 [20:29:57<64:26:24,  8.03s/it]
 24%|██▍       | 9068/37963 [20:30:08<70:39:29,  8.80s/it]
 24%|██▍       | 9069/37963 [20:30:15<67:22:53,  8.40s/it]
 24%|██▍       | 9070/37963 [20:30:23<65:45:53,  8.19s/it]
                                                          
{'loss': '0.1781', 'grad_norm': '2.955', 'learning_rate': '1.78e-05', 'epoch': '0.2389'}
+
 24%|██▍       | 9070/37963 [20:30:23<65:45:53,  8.19s/it]
 24%|██▍       | 9071/37963 [20:30:31<64:57:44,  8.09s/it]
 24%|██▍       | 9072/37963 [20:30:42<70:48:37,  8.82s/it]
 24%|██▍       | 9073/37963 [20:30:49<68:17:12,  8.51s/it]
 24%|██▍       | 9074/37963 [20:30:57<65:29:46,  8.16s/it]
 24%|██▍       | 9075/37963 [20:31:04<64:06:07,  7.99s/it]
 24%|██▍       | 9076/37963 [20:31:12<63:25:40,  7.90s/it]
 24%|██▍       | 9077/37963 [20:31:19<62:00:11,  7.73s/it]
 24%|██▍       | 9078/37963 [20:31:27<62:15:12,  7.76s/it]
 24%|██▍       | 9079/37963 [20:31:35<62:30:16,  7.79s/it]
 24%|██▍       | 9080/37963 [20:31:43<62:32:16,  7.79s/it]
                                                          
{'loss': '0.1715', 'grad_norm': '2.896', 'learning_rate': '1.779e-05', 'epoch': '0.2392'}
+
 24%|██▍       | 9080/37963 [20:31:43<62:32:16,  7.79s/it]
 24%|██▍       | 9081/37963 [20:31:50<61:46:56,  7.70s/it]
 24%|██▍       | 9082/37963 [20:31:58<61:27:23,  7.66s/it]
 24%|██▍       | 9083/37963 [20:32:05<61:27:50,  7.66s/it]
 24%|██▍       | 9084/37963 [20:32:13<61:36:03,  7.68s/it]
 24%|██▍       | 9085/37963 [20:32:21<61:33:08,  7.67s/it]
 24%|██▍       | 9086/37963 [20:32:29<61:40:49,  7.69s/it]
 24%|██▍       | 9087/37963 [20:32:36<61:35:37,  7.68s/it]
 24%|██▍       | 9088/37963 [20:32:44<61:58:02,  7.73s/it]
 24%|██▍       | 9089/37963 [20:32:52<61:59:44,  7.73s/it]
 24%|██▍       | 9090/37963 [20:32:59<61:16:30,  7.64s/it]
                                                          
{'loss': '0.177', 'grad_norm': '1.571', 'learning_rate': '1.779e-05', 'epoch': '0.2394'}
+
 24%|██▍       | 9090/37963 [20:32:59<61:16:30,  7.64s/it]
 24%|██▍       | 9091/37963 [20:33:07<60:35:41,  7.56s/it]
 24%|██▍       | 9092/37963 [20:33:14<61:08:05,  7.62s/it]
 24%|██▍       | 9093/37963 [20:33:22<61:30:38,  7.67s/it]
 24%|██▍       | 9094/37963 [20:33:30<61:36:21,  7.68s/it]
 24%|██▍       | 9095/37963 [20:33:38<61:51:20,  7.71s/it]
 24%|██▍       | 9096/37963 [20:33:45<61:26:31,  7.66s/it]
 24%|██▍       | 9097/37963 [20:33:53<61:36:02,  7.68s/it]
 24%|██▍       | 9098/37963 [20:34:01<61:30:04,  7.67s/it]
 24%|██▍       | 9099/37963 [20:34:08<62:07:14,  7.75s/it]
 24%|██▍       | 9100/37963 [20:34:16<62:17:15,  7.77s/it]
                                                          
{'loss': '0.1743', 'grad_norm': '2.701', 'learning_rate': '1.778e-05', 'epoch': '0.2397'}
+
 24%|██▍       | 9100/37963 [20:34:16<62:17:15,  7.77s/it]
 24%|██▍       | 9101/37963 [20:34:24<62:03:25,  7.74s/it]
 24%|██▍       | 9102/37963 [20:34:32<61:57:53,  7.73s/it]
 24%|██▍       | 9103/37963 [20:34:42<68:07:41,  8.50s/it]
 24%|██▍       | 9104/37963 [20:34:50<66:13:32,  8.26s/it]
 24%|██▍       | 9105/37963 [20:34:59<69:51:55,  8.72s/it]
 24%|██▍       | 9106/37963 [20:35:10<73:54:23,  9.22s/it]
 24%|██▍       | 9107/37963 [20:35:18<70:48:01,  8.83s/it]
 24%|██▍       | 9108/37963 [20:35:25<67:50:00,  8.46s/it]
 24%|██▍       | 9109/37963 [20:35:33<65:17:05,  8.15s/it]
 24%|██▍       | 9110/37963 [20:35:41<64:21:32,  8.03s/it]
                                                          
{'loss': '0.168', 'grad_norm': '1.01', 'learning_rate': '1.778e-05', 'epoch': '0.24'}
+
 24%|██▍       | 9110/37963 [20:35:41<64:21:32,  8.03s/it]
 24%|██▍       | 9111/37963 [20:35:51<70:26:57,  8.79s/it]
 24%|██▍       | 9112/37963 [20:35:59<68:16:55,  8.52s/it]
 24%|██▍       | 9113/37963 [20:36:07<66:01:23,  8.24s/it]
 24%|██▍       | 9114/37963 [20:36:14<64:29:17,  8.05s/it]
 24%|██▍       | 9115/37963 [20:36:27<76:35:41,  9.56s/it]
 24%|██▍       | 9116/37963 [20:36:38<78:25:14,  9.79s/it]
 24%|██▍       | 9117/37963 [20:36:45<73:05:32,  9.12s/it]
 24%|██▍       | 9118/37963 [20:36:53<68:55:42,  8.60s/it]
 24%|██▍       | 9119/37963 [20:37:00<66:13:53,  8.27s/it]
 24%|██▍       | 9120/37963 [20:37:08<64:58:16,  8.11s/it]
                                                          
{'loss': '0.1486', 'grad_norm': '2.062', 'learning_rate': '1.777e-05', 'epoch': '0.2402'}
+
 24%|██▍       | 9120/37963 [20:37:08<64:58:16,  8.11s/it]
 24%|██▍       | 9121/37963 [20:37:16<64:37:26,  8.07s/it]
 24%|██▍       | 9122/37963 [20:37:24<64:04:13,  8.00s/it]
 24%|██▍       | 9123/37963 [20:37:31<63:51:34,  7.97s/it]
 24%|██▍       | 9124/37963 [20:37:39<63:04:51,  7.87s/it]
 24%|██▍       | 9125/37963 [20:37:46<61:25:56,  7.67s/it]
 24%|██▍       | 9126/37963 [20:37:54<61:32:13,  7.68s/it]
 24%|██▍       | 9127/37963 [20:38:01<60:56:15,  7.61s/it]
 24%|██▍       | 9128/37963 [20:38:09<61:23:17,  7.66s/it]
 24%|██▍       | 9129/37963 [20:38:17<61:14:21,  7.65s/it]
 24%|██▍       | 9130/37963 [20:38:25<61:34:49,  7.69s/it]
                                                          
{'loss': '0.1715', 'grad_norm': '5.356', 'learning_rate': '1.777e-05', 'epoch': '0.2405'}
+
 24%|██▍       | 9130/37963 [20:38:25<61:34:49,  7.69s/it]
 24%|██▍       | 9131/37963 [20:38:32<61:34:31,  7.69s/it]
 24%|██▍       | 9132/37963 [20:38:40<61:49:37,  7.72s/it]
 24%|██▍       | 9133/37963 [20:38:48<62:05:54,  7.75s/it]
 24%|██▍       | 9134/37963 [20:38:56<61:55:42,  7.73s/it]
 24%|██▍       | 9135/37963 [20:39:03<61:22:38,  7.66s/it]
 24%|██▍       | 9136/37963 [20:39:11<61:27:38,  7.68s/it]
 24%|██▍       | 9137/37963 [20:39:19<61:36:05,  7.69s/it]
 24%|██▍       | 9138/37963 [20:39:26<61:29:28,  7.68s/it]
 24%|██▍       | 9139/37963 [20:39:34<61:50:57,  7.72s/it]
 24%|██▍       | 9140/37963 [20:39:42<61:35:00,  7.69s/it]
                                                          
{'loss': '0.1847', 'grad_norm': '3.309', 'learning_rate': '1.776e-05', 'epoch': '0.2408'}
+
 24%|██▍       | 9140/37963 [20:39:42<61:35:00,  7.69s/it]
 24%|██▍       | 9141/37963 [20:39:49<61:33:20,  7.69s/it]
 24%|██▍       | 9142/37963 [20:39:57<62:06:59,  7.76s/it]
 24%|██▍       | 9143/37963 [20:40:05<61:59:42,  7.74s/it]
 24%|██▍       | 9144/37963 [20:40:13<62:19:10,  7.78s/it]
 24%|██▍       | 9145/37963 [20:40:20<61:41:09,  7.71s/it]
 24%|██▍       | 9146/37963 [20:40:28<61:08:57,  7.64s/it]
 24%|██▍       | 9147/37963 [20:40:36<61:20:50,  7.66s/it]
 24%|██▍       | 9148/37963 [20:40:43<60:39:52,  7.58s/it]
 24%|██▍       | 9149/37963 [20:40:51<60:53:14,  7.61s/it]
 24%|██▍       | 9150/37963 [20:41:04<73:28:15,  9.18s/it]
                                                          
{'loss': '0.1704', 'grad_norm': '1.724', 'learning_rate': '1.775e-05', 'epoch': '0.241'}
+
 24%|██▍       | 9150/37963 [20:41:04<73:28:15,  9.18s/it]
 24%|██▍       | 9151/37963 [20:41:14<76:05:51,  9.51s/it]
 24%|██▍       | 9152/37963 [20:41:22<71:59:18,  9.00s/it]
 24%|██▍       | 9153/37963 [20:41:29<68:42:45,  8.59s/it]
 24%|██▍       | 9154/37963 [20:41:40<73:13:47,  9.15s/it]
 24%|██▍       | 9155/37963 [20:41:47<69:36:50,  8.70s/it]
 24%|██▍       | 9156/37963 [20:41:55<67:34:43,  8.45s/it]
 24%|██▍       | 9157/37963 [20:42:03<65:51:48,  8.23s/it]
 24%|██▍       | 9158/37963 [20:42:10<64:08:01,  8.02s/it]
 24%|██▍       | 9159/37963 [20:42:21<69:42:24,  8.71s/it]
 24%|██▍       | 9160/37963 [20:42:28<67:17:39,  8.41s/it]
                                                          
{'loss': '0.1627', 'grad_norm': '2.659', 'learning_rate': '1.775e-05', 'epoch': '0.2413'}
+
 24%|██▍       | 9160/37963 [20:42:28<67:17:39,  8.41s/it]
 24%|██▍       | 9161/37963 [20:42:36<65:38:14,  8.20s/it]
 24%|██▍       | 9162/37963 [20:42:44<64:13:40,  8.03s/it]
 24%|██▍       | 9163/37963 [20:42:51<62:31:01,  7.81s/it]
 24%|██▍       | 9164/37963 [20:43:01<67:56:40,  8.49s/it]
 24%|██▍       | 9165/37963 [20:43:09<66:09:05,  8.27s/it]
 24%|██▍       | 9166/37963 [20:43:17<64:47:54,  8.10s/it]
 24%|██▍       | 9167/37963 [20:43:24<63:38:11,  7.96s/it]
 24%|██▍       | 9168/37963 [20:43:32<62:44:57,  7.85s/it]
 24%|██▍       | 9169/37963 [20:43:43<69:31:15,  8.69s/it]
 24%|██▍       | 9170/37963 [20:43:50<66:53:36,  8.36s/it]
                                                          
{'loss': '0.178', 'grad_norm': '0.8494', 'learning_rate': '1.774e-05', 'epoch': '0.2416'}
+
 24%|██▍       | 9170/37963 [20:43:50<66:53:36,  8.36s/it]
 24%|██▍       | 9171/37963 [20:43:58<65:00:48,  8.13s/it]
 24%|██▍       | 9172/37963 [20:44:05<63:46:02,  7.97s/it]
 24%|██▍       | 9173/37963 [20:44:13<63:14:38,  7.91s/it]
 24%|██▍       | 9174/37963 [20:44:21<63:01:07,  7.88s/it]
 24%|██▍       | 9175/37963 [20:44:28<62:11:38,  7.78s/it]
 24%|██▍       | 9176/37963 [20:44:36<61:38:55,  7.71s/it]
 24%|██▍       | 9177/37963 [20:44:44<61:41:43,  7.72s/it]
 24%|██▍       | 9178/37963 [20:44:51<61:39:03,  7.71s/it]
 24%|██▍       | 9179/37963 [20:44:59<61:37:40,  7.71s/it]
 24%|██▍       | 9180/37963 [20:45:07<61:29:21,  7.69s/it]
                                                          
{'loss': '0.1759', 'grad_norm': '3.234', 'learning_rate': '1.774e-05', 'epoch': '0.2418'}
+
 24%|██▍       | 9180/37963 [20:45:07<61:29:21,  7.69s/it]
 24%|██▍       | 9181/37963 [20:45:14<61:05:06,  7.64s/it]
 24%|██▍       | 9182/37963 [20:45:22<60:57:12,  7.62s/it]
 24%|██▍       | 9183/37963 [20:45:30<61:18:13,  7.67s/it]
 24%|██▍       | 9184/37963 [20:45:38<61:49:19,  7.73s/it]
 24%|██▍       | 9185/37963 [20:45:45<61:44:10,  7.72s/it]
 24%|██▍       | 9186/37963 [20:45:53<61:42:44,  7.72s/it]
 24%|██▍       | 9187/37963 [20:46:01<61:36:23,  7.71s/it]
 24%|██▍       | 9188/37963 [20:46:08<61:29:19,  7.69s/it]
 24%|██▍       | 9189/37963 [20:46:16<61:33:52,  7.70s/it]
 24%|██▍       | 9190/37963 [20:46:24<61:49:11,  7.73s/it]
                                                          
{'loss': '0.1644', 'grad_norm': '2.176', 'learning_rate': '1.773e-05', 'epoch': '0.2421'}
+
 24%|██▍       | 9190/37963 [20:46:24<61:49:11,  7.73s/it]
 24%|██▍       | 9191/37963 [20:46:31<61:28:28,  7.69s/it]
 24%|██▍       | 9192/37963 [20:46:39<61:36:23,  7.71s/it]
 24%|██▍       | 9193/37963 [20:46:47<61:22:11,  7.68s/it]
 24%|██▍       | 9194/37963 [20:46:57<67:48:06,  8.48s/it]
 24%|██▍       | 9195/37963 [20:47:08<72:26:10,  9.06s/it]
 24%|██▍       | 9196/37963 [20:47:15<69:03:44,  8.64s/it]
 24%|██▍       | 9197/37963 [20:47:23<66:47:01,  8.36s/it]
 24%|██▍       | 9198/37963 [20:47:31<65:09:44,  8.16s/it]
 24%|██▍       | 9199/37963 [20:47:38<63:41:01,  7.97s/it]
 24%|██▍       | 9200/37963 [20:47:46<63:03:45,  7.89s/it]
                                                          
{'loss': '0.1552', 'grad_norm': '1.743', 'learning_rate': '1.773e-05', 'epoch': '0.2423'}
+
 24%|██▍       | 9200/37963 [20:47:46<63:03:45,  7.89s/it]
 24%|██▍       | 9201/37963 [20:47:54<62:40:36,  7.84s/it]
 24%|██▍       | 9202/37963 [20:48:01<62:15:44,  7.79s/it]
 24%|██▍       | 9203/37963 [20:48:11<67:27:10,  8.44s/it]
 24%|██▍       | 9204/37963 [20:48:19<65:44:38,  8.23s/it]
 24%|██▍       | 9205/37963 [20:48:29<70:54:23,  8.88s/it]
 24%|██▍       | 9206/37963 [20:48:37<68:41:57,  8.60s/it]
 24%|██▍       | 9207/37963 [20:48:45<67:10:43,  8.41s/it]
 24%|██▍       | 9208/37963 [20:48:53<65:43:12,  8.23s/it]
 24%|██▍       | 9209/37963 [20:49:01<64:32:13,  8.08s/it]
 24%|██▍       | 9210/37963 [20:49:11<70:11:17,  8.79s/it]
                                                          
{'loss': '0.1881', 'grad_norm': '1.464', 'learning_rate': '1.772e-05', 'epoch': '0.2426'}
+
 24%|██▍       | 9210/37963 [20:49:11<70:11:17,  8.79s/it]
 24%|██▍       | 9211/37963 [20:49:19<68:04:15,  8.52s/it]
 24%|██▍       | 9212/37963 [20:49:27<66:05:41,  8.28s/it]
 24%|██▍       | 9213/37963 [20:49:40<76:53:52,  9.63s/it]
 24%|██▍       | 9214/37963 [20:49:47<72:09:35,  9.04s/it]
 24%|██▍       | 9215/37963 [20:49:55<68:48:12,  8.62s/it]
 24%|██▍       | 9216/37963 [20:50:03<66:49:37,  8.37s/it]
 24%|██▍       | 9217/37963 [20:50:10<65:23:26,  8.19s/it]
 24%|██▍       | 9218/37963 [20:50:18<63:47:38,  7.99s/it]
 24%|██▍       | 9219/37963 [20:50:26<63:01:30,  7.89s/it]
 24%|██▍       | 9220/37963 [20:50:33<61:24:23,  7.69s/it]
                                                          
{'loss': '0.1691', 'grad_norm': '2.322', 'learning_rate': '1.772e-05', 'epoch': '0.2429'}
+
 24%|██▍       | 9220/37963 [20:50:33<61:24:23,  7.69s/it]
 24%|██▍       | 9221/37963 [20:50:41<61:38:32,  7.72s/it]
 24%|██▍       | 9222/37963 [20:50:48<61:49:22,  7.74s/it]
 24%|██▍       | 9223/37963 [20:50:59<68:19:57,  8.56s/it]
 24%|██▍       | 9224/37963 [20:51:07<66:33:05,  8.34s/it]
 24%|██▍       | 9225/37963 [20:51:14<64:43:52,  8.11s/it]
 24%|██▍       | 9226/37963 [20:51:22<63:57:36,  8.01s/it]
 24%|██▍       | 9227/37963 [20:51:30<63:01:14,  7.90s/it]
 24%|██▍       | 9228/37963 [20:51:38<62:57:06,  7.89s/it]
 24%|██▍       | 9229/37963 [20:51:45<62:37:26,  7.85s/it]
 24%|██▍       | 9230/37963 [20:51:53<62:14:52,  7.80s/it]
                                                          
{'loss': '0.1944', 'grad_norm': '2.674', 'learning_rate': '1.771e-05', 'epoch': '0.2431'}
+
 24%|██▍       | 9230/37963 [20:51:53<62:14:52,  7.80s/it]
 24%|██▍       | 9231/37963 [20:52:01<61:51:10,  7.75s/it]
 24%|██▍       | 9232/37963 [20:52:08<61:30:34,  7.71s/it]
 24%|██▍       | 9233/37963 [20:52:16<61:10:12,  7.66s/it]
 24%|██▍       | 9234/37963 [20:52:23<60:48:15,  7.62s/it]
 24%|██▍       | 9235/37963 [20:52:31<61:27:36,  7.70s/it]
 24%|██▍       | 9236/37963 [20:52:39<61:15:35,  7.68s/it]
 24%|██▍       | 9237/37963 [20:52:46<60:50:07,  7.62s/it]
 24%|██▍       | 9238/37963 [20:52:59<73:42:37,  9.24s/it]
 24%|██▍       | 9239/37963 [20:53:07<70:01:51,  8.78s/it]
 24%|██▍       | 9240/37963 [20:53:15<66:55:32,  8.39s/it]
                                                          
{'loss': '0.1767', 'grad_norm': '2', 'learning_rate': '1.771e-05', 'epoch': '0.2434'}
+
 24%|██▍       | 9240/37963 [20:53:15<66:55:32,  8.39s/it]
 24%|██▍       | 9241/37963 [20:53:22<65:29:27,  8.21s/it]
 24%|██▍       | 9242/37963 [20:53:30<64:11:54,  8.05s/it]
 24%|██▍       | 9243/37963 [20:53:38<63:40:06,  7.98s/it]
 24%|██▍       | 9244/37963 [20:53:45<62:37:40,  7.85s/it]
 24%|██▍       | 9245/37963 [20:53:53<62:14:54,  7.80s/it]
 24%|██▍       | 9246/37963 [20:54:01<62:01:15,  7.78s/it]
 24%|██▍       | 9247/37963 [20:54:08<61:23:55,  7.70s/it]
 24%|██▍       | 9248/37963 [20:54:16<61:20:10,  7.69s/it]
 24%|██▍       | 9249/37963 [20:54:26<67:16:24,  8.43s/it]
 24%|██▍       | 9250/37963 [20:54:34<65:24:23,  8.20s/it]
                                                          
{'loss': '0.1739', 'grad_norm': '1.814', 'learning_rate': '1.77e-05', 'epoch': '0.2437'}
+
 24%|██▍       | 9250/37963 [20:54:34<65:24:23,  8.20s/it]
 24%|██▍       | 9251/37963 [20:54:42<64:29:42,  8.09s/it]
 24%|██▍       | 9252/37963 [20:54:52<70:03:02,  8.78s/it]
 24%|██▍       | 9253/37963 [20:55:00<67:50:42,  8.51s/it]
 24%|██▍       | 9254/37963 [20:55:10<72:05:21,  9.04s/it]
 24%|██▍       | 9255/37963 [20:55:18<68:43:09,  8.62s/it]
 24%|██▍       | 9256/37963 [20:55:26<66:58:15,  8.40s/it]
 24%|██▍       | 9257/37963 [20:55:33<64:59:20,  8.15s/it]
 24%|██▍       | 9258/37963 [20:55:41<63:51:19,  8.01s/it]
 24%|██▍       | 9259/37963 [20:55:49<63:18:16,  7.94s/it]
 24%|██▍       | 9260/37963 [20:55:56<62:29:41,  7.84s/it]
                                                          
{'loss': '0.1681', 'grad_norm': '1.278', 'learning_rate': '1.769e-05', 'epoch': '0.2439'}
+
 24%|██▍       | 9260/37963 [20:55:56<62:29:41,  7.84s/it]
 24%|██▍       | 9261/37963 [20:56:04<61:03:44,  7.66s/it]
 24%|██▍       | 9262/37963 [20:56:11<61:40:52,  7.74s/it]
 24%|██▍       | 9263/37963 [20:56:19<61:31:18,  7.72s/it]
 24%|██▍       | 9264/37963 [20:56:27<60:47:41,  7.63s/it]
 24%|██▍       | 9265/37963 [20:56:34<61:05:59,  7.66s/it]
 24%|██▍       | 9266/37963 [20:56:42<61:04:05,  7.66s/it]
 24%|██▍       | 9267/37963 [20:56:55<73:03:49,  9.17s/it]
 24%|██▍       | 9268/37963 [20:57:03<70:32:12,  8.85s/it]
 24%|██▍       | 9269/37963 [20:57:10<67:13:58,  8.44s/it]
 24%|██▍       | 9270/37963 [20:57:18<64:31:16,  8.10s/it]
                                                          
{'loss': '0.1576', 'grad_norm': '1.828', 'learning_rate': '1.769e-05', 'epoch': '0.2442'}
+
 24%|██▍       | 9270/37963 [20:57:18<64:31:16,  8.10s/it]
 24%|██▍       | 9271/37963 [20:57:25<63:30:14,  7.97s/it]
 24%|██▍       | 9272/37963 [20:57:33<63:14:54,  7.94s/it]
 24%|██▍       | 9273/37963 [20:57:41<63:05:25,  7.92s/it]
 24%|██▍       | 9274/37963 [20:57:49<62:42:49,  7.87s/it]
 24%|██▍       | 9275/37963 [20:57:56<62:10:45,  7.80s/it]
 24%|██▍       | 9276/37963 [20:58:04<61:00:49,  7.66s/it]
 24%|██▍       | 9277/37963 [20:58:14<67:56:34,  8.53s/it]
 24%|██▍       | 9278/37963 [20:58:22<66:26:06,  8.34s/it]
 24%|██▍       | 9279/37963 [20:58:30<64:56:21,  8.15s/it]
 24%|██▍       | 9280/37963 [20:58:37<63:24:54,  7.96s/it]
                                                          
{'loss': '0.1634', 'grad_norm': '1.491', 'learning_rate': '1.768e-05', 'epoch': '0.2444'}
+
 24%|██▍       | 9280/37963 [20:58:37<63:24:54,  7.96s/it]
 24%|██▍       | 9281/37963 [20:58:45<62:12:55,  7.81s/it]
 24%|██▍       | 9282/37963 [20:58:55<68:13:52,  8.56s/it]
 24%|██▍       | 9283/37963 [20:59:03<66:05:29,  8.30s/it]
 24%|██▍       | 9284/37963 [20:59:10<64:17:29,  8.07s/it]
 24%|██▍       | 9285/37963 [20:59:18<63:16:58,  7.94s/it]
 24%|██▍       | 9286/37963 [20:59:28<69:19:26,  8.70s/it]
 24%|██▍       | 9287/37963 [20:59:36<67:29:00,  8.47s/it]
 24%|██▍       | 9288/37963 [20:59:44<65:07:25,  8.18s/it]
 24%|██▍       | 9289/37963 [20:59:52<63:51:12,  8.02s/it]
 24%|██▍       | 9290/37963 [20:59:59<63:39:54,  7.99s/it]
                                                          
{'loss': '0.1755', 'grad_norm': '5.249', 'learning_rate': '1.768e-05', 'epoch': '0.2447'}
+
 24%|██▍       | 9290/37963 [20:59:59<63:39:54,  7.99s/it]
 24%|██▍       | 9291/37963 [21:00:07<62:45:48,  7.88s/it]
 24%|██▍       | 9292/37963 [21:00:17<67:35:15,  8.49s/it]
 24%|██▍       | 9293/37963 [21:00:25<65:23:15,  8.21s/it]
 24%|██▍       | 9294/37963 [21:00:32<62:54:40,  7.90s/it]
 24%|██▍       | 9295/37963 [21:00:39<62:29:25,  7.85s/it]
 24%|██▍       | 9296/37963 [21:00:47<61:19:06,  7.70s/it]
 24%|██▍       | 9297/37963 [21:01:00<74:03:37,  9.30s/it]
 24%|██▍       | 9298/37963 [21:01:08<70:49:22,  8.89s/it]
 24%|██▍       | 9299/37963 [21:01:16<68:05:48,  8.55s/it]
 24%|██▍       | 9300/37963 [21:01:23<64:54:39,  8.15s/it]
                                                          
{'loss': '0.1677', 'grad_norm': '4.056', 'learning_rate': '1.767e-05', 'epoch': '0.245'}
+
 24%|██▍       | 9300/37963 [21:01:23<64:54:39,  8.15s/it]
 25%|██▍       | 9301/37963 [21:01:30<63:37:09,  7.99s/it]
 25%|██▍       | 9302/37963 [21:01:38<62:54:30,  7.90s/it]
 25%|██▍       | 9303/37963 [21:01:46<63:00:04,  7.91s/it]
 25%|██▍       | 9304/37963 [21:01:54<62:29:21,  7.85s/it]
 25%|██▍       | 9305/37963 [21:02:01<61:54:16,  7.78s/it]
 25%|██▍       | 9306/37963 [21:02:09<61:29:53,  7.73s/it]
 25%|██▍       | 9307/37963 [21:02:17<61:26:04,  7.72s/it]
 25%|██▍       | 9308/37963 [21:02:24<61:20:42,  7.71s/it]
 25%|██▍       | 9309/37963 [21:02:32<61:18:41,  7.70s/it]
 25%|██▍       | 9310/37963 [21:02:40<61:31:59,  7.73s/it]
                                                          
{'loss': '0.161', 'grad_norm': '1.294', 'learning_rate': '1.767e-05', 'epoch': '0.2452'}
+
 25%|██▍       | 9310/37963 [21:02:40<61:31:59,  7.73s/it]
 25%|██▍       | 9311/37963 [21:02:47<61:23:21,  7.71s/it]
 25%|██▍       | 9312/37963 [21:02:55<60:32:45,  7.61s/it]
 25%|██▍       | 9313/37963 [21:03:02<60:28:01,  7.60s/it]
 25%|██▍       | 9314/37963 [21:03:10<60:26:23,  7.59s/it]
 25%|██▍       | 9315/37963 [21:03:18<61:31:11,  7.73s/it]
 25%|██▍       | 9316/37963 [21:03:26<61:31:43,  7.73s/it]
 25%|██▍       | 9317/37963 [21:03:34<61:44:24,  7.76s/it]
 25%|██▍       | 9318/37963 [21:03:41<61:19:45,  7.71s/it]
 25%|██▍       | 9319/37963 [21:03:49<61:23:50,  7.72s/it]
 25%|██▍       | 9320/37963 [21:03:57<61:12:24,  7.69s/it]
                                                          
{'loss': '0.167', 'grad_norm': '1.63', 'learning_rate': '1.766e-05', 'epoch': '0.2455'}
+
 25%|██▍       | 9320/37963 [21:03:57<61:12:24,  7.69s/it]
 25%|██▍       | 9321/37963 [21:04:10<73:46:27,  9.27s/it]
 25%|██▍       | 9322/37963 [21:04:17<70:28:39,  8.86s/it]
 25%|██▍       | 9323/37963 [21:04:25<67:54:03,  8.54s/it]
 25%|██▍       | 9324/37963 [21:04:33<65:55:12,  8.29s/it]
 25%|██▍       | 9325/37963 [21:04:41<64:38:42,  8.13s/it]
 25%|██▍       | 9326/37963 [21:04:48<63:46:15,  8.02s/it]
 25%|██▍       | 9327/37963 [21:04:56<63:33:26,  7.99s/it]
 25%|██▍       | 9328/37963 [21:05:07<69:02:18,  8.68s/it]
 25%|██▍       | 9329/37963 [21:05:14<66:59:09,  8.42s/it]
 25%|██▍       | 9330/37963 [21:05:22<65:00:48,  8.17s/it]
                                                          
{'loss': '0.1741', 'grad_norm': '1.077', 'learning_rate': '1.766e-05', 'epoch': '0.2458'}
+
 25%|██▍       | 9330/37963 [21:05:22<65:00:48,  8.17s/it]
 25%|██▍       | 9331/37963 [21:05:33<70:39:01,  8.88s/it]
 25%|██▍       | 9332/37963 [21:05:41<68:32:50,  8.62s/it]
 25%|██▍       | 9333/37963 [21:05:48<66:37:57,  8.38s/it]
 25%|██▍       | 9334/37963 [21:05:59<71:04:53,  8.94s/it]
 25%|██▍       | 9335/37963 [21:06:07<68:42:55,  8.64s/it]
 25%|██▍       | 9336/37963 [21:06:17<72:42:58,  9.14s/it]
 25%|██▍       | 9337/37963 [21:06:25<69:40:50,  8.76s/it]
 25%|██▍       | 9338/37963 [21:06:33<67:24:08,  8.48s/it]
 25%|██▍       | 9339/37963 [21:06:40<65:41:47,  8.26s/it]
 25%|██▍       | 9340/37963 [21:06:48<64:58:04,  8.17s/it]
                                                          
{'loss': '0.168', 'grad_norm': '1.783', 'learning_rate': '1.765e-05', 'epoch': '0.246'}
+
 25%|██▍       | 9340/37963 [21:06:48<64:58:04,  8.17s/it]
 25%|██▍       | 9341/37963 [21:06:56<64:06:23,  8.06s/it]
 25%|██▍       | 9342/37963 [21:07:04<63:23:38,  7.97s/it]
 25%|██▍       | 9343/37963 [21:07:12<62:38:08,  7.88s/it]
 25%|██▍       | 9344/37963 [21:07:19<62:32:26,  7.87s/it]
 25%|██▍       | 9345/37963 [21:07:30<68:30:10,  8.62s/it]
 25%|██▍       | 9346/37963 [21:07:38<66:31:34,  8.37s/it]
 25%|██▍       | 9347/37963 [21:07:45<64:17:04,  8.09s/it]
 25%|██▍       | 9348/37963 [21:07:53<63:29:10,  7.99s/it]
 25%|██▍       | 9349/37963 [21:08:01<63:05:55,  7.94s/it]
 25%|██▍       | 9350/37963 [21:08:08<62:25:57,  7.86s/it]
                                                          
{'loss': '0.1657', 'grad_norm': '6.335', 'learning_rate': '1.765e-05', 'epoch': '0.2463'}
+
 25%|██▍       | 9350/37963 [21:08:08<62:25:57,  7.86s/it]
 25%|██▍       | 9351/37963 [21:08:18<67:55:48,  8.55s/it]
 25%|██▍       | 9352/37963 [21:08:26<66:06:17,  8.32s/it]
 25%|██▍       | 9353/37963 [21:08:34<64:11:04,  8.08s/it]
 25%|██▍       | 9354/37963 [21:08:41<63:11:35,  7.95s/it]
 25%|██▍       | 9355/37963 [21:08:49<62:41:49,  7.89s/it]
 25%|██▍       | 9356/37963 [21:08:57<62:01:31,  7.81s/it]
 25%|██▍       | 9357/37963 [21:09:04<61:57:37,  7.80s/it]
 25%|██▍       | 9358/37963 [21:09:12<61:27:50,  7.74s/it]
 25%|██▍       | 9359/37963 [21:09:20<61:45:28,  7.77s/it]
 25%|██▍       | 9360/37963 [21:09:27<61:08:59,  7.70s/it]
                                                          
{'loss': '0.1683', 'grad_norm': '3.123', 'learning_rate': '1.764e-05', 'epoch': '0.2466'}
+
 25%|██▍       | 9360/37963 [21:09:27<61:08:59,  7.70s/it]
 25%|██▍       | 9361/37963 [21:09:35<61:10:43,  7.70s/it]
 25%|██▍       | 9362/37963 [21:09:43<60:25:41,  7.61s/it]
 25%|██▍       | 9363/37963 [21:09:50<60:35:22,  7.63s/it]
 25%|██▍       | 9364/37963 [21:09:58<61:01:58,  7.68s/it]
 25%|██▍       | 9365/37963 [21:10:08<67:39:19,  8.52s/it]
 25%|██▍       | 9366/37963 [21:10:16<65:59:25,  8.31s/it]
 25%|██▍       | 9367/37963 [21:10:24<64:45:26,  8.15s/it]
 25%|██▍       | 9368/37963 [21:10:32<63:45:07,  8.03s/it]
 25%|██▍       | 9369/37963 [21:10:39<62:42:53,  7.90s/it]
 25%|██▍       | 9370/37963 [21:10:47<61:15:15,  7.71s/it]
                                                          
{'loss': '0.1903', 'grad_norm': '1.271', 'learning_rate': '1.763e-05', 'epoch': '0.2468'}
+
 25%|██▍       | 9370/37963 [21:10:47<61:15:15,  7.71s/it]
 25%|██▍       | 9371/37963 [21:10:55<61:44:41,  7.77s/it]
 25%|██▍       | 9372/37963 [21:11:02<60:58:17,  7.68s/it]
 25%|██▍       | 9373/37963 [21:11:10<60:50:04,  7.66s/it]
 25%|██▍       | 9374/37963 [21:11:17<60:37:29,  7.63s/it]
 25%|██▍       | 9375/37963 [21:11:28<66:54:54,  8.43s/it]
 25%|██▍       | 9376/37963 [21:11:37<70:21:42,  8.86s/it]
 25%|██▍       | 9377/37963 [21:11:45<67:24:20,  8.49s/it]
 25%|██▍       | 9378/37963 [21:11:53<65:22:24,  8.23s/it]
 25%|██▍       | 9379/37963 [21:12:03<70:51:20,  8.92s/it]
 25%|██▍       | 9380/37963 [21:12:13<73:57:43,  9.32s/it]
                                                          
{'loss': '0.1653', 'grad_norm': '2.043', 'learning_rate': '1.763e-05', 'epoch': '0.2471'}
+
 25%|██▍       | 9380/37963 [21:12:13<73:57:43,  9.32s/it]
 25%|██▍       | 9381/37963 [21:12:21<70:08:42,  8.84s/it]
 25%|██▍       | 9382/37963 [21:12:32<73:48:38,  9.30s/it]
 25%|██▍       | 9383/37963 [21:12:39<70:16:48,  8.85s/it]
 25%|██▍       | 9384/37963 [21:12:47<67:25:34,  8.49s/it]
 25%|██▍       | 9385/37963 [21:12:55<65:30:32,  8.25s/it]
 25%|██▍       | 9386/37963 [21:13:02<64:07:37,  8.08s/it]
 25%|██▍       | 9387/37963 [21:13:10<63:23:40,  7.99s/it]
 25%|██▍       | 9388/37963 [21:13:18<62:57:17,  7.93s/it]
 25%|██▍       | 9389/37963 [21:13:28<68:26:18,  8.62s/it]
 25%|██▍       | 9390/37963 [21:13:36<66:50:33,  8.42s/it]
                                                          
{'loss': '0.1687', 'grad_norm': '1.638', 'learning_rate': '1.762e-05', 'epoch': '0.2473'}
+
 25%|██▍       | 9390/37963 [21:13:36<66:50:33,  8.42s/it]
 25%|██▍       | 9391/37963 [21:13:44<65:24:45,  8.24s/it]
 25%|██▍       | 9392/37963 [21:13:52<63:54:05,  8.05s/it]
 25%|██▍       | 9393/37963 [21:13:59<63:20:08,  7.98s/it]
 25%|██▍       | 9394/37963 [21:14:07<62:51:39,  7.92s/it]
 25%|██▍       | 9395/37963 [21:14:18<68:38:45,  8.65s/it]
 25%|██▍       | 9396/37963 [21:14:25<66:41:28,  8.40s/it]
 25%|██▍       | 9397/37963 [21:14:33<64:56:23,  8.18s/it]
 25%|██▍       | 9398/37963 [21:14:41<64:12:55,  8.09s/it]
 25%|██▍       | 9399/37963 [21:14:49<63:15:46,  7.97s/it]
 25%|██▍       | 9400/37963 [21:14:56<62:37:34,  7.89s/it]
                                                          
{'loss': '0.1715', 'grad_norm': '4.822', 'learning_rate': '1.762e-05', 'epoch': '0.2476'}
+
 25%|██▍       | 9400/37963 [21:14:56<62:37:34,  7.89s/it]
 25%|██▍       | 9401/37963 [21:15:04<62:07:49,  7.83s/it]
 25%|██▍       | 9402/37963 [21:15:12<62:06:55,  7.83s/it]
 25%|██▍       | 9403/37963 [21:15:19<61:46:32,  7.79s/it]
 25%|██▍       | 9404/37963 [21:15:27<61:33:14,  7.76s/it]
 25%|██▍       | 9405/37963 [21:15:35<61:11:22,  7.71s/it]
 25%|██▍       | 9406/37963 [21:15:42<60:19:21,  7.60s/it]
 25%|██▍       | 9407/37963 [21:15:50<60:24:41,  7.62s/it]
 25%|██▍       | 9408/37963 [21:15:57<60:24:57,  7.62s/it]
 25%|██▍       | 9409/37963 [21:16:05<60:05:49,  7.58s/it]
 25%|██▍       | 9410/37963 [21:16:13<60:59:28,  7.69s/it]
                                                          
{'loss': '0.1534', 'grad_norm': '1.192', 'learning_rate': '1.761e-05', 'epoch': '0.2479'}
+
 25%|██▍       | 9410/37963 [21:16:13<60:59:28,  7.69s/it]
 25%|██▍       | 9411/37963 [21:16:21<60:59:18,  7.69s/it]
 25%|██▍       | 9412/37963 [21:16:28<61:01:02,  7.69s/it]
 25%|██▍       | 9413/37963 [21:16:39<67:23:29,  8.50s/it]
 25%|██▍       | 9414/37963 [21:16:46<65:17:57,  8.23s/it]
 25%|██▍       | 9415/37963 [21:16:54<63:46:34,  8.04s/it]
 25%|██▍       | 9416/37963 [21:17:01<62:47:51,  7.92s/it]
 25%|██▍       | 9417/37963 [21:17:09<62:27:34,  7.88s/it]
 25%|██▍       | 9418/37963 [21:17:17<61:57:45,  7.81s/it]
 25%|██▍       | 9419/37963 [21:17:27<67:35:03,  8.52s/it]
 25%|██▍       | 9420/37963 [21:17:35<65:36:55,  8.28s/it]
                                                          
{'loss': '0.1709', 'grad_norm': '2.259', 'learning_rate': '1.761e-05', 'epoch': '0.2481'}
+
 25%|██▍       | 9420/37963 [21:17:35<65:36:55,  8.28s/it]
 25%|██▍       | 9421/37963 [21:17:42<64:10:45,  8.09s/it]
 25%|██▍       | 9422/37963 [21:17:50<63:14:57,  7.98s/it]
 25%|██▍       | 9423/37963 [21:17:58<62:48:12,  7.92s/it]
 25%|██▍       | 9424/37963 [21:18:06<62:19:42,  7.86s/it]
 25%|██▍       | 9425/37963 [21:18:16<67:59:50,  8.58s/it]
 25%|██▍       | 9426/37963 [21:18:23<65:26:25,  8.26s/it]
 25%|██▍       | 9427/37963 [21:18:34<69:58:07,  8.83s/it]
 25%|██▍       | 9428/37963 [21:18:44<73:32:48,  9.28s/it]
 25%|██▍       | 9429/37963 [21:18:52<69:46:20,  8.80s/it]
 25%|██▍       | 9430/37963 [21:18:59<66:59:36,  8.45s/it]
                                                          
{'loss': '0.1861', 'grad_norm': '4.83', 'learning_rate': '1.76e-05', 'epoch': '0.2484'}
+
 25%|██▍       | 9430/37963 [21:18:59<66:59:36,  8.45s/it]
 25%|██▍       | 9431/37963 [21:19:09<70:37:36,  8.91s/it]
 25%|██▍       | 9432/37963 [21:19:17<68:06:24,  8.59s/it]
 25%|██▍       | 9433/37963 [21:19:24<65:12:19,  8.23s/it]
 25%|██▍       | 9434/37963 [21:19:32<64:05:21,  8.09s/it]
 25%|██▍       | 9435/37963 [21:19:40<62:39:29,  7.91s/it]
 25%|██▍       | 9436/37963 [21:19:47<62:18:30,  7.86s/it]
 25%|██▍       | 9437/37963 [21:19:55<62:01:31,  7.83s/it]
 25%|██▍       | 9438/37963 [21:20:05<67:24:14,  8.51s/it]
 25%|██▍       | 9439/37963 [21:20:13<65:35:38,  8.28s/it]
 25%|██▍       | 9440/37963 [21:20:21<63:58:16,  8.07s/it]
                                                          
{'loss': '0.1689', 'grad_norm': '1.226', 'learning_rate': '1.76e-05', 'epoch': '0.2487'}
+
 25%|██▍       | 9440/37963 [21:20:21<63:58:16,  8.07s/it]
 25%|██▍       | 9441/37963 [21:20:28<63:10:43,  7.97s/it]
 25%|██▍       | 9442/37963 [21:20:36<62:01:15,  7.83s/it]
 25%|██▍       | 9443/37963 [21:20:43<61:08:37,  7.72s/it]
 25%|██▍       | 9444/37963 [21:20:51<60:53:47,  7.69s/it]
 25%|██▍       | 9445/37963 [21:20:59<60:38:31,  7.66s/it]
 25%|██▍       | 9446/37963 [21:21:06<60:43:26,  7.67s/it]
 25%|██▍       | 9447/37963 [21:21:14<60:59:25,  7.70s/it]
 25%|██▍       | 9448/37963 [21:21:22<60:57:54,  7.70s/it]
 25%|██▍       | 9449/37963 [21:21:32<68:17:58,  8.62s/it]
 25%|██▍       | 9450/37963 [21:21:40<66:50:39,  8.44s/it]
                                                          
{'loss': '0.1813', 'grad_norm': '3.705', 'learning_rate': '1.759e-05', 'epoch': '0.2489'}
+
 25%|██▍       | 9450/37963 [21:21:40<66:50:39,  8.44s/it]
 25%|██▍       | 9451/37963 [21:21:48<65:34:47,  8.28s/it]
 25%|██▍       | 9452/37963 [21:21:56<63:59:49,  8.08s/it]
 25%|██▍       | 9453/37963 [21:22:04<62:38:34,  7.91s/it]
 25%|██▍       | 9454/37963 [21:22:11<61:23:24,  7.75s/it]
 25%|██▍       | 9455/37963 [21:22:19<61:22:28,  7.75s/it]
 25%|██▍       | 9456/37963 [21:22:26<60:57:54,  7.70s/it]
 25%|██▍       | 9457/37963 [21:22:34<61:01:33,  7.71s/it]
 25%|██▍       | 9458/37963 [21:22:42<61:38:57,  7.79s/it]
 25%|██▍       | 9459/37963 [21:22:50<61:42:34,  7.79s/it]
 25%|██▍       | 9460/37963 [21:22:58<61:43:21,  7.80s/it]
                                                          
{'loss': '0.1701', 'grad_norm': '2.185', 'learning_rate': '1.758e-05', 'epoch': '0.2492'}
+
 25%|██▍       | 9460/37963 [21:22:58<61:43:21,  7.80s/it]
 25%|██▍       | 9461/37963 [21:23:05<60:56:26,  7.70s/it]
 25%|██▍       | 9462/37963 [21:23:12<60:07:08,  7.59s/it]
 25%|██▍       | 9463/37963 [21:23:20<60:50:42,  7.69s/it]
 25%|██▍       | 9464/37963 [21:23:28<60:51:29,  7.69s/it]
 25%|██▍       | 9465/37963 [21:23:36<60:50:55,  7.69s/it]
 25%|██▍       | 9466/37963 [21:23:43<60:42:48,  7.67s/it]
 25%|██▍       | 9467/37963 [21:23:54<67:16:56,  8.50s/it]
 25%|██▍       | 9468/37963 [21:24:01<65:06:12,  8.23s/it]
 25%|██▍       | 9469/37963 [21:24:09<63:50:29,  8.07s/it]
 25%|██▍       | 9470/37963 [21:24:17<62:57:01,  7.95s/it]
                                                          
{'loss': '0.1731', 'grad_norm': '2.002', 'learning_rate': '1.758e-05', 'epoch': '0.2495'}
+
 25%|██▍       | 9470/37963 [21:24:17<62:57:01,  7.95s/it]
 25%|██▍       | 9471/37963 [21:24:24<62:38:04,  7.91s/it]
 25%|██▍       | 9472/37963 [21:24:32<62:09:23,  7.85s/it]
 25%|██▍       | 9473/37963 [21:24:40<61:11:54,  7.73s/it]
 25%|██▍       | 9474/37963 [21:24:47<61:15:08,  7.74s/it]
 25%|██▍       | 9475/37963 [21:24:55<61:10:15,  7.73s/it]
 25%|██▍       | 9476/37963 [21:25:05<66:17:36,  8.38s/it]
 25%|██▍       | 9477/37963 [21:25:15<70:41:14,  8.93s/it]
 25%|██▍       | 9478/37963 [21:25:23<66:45:04,  8.44s/it]
 25%|██▍       | 9479/37963 [21:25:33<72:02:37,  9.11s/it]
 25%|██▍       | 9480/37963 [21:25:41<68:22:10,  8.64s/it]
                                                          
{'loss': '0.1699', 'grad_norm': '1.391', 'learning_rate': '1.757e-05', 'epoch': '0.2497'}
+
 25%|██▍       | 9480/37963 [21:25:41<68:22:10,  8.64s/it]
 25%|██▍       | 9481/37963 [21:25:48<65:51:44,  8.32s/it]
 25%|██▍       | 9482/37963 [21:25:59<70:30:13,  8.91s/it]
 25%|██▍       | 9483/37963 [21:26:06<67:22:54,  8.52s/it]
 25%|██▍       | 9484/37963 [21:26:13<64:13:57,  8.12s/it]
 25%|██▍       | 9485/37963 [21:26:24<69:37:37,  8.80s/it]
 25%|██▍       | 9486/37963 [21:26:32<67:26:59,  8.53s/it]
 25%|██▍       | 9487/37963 [21:26:39<65:03:39,  8.23s/it]
 25%|██▍       | 9488/37963 [21:26:47<63:59:00,  8.09s/it]
 25%|██▍       | 9489/37963 [21:26:54<62:28:33,  7.90s/it]
 25%|██▍       | 9490/37963 [21:27:02<61:18:04,  7.75s/it]
                                                          
{'loss': '0.1688', 'grad_norm': '2.932', 'learning_rate': '1.757e-05', 'epoch': '0.25'}
+
 25%|██▍       | 9490/37963 [21:27:02<61:18:04,  7.75s/it]
 25%|██▌       | 9491/37963 [21:27:09<60:57:43,  7.71s/it]
 25%|██▌       | 9492/37963 [21:27:17<61:09:45,  7.73s/it]
 25%|██▌       | 9493/37963 [21:27:28<67:14:27,  8.50s/it]
 25%|██▌       | 9494/37963 [21:27:35<64:49:44,  8.20s/it]
 25%|██▌       | 9495/37963 [21:27:43<63:55:49,  8.08s/it]
 25%|██▌       | 9496/37963 [21:27:50<62:20:55,  7.88s/it]
 25%|██▌       | 9497/37963 [21:27:58<61:45:36,  7.81s/it]
 25%|██▌       | 9498/37963 [21:28:05<61:11:29,  7.74s/it]
 25%|██▌       | 9499/37963 [21:28:13<60:47:50,  7.69s/it]
 25%|██▌       | 9500/37963 [21:28:21<60:55:34,  7.71s/it]
                                                          
{'loss': '0.1571', 'grad_norm': '1.021', 'learning_rate': '1.756e-05', 'epoch': '0.2502'}
+
 25%|██▌       | 9500/37963 [21:28:21<60:55:34,  7.71s/it]
 25%|██▌       | 9501/37963 [21:28:29<61:25:29,  7.77s/it]
 25%|██▌       | 9502/37963 [21:28:37<61:38:54,  7.80s/it]
 25%|██▌       | 9503/37963 [21:28:44<61:24:21,  7.77s/it]
 25%|██▌       | 9504/37963 [21:28:52<61:53:45,  7.83s/it]
 25%|██▌       | 9505/37963 [21:29:00<61:05:18,  7.73s/it]
 25%|██▌       | 9506/37963 [21:29:08<61:18:57,  7.76s/it]
 25%|██▌       | 9507/37963 [21:29:15<61:39:07,  7.80s/it]
 25%|██▌       | 9508/37963 [21:29:23<61:46:50,  7.82s/it]
 25%|██▌       | 9509/37963 [21:29:31<61:10:20,  7.74s/it]
 25%|██▌       | 9510/37963 [21:29:39<61:45:10,  7.81s/it]
                                                          
{'loss': '0.1758', 'grad_norm': '1.738', 'learning_rate': '1.756e-05', 'epoch': '0.2505'}
+
 25%|██▌       | 9510/37963 [21:29:39<61:45:10,  7.81s/it]
 25%|██▌       | 9511/37963 [21:29:46<61:11:23,  7.74s/it]
 25%|██▌       | 9512/37963 [21:29:54<61:07:31,  7.73s/it]
 25%|██▌       | 9513/37963 [21:30:02<61:07:31,  7.73s/it]
 25%|██▌       | 9514/37963 [21:30:10<61:01:09,  7.72s/it]
 25%|██▌       | 9515/37963 [21:30:20<67:15:06,  8.51s/it]
 25%|██▌       | 9516/37963 [21:30:28<65:34:36,  8.30s/it]
 25%|██▌       | 9517/37963 [21:30:35<63:21:26,  8.02s/it]
 25%|██▌       | 9518/37963 [21:30:43<62:49:09,  7.95s/it]
 25%|██▌       | 9519/37963 [21:30:51<62:05:27,  7.86s/it]
 25%|██▌       | 9520/37963 [21:30:58<60:25:36,  7.65s/it]
                                                          
{'loss': '0.1714', 'grad_norm': '1.345', 'learning_rate': '1.755e-05', 'epoch': '0.2508'}
+
 25%|██▌       | 9520/37963 [21:30:58<60:25:36,  7.65s/it]
 25%|██▌       | 9521/37963 [21:31:08<66:07:56,  8.37s/it]
 25%|██▌       | 9522/37963 [21:31:15<64:22:29,  8.15s/it]
 25%|██▌       | 9523/37963 [21:31:26<70:09:34,  8.88s/it]
 25%|██▌       | 9524/37963 [21:31:34<67:05:34,  8.49s/it]
 25%|██▌       | 9525/37963 [21:31:44<71:55:40,  9.11s/it]
 25%|██▌       | 9526/37963 [21:31:54<74:03:22,  9.38s/it]
 25%|██▌       | 9527/37963 [21:32:02<70:19:31,  8.90s/it]
 25%|██▌       | 9528/37963 [21:32:12<73:45:52,  9.34s/it]
 25%|██▌       | 9529/37963 [21:32:20<69:52:47,  8.85s/it]
 25%|██▌       | 9530/37963 [21:32:27<66:16:15,  8.39s/it]
                                                          
{'loss': '0.1753', 'grad_norm': '4.613', 'learning_rate': '1.755e-05', 'epoch': '0.251'}
+
 25%|██▌       | 9530/37963 [21:32:27<66:16:15,  8.39s/it]
 25%|██▌       | 9531/37963 [21:32:35<64:23:01,  8.15s/it]
 25%|██▌       | 9532/37963 [21:32:43<63:17:48,  8.01s/it]
 25%|██▌       | 9533/37963 [21:32:53<68:20:18,  8.65s/it]
 25%|██▌       | 9534/37963 [21:33:00<65:39:55,  8.32s/it]
 25%|██▌       | 9535/37963 [21:33:08<64:24:59,  8.16s/it]
 25%|██▌       | 9536/37963 [21:33:16<63:00:54,  7.98s/it]
 25%|██▌       | 9537/37963 [21:33:23<62:16:55,  7.89s/it]
 25%|██▌       | 9538/37963 [21:33:31<60:59:29,  7.72s/it]
 25%|██▌       | 9539/37963 [21:33:38<61:10:12,  7.75s/it]
 25%|██▌       | 9540/37963 [21:33:46<60:54:51,  7.72s/it]
                                                          
{'loss': '0.1758', 'grad_norm': '1.273', 'learning_rate': '1.754e-05', 'epoch': '0.2513'}
+
 25%|██▌       | 9540/37963 [21:33:46<60:54:51,  7.72s/it]
 25%|██▌       | 9541/37963 [21:33:56<67:07:15,  8.50s/it]
 25%|██▌       | 9542/37963 [21:34:04<65:23:36,  8.28s/it]
 25%|██▌       | 9543/37963 [21:34:12<63:40:41,  8.07s/it]
 25%|██▌       | 9544/37963 [21:34:19<62:59:24,  7.98s/it]
 25%|██▌       | 9545/37963 [21:34:27<61:58:09,  7.85s/it]
 25%|██▌       | 9546/37963 [21:34:34<60:51:36,  7.71s/it]
 25%|██▌       | 9547/37963 [21:34:42<60:59:40,  7.73s/it]
 25%|██▌       | 9548/37963 [21:34:50<61:00:49,  7.73s/it]
 25%|██▌       | 9549/37963 [21:34:57<60:30:43,  7.67s/it]
 25%|██▌       | 9550/37963 [21:35:05<60:30:47,  7.67s/it]
                                                          
{'loss': '0.1794', 'grad_norm': '1.73', 'learning_rate': '1.753e-05', 'epoch': '0.2516'}
+
 25%|██▌       | 9550/37963 [21:35:05<60:30:47,  7.67s/it]
 25%|██▌       | 9551/37963 [21:35:13<60:35:02,  7.68s/it]
 25%|██▌       | 9552/37963 [21:35:21<60:52:31,  7.71s/it]
 25%|██▌       | 9553/37963 [21:35:28<60:58:05,  7.73s/it]
 25%|██▌       | 9554/37963 [21:35:36<60:42:28,  7.69s/it]
 25%|██▌       | 9555/37963 [21:35:44<60:25:26,  7.66s/it]
 25%|██▌       | 9556/37963 [21:35:51<60:24:30,  7.66s/it]
 25%|██▌       | 9557/37963 [21:35:59<60:10:08,  7.63s/it]
 25%|██▌       | 9558/37963 [21:36:07<60:36:09,  7.68s/it]
 25%|██▌       | 9559/37963 [21:36:14<60:52:31,  7.72s/it]
 25%|██▌       | 9560/37963 [21:36:22<60:43:55,  7.70s/it]
                                                          
{'loss': '0.1703', 'grad_norm': '5.011', 'learning_rate': '1.753e-05', 'epoch': '0.2518'}
+
 25%|██▌       | 9560/37963 [21:36:22<60:43:55,  7.70s/it]
 25%|██▌       | 9561/37963 [21:36:30<60:47:45,  7.71s/it]
 25%|██▌       | 9562/37963 [21:36:37<60:47:21,  7.71s/it]
 25%|██▌       | 9563/37963 [21:36:45<59:59:42,  7.61s/it]
 25%|██▌       | 9564/37963 [21:36:53<60:42:27,  7.70s/it]
 25%|██▌       | 9565/37963 [21:37:00<60:29:13,  7.67s/it]
 25%|██▌       | 9566/37963 [21:37:08<60:44:53,  7.70s/it]
 25%|██▌       | 9567/37963 [21:37:16<60:39:23,  7.69s/it]
 25%|██▌       | 9568/37963 [21:37:26<66:34:29,  8.44s/it]
 25%|██▌       | 9569/37963 [21:37:36<71:14:45,  9.03s/it]
 25%|██▌       | 9570/37963 [21:37:44<68:21:18,  8.67s/it]
                                                          
{'loss': '0.1659', 'grad_norm': '3.541', 'learning_rate': '1.752e-05', 'epoch': '0.2521'}
+
 25%|██▌       | 9570/37963 [21:37:44<68:21:18,  8.67s/it]
 25%|██▌       | 9571/37963 [21:37:52<65:45:35,  8.34s/it]
 25%|██▌       | 9572/37963 [21:38:02<69:59:35,  8.88s/it]
 25%|██▌       | 9573/37963 [21:38:12<73:22:46,  9.30s/it]
 25%|██▌       | 9574/37963 [21:38:20<69:52:12,  8.86s/it]
 25%|██▌       | 9575/37963 [21:38:30<73:39:44,  9.34s/it]
 25%|██▌       | 9576/37963 [21:38:41<76:14:25,  9.67s/it]
 25%|██▌       | 9577/37963 [21:38:49<71:50:20,  9.11s/it]
 25%|██▌       | 9578/37963 [21:38:57<68:47:00,  8.72s/it]
 25%|██▌       | 9579/37963 [21:39:05<67:06:05,  8.51s/it]
 25%|██▌       | 9580/37963 [21:39:12<65:04:54,  8.25s/it]
                                                          
{'loss': '0.174', 'grad_norm': '2.506', 'learning_rate': '1.752e-05', 'epoch': '0.2524'}
+
 25%|██▌       | 9580/37963 [21:39:12<65:04:54,  8.25s/it]
 25%|██▌       | 9581/37963 [21:39:20<62:59:31,  7.99s/it]
 25%|██▌       | 9582/37963 [21:39:27<62:24:47,  7.92s/it]
 25%|██▌       | 9583/37963 [21:39:35<61:45:21,  7.83s/it]
 25%|██▌       | 9584/37963 [21:39:45<67:41:27,  8.59s/it]
 25%|██▌       | 9585/37963 [21:39:53<65:46:37,  8.34s/it]
 25%|██▌       | 9586/37963 [21:40:01<64:05:55,  8.13s/it]
 25%|██▌       | 9587/37963 [21:40:11<69:10:05,  8.78s/it]
 25%|██▌       | 9588/37963 [21:40:19<66:58:38,  8.50s/it]
 25%|██▌       | 9589/37963 [21:40:27<65:44:02,  8.34s/it]
 25%|██▌       | 9590/37963 [21:40:34<63:59:47,  8.12s/it]
                                                          
{'loss': '0.1705', 'grad_norm': '1.039', 'learning_rate': '1.751e-05', 'epoch': '0.2526'}
+
 25%|██▌       | 9590/37963 [21:40:34<63:59:47,  8.12s/it]
 25%|██▌       | 9591/37963 [21:40:42<63:12:17,  8.02s/it]
 25%|██▌       | 9592/37963 [21:40:50<62:30:37,  7.93s/it]
 25%|██▌       | 9593/37963 [21:40:58<62:03:22,  7.87s/it]
 25%|██▌       | 9594/37963 [21:41:05<61:27:51,  7.80s/it]
 25%|██▌       | 9595/37963 [21:41:13<60:56:05,  7.73s/it]
 25%|██▌       | 9596/37963 [21:41:21<60:48:54,  7.72s/it]
 25%|██▌       | 9597/37963 [21:41:28<60:48:55,  7.72s/it]
 25%|██▌       | 9598/37963 [21:41:36<60:47:59,  7.72s/it]
 25%|██▌       | 9599/37963 [21:41:44<60:27:17,  7.67s/it]
 25%|██▌       | 9600/37963 [21:41:51<60:40:49,  7.70s/it]
                                                          
{'loss': '0.1668', 'grad_norm': '4.537', 'learning_rate': '1.751e-05', 'epoch': '0.2529'}
+
 25%|██▌       | 9600/37963 [21:41:51<60:40:49,  7.70s/it]
 25%|██▌       | 9601/37963 [21:41:59<60:08:39,  7.63s/it]
 25%|██▌       | 9602/37963 [21:42:06<60:08:03,  7.63s/it]
 25%|██▌       | 9603/37963 [21:42:14<60:00:30,  7.62s/it]
 25%|██▌       | 9604/37963 [21:42:21<59:30:57,  7.56s/it]
 25%|██▌       | 9605/37963 [21:42:29<59:57:54,  7.61s/it]
 25%|██▌       | 9606/37963 [21:42:37<59:56:11,  7.61s/it]
 25%|██▌       | 9607/37963 [21:42:44<59:29:19,  7.55s/it]
 25%|██▌       | 9608/37963 [21:42:52<59:29:45,  7.55s/it]
 25%|██▌       | 9609/37963 [21:42:59<59:38:25,  7.57s/it]
 25%|██▌       | 9610/37963 [21:43:07<60:00:04,  7.62s/it]
                                                          
{'loss': '0.1645', 'grad_norm': '4.688', 'learning_rate': '1.75e-05', 'epoch': '0.2531'}
+
 25%|██▌       | 9610/37963 [21:43:07<60:00:04,  7.62s/it]
 25%|██▌       | 9611/37963 [21:43:15<60:42:06,  7.71s/it]
 25%|██▌       | 9612/37963 [21:43:23<60:27:43,  7.68s/it]
 25%|██▌       | 9613/37963 [21:43:30<60:37:20,  7.70s/it]
 25%|██▌       | 9614/37963 [21:43:38<59:37:48,  7.57s/it]
 25%|██▌       | 9615/37963 [21:43:45<59:39:43,  7.58s/it]
 25%|██▌       | 9616/37963 [21:43:56<66:51:46,  8.49s/it]
 25%|██▌       | 9617/37963 [21:44:06<71:24:02,  9.07s/it]
 25%|██▌       | 9618/37963 [21:44:14<68:00:35,  8.64s/it]
 25%|██▌       | 9619/37963 [21:44:22<65:43:51,  8.35s/it]
 25%|██▌       | 9620/37963 [21:44:29<63:59:54,  8.13s/it]
                                                          
{'loss': '0.1887', 'grad_norm': '2.77', 'learning_rate': '1.75e-05', 'epoch': '0.2534'}
+
 25%|██▌       | 9620/37963 [21:44:29<63:59:54,  8.13s/it]
 25%|██▌       | 9621/37963 [21:44:39<68:56:37,  8.76s/it]
 25%|██▌       | 9622/37963 [21:44:47<66:40:32,  8.47s/it]
 25%|██▌       | 9623/37963 [21:44:55<65:06:55,  8.27s/it]
 25%|██▌       | 9624/37963 [21:45:05<69:36:37,  8.84s/it]
 25%|██▌       | 9625/37963 [21:45:13<66:54:07,  8.50s/it]
 25%|██▌       | 9626/37963 [21:45:21<64:50:09,  8.24s/it]
 25%|██▌       | 9627/37963 [21:45:28<63:12:42,  8.03s/it]
 25%|██▌       | 9628/37963 [21:45:36<62:38:28,  7.96s/it]
 25%|██▌       | 9629/37963 [21:45:46<67:54:54,  8.63s/it]
 25%|██▌       | 9630/37963 [21:45:56<71:38:50,  9.10s/it]
                                                          
{'loss': '0.171', 'grad_norm': '4.638', 'learning_rate': '1.749e-05', 'epoch': '0.2537'}
+
 25%|██▌       | 9630/37963 [21:45:56<71:38:50,  9.10s/it]
 25%|██▌       | 9631/37963 [21:46:04<68:40:25,  8.73s/it]
 25%|██▌       | 9632/37963 [21:46:14<71:51:21,  9.13s/it]
 25%|██▌       | 9633/37963 [21:46:22<67:46:42,  8.61s/it]
 25%|██▌       | 9634/37963 [21:46:29<65:40:19,  8.35s/it]
 25%|██▌       | 9635/37963 [21:46:37<63:56:16,  8.13s/it]
 25%|██▌       | 9636/37963 [21:46:45<62:46:16,  7.98s/it]
 25%|██▌       | 9637/37963 [21:46:52<61:56:26,  7.87s/it]
 25%|██▌       | 9638/37963 [21:47:00<61:23:52,  7.80s/it]
 25%|██▌       | 9639/37963 [21:47:08<61:27:31,  7.81s/it]
 25%|██▌       | 9640/37963 [21:47:15<61:08:56,  7.77s/it]
                                                          
{'loss': '0.177', 'grad_norm': '1.404', 'learning_rate': '1.748e-05', 'epoch': '0.2539'}
+
 25%|██▌       | 9640/37963 [21:47:15<61:08:56,  7.77s/it]
 25%|██▌       | 9641/37963 [21:47:25<66:41:14,  8.48s/it]
 25%|██▌       | 9642/37963 [21:47:33<65:00:01,  8.26s/it]
 25%|██▌       | 9643/37963 [21:47:41<63:39:06,  8.09s/it]
 25%|██▌       | 9644/37963 [21:47:48<62:22:32,  7.93s/it]
 25%|██▌       | 9645/37963 [21:47:56<61:19:03,  7.80s/it]
 25%|██▌       | 9646/37963 [21:48:04<60:50:04,  7.73s/it]
 25%|██▌       | 9647/37963 [21:48:11<60:59:58,  7.76s/it]
 25%|██▌       | 9648/37963 [21:48:19<60:47:20,  7.73s/it]
 25%|██▌       | 9649/37963 [21:48:27<61:14:40,  7.79s/it]
 25%|██▌       | 9650/37963 [21:48:35<60:52:01,  7.74s/it]
                                                          
{'loss': '0.1602', 'grad_norm': '3.125', 'learning_rate': '1.748e-05', 'epoch': '0.2542'}
+
 25%|██▌       | 9650/37963 [21:48:35<60:52:01,  7.74s/it]
 25%|██▌       | 9651/37963 [21:48:42<60:40:04,  7.71s/it]
 25%|██▌       | 9652/37963 [21:48:50<60:22:59,  7.68s/it]
 25%|██▌       | 9653/37963 [21:48:58<60:31:35,  7.70s/it]
 25%|██▌       | 9654/37963 [21:49:05<60:34:56,  7.70s/it]
 25%|██▌       | 9655/37963 [21:49:13<60:26:04,  7.69s/it]
 25%|██▌       | 9656/37963 [21:49:21<60:25:07,  7.68s/it]
 25%|██▌       | 9657/37963 [21:49:28<60:34:25,  7.70s/it]
 25%|██▌       | 9658/37963 [21:49:36<60:36:31,  7.71s/it]
 25%|██▌       | 9659/37963 [21:49:44<60:20:52,  7.68s/it]
 25%|██▌       | 9660/37963 [21:49:51<60:32:01,  7.70s/it]
                                                          
{'loss': '0.1691', 'grad_norm': '1.405', 'learning_rate': '1.747e-05', 'epoch': '0.2545'}
+
 25%|██▌       | 9660/37963 [21:49:51<60:32:01,  7.70s/it]
 25%|██▌       | 9661/37963 [21:49:59<60:20:28,  7.68s/it]
 25%|██▌       | 9662/37963 [21:50:07<60:39:04,  7.72s/it]
 25%|██▌       | 9663/37963 [21:50:15<60:30:44,  7.70s/it]
 25%|██▌       | 9664/37963 [21:50:25<66:50:41,  8.50s/it]
 25%|██▌       | 9665/37963 [21:50:33<65:10:26,  8.29s/it]
 25%|██▌       | 9666/37963 [21:50:40<63:39:35,  8.10s/it]
 25%|██▌       | 9667/37963 [21:50:48<62:37:56,  7.97s/it]
 25%|██▌       | 9668/37963 [21:50:56<62:11:58,  7.91s/it]
 25%|██▌       | 9669/37963 [21:51:03<61:31:25,  7.83s/it]
 25%|██▌       | 9670/37963 [21:51:14<67:16:42,  8.56s/it]
                                                          
{'loss': '0.171', 'grad_norm': '4.789', 'learning_rate': '1.747e-05', 'epoch': '0.2547'}
+
 25%|██▌       | 9670/37963 [21:51:14<67:16:42,  8.56s/it]
 25%|██▌       | 9671/37963 [21:51:21<65:10:54,  8.29s/it]
 25%|██▌       | 9672/37963 [21:51:29<63:38:40,  8.10s/it]
 25%|██▌       | 9673/37963 [21:51:39<68:47:04,  8.75s/it]
 25%|██▌       | 9674/37963 [21:51:47<65:52:16,  8.38s/it]
 25%|██▌       | 9675/37963 [21:51:57<70:14:10,  8.94s/it]
 25%|██▌       | 9676/37963 [21:52:05<67:39:34,  8.61s/it]
 25%|██▌       | 9677/37963 [21:52:12<65:15:06,  8.30s/it]
 25%|██▌       | 9678/37963 [21:52:23<69:21:13,  8.83s/it]
 25%|██▌       | 9679/37963 [21:52:30<66:17:43,  8.44s/it]
 25%|██▌       | 9680/37963 [21:52:38<65:01:01,  8.28s/it]
                                                          
{'loss': '0.1726', 'grad_norm': '1.296', 'learning_rate': '1.746e-05', 'epoch': '0.255'}
+
 25%|██▌       | 9680/37963 [21:52:38<65:01:01,  8.28s/it]
 26%|██▌       | 9681/37963 [21:52:46<63:43:05,  8.11s/it]
 26%|██▌       | 9682/37963 [21:52:54<63:46:43,  8.12s/it]
 26%|██▌       | 9683/37963 [21:53:04<68:47:48,  8.76s/it]
 26%|██▌       | 9684/37963 [21:53:12<66:14:50,  8.43s/it]
 26%|██▌       | 9685/37963 [21:53:19<64:17:58,  8.19s/it]
 26%|██▌       | 9686/37963 [21:53:29<68:30:22,  8.72s/it]
 26%|██▌       | 9687/37963 [21:53:37<66:13:46,  8.43s/it]
 26%|██▌       | 9688/37963 [21:53:45<64:32:20,  8.22s/it]
 26%|██▌       | 9689/37963 [21:53:55<69:18:13,  8.82s/it]
 26%|██▌       | 9690/37963 [21:54:03<66:29:41,  8.47s/it]
                                                          
{'loss': '0.1859', 'grad_norm': '5.388', 'learning_rate': '1.746e-05', 'epoch': '0.2552'}
+
 26%|██▌       | 9690/37963 [21:54:03<66:29:41,  8.47s/it]
 26%|██▌       | 9691/37963 [21:54:10<64:19:27,  8.19s/it]
 26%|██▌       | 9692/37963 [21:54:17<61:58:15,  7.89s/it]
 26%|██▌       | 9693/37963 [21:54:25<61:26:26,  7.82s/it]
 26%|██▌       | 9694/37963 [21:54:33<61:27:42,  7.83s/it]
 26%|██▌       | 9695/37963 [21:54:41<61:19:29,  7.81s/it]
 26%|██▌       | 9696/37963 [21:54:48<61:12:02,  7.79s/it]
 26%|██▌       | 9697/37963 [21:54:56<61:09:03,  7.79s/it]
 26%|██▌       | 9698/37963 [21:55:04<60:43:38,  7.73s/it]
 26%|██▌       | 9699/37963 [21:55:11<60:14:20,  7.67s/it]
 26%|██▌       | 9700/37963 [21:55:19<60:10:43,  7.67s/it]
                                                          
{'loss': '0.1794', 'grad_norm': '1.166', 'learning_rate': '1.745e-05', 'epoch': '0.2555'}
+
 26%|██▌       | 9700/37963 [21:55:19<60:10:43,  7.67s/it]
 26%|██▌       | 9701/37963 [21:55:27<60:54:21,  7.76s/it]
 26%|██▌       | 9702/37963 [21:55:35<60:41:01,  7.73s/it]
 26%|██▌       | 9703/37963 [21:55:42<59:52:54,  7.63s/it]
 26%|██▌       | 9704/37963 [21:55:50<59:40:51,  7.60s/it]
 26%|██▌       | 9705/37963 [21:55:57<59:56:32,  7.64s/it]
 26%|██▌       | 9706/37963 [21:56:05<59:48:56,  7.62s/it]
 26%|██▌       | 9707/37963 [21:56:12<59:49:00,  7.62s/it]
 26%|██▌       | 9708/37963 [21:56:20<59:53:28,  7.63s/it]
 26%|██▌       | 9709/37963 [21:56:28<60:08:16,  7.66s/it]
 26%|██▌       | 9710/37963 [21:56:36<60:44:21,  7.74s/it]
                                                          
{'loss': '0.1554', 'grad_norm': '3.184', 'learning_rate': '1.744e-05', 'epoch': '0.2558'}
+
 26%|██▌       | 9710/37963 [21:56:36<60:44:21,  7.74s/it]
 26%|██▌       | 9711/37963 [21:56:44<61:20:37,  7.82s/it]
 26%|██▌       | 9712/37963 [21:56:54<67:56:31,  8.66s/it]
 26%|██▌       | 9713/37963 [21:57:02<65:57:03,  8.40s/it]
 26%|██▌       | 9714/37963 [21:57:10<64:14:20,  8.19s/it]
 26%|██▌       | 9715/37963 [21:57:18<63:11:13,  8.05s/it]
 26%|██▌       | 9716/37963 [21:57:25<62:27:26,  7.96s/it]
 26%|██▌       | 9717/37963 [21:57:33<62:38:23,  7.98s/it]
 26%|██▌       | 9718/37963 [21:57:41<62:25:03,  7.96s/it]
 26%|██▌       | 9719/37963 [21:57:49<61:39:46,  7.86s/it]
 26%|██▌       | 9720/37963 [21:57:57<61:10:51,  7.80s/it]
                                                          
{'loss': '0.1858', 'grad_norm': '1.123', 'learning_rate': '1.744e-05', 'epoch': '0.256'}
+
 26%|██▌       | 9720/37963 [21:57:57<61:10:51,  7.80s/it]
 26%|██▌       | 9721/37963 [21:58:04<60:26:18,  7.70s/it]
 26%|██▌       | 9722/37963 [21:58:14<66:03:10,  8.42s/it]
 26%|██▌       | 9723/37963 [21:58:25<70:55:45,  9.04s/it]
 26%|██▌       | 9724/37963 [21:58:35<73:54:12,  9.42s/it]
 26%|██���       | 9725/37963 [21:58:43<70:08:03,  8.94s/it]
 26%|██▌       | 9726/37963 [21:58:50<66:49:11,  8.52s/it]
 26%|██▌       | 9727/37963 [21:58:58<64:46:59,  8.26s/it]
 26%|██▌       | 9728/37963 [21:59:06<63:34:32,  8.11s/it]
 26%|██▌       | 9729/37963 [21:59:14<62:57:26,  8.03s/it]
 26%|██▌       | 9730/37963 [21:59:24<68:30:19,  8.74s/it]
                                                          
{'loss': '0.1805', 'grad_norm': '3.697', 'learning_rate': '1.743e-05', 'epoch': '0.2563'}
+
 26%|██▌       | 9730/37963 [21:59:24<68:30:19,  8.74s/it]
 26%|██▌       | 9731/37963 [21:59:32<66:16:48,  8.45s/it]
 26%|██▌       | 9732/37963 [21:59:42<70:35:37,  9.00s/it]
 26%|██▌       | 9733/37963 [21:59:50<67:39:19,  8.63s/it]
 26%|██▌       | 9734/37963 [21:59:57<65:03:41,  8.30s/it]
 26%|██▌       | 9735/37963 [22:00:05<63:32:56,  8.10s/it]
 26%|██▌       | 9736/37963 [22:00:13<63:02:02,  8.04s/it]
 26%|██▌       | 9737/37963 [22:00:23<68:26:54,  8.73s/it]
 26%|██▌       | 9738/37963 [22:00:34<73:02:44,  9.32s/it]
 26%|██▌       | 9739/37963 [22:00:42<69:53:55,  8.92s/it]
 26%|██▌       | 9740/37963 [22:00:50<66:57:31,  8.54s/it]
                                                          
{'loss': '0.1749', 'grad_norm': '2.785', 'learning_rate': '1.743e-05', 'epoch': '0.2566'}
+
 26%|██▌       | 9740/37963 [22:00:50<66:57:31,  8.54s/it]
 26%|██▌       | 9741/37963 [22:00:57<64:16:25,  8.20s/it]
 26%|██▌       | 9742/37963 [22:01:05<63:48:56,  8.14s/it]
 26%|██▌       | 9743/37963 [22:01:13<62:58:03,  8.03s/it]
 26%|██▌       | 9744/37963 [22:01:20<62:12:49,  7.94s/it]
 26%|██▌       | 9745/37963 [22:01:28<62:13:54,  7.94s/it]
 26%|██▌       | 9746/37963 [22:01:36<62:07:49,  7.93s/it]
 26%|██▌       | 9747/37963 [22:01:44<61:51:54,  7.89s/it]
 26%|██▌       | 9748/37963 [22:01:52<61:15:07,  7.82s/it]
 26%|██▌       | 9749/37963 [22:01:59<60:17:06,  7.69s/it]
 26%|██▌       | 9750/37963 [22:02:07<60:10:41,  7.68s/it]
                                                          
{'loss': '0.1546', 'grad_norm': '2.418', 'learning_rate': '1.742e-05', 'epoch': '0.2568'}
+
 26%|██▌       | 9750/37963 [22:02:07<60:10:41,  7.68s/it]
 26%|██▌       | 9751/37963 [22:02:14<60:05:04,  7.67s/it]
 26%|██▌       | 9752/37963 [22:02:22<59:48:45,  7.63s/it]
 26%|██▌       | 9753/37963 [22:02:30<60:00:02,  7.66s/it]
 26%|██▌       | 9754/37963 [22:02:37<60:16:33,  7.69s/it]
 26%|██▌       | 9755/37963 [22:02:45<60:05:24,  7.67s/it]
 26%|██▌       | 9756/37963 [22:02:53<60:07:07,  7.67s/it]
 26%|██▌       | 9757/37963 [22:03:00<59:13:57,  7.56s/it]
 26%|██▌       | 9758/37963 [22:03:08<59:00:26,  7.53s/it]
 26%|██▌       | 9759/37963 [22:03:15<59:25:12,  7.58s/it]
 26%|██▌       | 9760/37963 [22:03:26<66:07:36,  8.44s/it]
                                                          
{'loss': '0.1602', 'grad_norm': '3.688', 'learning_rate': '1.742e-05', 'epoch': '0.2571'}
+
 26%|██▌       | 9760/37963 [22:03:26<66:07:36,  8.44s/it]
 26%|██▌       | 9761/37963 [22:03:34<65:02:23,  8.30s/it]
 26%|██▌       | 9762/37963 [22:03:41<63:23:37,  8.09s/it]
 26%|██▌       | 9763/37963 [22:03:48<60:46:04,  7.76s/it]
 26%|██▌       | 9764/37963 [22:03:56<60:41:04,  7.75s/it]
 26%|██▌       | 9765/37963 [22:04:04<60:21:01,  7.70s/it]
 26%|██▌       | 9766/37963 [22:04:11<60:10:59,  7.68s/it]
 26%|██▌       | 9767/37963 [22:04:19<60:44:45,  7.76s/it]
 26%|██▌       | 9768/37963 [22:04:29<66:39:33,  8.51s/it]
 26%|██▌       | 9769/37963 [22:04:37<65:23:20,  8.35s/it]
 26%|██▌       | 9770/37963 [22:04:45<63:29:47,  8.11s/it]
                                                          
{'loss': '0.1433', 'grad_norm': '1.735', 'learning_rate': '1.741e-05', 'epoch': '0.2574'}
+
 26%|██▌       | 9770/37963 [22:04:45<63:29:47,  8.11s/it]
 26%|██▌       | 9771/37963 [22:04:53<62:18:23,  7.96s/it]
 26%|██▌       | 9772/37963 [22:05:01<62:24:45,  7.97s/it]
 26%|██▌       | 9773/37963 [22:05:11<68:17:56,  8.72s/it]
 26%|██▌       | 9774/37963 [22:05:21<71:47:36,  9.17s/it]
 26%|██▌       | 9775/37963 [22:05:29<68:23:10,  8.73s/it]
 26%|██▌       | 9776/37963 [22:05:37<66:03:00,  8.44s/it]
 26%|██▌       | 9777/37963 [22:05:44<64:23:12,  8.22s/it]
 26%|██▌       | 9778/37963 [22:05:52<63:26:46,  8.10s/it]
 26%|██▌       | 9779/37963 [22:06:00<62:13:45,  7.95s/it]
 26%|██▌       | 9780/37963 [22:06:10<67:51:42,  8.67s/it]
                                                          
{'loss': '0.1721', 'grad_norm': '1.86', 'learning_rate': '1.74e-05', 'epoch': '0.2576'}
+
 26%|██▌       | 9780/37963 [22:06:10<67:51:42,  8.67s/it]
 26%|██▌       | 9781/37963 [22:06:18<65:19:24,  8.34s/it]
 26%|██▌       | 9782/37963 [22:06:25<63:56:07,  8.17s/it]
 26%|██▌       | 9783/37963 [22:06:33<62:16:58,  7.96s/it]
 26%|██▌       | 9784/37963 [22:06:41<61:27:27,  7.85s/it]
 26%|██▌       | 9785/37963 [22:06:48<60:36:02,  7.74s/it]
 26%|██▌       | 9786/37963 [22:06:56<60:06:06,  7.68s/it]
 26%|██▌       | 9787/37963 [22:07:03<60:18:44,  7.71s/it]
 26%|██▌       | 9788/37963 [22:07:11<60:36:35,  7.74s/it]
 26%|██▌       | 9789/37963 [22:07:19<60:47:10,  7.77s/it]
 26%|██▌       | 9790/37963 [22:07:29<66:51:48,  8.54s/it]
                                                          
{'loss': '0.1657', 'grad_norm': '1.886', 'learning_rate': '1.74e-05', 'epoch': '0.2579'}
+
 26%|██▌       | 9790/37963 [22:07:29<66:51:48,  8.54s/it]
 26%|██▌       | 9791/37963 [22:07:40<71:03:57,  9.08s/it]
 26%|██▌       | 9792/37963 [22:07:47<67:51:48,  8.67s/it]
 26%|██▌       | 9793/37963 [22:07:55<65:56:23,  8.43s/it]
 26%|██▌       | 9794/37963 [22:08:03<63:40:11,  8.14s/it]
 26%|██▌       | 9795/37963 [22:08:11<62:54:30,  8.04s/it]
 26%|██▌       | 9796/37963 [22:08:18<61:36:09,  7.87s/it]
 26%|██▌       | 9797/37963 [22:08:26<61:19:56,  7.84s/it]
 26%|██▌       | 9798/37963 [22:08:33<60:47:11,  7.77s/it]
 26%|██▌       | 9799/37963 [22:08:41<60:26:12,  7.73s/it]
 26%|██▌       | 9800/37963 [22:08:49<60:17:03,  7.71s/it]
                                                          
{'loss': '0.169', 'grad_norm': '2.389', 'learning_rate': '1.739e-05', 'epoch': '0.2581'}
+
 26%|██▌       | 9800/37963 [22:08:49<60:17:03,  7.71s/it]
 26%|██▌       | 9801/37963 [22:08:56<59:28:04,  7.60s/it]
 26%|██▌       | 9802/37963 [22:09:03<58:37:23,  7.49s/it]
 26%|██▌       | 9803/37963 [22:09:11<58:43:00,  7.51s/it]
 26%|██▌       | 9804/37963 [22:09:19<59:10:26,  7.57s/it]
 26%|██▌       | 9805/37963 [22:09:26<59:44:52,  7.64s/it]
 26%|██▌       | 9806/37963 [22:09:34<58:50:58,  7.52s/it]
 26%|██▌       | 9807/37963 [22:09:41<59:12:33,  7.57s/it]
 26%|██▌       | 9808/37963 [22:09:49<59:35:13,  7.62s/it]
 26%|██▌       | 9809/37963 [22:09:57<59:32:19,  7.61s/it]
 26%|██▌       | 9810/37963 [22:10:04<59:50:07,  7.65s/it]
                                                          
{'loss': '0.1699', 'grad_norm': '3.762', 'learning_rate': '1.739e-05', 'epoch': '0.2584'}
+
 26%|██▌       | 9810/37963 [22:10:04<59:50:07,  7.65s/it]
 26%|██▌       | 9811/37963 [22:10:12<59:21:46,  7.59s/it]
 26%|██▌       | 9812/37963 [22:10:22<65:23:59,  8.36s/it]
 26%|██▌       | 9813/37963 [22:10:30<63:32:29,  8.13s/it]
 26%|██▌       | 9814/37963 [22:10:40<69:29:45,  8.89s/it]
 26%|██▌       | 9815/37963 [22:10:48<66:51:33,  8.55s/it]
 26%|██▌       | 9816/37963 [22:10:56<64:44:35,  8.28s/it]
 26%|██▌       | 9817/37963 [22:11:03<63:28:36,  8.12s/it]
 26%|██▌       | 9818/37963 [22:11:11<62:22:12,  7.98s/it]
 26%|██▌       | 9819/37963 [22:11:19<61:46:34,  7.90s/it]
 26%|██▌       | 9820/37963 [22:11:26<61:18:41,  7.84s/it]
                                                          
{'loss': '0.1546', 'grad_norm': '2.622', 'learning_rate': '1.738e-05', 'epoch': '0.2587'}
+
 26%|██▌       | 9820/37963 [22:11:26<61:18:41,  7.84s/it]
 26%|██▌       | 9821/37963 [22:11:36<65:56:21,  8.44s/it]
 26%|██▌       | 9822/37963 [22:11:44<64:16:46,  8.22s/it]
 26%|██▌       | 9823/37963 [22:11:52<62:54:15,  8.05s/it]
 26%|██▌       | 9824/37963 [22:11:59<62:03:22,  7.94s/it]
 26%|██▌       | 9825/37963 [22:12:07<61:11:09,  7.83s/it]
 26%|██▌       | 9826/37963 [22:12:15<61:04:43,  7.81s/it]
 26%|██▌       | 9827/37963 [22:12:28<73:05:18,  9.35s/it]
 26%|██▌       | 9828/37963 [22:12:38<75:05:29,  9.61s/it]
 26%|██▌       | 9829/37963 [22:12:46<71:22:02,  9.13s/it]
 26%|██▌       | 9830/37963 [22:12:54<68:18:48,  8.74s/it]
                                                          
{'loss': '0.1773', 'grad_norm': '2.539', 'learning_rate': '1.738e-05', 'epoch': '0.2589'}
+
 26%|██▌       | 9830/37963 [22:12:54<68:18:48,  8.74s/it]
 26%|██▌       | 9831/37963 [22:13:02<66:29:51,  8.51s/it]
 26%|██▌       | 9832/37963 [22:13:09<63:57:04,  8.18s/it]
 26%|██▌       | 9833/37963 [22:13:17<63:08:28,  8.08s/it]
 26%|██▌       | 9834/37963 [22:13:25<62:15:18,  7.97s/it]
 26%|██▌       | 9835/37963 [22:13:32<61:05:07,  7.82s/it]
 26%|██▌       | 9836/37963 [22:13:40<60:34:54,  7.75s/it]
 26%|██▌       | 9837/37963 [22:13:50<66:30:27,  8.51s/it]
 26%|██▌       | 9838/37963 [22:13:58<65:03:22,  8.33s/it]
 26%|██▌       | 9839/37963 [22:14:06<64:05:23,  8.20s/it]
 26%|██▌       | 9840/37963 [22:14:13<62:22:32,  7.98s/it]
                                                          
{'loss': '0.168', 'grad_norm': '2.853', 'learning_rate': '1.737e-05', 'epoch': '0.2592'}
+
 26%|██▌       | 9840/37963 [22:14:13<62:22:32,  7.98s/it]
 26%|██▌       | 9841/37963 [22:14:21<61:18:39,  7.85s/it]
 26%|██▌       | 9842/37963 [22:14:28<60:39:06,  7.76s/it]
 26%|██▌       | 9843/37963 [22:14:36<60:52:44,  7.79s/it]
 26%|██▌       | 9844/37963 [22:14:44<60:29:58,  7.75s/it]
 26%|██▌       | 9845/37963 [22:14:54<66:18:34,  8.49s/it]
 26%|██▌       | 9846/37963 [22:15:02<64:34:24,  8.27s/it]
 26%|██▌       | 9847/37963 [22:15:10<63:24:19,  8.12s/it]
 26%|██▌       | 9848/37963 [22:15:18<63:10:58,  8.09s/it]
 26%|██▌       | 9849/37963 [22:15:25<62:31:01,  8.01s/it]
 26%|██▌       | 9850/37963 [22:15:33<62:01:14,  7.94s/it]
                                                          
{'loss': '0.1639', 'grad_norm': '1.273', 'learning_rate': '1.736e-05', 'epoch': '0.2595'}
+
 26%|██▌       | 9850/37963 [22:15:33<62:01:14,  7.94s/it]
 26%|██▌       | 9851/37963 [22:15:41<61:45:56,  7.91s/it]
 26%|██▌       | 9852/37963 [22:15:49<61:31:50,  7.88s/it]
 26%|██▌       | 9853/37963 [22:15:57<61:10:40,  7.83s/it]
 26%|██▌       | 9854/37963 [22:16:04<60:51:13,  7.79s/it]
 26%|██▌       | 9855/37963 [22:16:14<66:27:30,  8.51s/it]
 26%|██▌       | 9856/37963 [22:16:22<64:40:27,  8.28s/it]
 26%|██▌       | 9857/37963 [22:16:30<63:36:06,  8.15s/it]
 26%|██▌       | 9858/37963 [22:16:41<69:31:33,  8.91s/it]
 26%|██▌       | 9859/37963 [22:16:48<66:44:36,  8.55s/it]
 26%|██▌       | 9860/37963 [22:16:56<64:34:15,  8.27s/it]
                                                          
{'loss': '0.1632', 'grad_norm': '4.097', 'learning_rate': '1.736e-05', 'epoch': '0.2597'}
+
 26%|██▌       | 9860/37963 [22:16:56<64:34:15,  8.27s/it]
 26%|██▌       | 9861/37963 [22:17:04<63:11:35,  8.10s/it]
 26%|██▌       | 9862/37963 [22:17:11<62:03:20,  7.95s/it]
 26%|██▌       | 9863/37963 [22:17:19<61:32:29,  7.88s/it]
 26%|██▌       | 9864/37963 [22:17:27<61:39:00,  7.90s/it]
 26%|██▌       | 9865/37963 [22:17:37<66:58:47,  8.58s/it]
 26%|██▌       | 9866/37963 [22:17:45<64:08:10,  8.22s/it]
 26%|██▌       | 9867/37963 [22:17:52<63:05:55,  8.08s/it]
 26%|██▌       | 9868/37963 [22:18:00<62:16:15,  7.98s/it]
 26%|██▌       | 9869/37963 [22:18:08<61:50:22,  7.92s/it]
 26%|██▌       | 9870/37963 [22:18:16<61:23:37,  7.87s/it]
                                                          
{'loss': '0.167', 'grad_norm': '1.98', 'learning_rate': '1.735e-05', 'epoch': '0.26'}
+
 26%|██▌       | 9870/37963 [22:18:16<61:23:37,  7.87s/it]
 26%|██▌       | 9871/37963 [22:18:26<67:06:07,  8.60s/it]
 26%|██▌       | 9872/37963 [22:18:36<70:44:45,  9.07s/it]
 26%|██▌       | 9873/37963 [22:18:44<67:23:33,  8.64s/it]
 26%|██▌       | 9874/37963 [22:18:51<64:45:04,  8.30s/it]
 26%|██▌       | 9875/37963 [22:18:59<63:13:33,  8.10s/it]
 26%|██▌       | 9876/37963 [22:19:06<61:56:18,  7.94s/it]
 26%|██▌       | 9877/37963 [22:19:14<61:31:37,  7.89s/it]
 26%|██▌       | 9878/37963 [22:19:22<61:18:12,  7.86s/it]
 26%|██▌       | 9879/37963 [22:19:30<61:23:42,  7.87s/it]
 26%|██▌       | 9880/37963 [22:19:37<60:38:25,  7.77s/it]
                                                          
{'loss': '0.1824', 'grad_norm': '1.375', 'learning_rate': '1.735e-05', 'epoch': '0.2603'}
+
 26%|██▌       | 9880/37963 [22:19:37<60:38:25,  7.77s/it]
 26%|██▌       | 9881/37963 [22:19:48<66:15:13,  8.49s/it]
 26%|██▌       | 9882/37963 [22:19:55<64:29:37,  8.27s/it]
 26%|██▌       | 9883/37963 [22:20:03<63:07:16,  8.09s/it]
 26%|██▌       | 9884/37963 [22:20:10<61:45:52,  7.92s/it]
 26%|██▌       | 9885/37963 [22:20:18<61:23:10,  7.87s/it]
 26%|██▌       | 9886/37963 [22:20:26<60:45:58,  7.79s/it]
 26%|██▌       | 9887/37963 [22:20:34<60:25:25,  7.75s/it]
 26%|██▌       | 9888/37963 [22:20:41<60:34:08,  7.77s/it]
 26%|██▌       | 9889/37963 [22:20:49<59:52:55,  7.68s/it]
 26%|██▌       | 9890/37963 [22:20:56<59:18:12,  7.60s/it]
                                                          
{'loss': '0.1716', 'grad_norm': '1.921', 'learning_rate': '1.734e-05', 'epoch': '0.2605'}
+
 26%|██▌       | 9890/37963 [22:20:56<59:18:12,  7.60s/it]
 26%|██▌       | 9891/37963 [22:21:06<65:31:46,  8.40s/it]
 26%|██▌       | 9892/37963 [22:21:14<63:40:26,  8.17s/it]
 26%|██▌       | 9893/37963 [22:21:22<62:29:17,  8.01s/it]
 26%|██▌       | 9894/37963 [22:21:29<61:42:05,  7.91s/it]
 26%|██▌       | 9895/37963 [22:21:37<61:37:10,  7.90s/it]
 26%|██▌       | 9896/37963 [22:21:45<61:21:18,  7.87s/it]
 26%|██▌       | 9897/37963 [22:21:53<60:38:39,  7.78s/it]
 26%|██▌       | 9898/37963 [22:22:00<60:26:20,  7.75s/it]
 26%|██▌       | 9899/37963 [22:22:13<72:44:59,  9.33s/it]
 26%|██▌       | 9900/37963 [22:22:21<69:46:13,  8.95s/it]
                                                          
{'loss': '0.1805', 'grad_norm': '2.907', 'learning_rate': '1.733e-05', 'epoch': '0.2608'}
+
 26%|██▌       | 9900/37963 [22:22:21<69:46:13,  8.95s/it]
 26%|██▌       | 9901/37963 [22:22:29<67:18:51,  8.64s/it]
 26%|██▌       | 9902/37963 [22:22:37<64:38:38,  8.29s/it]
 26%|██▌       | 9903/37963 [22:22:45<63:28:21,  8.14s/it]
 26%|██▌       | 9904/37963 [22:22:52<62:19:23,  8.00s/it]
 26%|██▌       | 9905/37963 [22:23:00<61:42:19,  7.92s/it]
 26%|██▌       | 9906/37963 [22:23:11<67:50:03,  8.70s/it]
 26%|██▌       | 9907/37963 [22:23:18<65:51:38,  8.45s/it]
 26%|██▌       | 9908/37963 [22:23:26<64:10:58,  8.24s/it]
 26%|██▌       | 9909/37963 [22:23:34<63:17:57,  8.12s/it]
 26%|██▌       | 9910/37963 [22:23:42<62:30:26,  8.02s/it]
                                                          
{'loss': '0.1758', 'grad_norm': '1.725', 'learning_rate': '1.733e-05', 'epoch': '0.261'}
+
 26%|██▌       | 9910/37963 [22:23:42<62:30:26,  8.02s/it]
 26%|██▌       | 9911/37963 [22:23:49<61:42:58,  7.92s/it]
 26%|██▌       | 9912/37963 [22:23:57<61:10:28,  7.85s/it]
 26%|██▌       | 9913/37963 [22:24:05<61:02:03,  7.83s/it]
 26%|██▌       | 9914/37963 [22:24:15<66:39:35,  8.56s/it]
 26%|██▌       | 9915/37963 [22:24:23<64:20:20,  8.26s/it]
 26%|██▌       | 9916/37963 [22:24:30<62:52:22,  8.07s/it]
 26%|██▌       | 9917/37963 [22:24:38<62:05:01,  7.97s/it]
 26%|██▌       | 9918/37963 [22:24:46<61:30:22,  7.90s/it]
 26%|██▌       | 9919/37963 [22:24:56<67:26:25,  8.66s/it]
 26%|██▌       | 9920/37963 [22:25:04<65:35:12,  8.42s/it]
                                                          
{'loss': '0.1664', 'grad_norm': '1.173', 'learning_rate': '1.732e-05', 'epoch': '0.2613'}
+
 26%|██▌       | 9920/37963 [22:25:04<65:35:12,  8.42s/it]
 26%|██▌       | 9921/37963 [22:25:12<63:03:45,  8.10s/it]
 26%|██▌       | 9922/37963 [22:25:19<61:25:20,  7.89s/it]
 26%|██▌       | 9923/37963 [22:25:26<60:30:55,  7.77s/it]
 26%|██▌       | 9924/37963 [22:25:34<60:26:31,  7.76s/it]
 26%|██▌       | 9925/37963 [22:25:41<59:22:05,  7.62s/it]
 26%|██▌       | 9926/37963 [22:25:52<65:47:42,  8.45s/it]
 26%|██▌       | 9927/37963 [22:25:59<63:32:11,  8.16s/it]
 26%|██▌       | 9928/37963 [22:26:07<61:39:38,  7.92s/it]
 26%|██▌       | 9929/37963 [22:26:17<66:59:56,  8.60s/it]
 26%|██▌       | 9930/37963 [22:26:24<64:37:36,  8.30s/it]
                                                          
{'loss': '0.1852', 'grad_norm': '4.861', 'learning_rate': '1.732e-05', 'epoch': '0.2616'}
+
 26%|██▌       | 9930/37963 [22:26:24<64:37:36,  8.30s/it]
 26%|██▌       | 9931/37963 [22:26:32<63:21:17,  8.14s/it]
 26%|██▌       | 9932/37963 [22:26:40<62:25:31,  8.02s/it]
 26%|██▌       | 9933/37963 [22:26:48<61:27:50,  7.89s/it]
 26%|██▌       | 9934/37963 [22:26:55<61:14:34,  7.87s/it]
 26%|██▌       | 9935/37963 [22:27:06<66:40:04,  8.56s/it]
 26%|██▌       | 9936/37963 [22:27:13<63:46:38,  8.19s/it]
 26%|██▌       | 9937/37963 [22:27:21<62:36:10,  8.04s/it]
 26%|██▌       | 9938/37963 [22:27:28<62:01:37,  7.97s/it]
 26%|██▌       | 9939/37963 [22:27:36<61:31:38,  7.90s/it]
 26%|██▌       | 9940/37963 [22:27:44<61:06:21,  7.85s/it]
                                                          
{'loss': '0.1646', 'grad_norm': '1.825', 'learning_rate': '1.731e-05', 'epoch': '0.2618'}
+
 26%|██▌       | 9940/37963 [22:27:44<61:06:21,  7.85s/it]
 26%|██▌       | 9941/37963 [22:27:51<60:23:33,  7.76s/it]
 26%|██▌       | 9942/37963 [22:27:59<60:02:42,  7.71s/it]
 26%|██▌       | 9943/37963 [22:28:07<59:55:38,  7.70s/it]
 26%|██▌       | 9944/37963 [22:28:15<60:20:22,  7.75s/it]
 26%|██▌       | 9945/37963 [22:28:22<60:10:25,  7.73s/it]
 26%|██▌       | 9946/37963 [22:28:30<60:26:10,  7.77s/it]
 26%|██▌       | 9947/37963 [22:28:38<60:31:18,  7.78s/it]
 26%|██▌       | 9948/37963 [22:28:46<60:31:18,  7.78s/it]
 26%|██▌       | 9949/37963 [22:28:53<60:31:40,  7.78s/it]
 26%|██▌       | 9950/37963 [22:29:01<59:19:07,  7.62s/it]
                                                          
{'loss': '0.1649', 'grad_norm': '2.899', 'learning_rate': '1.731e-05', 'epoch': '0.2621'}
+
 26%|██▌       | 9950/37963 [22:29:01<59:19:07,  7.62s/it]
 26%|██▌       | 9951/37963 [22:29:08<59:27:35,  7.64s/it]
 26%|██▌       | 9952/37963 [22:29:16<59:40:09,  7.67s/it]
 26%|██▌       | 9953/37963 [22:29:29<70:48:47,  9.10s/it]
 26%|██▌       | 9954/37963 [22:29:39<74:48:15,  9.61s/it]
 26%|██▌       | 9955/37963 [22:29:47<70:48:18,  9.10s/it]
 26%|██▌       | 9956/37963 [22:29:55<67:47:59,  8.71s/it]
 26%|██▌       | 9957/37963 [22:30:03<65:23:23,  8.41s/it]
 26%|██▌       | 9958/37963 [22:30:13<69:30:12,  8.93s/it]
 26%|██▌       | 9959/37963 [22:30:20<66:16:15,  8.52s/it]
 26%|██▌       | 9960/37963 [22:30:28<64:14:59,  8.26s/it]
                                                          
{'loss': '0.1672', 'grad_norm': '1.815', 'learning_rate': '1.73e-05', 'epoch': '0.2624'}
+
 26%|██▌       | 9960/37963 [22:30:28<64:14:59,  8.26s/it]
 26%|██▌       | 9961/37963 [22:30:36<62:47:00,  8.07s/it]
 26%|██▌       | 9962/37963 [22:30:44<62:01:39,  7.97s/it]
 26%|██▌       | 9963/37963 [22:30:51<61:59:38,  7.97s/it]
 26%|██▌       | 9964/37963 [22:30:59<61:48:28,  7.95s/it]
 26%|██▌       | 9965/37963 [22:31:07<60:45:09,  7.81s/it]
 26%|██▋       | 9966/37963 [22:31:14<60:03:08,  7.72s/it]
 26%|██▋       | 9967/37963 [22:31:22<59:46:18,  7.69s/it]
 26%|██▋       | 9968/37963 [22:31:32<65:40:04,  8.44s/it]
 26%|██▋       | 9969/37963 [22:31:40<63:46:12,  8.20s/it]
 26%|██▋       | 9970/37963 [22:31:48<62:38:40,  8.06s/it]
                                                          
{'loss': '0.1603', 'grad_norm': '1.572', 'learning_rate': '1.729e-05', 'epoch': '0.2626'}
+
 26%|██▋       | 9970/37963 [22:31:48<62:38:40,  8.06s/it]
 26%|██▋       | 9971/37963 [22:31:55<61:24:34,  7.90s/it]
 26%|██▋       | 9972/37963 [22:32:03<60:57:35,  7.84s/it]
 26%|██▋       | 9973/37963 [22:32:10<60:10:13,  7.74s/it]
 26%|██▋       | 9974/37963 [22:32:18<59:28:20,  7.65s/it]
 26%|██▋       | 9975/37963 [22:32:26<60:28:34,  7.78s/it]
 26%|██▋       | 9976/37963 [22:32:34<60:19:12,  7.76s/it]
 26%|██▋       | 9977/37963 [22:32:41<59:25:24,  7.64s/it]
 26%|██▋       | 9978/37963 [22:32:48<59:20:33,  7.63s/it]
 26%|██▋       | 9979/37963 [22:32:56<59:42:54,  7.68s/it]
 26%|██▋       | 9980/37963 [22:33:07<65:56:25,  8.48s/it]
                                                          
{'loss': '0.1642', 'grad_norm': '3.219', 'learning_rate': '1.729e-05', 'epoch': '0.2629'}
+
 26%|██▋       | 9980/37963 [22:33:07<65:56:25,  8.48s/it]
 26%|██▋       | 9981/37963 [22:33:14<64:10:23,  8.26s/it]
 26%|██▋       | 9982/37963 [22:33:22<62:05:20,  7.99s/it]
 26%|██▋       | 9983/37963 [22:33:29<61:09:42,  7.87s/it]
 26%|██▋       | 9984/37963 [22:33:37<61:04:37,  7.86s/it]
 26%|██▋       | 9985/37963 [22:33:45<61:43:23,  7.94s/it]
 26%|██▋       | 9986/37963 [22:33:53<61:12:02,  7.88s/it]
 26%|██▋       | 9987/37963 [22:34:01<61:00:24,  7.85s/it]
 26%|██▋       | 9988/37963 [22:34:09<60:58:17,  7.85s/it]
 26%|██▋       | 9989/37963 [22:34:19<66:35:49,  8.57s/it]
 26%|██▋       | 9990/37963 [22:34:27<64:44:34,  8.33s/it]
                                                          
{'loss': '0.1809', 'grad_norm': '2.788', 'learning_rate': '1.728e-05', 'epoch': '0.2632'}
+
 26%|██▋       | 9990/37963 [22:34:27<64:44:34,  8.33s/it]
 26%|██▋       | 9991/37963 [22:34:34<62:59:11,  8.11s/it]
 26%|██▋       | 9992/37963 [22:34:42<61:32:09,  7.92s/it]
 26%|██▋       | 9993/37963 [22:34:49<61:05:18,  7.86s/it]
 26%|██▋       | 9994/37963 [22:34:57<60:55:32,  7.84s/it]
 26%|██▋       | 9995/37963 [22:35:05<60:49:59,  7.83s/it]
 26%|██▋       | 9996/37963 [22:35:13<60:17:58,  7.76s/it]
 26%|██▋       | 9997/37963 [22:35:23<66:20:19,  8.54s/it]
 26%|██▋       | 9998/37963 [22:35:31<64:24:06,  8.29s/it]
 26%|██▋       | 9999/37963 [22:35:38<62:28:25,  8.04s/it]
 26%|██▋       | 10000/37963 [22:35:45<60:34:45,  7.80s/it]
                                                           
{'loss': '0.1866', 'grad_norm': '10.21', 'learning_rate': '1.728e-05', 'epoch': '0.2634'}
+
 26%|██▋       | 10000/37963 [22:35:45<60:34:45,  7.80s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.73s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.73s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 26%|██▋       | 10001/37963 [22:36:48<188:01:42, 24.21s/it]
 26%|██▋       | 10002/37963 [22:36:55<148:58:05, 19.18s/it]
 26%|██▋       | 10003/37963 [22:37:03<122:11:06, 15.73s/it]
 26%|██▋       | 10004/37963 [22:37:13<109:49:34, 14.14s/it]
 26%|██▋       | 10005/37963 [22:37:21<95:26:58, 12.29s/it] 
 26%|██▋       | 10006/37963 [22:37:29<85:11:53, 10.97s/it]
 26%|██▋       | 10007/37963 [22:37:40<84:25:41, 10.87s/it]
 26%|██▋       | 10008/37963 [22:37:48<77:28:53,  9.98s/it]
 26%|██▋       | 10009/37963 [22:37:56<72:00:30,  9.27s/it]
 26%|██▋       | 10010/37963 [22:38:06<74:05:31,  9.54s/it]
                                                           
{'loss': '0.1886', 'grad_norm': '2.089', 'learning_rate': '1.727e-05', 'epoch': '0.2637'}
+
 26%|██▋       | 10010/37963 [22:38:06<74:05:31,  9.54s/it]
 26%|██▋       | 10011/37963 [22:38:13<69:09:12,  8.91s/it]
 26%|██▋       | 10012/37963 [22:38:21<66:03:48,  8.51s/it]
 26%|██▋       | 10013/37963 [22:38:28<64:19:58,  8.29s/it]
 26%|██▋       | 10014/37963 [22:38:39<69:02:03,  8.89s/it]
 26%|██▋       | 10015/37963 [22:38:46<65:46:08,  8.47s/it]
 26%|██▋       | 10016/37963 [22:38:54<63:40:01,  8.20s/it]
 26%|██▋       | 10017/37963 [22:39:01<62:11:22,  8.01s/it]
 26%|██▋       | 10018/37963 [22:39:09<61:52:21,  7.97s/it]
 26%|██▋       | 10019/37963 [22:39:17<61:23:14,  7.91s/it]
 26%|██▋       | 10020/37963 [22:39:25<60:41:44,  7.82s/it]
                                                           
{'loss': '0.1793', 'grad_norm': '2.974', 'learning_rate': '1.726e-05', 'epoch': '0.2639'}
+
 26%|██▋       | 10020/37963 [22:39:25<60:41:44,  7.82s/it]
 26%|██▋       | 10021/37963 [22:39:32<60:23:58,  7.78s/it]
 26%|██▋       | 10022/37963 [22:39:40<60:05:48,  7.74s/it]
 26%|██▋       | 10023/37963 [22:39:48<59:36:42,  7.68s/it]
 26%|██▋       | 10024/37963 [22:39:55<59:42:03,  7.69s/it]
 26%|██▋       | 10025/37963 [22:40:03<59:48:39,  7.71s/it]
 26%|██▋       | 10026/37963 [22:40:11<59:50:20,  7.71s/it]
 26%|██▋       | 10027/37963 [22:40:18<59:03:09,  7.61s/it]
 26%|██▋       | 10028/37963 [22:40:26<59:12:51,  7.63s/it]
 26%|██▋       | 10029/37963 [22:40:36<65:20:12,  8.42s/it]
 26%|██▋       | 10030/37963 [22:40:44<63:51:40,  8.23s/it]
                                                           
{'loss': '0.1649', 'grad_norm': '1.127', 'learning_rate': '1.726e-05', 'epoch': '0.2642'}
+
 26%|██▋       | 10030/37963 [22:40:44<63:51:40,  8.23s/it]
 26%|██▋       | 10031/37963 [22:40:51<62:27:37,  8.05s/it]
 26%|██▋       | 10032/37963 [22:41:02<67:53:14,  8.75s/it]
 26%|██▋       | 10033/37963 [22:41:09<65:14:33,  8.41s/it]
 26%|██▋       | 10034/37963 [22:41:17<63:29:49,  8.18s/it]
 26%|██▋       | 10035/37963 [22:41:25<62:17:11,  8.03s/it]
 26%|██▋       | 10036/37963 [22:41:33<61:43:48,  7.96s/it]
 26%|██▋       | 10037/37963 [22:41:40<60:29:28,  7.80s/it]
 26%|██▋       | 10038/37963 [22:41:50<66:05:00,  8.52s/it]
 26%|██▋       | 10039/37963 [22:41:58<64:35:41,  8.33s/it]
 26%|██▋       | 10040/37963 [22:42:06<63:22:32,  8.17s/it]
                                                           
{'loss': '0.1857', 'grad_norm': '2.921', 'learning_rate': '1.725e-05', 'epoch': '0.2645'}
+
 26%|██▋       | 10040/37963 [22:42:06<63:22:32,  8.17s/it]
 26%|██▋       | 10041/37963 [22:42:14<62:16:42,  8.03s/it]
 26%|██▋       | 10042/37963 [22:42:21<61:19:17,  7.91s/it]
 26%|██▋       | 10043/37963 [22:42:29<60:55:31,  7.86s/it]
 26%|██▋       | 10044/37963 [22:42:37<60:54:26,  7.85s/it]
 26%|██▋       | 10045/37963 [22:42:44<60:09:50,  7.76s/it]
 26%|██▋       | 10046/37963 [22:42:52<59:37:02,  7.69s/it]
 26%|██▋       | 10047/37963 [22:43:00<60:03:28,  7.74s/it]
 26%|██▋       | 10048/37963 [22:43:07<59:38:17,  7.69s/it]
 26%|██▋       | 10049/37963 [22:43:15<59:39:02,  7.69s/it]
 26%|██▋       | 10050/37963 [22:43:28<71:06:14,  9.17s/it]
                                                           
{'loss': '0.1762', 'grad_norm': '1.61', 'learning_rate': '1.725e-05', 'epoch': '0.2647'}
+
 26%|██▋       | 10050/37963 [22:43:28<71:06:14,  9.17s/it]
 26%|██▋       | 10051/37963 [22:43:35<67:51:26,  8.75s/it]
 26%|██▋       | 10052/37963 [22:43:45<71:04:33,  9.17s/it]
 26%|██▋       | 10053/37963 [22:43:53<67:36:01,  8.72s/it]
 26%|██▋       | 10054/37963 [22:44:00<64:17:52,  8.29s/it]
 26%|██▋       | 10055/37963 [22:44:08<62:50:36,  8.11s/it]
 26%|██▋       | 10056/37963 [22:44:16<61:43:34,  7.96s/it]
 26%|██▋       | 10057/37963 [22:44:24<61:24:24,  7.92s/it]
 26%|██▋       | 10058/37963 [22:44:34<67:14:35,  8.67s/it]
 26%|██▋       | 10059/37963 [22:44:42<65:03:25,  8.39s/it]
 26%|██▋       | 10060/37963 [22:44:49<63:20:22,  8.17s/it]
                                                           
{'loss': '0.1812', 'grad_norm': '1.088', 'learning_rate': '1.724e-05', 'epoch': '0.265'}
+
 26%|██▋       | 10060/37963 [22:44:49<63:20:22,  8.17s/it]
 27%|██▋       | 10061/37963 [22:44:57<62:45:42,  8.10s/it]
 27%|██▋       | 10062/37963 [22:45:05<61:50:04,  7.98s/it]
 27%|██▋       | 10063/37963 [22:45:13<61:02:09,  7.88s/it]
 27%|██▋       | 10064/37963 [22:45:23<66:45:00,  8.61s/it]
 27%|██▋       | 10065/37963 [22:45:31<64:41:11,  8.35s/it]
 27%|██▋       | 10066/37963 [22:45:38<63:06:54,  8.14s/it]
 27%|██▋       | 10067/37963 [22:45:46<61:52:53,  7.99s/it]
 27%|██▋       | 10068/37963 [22:45:54<61:10:12,  7.89s/it]
 27%|██▋       | 10069/37963 [22:46:01<60:44:46,  7.84s/it]
 27%|██▋       | 10070/37963 [22:46:09<60:59:22,  7.87s/it]
                                                           
{'loss': '0.1745', 'grad_norm': '1.785', 'learning_rate': '1.724e-05', 'epoch': '0.2653'}
+
 27%|██▋       | 10070/37963 [22:46:09<60:59:22,  7.87s/it]
 27%|██▋       | 10071/37963 [22:46:17<59:47:50,  7.72s/it]
 27%|██▋       | 10072/37963 [22:46:25<59:58:19,  7.74s/it]
 27%|██▋       | 10073/37963 [22:46:32<59:52:01,  7.73s/it]
 27%|██▋       | 10074/37963 [22:46:39<58:38:58,  7.57s/it]
 27%|██▋       | 10075/37963 [22:46:47<59:07:28,  7.63s/it]
 27%|██▋       | 10076/37963 [22:46:55<59:32:00,  7.69s/it]
 27%|██▋       | 10077/37963 [22:47:03<59:21:25,  7.66s/it]
 27%|██▋       | 10078/37963 [22:47:10<59:26:49,  7.67s/it]
 27%|██▋       | 10079/37963 [22:47:18<59:25:48,  7.67s/it]
 27%|██▋       | 10080/37963 [22:47:25<58:57:44,  7.61s/it]
                                                           
{'loss': '0.1914', 'grad_norm': '2.031', 'learning_rate': '1.723e-05', 'epoch': '0.2655'}
+
 27%|██▋       | 10080/37963 [22:47:25<58:57:44,  7.61s/it]
 27%|██▋       | 10081/37963 [22:47:33<59:06:25,  7.63s/it]
 27%|██▋       | 10082/37963 [22:47:43<65:17:19,  8.43s/it]
 27%|██▋       | 10083/37963 [22:47:54<69:32:33,  8.98s/it]
 27%|██▋       | 10084/37963 [22:48:01<66:10:16,  8.54s/it]
 27%|██▋       | 10085/37963 [22:48:09<64:27:50,  8.32s/it]
 27%|██▋       | 10086/37963 [22:48:19<69:17:56,  8.95s/it]
 27%|██▋       | 10087/37963 [22:48:27<66:08:03,  8.54s/it]
 27%|██▋       | 10088/37963 [22:48:35<64:28:13,  8.33s/it]
 27%|██▋       | 10089/37963 [22:48:42<62:53:18,  8.12s/it]
 27%|██▋       | 10090/37963 [22:48:50<61:31:35,  7.95s/it]
                                                           
{'loss': '0.1746', 'grad_norm': '3.653', 'learning_rate': '1.722e-05', 'epoch': '0.2658'}
+
 27%|██▋       | 10090/37963 [22:48:50<61:31:35,  7.95s/it]
 27%|██▋       | 10091/37963 [22:48:58<61:07:24,  7.89s/it]
 27%|██▋       | 10092/37963 [22:49:06<61:24:38,  7.93s/it]
 27%|██▋       | 10093/37963 [22:49:13<60:36:44,  7.83s/it]
 27%|██▋       | 10094/37963 [22:49:24<66:27:11,  8.58s/it]
 27%|██▋       | 10095/37963 [22:49:32<64:39:56,  8.35s/it]
 27%|██▋       | 10096/37963 [22:49:39<63:09:53,  8.16s/it]
 27%|██▋       | 10097/37963 [22:49:47<61:47:48,  7.98s/it]
 27%|██▋       | 10098/37963 [22:49:57<66:57:21,  8.65s/it]
 27%|██▋       | 10099/37963 [22:50:05<65:00:08,  8.40s/it]
 27%|██▋       | 10100/37963 [22:50:13<63:55:42,  8.26s/it]
                                                           
{'loss': '0.1676', 'grad_norm': '1.537', 'learning_rate': '1.722e-05', 'epoch': '0.266'}
+
 27%|██▋       | 10100/37963 [22:50:13<63:55:42,  8.26s/it]
 27%|██▋       | 10101/37963 [22:50:23<68:22:27,  8.83s/it]
 27%|██▋       | 10102/37963 [22:50:31<65:42:44,  8.49s/it]
 27%|██▋       | 10103/37963 [22:50:38<63:50:10,  8.25s/it]
 27%|██▋       | 10104/37963 [22:50:46<62:48:20,  8.12s/it]
 27%|██▋       | 10105/37963 [22:50:54<62:26:33,  8.07s/it]
 27%|██▋       | 10106/37963 [22:51:02<61:34:33,  7.96s/it]
 27%|██▋       | 10107/37963 [22:51:09<60:46:37,  7.85s/it]
 27%|██▋       | 10108/37963 [22:51:17<60:34:09,  7.83s/it]
 27%|██▋       | 10109/37963 [22:51:25<60:36:32,  7.83s/it]
 27%|██▋       | 10110/37963 [22:51:33<60:17:38,  7.79s/it]
                                                           
{'loss': '0.1711', 'grad_norm': '2.356', 'learning_rate': '1.721e-05', 'epoch': '0.2663'}
+
 27%|██▋       | 10110/37963 [22:51:33<60:17:38,  7.79s/it]
 27%|██▋       | 10111/37963 [22:51:43<65:42:07,  8.49s/it]
 27%|██▋       | 10112/37963 [22:51:51<63:44:38,  8.24s/it]
 27%|██▋       | 10113/37963 [22:51:58<62:54:10,  8.13s/it]
 27%|██▋       | 10114/37963 [22:52:06<61:44:19,  7.98s/it]
 27%|██▋       | 10115/37963 [22:52:14<61:25:45,  7.94s/it]
 27%|██▋       | 10116/37963 [22:52:22<60:54:30,  7.87s/it]
 27%|██▋       | 10117/37963 [22:52:29<60:40:44,  7.84s/it]
 27%|██▋       | 10118/37963 [22:52:40<66:45:29,  8.63s/it]
 27%|██▋       | 10119/37963 [22:52:48<65:12:07,  8.43s/it]
 27%|██▋       | 10120/37963 [22:52:56<63:33:36,  8.22s/it]
                                                           
{'loss': '0.1808', 'grad_norm': '1.452', 'learning_rate': '1.721e-05', 'epoch': '0.2666'}
+
 27%|██▋       | 10120/37963 [22:52:56<63:33:36,  8.22s/it]
 27%|██▋       | 10121/37963 [22:53:03<62:36:36,  8.10s/it]
 27%|██▋       | 10122/37963 [22:53:11<60:55:07,  7.88s/it]
 27%|██▋       | 10123/37963 [22:53:19<60:47:18,  7.86s/it]
 27%|██▋       | 10124/37963 [22:53:26<60:34:53,  7.83s/it]
 27%|██▋       | 10125/37963 [22:53:34<60:27:18,  7.82s/it]
 27%|██▋       | 10126/37963 [22:53:42<60:24:36,  7.81s/it]
 27%|██▋       | 10127/37963 [22:53:50<60:15:11,  7.79s/it]
 27%|██▋       | 10128/37963 [22:53:57<59:47:25,  7.73s/it]
 27%|██▋       | 10129/37963 [22:54:05<59:28:24,  7.69s/it]
 27%|██▋       | 10130/37963 [22:54:13<59:36:37,  7.71s/it]
                                                           
{'loss': '0.1746', 'grad_norm': '3.522', 'learning_rate': '1.72e-05', 'epoch': '0.2668'}
+
 27%|██��       | 10130/37963 [22:54:13<59:36:37,  7.71s/it]
 27%|██▋       | 10131/37963 [22:54:20<59:49:17,  7.74s/it]
 27%|██▋       | 10132/37963 [22:54:28<60:06:30,  7.78s/it]
 27%|██▋       | 10133/37963 [22:54:36<60:22:21,  7.81s/it]
 27%|██▋       | 10134/37963 [22:54:44<60:02:08,  7.77s/it]
 27%|██▋       | 10135/37963 [22:54:52<60:33:26,  7.83s/it]
 27%|██▋       | 10136/37963 [22:55:02<65:32:05,  8.48s/it]
 27%|██▋       | 10137/37963 [22:55:12<70:04:07,  9.07s/it]
 27%|██▋       | 10138/37963 [22:55:20<66:57:38,  8.66s/it]
 27%|██▋       | 10139/37963 [22:55:28<64:33:27,  8.35s/it]
 27%|██▋       | 10140/37963 [22:55:38<69:26:42,  8.99s/it]
                                                           
{'loss': '0.171', 'grad_norm': '2.99', 'learning_rate': '1.719e-05', 'epoch': '0.2671'}
+
 27%|██▋       | 10140/37963 [22:55:38<69:26:42,  8.99s/it]
 27%|██▋       | 10141/37963 [22:55:46<66:33:14,  8.61s/it]
 27%|██▋       | 10142/37963 [22:55:53<64:05:27,  8.29s/it]
 27%|██▋       | 10143/37963 [22:56:01<62:23:31,  8.07s/it]
 27%|██▋       | 10144/37963 [22:56:09<61:30:50,  7.96s/it]
 27%|██▋       | 10145/37963 [22:56:16<61:17:12,  7.93s/it]
 27%|██▋       | 10146/37963 [22:56:24<60:24:23,  7.82s/it]
 27%|██▋       | 10147/37963 [22:56:34<65:56:16,  8.53s/it]
 27%|██▋       | 10148/37963 [22:56:45<70:23:41,  9.11s/it]
 27%|██▋       | 10149/37963 [22:56:55<73:27:00,  9.51s/it]
 27%|██▋       | 10150/37963 [22:57:02<68:17:03,  8.84s/it]
                                                           
{'loss': '0.1814', 'grad_norm': '1.431', 'learning_rate': '1.719e-05', 'epoch': '0.2674'}
+
 27%|██▋       | 10150/37963 [22:57:02<68:17:03,  8.84s/it]
 27%|██▋       | 10151/37963 [22:57:10<65:30:59,  8.48s/it]
 27%|██▋       | 10152/37963 [22:57:18<63:33:10,  8.23s/it]
 27%|██▋       | 10153/37963 [22:57:25<62:37:54,  8.11s/it]
 27%|██▋       | 10154/37963 [22:57:33<61:32:16,  7.97s/it]
 27%|██▋       | 10155/37963 [22:57:43<66:49:09,  8.65s/it]
 27%|██▋       | 10156/37963 [22:57:51<64:38:09,  8.37s/it]
 27%|██▋       | 10157/37963 [22:57:59<63:02:23,  8.16s/it]
 27%|██▋       | 10158/37963 [22:58:06<61:50:18,  8.01s/it]
 27%|██▋       | 10159/37963 [22:58:14<61:13:38,  7.93s/it]
 27%|██▋       | 10160/37963 [22:58:22<60:51:00,  7.88s/it]
                                                           
{'loss': '0.1743', 'grad_norm': '2.743', 'learning_rate': '1.718e-05', 'epoch': '0.2676'}
+
 27%|██▋       | 10160/37963 [22:58:22<60:51:00,  7.88s/it]
 27%|██▋       | 10161/37963 [22:58:30<60:24:09,  7.82s/it]
 27%|██▋       | 10162/37963 [22:58:37<59:33:59,  7.71s/it]
 27%|██▋       | 10163/37963 [22:58:45<59:27:25,  7.70s/it]
 27%|██▋       | 10164/37963 [22:58:52<59:12:56,  7.67s/it]
 27%|██▋       | 10165/37963 [22:59:00<58:54:38,  7.63s/it]
 27%|██▋       | 10166/37963 [22:59:08<59:09:14,  7.66s/it]
 27%|██▋       | 10167/37963 [22:59:15<59:01:08,  7.64s/it]
 27%|██▋       | 10168/37963 [22:59:23<59:25:34,  7.70s/it]
 27%|██▋       | 10169/37963 [22:59:31<59:27:52,  7.70s/it]
 27%|██▋       | 10170/37963 [22:59:38<59:39:08,  7.73s/it]
                                                           
{'loss': '0.172', 'grad_norm': '2.256', 'learning_rate': '1.718e-05', 'epoch': '0.2679'}
+
 27%|██▋       | 10170/37963 [22:59:38<59:39:08,  7.73s/it]
 27%|██▋       | 10171/37963 [22:59:46<59:37:57,  7.72s/it]
 27%|██▋       | 10172/37963 [22:59:56<65:29:00,  8.48s/it]
 27%|██▋       | 10173/37963 [23:00:04<63:19:49,  8.20s/it]
 27%|██▋       | 10174/37963 [23:00:11<61:27:11,  7.96s/it]
 27%|██▋       | 10175/37963 [23:00:19<60:31:33,  7.84s/it]
 27%|██▋       | 10176/37963 [23:00:27<60:28:27,  7.83s/it]
 27%|██▋       | 10177/37963 [23:00:35<60:13:21,  7.80s/it]
 27%|██▋       | 10178/37963 [23:00:42<59:03:09,  7.65s/it]
 27%|██▋       | 10179/37963 [23:00:50<59:31:14,  7.71s/it]
 27%|██▋       | 10180/37963 [23:01:00<65:53:24,  8.54s/it]
                                                           
{'loss': '0.1655', 'grad_norm': '2.413', 'learning_rate': '1.717e-05', 'epoch': '0.2682'}
+
 27%|██▋       | 10180/37963 [23:01:00<65:53:24,  8.54s/it]
 27%|██▋       | 10181/37963 [23:01:10<69:38:44,  9.02s/it]
 27%|██▋       | 10182/37963 [23:01:18<66:29:25,  8.62s/it]
 27%|██▋       | 10183/37963 [23:01:26<64:16:42,  8.33s/it]
 27%|██▋       | 10184/37963 [23:01:33<63:13:58,  8.19s/it]
 27%|██▋       | 10185/37963 [23:01:41<62:01:58,  8.04s/it]
 27%|██▋       | 10186/37963 [23:01:48<60:11:37,  7.80s/it]
 27%|██▋       | 10187/37963 [23:01:56<60:13:13,  7.81s/it]
 27%|██▋       | 10188/37963 [23:02:04<60:18:01,  7.82s/it]
 27%|██▋       | 10189/37963 [23:02:12<60:06:37,  7.79s/it]
 27%|██▋       | 10190/37963 [23:02:20<60:01:34,  7.78s/it]
                                                           
{'loss': '0.1708', 'grad_norm': '2.15', 'learning_rate': '1.716e-05', 'epoch': '0.2684'}
+
 27%|██▋       | 10190/37963 [23:02:20<60:01:34,  7.78s/it]
 27%|██▋       | 10191/37963 [23:02:27<60:23:13,  7.83s/it]
 27%|██▋       | 10192/37963 [23:02:35<60:17:20,  7.82s/it]
 27%|██▋       | 10193/37963 [23:02:48<72:25:38,  9.39s/it]
 27%|██▋       | 10194/37963 [23:02:59<74:54:26,  9.71s/it]
 27%|██▋       | 10195/37963 [23:03:09<75:58:45,  9.85s/it]
 27%|██▋       | 10196/37963 [23:03:17<70:45:50,  9.17s/it]
 27%|██▋       | 10197/37963 [23:03:24<67:30:54,  8.75s/it]
 27%|██▋       | 10198/37963 [23:03:32<65:04:29,  8.44s/it]
 27%|██▋       | 10199/37963 [23:03:40<63:21:02,  8.21s/it]
 27%|██▋       | 10200/37963 [23:03:47<62:01:56,  8.04s/it]
                                                           
{'loss': '0.1728', 'grad_norm': '1.917', 'learning_rate': '1.716e-05', 'epoch': '0.2687'}
+
 27%|██▋       | 10200/37963 [23:03:47<62:01:56,  8.04s/it]
 27%|██▋       | 10201/37963 [23:03:55<61:23:02,  7.96s/it]
 27%|██▋       | 10202/37963 [23:04:03<60:55:04,  7.90s/it]
 27%|██▋       | 10203/37963 [23:04:10<59:53:13,  7.77s/it]
 27%|██▋       | 10204/37963 [23:04:18<59:04:16,  7.66s/it]
 27%|██▋       | 10205/37963 [23:04:26<59:18:50,  7.69s/it]
 27%|██▋       | 10206/37963 [23:04:33<59:20:40,  7.70s/it]
 27%|██▋       | 10207/37963 [23:04:41<58:38:45,  7.61s/it]
 27%|██▋       | 10208/37963 [23:04:48<58:45:24,  7.62s/it]
 27%|██▋       | 10209/37963 [23:04:58<64:04:00,  8.31s/it]
 27%|██▋       | 10210/37963 [23:05:06<63:07:44,  8.19s/it]
                                                           
{'loss': '0.1743', 'grad_norm': '0.7473', 'learning_rate': '1.715e-05', 'epoch': '0.2689'}
+
 27%|██▋       | 10210/37963 [23:05:06<63:07:44,  8.19s/it]
 27%|██▋       | 10211/37963 [23:05:14<61:16:38,  7.95s/it]
 27%|██▋       | 10212/37963 [23:05:21<61:15:10,  7.95s/it]
 27%|██▋       | 10213/37963 [23:05:29<60:51:17,  7.89s/it]
 27%|██▋       | 10214/37963 [23:05:37<60:13:52,  7.81s/it]
 27%|██▋       | 10215/37963 [23:05:45<60:03:11,  7.79s/it]
 27%|██▋       | 10216/37963 [23:05:52<59:59:00,  7.78s/it]
 27%|██▋       | 10217/37963 [23:06:00<59:35:38,  7.73s/it]
 27%|██▋       | 10218/37963 [23:06:08<59:42:48,  7.75s/it]
 27%|██▋       | 10219/37963 [23:06:15<59:05:52,  7.67s/it]
 27%|██▋       | 10220/37963 [23:06:23<58:49:51,  7.63s/it]
                                                           
{'loss': '0.1644', 'grad_norm': '4.508', 'learning_rate': '1.715e-05', 'epoch': '0.2692'}
+
 27%|██▋       | 10220/37963 [23:06:23<58:49:51,  7.63s/it]
 27%|██▋       | 10221/37963 [23:06:31<59:48:29,  7.76s/it]
 27%|██▋       | 10222/37963 [23:06:38<58:33:43,  7.60s/it]
 27%|██▋       | 10223/37963 [23:06:49<65:15:03,  8.47s/it]
 27%|██▋       | 10224/37963 [23:06:56<63:53:47,  8.29s/it]
 27%|██▋       | 10225/37963 [23:07:04<62:47:45,  8.15s/it]
 27%|██▋       | 10226/37963 [23:07:17<73:45:29,  9.57s/it]
 27%|██▋       | 10227/37963 [23:07:25<69:32:58,  9.03s/it]
 27%|██▋       | 10228/37963 [23:07:33<67:00:29,  8.70s/it]
 27%|██▋       | 10229/37963 [23:07:40<63:51:57,  8.29s/it]
 27%|██▋       | 10230/37963 [23:07:48<62:25:39,  8.10s/it]
                                                           
{'loss': '0.1637', 'grad_norm': '1.057', 'learning_rate': '1.714e-05', 'epoch': '0.2695'}
+
 27%|██▋       | 10230/37963 [23:07:48<62:25:39,  8.10s/it]
 27%|██▋       | 10231/37963 [23:07:56<61:41:32,  8.01s/it]
 27%|██▋       | 10232/37963 [23:08:03<60:38:07,  7.87s/it]
 27%|██▋       | 10233/37963 [23:08:11<60:03:32,  7.80s/it]
 27%|██▋       | 10234/37963 [23:08:19<60:06:18,  7.80s/it]
 27%|██▋       | 10235/37963 [23:08:26<59:07:09,  7.68s/it]
 27%|██▋       | 10236/37963 [23:08:36<64:49:18,  8.42s/it]
 27%|██▋       | 10237/37963 [23:08:47<70:11:39,  9.11s/it]
 27%|██▋       | 10238/37963 [23:08:55<67:18:01,  8.74s/it]
 27%|██▋       | 10239/37963 [23:09:03<65:17:13,  8.48s/it]
 27%|██▋       | 10240/37963 [23:09:10<63:34:37,  8.26s/it]
                                                           
{'loss': '0.1691', 'grad_norm': '1.214', 'learning_rate': '1.713e-05', 'epoch': '0.2697'}
+
 27%|██▋       | 10240/37963 [23:09:10<63:34:37,  8.26s/it]
 27%|██▋       | 10241/37963 [23:09:18<62:39:40,  8.14s/it]
 27%|██▋       | 10242/37963 [23:09:26<61:53:54,  8.04s/it]
 27%|██▋       | 10243/37963 [23:09:36<66:46:00,  8.67s/it]
 27%|██▋       | 10244/37963 [23:09:44<64:40:04,  8.40s/it]
 27%|██▋       | 10245/37963 [23:09:52<63:27:55,  8.24s/it]
 27%|██▋       | 10246/37963 [23:10:00<62:24:18,  8.11s/it]
 27%|██▋       | 10247/37963 [23:10:07<61:18:00,  7.96s/it]
 27%|██▋       | 10248/37963 [23:10:18<67:12:18,  8.73s/it]
 27%|██▋       | 10249/37963 [23:10:26<65:22:55,  8.49s/it]
 27%|██▋       | 10250/37963 [23:10:33<63:32:04,  8.25s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '3.025', 'learning_rate': '1.713e-05', 'epoch': '0.27'}
+
 27%|██▋       | 10250/37963 [23:10:33<63:32:04,  8.25s/it]
 27%|██▋       | 10251/37963 [23:10:41<62:45:01,  8.15s/it]
 27%|██▋       | 10252/37963 [23:10:49<61:45:59,  8.02s/it]
 27%|██▋       | 10253/37963 [23:10:56<59:51:16,  7.78s/it]
 27%|██▋       | 10254/37963 [23:11:04<59:37:44,  7.75s/it]
 27%|██▋       | 10255/37963 [23:11:12<59:38:10,  7.75s/it]
 27%|██▋       | 10256/37963 [23:11:19<59:15:29,  7.70s/it]
 27%|██▋       | 10257/37963 [23:11:27<59:00:31,  7.67s/it]
 27%|██▋       | 10258/37963 [23:11:37<65:18:52,  8.49s/it]
 27%|██▋       | 10259/37963 [23:11:45<63:21:13,  8.23s/it]
 27%|██▋       | 10260/37963 [23:11:52<61:52:31,  8.04s/it]
                                                           
{'loss': '0.1719', 'grad_norm': '2.064', 'learning_rate': '1.712e-05', 'epoch': '0.2703'}
+
 27%|██▋       | 10260/37963 [23:11:52<61:52:31,  8.04s/it]
 27%|██▋       | 10261/37963 [23:12:00<61:15:30,  7.96s/it]
 27%|██▋       | 10262/37963 [23:12:08<60:56:42,  7.92s/it]
 27%|██▋       | 10263/37963 [23:12:16<60:01:38,  7.80s/it]
 27%|██▋       | 10264/37963 [23:12:23<60:14:15,  7.83s/it]
 27%|██▋       | 10265/37963 [23:12:31<59:48:23,  7.77s/it]
 27%|██▋       | 10266/37963 [23:12:39<59:53:47,  7.79s/it]
 27%|██▋       | 10267/37963 [23:12:47<59:32:20,  7.74s/it]
 27%|██▋       | 10268/37963 [23:12:54<59:13:50,  7.70s/it]
 27%|██▋       | 10269/37963 [23:13:07<70:50:58,  9.21s/it]
 27%|██▋       | 10270/37963 [23:13:15<67:34:26,  8.78s/it]
                                                           
{'loss': '0.1606', 'grad_norm': '6.186', 'learning_rate': '1.712e-05', 'epoch': '0.2705'}
+
 27%|██▋       | 10270/37963 [23:13:15<67:34:26,  8.78s/it]
 27%|██▋       | 10271/37963 [23:13:23<65:52:40,  8.56s/it]
 27%|██▋       | 10272/37963 [23:13:30<63:12:32,  8.22s/it]
 27%|██▋       | 10273/37963 [23:13:38<61:58:29,  8.06s/it]
 27%|██▋       | 10274/37963 [23:13:45<60:15:13,  7.83s/it]
 27%|██▋       | 10275/37963 [23:13:53<59:56:18,  7.79s/it]
 27%|██▋       | 10276/37963 [23:14:03<65:56:04,  8.57s/it]
 27%|██▋       | 10277/37963 [23:14:11<64:11:23,  8.35s/it]
 27%|██▋       | 10278/37963 [23:14:19<62:47:38,  8.17s/it]
 27%|██▋       | 10279/37963 [23:14:26<61:24:40,  7.99s/it]
 27%|██▋       | 10280/37963 [23:14:34<61:19:28,  7.97s/it]
                                                           
{'loss': '0.1681', 'grad_norm': '3.708', 'learning_rate': '1.711e-05', 'epoch': '0.2708'}
+
 27%|██▋       | 10280/37963 [23:14:34<61:19:28,  7.97s/it]
 27%|██▋       | 10281/37963 [23:14:42<60:46:23,  7.90s/it]
 27%|██▋       | 10282/37963 [23:14:50<60:40:35,  7.89s/it]
 27%|██▋       | 10283/37963 [23:14:58<60:25:43,  7.86s/it]
 27%|██▋       | 10284/37963 [23:15:05<59:51:49,  7.79s/it]
 27%|██▋       | 10285/37963 [23:15:16<66:05:41,  8.60s/it]
 27%|██▋       | 10286/37963 [23:15:24<64:31:16,  8.39s/it]
 27%|██▋       | 10287/37963 [23:15:34<68:48:44,  8.95s/it]
 27%|██▋       | 10288/37963 [23:15:42<66:22:49,  8.63s/it]
 27%|██▋       | 10289/37963 [23:15:50<64:18:50,  8.37s/it]
 27%|██▋       | 10290/37963 [23:16:00<68:29:52,  8.91s/it]
                                                           
{'loss': '0.1808', 'grad_norm': '3.792', 'learning_rate': '1.71e-05', 'epoch': '0.2711'}
+
 27%|██▋       | 10290/37963 [23:16:00<68:29:52,  8.91s/it]
 27%|██▋       | 10291/37963 [23:16:08<65:49:53,  8.56s/it]
 27%|██▋       | 10292/37963 [23:16:15<63:53:08,  8.31s/it]
 27%|██▋       | 10293/37963 [23:16:23<62:12:49,  8.09s/it]
 27%|██▋       | 10294/37963 [23:16:31<61:07:53,  7.95s/it]
 27%|██▋       | 10295/37963 [23:16:38<60:41:31,  7.90s/it]
 27%|██▋       | 10296/37963 [23:16:46<60:34:07,  7.88s/it]
 27%|██▋       | 10297/37963 [23:16:54<60:23:15,  7.86s/it]
 27%|██▋       | 10298/37963 [23:17:02<59:46:12,  7.78s/it]
 27%|██▋       | 10299/37963 [23:17:09<59:44:49,  7.78s/it]
 27%|██▋       | 10300/37963 [23:17:17<59:29:57,  7.74s/it]
                                                           
{'loss': '0.1658', 'grad_norm': '2.959', 'learning_rate': '1.71e-05', 'epoch': '0.2713'}
+
 27%|██▋       | 10300/37963 [23:17:17<59:29:57,  7.74s/it]
 27%|██▋       | 10301/37963 [23:17:25<60:14:35,  7.84s/it]
 27%|██▋       | 10302/37963 [23:17:36<66:35:30,  8.67s/it]
 27%|██▋       | 10303/37963 [23:17:43<64:37:00,  8.41s/it]
 27%|██▋       | 10304/37963 [23:17:51<63:06:54,  8.21s/it]
 27%|██▋       | 10305/37963 [23:17:59<61:51:46,  8.05s/it]
 27%|██▋       | 10306/37963 [23:18:07<61:22:35,  7.99s/it]
 27%|██▋       | 10307/37963 [23:18:15<61:06:58,  7.96s/it]
 27%|██▋       | 10308/37963 [23:18:22<60:26:21,  7.87s/it]
 27%|██▋       | 10309/37963 [23:18:30<59:53:45,  7.80s/it]
 27%|██▋       | 10310/37963 [23:18:40<65:45:57,  8.56s/it]
                                                           
{'loss': '0.1547', 'grad_norm': '1.168', 'learning_rate': '1.709e-05', 'epoch': '0.2716'}
+
 27%|██▋       | 10310/37963 [23:18:40<65:45:57,  8.56s/it]
 27%|██▋       | 10311/37963 [23:18:48<63:49:33,  8.31s/it]
 27%|██▋       | 10312/37963 [23:18:56<62:10:27,  8.09s/it]
 27%|██▋       | 10313/37963 [23:19:03<60:38:40,  7.90s/it]
 27%|██▋       | 10314/37963 [23:19:11<60:16:56,  7.85s/it]
 27%|██▋       | 10315/37963 [23:19:18<59:49:40,  7.79s/it]
 27%|██▋       | 10316/37963 [23:19:26<59:18:17,  7.72s/it]
 27%|██▋       | 10317/37963 [23:19:36<64:47:57,  8.44s/it]
 27%|██▋       | 10318/37963 [23:19:44<62:42:32,  8.17s/it]
 27%|██▋       | 10319/37963 [23:19:51<61:27:48,  8.00s/it]
 27%|██▋       | 10320/37963 [23:19:59<59:56:51,  7.81s/it]
                                                           
{'loss': '0.1768', 'grad_norm': '2.891', 'learning_rate': '1.709e-05', 'epoch': '0.2718'}
+
 27%|██▋       | 10320/37963 [23:19:59<59:56:51,  7.81s/it]
 27%|██▋       | 10321/37963 [23:20:06<59:55:19,  7.80s/it]
 27%|██▋       | 10322/37963 [23:20:14<59:19:08,  7.73s/it]
 27%|██▋       | 10323/37963 [23:20:24<64:22:19,  8.38s/it]
 27%|██▋       | 10324/37963 [23:20:31<62:13:14,  8.10s/it]
 27%|██▋       | 10325/37963 [23:20:39<60:34:13,  7.89s/it]
 27%|██▋       | 10326/37963 [23:20:46<59:56:57,  7.81s/it]
 27%|██▋       | 10327/37963 [23:20:54<59:52:15,  7.80s/it]
 27%|██▋       | 10328/37963 [23:21:02<59:39:42,  7.77s/it]
 27%|██▋       | 10329/37963 [23:21:09<59:26:03,  7.74s/it]
 27%|██▋       | 10330/37963 [23:21:20<65:14:46,  8.50s/it]
                                                           
{'loss': '0.1697', 'grad_norm': '3.456', 'learning_rate': '1.708e-05', 'epoch': '0.2721'}
+
 27%|██▋       | 10330/37963 [23:21:20<65:14:46,  8.50s/it]
 27%|██▋       | 10331/37963 [23:21:27<63:28:55,  8.27s/it]
 27%|██▋       | 10332/37963 [23:21:35<62:08:28,  8.10s/it]
 27%|██▋       | 10333/37963 [23:21:43<61:03:51,  7.96s/it]
 27%|██▋       | 10334/37963 [23:21:51<60:54:27,  7.94s/it]
 27%|██▋       | 10335/37963 [23:22:01<66:20:20,  8.64s/it]
 27%|██▋       | 10336/37963 [23:22:09<64:22:22,  8.39s/it]
 27%|██▋       | 10337/37963 [23:22:16<62:37:19,  8.16s/it]
 27%|██▋       | 10338/37963 [23:22:24<61:27:42,  8.01s/it]
 27%|██▋       | 10339/37963 [23:22:37<72:56:06,  9.51s/it]
 27%|██▋       | 10340/37963 [23:22:45<68:30:45,  8.93s/it]
                                                           
{'loss': '0.1725', 'grad_norm': '0.9732', 'learning_rate': '1.707e-05', 'epoch': '0.2724'}
+
 27%|██▋       | 10340/37963 [23:22:45<68:30:45,  8.93s/it]
 27%|██▋       | 10341/37963 [23:22:52<65:22:11,  8.52s/it]
 27%|██▋       | 10342/37963 [23:23:00<63:36:22,  8.29s/it]
 27%|██▋       | 10343/37963 [23:23:08<62:23:07,  8.13s/it]
 27%|██▋       | 10344/37963 [23:23:15<61:09:12,  7.97s/it]
 27%|██▋       | 10345/37963 [23:23:26<66:37:51,  8.69s/it]
 27%|██▋       | 10346/37963 [23:23:33<64:46:23,  8.44s/it]
 27%|██▋       | 10347/37963 [23:23:41<62:52:40,  8.20s/it]
 27%|██▋       | 10348/37963 [23:23:49<61:40:12,  8.04s/it]
 27%|██▋       | 10349/37963 [23:23:56<60:52:29,  7.94s/it]
 27%|██▋       | 10350/37963 [23:24:04<60:05:30,  7.83s/it]
                                                           
{'loss': '0.1596', 'grad_norm': '1.892', 'learning_rate': '1.707e-05', 'epoch': '0.2726'}
+
 27%|██▋       | 10350/37963 [23:24:04<60:05:30,  7.83s/it]
 27%|██▋       | 10351/37963 [23:24:12<60:07:59,  7.84s/it]
 27%|██▋       | 10352/37963 [23:24:19<59:25:09,  7.75s/it]
 27%|██▋       | 10353/37963 [23:24:29<64:29:59,  8.41s/it]
 27%|██▋       | 10354/37963 [23:24:37<62:27:56,  8.15s/it]
 27%|██▋       | 10355/37963 [23:24:45<62:05:24,  8.10s/it]
 27%|██▋       | 10356/37963 [23:24:53<61:22:30,  8.00s/it]
 27%|██▋       | 10357/37963 [23:25:00<60:16:55,  7.86s/it]
 27%|██▋       | 10358/37963 [23:25:08<59:54:28,  7.81s/it]
 27%|██▋       | 10359/37963 [23:25:16<59:57:59,  7.82s/it]
 27%|██▋       | 10360/37963 [23:25:23<59:31:15,  7.76s/it]
                                                           
{'loss': '0.1862', 'grad_norm': '2.673', 'learning_rate': '1.706e-05', 'epoch': '0.2729'}
+
 27%|██▋       | 10360/37963 [23:25:23<59:31:15,  7.76s/it]
 27%|██▋       | 10361/37963 [23:25:31<58:29:49,  7.63s/it]
 27%|██▋       | 10362/37963 [23:25:38<58:34:28,  7.64s/it]
 27%|██▋       | 10363/37963 [23:25:46<58:24:37,  7.62s/it]
 27%|██▋       | 10364/37963 [23:25:54<58:39:04,  7.65s/it]
 27%|██▋       | 10365/37963 [23:26:01<58:04:32,  7.58s/it]
 27%|██▋       | 10366/37963 [23:26:11<64:11:00,  8.37s/it]
 27%|██▋       | 10367/37963 [23:26:19<62:48:09,  8.19s/it]
 27%|██▋       | 10368/37963 [23:26:27<62:02:59,  8.09s/it]
 27%|██▋       | 10369/37963 [23:26:35<61:09:19,  7.98s/it]
 27%|██▋       | 10370/37963 [23:26:42<60:33:43,  7.90s/it]
                                                           
{'loss': '0.1793', 'grad_norm': '2.8', 'learning_rate': '1.706e-05', 'epoch': '0.2732'}
+
 27%|██▋       | 10370/37963 [23:26:42<60:33:43,  7.90s/it]
 27%|██▋       | 10371/37963 [23:26:50<59:59:48,  7.83s/it]
 27%|██▋       | 10372/37963 [23:26:58<60:30:15,  7.89s/it]
 27%|██▋       | 10373/37963 [23:27:06<59:54:41,  7.82s/it]
 27%|██▋       | 10374/37963 [23:27:16<65:25:50,  8.54s/it]
 27%|██▋       | 10375/37963 [23:27:24<63:25:57,  8.28s/it]
 27%|██▋       | 10376/37963 [23:27:31<62:25:56,  8.15s/it]
 27%|██▋       | 10377/37963 [23:27:42<67:16:42,  8.78s/it]
 27%|██▋       | 10378/37963 [23:27:49<64:41:16,  8.44s/it]
 27%|██▋       | 10379/37963 [23:27:59<68:14:19,  8.91s/it]
 27%|██▋       | 10380/37963 [23:28:07<66:06:21,  8.63s/it]
                                                           
{'loss': '0.1665', 'grad_norm': '1.975', 'learning_rate': '1.705e-05', 'epoch': '0.2734'}
+
 27%|██▋       | 10380/37963 [23:28:07<66:06:21,  8.63s/it]
 27%|██▋       | 10381/37963 [23:28:15<63:45:31,  8.32s/it]
 27%|██▋       | 10382/37963 [23:28:23<62:36:17,  8.17s/it]
 27%|██▋       | 10383/37963 [23:28:33<68:19:23,  8.92s/it]
 27%|██▋       | 10384/37963 [23:28:41<65:45:33,  8.58s/it]
 27%|██▋       | 10385/37963 [23:28:49<62:52:36,  8.21s/it]
 27%|██▋       | 10386/37963 [23:28:56<61:48:21,  8.07s/it]
 27%|██▋       | 10387/37963 [23:29:07<67:27:14,  8.81s/it]
 27%|██▋       | 10388/37963 [23:29:15<65:08:11,  8.50s/it]
 27%|██▋       | 10389/37963 [23:29:22<62:51:42,  8.21s/it]
 27%|██▋       | 10390/37963 [23:29:30<61:46:28,  8.07s/it]
                                                           
{'loss': '0.1687', 'grad_norm': '1.236', 'learning_rate': '1.704e-05', 'epoch': '0.2737'}
+
 27%|██▋       | 10390/37963 [23:29:30<61:46:28,  8.07s/it]
 27%|██▋       | 10391/37963 [23:29:38<61:14:33,  8.00s/it]
 27%|██▋       | 10392/37963 [23:29:45<60:35:32,  7.91s/it]
 27%|██▋       | 10393/37963 [23:29:53<60:11:58,  7.86s/it]
 27%|██▋       | 10394/37963 [23:30:01<60:15:05,  7.87s/it]
 27%|██▋       | 10395/37963 [23:30:09<59:57:07,  7.83s/it]
 27%|██▋       | 10396/37963 [23:30:16<59:31:58,  7.77s/it]
 27%|██▋       | 10397/37963 [23:30:24<59:24:05,  7.76s/it]
 27%|██▋       | 10398/37963 [23:30:32<59:00:14,  7.71s/it]
 27%|██▋       | 10399/37963 [23:30:42<64:59:03,  8.49s/it]
 27%|██▋       | 10400/37963 [23:30:49<62:32:58,  8.17s/it]
                                                           
{'loss': '0.1737', 'grad_norm': '3.309', 'learning_rate': '1.704e-05', 'epoch': '0.274'}
+
 27%|██▋       | 10400/37963 [23:30:49<62:32:58,  8.17s/it]
 27%|██▋       | 10401/37963 [23:30:57<62:05:44,  8.11s/it]
 27%|██▋       | 10402/37963 [23:31:05<61:13:41,  8.00s/it]
 27%|██▋       | 10403/37963 [23:31:15<66:23:58,  8.67s/it]
 27%|██▋       | 10404/37963 [23:31:23<63:56:37,  8.35s/it]
 27%|██▋       | 10405/37963 [23:31:31<62:06:34,  8.11s/it]
 27%|██▋       | 10406/37963 [23:31:38<60:44:49,  7.94s/it]
 27%|██▋       | 10407/37963 [23:31:46<59:51:37,  7.82s/it]
 27%|██▋       | 10408/37963 [23:31:53<59:24:22,  7.76s/it]
 27%|██▋       | 10409/37963 [23:32:01<59:37:30,  7.79s/it]
 27%|██▋       | 10410/37963 [23:32:09<59:17:01,  7.75s/it]
                                                           
{'loss': '0.1741', 'grad_norm': '2.148', 'learning_rate': '1.703e-05', 'epoch': '0.2742'}
+
 27%|██▋       | 10410/37963 [23:32:09<59:17:01,  7.75s/it]
 27%|██▋       | 10411/37963 [23:32:16<58:51:53,  7.69s/it]
 27%|██▋       | 10412/37963 [23:32:27<65:19:36,  8.54s/it]
 27%|██▋       | 10413/37963 [23:32:35<63:58:44,  8.36s/it]
 27%|██▋       | 10414/37963 [23:32:42<61:30:57,  8.04s/it]
 27%|██▋       | 10415/37963 [23:32:50<60:24:14,  7.89s/it]
 27%|██▋       | 10416/37963 [23:32:58<60:40:11,  7.93s/it]
 27%|██▋       | 10417/37963 [23:33:05<59:57:54,  7.84s/it]
 27%|██▋       | 10418/37963 [23:33:15<64:27:46,  8.42s/it]
 27%|██▋       | 10419/37963 [23:33:23<62:52:50,  8.22s/it]
 27%|██▋       | 10420/37963 [23:33:30<61:27:25,  8.03s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '5.535', 'learning_rate': '1.703e-05', 'epoch': '0.2745'}
+
 27%|██▋       | 10420/37963 [23:33:30<61:27:25,  8.03s/it]
 27%|██▋       | 10421/37963 [23:33:38<60:36:32,  7.92s/it]
 27%|██▋       | 10422/37963 [23:33:46<60:08:18,  7.86s/it]
 27%|██▋       | 10423/37963 [23:33:53<59:37:39,  7.79s/it]
 27%|██▋       | 10424/37963 [23:34:01<59:42:14,  7.80s/it]
 27%|██▋       | 10425/37963 [23:34:09<59:10:07,  7.74s/it]
 27%|██▋       | 10426/37963 [23:34:19<65:39:33,  8.58s/it]
 27%|██▋       | 10427/37963 [23:34:27<63:11:19,  8.26s/it]
 27%|██▋       | 10428/37963 [23:34:34<61:29:16,  8.04s/it]
 27%|██▋       | 10429/37963 [23:34:42<59:46:39,  7.82s/it]
 27%|██▋       | 10430/37963 [23:34:49<59:35:09,  7.79s/it]
                                                           
{'loss': '0.1741', 'grad_norm': '2.011', 'learning_rate': '1.702e-05', 'epoch': '0.2747'}
+
 27%|██▋       | 10430/37963 [23:34:49<59:35:09,  7.79s/it]
 27%|██▋       | 10431/37963 [23:34:59<64:02:35,  8.37s/it]
 27%|██▋       | 10432/37963 [23:35:07<62:39:17,  8.19s/it]
 27%|██▋       | 10433/37963 [23:35:17<67:19:34,  8.80s/it]
 27%|██▋       | 10434/37963 [23:35:25<64:32:33,  8.44s/it]
 27%|██▋       | 10435/37963 [23:35:35<68:02:20,  8.90s/it]
 27%|██▋       | 10436/37963 [23:35:43<65:27:00,  8.56s/it]
 27%|██▋       | 10437/37963 [23:35:50<62:51:11,  8.22s/it]
 27%|██▋       | 10438/37963 [23:35:57<60:34:28,  7.92s/it]
 27%|██▋       | 10439/37963 [23:36:05<60:20:59,  7.89s/it]
 28%|██▊       | 10440/37963 [23:36:13<59:44:06,  7.81s/it]
                                                           
{'loss': '0.1787', 'grad_norm': '2.231', 'learning_rate': '1.701e-05', 'epoch': '0.275'}
+
 28%|██▊       | 10440/37963 [23:36:13<59:44:06,  7.81s/it]
 28%|██▊       | 10441/37963 [23:36:20<59:38:08,  7.80s/it]
 28%|██▊       | 10442/37963 [23:36:28<58:52:47,  7.70s/it]
 28%|██▊       | 10443/37963 [23:36:36<59:19:17,  7.76s/it]
 28%|██▊       | 10444/37963 [23:36:43<58:26:41,  7.65s/it]
 28%|██▊       | 10445/37963 [23:36:51<58:41:13,  7.68s/it]
 28%|██▊       | 10446/37963 [23:36:59<58:58:24,  7.72s/it]
 28%|██▊       | 10447/37963 [23:37:12<71:23:31,  9.34s/it]
 28%|██▊       | 10448/37963 [23:37:20<67:36:03,  8.84s/it]
 28%|██▊       | 10449/37963 [23:37:27<64:57:22,  8.50s/it]
 28%|██▊       | 10450/37963 [23:37:35<63:30:56,  8.31s/it]
                                                           
{'loss': '0.162', 'grad_norm': '1.578', 'learning_rate': '1.701e-05', 'epoch': '0.2753'}
+
 28%|██▊       | 10450/37963 [23:37:35<63:30:56,  8.31s/it]
 28%|██▊       | 10451/37963 [23:37:43<62:08:23,  8.13s/it]
 28%|██▊       | 10452/37963 [23:37:51<61:13:51,  8.01s/it]
 28%|██▊       | 10453/37963 [23:37:58<60:27:54,  7.91s/it]
 28%|██▊       | 10454/37963 [23:38:06<59:45:01,  7.82s/it]
 28%|██▊       | 10455/37963 [23:38:16<65:03:27,  8.51s/it]
 28%|██▊       | 10456/37963 [23:38:24<63:03:42,  8.25s/it]
 28%|██▊       | 10457/37963 [23:38:31<61:38:34,  8.07s/it]
 28%|██▊       | 10458/37963 [23:38:39<60:27:46,  7.91s/it]
 28%|██▊       | 10459/37963 [23:38:46<59:48:01,  7.83s/it]
 28%|██▊       | 10460/37963 [23:38:54<59:13:42,  7.75s/it]
                                                           
{'loss': '0.177', 'grad_norm': '1.59', 'learning_rate': '1.7e-05', 'epoch': '0.2755'}
+
 28%|██▊       | 10460/37963 [23:38:54<59:13:42,  7.75s/it]
 28%|██▊       | 10461/37963 [23:39:02<59:06:14,  7.74s/it]
 28%|██▊       | 10462/37963 [23:39:09<58:50:05,  7.70s/it]
 28%|██▊       | 10463/37963 [23:39:17<59:19:52,  7.77s/it]
 28%|██▊       | 10464/37963 [23:39:25<58:41:57,  7.68s/it]
 28%|██▊       | 10465/37963 [23:39:35<64:45:05,  8.48s/it]
 28%|██▊       | 10466/37963 [23:39:43<63:04:20,  8.26s/it]
 28%|██▊       | 10467/37963 [23:39:50<61:43:52,  8.08s/it]
 28%|██▊       | 10468/37963 [23:39:58<60:38:37,  7.94s/it]
 28%|██▊       | 10469/37963 [23:40:06<60:05:49,  7.87s/it]
 28%|██▊       | 10470/37963 [23:40:13<59:34:15,  7.80s/it]
                                                           
{'loss': '0.1872', 'grad_norm': '2.416', 'learning_rate': '1.7e-05', 'epoch': '0.2758'}
+
 28%|██▊       | 10470/37963 [23:40:13<59:34:15,  7.80s/it]
 28%|██▊       | 10471/37963 [23:40:21<59:59:33,  7.86s/it]
 28%|██▊       | 10472/37963 [23:40:29<59:21:45,  7.77s/it]
 28%|██▊       | 10473/37963 [23:40:37<58:58:36,  7.72s/it]
 28%|██▊       | 10474/37963 [23:40:47<65:01:38,  8.52s/it]
 28%|██▊       | 10475/37963 [23:40:55<63:15:21,  8.28s/it]
 28%|██▊       | 10476/37963 [23:41:02<61:51:53,  8.10s/it]
 28%|██▊       | 10477/37963 [23:41:13<67:03:22,  8.78s/it]
 28%|██▊       | 10478/37963 [23:41:20<64:27:56,  8.44s/it]
 28%|██▊       | 10479/37963 [23:41:28<63:20:23,  8.30s/it]
 28%|██▊       | 10480/37963 [23:41:36<61:32:01,  8.06s/it]
                                                           
{'loss': '0.1786', 'grad_norm': '2.03', 'learning_rate': '1.699e-05', 'epoch': '0.2761'}
+
 28%|██▊       | 10480/37963 [23:41:36<61:32:01,  8.06s/it]
 28%|██▊       | 10481/37963 [23:41:44<60:38:51,  7.94s/it]
 28%|██▊       | 10482/37963 [23:41:51<60:32:02,  7.93s/it]
 28%|██▊       | 10483/37963 [23:41:59<59:27:06,  7.79s/it]
 28%|██▊       | 10484/37963 [23:42:07<59:25:20,  7.78s/it]
 28%|██▊       | 10485/37963 [23:42:17<64:16:28,  8.42s/it]
 28%|██▊       | 10486/37963 [23:42:24<62:39:52,  8.21s/it]
 28%|██▊       | 10487/37963 [23:42:32<61:43:21,  8.09s/it]
 28%|██▊       | 10488/37963 [23:42:40<61:16:43,  8.03s/it]
 28%|██▊       | 10489/37963 [23:42:50<65:42:18,  8.61s/it]
 28%|██▊       | 10490/37963 [23:42:58<63:30:00,  8.32s/it]
                                                           
{'loss': '0.1774', 'grad_norm': '4.369', 'learning_rate': '1.698e-05', 'epoch': '0.2763'}
+
 28%|██▊       | 10490/37963 [23:42:58<63:30:00,  8.32s/it]
 28%|██▊       | 10491/37963 [23:43:08<68:30:59,  8.98s/it]
 28%|██▊       | 10492/37963 [23:43:16<65:47:12,  8.62s/it]
 28%|██▊       | 10493/37963 [23:43:24<63:27:57,  8.32s/it]
 28%|██▊       | 10494/37963 [23:43:31<61:56:30,  8.12s/it]
 28%|██▊       | 10495/37963 [23:43:39<60:45:42,  7.96s/it]
 28%|██▊       | 10496/37963 [23:43:46<59:46:35,  7.83s/it]
 28%|██▊       | 10497/37963 [23:43:54<60:24:48,  7.92s/it]
 28%|██▊       | 10498/37963 [23:44:02<59:30:44,  7.80s/it]
 28%|██▊       | 10499/37963 [23:44:12<65:12:12,  8.55s/it]
 28%|██▊       | 10500/37963 [23:44:20<62:25:26,  8.18s/it]
                                                           
{'loss': '0.1696', 'grad_norm': '2.342', 'learning_rate': '1.698e-05', 'epoch': '0.2766'}
+
 28%|██▊       | 10500/37963 [23:44:20<62:25:26,  8.18s/it]
 28%|██▊       | 10501/37963 [23:44:27<61:08:53,  8.02s/it]
 28%|██▊       | 10502/37963 [23:44:35<60:10:18,  7.89s/it]
 28%|██▊       | 10503/37963 [23:44:45<65:23:53,  8.57s/it]
 28%|██▊       | 10504/37963 [23:44:53<63:33:42,  8.33s/it]
 28%|██▊       | 10505/37963 [23:45:00<62:12:49,  8.16s/it]
 28%|██▊       | 10506/37963 [23:45:08<60:11:13,  7.89s/it]
 28%|██▊       | 10507/37963 [23:45:16<59:58:09,  7.86s/it]
 28%|██▊       | 10508/37963 [23:45:23<59:30:47,  7.80s/it]
 28%|██▊       | 10509/37963 [23:45:31<59:22:16,  7.79s/it]
 28%|██▊       | 10510/37963 [23:45:38<58:43:52,  7.70s/it]
                                                           
{'loss': '0.1666', 'grad_norm': '2.494', 'learning_rate': '1.697e-05', 'epoch': '0.2768'}
+
 28%|██▊       | 10510/37963 [23:45:38<58:43:52,  7.70s/it]
 28%|██▊       | 10511/37963 [23:45:46<58:56:34,  7.73s/it]
 28%|██▊       | 10512/37963 [23:45:54<58:03:32,  7.61s/it]
 28%|██▊       | 10513/37963 [23:46:04<63:57:19,  8.39s/it]
 28%|██▊       | 10514/37963 [23:46:11<61:50:13,  8.11s/it]
 28%|██▊       | 10515/37963 [23:46:19<60:44:06,  7.97s/it]
 28%|██▊       | 10516/37963 [23:46:27<60:10:34,  7.89s/it]
 28%|██▊       | 10517/37963 [23:46:37<66:48:10,  8.76s/it]
 28%|██▊       | 10518/37963 [23:46:45<63:56:56,  8.39s/it]
 28%|██▊       | 10519/37963 [23:46:53<62:51:09,  8.24s/it]
 28%|██▊       | 10520/37963 [23:47:03<67:37:42,  8.87s/it]
                                                           
{'loss': '0.1698', 'grad_norm': '1.483', 'learning_rate': '1.697e-05', 'epoch': '0.2771'}
+
 28%|██▊       | 10520/37963 [23:47:03<67:37:42,  8.87s/it]
 28%|██▊       | 10521/37963 [23:47:11<64:51:59,  8.51s/it]
 28%|██▊       | 10522/37963 [23:47:19<63:16:40,  8.30s/it]
 28%|██▊       | 10523/37963 [23:47:26<62:04:16,  8.14s/it]
 28%|██▊       | 10524/37963 [23:47:34<60:25:16,  7.93s/it]
 28%|██▊       | 10525/37963 [23:47:41<59:34:49,  7.82s/it]
 28%|██▊       | 10526/37963 [23:47:49<58:38:17,  7.69s/it]
 28%|██▊       | 10527/37963 [23:47:57<58:43:22,  7.71s/it]
 28%|██▊       | 10528/37963 [23:48:04<57:56:18,  7.60s/it]
 28%|██▊       | 10529/37963 [23:48:11<57:40:02,  7.57s/it]
 28%|██▊       | 10530/37963 [23:48:19<58:19:04,  7.65s/it]
                                                           
{'loss': '0.1643', 'grad_norm': '1.918', 'learning_rate': '1.696e-05', 'epoch': '0.2774'}
+
 28%|██▊       | 10530/37963 [23:48:19<58:19:04,  7.65s/it]
 28%|██▊       | 10531/37963 [23:48:27<58:21:52,  7.66s/it]
 28%|██▊       | 10532/37963 [23:48:37<64:35:15,  8.48s/it]
 28%|██▊       | 10533/37963 [23:48:45<63:04:14,  8.28s/it]
 28%|██▊       | 10534/37963 [23:48:55<66:44:28,  8.76s/it]
 28%|██▊       | 10535/37963 [23:49:03<64:09:50,  8.42s/it]
 28%|██▊       | 10536/37963 [23:49:10<62:26:43,  8.20s/it]
 28%|██▊       | 10537/37963 [23:49:18<60:55:12,  8.00s/it]
 28%|██▊       | 10538/37963 [23:49:28<66:11:06,  8.69s/it]
 28%|██▊       | 10539/37963 [23:49:36<64:20:11,  8.45s/it]
 28%|██▊       | 10540/37963 [23:49:44<62:54:45,  8.26s/it]
                                                           
{'loss': '0.1804', 'grad_norm': '1.628', 'learning_rate': '1.695e-05', 'epoch': '0.2776'}
+
 28%|██▊       | 10540/37963 [23:49:44<62:54:45,  8.26s/it]
 28%|██▊       | 10541/37963 [23:49:52<61:43:59,  8.10s/it]
 28%|██▊       | 10542/37963 [23:49:59<61:12:36,  8.04s/it]
 28%|██▊       | 10543/37963 [23:50:10<65:59:03,  8.66s/it]
 28%|██▊       | 10544/37963 [23:50:17<63:54:59,  8.39s/it]
 28%|██▊       | 10545/37963 [23:50:25<61:39:29,  8.10s/it]
 28%|██▊       | 10546/37963 [23:50:32<60:46:29,  7.98s/it]
 28%|██▊       | 10547/37963 [23:50:40<59:59:05,  7.88s/it]
 28%|██▊       | 10548/37963 [23:50:47<58:47:42,  7.72s/it]
 28%|██▊       | 10549/37963 [23:50:55<59:07:25,  7.76s/it]
 28%|██▊       | 10550/37963 [23:51:03<59:13:05,  7.78s/it]
                                                           
{'loss': '0.1765', 'grad_norm': '3.783', 'learning_rate': '1.695e-05', 'epoch': '0.2779'}
+
 28%|██▊       | 10550/37963 [23:51:03<59:13:05,  7.78s/it]
 28%|██▊       | 10551/37963 [23:51:11<58:53:19,  7.73s/it]
 28%|██▊       | 10552/37963 [23:51:19<59:09:05,  7.77s/it]
 28%|██▊       | 10553/37963 [23:51:26<59:09:34,  7.77s/it]
 28%|██▊       | 10554/37963 [23:51:34<58:31:58,  7.69s/it]
 28%|██▊       | 10555/37963 [23:51:41<58:19:00,  7.66s/it]
 28%|██▊       | 10556/37963 [23:51:52<64:02:41,  8.41s/it]
 28%|██▊       | 10557/37963 [23:52:02<68:27:21,  8.99s/it]
 28%|██▊       | 10558/37963 [23:52:10<65:26:02,  8.60s/it]
 28%|██▊       | 10559/37963 [23:52:17<63:09:42,  8.30s/it]
 28%|██▊       | 10560/37963 [23:52:25<62:28:13,  8.21s/it]
                                                           
{'loss': '0.1694', 'grad_norm': '2.094', 'learning_rate': '1.694e-05', 'epoch': '0.2782'}
+
 28%|██▊       | 10560/37963 [23:52:25<62:28:13,  8.21s/it]
 28%|██▊       | 10561/37963 [23:52:33<60:50:57,  7.99s/it]
 28%|██▊       | 10562/37963 [23:52:40<60:02:34,  7.89s/it]
 28%|██▊       | 10563/37963 [23:52:48<59:13:03,  7.78s/it]
 28%|██▊       | 10564/37963 [23:52:56<59:10:25,  7.77s/it]
 28%|██▊       | 10565/37963 [23:53:07<66:31:57,  8.74s/it]
 28%|██▊       | 10566/37963 [23:53:14<63:24:44,  8.33s/it]
 28%|██▊       | 10567/37963 [23:53:22<61:31:24,  8.08s/it]
 28%|██▊       | 10568/37963 [23:53:29<60:30:59,  7.95s/it]
 28%|██▊       | 10569/37963 [23:53:40<65:59:43,  8.67s/it]
 28%|██▊       | 10570/37963 [23:53:48<64:42:37,  8.50s/it]
                                                           
{'loss': '0.1739', 'grad_norm': '2.842', 'learning_rate': '1.693e-05', 'epoch': '0.2784'}
+
 28%|██▊       | 10570/37963 [23:53:48<64:42:37,  8.50s/it]
 28%|██▊       | 10571/37963 [23:53:55<62:44:51,  8.25s/it]
 28%|██▊       | 10572/37963 [23:54:03<61:33:30,  8.09s/it]
 28%|██▊       | 10573/37963 [23:54:11<60:36:41,  7.97s/it]
 28%|██▊       | 10574/37963 [23:54:19<60:21:49,  7.93s/it]
 28%|██▊       | 10575/37963 [23:54:26<59:41:52,  7.85s/it]
 28%|██▊       | 10576/37963 [23:54:34<59:29:30,  7.82s/it]
 28%|██▊       | 10577/37963 [23:54:42<59:14:39,  7.79s/it]
 28%|██▊       | 10578/37963 [23:54:49<59:16:00,  7.79s/it]
 28%|██▊       | 10579/37963 [23:54:57<58:18:35,  7.67s/it]
 28%|██▊       | 10580/37963 [23:55:07<63:53:01,  8.40s/it]
                                                           
{'loss': '0.1783', 'grad_norm': '1.881', 'learning_rate': '1.693e-05', 'epoch': '0.2787'}
+
 28%|██▊       | 10580/37963 [23:55:07<63:53:01,  8.40s/it]
 28%|██▊       | 10581/37963 [23:55:15<62:35:03,  8.23s/it]
 28%|██▊       | 10582/37963 [23:55:25<66:59:25,  8.81s/it]
 28%|██▊       | 10583/37963 [23:55:32<63:55:33,  8.41s/it]
 28%|██▊       | 10584/37963 [23:55:40<62:38:01,  8.24s/it]
 28%|██▊       | 10585/37963 [23:55:48<61:10:38,  8.04s/it]
 28%|██▊       | 10586/37963 [23:56:01<72:26:21,  9.53s/it]
 28%|██▊       | 10587/37963 [23:56:09<68:16:29,  8.98s/it]
 28%|██▊       | 10588/37963 [23:56:16<65:17:19,  8.59s/it]
 28%|██▊       | 10589/37963 [23:56:24<63:09:06,  8.31s/it]
 28%|██▊       | 10590/37963 [23:56:31<61:37:36,  8.10s/it]
                                                           
{'loss': '0.1771', 'grad_norm': '2.875', 'learning_rate': '1.692e-05', 'epoch': '0.279'}
+
 28%|██▊       | 10590/37963 [23:56:31<61:37:36,  8.10s/it]
 28%|██▊       | 10591/37963 [23:56:39<60:28:27,  7.95s/it]
 28%|██▊       | 10592/37963 [23:56:47<60:01:14,  7.89s/it]
 28%|██▊       | 10593/37963 [23:56:54<59:26:23,  7.82s/it]
 28%|██▊       | 10594/37963 [23:57:02<59:02:27,  7.77s/it]
 28%|██▊       | 10595/37963 [23:57:10<58:36:36,  7.71s/it]
 28%|██▊       | 10596/37963 [23:57:17<58:30:38,  7.70s/it]
 28%|██▊       | 10597/37963 [23:57:25<58:03:56,  7.64s/it]
 28%|██▊       | 10598/37963 [23:57:33<58:26:19,  7.69s/it]
 28%|█��▊       | 10599/37963 [23:57:40<58:35:28,  7.71s/it]
 28%|██▊       | 10600/37963 [23:57:51<64:34:34,  8.50s/it]
                                                           
{'loss': '0.1604', 'grad_norm': '4.109', 'learning_rate': '1.692e-05', 'epoch': '0.2792'}
+
 28%|██▊       | 10600/37963 [23:57:51<64:34:34,  8.50s/it]
 28%|██▊       | 10601/37963 [23:57:59<63:02:05,  8.29s/it]
 28%|██▊       | 10602/37963 [23:58:06<61:28:43,  8.09s/it]
 28%|██▊       | 10603/37963 [23:58:14<59:56:49,  7.89s/it]
 28%|██▊       | 10604/37963 [23:58:21<59:31:07,  7.83s/it]
 28%|██▊       | 10605/37963 [23:58:29<59:47:06,  7.87s/it]
 28%|██▊       | 10606/37963 [23:58:36<58:11:58,  7.66s/it]
 28%|██▊       | 10607/37963 [23:58:44<58:06:51,  7.65s/it]
 28%|██▊       | 10608/37963 [23:58:52<57:53:30,  7.62s/it]
 28%|██▊       | 10609/37963 [23:59:02<64:33:30,  8.50s/it]
 28%|██▊       | 10610/37963 [23:59:10<62:12:05,  8.19s/it]
                                                           
{'loss': '0.1728', 'grad_norm': '4.155', 'learning_rate': '1.691e-05', 'epoch': '0.2795'}
+
 28%|██▊       | 10610/37963 [23:59:10<62:12:05,  8.19s/it]
 28%|██▊       | 10611/37963 [23:59:20<67:08:02,  8.84s/it]
 28%|██▊       | 10612/37963 [23:59:28<64:22:06,  8.47s/it]
 28%|██▊       | 10613/37963 [23:59:36<63:08:35,  8.31s/it]
 28%|██▊       | 10614/37963 [23:59:43<62:18:11,  8.20s/it]
 28%|██▊       | 10615/37963 [23:59:51<61:41:53,  8.12s/it]
 28%|██▊       | 10616/37963 [23:59:59<60:38:29,  7.98s/it]
 28%|██▊       | 10617/37963 [24:00:09<65:51:24,  8.67s/it]
 28%|██▊       | 10618/37963 [24:00:17<63:29:24,  8.36s/it]
 28%|██▊       | 10619/37963 [24:00:25<62:27:48,  8.22s/it]
 28%|██▊       | 10620/37963 [24:00:33<61:17:20,  8.07s/it]
                                                           
{'loss': '0.1886', 'grad_norm': '3.436', 'learning_rate': '1.69e-05', 'epoch': '0.2797'}
+
 28%|██▊       | 10620/37963 [24:00:33<61:17:20,  8.07s/it]
 28%|██▊       | 10621/37963 [24:00:40<59:30:17,  7.83s/it]
 28%|██▊       | 10622/37963 [24:00:48<59:03:42,  7.78s/it]
 28%|██▊       | 10623/37963 [24:00:55<58:18:47,  7.68s/it]
 28%|██▊       | 10624/37963 [24:01:03<58:33:30,  7.71s/it]
 28%|██▊       | 10625/37963 [24:01:11<58:51:29,  7.75s/it]
 28%|██▊       | 10626/37963 [24:01:18<58:59:36,  7.77s/it]
 28%|██▊       | 10627/37963 [24:01:25<57:25:21,  7.56s/it]
 28%|██▊       | 10628/37963 [24:01:33<56:55:03,  7.50s/it]
 28%|██▊       | 10629/37963 [24:01:41<57:19:35,  7.55s/it]
 28%|██▊       | 10630/37963 [24:01:53<69:19:24,  9.13s/it]
                                                           
{'loss': '0.1678', 'grad_norm': '1.494', 'learning_rate': '1.69e-05', 'epoch': '0.28'}
+
 28%|██▊       | 10630/37963 [24:01:53<69:19:24,  9.13s/it]
 28%|██▊       | 10631/37963 [24:02:01<66:00:32,  8.69s/it]
 28%|██▊       | 10632/37963 [24:02:08<63:10:24,  8.32s/it]
 28%|██▊       | 10633/37963 [24:02:16<61:30:03,  8.10s/it]
 28%|██▊       | 10634/37963 [24:02:26<65:29:41,  8.63s/it]
 28%|██▊       | 10635/37963 [24:02:34<63:48:09,  8.40s/it]
 28%|██▊       | 10636/37963 [24:02:41<61:02:01,  8.04s/it]
 28%|██▊       | 10637/37963 [24:02:49<60:26:26,  7.96s/it]
 28%|██▊       | 10638/37963 [24:02:56<59:34:19,  7.85s/it]
 28%|██▊       | 10639/37963 [24:03:04<59:11:10,  7.80s/it]
 28%|██▊       | 10640/37963 [24:03:14<64:31:26,  8.50s/it]
                                                           
{'loss': '0.1775', 'grad_norm': '2.254', 'learning_rate': '1.689e-05', 'epoch': '0.2803'}
+
 28%|██▊       | 10640/37963 [24:03:14<64:31:26,  8.50s/it]
 28%|██▊       | 10641/37963 [24:03:22<62:43:59,  8.27s/it]
 28%|██▊       | 10642/37963 [24:03:30<61:43:29,  8.13s/it]
 28%|██▊       | 10643/37963 [24:03:38<61:13:46,  8.07s/it]
 28%|██▊       | 10644/37963 [24:03:45<60:00:30,  7.91s/it]
 28%|██▊       | 10645/37963 [24:03:53<59:33:58,  7.85s/it]
 28%|██▊       | 10646/37963 [24:04:01<59:08:06,  7.79s/it]
 28%|██▊       | 10647/37963 [24:04:08<59:21:57,  7.82s/it]
 28%|██▊       | 10648/37963 [24:04:19<64:55:34,  8.56s/it]
 28%|██▊       | 10649/37963 [24:04:26<62:40:03,  8.26s/it]
 28%|██▊       | 10650/37963 [24:04:34<61:16:21,  8.08s/it]
                                                           
{'loss': '0.1773', 'grad_norm': '1.718', 'learning_rate': '1.689e-05', 'epoch': '0.2805'}
+
 28%|██▊       | 10650/37963 [24:04:34<61:16:21,  8.08s/it]
 28%|██▊       | 10651/37963 [24:04:42<60:27:47,  7.97s/it]
 28%|██▊       | 10652/37963 [24:04:50<60:14:35,  7.94s/it]
 28%|██▊       | 10653/37963 [24:05:00<66:09:40,  8.72s/it]
 28%|██▊       | 10654/37963 [24:05:08<64:19:54,  8.48s/it]
 28%|██▊       | 10655/37963 [24:05:15<62:02:46,  8.18s/it]
 28%|██▊       | 10656/37963 [24:05:23<60:18:36,  7.95s/it]
 28%|██▊       | 10657/37963 [24:05:30<59:30:41,  7.85s/it]
 28%|██▊       | 10658/37963 [24:05:38<59:03:18,  7.79s/it]
 28%|██▊       | 10659/37963 [24:05:45<57:50:33,  7.63s/it]
 28%|██▊       | 10660/37963 [24:05:56<64:06:38,  8.45s/it]
                                                           
{'loss': '0.1608', 'grad_norm': '4.543', 'learning_rate': '1.688e-05', 'epoch': '0.2808'}
+
 28%|██▊       | 10660/37963 [24:05:56<64:06:38,  8.45s/it]
 28%|██▊       | 10661/37963 [24:06:04<62:48:13,  8.28s/it]
 28%|██▊       | 10662/37963 [24:06:11<61:10:07,  8.07s/it]
 28%|██▊       | 10663/37963 [24:06:19<60:18:28,  7.95s/it]
 28%|██▊       | 10664/37963 [24:06:27<59:35:06,  7.86s/it]
 28%|██▊       | 10665/37963 [24:06:37<65:24:32,  8.63s/it]
 28%|██▊       | 10666/37963 [24:06:45<63:24:31,  8.36s/it]
 28%|██▊       | 10667/37963 [24:06:52<61:38:05,  8.13s/it]
 28%|██▊       | 10668/37963 [24:07:00<60:16:21,  7.95s/it]
 28%|██▊       | 10669/37963 [24:07:08<59:47:59,  7.89s/it]
 28%|██▊       | 10670/37963 [24:07:15<59:12:44,  7.81s/it]
                                                           
{'loss': '0.176', 'grad_norm': '3.474', 'learning_rate': '1.687e-05', 'epoch': '0.2811'}
+
 28%|██▊       | 10670/37963 [24:07:15<59:12:44,  7.81s/it]
 28%|██▊       | 10671/37963 [24:07:23<59:10:19,  7.81s/it]
 28%|██▊       | 10672/37963 [24:07:31<59:18:28,  7.82s/it]
 28%|██▊       | 10673/37963 [24:07:41<64:09:02,  8.46s/it]
 28%|██▊       | 10674/37963 [24:07:49<62:28:28,  8.24s/it]
 28%|██▊       | 10675/37963 [24:07:56<61:22:26,  8.10s/it]
 28%|██▊       | 10676/37963 [24:08:06<65:33:29,  8.65s/it]
 28%|██▊       | 10677/37963 [24:08:14<62:35:15,  8.26s/it]
 28%|██▊       | 10678/37963 [24:08:21<61:32:39,  8.12s/it]
 28%|██▊       | 10679/37963 [24:08:29<60:19:30,  7.96s/it]
 28%|██▊       | 10680/37963 [24:08:37<60:38:00,  8.00s/it]
                                                           
{'loss': '0.1668', 'grad_norm': '3.796', 'learning_rate': '1.687e-05', 'epoch': '0.2813'}
+
 28%|██▊       | 10680/37963 [24:08:37<60:38:00,  8.00s/it]
 28%|██▊       | 10681/37963 [24:08:45<59:46:26,  7.89s/it]
 28%|██▊       | 10682/37963 [24:08:55<64:14:22,  8.48s/it]
 28%|██▊       | 10683/37963 [24:09:02<62:16:04,  8.22s/it]
 28%|██▊       | 10684/37963 [24:09:10<61:18:13,  8.09s/it]
 28%|██▊       | 10685/37963 [24:09:17<59:45:22,  7.89s/it]
 28%|██▊       | 10686/37963 [24:09:25<58:40:50,  7.74s/it]
 28%|██▊       | 10687/37963 [24:09:32<58:29:52,  7.72s/it]
 28%|██▊       | 10688/37963 [24:09:40<58:37:22,  7.74s/it]
 28%|██▊       | 10689/37963 [24:09:48<58:22:00,  7.70s/it]
 28%|██▊       | 10690/37963 [24:09:55<57:39:31,  7.61s/it]
                                                           
{'loss': '0.1783', 'grad_norm': '4.412', 'learning_rate': '1.686e-05', 'epoch': '0.2816'}
+
 28%|██▊       | 10690/37963 [24:09:55<57:39:31,  7.61s/it]
 28%|██▊       | 10691/37963 [24:10:03<57:33:36,  7.60s/it]
 28%|██▊       | 10692/37963 [24:10:13<63:21:57,  8.36s/it]
 28%|██▊       | 10693/37963 [24:10:21<61:44:31,  8.15s/it]
 28%|██▊       | 10694/37963 [24:10:31<66:20:36,  8.76s/it]
 28%|██▊       | 10695/37963 [24:10:38<63:33:54,  8.39s/it]
 28%|██▊       | 10696/37963 [24:10:49<68:26:05,  9.04s/it]
 28%|██▊       | 10697/37963 [24:10:56<64:43:38,  8.55s/it]
 28%|██▊       | 10698/37963 [24:11:04<62:30:15,  8.25s/it]
 28%|██▊       | 10699/37963 [24:11:11<60:23:05,  7.97s/it]
 28%|██▊       | 10700/37963 [24:11:19<59:35:42,  7.87s/it]
                                                           
{'loss': '0.1695', 'grad_norm': '2.314', 'learning_rate': '1.685e-05', 'epoch': '0.2819'}
+
 28%|██▊       | 10700/37963 [24:11:19<59:35:42,  7.87s/it]
 28%|██▊       | 10701/37963 [24:11:27<59:25:37,  7.85s/it]
 28%|██▊       | 10702/37963 [24:11:34<59:14:41,  7.82s/it]
 28%|██▊       | 10703/37963 [24:11:42<59:00:22,  7.79s/it]
 28%|██▊       | 10704/37963 [24:11:50<58:42:06,  7.75s/it]
 28%|██▊       | 10705/37963 [24:11:58<59:18:19,  7.83s/it]
 28%|██▊       | 10706/37963 [24:12:05<58:38:18,  7.74s/it]
 28%|██▊       | 10707/37963 [24:12:13<58:24:33,  7.71s/it]
 28%|██▊       | 10708/37963 [24:12:20<57:51:49,  7.64s/it]
 28%|██▊       | 10709/37963 [24:12:31<63:57:50,  8.45s/it]
 28%|██▊       | 10710/37963 [24:12:38<61:48:52,  8.17s/it]
                                                           
{'loss': '0.1758', 'grad_norm': '1.107', 'learning_rate': '1.685e-05', 'epoch': '0.2821'}
+
 28%|██▊       | 10710/37963 [24:12:38<61:48:52,  8.17s/it]
 28%|██▊       | 10711/37963 [24:12:46<60:43:43,  8.02s/it]
 28%|██▊       | 10712/37963 [24:12:53<59:41:26,  7.89s/it]
 28%|██▊       | 10713/37963 [24:13:01<59:45:26,  7.89s/it]
 28%|██▊       | 10714/37963 [24:13:09<59:34:46,  7.87s/it]
 28%|██▊       | 10715/37963 [24:13:17<58:44:29,  7.76s/it]
 28%|██▊       | 10716/37963 [24:13:24<58:25:48,  7.72s/it]
 28%|██▊       | 10717/37963 [24:13:34<63:44:27,  8.42s/it]
 28%|██▊       | 10718/37963 [24:13:42<61:57:53,  8.19s/it]
 28%|██▊       | 10719/37963 [24:13:53<67:14:02,  8.88s/it]
 28%|██▊       | 10720/37963 [24:14:00<63:53:26,  8.44s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '2.249', 'learning_rate': '1.684e-05', 'epoch': '0.2824'}
+
 28%|██▊       | 10720/37963 [24:14:00<63:53:26,  8.44s/it]
 28%|██▊       | 10721/37963 [24:14:08<62:24:55,  8.25s/it]
 28%|██▊       | 10722/37963 [24:14:16<61:37:37,  8.14s/it]
 28%|██▊       | 10723/37963 [24:14:24<61:26:49,  8.12s/it]
 28%|██▊       | 10724/37963 [24:14:32<60:55:33,  8.05s/it]
 28%|██▊       | 10725/37963 [24:14:42<65:56:56,  8.72s/it]
 28%|██▊       | 10726/37963 [24:14:52<69:26:27,  9.18s/it]
 28%|██▊       | 10727/37963 [24:15:00<66:17:58,  8.76s/it]
 28%|██▊       | 10728/37963 [24:15:08<63:53:33,  8.45s/it]
 28%|██▊       | 10729/37963 [24:15:16<62:44:14,  8.29s/it]
 28%|██▊       | 10730/37963 [24:15:23<61:20:31,  8.11s/it]
                                                           
{'loss': '0.1514', 'grad_norm': '2.375', 'learning_rate': '1.684e-05', 'epoch': '0.2826'}
+
 28%|██▊       | 10730/37963 [24:15:23<61:20:31,  8.11s/it]
 28%|██▊       | 10731/37963 [24:15:31<60:12:48,  7.96s/it]
 28%|██▊       | 10732/37963 [24:15:38<59:13:48,  7.83s/it]
 28%|██▊       | 10733/37963 [24:15:46<58:49:59,  7.78s/it]
 28%|██▊       | 10734/37963 [24:15:54<59:14:10,  7.83s/it]
 28%|██▊       | 10735/37963 [24:16:02<59:08:21,  7.82s/it]
 28%|██▊       | 10736/37963 [24:16:10<58:59:22,  7.80s/it]
 28%|██▊       | 10737/37963 [24:16:17<58:45:13,  7.77s/it]
 28%|██▊       | 10738/37963 [24:16:25<57:50:03,  7.65s/it]
 28%|██▊       | 10739/37963 [24:16:32<57:58:44,  7.67s/it]
 28%|██▊       | 10740/37963 [24:16:43<63:59:41,  8.46s/it]
                                                           
{'loss': '0.1716', 'grad_norm': '1.819', 'learning_rate': '1.683e-05', 'epoch': '0.2829'}
+
 28%|██▊       | 10740/37963 [24:16:43<63:59:41,  8.46s/it]
 28%|██▊       | 10741/37963 [24:16:50<62:00:21,  8.20s/it]
 28%|██▊       | 10742/37963 [24:16:58<60:39:30,  8.02s/it]
 28%|██▊       | 10743/37963 [24:17:05<59:06:18,  7.82s/it]
 28%|██▊       | 10744/37963 [24:17:16<65:46:34,  8.70s/it]
 28%|██▊       | 10745/37963 [24:17:24<63:54:01,  8.45s/it]
 28%|██▊       | 10746/37963 [24:17:31<62:07:56,  8.22s/it]
 28%|██▊       | 10747/37963 [24:17:39<61:36:05,  8.15s/it]
 28%|██▊       | 10748/37963 [24:17:50<66:00:28,  8.73s/it]
 28%|██▊       | 10749/37963 [24:17:57<64:09:58,  8.49s/it]
 28%|██▊       | 10750/37963 [24:18:05<62:33:00,  8.27s/it]
                                                           
{'loss': '0.1876', 'grad_norm': '2.472', 'learning_rate': '1.682e-05', 'epoch': '0.2832'}
+
 28%|██▊       | 10750/37963 [24:18:05<62:33:00,  8.27s/it]
 28%|██▊       | 10751/37963 [24:18:13<61:13:15,  8.10s/it]
 28%|██▊       | 10752/37963 [24:18:23<66:12:20,  8.76s/it]
 28%|██▊       | 10753/37963 [24:18:31<63:32:19,  8.41s/it]
 28%|██▊       | 10754/37963 [24:18:38<61:45:42,  8.17s/it]
 28%|██▊       | 10755/37963 [24:18:46<60:04:55,  7.95s/it]
 28%|██▊       | 10756/37963 [24:18:54<59:46:49,  7.91s/it]
 28%|██▊       | 10757/37963 [24:19:01<59:15:27,  7.84s/it]
 28%|██▊       | 10758/37963 [24:19:09<59:11:57,  7.83s/it]
 28%|██▊       | 10759/37963 [24:19:17<58:41:13,  7.77s/it]
 28%|██▊       | 10760/37963 [24:19:24<58:18:39,  7.72s/it]
                                                           
{'loss': '0.185', 'grad_norm': '2.404', 'learning_rate': '1.682e-05', 'epoch': '0.2834'}
+
 28%|██▊       | 10760/37963 [24:19:24<58:18:39,  7.72s/it]
 28%|██▊       | 10761/37963 [24:19:35<64:29:14,  8.53s/it]
 28%|██▊       | 10762/37963 [24:19:45<68:01:58,  9.00s/it]
 28%|██▊       | 10763/37963 [24:19:53<64:58:48,  8.60s/it]
 28%|██▊       | 10764/37963 [24:20:00<62:23:33,  8.26s/it]
 28%|██▊       | 10765/37963 [24:20:08<61:30:26,  8.14s/it]
 28%|██▊       | 10766/37963 [24:20:15<59:42:41,  7.90s/it]
 28%|██▊       | 10767/37963 [24:20:23<59:27:31,  7.87s/it]
 28%|██▊       | 10768/37963 [24:20:31<59:22:04,  7.86s/it]
 28%|██▊       | 10769/37963 [24:20:39<59:02:21,  7.82s/it]
 28%|██▊       | 10770/37963 [24:20:49<64:25:19,  8.53s/it]
                                                           
{'loss': '0.1777', 'grad_norm': '3.675', 'learning_rate': '1.681e-05', 'epoch': '0.2837'}
+
 28%|██▊       | 10770/37963 [24:20:49<64:25:19,  8.53s/it]
 28%|██▊       | 10771/37963 [24:20:56<62:32:17,  8.28s/it]
 28%|██▊       | 10772/37963 [24:21:04<61:12:22,  8.10s/it]
 28%|██▊       | 10773/37963 [24:21:12<59:40:05,  7.90s/it]
 28%|██▊       | 10774/37963 [24:21:19<59:00:07,  7.81s/it]
 28%|██▊       | 10775/37963 [24:21:27<58:52:25,  7.80s/it]
 28%|██▊       | 10776/37963 [24:21:35<58:29:52,  7.75s/it]
 28%|██▊       | 10777/37963 [24:21:42<58:17:53,  7.72s/it]
 28%|██▊       | 10778/37963 [24:21:50<58:04:43,  7.69s/it]
 28%|██▊       | 10779/37963 [24:21:57<57:48:39,  7.66s/it]
 28%|██▊       | 10780/37963 [24:22:08<63:53:54,  8.46s/it]
                                                           
{'loss': '0.175', 'grad_norm': '1.48', 'learning_rate': '1.68e-05', 'epoch': '0.284'}
+
 28%|██▊       | 10780/37963 [24:22:08<63:53:54,  8.46s/it]
 28%|██▊       | 10781/37963 [24:22:16<62:26:10,  8.27s/it]
 28%|██▊       | 10782/37963 [24:22:23<61:16:49,  8.12s/it]
 28%|██▊       | 10783/37963 [24:22:31<60:14:40,  7.98s/it]
 28%|██▊       | 10784/37963 [24:22:39<59:31:29,  7.88s/it]
 28%|██▊       | 10785/37963 [24:22:46<58:58:16,  7.81s/it]
 28%|██▊       | 10786/37963 [24:22:54<59:03:05,  7.82s/it]
 28%|██▊       | 10787/37963 [24:23:02<58:38:14,  7.77s/it]
 28%|██▊       | 10788/37963 [24:23:12<64:44:42,  8.58s/it]
 28%|██▊       | 10789/37963 [24:23:20<62:47:51,  8.32s/it]
 28%|██▊       | 10790/37963 [24:23:27<60:23:43,  8.00s/it]
                                                           
{'loss': '0.1691', 'grad_norm': '3.835', 'learning_rate': '1.68e-05', 'epoch': '0.2842'}
+
 28%|██▊       | 10790/37963 [24:23:27<60:23:43,  8.00s/it]
 28%|██▊       | 10791/37963 [24:23:35<58:50:17,  7.80s/it]
 28%|██▊       | 10792/37963 [24:23:42<58:19:02,  7.73s/it]
 28%|██▊       | 10793/37963 [24:23:52<63:57:32,  8.47s/it]
 28%|██▊       | 10794/37963 [24:24:00<61:52:41,  8.20s/it]
 28%|██▊       | 10795/37963 [24:24:08<60:51:46,  8.06s/it]
 28%|██▊       | 10796/37963 [24:24:18<65:52:09,  8.73s/it]
 28%|██▊       | 10797/37963 [24:24:26<63:29:48,  8.41s/it]
 28%|██▊       | 10798/37963 [24:24:36<68:12:38,  9.04s/it]
 28%|██▊       | 10799/37963 [24:24:44<64:56:13,  8.61s/it]
 28%|██▊       | 10800/37963 [24:24:52<63:18:59,  8.39s/it]
                                                           
{'loss': '0.1661', 'grad_norm': '3.249', 'learning_rate': '1.679e-05', 'epoch': '0.2845'}
+
 28%|██▊       | 10800/37963 [24:24:52<63:18:59,  8.39s/it]
 28%|██▊       | 10801/37963 [24:24:59<61:49:09,  8.19s/it]
 28%|██▊       | 10802/37963 [24:25:07<60:18:53,  7.99s/it]
 28%|██▊       | 10803/37963 [24:25:15<59:41:18,  7.91s/it]
 28%|██▊       | 10804/37963 [24:25:22<58:24:59,  7.74s/it]
 28%|██▊       | 10805/37963 [24:25:32<63:58:07,  8.48s/it]
 28%|██▊       | 10806/37963 [24:25:40<62:43:15,  8.31s/it]
 28%|██▊       | 10807/37963 [24:25:48<61:29:54,  8.15s/it]
 28%|██▊       | 10808/37963 [24:25:55<60:04:38,  7.96s/it]
 28%|██▊       | 10809/37963 [24:26:03<58:49:46,  7.80s/it]
 28%|██▊       | 10810/37963 [24:26:10<57:31:18,  7.63s/it]
                                                           
{'loss': '0.1715', 'grad_norm': '2.819', 'learning_rate': '1.679e-05', 'epoch': '0.2848'}
+
 28%|██▊       | 10810/37963 [24:26:10<57:31:18,  7.63s/it]
 28%|██▊       | 10811/37963 [24:26:18<57:31:27,  7.63s/it]
 28%|██▊       | 10812/37963 [24:26:26<58:21:37,  7.74s/it]
 28%|██▊       | 10813/37963 [24:26:34<59:03:43,  7.83s/it]
 28%|██▊       | 10814/37963 [24:26:41<58:41:42,  7.78s/it]
 28%|██▊       | 10815/37963 [24:26:51<63:45:42,  8.46s/it]
 28%|██▊       | 10816/37963 [24:26:59<62:36:29,  8.30s/it]
 28%|██▊       | 10817/37963 [24:27:07<60:30:22,  8.02s/it]
 28%|██▊       | 10818/37963 [24:27:15<60:13:39,  7.99s/it]
 28%|██▊       | 10819/37963 [24:27:22<59:44:54,  7.92s/it]
 29%|██▊       | 10820/37963 [24:27:30<58:32:55,  7.77s/it]
                                                           
{'loss': '0.1654', 'grad_norm': '5.404', 'learning_rate': '1.678e-05', 'epoch': '0.285'}
+
 29%|██▊       | 10820/37963 [24:27:30<58:32:55,  7.77s/it]
 29%|██▊       | 10821/37963 [24:27:37<58:19:52,  7.74s/it]
 29%|██▊       | 10822/37963 [24:27:45<58:17:07,  7.73s/it]
 29%|██▊       | 10823/37963 [24:27:53<58:10:08,  7.72s/it]
 29%|██▊       | 10824/37963 [24:28:06<69:41:40,  9.25s/it]
 29%|██▊       | 10825/37963 [24:28:13<66:08:43,  8.77s/it]
 29%|██▊       | 10826/37963 [24:28:21<63:16:55,  8.40s/it]
 29%|██▊       | 10827/37963 [24:28:28<61:29:31,  8.16s/it]
 29%|██▊       | 10828/37963 [24:28:36<60:42:54,  8.06s/it]
 29%|██▊       | 10829/37963 [24:28:44<60:01:46,  7.96s/it]
 29%|██▊       | 10830/37963 [24:28:52<59:16:10,  7.86s/it]
                                                           
{'loss': '0.1912', 'grad_norm': '6.018', 'learning_rate': '1.677e-05', 'epoch': '0.2853'}
+
 29%|██▊       | 10830/37963 [24:28:52<59:16:10,  7.86s/it]
 29%|██▊       | 10831/37963 [24:29:00<59:15:36,  7.86s/it]
 29%|██▊       | 10832/37963 [24:29:07<59:05:33,  7.84s/it]
 29%|██▊       | 10833/37963 [24:29:15<58:58:03,  7.82s/it]
 29%|██▊       | 10834/37963 [24:29:23<58:17:54,  7.74s/it]
 29%|██▊       | 10835/37963 [24:29:30<58:32:15,  7.77s/it]
 29%|██▊       | 10836/37963 [24:29:41<63:42:53,  8.46s/it]
 29%|██▊       | 10837/37963 [24:29:48<61:38:20,  8.18s/it]
 29%|██▊       | 10838/37963 [24:29:56<60:23:07,  8.01s/it]
 29%|██▊       | 10839/37963 [24:30:03<59:36:25,  7.91s/it]
 29%|██▊       | 10840/37963 [24:30:11<59:30:08,  7.90s/it]
                                                           
{'loss': '0.1681', 'grad_norm': '6.746', 'learning_rate': '1.677e-05', 'epoch': '0.2855'}
+
 29%|██▊       | 10840/37963 [24:30:11<59:30:08,  7.90s/it]
 29%|██▊       | 10841/37963 [24:30:19<58:48:10,  7.81s/it]
 29%|██▊       | 10842/37963 [24:30:29<64:28:18,  8.56s/it]
 29%|██▊       | 10843/37963 [24:30:37<62:08:59,  8.25s/it]
 29%|██▊       | 10844/37963 [24:30:47<66:36:23,  8.84s/it]
 29%|██▊       | 10845/37963 [24:30:55<63:53:47,  8.48s/it]
 29%|██▊       | 10846/37963 [24:31:02<61:52:45,  8.21s/it]
 29%|██▊       | 10847/37963 [24:31:10<60:33:57,  8.04s/it]
 29%|██▊       | 10848/37963 [24:31:20<65:45:48,  8.73s/it]
 29%|██▊       | 10849/37963 [24:31:28<63:16:02,  8.40s/it]
 29%|██▊       | 10850/37963 [24:31:35<61:40:20,  8.19s/it]
                                                           
{'loss': '0.1807', 'grad_norm': '2.697', 'learning_rate': '1.676e-05', 'epoch': '0.2858'}
+
 29%|██▊       | 10850/37963 [24:31:35<61:40:20,  8.19s/it]
 29%|██▊       | 10851/37963 [24:31:43<60:11:40,  7.99s/it]
 29%|██▊       | 10852/37963 [24:31:53<64:57:14,  8.63s/it]
 29%|██▊       | 10853/37963 [24:32:00<62:09:09,  8.25s/it]
 29%|██▊       | 10854/37963 [24:32:08<60:45:39,  8.07s/it]
 29%|██▊       | 10855/37963 [24:32:16<59:48:13,  7.94s/it]
 29%|██▊       | 10856/37963 [24:32:23<58:50:57,  7.82s/it]
 29%|██▊       | 10857/37963 [24:32:31<58:13:49,  7.73s/it]
 29%|██▊       | 10858/37963 [24:32:39<58:19:55,  7.75s/it]
 29%|██▊       | 10859/37963 [24:32:49<63:48:53,  8.48s/it]
 29%|██▊       | 10860/37963 [24:32:57<62:26:08,  8.29s/it]
                                                           
{'loss': '0.1734', 'grad_norm': '1.137', 'learning_rate': '1.675e-05', 'epoch': '0.2861'}
+
 29%|██▊       | 10860/37963 [24:32:57<62:26:08,  8.29s/it]
 29%|██▊       | 10861/37963 [24:33:05<61:34:42,  8.18s/it]
 29%|██▊       | 10862/37963 [24:33:12<60:42:43,  8.06s/it]
 29%|██▊       | 10863/37963 [24:33:20<59:35:26,  7.92s/it]
 29%|██▊       | 10864/37963 [24:33:28<59:01:11,  7.84s/it]
 29%|██▊       | 10865/37963 [24:33:35<58:56:41,  7.83s/it]
 29%|██▊       | 10866/37963 [24:33:43<58:45:14,  7.81s/it]
 29%|██▊       | 10867/37963 [24:33:51<58:30:32,  7.77s/it]
 29%|██▊       | 10868/37963 [24:33:58<58:15:27,  7.74s/it]
 29%|██▊       | 10869/37963 [24:34:06<58:22:49,  7.76s/it]
 29%|██▊       | 10870/37963 [24:34:14<58:32:47,  7.78s/it]
                                                           
{'loss': '0.1716', 'grad_norm': '1.369', 'learning_rate': '1.675e-05', 'epoch': '0.2863'}
+
 29%|██▊       | 10870/37963 [24:34:14<58:32:47,  7.78s/it]
 29%|██▊       | 10871/37963 [24:34:22<58:17:17,  7.75s/it]
 29%|██▊       | 10872/37963 [24:34:32<64:03:29,  8.51s/it]
 29%|██▊       | 10873/37963 [24:34:40<62:42:24,  8.33s/it]
 29%|██▊       | 10874/37963 [24:34:48<61:33:34,  8.18s/it]
 29%|██▊       | 10875/37963 [24:34:55<59:22:54,  7.89s/it]
 29%|██▊       | 10876/37963 [24:35:03<58:59:20,  7.84s/it]
 29%|██▊       | 10877/37963 [24:35:10<58:46:48,  7.81s/it]
 29%|██▊       | 10878/37963 [24:35:21<64:34:38,  8.58s/it]
 29%|██▊       | 10879/37963 [24:35:28<62:00:02,  8.24s/it]
 29%|██▊       | 10880/37963 [24:35:39<66:31:12,  8.84s/it]
                                                           
{'loss': '0.1823', 'grad_norm': '3.299', 'learning_rate': '1.674e-05', 'epoch': '0.2866'}
+
 29%|██▊       | 10880/37963 [24:35:39<66:31:12,  8.84s/it]
 29%|██▊       | 10881/37963 [24:35:46<63:56:45,  8.50s/it]
 29%|██▊       | 10882/37963 [24:35:54<62:16:46,  8.28s/it]
 29%|██▊       | 10883/37963 [24:36:02<61:07:03,  8.12s/it]
 29%|██▊       | 10884/37963 [24:36:10<60:20:13,  8.02s/it]
 29%|██▊       | 10885/37963 [24:36:17<60:04:30,  7.99s/it]
 29%|██▊       | 10886/37963 [24:36:25<59:16:52,  7.88s/it]
 29%|██▊       | 10887/37963 [24:36:33<58:13:45,  7.74s/it]
 29%|██▊       | 10888/37963 [24:36:43<64:09:17,  8.53s/it]
 29%|██▊       | 10889/37963 [24:36:51<62:26:50,  8.30s/it]
 29%|██▊       | 10890/37963 [24:37:01<66:52:03,  8.89s/it]
                                                           
{'loss': '0.1714', 'grad_norm': '1.695', 'learning_rate': '1.674e-05', 'epoch': '0.2869'}
+
 29%|██▊       | 10890/37963 [24:37:01<66:52:03,  8.89s/it]
 29%|██▊       | 10891/37963 [24:37:09<64:31:09,  8.58s/it]
 29%|██▊       | 10892/37963 [24:37:16<62:19:50,  8.29s/it]
 29%|██▊       | 10893/37963 [24:37:24<61:09:38,  8.13s/it]
 29%|██▊       | 10894/37963 [24:37:32<60:01:09,  7.98s/it]
 29%|██▊       | 10895/37963 [24:37:39<59:12:42,  7.88s/it]
 29%|██▊       | 10896/37963 [24:37:50<64:47:05,  8.62s/it]
 29%|██▊       | 10897/37963 [24:37:57<62:06:03,  8.26s/it]
 29%|██▊       | 10898/37963 [24:38:05<60:38:20,  8.07s/it]
 29%|██▊       | 10899/37963 [24:38:12<59:15:12,  7.88s/it]
 29%|██▊       | 10900/37963 [24:38:20<58:34:29,  7.79s/it]
                                                           
{'loss': '0.1714', 'grad_norm': '1.61', 'learning_rate': '1.673e-05', 'epoch': '0.2871'}
+
 29%|██▊       | 10900/37963 [24:38:20<58:34:29,  7.79s/it]
 29%|██▊       | 10901/37963 [24:38:27<58:08:17,  7.73s/it]
 29%|██▊       | 10902/37963 [24:38:38<64:19:58,  8.56s/it]
 29%|██▊       | 10903/37963 [24:38:46<62:37:30,  8.33s/it]
 29%|██▊       | 10904/37963 [24:38:53<60:39:34,  8.07s/it]
 29%|██▊       | 10905/37963 [24:39:01<59:19:34,  7.89s/it]
 29%|██▊       | 10906/37963 [24:39:11<65:03:34,  8.66s/it]
 29%|██▊       | 10907/37963 [24:39:19<62:51:14,  8.36s/it]
 29%|██▊       | 10908/37963 [24:39:27<61:30:56,  8.19s/it]
 29%|██▊       | 10909/37963 [24:39:34<60:35:37,  8.06s/it]
 29%|██▊       | 10910/37963 [24:39:42<60:02:47,  7.99s/it]
                                                           
{'loss': '0.1715', 'grad_norm': '2.132', 'learning_rate': '1.672e-05', 'epoch': '0.2874'}
+
 29%|██▊       | 10910/37963 [24:39:42<60:02:47,  7.99s/it]
 29%|██▊       | 10911/37963 [24:39:50<59:23:34,  7.90s/it]
 29%|██▊       | 10912/37963 [24:39:58<59:11:44,  7.88s/it]
 29%|██▊       | 10913/37963 [24:40:05<58:02:09,  7.72s/it]
 29%|██▊       | 10914/37963 [24:40:13<57:54:11,  7.71s/it]
 29%|██▉       | 10915/37963 [24:40:21<58:12:40,  7.75s/it]
 29%|██▉       | 10916/37963 [24:40:28<58:04:55,  7.73s/it]
 29%|██▉       | 10917/37963 [24:40:36<58:05:54,  7.73s/it]
 29%|██▉       | 10918/37963 [24:40:44<58:24:42,  7.78s/it]
 29%|██▉       | 10919/37963 [24:40:51<58:06:28,  7.74s/it]
 29%|██▉       | 10920/37963 [24:40:59<57:45:11,  7.69s/it]
                                                           
{'loss': '0.1679', 'grad_norm': '5.364', 'learning_rate': '1.672e-05', 'epoch': '0.2876'}
+
 29%|██▉       | 10920/37963 [24:40:59<57:45:11,  7.69s/it]
 29%|██▉       | 10921/37963 [24:41:09<62:51:33,  8.37s/it]
 29%|██▉       | 10922/37963 [24:41:17<61:53:49,  8.24s/it]
 29%|██▉       | 10923/37963 [24:41:27<66:24:15,  8.84s/it]
 29%|██▉       | 10924/37963 [24:41:35<63:53:52,  8.51s/it]
 29%|██▉       | 10925/37963 [24:41:43<61:59:00,  8.25s/it]
 29%|██▉       | 10926/37963 [24:41:53<66:25:50,  8.85s/it]
 29%|██▉       | 10927/37963 [24:42:01<64:19:50,  8.57s/it]
 29%|██▉       | 10928/37963 [24:42:09<62:44:04,  8.35s/it]
 29%|██▉       | 10929/37963 [24:42:17<61:49:34,  8.23s/it]
 29%|██▉       | 10930/37963 [24:42:24<61:10:19,  8.15s/it]
                                                           
{'loss': '0.1629', 'grad_norm': '2.103', 'learning_rate': '1.671e-05', 'epoch': '0.2879'}
+
 29%|██▉       | 10930/37963 [24:42:24<61:10:19,  8.15s/it]
 29%|██▉       | 10931/37963 [24:42:35<65:25:54,  8.71s/it]
 29%|██▉       | 10932/37963 [24:42:42<63:31:28,  8.46s/it]
 29%|██▉       | 10933/37963 [24:42:50<61:25:17,  8.18s/it]
 29%|██▉       | 10934/37963 [24:43:00<65:57:38,  8.79s/it]
 29%|██▉       | 10935/37963 [24:43:08<63:50:00,  8.50s/it]
 29%|██▉       | 10936/37963 [24:43:16<61:57:35,  8.25s/it]
 29%|██▉       | 10937/37963 [24:43:23<60:07:31,  8.01s/it]
 29%|██▉       | 10938/37963 [24:43:31<59:20:23,  7.90s/it]
 29%|██▉       | 10939/37963 [24:43:38<58:25:13,  7.78s/it]
 29%|██▉       | 10940/37963 [24:43:46<57:37:07,  7.68s/it]
                                                           
{'loss': '0.169', 'grad_norm': '6.633', 'learning_rate': '1.67e-05', 'epoch': '0.2882'}
+
 29%|██▉       | 10940/37963 [24:43:46<57:37:07,  7.68s/it]
 29%|██▉       | 10941/37963 [24:43:53<57:34:09,  7.67s/it]
 29%|██▉       | 10942/37963 [24:44:01<58:00:46,  7.73s/it]
 29%|██▉       | 10943/37963 [24:44:09<57:59:14,  7.73s/it]
 29%|██▉       | 10944/37963 [24:44:19<63:42:19,  8.49s/it]
 29%|██▉       | 10945/37963 [24:44:27<62:05:57,  8.27s/it]
 29%|██▉       | 10946/37963 [24:44:35<61:16:30,  8.16s/it]
 29%|██▉       | 10947/37963 [24:44:43<60:42:40,  8.09s/it]
 29%|██▉       | 10948/37963 [24:44:50<59:32:36,  7.93s/it]
 29%|██▉       | 10949/37963 [24:44:58<59:09:48,  7.88s/it]
 29%|██▉       | 10950/37963 [24:45:06<58:53:20,  7.85s/it]
                                                           
{'loss': '0.1604', 'grad_norm': '1.433', 'learning_rate': '1.67e-05', 'epoch': '0.2884'}
+
 29%|██▉       | 10950/37963 [24:45:06<58:53:20,  7.85s/it]
 29%|██▉       | 10951/37963 [24:45:14<58:27:36,  7.79s/it]
 29%|██▉       | 10952/37963 [24:45:21<57:54:59,  7.72s/it]
 29%|██▉       | 10953/37963 [24:45:29<57:28:23,  7.66s/it]
 29%|██▉       | 10954/37963 [24:45:36<56:50:42,  7.58s/it]
 29%|██▉       | 10955/37963 [24:45:44<56:55:25,  7.59s/it]
 29%|██▉       | 10956/37963 [24:45:54<63:35:09,  8.48s/it]
 29%|██▉       | 10957/37963 [24:46:02<61:11:21,  8.16s/it]
 29%|██▉       | 10958/37963 [24:46:09<60:19:23,  8.04s/it]
 29%|██▉       | 10959/37963 [24:46:17<59:01:49,  7.87s/it]
 29%|██▉       | 10960/37963 [24:46:27<65:06:10,  8.68s/it]
                                                           
{'loss': '0.1564', 'grad_norm': '3.43', 'learning_rate': '1.669e-05', 'epoch': '0.2887'}
+
 29%|██▉       | 10960/37963 [24:46:27<65:06:10,  8.68s/it]
 29%|██▉       | 10961/37963 [24:46:35<63:06:57,  8.41s/it]
 29%|██▉       | 10962/37963 [24:46:43<61:15:15,  8.17s/it]
 29%|██▉       | 10963/37963 [24:46:51<60:19:50,  8.04s/it]
 29%|██▉       | 10964/37963 [24:46:58<59:40:36,  7.96s/it]
 29%|██▉       | 10965/37963 [24:47:09<64:50:35,  8.65s/it]
 29%|██▉       | 10966/37963 [24:47:16<62:45:34,  8.37s/it]
 29%|██▉       | 10967/37963 [24:47:24<60:57:07,  8.13s/it]
 29%|██▉       | 10968/37963 [24:47:31<59:45:44,  7.97s/it]
 29%|██▉       | 10969/37963 [24:47:39<59:24:09,  7.92s/it]
 29%|██▉       | 10970/37963 [24:47:47<59:05:02,  7.88s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '1.669', 'learning_rate': '1.668e-05', 'epoch': '0.289'}
+
 29%|██▉       | 10970/37963 [24:47:47<59:05:02,  7.88s/it]
 29%|██▉       | 10971/37963 [24:47:55<58:28:09,  7.80s/it]
 29%|██▉       | 10972/37963 [24:48:05<64:00:27,  8.54s/it]
 29%|██▉       | 10973/37963 [24:48:13<62:11:44,  8.30s/it]
 29%|██▉       | 10974/37963 [24:48:20<60:38:36,  8.09s/it]
 29%|██▉       | 10975/37963 [24:48:28<59:29:44,  7.94s/it]
 29%|██▉       | 10976/37963 [24:48:38<64:21:28,  8.59s/it]
 29%|██▉       | 10977/37963 [24:48:48<68:11:51,  9.10s/it]
 29%|██▉       | 10978/37963 [24:48:56<65:01:40,  8.68s/it]
 29%|██▉       | 10979/37963 [24:49:04<62:45:26,  8.37s/it]
 29%|██▉       | 10980/37963 [24:49:14<66:57:02,  8.93s/it]
                                                           
{'loss': '0.1714', 'grad_norm': '1.543', 'learning_rate': '1.668e-05', 'epoch': '0.2892'}
+
 29%|██▉       | 10980/37963 [24:49:14<66:57:02,  8.93s/it]
 29%|██▉       | 10981/37963 [24:49:22<64:35:29,  8.62s/it]
 29%|██▉       | 10982/37963 [24:49:29<61:51:53,  8.25s/it]
 29%|██▉       | 10983/37963 [24:49:37<60:58:28,  8.14s/it]
 29%|██▉       | 10984/37963 [24:49:44<59:25:08,  7.93s/it]
 29%|██▉       | 10985/37963 [24:49:52<59:23:25,  7.93s/it]
 29%|██▉       | 10986/37963 [24:50:00<59:01:13,  7.88s/it]
 29%|██▉       | 10987/37963 [24:50:08<58:24:19,  7.79s/it]
 29%|██▉       | 10988/37963 [24:50:15<57:59:37,  7.74s/it]
 29%|██▉       | 10989/37963 [24:50:23<57:47:26,  7.71s/it]
 29%|██▉       | 10990/37963 [24:50:30<57:24:17,  7.66s/it]
                                                           
{'loss': '0.1875', 'grad_norm': '1.998', 'learning_rate': '1.667e-05', 'epoch': '0.2895'}
+
 29%|██▉       | 10990/37963 [24:50:30<57:24:17,  7.66s/it]
 29%|██▉       | 10991/37963 [24:50:38<57:43:04,  7.70s/it]
 29%|██▉       | 10992/37963 [24:50:46<58:13:44,  7.77s/it]
 29%|██▉       | 10993/37963 [24:50:57<64:05:56,  8.56s/it]
 29%|██▉       | 10994/37963 [24:51:05<62:56:53,  8.40s/it]
 29%|██▉       | 10995/37963 [24:51:12<60:39:48,  8.10s/it]
 29%|██▉       | 10996/37963 [24:51:20<59:38:29,  7.96s/it]
 29%|██▉       | 10997/37963 [24:51:27<58:22:42,  7.79s/it]
 29%|██▉       | 10998/37963 [24:51:35<57:59:20,  7.74s/it]
 29%|██▉       | 10999/37963 [24:51:43<58:22:15,  7.79s/it]
 29%|██▉       | 11000/37963 [24:51:50<57:45:57,  7.71s/it]
                                                           
{'loss': '0.1735', 'grad_norm': '1.992', 'learning_rate': '1.667e-05', 'epoch': '0.2898'}
+
 29%|██▉       | 11000/37963 [24:51:50<57:45:57,  7.71s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.93s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.93s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 29%|██▉       | 11001/37963 [24:52:52<179:50:14, 24.01s/it]
 29%|██▉       | 11002/37963 [24:53:00<142:55:39, 19.08s/it]
 29%|██▉       | 11003/37963 [24:53:08<117:28:31, 15.69s/it]
 29%|██▉       | 11004/37963 [24:53:15<99:32:55, 13.29s/it] 
 29%|██▉       | 11005/37963 [24:53:23<86:45:54, 11.59s/it]
 29%|██▉       | 11006/37963 [24:53:30<77:49:00, 10.39s/it]
 29%|██▉       | 11007/37963 [24:53:38<71:56:37,  9.61s/it]
 29%|██▉       | 11008/37963 [24:53:46<67:37:33,  9.03s/it]
 29%|██▉       | 11009/37963 [24:53:56<69:46:19,  9.32s/it]
 29%|██▉       | 11010/37963 [24:54:04<66:18:52,  8.86s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '1.927', 'learning_rate': '1.666e-05', 'epoch': '0.29'}
+
 29%|██▉       | 11010/37963 [24:54:04<66:18:52,  8.86s/it]
 29%|██▉       | 11011/37963 [24:54:11<63:16:03,  8.45s/it]
 29%|██▉       | 11012/37963 [24:54:19<61:44:39,  8.25s/it]
 29%|██▉       | 11013/37963 [24:54:30<67:02:10,  8.95s/it]
 29%|██▉       | 11014/37963 [24:54:38<64:52:09,  8.67s/it]
 29%|██▉       | 11015/37963 [24:54:45<62:59:19,  8.41s/it]
 29%|██▉       | 11016/37963 [24:54:56<67:19:47,  8.99s/it]
 29%|██▉       | 11017/37963 [24:55:06<70:00:13,  9.35s/it]
 29%|██▉       | 11018/37963 [24:55:14<66:19:49,  8.86s/it]
 29%|██▉       | 11019/37963 [24:55:21<63:32:42,  8.49s/it]
 29%|██▉       | 11020/37963 [24:55:29<61:40:34,  8.24s/it]
                                                           
{'loss': '0.1718', 'grad_norm': '2.113', 'learning_rate': '1.665e-05', 'epoch': '0.2903'}
+
 29%|██▉       | 11020/37963 [24:55:29<61:40:34,  8.24s/it]
 29%|██▉       | 11021/37963 [24:55:37<60:26:51,  8.08s/it]
 29%|██▉       | 11022/37963 [24:55:44<59:01:47,  7.89s/it]
 29%|██▉       | 11023/37963 [24:55:52<58:33:50,  7.83s/it]
 29%|██▉       | 11024/37963 [24:56:02<63:59:42,  8.55s/it]
 29%|██▉       | 11025/37963 [24:56:12<67:36:29,  9.04s/it]
 29%|██▉       | 11026/37963 [24:56:20<64:38:55,  8.64s/it]
 29%|██▉       | 11027/37963 [24:56:28<63:00:57,  8.42s/it]
 29%|██▉       | 11028/37963 [24:56:38<66:40:51,  8.91s/it]
 29%|██▉       | 11029/37963 [24:56:46<64:17:53,  8.59s/it]
 29%|██▉       | 11030/37963 [24:56:53<61:58:39,  8.28s/it]
                                                           
{'loss': '0.1603', 'grad_norm': '1.587', 'learning_rate': '1.665e-05', 'epoch': '0.2905'}
+
 29%|██▉       | 11030/37963 [24:56:53<61:58:39,  8.28s/it]
 29%|██▉       | 11031/37963 [24:57:01<60:36:14,  8.10s/it]
 29%|██▉       | 11032/37963 [24:57:08<59:05:59,  7.90s/it]
 29%|██▉       | 11033/37963 [24:57:16<58:21:56,  7.80s/it]
 29%|██▉       | 11034/37963 [24:57:24<58:03:51,  7.76s/it]
 29%|██▉       | 11035/37963 [24:57:31<58:22:58,  7.81s/it]
 29%|██▉       | 11036/37963 [24:57:39<58:15:14,  7.79s/it]
 29%|██▉       | 11037/37963 [24:57:47<57:56:45,  7.75s/it]
 29%|██▉       | 11038/37963 [24:57:55<58:24:24,  7.81s/it]
 29%|██▉       | 11039/37963 [24:58:02<58:00:05,  7.76s/it]
 29%|██▉       | 11040/37963 [24:58:10<57:47:49,  7.73s/it]
                                                           
{'loss': '0.1865', 'grad_norm': '3.518', 'learning_rate': '1.664e-05', 'epoch': '0.2908'}
+
 29%|██▉       | 11040/37963 [24:58:10<57:47:49,  7.73s/it]
 29%|██▉       | 11041/37963 [24:58:18<57:39:27,  7.71s/it]
 29%|██▉       | 11042/37963 [24:58:26<57:41:42,  7.72s/it]
 29%|██▉       | 11043/37963 [24:58:33<57:24:19,  7.68s/it]
 29%|██▉       | 11044/37963 [24:58:41<57:27:10,  7.68s/it]
 29%|██▉       | 11045/37963 [24:58:51<63:15:02,  8.46s/it]
 29%|██▉       | 11046/37963 [24:58:58<60:42:03,  8.12s/it]
 29%|██▉       | 11047/37963 [24:59:06<59:48:52,  8.00s/it]
 29%|██▉       | 11048/37963 [24:59:14<59:15:06,  7.93s/it]
 29%|██▉       | 11049/37963 [24:59:21<58:31:36,  7.83s/it]
 29%|██▉       | 11050/37963 [24:59:29<57:33:37,  7.70s/it]
                                                           
{'loss': '0.1732', 'grad_norm': '5.187', 'learning_rate': '1.663e-05', 'epoch': '0.2911'}
+
 29%|██▉       | 11050/37963 [24:59:29<57:33:37,  7.70s/it]
 29%|██▉       | 11051/37963 [24:59:36<56:49:53,  7.60s/it]
 29%|██▉       | 11052/37963 [24:59:44<57:08:04,  7.64s/it]
 29%|██▉       | 11053/37963 [24:59:52<57:26:20,  7.68s/it]
 29%|██▉       | 11054/37963 [24:59:59<57:21:36,  7.67s/it]
 29%|██▉       | 11055/37963 [25:00:07<57:23:58,  7.68s/it]
 29%|██▉       | 11056/37963 [25:00:15<57:18:43,  7.67s/it]
 29%|██▉       | 11057/37963 [25:00:22<57:14:30,  7.66s/it]
 29%|██▉       | 11058/37963 [25:00:30<57:51:19,  7.74s/it]
 29%|██▉       | 11059/37963 [25:00:38<57:26:29,  7.69s/it]
 29%|██▉       | 11060/37963 [25:00:45<57:09:42,  7.65s/it]
                                                           
{'loss': '0.1814', 'grad_norm': '2.319', 'learning_rate': '1.663e-05', 'epoch': '0.2913'}
+
 29%|██▉       | 11060/37963 [25:00:45<57:09:42,  7.65s/it]
 29%|██▉       | 11061/37963 [25:00:56<63:28:35,  8.49s/it]
 29%|██▉       | 11062/37963 [25:01:04<62:40:30,  8.39s/it]
 29%|██▉       | 11063/37963 [25:01:17<72:26:20,  9.69s/it]
 29%|██▉       | 11064/37963 [25:01:25<68:10:58,  9.13s/it]
 29%|██▉       | 11065/37963 [25:01:32<64:55:16,  8.69s/it]
 29%|██▉       | 11066/37963 [25:01:40<63:08:33,  8.45s/it]
 29%|██▉       | 11067/37963 [25:01:48<61:35:34,  8.24s/it]
 29%|██▉       | 11068/37963 [25:01:56<60:28:00,  8.09s/it]
 29%|██▉       | 11069/37963 [25:02:06<65:09:13,  8.72s/it]
 29%|██▉       | 11070/37963 [25:02:14<63:26:48,  8.49s/it]
                                                           
{'loss': '0.1855', 'grad_norm': '2.148', 'learning_rate': '1.662e-05', 'epoch': '0.2916'}
+
 29%|██▉       | 11070/37963 [25:02:14<63:26:48,  8.49s/it]
 29%|██▉       | 11071/37963 [25:02:24<67:01:42,  8.97s/it]
 29%|██▉       | 11072/37963 [25:02:37<75:56:54, 10.17s/it]
 29%|██▉       | 11073/37963 [25:02:45<70:21:52,  9.42s/it]
 29%|██▉       | 11074/37963 [25:02:52<66:28:09,  8.90s/it]
 29%|██▉       | 11075/37963 [25:03:00<64:00:06,  8.57s/it]
 29%|██▉       | 11076/37963 [25:03:07<61:15:05,  8.20s/it]
 29%|██▉       | 11077/37963 [25:03:15<59:47:52,  8.01s/it]
 29%|██▉       | 11078/37963 [25:03:23<58:58:22,  7.90s/it]
 29%|██▉       | 11079/37963 [25:03:30<58:07:13,  7.78s/it]
 29%|██▉       | 11080/37963 [25:03:38<57:51:53,  7.75s/it]
                                                           
{'loss': '0.1806', 'grad_norm': '2', 'learning_rate': '1.661e-05', 'epoch': '0.2919'}
+
 29%|██▉       | 11080/37963 [25:03:38<57:51:53,  7.75s/it]
 29%|██▉       | 11081/37963 [25:03:45<57:09:54,  7.66s/it]
 29%|██▉       | 11082/37963 [25:03:53<57:22:00,  7.68s/it]
 29%|██▉       | 11083/37963 [25:04:01<57:13:35,  7.66s/it]
 29%|██▉       | 11084/37963 [25:04:08<56:54:16,  7.62s/it]
 29%|██▉       | 11085/37963 [25:04:15<56:27:30,  7.56s/it]
 29%|██▉       | 11086/37963 [25:04:23<56:37:48,  7.59s/it]
 29%|██▉       | 11087/37963 [25:04:31<56:38:48,  7.59s/it]
 29%|██▉       | 11088/37963 [25:04:39<57:04:51,  7.65s/it]
 29%|██▉       | 11089/37963 [25:04:46<57:24:30,  7.69s/it]
 29%|██▉       | 11090/37963 [25:04:54<57:39:51,  7.72s/it]
                                                           
{'loss': '0.1627', 'grad_norm': '4.428', 'learning_rate': '1.661e-05', 'epoch': '0.2921'}
+
 29%|██▉       | 11090/37963 [25:04:54<57:39:51,  7.72s/it]
 29%|██▉       | 11091/37963 [25:05:02<57:43:36,  7.73s/it]
 29%|██▉       | 11092/37963 [25:05:10<57:33:32,  7.71s/it]
 29%|██▉       | 11093/37963 [25:05:17<57:56:34,  7.76s/it]
 29%|██▉       | 11094/37963 [25:05:25<57:26:46,  7.70s/it]
 29%|██▉       | 11095/37963 [25:05:33<57:33:31,  7.71s/it]
 29%|██▉       | 11096/37963 [25:05:40<57:27:29,  7.70s/it]
 29%|██▉       | 11097/37963 [25:05:48<57:19:11,  7.68s/it]
 29%|██▉       | 11098/37963 [25:05:56<57:10:03,  7.66s/it]
 29%|██▉       | 11099/37963 [25:06:06<63:00:03,  8.44s/it]
 29%|██▉       | 11100/37963 [25:06:14<61:48:13,  8.28s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '2.477', 'learning_rate': '1.66e-05', 'epoch': '0.2924'}
+
 29%|██▉       | 11100/37963 [25:06:14<61:48:13,  8.28s/it]
 29%|██▉       | 11101/37963 [25:06:22<60:35:37,  8.12s/it]
 29%|██▉       | 11102/37963 [25:06:29<59:52:38,  8.02s/it]
 29%|██▉       | 11103/37963 [25:06:37<59:32:19,  7.98s/it]
 29%|██▉       | 11104/37963 [25:06:48<65:34:19,  8.79s/it]
 29%|██▉       | 11105/37963 [25:06:56<63:03:34,  8.45s/it]
 29%|██▉       | 11106/37963 [25:07:03<61:00:43,  8.18s/it]
 29%|██▉       | 11107/37963 [25:07:16<71:31:20,  9.59s/it]
 29%|██▉       | 11108/37963 [25:07:24<67:32:35,  9.05s/it]
 29%|██▉       | 11109/37963 [25:07:32<65:11:13,  8.74s/it]
 29%|██▉       | 11110/37963 [25:07:39<62:36:00,  8.39s/it]
                                                           
{'loss': '0.1762', 'grad_norm': '1.606', 'learning_rate': '1.66e-05', 'epoch': '0.2927'}
+
 29%|██▉       | 11110/37963 [25:07:39<62:36:00,  8.39s/it]
 29%|██▉       | 11111/37963 [25:07:47<60:56:31,  8.17s/it]
 29%|██▉       | 11112/37963 [25:07:55<59:48:29,  8.02s/it]
 29%|██▉       | 11113/37963 [25:08:02<58:35:09,  7.86s/it]
 29%|██▉       | 11114/37963 [25:08:10<58:10:00,  7.80s/it]
 29%|██▉       | 11115/37963 [25:08:17<56:47:45,  7.62s/it]
 29%|██▉       | 11116/37963 [25:08:25<57:04:25,  7.65s/it]
 29%|██▉       | 11117/37963 [25:08:32<57:09:34,  7.66s/it]
 29%|██���       | 11118/37963 [25:08:40<57:22:36,  7.69s/it]
 29%|██▉       | 11119/37963 [25:08:48<57:28:50,  7.71s/it]
 29%|██▉       | 11120/37963 [25:08:56<57:27:57,  7.71s/it]
                                                           
{'loss': '0.1851', 'grad_norm': '1.449', 'learning_rate': '1.659e-05', 'epoch': '0.2929'}
+
 29%|██▉       | 11120/37963 [25:08:56<57:27:57,  7.71s/it]
 29%|██▉       | 11121/37963 [25:09:03<57:05:39,  7.66s/it]
 29%|██▉       | 11122/37963 [25:09:11<57:05:48,  7.66s/it]
 29%|██▉       | 11123/37963 [25:09:21<62:20:27,  8.36s/it]
 29%|██▉       | 11124/37963 [25:09:29<61:09:01,  8.20s/it]
 29%|██▉       | 11125/37963 [25:09:41<70:43:33,  9.49s/it]
 29%|██▉       | 11126/37963 [25:09:52<73:06:26,  9.81s/it]
 29%|██▉       | 11127/37963 [25:10:00<69:21:13,  9.30s/it]
 29%|██▉       | 11128/37963 [25:10:08<65:54:16,  8.84s/it]
 29%|██▉       | 11129/37963 [25:10:16<63:50:27,  8.56s/it]
 29%|██▉       | 11130/37963 [25:10:23<62:27:21,  8.38s/it]
                                                           
{'loss': '0.1698', 'grad_norm': '2.834', 'learning_rate': '1.658e-05', 'epoch': '0.2932'}
+
 29%|██▉       | 11130/37963 [25:10:23<62:27:21,  8.38s/it]
 29%|██▉       | 11131/37963 [25:10:31<60:59:24,  8.18s/it]
 29%|██▉       | 11132/37963 [25:10:39<59:36:29,  8.00s/it]
 29%|██▉       | 11133/37963 [25:10:47<59:25:03,  7.97s/it]
 29%|██▉       | 11134/37963 [25:10:54<58:17:37,  7.82s/it]
 29%|██▉       | 11135/37963 [25:11:02<58:01:43,  7.79s/it]
 29%|██▉       | 11136/37963 [25:11:10<57:51:08,  7.76s/it]
 29%|██▉       | 11137/37963 [25:11:17<57:41:25,  7.74s/it]
 29%|██▉       | 11138/37963 [25:11:25<57:51:24,  7.76s/it]
 29%|██▉       | 11139/37963 [25:11:33<58:08:07,  7.80s/it]
 29%|██▉       | 11140/37963 [25:11:41<57:35:41,  7.73s/it]
                                                           
{'loss': '0.173', 'grad_norm': '1.629', 'learning_rate': '1.658e-05', 'epoch': '0.2934'}
+
 29%|██▉       | 11140/37963 [25:11:41<57:35:41,  7.73s/it]
 29%|██▉       | 11141/37963 [25:11:48<57:59:25,  7.78s/it]
 29%|██▉       | 11142/37963 [25:11:56<57:58:15,  7.78s/it]
 29%|██▉       | 11143/37963 [25:12:04<57:57:44,  7.78s/it]
 29%|██▉       | 11144/37963 [25:12:12<57:55:42,  7.78s/it]
 29%|██▉       | 11145/37963 [25:12:19<57:44:18,  7.75s/it]
 29%|██▉       | 11146/37963 [25:12:27<57:32:41,  7.73s/it]
 29%|██▉       | 11147/37963 [25:12:35<57:12:52,  7.68s/it]
 29%|██▉       | 11148/37963 [25:12:45<63:43:43,  8.56s/it]
 29%|██▉       | 11149/37963 [25:12:53<62:03:00,  8.33s/it]
 29%|██▉       | 11150/37963 [25:13:04<66:56:02,  8.99s/it]
                                                           
{'loss': '0.1655', 'grad_norm': '2.923', 'learning_rate': '1.657e-05', 'epoch': '0.2937'}
+
 29%|██▉       | 11150/37963 [25:13:04<66:56:02,  8.99s/it]
 29%|██▉       | 11151/37963 [25:13:11<63:50:22,  8.57s/it]
 29%|██▉       | 11152/37963 [25:13:19<61:58:00,  8.32s/it]
 29%|██▉       | 11153/37963 [25:13:32<72:18:42,  9.71s/it]
 29%|██▉       | 11154/37963 [25:13:40<68:24:09,  9.19s/it]
 29%|██▉       | 11155/37963 [25:13:47<64:35:43,  8.67s/it]
 29%|██▉       | 11156/37963 [25:13:55<62:21:19,  8.37s/it]
 29%|██▉       | 11157/37963 [25:14:03<60:45:10,  8.16s/it]
 29%|██▉       | 11158/37963 [25:14:10<59:52:58,  8.04s/it]
 29%|██▉       | 11159/37963 [25:14:18<58:49:44,  7.90s/it]
 29%|██▉       | 11160/37963 [25:14:26<58:32:06,  7.86s/it]
                                                           
{'loss': '0.1749', 'grad_norm': '2.107', 'learning_rate': '1.656e-05', 'epoch': '0.294'}
+
 29%|██▉       | 11160/37963 [25:14:26<58:32:06,  7.86s/it]
 29%|██▉       | 11161/37963 [25:14:33<58:03:07,  7.80s/it]
 29%|██▉       | 11162/37963 [25:14:41<56:49:40,  7.63s/it]
 29%|██▉       | 11163/37963 [25:14:48<56:52:06,  7.64s/it]
 29%|██▉       | 11164/37963 [25:14:56<57:00:19,  7.66s/it]
 29%|██▉       | 11165/37963 [25:15:03<56:23:57,  7.58s/it]
 29%|██▉       | 11166/37963 [25:15:11<56:23:10,  7.58s/it]
 29%|██▉       | 11167/37963 [25:15:19<56:47:32,  7.63s/it]
 29%|██▉       | 11168/37963 [25:15:27<57:23:33,  7.71s/it]
 29%|██▉       | 11169/37963 [25:15:34<57:19:02,  7.70s/it]
 29%|██▉       | 11170/37963 [25:15:42<57:36:02,  7.74s/it]
                                                           
{'loss': '0.1677', 'grad_norm': '3.436', 'learning_rate': '1.656e-05', 'epoch': '0.2942'}
+
 29%|██▉       | 11170/37963 [25:15:42<57:36:02,  7.74s/it]
 29%|██▉       | 11171/37963 [25:15:52<63:21:04,  8.51s/it]
 29%|██▉       | 11172/37963 [25:16:00<61:55:29,  8.32s/it]
 29%|██▉       | 11173/37963 [25:16:08<60:26:12,  8.12s/it]
 29%|██▉       | 11174/37963 [25:16:16<59:39:35,  8.02s/it]
 29%|██▉       | 11175/37963 [25:16:23<58:51:41,  7.91s/it]
 29%|██▉       | 11176/37963 [25:16:31<58:48:21,  7.90s/it]
 29%|██▉       | 11177/37963 [25:16:39<57:35:22,  7.74s/it]
 29%|██▉       | 11178/37963 [25:16:46<57:21:16,  7.71s/it]
 29%|██▉       | 11179/37963 [25:16:59<68:07:13,  9.16s/it]
 29%|██▉       | 11180/37963 [25:17:09<71:13:09,  9.57s/it]
                                                           
{'loss': '0.1745', 'grad_norm': '2.738', 'learning_rate': '1.655e-05', 'epoch': '0.2945'}
+
 29%|██▉       | 11180/37963 [25:17:09<71:13:09,  9.57s/it]
 29%|██▉       | 11181/37963 [25:17:17<67:32:31,  9.08s/it]
 29%|██▉       | 11182/37963 [25:17:25<63:46:47,  8.57s/it]
 29%|██▉       | 11183/37963 [25:17:32<61:50:32,  8.31s/it]
 29%|██▉       | 11184/37963 [25:17:40<60:28:49,  8.13s/it]
 29%|██▉       | 11185/37963 [25:17:48<59:20:20,  7.98s/it]
 29%|██▉       | 11186/37963 [25:17:55<58:27:06,  7.86s/it]
 29%|██▉       | 11187/37963 [25:18:03<57:25:58,  7.72s/it]
 29%|██▉       | 11188/37963 [25:18:11<57:36:41,  7.75s/it]
 29%|██▉       | 11189/37963 [25:18:18<57:25:34,  7.72s/it]
 29%|██▉       | 11190/37963 [25:18:26<57:27:20,  7.73s/it]
                                                           
{'loss': '0.1694', 'grad_norm': '3.5', 'learning_rate': '1.654e-05', 'epoch': '0.2948'}
+
 29%|██▉       | 11190/37963 [25:18:26<57:27:20,  7.73s/it]
 29%|██▉       | 11191/37963 [25:18:33<56:58:48,  7.66s/it]
 29%|██▉       | 11192/37963 [25:18:41<57:08:13,  7.68s/it]
 29%|██▉       | 11193/37963 [25:18:49<56:34:46,  7.61s/it]
 29%|██▉       | 11194/37963 [25:18:56<56:53:09,  7.65s/it]
 29%|██▉       | 11195/37963 [25:19:04<57:37:13,  7.75s/it]
 29%|██▉       | 11196/37963 [25:19:12<56:57:37,  7.66s/it]
 29%|██▉       | 11197/37963 [25:19:20<57:21:57,  7.72s/it]
 29%|██▉       | 11198/37963 [25:19:27<56:50:36,  7.65s/it]
 29%|██▉       | 11199/37963 [25:19:35<56:30:52,  7.60s/it]
 30%|██▉       | 11200/37963 [25:19:42<56:28:41,  7.60s/it]
                                                           
{'loss': '0.1624', 'grad_norm': '1.189', 'learning_rate': '1.654e-05', 'epoch': '0.295'}
+
 30%|██▉       | 11200/37963 [25:19:42<56:28:41,  7.60s/it]
 30%|██▉       | 11201/37963 [25:19:53<62:48:14,  8.45s/it]
 30%|██▉       | 11202/37963 [25:20:03<67:44:21,  9.11s/it]
 30%|██▉       | 11203/37963 [25:20:11<64:13:43,  8.64s/it]
 30%|██▉       | 11204/37963 [25:20:21<68:03:15,  9.16s/it]
 30%|██▉       | 11205/37963 [25:20:29<65:05:43,  8.76s/it]
 30%|██▉       | 11206/37963 [25:20:39<68:17:53,  9.19s/it]
 30%|██▉       | 11207/37963 [25:20:47<65:10:57,  8.77s/it]
 30%|██▉       | 11208/37963 [25:20:55<62:33:56,  8.42s/it]
 30%|██▉       | 11209/37963 [25:21:02<60:43:22,  8.17s/it]
 30%|██▉       | 11210/37963 [25:21:10<59:28:01,  8.00s/it]
                                                           
{'loss': '0.1779', 'grad_norm': '1.339', 'learning_rate': '1.653e-05', 'epoch': '0.2953'}
+
 30%|██▉       | 11210/37963 [25:21:10<59:28:01,  8.00s/it]
 30%|██▉       | 11211/37963 [25:21:17<57:54:36,  7.79s/it]
 30%|██▉       | 11212/37963 [25:21:25<57:33:56,  7.75s/it]
 30%|██▉       | 11213/37963 [25:21:32<57:00:08,  7.67s/it]
 30%|██▉       | 11214/37963 [25:21:40<56:44:57,  7.64s/it]
 30%|██▉       | 11215/37963 [25:21:50<62:51:48,  8.46s/it]
 30%|██▉       | 11216/37963 [25:21:58<61:19:54,  8.25s/it]
 30%|██▉       | 11217/37963 [25:22:06<60:07:49,  8.09s/it]
 30%|██▉       | 11218/37963 [25:22:13<58:59:51,  7.94s/it]
 30%|██▉       | 11219/37963 [25:22:21<57:45:59,  7.78s/it]
 30%|██▉       | 11220/37963 [25:22:28<57:43:41,  7.77s/it]
                                                           
{'loss': '0.1841', 'grad_norm': '3.918', 'learning_rate': '1.652e-05', 'epoch': '0.2956'}
+
 30%|██▉       | 11220/37963 [25:22:28<57:43:41,  7.77s/it]
 30%|██▉       | 11221/37963 [25:22:36<57:24:45,  7.73s/it]
 30%|██▉       | 11222/37963 [25:22:44<58:04:30,  7.82s/it]
 30%|██▉       | 11223/37963 [25:22:52<57:55:33,  7.80s/it]
 30%|██▉       | 11224/37963 [25:22:59<57:19:34,  7.72s/it]
 30%|██▉       | 11225/37963 [25:23:07<57:22:40,  7.73s/it]
 30%|██▉       | 11226/37963 [25:23:15<57:19:52,  7.72s/it]
 30%|██▉       | 11227/37963 [25:23:22<56:59:35,  7.67s/it]
 30%|██▉       | 11228/37963 [25:23:30<57:07:28,  7.69s/it]
 30%|██▉       | 11229/37963 [25:23:38<56:54:16,  7.66s/it]
 30%|██▉       | 11230/37963 [25:23:46<57:21:11,  7.72s/it]
                                                           
{'loss': '0.1812', 'grad_norm': '4.947', 'learning_rate': '1.652e-05', 'epoch': '0.2958'}
+
 30%|██▉       | 11230/37963 [25:23:46<57:21:11,  7.72s/it]
 30%|██▉       | 11231/37963 [25:23:53<57:12:13,  7.70s/it]
 30%|██▉       | 11232/37963 [25:24:01<57:05:31,  7.69s/it]
 30%|██▉       | 11233/37963 [25:24:14<68:29:02,  9.22s/it]
 30%|██▉       | 11234/37963 [25:24:24<70:18:29,  9.47s/it]
 30%|██▉       | 11235/37963 [25:24:31<66:11:11,  8.91s/it]
 30%|██▉       | 11236/37963 [25:24:39<63:19:53,  8.53s/it]
 30%|██▉       | 11237/37963 [25:24:47<61:16:18,  8.25s/it]
 30%|██▉       | 11238/37963 [25:24:54<60:02:08,  8.09s/it]
 30%|██▉       | 11239/37963 [25:25:02<58:53:29,  7.93s/it]
 30%|██▉       | 11240/37963 [25:25:10<58:30:59,  7.88s/it]
                                                           
{'loss': '0.1862', 'grad_norm': '2.967', 'learning_rate': '1.651e-05', 'epoch': '0.2961'}
+
 30%|██▉       | 11240/37963 [25:25:10<58:30:59,  7.88s/it]
 30%|██▉       | 11241/37963 [25:25:17<57:47:55,  7.79s/it]
 30%|██▉       | 11242/37963 [25:25:25<57:38:58,  7.77s/it]
 30%|██▉       | 11243/37963 [25:25:33<57:21:35,  7.73s/it]
 30%|██▉       | 11244/37963 [25:25:43<62:16:01,  8.39s/it]
 30%|██▉       | 11245/37963 [25:25:50<60:59:35,  8.22s/it]
 30%|██▉       | 11246/37963 [25:25:58<59:20:40,  8.00s/it]
 30%|██▉       | 11247/37963 [25:26:06<59:17:09,  7.99s/it]
 30%|██▉       | 11248/37963 [25:26:14<58:43:00,  7.91s/it]
 30%|██▉       | 11249/37963 [25:26:21<58:05:44,  7.83s/it]
 30%|██▉       | 11250/37963 [25:26:32<64:22:14,  8.67s/it]
                                                           
{'loss': '0.1733', 'grad_norm': '3.926', 'learning_rate': '1.651e-05', 'epoch': '0.2963'}
+
 30%|██▉       | 11250/37963 [25:26:32<64:22:14,  8.67s/it]
 30%|██▉       | 11251/37963 [25:26:39<62:11:33,  8.38s/it]
 30%|██▉       | 11252/37963 [25:26:47<60:33:55,  8.16s/it]
 30%|██▉       | 11253/37963 [25:26:55<59:28:00,  8.02s/it]
 30%|██▉       | 11254/37963 [25:27:03<59:00:19,  7.95s/it]
 30%|██▉       | 11255/37963 [25:27:10<58:36:14,  7.90s/it]
 30%|██▉       | 11256/37963 [25:27:18<58:33:14,  7.89s/it]
 30%|██▉       | 11257/37963 [25:27:29<63:52:46,  8.61s/it]
 30%|██▉       | 11258/37963 [25:27:41<72:56:00,  9.83s/it]
 30%|██▉       | 11259/37963 [25:27:49<68:24:28,  9.22s/it]
 30%|██▉       | 11260/37963 [25:27:57<65:13:36,  8.79s/it]
                                                           
{'loss': '0.172', 'grad_norm': '3.966', 'learning_rate': '1.65e-05', 'epoch': '0.2966'}
+
 30%|██▉       | 11260/37963 [25:27:57<65:13:36,  8.79s/it]
 30%|██▉       | 11261/37963 [25:28:05<63:12:17,  8.52s/it]
 30%|██▉       | 11262/37963 [25:28:12<61:33:04,  8.30s/it]
 30%|██▉       | 11263/37963 [25:28:20<60:51:05,  8.20s/it]
 30%|██▉       | 11264/37963 [25:28:29<60:32:24,  8.16s/it]
 30%|██▉       | 11265/37963 [25:28:36<59:41:35,  8.05s/it]
 30%|██▉       | 11266/37963 [25:28:44<59:08:25,  7.97s/it]
 30%|██▉       | 11267/37963 [25:28:52<58:31:01,  7.89s/it]
 30%|██▉       | 11268/37963 [25:29:00<58:12:53,  7.85s/it]
 30%|██▉       | 11269/37963 [25:29:07<58:07:39,  7.84s/it]
 30%|██▉       | 11270/37963 [25:29:15<57:48:32,  7.80s/it]
                                                           
{'loss': '0.1777', 'grad_norm': '1.809', 'learning_rate': '1.649e-05', 'epoch': '0.2969'}
+
 30%|██▉       | 11270/37963 [25:29:15<57:48:32,  7.80s/it]
 30%|██▉       | 11271/37963 [25:29:23<57:01:24,  7.69s/it]
 30%|██▉       | 11272/37963 [25:29:30<57:11:08,  7.71s/it]
 30%|██▉       | 11273/37963 [25:29:38<57:27:03,  7.75s/it]
 30%|██▉       | 11274/37963 [25:29:46<57:26:33,  7.75s/it]
 30%|██▉       | 11275/37963 [25:29:53<56:22:31,  7.60s/it]
 30%|██▉       | 11276/37963 [25:30:01<56:39:00,  7.64s/it]
 30%|██▉       | 11277/37963 [25:30:09<56:38:39,  7.64s/it]
 30%|██▉       | 11278/37963 [25:30:16<56:40:51,  7.65s/it]
 30%|██▉       | 11279/37963 [25:30:24<56:31:23,  7.63s/it]
 30%|██▉       | 11280/37963 [25:30:31<56:44:26,  7.66s/it]
                                                           
{'loss': '0.1714', 'grad_norm': '2.819', 'learning_rate': '1.649e-05', 'epoch': '0.2971'}
+
 30%|██▉       | 11280/37963 [25:30:31<56:44:26,  7.66s/it]
 30%|██▉       | 11281/37963 [25:30:39<57:02:14,  7.70s/it]
 30%|██▉       | 11282/37963 [25:30:47<57:07:56,  7.71s/it]
 30%|██▉       | 11283/37963 [25:30:55<56:55:09,  7.68s/it]
 30%|██▉       | 11284/37963 [25:31:03<57:32:32,  7.76s/it]
 30%|██▉       | 11285/37963 [25:31:10<56:52:08,  7.67s/it]
 30%|██▉       | 11286/37963 [25:31:18<57:03:31,  7.70s/it]
 30%|██▉       | 11287/37963 [25:31:31<69:01:12,  9.31s/it]
 30%|██▉       | 11288/37963 [25:31:41<71:25:47,  9.64s/it]
 30%|██▉       | 11289/37963 [25:31:49<67:35:04,  9.12s/it]
 30%|██▉       | 11290/37963 [25:31:57<64:42:59,  8.73s/it]
                                                           
{'loss': '0.1827', 'grad_norm': '0.9599', 'learning_rate': '1.648e-05', 'epoch': '0.2974'}
+
 30%|██▉       | 11290/37963 [25:31:57<64:42:59,  8.73s/it]
 30%|██▉       | 11291/37963 [25:32:05<62:16:58,  8.41s/it]
 30%|██▉       | 11292/37963 [25:32:12<60:57:01,  8.23s/it]
 30%|██▉       | 11293/37963 [25:32:20<58:42:21,  7.92s/it]
 30%|██▉       | 11294/37963 [25:32:27<57:41:24,  7.79s/it]
 30%|██▉       | 11295/37963 [25:32:35<57:52:54,  7.81s/it]
 30%|██▉       | 11296/37963 [25:32:43<57:26:43,  7.76s/it]
 30%|██▉       | 11297/37963 [25:32:50<56:51:52,  7.68s/it]
 30%|██▉       | 11298/37963 [25:33:00<62:12:21,  8.40s/it]
 30%|██▉       | 11299/37963 [25:33:08<60:55:58,  8.23s/it]
 30%|██▉       | 11300/37963 [25:33:16<59:35:00,  8.04s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '1.64', 'learning_rate': '1.647e-05', 'epoch': '0.2977'}
+
 30%|██▉       | 11300/37963 [25:33:16<59:35:00,  8.04s/it]
 30%|██▉       | 11301/37963 [25:33:26<64:34:55,  8.72s/it]
 30%|██▉       | 11302/37963 [25:33:36<67:42:48,  9.14s/it]
 30%|██▉       | 11303/37963 [25:33:44<64:05:27,  8.65s/it]
 30%|██▉       | 11304/37963 [25:33:54<67:56:00,  9.17s/it]
 30%|██▉       | 11305/37963 [25:34:02<64:47:12,  8.75s/it]
 30%|██▉       | 11306/37963 [25:34:12<67:43:19,  9.15s/it]
 30%|██▉       | 11307/37963 [25:34:20<64:42:31,  8.74s/it]
 30%|██▉       | 11308/37963 [25:34:27<62:37:21,  8.46s/it]
 30%|██▉       | 11309/37963 [25:34:35<61:08:43,  8.26s/it]
 30%|██▉       | 11310/37963 [25:34:43<59:51:41,  8.09s/it]
                                                           
{'loss': '0.1821', 'grad_norm': '3.183', 'learning_rate': '1.647e-05', 'epoch': '0.2979'}
+
 30%|██▉       | 11310/37963 [25:34:43<59:51:41,  8.09s/it]
 30%|██▉       | 11311/37963 [25:34:50<58:33:10,  7.91s/it]
 30%|██▉       | 11312/37963 [25:34:58<57:56:42,  7.83s/it]
 30%|██▉       | 11313/37963 [25:35:06<57:36:46,  7.78s/it]
 30%|██▉       | 11314/37963 [25:35:14<58:00:42,  7.84s/it]
 30%|██▉       | 11315/37963 [25:35:21<57:39:23,  7.79s/it]
 30%|██▉       | 11316/37963 [25:35:29<57:10:55,  7.73s/it]
 30%|██▉       | 11317/37963 [25:35:37<57:40:05,  7.79s/it]
 30%|██▉       | 11318/37963 [25:35:45<57:48:33,  7.81s/it]
 30%|██▉       | 11319/37963 [25:35:53<57:46:52,  7.81s/it]
 30%|██▉       | 11320/37963 [25:36:00<57:07:19,  7.72s/it]
                                                           
{'loss': '0.1853', 'grad_norm': '2.14', 'learning_rate': '1.646e-05', 'epoch': '0.2982'}
+
 30%|██▉       | 11320/37963 [25:36:00<57:07:19,  7.72s/it]
 30%|██▉       | 11321/37963 [25:36:08<56:38:39,  7.65s/it]
 30%|██▉       | 11322/37963 [25:36:15<56:22:59,  7.62s/it]
 30%|██▉       | 11323/37963 [25:36:23<56:44:31,  7.67s/it]
 30%|██▉       | 11324/37963 [25:36:31<56:56:52,  7.70s/it]
 30%|██▉       | 11325/37963 [25:36:38<56:47:42,  7.68s/it]
 30%|██▉       | 11326/37963 [25:36:46<56:34:28,  7.65s/it]
 30%|██▉       | 11327/37963 [25:36:54<56:54:05,  7.69s/it]
 30%|██▉       | 11328/37963 [25:37:01<56:58:20,  7.70s/it]
 30%|██▉       | 11329/37963 [25:37:09<57:17:55,  7.74s/it]
 30%|██▉       | 11330/37963 [25:37:17<56:59:46,  7.70s/it]
                                                           
{'loss': '0.1722', 'grad_norm': '3.304', 'learning_rate': '1.645e-05', 'epoch': '0.2984'}
+
 30%|██▉       | 11330/37963 [25:37:17<56:59:46,  7.70s/it]
 30%|██▉       | 11331/37963 [25:37:25<57:03:41,  7.71s/it]
 30%|██▉       | 11332/37963 [25:37:35<62:41:24,  8.47s/it]
 30%|██▉       | 11333/37963 [25:37:43<61:33:42,  8.32s/it]
 30%|██▉       | 11334/37963 [25:37:50<59:58:47,  8.11s/it]
 30%|██▉       | 11335/37963 [25:37:58<59:15:39,  8.01s/it]
 30%|██▉       | 11336/37963 [25:38:08<64:06:59,  8.67s/it]
 30%|██▉       | 11337/37963 [25:38:16<61:56:08,  8.37s/it]
 30%|██▉       | 11338/37963 [25:38:24<60:00:26,  8.11s/it]
 30%|██▉       | 11339/37963 [25:38:31<59:26:37,  8.04s/it]
 30%|██▉       | 11340/37963 [25:38:39<58:45:57,  7.95s/it]
                                                           
{'loss': '0.1757', 'grad_norm': '0.8982', 'learning_rate': '1.645e-05', 'epoch': '0.2987'}
+
 30%|██▉       | 11340/37963 [25:38:39<58:45:57,  7.95s/it]
 30%|██▉       | 11341/37963 [25:38:47<58:04:10,  7.85s/it]
 30%|██▉       | 11342/37963 [25:38:57<63:31:30,  8.59s/it]
 30%|██▉       | 11343/37963 [25:39:04<60:48:00,  8.22s/it]
 30%|██▉       | 11344/37963 [25:39:12<59:06:43,  7.99s/it]
 30%|██▉       | 11345/37963 [25:39:20<58:19:32,  7.89s/it]
 30%|██▉       | 11346/37963 [25:39:30<63:08:24,  8.54s/it]
 30%|██▉       | 11347/37963 [25:39:40<66:22:39,  8.98s/it]
 30%|██▉       | 11348/37963 [25:39:48<63:56:54,  8.65s/it]
 30%|██▉       | 11349/37963 [25:39:55<61:36:26,  8.33s/it]
 30%|██▉       | 11350/37963 [25:40:05<66:05:40,  8.94s/it]
                                                           
{'loss': '0.1738', 'grad_norm': '3.397', 'learning_rate': '1.644e-05', 'epoch': '0.299'}
+
 30%|██▉       | 11350/37963 [25:40:05<66:05:40,  8.94s/it]
 30%|██▉       | 11351/37963 [25:40:13<63:15:27,  8.56s/it]
 30%|██▉       | 11352/37963 [25:40:21<61:12:32,  8.28s/it]
 30%|██▉       | 11353/37963 [25:40:28<59:45:50,  8.09s/it]
 30%|██▉       | 11354/37963 [25:40:38<64:04:57,  8.67s/it]
 30%|██▉       | 11355/37963 [25:40:46<61:59:15,  8.39s/it]
 30%|██▉       | 11356/37963 [25:40:54<60:20:21,  8.16s/it]
 30%|██▉       | 11357/37963 [25:41:01<59:03:32,  7.99s/it]
 30%|██▉       | 11358/37963 [25:41:12<65:02:03,  8.80s/it]
 30%|██▉       | 11359/37963 [25:41:20<62:39:12,  8.48s/it]
 30%|██▉       | 11360/37963 [25:41:28<61:01:41,  8.26s/it]
                                                           
{'loss': '0.1878', 'grad_norm': '1.45', 'learning_rate': '1.643e-05', 'epoch': '0.2992'}
+
 30%|██▉       | 11360/37963 [25:41:28<61:01:41,  8.26s/it]
 30%|██▉       | 11361/37963 [25:41:35<60:18:59,  8.16s/it]
 30%|██▉       | 11362/37963 [25:41:43<59:32:54,  8.06s/it]
 30%|██▉       | 11363/37963 [25:41:51<58:48:39,  7.96s/it]
 30%|██▉       | 11364/37963 [25:41:59<58:10:09,  7.87s/it]
 30%|██▉       | 11365/37963 [25:42:07<58:04:37,  7.86s/it]
 30%|██▉       | 11366/37963 [25:42:14<58:18:40,  7.89s/it]
 30%|██▉       | 11367/37963 [25:42:22<57:50:10,  7.83s/it]
 30%|██▉       | 11368/37963 [25:42:30<57:15:53,  7.75s/it]
 30%|██▉       | 11369/37963 [25:42:38<57:33:51,  7.79s/it]
 30%|██▉       | 11370/37963 [25:42:45<56:23:31,  7.63s/it]
                                                           
{'loss': '0.1667', 'grad_norm': '2.818', 'learning_rate': '1.643e-05', 'epoch': '0.2995'}
+
 30%|██▉       | 11370/37963 [25:42:45<56:23:31,  7.63s/it]
 30%|██▉       | 11371/37963 [25:42:53<56:34:40,  7.66s/it]
 30%|██▉       | 11372/37963 [25:43:00<56:36:29,  7.66s/it]
 30%|██▉       | 11373/37963 [25:43:08<56:59:27,  7.72s/it]
 30%|██▉       | 11374/37963 [25:43:16<57:13:48,  7.75s/it]
 30%|██▉       | 11375/37963 [25:43:24<57:26:57,  7.78s/it]
 30%|██▉       | 11376/37963 [25:43:31<56:45:01,  7.68s/it]
 30%|██▉       | 11377/37963 [25:43:39<56:52:14,  7.70s/it]
 30%|██▉       | 11378/37963 [25:43:46<55:46:26,  7.55s/it]
 30%|██▉       | 11379/37963 [25:43:54<56:22:24,  7.63s/it]
 30%|██▉       | 11380/37963 [25:44:02<56:22:10,  7.63s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '1.599', 'learning_rate': '1.642e-05', 'epoch': '0.2998'}
+
 30%|██▉       | 11380/37963 [25:44:02<56:22:10,  7.63s/it]
 30%|██▉       | 11381/37963 [25:44:09<56:33:17,  7.66s/it]
 30%|██▉       | 11382/37963 [25:44:17<56:18:24,  7.63s/it]
 30%|██▉       | 11383/37963 [25:44:24<56:04:06,  7.59s/it]
 30%|██▉       | 11384/37963 [25:44:32<55:57:51,  7.58s/it]
 30%|██▉       | 11385/37963 [25:44:42<61:32:46,  8.34s/it]
 30%|██▉       | 11386/37963 [25:44:50<60:12:04,  8.15s/it]
 30%|██▉       | 11387/37963 [25:44:58<59:13:58,  8.02s/it]
 30%|██▉       | 11388/37963 [25:45:05<58:24:45,  7.91s/it]
 30%|███       | 11389/37963 [25:45:13<57:57:09,  7.85s/it]
 30%|███       | 11390/37963 [25:45:26<68:52:48,  9.33s/it]
                                                           
{'loss': '0.1621', 'grad_norm': '1.735', 'learning_rate': '1.641e-05', 'epoch': '0.3'}
+
 30%|███       | 11390/37963 [25:45:26<68:52:48,  9.33s/it]
 30%|███       | 11391/37963 [25:45:34<65:37:55,  8.89s/it]
 30%|███       | 11392/37963 [25:45:41<62:48:27,  8.51s/it]
 30%|███       | 11393/37963 [25:45:49<61:12:17,  8.29s/it]
 30%|███       | 11394/37963 [25:45:57<59:37:31,  8.08s/it]
 30%|███       | 11395/37963 [25:46:07<64:22:08,  8.72s/it]
 30%|███       | 11396/37963 [25:46:15<62:11:25,  8.43s/it]
 30%|███       | 11397/37963 [25:46:22<60:22:37,  8.18s/it]
 30%|███       | 11398/37963 [25:46:30<59:05:23,  8.01s/it]
 30%|███       | 11399/37963 [25:46:38<58:41:10,  7.95s/it]
 30%|███       | 11400/37963 [25:46:48<63:59:03,  8.67s/it]
                                                           
{'loss': '0.175', 'grad_norm': '2.283', 'learning_rate': '1.641e-05', 'epoch': '0.3003'}
+
 30%|███       | 11400/37963 [25:46:48<63:59:03,  8.67s/it]
 30%|███       | 11401/37963 [25:46:56<61:44:52,  8.37s/it]
 30%|███       | 11402/37963 [25:47:06<66:35:08,  9.02s/it]
 30%|███       | 11403/37963 [25:47:14<63:27:28,  8.60s/it]
 30%|███       | 11404/37963 [25:47:27<73:08:03,  9.91s/it]
 30%|███       | 11405/37963 [25:47:34<68:23:49,  9.27s/it]
 30%|███       | 11406/37963 [25:47:42<64:38:05,  8.76s/it]
 30%|███       | 11407/37963 [25:47:49<61:27:00,  8.33s/it]
 30%|███       | 11408/37963 [25:47:57<59:52:03,  8.12s/it]
 30%|███       | 11409/37963 [25:48:05<58:44:49,  7.96s/it]
 30%|███       | 11410/37963 [25:48:12<58:14:33,  7.90s/it]
                                                           
{'loss': '0.1677', 'grad_norm': '0.921', 'learning_rate': '1.64e-05', 'epoch': '0.3006'}
+
 30%|███       | 11410/37963 [25:48:12<58:14:33,  7.90s/it]
 30%|███       | 11411/37963 [25:48:20<57:34:49,  7.81s/it]
 30%|███       | 11412/37963 [25:48:28<57:23:14,  7.78s/it]
 30%|███       | 11413/37963 [25:48:35<57:13:24,  7.76s/it]
 30%|███       | 11414/37963 [25:48:43<56:42:04,  7.69s/it]
 30%|███       | 11415/37963 [25:48:51<57:29:41,  7.80s/it]
 30%|███       | 11416/37963 [25:48:59<57:01:27,  7.73s/it]
 30%|███       | 11417/37963 [25:49:06<56:38:45,  7.68s/it]
 30%|███       | 11418/37963 [25:49:14<57:21:08,  7.78s/it]
 30%|███       | 11419/37963 [25:49:22<57:30:54,  7.80s/it]
 30%|███       | 11420/37963 [25:49:30<57:04:05,  7.74s/it]
                                                           
{'loss': '0.1749', 'grad_norm': '3.104', 'learning_rate': '1.639e-05', 'epoch': '0.3008'}
+
 30%|███       | 11420/37963 [25:49:30<57:04:05,  7.74s/it]
 30%|███       | 11421/37963 [25:49:37<56:49:49,  7.71s/it]
 30%|███       | 11422/37963 [25:49:45<56:36:11,  7.68s/it]
 30%|███       | 11423/37963 [25:49:52<56:25:31,  7.65s/it]
 30%|███       | 11424/37963 [25:50:00<56:17:26,  7.64s/it]
 30%|███       | 11425/37963 [25:50:08<56:24:23,  7.65s/it]
 30%|███       | 11426/37963 [25:50:15<56:16:15,  7.63s/it]
 30%|███       | 11427/37963 [25:50:23<56:51:02,  7.71s/it]
 30%|███       | 11428/37963 [25:50:31<56:23:05,  7.65s/it]
 30%|███       | 11429/37963 [25:50:38<56:18:46,  7.64s/it]
 30%|███       | 11430/37963 [25:50:46<56:56:38,  7.73s/it]
                                                           
{'loss': '0.1727', 'grad_norm': '1.143', 'learning_rate': '1.639e-05', 'epoch': '0.3011'}
+
 30%|███       | 11430/37963 [25:50:46<56:56:38,  7.73s/it]
 30%|███       | 11431/37963 [25:50:54<56:59:54,  7.73s/it]
 30%|███       | 11432/37963 [25:51:02<56:57:52,  7.73s/it]
 30%|███       | 11433/37963 [25:51:12<62:21:37,  8.46s/it]
 30%|███       | 11434/37963 [25:51:22<66:35:32,  9.04s/it]
 30%|███       | 11435/37963 [25:51:30<63:57:44,  8.68s/it]
 30%|███       | 11436/37963 [25:51:38<62:02:16,  8.42s/it]
 30%|███       | 11437/37963 [25:51:46<60:54:35,  8.27s/it]
 30%|███       | 11438/37963 [25:51:56<65:13:57,  8.85s/it]
 30%|███       | 11439/37963 [25:52:04<62:56:51,  8.54s/it]
 30%|███       | 11440/37963 [25:52:12<61:12:13,  8.31s/it]
                                                           
{'loss': '0.1779', 'grad_norm': '3.711', 'learning_rate': '1.638e-05', 'epoch': '0.3013'}
+
 30%|███       | 11440/37963 [25:52:12<61:12:13,  8.31s/it]
 30%|███       | 11441/37963 [25:52:19<59:59:05,  8.14s/it]
 30%|███       | 11442/37963 [25:52:27<58:47:52,  7.98s/it]
 30%|███       | 11443/37963 [25:52:37<63:55:55,  8.68s/it]
 30%|███       | 11444/37963 [25:52:45<61:40:20,  8.37s/it]
 30%|███       | 11445/37963 [25:52:53<59:58:02,  8.14s/it]
 30%|███       | 11446/37963 [25:53:00<58:54:27,  8.00s/it]
 30%|███       | 11447/37963 [25:53:11<64:16:45,  8.73s/it]
 30%|███       | 11448/37963 [25:53:18<62:21:19,  8.47s/it]
 30%|███       | 11449/37963 [25:53:26<60:55:34,  8.27s/it]
 30%|███       | 11450/37963 [25:53:37<65:46:15,  8.93s/it]
                                                           
{'loss': '0.1655', 'grad_norm': '2.266', 'learning_rate': '1.637e-05', 'epoch': '0.3016'}
+
 30%|███       | 11450/37963 [25:53:37<65:46:15,  8.93s/it]
 30%|███       | 11451/37963 [25:53:45<63:17:28,  8.59s/it]
 30%|███       | 11452/37963 [25:53:55<66:57:27,  9.09s/it]
 30%|███       | 11453/37963 [25:54:05<68:58:36,  9.37s/it]
 30%|███       | 11454/37963 [25:54:12<65:11:50,  8.85s/it]
 30%|███       | 11455/37963 [25:54:20<62:41:54,  8.51s/it]
 30%|███       | 11456/37963 [25:54:28<60:49:43,  8.26s/it]
 30%|███       | 11457/37963 [25:54:35<59:02:09,  8.02s/it]
 30%|███       | 11458/37963 [25:54:43<58:42:12,  7.97s/it]
 30%|███       | 11459/37963 [25:54:51<58:01:18,  7.88s/it]
 30%|███       | 11460/37963 [25:54:59<57:42:29,  7.84s/it]
                                                           
{'loss': '0.1733', 'grad_norm': '1.275', 'learning_rate': '1.637e-05', 'epoch': '0.3019'}
+
 30%|███       | 11460/37963 [25:54:59<57:42:29,  7.84s/it]
 30%|███       | 11461/37963 [25:55:06<57:29:02,  7.81s/it]
 30%|███       | 11462/37963 [25:55:14<56:56:49,  7.74s/it]
 30%|███       | 11463/37963 [25:55:21<56:04:34,  7.62s/it]
 30%|███       | 11464/37963 [25:55:29<56:13:49,  7.64s/it]
 30%|███       | 11465/37963 [25:55:37<56:35:48,  7.69s/it]
 30%|███       | 11466/37963 [25:55:44<56:22:38,  7.66s/it]
 30%|███       | 11467/37963 [25:55:52<56:46:21,  7.71s/it]
 30%|███       | 11468/37963 [25:56:00<56:07:20,  7.63s/it]
 30%|███       | 11469/37963 [25:56:07<56:15:03,  7.64s/it]
 30%|███       | 11470/37963 [25:56:15<56:26:10,  7.67s/it]
                                                           
{'loss': '0.1966', 'grad_norm': '3.214', 'learning_rate': '1.636e-05', 'epoch': '0.3021'}
+
 30%|███       | 11470/37963 [25:56:15<56:26:10,  7.67s/it]
 30%|███       | 11471/37963 [25:56:23<56:14:47,  7.64s/it]
 30%|███       | 11472/37963 [25:56:30<56:16:22,  7.65s/it]
 30%|███       | 11473/37963 [25:56:38<56:18:15,  7.65s/it]
 30%|███       | 11474/37963 [25:56:45<56:10:07,  7.63s/it]
 30%|███       | 11475/37963 [25:56:53<56:12:14,  7.64s/it]
 30%|███       | 11476/37963 [25:57:01<56:46:19,  7.72s/it]
 30%|███       | 11477/37963 [25:57:11<62:12:28,  8.46s/it]
 30%|███       | 11478/37963 [25:57:19<60:11:54,  8.18s/it]
 30%|███       | 11479/37963 [25:57:26<58:59:18,  8.02s/it]
 30%|███       | 11480/37963 [25:57:34<57:32:24,  7.82s/it]
                                                           
{'loss': '0.1514', 'grad_norm': '5.25', 'learning_rate': '1.635e-05', 'epoch': '0.3024'}
+
 30%|███       | 11480/37963 [25:57:34<57:32:24,  7.82s/it]
 30%|███       | 11481/37963 [25:57:44<62:45:59,  8.53s/it]
 30%|███       | 11482/37963 [25:57:52<60:44:08,  8.26s/it]
 30%|███       | 11483/37963 [25:57:59<58:29:54,  7.95s/it]
 30%|███       | 11484/37963 [25:58:07<58:31:23,  7.96s/it]
 30%|███       | 11485/37963 [25:58:15<58:09:41,  7.91s/it]
 30%|███       | 11486/37963 [25:58:25<63:46:47,  8.67s/it]
 30%|███       | 11487/37963 [25:58:33<61:26:27,  8.35s/it]
 30%|███       | 11488/37963 [25:58:40<59:45:04,  8.12s/it]
 30%|███       | 11489/37963 [25:58:48<58:31:32,  7.96s/it]
 30%|███       | 11490/37963 [25:58:55<57:39:54,  7.84s/it]
                                                           
{'loss': '0.1733', 'grad_norm': '4.226', 'learning_rate': '1.635e-05', 'epoch': '0.3027'}
+
 30%|███       | 11490/37963 [25:58:55<57:39:54,  7.84s/it]
 30%|███       | 11491/37963 [25:59:05<62:36:21,  8.51s/it]
 30%|███       | 11492/37963 [25:59:13<61:07:24,  8.31s/it]
 30%|███       | 11493/37963 [25:59:24<65:59:41,  8.98s/it]
 30%|███       | 11494/37963 [25:59:31<62:55:54,  8.56s/it]
 30%|███       | 11495/37963 [25:59:41<65:49:46,  8.95s/it]
 30%|███       | 11496/37963 [25:59:52<68:41:57,  9.34s/it]
 30%|███       | 11497/37963 [25:59:59<64:58:01,  8.84s/it]
 30%|███       | 11498/37963 [26:00:07<62:23:50,  8.49s/it]
 30%|███       | 11499/37963 [26:00:15<60:35:02,  8.24s/it]
 30%|███       | 11500/37963 [26:00:22<59:06:53,  8.04s/it]
                                                           
{'loss': '0.1727', 'grad_norm': '2.613', 'learning_rate': '1.634e-05', 'epoch': '0.3029'}
+
 30%|███       | 11500/37963 [26:00:22<59:06:53,  8.04s/it]
 30%|███       | 11501/37963 [26:00:32<64:07:35,  8.72s/it]
 30%|███       | 11502/37963 [26:00:40<62:06:11,  8.45s/it]
 30%|███       | 11503/37963 [26:00:48<60:18:20,  8.20s/it]
 30%|███       | 11504/37963 [26:00:55<58:39:12,  7.98s/it]
 30%|███       | 11505/37963 [26:01:03<58:43:46,  7.99s/it]
 30%|███       | 11506/37963 [26:01:11<58:25:00,  7.95s/it]
 30%|███       | 11507/37963 [26:01:19<58:18:35,  7.93s/it]
 30%|███       | 11508/37963 [26:01:26<57:02:05,  7.76s/it]
 30%|███       | 11509/37963 [26:01:34<56:48:13,  7.73s/it]
 30%|███       | 11510/37963 [26:01:42<57:10:49,  7.78s/it]
                                                           
{'loss': '0.1853', 'grad_norm': '2.344', 'learning_rate': '1.634e-05', 'epoch': '0.3032'}
+
 30%|███       | 11510/37963 [26:01:42<57:10:49,  7.78s/it]
 30%|███       | 11511/37963 [26:01:49<55:57:16,  7.62s/it]
 30%|███       | 11512/37963 [26:01:57<56:10:56,  7.65s/it]
 30%|███       | 11513/37963 [26:02:05<56:27:50,  7.69s/it]
 30%|███       | 11514/37963 [26:02:13<56:41:31,  7.72s/it]
 30%|███       | 11515/37963 [26:02:20<56:40:23,  7.71s/it]
 30%|███       | 11516/37963 [26:02:28<56:53:10,  7.74s/it]
 30%|███       | 11517/37963 [26:02:36<56:25:27,  7.68s/it]
 30%|███       | 11518/37963 [26:02:43<56:20:25,  7.67s/it]
 30%|███       | 11519/37963 [26:02:51<56:00:51,  7.63s/it]
 30%|███       | 11520/37963 [26:02:58<55:36:33,  7.57s/it]
                                                           
{'loss': '0.1707', 'grad_norm': '4.956', 'learning_rate': '1.633e-05', 'epoch': '0.3035'}
+
 30%|███       | 11520/37963 [26:02:58<55:36:33,  7.57s/it]
 30%|███       | 11521/37963 [26:03:06<55:53:07,  7.61s/it]
 30%|███       | 11522/37963 [26:03:14<55:59:35,  7.62s/it]
 30%|███       | 11523/37963 [26:03:21<55:46:24,  7.59s/it]
 30%|███       | 11524/37963 [26:03:29<56:03:58,  7.63s/it]
 30%|███       | 11525/37963 [26:03:39<61:43:31,  8.40s/it]
 30%|███       | 11526/37963 [26:03:47<60:25:09,  8.23s/it]
 30%|███       | 11527/37963 [26:03:55<59:34:14,  8.11s/it]
 30%|███       | 11528/37963 [26:04:02<58:28:21,  7.96s/it]
 30%|███       | 11529/37963 [26:04:10<57:42:07,  7.86s/it]
 30%|███       | 11530/37963 [26:04:20<62:54:06,  8.57s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '1.741', 'learning_rate': '1.632e-05', 'epoch': '0.3037'}
+
 30%|███       | 11530/37963 [26:04:20<62:54:06,  8.57s/it]
 30%|███       | 11531/37963 [26:04:31<67:09:42,  9.15s/it]
 30%|███       | 11532/37963 [26:04:39<64:33:28,  8.79s/it]
 30%|███       | 11533/37963 [26:04:46<62:32:34,  8.52s/it]
 30%|███       | 11534/37963 [26:04:54<60:33:33,  8.25s/it]
 30%|███       | 11535/37963 [26:05:04<64:24:10,  8.77s/it]
 30%|███       | 11536/37963 [26:05:11<61:16:15,  8.35s/it]
 30%|███       | 11537/37963 [26:05:22<65:59:22,  8.99s/it]
 30%|███       | 11538/37963 [26:05:30<63:00:39,  8.58s/it]
 30%|███       | 11539/37963 [26:05:37<61:33:28,  8.39s/it]
 30%|███       | 11540/37963 [26:05:48<65:34:40,  8.93s/it]
                                                           
{'loss': '0.1692', 'grad_norm': '2.965', 'learning_rate': '1.632e-05', 'epoch': '0.304'}
+
 30%|███       | 11540/37963 [26:05:48<65:34:40,  8.93s/it]
 30%|███       | 11541/37963 [26:05:55<62:01:44,  8.45s/it]
 30%|███       | 11542/37963 [26:06:03<60:25:37,  8.23s/it]
 30%|███       | 11543/37963 [26:06:10<58:51:57,  8.02s/it]
 30%|███       | 11544/37963 [26:06:18<57:11:27,  7.79s/it]
 30%|███       | 11545/37963 [26:06:25<57:10:51,  7.79s/it]
 30%|███       | 11546/37963 [26:06:33<56:53:19,  7.75s/it]
 30%|███       | 11547/37963 [26:06:40<56:20:10,  7.68s/it]
 30%|███       | 11548/37963 [26:06:48<55:36:15,  7.58s/it]
 30%|███       | 11549/37963 [26:06:58<61:26:43,  8.37s/it]
 30%|███       | 11550/37963 [26:07:08<65:39:38,  8.95s/it]
                                                           
{'loss': '0.1736', 'grad_norm': '2.628', 'learning_rate': '1.631e-05', 'epoch': '0.3042'}
+
 30%|███       | 11550/37963 [26:07:08<65:39:38,  8.95s/it]
 30%|███       | 11551/37963 [26:07:16<63:10:33,  8.61s/it]
 30%|███       | 11552/37963 [26:07:24<61:03:37,  8.32s/it]
 30%|███       | 11553/37963 [26:07:32<59:58:02,  8.17s/it]
 30%|███       | 11554/37963 [26:07:39<58:46:38,  8.01s/it]
 30%|███       | 11555/37963 [26:07:47<58:21:19,  7.96s/it]
 30%|███       | 11556/37963 [26:07:55<57:27:17,  7.83s/it]
 30%|███       | 11557/37963 [26:08:02<57:16:35,  7.81s/it]
 30%|███       | 11558/37963 [26:08:10<57:03:07,  7.78s/it]
 30%|███       | 11559/37963 [26:08:18<56:45:02,  7.74s/it]
 30%|███       | 11560/37963 [26:08:26<56:52:11,  7.75s/it]
                                                           
{'loss': '0.1853', 'grad_norm': '1.284', 'learning_rate': '1.63e-05', 'epoch': '0.3045'}
+
 30%|███       | 11560/37963 [26:08:26<56:52:11,  7.75s/it]
 30%|███       | 11561/37963 [26:08:33<56:39:56,  7.73s/it]
 30%|███       | 11562/37963 [26:08:41<56:40:55,  7.73s/it]
 30%|███       | 11563/37963 [26:08:49<56:57:41,  7.77s/it]
 30%|███       | 11564/37963 [26:08:57<57:06:10,  7.79s/it]
 30%|███       | 11565/37963 [26:09:04<56:49:40,  7.75s/it]
 30%|███       | 11566/37963 [26:09:12<55:49:06,  7.61s/it]
 30%|███       | 11567/37963 [26:09:19<56:15:42,  7.67s/it]
 30%|███       | 11568/37963 [26:09:27<56:49:18,  7.75s/it]
 30%|███       | 11569/37963 [26:09:35<56:08:47,  7.66s/it]
 30%|███       | 11570/37963 [26:09:42<56:18:59,  7.68s/it]
                                                           
{'loss': '0.1791', 'grad_norm': '2.781', 'learning_rate': '1.63e-05', 'epoch': '0.3048'}
+
 30%|███       | 11570/37963 [26:09:42<56:18:59,  7.68s/it]
 30%|███       | 11571/37963 [26:09:50<55:55:17,  7.63s/it]
 30%|███       | 11572/37963 [26:09:58<56:14:37,  7.67s/it]
 30%|███       | 11573/37963 [26:10:08<61:35:54,  8.40s/it]
 30%|███       | 11574/37963 [26:10:16<60:25:33,  8.24s/it]
 30%|███       | 11575/37963 [26:10:23<59:11:17,  8.07s/it]
 30%|███       | 11576/37963 [26:10:31<58:37:13,  8.00s/it]
 30%|███       | 11577/37963 [26:10:39<57:18:30,  7.82s/it]
 30%|███       | 11578/37963 [26:10:46<56:55:38,  7.77s/it]
 31%|███       | 11579/37963 [26:10:54<57:09:45,  7.80s/it]
 31%|███       | 11580/37963 [26:11:04<62:22:04,  8.51s/it]
                                                           
{'loss': '0.1813', 'grad_norm': '1.67', 'learning_rate': '1.629e-05', 'epoch': '0.305'}
+
 31%|███       | 11580/37963 [26:11:04<62:22:04,  8.51s/it]
 31%|███       | 11581/37963 [26:11:12<60:29:44,  8.26s/it]
 31%|███       | 11582/37963 [26:11:20<59:06:59,  8.07s/it]
 31%|███       | 11583/37963 [26:11:27<58:09:01,  7.94s/it]
 31%|███       | 11584/37963 [26:11:38<63:42:22,  8.69s/it]
 31%|███       | 11585/37963 [26:11:48<67:15:39,  9.18s/it]
 31%|███       | 11586/37963 [26:11:56<63:50:08,  8.71s/it]
 31%|███       | 11587/37963 [26:12:03<61:04:10,  8.34s/it]
 31%|███       | 11588/37963 [26:12:13<65:29:39,  8.94s/it]
 31%|███       | 11589/37963 [26:12:23<67:46:01,  9.25s/it]
 31%|███       | 11590/37963 [26:12:31<63:54:12,  8.72s/it]
                                                           
{'loss': '0.1763', 'grad_norm': '2.528', 'learning_rate': '1.628e-05', 'epoch': '0.3053'}
+
 31%|███       | 11590/37963 [26:12:31<63:54:12,  8.72s/it]
 31%|███       | 11591/37963 [26:12:39<62:08:45,  8.48s/it]
 31%|███       | 11592/37963 [26:12:47<60:21:18,  8.24s/it]
 31%|███       | 11593/37963 [26:12:57<64:29:43,  8.80s/it]
 31%|███       | 11594/37963 [26:13:04<61:38:05,  8.41s/it]
 31%|███       | 11595/37963 [26:13:12<59:39:27,  8.14s/it]
 31%|███       | 11596/37963 [26:13:19<58:52:56,  8.04s/it]
 31%|███       | 11597/37963 [26:13:27<57:23:28,  7.84s/it]
 31%|███       | 11598/37963 [26:13:34<56:11:46,  7.67s/it]
 31%|███       | 11599/37963 [26:13:42<55:39:06,  7.60s/it]
 31%|███       | 11600/37963 [26:13:49<55:31:40,  7.58s/it]
                                                           
{'loss': '0.1741', 'grad_norm': '1.934', 'learning_rate': '1.628e-05', 'epoch': '0.3056'}
+
 31%|███       | 11600/37963 [26:13:49<55:31:40,  7.58s/it]
 31%|███       | 11601/37963 [26:13:57<55:40:03,  7.60s/it]
 31%|███       | 11602/37963 [26:14:04<55:39:54,  7.60s/it]
 31%|███       | 11603/37963 [26:14:12<55:41:43,  7.61s/it]
 31%|███       | 11604/37963 [26:14:22<61:00:28,  8.33s/it]
 31%|███       | 11605/37963 [26:14:30<59:42:48,  8.16s/it]
 31%|███       | 11606/37963 [26:14:38<59:07:14,  8.08s/it]
 31%|███       | 11607/37963 [26:14:45<58:12:38,  7.95s/it]
 31%|███       | 11608/37963 [26:14:53<57:04:31,  7.80s/it]
 31%|███       | 11609/37963 [26:15:00<56:41:53,  7.75s/it]
 31%|███       | 11610/37963 [26:15:08<56:48:26,  7.76s/it]
                                                           
{'loss': '0.1701', 'grad_norm': '2.078', 'learning_rate': '1.627e-05', 'epoch': '0.3058'}
+
 31%|███       | 11610/37963 [26:15:08<56:48:26,  7.76s/it]
 31%|███       | 11611/37963 [26:15:16<56:45:38,  7.75s/it]
 31%|███       | 11612/37963 [26:15:24<57:03:23,  7.79s/it]
 31%|███       | 11613/37963 [26:15:31<56:43:21,  7.75s/it]
 31%|███       | 11614/37963 [26:15:39<56:29:46,  7.72s/it]
 31%|███       | 11615/37963 [26:15:47<56:40:41,  7.74s/it]
 31%|███       | 11616/37963 [26:15:54<56:12:57,  7.68s/it]
 31%|███       | 11617/37963 [26:16:02<56:22:14,  7.70s/it]
 31%|███       | 11618/37963 [26:16:10<56:44:21,  7.75s/it]
 31%|███       | 11619/37963 [26:16:17<56:02:43,  7.66s/it]
 31%|███       | 11620/37963 [26:16:25<56:12:26,  7.68s/it]
                                                           
{'loss': '0.1948', 'grad_norm': '1.367', 'learning_rate': '1.626e-05', 'epoch': '0.3061'}
+
 31%|███       | 11620/37963 [26:16:25<56:12:26,  7.68s/it]
 31%|███       | 11621/37963 [26:16:35<61:49:41,  8.45s/it]
 31%|███       | 11622/37963 [26:16:43<59:59:31,  8.20s/it]
 31%|███       | 11623/37963 [26:16:51<59:07:03,  8.08s/it]
 31%|███       | 11624/37963 [26:17:01<64:25:19,  8.81s/it]
 31%|███       | 11625/37963 [26:17:09<61:18:47,  8.38s/it]
 31%|███       | 11626/37963 [26:17:16<59:40:32,  8.16s/it]
 31%|███       | 11627/37963 [26:17:24<58:58:18,  8.06s/it]
 31%|███       | 11628/37963 [26:17:32<58:31:51,  8.00s/it]
 31%|███       | 11629/37963 [26:17:39<57:16:15,  7.83s/it]
 31%|███       | 11630/37963 [26:17:47<56:55:08,  7.78s/it]
                                                           
{'loss': '0.1864', 'grad_norm': '1.52', 'learning_rate': '1.626e-05', 'epoch': '0.3064'}
+
 31%|███       | 11630/37963 [26:17:47<56:55:08,  7.78s/it]
 31%|███       | 11631/37963 [26:17:55<56:39:25,  7.75s/it]
 31%|███       | 11632/37963 [26:18:02<56:12:28,  7.68s/it]
 31%|███       | 11633/37963 [26:18:10<56:04:20,  7.67s/it]
 31%|███       | 11634/37963 [26:18:21<62:19:13,  8.52s/it]
 31%|███       | 11635/37963 [26:18:28<60:47:07,  8.31s/it]
 31%|███       | 11636/37963 [26:18:36<59:45:43,  8.17s/it]
 31%|███       | 11637/37963 [26:18:46<63:37:57,  8.70s/it]
 31%|███       | 11638/37963 [26:18:59<72:47:37,  9.95s/it]
 31%|███       | 11639/37963 [26:19:07<68:26:13,  9.36s/it]
 31%|███       | 11640/37963 [26:19:14<64:12:28,  8.78s/it]
                                                           
{'loss': '0.1806', 'grad_norm': '2.733', 'learning_rate': '1.625e-05', 'epoch': '0.3066'}
+
 31%|███       | 11640/37963 [26:19:14<64:12:28,  8.78s/it]
 31%|███       | 11641/37963 [26:19:22<61:53:55,  8.47s/it]
 31%|███       | 11642/37963 [26:19:32<65:41:27,  8.98s/it]
 31%|███       | 11643/37963 [26:19:40<62:43:49,  8.58s/it]
 31%|███       | 11644/37963 [26:19:48<60:56:45,  8.34s/it]
 31%|███       | 11645/37963 [26:19:55<59:24:55,  8.13s/it]
 31%|███       | 11646/37963 [26:20:03<58:43:41,  8.03s/it]
 31%|███       | 11647/37963 [26:20:11<58:22:11,  7.98s/it]
 31%|███       | 11648/37963 [26:20:19<57:49:34,  7.91s/it]
 31%|███       | 11649/37963 [26:20:27<57:26:15,  7.86s/it]
 31%|███       | 11650/37963 [26:20:34<56:52:42,  7.78s/it]
                                                           
{'loss': '0.1592', 'grad_norm': '2.495', 'learning_rate': '1.624e-05', 'epoch': '0.3069'}
+
 31%|███       | 11650/37963 [26:20:34<56:52:42,  7.78s/it]
 31%|███       | 11651/37963 [26:20:42<56:38:44,  7.75s/it]
 31%|███       | 11652/37963 [26:20:50<56:54:34,  7.79s/it]
 31%|███       | 11653/37963 [26:20:57<56:30:41,  7.73s/it]
 31%|███       | 11654/37963 [26:21:05<56:26:46,  7.72s/it]
 31%|███       | 11655/37963 [26:21:13<56:14:51,  7.70s/it]
 31%|███       | 11656/37963 [26:21:20<56:12:17,  7.69s/it]
 31%|███       | 11657/37963 [26:21:28<56:11:12,  7.69s/it]
 31%|███       | 11658/37963 [26:21:38<61:44:52,  8.45s/it]
 31%|███       | 11659/37963 [26:21:46<60:03:47,  8.22s/it]
 31%|███       | 11660/37963 [26:21:54<58:45:26,  8.04s/it]
                                                           
{'loss': '0.1752', 'grad_norm': '1.433', 'learning_rate': '1.624e-05', 'epoch': '0.3071'}
+
 31%|███       | 11660/37963 [26:21:54<58:45:26,  8.04s/it]
 31%|███       | 11661/37963 [26:22:01<57:33:56,  7.88s/it]
 31%|███       | 11662/37963 [26:22:09<57:27:57,  7.87s/it]
 31%|███       | 11663/37963 [26:22:17<57:04:33,  7.81s/it]
 31%|███       | 11664/37963 [26:22:24<57:21:02,  7.85s/it]
 31%|███       | 11665/37963 [26:22:35<62:57:50,  8.62s/it]
 31%|███       | 11666/37963 [26:22:42<60:36:55,  8.30s/it]
 31%|███       | 11667/37963 [26:22:50<59:07:13,  8.09s/it]
 31%|███       | 11668/37963 [26:22:58<58:05:26,  7.95s/it]
 31%|███       | 11669/37963 [26:23:06<58:12:46,  7.97s/it]
 31%|███       | 11670/37963 [26:23:13<57:28:22,  7.87s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '2.055', 'learning_rate': '1.623e-05', 'epoch': '0.3074'}
+
 31%|███       | 11670/37963 [26:23:13<57:28:22,  7.87s/it]
 31%|███       | 11671/37963 [26:23:21<57:21:21,  7.85s/it]
 31%|███       | 11672/37963 [26:23:32<63:25:48,  8.69s/it]
 31%|███       | 11673/37963 [26:23:40<61:36:41,  8.44s/it]
 31%|███       | 11674/37963 [26:23:47<60:09:02,  8.24s/it]
 31%|███       | 11675/37963 [26:23:55<58:45:14,  8.05s/it]
 31%|███       | 11676/37963 [26:24:03<58:20:59,  7.99s/it]
 31%|███       | 11677/37963 [26:24:11<57:57:41,  7.94s/it]
 31%|███       | 11678/37963 [26:24:18<57:07:53,  7.82s/it]
 31%|███       | 11679/37963 [26:24:26<56:51:15,  7.79s/it]
 31%|███       | 11680/37963 [26:24:36<62:15:36,  8.53s/it]
                                                           
{'loss': '0.159', 'grad_norm': '3.798', 'learning_rate': '1.622e-05', 'epoch': '0.3077'}
+
 31%|███       | 11680/37963 [26:24:36<62:15:36,  8.53s/it]
 31%|███       | 11681/37963 [26:24:44<60:52:34,  8.34s/it]
 31%|███       | 11682/37963 [26:24:54<64:24:23,  8.82s/it]
 31%|███       | 11683/37963 [26:25:02<62:06:15,  8.51s/it]
 31%|███       | 11684/37963 [26:25:10<60:34:47,  8.30s/it]
 31%|███       | 11685/37963 [26:25:17<59:18:44,  8.13s/it]
 31%|███       | 11686/37963 [26:25:30<70:19:35,  9.63s/it]
 31%|███       | 11687/37963 [26:25:38<66:05:17,  9.05s/it]
 31%|███       | 11688/37963 [26:25:46<62:48:23,  8.61s/it]
 31%|███       | 11689/37963 [26:25:54<60:59:18,  8.36s/it]
 31%|███       | 11690/37963 [26:26:01<59:43:35,  8.18s/it]
                                                           
{'loss': '0.1813', 'grad_norm': '4.671', 'learning_rate': '1.622e-05', 'epoch': '0.3079'}
+
 31%|███       | 11690/37963 [26:26:01<59:43:35,  8.18s/it]
 31%|███       | 11691/37963 [26:26:09<58:31:26,  8.02s/it]
 31%|███       | 11692/37963 [26:26:17<58:18:06,  7.99s/it]
 31%|███       | 11693/37963 [26:26:25<57:32:40,  7.89s/it]
 31%|███       | 11694/37963 [26:26:32<56:58:51,  7.81s/it]
 31%|███       | 11695/37963 [26:26:40<56:49:30,  7.79s/it]
 31%|███       | 11696/37963 [26:26:50<62:45:38,  8.60s/it]
 31%|███       | 11697/37963 [26:26:58<60:53:46,  8.35s/it]
 31%|███       | 11698/37963 [26:27:06<59:45:04,  8.19s/it]
 31%|███       | 11699/37963 [26:27:13<58:13:41,  7.98s/it]
 31%|███       | 11700/37963 [26:27:21<57:56:15,  7.94s/it]
                                                           
{'loss': '0.1772', 'grad_norm': '2.533', 'learning_rate': '1.621e-05', 'epoch': '0.3082'}
+
 31%|███       | 11700/37963 [26:27:21<57:56:15,  7.94s/it]
 31%|███       | 11701/37963 [26:27:29<58:07:52,  7.97s/it]
 31%|███       | 11702/37963 [26:27:37<57:21:59,  7.86s/it]
 31%|███       | 11703/37963 [26:27:45<56:51:59,  7.80s/it]
 31%|███       | 11704/37963 [26:27:53<57:20:40,  7.86s/it]
 31%|███       | 11705/37963 [26:28:00<57:04:39,  7.83s/it]
 31%|███       | 11706/37963 [26:28:08<56:46:12,  7.78s/it]
 31%|███       | 11707/37963 [26:28:16<56:41:55,  7.77s/it]
 31%|███       | 11708/37963 [26:28:23<56:25:47,  7.74s/it]
 31%|███       | 11709/37963 [26:28:34<62:33:43,  8.58s/it]
 31%|███       | 11710/37963 [26:28:42<60:48:52,  8.34s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '1.82', 'learning_rate': '1.62e-05', 'epoch': '0.3085'}
+
 31%|███       | 11710/37963 [26:28:42<60:48:52,  8.34s/it]
 31%|███       | 11711/37963 [26:28:49<59:18:19,  8.13s/it]
 31%|███       | 11712/37963 [26:29:00<64:18:28,  8.82s/it]
 31%|███       | 11713/37963 [26:29:08<62:20:42,  8.55s/it]
 31%|███       | 11714/37963 [26:29:15<60:24:34,  8.29s/it]
 31%|███       | 11715/37963 [26:29:23<58:56:16,  8.08s/it]
 31%|███       | 11716/37963 [26:29:31<58:35:00,  8.04s/it]
 31%|███       | 11717/37963 [26:29:39<58:06:31,  7.97s/it]
 31%|███       | 11718/37963 [26:29:46<57:32:04,  7.89s/it]
 31%|███       | 11719/37963 [26:29:54<57:30:27,  7.89s/it]
 31%|███       | 11720/37963 [26:30:02<57:51:25,  7.94s/it]
                                                           
{'loss': '0.1742', 'grad_norm': '1.364', 'learning_rate': '1.62e-05', 'epoch': '0.3087'}
+
 31%|███       | 11720/37963 [26:30:02<57:51:25,  7.94s/it]
 31%|███       | 11721/37963 [26:30:10<57:27:33,  7.88s/it]
 31%|███       | 11722/37963 [26:30:18<57:26:04,  7.88s/it]
 31%|███       | 11723/37963 [26:30:26<57:09:19,  7.84s/it]
 31%|███       | 11724/37963 [26:30:33<56:14:04,  7.72s/it]
 31%|███       | 11725/37963 [26:30:41<56:25:36,  7.74s/it]
 31%|███       | 11726/37963 [26:30:52<63:16:13,  8.68s/it]
 31%|███       | 11727/37963 [26:31:00<61:10:09,  8.39s/it]
 31%|███       | 11728/37963 [26:31:07<59:31:49,  8.17s/it]
 31%|███       | 11729/37963 [26:31:20<68:50:07,  9.45s/it]
 31%|███       | 11730/37963 [26:31:27<64:57:22,  8.91s/it]
                                                           
{'loss': '0.1843', 'grad_norm': '2.288', 'learning_rate': '1.619e-05', 'epoch': '0.309'}
+
 31%|███       | 11730/37963 [26:31:27<64:57:22,  8.91s/it]
 31%|███       | 11731/37963 [26:31:35<62:04:20,  8.52s/it]
 31%|███       | 11732/37963 [26:31:43<60:39:40,  8.33s/it]
 31%|███       | 11733/37963 [26:31:50<59:12:18,  8.13s/it]
 31%|███       | 11734/37963 [26:32:01<64:08:33,  8.80s/it]
 31%|███       | 11735/37963 [26:32:08<61:28:12,  8.44s/it]
 31%|███       | 11736/37963 [26:32:19<65:26:20,  8.98s/it]
 31%|███       | 11737/37963 [26:32:26<62:26:03,  8.57s/it]
 31%|███       | 11738/37963 [26:32:34<59:51:39,  8.22s/it]
 31%|███       | 11739/37963 [26:32:42<58:58:36,  8.10s/it]
 31%|███       | 11740/37963 [26:32:52<63:49:32,  8.76s/it]
                                                           
{'loss': '0.1604', 'grad_norm': '3.671', 'learning_rate': '1.618e-05', 'epoch': '0.3092'}
+
 31%|███       | 11740/37963 [26:32:52<63:49:32,  8.76s/it]
 31%|███       | 11741/37963 [26:33:00<61:48:04,  8.48s/it]
 31%|███       | 11742/37963 [26:33:07<59:21:29,  8.15s/it]
 31%|███       | 11743/37963 [26:33:15<58:23:21,  8.02s/it]
 31%|███       | 11744/37963 [26:33:23<57:59:36,  7.96s/it]
 31%|███       | 11745/37963 [26:33:30<56:35:58,  7.77s/it]
 31%|███       | 11746/37963 [26:33:38<56:44:17,  7.79s/it]
 31%|███       | 11747/37963 [26:33:45<55:57:43,  7.68s/it]
 31%|███       | 11748/37963 [26:33:53<55:58:14,  7.69s/it]
 31%|███       | 11749/37963 [26:34:01<56:20:39,  7.74s/it]
 31%|███       | 11750/37963 [26:34:08<56:17:04,  7.73s/it]
                                                           
{'loss': '0.1741', 'grad_norm': '3.037', 'learning_rate': '1.618e-05', 'epoch': '0.3095'}
+
 31%|███       | 11750/37963 [26:34:08<56:17:04,  7.73s/it]
 31%|███       | 11751/37963 [26:34:16<56:06:26,  7.71s/it]
 31%|███       | 11752/37963 [26:34:26<61:09:34,  8.40s/it]
 31%|███       | 11753/37963 [26:34:34<60:04:21,  8.25s/it]
 31%|███       | 11754/37963 [26:34:41<58:13:03,  8.00s/it]
 31%|███       | 11755/37963 [26:34:49<57:35:53,  7.91s/it]
 31%|███       | 11756/37963 [26:34:57<56:50:20,  7.81s/it]
 31%|███       | 11757/37963 [26:35:04<56:29:43,  7.76s/it]
 31%|███       | 11758/37963 [26:35:12<56:17:23,  7.73s/it]
 31%|███       | 11759/37963 [26:35:20<56:01:45,  7.70s/it]
 31%|███       | 11760/37963 [26:35:27<55:59:44,  7.69s/it]
                                                           
{'loss': '0.1819', 'grad_norm': '1.953', 'learning_rate': '1.617e-05', 'epoch': '0.3098'}
+
 31%|███       | 11760/37963 [26:35:27<55:59:44,  7.69s/it]
 31%|███       | 11761/37963 [26:35:35<56:24:53,  7.75s/it]
 31%|███       | 11762/37963 [26:35:43<55:34:00,  7.63s/it]
 31%|███       | 11763/37963 [26:35:50<55:26:16,  7.62s/it]
 31%|███       | 11764/37963 [26:35:58<55:48:11,  7.67s/it]
 31%|███       | 11765/37963 [26:36:06<55:46:40,  7.66s/it]
 31%|███       | 11766/37963 [26:36:16<61:12:12,  8.41s/it]
 31%|███       | 11767/37963 [26:36:23<59:32:47,  8.18s/it]
 31%|███       | 11768/37963 [26:36:31<58:13:22,  8.00s/it]
 31%|███       | 11769/37963 [26:36:38<57:05:29,  7.85s/it]
 31%|███       | 11770/37963 [26:36:46<56:30:01,  7.77s/it]
                                                           
{'loss': '0.1758', 'grad_norm': '4.569', 'learning_rate': '1.616e-05', 'epoch': '0.31'}
+
 31%|███       | 11770/37963 [26:36:46<56:30:01,  7.77s/it]
 31%|███       | 11771/37963 [26:36:54<56:38:15,  7.78s/it]
 31%|███       | 11772/37963 [26:37:04<62:03:55,  8.53s/it]
 31%|███       | 11773/37963 [26:37:12<59:44:41,  8.21s/it]
 31%|███       | 11774/37963 [26:37:19<58:24:02,  8.03s/it]
 31%|███       | 11775/37963 [26:37:30<63:31:14,  8.73s/it]
 31%|███       | 11776/37963 [26:37:37<60:46:22,  8.35s/it]
 31%|███       | 11777/37963 [26:37:45<59:50:22,  8.23s/it]
 31%|███       | 11778/37963 [26:37:55<64:10:05,  8.82s/it]
 31%|███       | 11779/37963 [26:38:03<61:45:34,  8.49s/it]
 31%|███       | 11780/37963 [26:38:13<65:54:14,  9.06s/it]
                                                           
{'loss': '0.1656', 'grad_norm': '2.67', 'learning_rate': '1.616e-05', 'epoch': '0.3103'}
+
 31%|███       | 11780/37963 [26:38:13<65:54:14,  9.06s/it]
 31%|███       | 11781/37963 [26:38:21<63:17:54,  8.70s/it]
 31%|███       | 11782/37963 [26:38:29<60:50:43,  8.37s/it]
 31%|███       | 11783/37963 [26:38:39<64:57:53,  8.93s/it]
 31%|███       | 11784/37963 [26:38:49<67:48:42,  9.33s/it]
 31%|███       | 11785/37963 [26:38:57<64:15:30,  8.84s/it]
 31%|███       | 11786/37963 [26:39:04<60:34:06,  8.33s/it]
 31%|███       | 11787/37963 [26:39:12<59:47:06,  8.22s/it]
 31%|███       | 11788/37963 [26:39:20<58:27:42,  8.04s/it]
 31%|███       | 11789/37963 [26:39:27<57:29:08,  7.91s/it]
 31%|███       | 11790/37963 [26:39:35<57:18:20,  7.88s/it]
                                                           
{'loss': '0.1468', 'grad_norm': '1.405', 'learning_rate': '1.615e-05', 'epoch': '0.3106'}
+
 31%|███       | 11790/37963 [26:39:35<57:18:20,  7.88s/it]
 31%|███       | 11791/37963 [26:39:43<56:53:57,  7.83s/it]
 31%|███       | 11792/37963 [26:39:51<57:00:42,  7.84s/it]
 31%|███       | 11793/37963 [26:39:58<56:39:37,  7.79s/it]
 31%|███       | 11794/37963 [26:40:06<56:28:32,  7.77s/it]
 31%|███       | 11795/37963 [26:40:14<56:19:48,  7.75s/it]
 31%|███       | 11796/37963 [26:40:21<55:20:19,  7.61s/it]
 31%|███       | 11797/37963 [26:40:29<55:40:38,  7.66s/it]
 31%|███       | 11798/37963 [26:40:37<55:52:09,  7.69s/it]
 31%|███       | 11799/37963 [26:40:44<56:02:39,  7.71s/it]
 31%|███       | 11800/37963 [26:40:52<56:00:00,  7.71s/it]
                                                           
{'loss': '0.1654', 'grad_norm': '2.622', 'learning_rate': '1.614e-05', 'epoch': '0.3108'}
+
 31%|███       | 11800/37963 [26:40:52<56:00:00,  7.71s/it]
 31%|███       | 11801/37963 [26:41:00<56:07:01,  7.72s/it]
 31%|███       | 11802/37963 [26:41:08<56:12:43,  7.74s/it]
 31%|███       | 11803/37963 [26:41:15<56:24:27,  7.76s/it]
 31%|███       | 11804/37963 [26:41:23<57:06:03,  7.86s/it]
 31%|███       | 11805/37963 [26:41:31<56:56:47,  7.84s/it]
 31%|███       | 11806/37963 [26:41:41<61:54:53,  8.52s/it]
 31%|███       | 11807/37963 [26:41:49<59:19:13,  8.16s/it]
 31%|███       | 11808/37963 [26:41:56<57:50:49,  7.96s/it]
 31%|███       | 11809/37963 [26:42:04<57:15:19,  7.88s/it]
 31%|███       | 11810/37963 [26:42:12<57:01:35,  7.85s/it]
                                                           
{'loss': '0.1806', 'grad_norm': '2.834', 'learning_rate': '1.614e-05', 'epoch': '0.3111'}
+
 31%|███       | 11810/37963 [26:42:12<57:01:35,  7.85s/it]
 31%|███       | 11811/37963 [26:42:19<55:53:07,  7.69s/it]
 31%|███       | 11812/37963 [26:42:27<55:59:32,  7.71s/it]
 31%|███       | 11813/37963 [26:42:35<56:07:14,  7.73s/it]
 31%|███       | 11814/37963 [26:42:42<55:40:21,  7.66s/it]
 31%|███       | 11815/37963 [26:42:50<55:35:23,  7.65s/it]
 31%|███       | 11816/37963 [26:42:57<55:13:21,  7.60s/it]
 31%|███       | 11817/37963 [26:43:05<55:44:06,  7.67s/it]
 31%|███       | 11818/37963 [26:43:13<55:34:42,  7.65s/it]
 31%|███       | 11819/37963 [26:43:20<55:56:48,  7.70s/it]
 31%|███       | 11820/37963 [26:43:31<61:20:43,  8.45s/it]
                                                           
{'loss': '0.1546', 'grad_norm': '1.338', 'learning_rate': '1.613e-05', 'epoch': '0.3114'}
+
 31%|███       | 11820/37963 [26:43:31<61:20:43,  8.45s/it]
 31%|███       | 11821/37963 [26:43:41<65:07:58,  8.97s/it]
 31%|███       | 11822/37963 [26:43:48<61:58:30,  8.53s/it]
 31%|███       | 11823/37963 [26:43:59<65:40:29,  9.04s/it]
 31%|███       | 11824/37963 [26:44:06<63:09:19,  8.70s/it]
 31%|███       | 11825/37963 [26:44:14<61:05:07,  8.41s/it]
 31%|███       | 11826/37963 [26:44:24<64:35:57,  8.90s/it]
 31%|███       | 11827/37963 [26:44:35<67:47:32,  9.34s/it]
 31%|███       | 11828/37963 [26:44:45<70:42:39,  9.74s/it]
 31%|███       | 11829/37963 [26:44:53<66:25:04,  9.15s/it]
 31%|███       | 11830/37963 [26:45:01<63:36:39,  8.76s/it]
                                                           
{'loss': '0.1786', 'grad_norm': '2.82', 'learning_rate': '1.612e-05', 'epoch': '0.3116'}
+
 31%|███       | 11830/37963 [26:45:01<63:36:39,  8.76s/it]
 31%|███       | 11831/37963 [26:45:09<61:09:54,  8.43s/it]
 31%|███       | 11832/37963 [26:45:16<60:05:38,  8.28s/it]
 31%|███       | 11833/37963 [26:45:24<59:06:02,  8.14s/it]
 31%|███       | 11834/37963 [26:45:32<57:53:49,  7.98s/it]
 31%|███       | 11835/37963 [26:45:40<57:18:05,  7.90s/it]
 31%|███       | 11836/37963 [26:45:47<56:33:53,  7.79s/it]
 31%|███       | 11837/37963 [26:45:57<61:49:39,  8.52s/it]
 31%|███       | 11838/37963 [26:46:05<60:46:12,  8.37s/it]
 31%|███       | 11839/37963 [26:46:13<59:15:20,  8.17s/it]
 31%|███       | 11840/37963 [26:46:21<58:06:01,  8.01s/it]
                                                           
{'loss': '0.1729', 'grad_norm': '2.408', 'learning_rate': '1.611e-05', 'epoch': '0.3119'}
+
 31%|███       | 11840/37963 [26:46:21<58:06:01,  8.01s/it]
 31%|███       | 11841/37963 [26:46:28<56:34:37,  7.80s/it]
 31%|███       | 11842/37963 [26:46:36<56:10:47,  7.74s/it]
 31%|███       | 11843/37963 [26:46:43<56:07:55,  7.74s/it]
 31%|███       | 11844/37963 [26:46:51<56:19:49,  7.76s/it]
 31%|███       | 11845/37963 [26:46:59<56:09:30,  7.74s/it]
 31%|███       | 11846/37963 [26:47:07<56:25:22,  7.78s/it]
 31%|███       | 11847/37963 [26:47:14<55:38:13,  7.67s/it]
 31%|███       | 11848/37963 [26:47:22<55:42:39,  7.68s/it]
 31%|███       | 11849/37963 [26:47:29<55:39:03,  7.67s/it]
 31%|███       | 11850/37963 [26:47:37<55:39:15,  7.67s/it]
                                                           
{'loss': '0.1899', 'grad_norm': '1.754', 'learning_rate': '1.611e-05', 'epoch': '0.3121'}
+
 31%|███       | 11850/37963 [26:47:37<55:39:15,  7.67s/it]
 31%|███       | 11851/37963 [26:47:45<55:57:09,  7.71s/it]
 31%|███       | 11852/37963 [26:47:53<55:50:19,  7.70s/it]
 31%|███       | 11853/37963 [26:48:00<55:56:56,  7.71s/it]
 31%|███       | 11854/37963 [26:48:08<55:20:08,  7.63s/it]
 31%|███       | 11855/37963 [26:48:18<61:11:37,  8.44s/it]
 31%|███       | 11856/37963 [26:48:26<59:56:07,  8.26s/it]
 31%|███       | 11857/37963 [26:48:33<57:44:25,  7.96s/it]
 31%|███       | 11858/37963 [26:48:41<56:55:16,  7.85s/it]
 31%|███       | 11859/37963 [26:48:49<56:51:43,  7.84s/it]
 31%|███       | 11860/37963 [26:48:56<56:41:36,  7.82s/it]
                                                           
{'loss': '0.1706', 'grad_norm': '4.004', 'learning_rate': '1.61e-05', 'epoch': '0.3124'}
+
 31%|███       | 11860/37963 [26:48:56<56:41:36,  7.82s/it]
 31%|███       | 11861/37963 [26:49:04<56:32:43,  7.80s/it]
 31%|███       | 11862/37963 [26:49:12<55:57:48,  7.72s/it]
 31%|███       | 11863/37963 [26:49:19<55:52:35,  7.71s/it]
 31%|███▏      | 11864/37963 [26:49:30<61:26:05,  8.47s/it]
 31%|███▏      | 11865/37963 [26:49:37<59:34:18,  8.22s/it]
 31%|███▏      | 11866/37963 [26:49:45<58:36:38,  8.09s/it]
 31%|███▏      | 11867/37963 [26:49:53<57:13:30,  7.89s/it]
 31%|███▏      | 11868/37963 [26:50:00<57:00:31,  7.86s/it]
 31%|███▏      | 11869/37963 [26:50:11<62:57:34,  8.69s/it]
 31%|███▏      | 11870/37963 [26:50:19<60:47:09,  8.39s/it]
                                                           
{'loss': '0.1611', 'grad_norm': '2.672', 'learning_rate': '1.609e-05', 'epoch': '0.3127'}
+
 31%|███▏      | 11870/37963 [26:50:19<60:47:09,  8.39s/it]
 31%|███▏      | 11871/37963 [26:50:26<58:58:15,  8.14s/it]
 31%|███▏      | 11872/37963 [26:50:37<64:36:22,  8.91s/it]
 31%|███▏      | 11873/37963 [26:50:44<61:42:44,  8.52s/it]
 31%|███▏      | 11874/37963 [26:50:52<60:01:26,  8.28s/it]
 31%|███▏      | 11875/37963 [26:51:03<65:04:05,  8.98s/it]
 31%|███▏      | 11876/37963 [26:51:11<62:32:49,  8.63s/it]
 31%|███▏      | 11877/37963 [26:51:21<66:14:50,  9.14s/it]
 31%|███▏      | 11878/37963 [26:51:29<63:05:54,  8.71s/it]
 31%|███▏      | 11879/37963 [26:51:36<60:46:07,  8.39s/it]
 31%|███▏      | 11880/37963 [26:51:44<59:26:52,  8.21s/it]
                                                           
{'loss': '0.1729', 'grad_norm': '1.675', 'learning_rate': '1.609e-05', 'epoch': '0.3129'}
+
 31%|███▏      | 11880/37963 [26:51:44<59:26:52,  8.21s/it]
 31%|███▏      | 11881/37963 [26:51:54<64:13:49,  8.87s/it]
 31%|███▏      | 11882/37963 [26:52:02<61:38:46,  8.51s/it]
 31%|███▏      | 11883/37963 [26:52:10<59:40:33,  8.24s/it]
 31%|███▏      | 11884/37963 [26:52:17<58:31:26,  8.08s/it]
 31%|███▏      | 11885/37963 [26:52:26<58:30:03,  8.08s/it]
 31%|███▏      | 11886/37963 [26:52:33<57:59:47,  8.01s/it]
 31%|███▏      | 11887/37963 [26:52:41<57:14:34,  7.90s/it]
 31%|███▏      | 11888/37963 [26:52:49<56:43:34,  7.83s/it]
 31%|███▏      | 11889/37963 [26:52:56<56:19:35,  7.78s/it]
 31%|███▏      | 11890/37963 [26:53:04<56:04:45,  7.74s/it]
                                                           
{'loss': '0.1739', 'grad_norm': '4.819', 'learning_rate': '1.608e-05', 'epoch': '0.3132'}
+
 31%|███▏      | 11890/37963 [26:53:04<56:04:45,  7.74s/it]
 31%|███▏      | 11891/37963 [26:53:14<61:42:00,  8.52s/it]
 31%|███▏      | 11892/37963 [26:53:22<59:54:13,  8.27s/it]
 31%|███▏      | 11893/37963 [26:53:30<58:37:37,  8.10s/it]
 31%|███▏      | 11894/37963 [26:53:37<57:24:09,  7.93s/it]
 31%|███▏      | 11895/37963 [26:53:45<56:42:50,  7.83s/it]
 31%|███▏      | 11896/37963 [26:53:53<56:16:20,  7.77s/it]
 31%|███▏      | 11897/37963 [26:54:00<56:04:05,  7.74s/it]
 31%|███▏      | 11898/37963 [26:54:08<56:21:37,  7.78s/it]
 31%|███▏      | 11899/37963 [26:54:16<55:40:05,  7.69s/it]
 31%|███▏      | 11900/37963 [26:54:23<55:36:13,  7.68s/it]
                                                           
{'loss': '0.1584', 'grad_norm': '2.717', 'learning_rate': '1.607e-05', 'epoch': '0.3135'}
+
 31%|███▏      | 11900/37963 [26:54:23<55:36:13,  7.68s/it]
 31%|███▏      | 11901/37963 [26:54:31<55:23:18,  7.65s/it]
 31%|███▏      | 11902/37963 [26:54:39<55:39:57,  7.69s/it]
 31%|███▏      | 11903/37963 [26:54:49<60:35:00,  8.37s/it]
 31%|███▏      | 11904/37963 [26:54:56<58:30:15,  8.08s/it]
 31%|███▏      | 11905/37963 [26:55:04<57:34:06,  7.95s/it]
 31%|███▏      | 11906/37963 [26:55:11<57:25:21,  7.93s/it]
 31%|███▏      | 11907/37963 [26:55:19<57:09:39,  7.90s/it]
 31%|███▏      | 11908/37963 [26:55:30<62:37:07,  8.65s/it]
 31%|███▏      | 11909/37963 [26:55:37<60:41:05,  8.39s/it]
 31%|███▏      | 11910/37963 [26:55:45<58:43:19,  8.11s/it]
                                                           
{'loss': '0.1586', 'grad_norm': '0.9887', 'learning_rate': '1.607e-05', 'epoch': '0.3137'}
+
 31%|███▏      | 11910/37963 [26:55:45<58:43:19,  8.11s/it]
 31%|███▏      | 11911/37963 [26:55:53<57:55:17,  8.00s/it]
 31%|███▏      | 11912/37963 [26:56:01<57:35:12,  7.96s/it]
 31%|███▏      | 11913/37963 [26:56:11<62:56:53,  8.70s/it]
 31%|███▏      | 11914/37963 [26:56:19<61:05:18,  8.44s/it]
 31%|███▏      | 11915/37963 [26:56:26<58:24:34,  8.07s/it]
 31%|███▏      | 11916/37963 [26:56:36<63:16:45,  8.75s/it]
 31%|███▏      | 11917/37963 [26:56:44<61:35:23,  8.51s/it]
 31%|███▏      | 11918/37963 [26:56:52<59:45:59,  8.26s/it]
 31%|███▏      | 11919/37963 [26:57:00<58:18:16,  8.06s/it]
 31%|███▏      | 11920/37963 [26:57:07<57:15:54,  7.92s/it]
                                                           
{'loss': '0.1748', 'grad_norm': '1.088', 'learning_rate': '1.606e-05', 'epoch': '0.314'}
+
 31%|███▏      | 11920/37963 [26:57:07<57:15:54,  7.92s/it]
 31%|███▏      | 11921/37963 [26:57:15<56:39:39,  7.83s/it]
 31%|███▏      | 11922/37963 [26:57:22<55:59:27,  7.74s/it]
 31%|███▏      | 11923/37963 [26:57:32<61:13:21,  8.46s/it]
 31%|███▏      | 11924/37963 [26:57:40<59:30:03,  8.23s/it]
 31%|███▏      | 11925/37963 [26:57:50<63:36:54,  8.80s/it]
 31%|███▏      | 11926/37963 [26:57:58<61:23:48,  8.49s/it]
 31%|███▏      | 11927/37963 [26:58:06<59:29:42,  8.23s/it]
 31%|███▏      | 11928/37963 [26:58:13<58:01:11,  8.02s/it]
 31%|███▏      | 11929/37963 [26:58:21<57:06:01,  7.90s/it]
 31%|███▏      | 11930/37963 [26:58:32<63:17:07,  8.75s/it]
                                                           
{'loss': '0.1715', 'grad_norm': '2.674', 'learning_rate': '1.605e-05', 'epoch': '0.3143'}
+
 31%|███▏      | 11930/37963 [26:58:32<63:17:07,  8.75s/it]
 31%|███▏      | 11931/37963 [26:58:39<61:29:25,  8.50s/it]
 31%|███▏      | 11932/37963 [26:58:47<59:33:18,  8.24s/it]
 31%|███▏      | 11933/37963 [26:58:54<57:16:32,  7.92s/it]
 31%|███▏      | 11934/37963 [26:59:02<56:54:43,  7.87s/it]
 31%|███▏      | 11935/37963 [26:59:12<62:01:31,  8.58s/it]
 31%|███▏      | 11936/37963 [26:59:20<60:11:11,  8.32s/it]
 31%|███▏      | 11937/37963 [26:59:27<58:25:18,  8.08s/it]
 31%|███▏      | 11938/37963 [26:59:35<56:23:20,  7.80s/it]
 31%|███▏      | 11939/37963 [26:59:42<55:37:10,  7.69s/it]
 31%|███▏      | 11940/37963 [26:59:50<55:46:08,  7.72s/it]
                                                           
{'loss': '0.1655', 'grad_norm': '2.133', 'learning_rate': '1.605e-05', 'epoch': '0.3145'}
+
 31%|███▏      | 11940/37963 [26:59:50<55:46:08,  7.72s/it]
 31%|███▏      | 11941/37963 [26:59:58<55:50:04,  7.72s/it]
 31%|███▏      | 11942/37963 [27:00:05<55:43:17,  7.71s/it]
 31%|███▏      | 11943/37963 [27:00:13<55:24:55,  7.67s/it]
 31%|███▏      | 11944/37963 [27:00:20<55:20:37,  7.66s/it]
 31%|███▏      | 11945/37963 [27:00:28<55:25:13,  7.67s/it]
 31%|███▏      | 11946/37963 [27:00:36<54:44:46,  7.58s/it]
 31%|███▏      | 11947/37963 [27:00:43<55:31:39,  7.68s/it]
 31%|███▏      | 11948/37963 [27:00:51<55:39:46,  7.70s/it]
 31%|███▏      | 11949/37963 [27:00:59<55:49:44,  7.73s/it]
 31%|███▏      | 11950/37963 [27:01:07<55:32:51,  7.69s/it]
                                                           
{'loss': '0.1761', 'grad_norm': '1.372', 'learning_rate': '1.604e-05', 'epoch': '0.3148'}
+
 31%|███▏      | 11950/37963 [27:01:07<55:32:51,  7.69s/it]
 31%|███▏      | 11951/37963 [27:01:20<67:05:21,  9.28s/it]
 31%|███▏      | 11952/37963 [27:01:27<63:34:48,  8.80s/it]
 31%|███▏      | 11953/37963 [27:01:35<61:12:33,  8.47s/it]
 31%|███▏      | 11954/37963 [27:01:43<59:47:38,  8.28s/it]
 31%|███▏      | 11955/37963 [27:01:50<58:19:05,  8.07s/it]
 31%|███▏      | 11956/37963 [27:01:58<57:43:57,  7.99s/it]
 31%|███▏      | 11957/37963 [27:02:06<57:32:12,  7.96s/it]
 31%|███▏      | 11958/37963 [27:02:14<56:45:06,  7.86s/it]
 32%|███▏      | 11959/37963 [27:02:22<56:46:03,  7.86s/it]
 32%|███▏      | 11960/37963 [27:02:32<61:30:13,  8.51s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '1.547', 'learning_rate': '1.603e-05', 'epoch': '0.315'}
+
 32%|███▏      | 11960/37963 [27:02:32<61:30:13,  8.51s/it]
 32%|███▏      | 11961/37963 [27:02:39<60:03:30,  8.32s/it]
 32%|███▏      | 11962/37963 [27:02:47<58:47:44,  8.14s/it]
 32%|███▏      | 11963/37963 [27:02:55<57:43:22,  7.99s/it]
 32%|███▏      | 11964/37963 [27:03:05<62:00:25,  8.59s/it]
 32%|███▏      | 11965/37963 [27:03:13<60:08:41,  8.33s/it]
 32%|███▏      | 11966/37963 [27:03:20<58:43:40,  8.13s/it]
 32%|███▏      | 11967/37963 [27:03:28<57:29:10,  7.96s/it]
 32%|███▏      | 11968/37963 [27:03:35<56:58:04,  7.89s/it]
 32%|███▏      | 11969/37963 [27:03:43<56:11:01,  7.78s/it]
 32%|███▏      | 11970/37963 [27:03:51<55:53:51,  7.74s/it]
                                                           
{'loss': '0.1777', 'grad_norm': '1.872', 'learning_rate': '1.603e-05', 'epoch': '0.3153'}
+
 32%|███▏      | 11970/37963 [27:03:51<55:53:51,  7.74s/it]
 32%|███▏      | 11971/37963 [27:03:58<55:33:12,  7.69s/it]
 32%|███▏      | 11972/37963 [27:04:06<55:07:21,  7.64s/it]
 32%|███▏      | 11973/37963 [27:04:13<55:07:32,  7.64s/it]
 32%|███▏      | 11974/37963 [27:04:24<60:46:41,  8.42s/it]
 32%|███▏      | 11975/37963 [27:04:34<64:50:09,  8.98s/it]
 32%|███▏      | 11976/37963 [27:04:41<61:15:37,  8.49s/it]
 32%|███▏      | 11977/37963 [27:04:49<60:00:33,  8.31s/it]
 32%|███▏      | 11978/37963 [27:05:00<64:34:22,  8.95s/it]
 32%|███▏      | 11979/37963 [27:05:07<61:57:38,  8.58s/it]
 32%|███▏      | 11980/37963 [27:05:15<59:45:05,  8.28s/it]
                                                           
{'loss': '0.1795', 'grad_norm': '2.77', 'learning_rate': '1.602e-05', 'epoch': '0.3156'}
+
 32%|███▏      | 11980/37963 [27:05:15<59:45:05,  8.28s/it]
 32%|███▏      | 11981/37963 [27:05:23<58:17:41,  8.08s/it]
 32%|███▏      | 11982/37963 [27:05:30<57:37:20,  7.98s/it]
 32%|███▏      | 11983/37963 [27:05:38<57:06:56,  7.91s/it]
 32%|███▏      | 11984/37963 [27:05:46<56:38:24,  7.85s/it]
 32%|███▏      | 11985/37963 [27:05:53<56:20:02,  7.81s/it]
 32%|███▏      | 11986/37963 [27:06:01<56:00:18,  7.76s/it]
 32%|███▏      | 11987/37963 [27:06:08<55:14:30,  7.66s/it]
 32%|███▏      | 11988/37963 [27:06:16<55:42:58,  7.72s/it]
 32%|███▏      | 11989/37963 [27:06:27<62:06:12,  8.61s/it]
 32%|███▏      | 11990/37963 [27:06:35<60:50:21,  8.43s/it]
                                                           
{'loss': '0.1662', 'grad_norm': '1.653', 'learning_rate': '1.601e-05', 'epoch': '0.3158'}
+
 32%|███▏      | 11990/37963 [27:06:35<60:50:21,  8.43s/it]
 32%|███▏      | 11991/37963 [27:06:43<58:59:59,  8.18s/it]
 32%|███▏      | 11992/37963 [27:06:51<58:18:40,  8.08s/it]
 32%|███▏      | 11993/37963 [27:06:58<57:22:31,  7.95s/it]
 32%|███▏      | 11994/37963 [27:07:08<62:28:36,  8.66s/it]
 32%|███▏      | 11995/37963 [27:07:16<60:01:20,  8.32s/it]
 32%|███▏      | 11996/37963 [27:07:24<58:20:11,  8.09s/it]
 32%|███▏      | 11997/37963 [27:07:31<56:56:39,  7.89s/it]
 32%|███▏      | 11998/37963 [27:07:38<55:39:18,  7.72s/it]
 32%|███▏      | 11999/37963 [27:07:46<55:38:36,  7.72s/it]
 32%|███▏      | 12000/37963 [27:07:54<55:15:22,  7.66s/it]
                                                           
{'loss': '0.181', 'grad_norm': '2.113', 'learning_rate': '1.601e-05', 'epoch': '0.3161'}
+
 32%|███▏      | 12000/37963 [27:07:54<55:15:22,  7.66s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.61s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.62s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 32%|███▏      | 12001/37963 [27:08:56<173:00:33, 23.99s/it]
 32%|███▏      | 12002/37963 [27:09:03<138:00:34, 19.14s/it]
 32%|███▏      | 12003/37963 [27:09:11<112:46:38, 15.64s/it]
 32%|███▏      | 12004/37963 [27:09:21<100:41:43, 13.96s/it]
 32%|███▏      | 12005/37963 [27:09:31<92:26:10, 12.82s/it] 
 32%|███▏      | 12006/37963 [27:09:39<81:59:12, 11.37s/it]
 32%|███▏      | 12007/37963 [27:09:47<74:09:32, 10.29s/it]
 32%|███▏      | 12008/37963 [27:09:55<68:49:06,  9.55s/it]
 32%|███▏      | 12009/37963 [27:10:02<64:43:55,  8.98s/it]
 32%|███▏      | 12010/37963 [27:10:10<61:48:52,  8.57s/it]
                                                           
{'loss': '0.1771', 'grad_norm': '1.699', 'learning_rate': '1.6e-05', 'epoch': '0.3164'}
+
 32%|███▏      | 12010/37963 [27:10:10<61:48:52,  8.57s/it]
 32%|███▏      | 12011/37963 [27:10:21<66:16:06,  9.19s/it]
 32%|███▏      | 12012/37963 [27:10:28<63:16:16,  8.78s/it]
 32%|███▏      | 12013/37963 [27:10:36<61:04:15,  8.47s/it]
 32%|███▏      | 12014/37963 [27:10:44<59:19:46,  8.23s/it]
 32%|███▏      | 12015/37963 [27:10:52<58:13:46,  8.08s/it]
 32%|███▏      | 12016/37963 [27:11:00<58:09:48,  8.07s/it]
 32%|███▏      | 12017/37963 [27:11:07<57:32:21,  7.98s/it]
 32%|███▏      | 12018/37963 [27:11:18<62:08:50,  8.62s/it]
 32%|███▏      | 12019/37963 [27:11:25<59:57:13,  8.32s/it]
 32%|███▏      | 12020/37963 [27:11:33<58:34:27,  8.13s/it]
                                                           
{'loss': '0.1705', 'grad_norm': '2.432', 'learning_rate': '1.599e-05', 'epoch': '0.3166'}
+
 32%|███▏      | 12020/37963 [27:11:33<58:34:27,  8.13s/it]
 32%|███▏      | 12021/37963 [27:11:41<57:46:30,  8.02s/it]
 32%|███▏      | 12022/37963 [27:11:48<56:55:30,  7.90s/it]
 32%|███▏      | 12023/37963 [27:11:56<56:23:54,  7.83s/it]
 32%|███▏      | 12024/37963 [27:12:03<56:00:28,  7.77s/it]
 32%|███▏      | 12025/37963 [27:12:11<55:04:47,  7.64s/it]
 32%|███▏      | 12026/37963 [27:12:24<66:11:52,  9.19s/it]
 32%|███▏      | 12027/37963 [27:12:31<62:21:30,  8.66s/it]
 32%|███▏      | 12028/37963 [27:12:39<60:04:17,  8.34s/it]
 32%|███▏      | 12029/37963 [27:12:47<59:19:25,  8.23s/it]
 32%|███▏      | 12030/37963 [27:12:54<57:45:25,  8.02s/it]
                                                           
{'loss': '0.1542', 'grad_norm': '1.537', 'learning_rate': '1.599e-05', 'epoch': '0.3169'}
+
 32%|███▏      | 12030/37963 [27:12:54<57:45:25,  8.02s/it]
 32%|███▏      | 12031/37963 [27:13:02<57:09:59,  7.94s/it]
 32%|███▏      | 12032/37963 [27:13:10<56:48:16,  7.89s/it]
 32%|███▏      | 12033/37963 [27:13:17<56:17:33,  7.82s/it]
 32%|███▏      | 12034/37963 [27:13:28<61:33:34,  8.55s/it]
 32%|███▏      | 12035/37963 [27:13:35<59:33:54,  8.27s/it]
 32%|███▏      | 12036/37963 [27:13:43<58:31:11,  8.13s/it]
 32%|███▏      | 12037/37963 [27:13:51<57:14:06,  7.95s/it]
 32%|███▏      | 12038/37963 [27:13:58<56:55:41,  7.91s/it]
 32%|███▏      | 12039/37963 [27:14:06<55:55:59,  7.77s/it]
 32%|███▏      | 12040/37963 [27:14:14<56:12:09,  7.81s/it]
                                                           
{'loss': '0.1816', 'grad_norm': '3.024', 'learning_rate': '1.598e-05', 'epoch': '0.3172'}
+
 32%|███▏      | 12040/37963 [27:14:14<56:12:09,  7.81s/it]
 32%|███▏      | 12041/37963 [27:14:21<55:56:01,  7.77s/it]
 32%|███▏      | 12042/37963 [27:14:29<55:49:05,  7.75s/it]
 32%|███▏      | 12043/37963 [27:14:39<61:00:41,  8.47s/it]
 32%|███▏      | 12044/37963 [27:14:47<59:36:02,  8.28s/it]
 32%|███▏      | 12045/37963 [27:14:55<58:53:24,  8.18s/it]
 32%|███▏      | 12046/37963 [27:15:03<57:49:56,  8.03s/it]
 32%|███▏      | 12047/37963 [27:15:11<57:27:52,  7.98s/it]
 32%|███▏      | 12048/37963 [27:15:18<56:58:30,  7.91s/it]
 32%|███▏      | 12049/37963 [27:15:26<56:26:44,  7.84s/it]
 32%|███▏      | 12050/37963 [27:15:34<56:01:26,  7.78s/it]
                                                           
{'loss': '0.1769', 'grad_norm': '1.618', 'learning_rate': '1.597e-05', 'epoch': '0.3174'}
+
 32%|███▏      | 12050/37963 [27:15:34<56:01:26,  7.78s/it]
 32%|███▏      | 12051/37963 [27:15:41<55:30:58,  7.71s/it]
 32%|███▏      | 12052/37963 [27:15:49<55:24:27,  7.70s/it]
 32%|███▏      | 12053/37963 [27:15:59<61:10:14,  8.50s/it]
 32%|███▏      | 12054/37963 [27:16:07<59:42:16,  8.30s/it]
 32%|███▏      | 12055/37963 [27:16:18<64:52:42,  9.02s/it]
 32%|███▏      | 12056/37963 [27:16:25<61:52:58,  8.60s/it]
 32%|███▏      | 12057/37963 [27:16:33<59:07:15,  8.22s/it]
 32%|███▏      | 12058/37963 [27:16:43<63:27:51,  8.82s/it]
 32%|███▏      | 12059/37963 [27:16:51<60:52:28,  8.46s/it]
 32%|███▏      | 12060/37963 [27:16:58<59:41:19,  8.30s/it]
                                                           
{'loss': '0.1629', 'grad_norm': '1.88', 'learning_rate': '1.597e-05', 'epoch': '0.3177'}
+
 32%|███▏      | 12060/37963 [27:16:58<59:41:19,  8.30s/it]
 32%|███▏      | 12061/37963 [27:17:06<58:01:58,  8.07s/it]
 32%|███▏      | 12062/37963 [27:17:16<63:07:42,  8.77s/it]
 32%|███▏      | 12063/37963 [27:17:24<60:18:54,  8.38s/it]
 32%|███▏      | 12064/37963 [27:17:32<59:02:54,  8.21s/it]
 32%|███▏      | 12065/37963 [27:17:39<58:12:18,  8.09s/it]
 32%|███▏      | 12066/37963 [27:17:47<57:10:21,  7.95s/it]
 32%|███▏      | 12067/37963 [27:17:55<56:25:53,  7.84s/it]
 32%|███▏      | 12068/37963 [27:18:02<55:58:13,  7.78s/it]
 32%|███▏      | 12069/37963 [27:18:10<55:40:59,  7.74s/it]
 32%|███▏      | 12070/37963 [27:18:20<61:06:14,  8.50s/it]
                                                           
{'loss': '0.1754', 'grad_norm': '1.53', 'learning_rate': '1.596e-05', 'epoch': '0.3179'}
+
 32%|███▏      | 12070/37963 [27:18:20<61:06:14,  8.50s/it]
 32%|███▏      | 12071/37963 [27:18:28<59:40:58,  8.30s/it]
 32%|███▏      | 12072/37963 [27:18:36<58:09:46,  8.09s/it]
 32%|███▏      | 12073/37963 [27:18:43<56:40:54,  7.88s/it]
 32%|███▏      | 12074/37963 [27:18:51<56:36:46,  7.87s/it]
 32%|███▏      | 12075/37963 [27:18:59<56:28:40,  7.85s/it]
 32%|███▏      | 12076/37963 [27:19:06<55:05:53,  7.66s/it]
 32%|███▏      | 12077/37963 [27:19:14<55:26:12,  7.71s/it]
 32%|███▏      | 12078/37963 [27:19:21<55:10:39,  7.67s/it]
 32%|███▏      | 12079/37963 [27:19:29<55:28:55,  7.72s/it]
 32%|███▏      | 12080/37963 [27:19:39<60:40:19,  8.44s/it]
                                                           
{'loss': '0.1693', 'grad_norm': '1.401', 'learning_rate': '1.595e-05', 'epoch': '0.3182'}
+
 32%|███▏      | 12080/37963 [27:19:39<60:40:19,  8.44s/it]
 32%|███▏      | 12081/37963 [27:19:47<59:54:47,  8.33s/it]
 32%|███▏      | 12082/37963 [27:19:57<63:29:30,  8.83s/it]
 32%|███▏      | 12083/37963 [27:20:05<60:50:43,  8.46s/it]
 32%|███▏      | 12084/37963 [27:20:13<59:20:40,  8.26s/it]
 32%|███▏      | 12085/37963 [27:20:20<57:38:25,  8.02s/it]
 32%|███▏      | 12086/37963 [27:20:28<56:42:32,  7.89s/it]
 32%|███▏      | 12087/37963 [27:20:38<62:16:03,  8.66s/it]
 32%|███▏      | 12088/37963 [27:20:46<60:50:24,  8.46s/it]
 32%|███▏      | 12089/37963 [27:20:54<59:06:02,  8.22s/it]
 32%|███▏      | 12090/37963 [27:21:02<57:46:32,  8.04s/it]
                                                           
{'loss': '0.1758', 'grad_norm': '4.35', 'learning_rate': '1.594e-05', 'epoch': '0.3185'}
+
 32%|███▏      | 12090/37963 [27:21:02<57:46:32,  8.04s/it]
 32%|███▏      | 12091/37963 [27:21:09<56:22:47,  7.85s/it]
 32%|███▏      | 12092/37963 [27:21:17<56:33:01,  7.87s/it]
 32%|███▏      | 12093/37963 [27:21:25<56:14:18,  7.83s/it]
 32%|███▏      | 12094/37963 [27:21:32<55:32:58,  7.73s/it]
 32%|███▏      | 12095/37963 [27:21:40<55:53:36,  7.78s/it]
 32%|███▏      | 12096/37963 [27:21:48<55:59:24,  7.79s/it]
 32%|███▏      | 12097/37963 [27:21:55<55:34:42,  7.74s/it]
 32%|███▏      | 12098/37963 [27:22:06<61:48:00,  8.60s/it]
 32%|███▏      | 12099/37963 [27:22:14<60:08:04,  8.37s/it]
 32%|███▏      | 12100/37963 [27:22:22<58:37:45,  8.16s/it]
                                                           
{'loss': '0.1675', 'grad_norm': '0.6866', 'learning_rate': '1.594e-05', 'epoch': '0.3187'}
+
 32%|███▏      | 12100/37963 [27:22:22<58:37:45,  8.16s/it]
 32%|███▏      | 12101/37963 [27:22:32<63:44:32,  8.87s/it]
 32%|███▏      | 12102/37963 [27:22:42<66:37:16,  9.27s/it]
 32%|███▏      | 12103/37963 [27:22:50<63:11:14,  8.80s/it]
 32%|███▏      | 12104/37963 [27:22:58<60:37:13,  8.44s/it]
 32%|███▏      | 12105/37963 [27:23:06<59:59:59,  8.35s/it]
 32%|███▏      | 12106/37963 [27:23:14<58:57:43,  8.21s/it]
 32%|███▏      | 12107/37963 [27:23:21<57:35:25,  8.02s/it]
 32%|███▏      | 12108/37963 [27:23:29<56:41:46,  7.89s/it]
 32%|███▏      | 12109/37963 [27:23:36<56:12:19,  7.83s/it]
 32%|███▏      | 12110/37963 [27:23:44<55:46:37,  7.77s/it]
                                                           
{'loss': '0.1719', 'grad_norm': '1.754', 'learning_rate': '1.593e-05', 'epoch': '0.319'}
+
 32%|███▏      | 12110/37963 [27:23:44<55:46:37,  7.77s/it]
 32%|███▏      | 12111/37963 [27:23:52<55:24:59,  7.72s/it]
 32%|███▏      | 12112/37963 [27:23:59<54:31:55,  7.59s/it]
 32%|███▏      | 12113/37963 [27:24:09<60:41:46,  8.45s/it]
 32%|███▏      | 12114/37963 [27:24:17<58:39:44,  8.17s/it]
 32%|███▏      | 12115/37963 [27:24:25<57:52:04,  8.06s/it]
 32%|███▏      | 12116/37963 [27:24:35<62:35:10,  8.72s/it]
 32%|███▏      | 12117/37963 [27:24:43<60:40:34,  8.45s/it]
 32%|███▏      | 12118/37963 [27:24:50<59:00:51,  8.22s/it]
 32%|███▏      | 12119/37963 [27:24:58<58:24:29,  8.14s/it]
 32%|███▏      | 12120/37963 [27:25:06<57:49:32,  8.06s/it]
                                                           
{'loss': '0.164', 'grad_norm': '1.539', 'learning_rate': '1.592e-05', 'epoch': '0.3193'}
+
 32%|███▏      | 12120/37963 [27:25:06<57:49:32,  8.06s/it]
 32%|███▏      | 12121/37963 [27:25:14<57:30:37,  8.01s/it]
 32%|███▏      | 12122/37963 [27:25:22<56:55:08,  7.93s/it]
 32%|███▏      | 12123/37963 [27:25:30<56:16:38,  7.84s/it]
 32%|███▏      | 12124/37963 [27:25:37<56:07:56,  7.82s/it]
 32%|███▏      | 12125/37963 [27:25:45<55:40:31,  7.76s/it]
 32%|███▏      | 12126/37963 [27:25:53<55:38:42,  7.75s/it]
 32%|███▏      | 12127/37963 [27:26:01<55:45:11,  7.77s/it]
 32%|███▏      | 12128/37963 [27:26:11<60:59:20,  8.50s/it]
 32%|███▏      | 12129/37963 [27:26:18<59:15:29,  8.26s/it]
 32%|███▏      | 12130/37963 [27:26:26<57:46:25,  8.05s/it]
                                                           
{'loss': '0.1835', 'grad_norm': '2.271', 'learning_rate': '1.592e-05', 'epoch': '0.3195'}
+
 32%|███▏      | 12130/37963 [27:26:26<57:46:25,  8.05s/it]
 32%|███▏      | 12131/37963 [27:26:34<56:59:51,  7.94s/it]
 32%|███▏      | 12132/37963 [27:26:42<56:53:59,  7.93s/it]
 32%|███▏      | 12133/37963 [27:26:49<56:20:38,  7.85s/it]
 32%|███▏      | 12134/37963 [27:26:57<55:45:02,  7.77s/it]
 32%|███▏      | 12135/37963 [27:27:07<60:20:37,  8.41s/it]
 32%|███▏      | 12136/37963 [27:27:14<58:41:47,  8.18s/it]
 32%|███▏      | 12137/37963 [27:27:22<56:41:33,  7.90s/it]
 32%|███▏      | 12138/37963 [27:27:32<61:54:06,  8.63s/it]
 32%|███▏      | 12139/37963 [27:27:40<60:18:10,  8.41s/it]
 32%|███▏      | 12140/37963 [27:27:48<58:59:22,  8.22s/it]
                                                           
{'loss': '0.1697', 'grad_norm': '1.493', 'learning_rate': '1.591e-05', 'epoch': '0.3198'}
+
 32%|███▏      | 12140/37963 [27:27:48<58:59:22,  8.22s/it]
 32%|███▏      | 12141/37963 [27:27:55<58:06:33,  8.10s/it]
 32%|███▏      | 12142/37963 [27:28:03<57:01:24,  7.95s/it]
 32%|███▏      | 12143/37963 [27:28:11<56:30:12,  7.88s/it]
 32%|███▏      | 12144/37963 [27:28:19<56:29:45,  7.88s/it]
 32%|███▏      | 12145/37963 [27:28:29<60:58:04,  8.50s/it]
 32%|███▏      | 12146/37963 [27:28:36<59:40:11,  8.32s/it]
 32%|███▏      | 12147/37963 [27:28:44<58:31:55,  8.16s/it]
 32%|███▏      | 12148/37963 [27:28:52<57:05:31,  7.96s/it]
 32%|███▏      | 12149/37963 [27:29:00<56:43:15,  7.91s/it]
 32%|███▏      | 12150/37963 [27:29:10<62:06:55,  8.66s/it]
                                                           
{'loss': '0.1696', 'grad_norm': '3.273', 'learning_rate': '1.59e-05', 'epoch': '0.32'}
+
 32%|███▏      | 12150/37963 [27:29:10<62:06:55,  8.66s/it]
 32%|███▏      | 12151/37963 [27:29:17<59:28:10,  8.29s/it]
 32%|███▏      | 12152/37963 [27:29:28<64:18:45,  8.97s/it]
 32%|███▏      | 12153/37963 [27:29:36<61:44:47,  8.61s/it]
 32%|███▏      | 12154/37963 [27:29:43<59:34:31,  8.31s/it]
 32%|███▏      | 12155/37963 [27:29:51<58:08:10,  8.11s/it]
 32%|███▏      | 12156/37963 [27:29:58<56:37:53,  7.90s/it]
 32%|███▏      | 12157/37963 [27:30:06<56:27:53,  7.88s/it]
 32%|███▏      | 12158/37963 [27:30:14<56:17:51,  7.85s/it]
 32%|███▏      | 12159/37963 [27:30:22<56:06:21,  7.83s/it]
 32%|███▏      | 12160/37963 [27:30:32<61:09:38,  8.53s/it]
                                                           
{'loss': '0.168', 'grad_norm': '2.304', 'learning_rate': '1.59e-05', 'epoch': '0.3203'}
+
 32%|███▏      | 12160/37963 [27:30:32<61:09:38,  8.53s/it]
 32%|███▏      | 12161/37963 [27:30:39<58:39:06,  8.18s/it]
 32%|███▏      | 12162/37963 [27:30:47<57:58:25,  8.09s/it]
 32%|███▏      | 12163/37963 [27:30:55<57:33:03,  8.03s/it]
 32%|███▏      | 12164/37963 [27:31:03<56:43:43,  7.92s/it]
 32%|███▏      | 12165/37963 [27:31:10<56:13:06,  7.85s/it]
 32%|███▏      | 12166/37963 [27:31:18<56:23:33,  7.87s/it]
 32%|███▏      | 12167/37963 [27:31:28<61:16:18,  8.55s/it]
 32%|███▏      | 12168/37963 [27:31:36<59:36:08,  8.32s/it]
 32%|███▏      | 12169/37963 [27:31:44<57:56:50,  8.09s/it]
 32%|███▏      | 12170/37963 [27:31:51<56:59:23,  7.95s/it]
                                                           
{'loss': '0.1751', 'grad_norm': '2.221', 'learning_rate': '1.589e-05', 'epoch': '0.3206'}
+
 32%|███▏      | 12170/37963 [27:31:51<56:59:23,  7.95s/it]
 32%|███▏      | 12171/37963 [27:31:59<56:13:40,  7.85s/it]
 32%|███▏      | 12172/37963 [27:32:09<61:19:34,  8.56s/it]
 32%|███▏      | 12173/37963 [27:32:17<59:30:28,  8.31s/it]
 32%|███▏      | 12174/37963 [27:32:25<58:20:25,  8.14s/it]
 32%|███▏      | 12175/37963 [27:32:33<57:28:07,  8.02s/it]
 32%|███▏      | 12176/37963 [27:32:40<56:43:08,  7.92s/it]
 32%|███▏      | 12177/37963 [27:32:48<56:33:07,  7.90s/it]
 32%|███▏      | 12178/37963 [27:32:56<56:48:21,  7.93s/it]
 32%|███▏      | 12179/37963 [27:33:04<56:23:40,  7.87s/it]
 32%|███▏      | 12180/37963 [27:33:11<55:24:44,  7.74s/it]
                                                           
{'loss': '0.1736', 'grad_norm': '4.899', 'learning_rate': '1.588e-05', 'epoch': '0.3208'}
+
 32%|███▏      | 12180/37963 [27:33:11<55:24:44,  7.74s/it]
 32%|███▏      | 12181/37963 [27:33:19<54:49:45,  7.66s/it]
 32%|███▏      | 12182/37963 [27:33:29<60:34:06,  8.46s/it]
 32%|███▏      | 12183/37963 [27:33:36<58:04:42,  8.11s/it]
 32%|███▏      | 12184/37963 [27:33:46<62:33:22,  8.74s/it]
 32%|███▏      | 12185/37963 [27:33:55<61:15:18,  8.55s/it]
 32%|███▏      | 12186/37963 [27:34:02<59:18:41,  8.28s/it]
 32%|███▏      | 12187/37963 [27:34:10<57:55:05,  8.09s/it]
 32%|███▏      | 12188/37963 [27:34:20<62:24:25,  8.72s/it]
 32%|███▏      | 12189/37963 [27:34:28<59:52:08,  8.36s/it]
 32%|███▏      | 12190/37963 [27:34:35<58:20:59,  8.15s/it]
                                                           
{'loss': '0.1759', 'grad_norm': '1.236', 'learning_rate': '1.588e-05', 'epoch': '0.3211'}
+
 32%|███▏      | 12190/37963 [27:34:35<58:20:59,  8.15s/it]
 32%|███▏      | 12191/37963 [27:34:43<57:13:37,  7.99s/it]
 32%|███▏      | 12192/37963 [27:34:50<56:19:56,  7.87s/it]
 32%|███▏      | 12193/37963 [27:34:58<56:00:31,  7.82s/it]
 32%|███▏      | 12194/37963 [27:35:06<55:41:33,  7.78s/it]
 32%|███▏      | 12195/37963 [27:35:14<55:29:39,  7.75s/it]
 32%|███▏      | 12196/37963 [27:35:21<55:19:18,  7.73s/it]
 32%|███▏      | 12197/37963 [27:35:29<55:10:50,  7.71s/it]
 32%|███▏      | 12198/37963 [27:35:37<54:57:19,  7.68s/it]
 32%|███▏      | 12199/37963 [27:35:44<54:55:22,  7.67s/it]
 32%|███▏      | 12200/37963 [27:35:52<55:03:16,  7.69s/it]
                                                           
{'loss': '0.1789', 'grad_norm': '1.096', 'learning_rate': '1.587e-05', 'epoch': '0.3214'}
+
 32%|███▏      | 12200/37963 [27:35:52<55:03:16,  7.69s/it]
 32%|███▏      | 12201/37963 [27:36:00<55:07:56,  7.70s/it]
 32%|███▏      | 12202/37963 [27:36:07<54:44:56,  7.65s/it]
 32%|███▏      | 12203/37963 [27:36:15<54:35:19,  7.63s/it]
 32%|███▏      | 12204/37963 [27:36:25<61:00:05,  8.53s/it]
 32%|███▏      | 12205/37963 [27:36:36<65:25:41,  9.14s/it]
 32%|███▏      | 12206/37963 [27:36:44<62:05:08,  8.68s/it]
 32%|███▏      | 12207/37963 [27:36:51<59:55:17,  8.38s/it]
 32%|███▏      | 12208/37963 [27:36:59<58:27:25,  8.17s/it]
 32%|███▏      | 12209/37963 [27:37:07<57:14:17,  8.00s/it]
 32%|███▏      | 12210/37963 [27:37:14<56:23:41,  7.88s/it]
                                                           
{'loss': '0.1631', 'grad_norm': '3.036', 'learning_rate': '1.586e-05', 'epoch': '0.3216'}
+
 32%|███▏      | 12210/37963 [27:37:14<56:23:41,  7.88s/it]
 32%|███▏      | 12211/37963 [27:37:22<56:11:35,  7.86s/it]
 32%|███▏      | 12212/37963 [27:37:29<55:28:45,  7.76s/it]
 32%|███▏      | 12213/37963 [27:37:37<55:30:09,  7.76s/it]
 32%|███▏      | 12214/37963 [27:37:48<61:02:27,  8.53s/it]
 32%|███▏      | 12215/37963 [27:37:55<59:13:10,  8.28s/it]
 32%|███▏      | 12216/37963 [27:38:05<63:18:18,  8.85s/it]
 32%|███▏      | 12217/37963 [27:38:13<61:16:39,  8.57s/it]
 32%|███▏      | 12218/37963 [27:38:21<60:13:54,  8.42s/it]
 32%|███▏      | 12219/37963 [27:38:29<58:29:08,  8.18s/it]
 32%|███▏      | 12220/37963 [27:38:37<57:16:07,  8.01s/it]
                                                           
{'loss': '0.1943', 'grad_norm': '2.343', 'learning_rate': '1.586e-05', 'epoch': '0.3219'}
+
 32%|███▏      | 12220/37963 [27:38:37<57:16:07,  8.01s/it]
 32%|███▏      | 12221/37963 [27:38:47<62:29:41,  8.74s/it]
 32%|███▏      | 12222/37963 [27:38:55<60:25:10,  8.45s/it]
 32%|███▏      | 12223/37963 [27:39:03<58:45:09,  8.22s/it]
 32%|███▏      | 12224/37963 [27:39:10<57:50:30,  8.09s/it]
 32%|███▏      | 12225/37963 [27:39:18<56:47:27,  7.94s/it]
 32%|███▏      | 12226/37963 [27:39:26<56:34:05,  7.91s/it]
 32%|███▏      | 12227/37963 [27:39:33<55:48:00,  7.81s/it]
 32%|███▏      | 12228/37963 [27:39:41<55:58:16,  7.83s/it]
 32%|███▏      | 12229/37963 [27:39:49<55:29:02,  7.76s/it]
 32%|███▏      | 12230/37963 [27:39:59<60:47:27,  8.50s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '1.52', 'learning_rate': '1.585e-05', 'epoch': '0.3222'}
+
 32%|███▏      | 12230/37963 [27:39:59<60:47:27,  8.50s/it]
 32%|███▏      | 12231/37963 [27:40:07<58:55:01,  8.24s/it]
 32%|███▏      | 12232/37963 [27:40:17<63:16:58,  8.85s/it]
 32%|███▏      | 12233/37963 [27:40:25<60:52:14,  8.52s/it]
 32%|███▏      | 12234/37963 [27:40:33<59:23:12,  8.31s/it]
 32%|███▏      | 12235/37963 [27:40:40<58:11:12,  8.14s/it]
 32%|███▏      | 12236/37963 [27:40:51<62:53:57,  8.80s/it]
 32%|███▏      | 12237/37963 [27:40:58<60:35:07,  8.48s/it]
 32%|███▏      | 12238/37963 [27:41:06<59:51:17,  8.38s/it]
 32%|███▏      | 12239/37963 [27:41:14<58:16:12,  8.15s/it]
 32%|███▏      | 12240/37963 [27:41:22<57:02:00,  7.98s/it]
                                                           
{'loss': '0.1698', 'grad_norm': '4.899', 'learning_rate': '1.584e-05', 'epoch': '0.3224'}
+
 32%|███▏      | 12240/37963 [27:41:22<57:02:00,  7.98s/it]
 32%|███▏      | 12241/37963 [27:41:29<55:30:38,  7.77s/it]
 32%|███▏      | 12242/37963 [27:41:37<55:32:19,  7.77s/it]
 32%|███▏      | 12243/37963 [27:41:44<55:04:43,  7.71s/it]
 32%|███▏      | 12244/37963 [27:41:52<54:40:56,  7.65s/it]
 32%|███▏      | 12245/37963 [27:41:59<54:35:25,  7.64s/it]
 32%|███▏      | 12246/37963 [27:42:07<54:25:57,  7.62s/it]
 32%|███▏      | 12247/37963 [27:42:14<53:40:56,  7.52s/it]
 32%|███▏      | 12248/37963 [27:42:25<59:55:05,  8.39s/it]
 32%|███▏      | 12249/37963 [27:42:32<58:38:46,  8.21s/it]
 32%|███▏      | 12250/37963 [27:42:40<57:18:46,  8.02s/it]
                                                           
{'loss': '0.1772', 'grad_norm': '1.407', 'learning_rate': '1.583e-05', 'epoch': '0.3227'}
+
 32%|███▏      | 12250/37963 [27:42:40<57:18:46,  8.02s/it]
 32%|███▏      | 12251/37963 [27:42:48<56:23:51,  7.90s/it]
 32%|███▏      | 12252/37963 [27:42:55<55:46:59,  7.81s/it]
 32%|███▏      | 12253/37963 [27:43:03<55:38:33,  7.79s/it]
 32%|███▏      | 12254/37963 [27:43:11<55:13:22,  7.73s/it]
 32%|███▏      | 12255/37963 [27:43:18<54:56:02,  7.69s/it]
 32%|███▏      | 12256/37963 [27:43:26<55:09:38,  7.72s/it]
 32%|███▏      | 12257/37963 [27:43:34<54:46:46,  7.67s/it]
 32%|███▏      | 12258/37963 [27:43:41<54:38:45,  7.65s/it]
 32%|███▏      | 12259/37963 [27:43:52<60:47:23,  8.51s/it]
 32%|███▏      | 12260/37963 [27:43:59<58:59:42,  8.26s/it]
                                                           
{'loss': '0.1815', 'grad_norm': '2.415', 'learning_rate': '1.583e-05', 'epoch': '0.3229'}
+
 32%|███▏      | 12260/37963 [27:43:59<58:59:42,  8.26s/it]
 32%|███▏      | 12261/37963 [27:44:07<56:40:24,  7.94s/it]
 32%|███▏      | 12262/37963 [27:44:14<55:59:21,  7.84s/it]
 32%|███▏      | 12263/37963 [27:44:22<56:10:13,  7.87s/it]
 32%|███▏      | 12264/37963 [27:44:32<61:09:50,  8.57s/it]
 32%|███▏      | 12265/37963 [27:44:40<59:22:41,  8.32s/it]
 32%|███▏      | 12266/37963 [27:44:48<58:23:49,  8.18s/it]
 32%|███▏      | 12267/37963 [27:44:56<57:14:00,  8.02s/it]
 32%|███▏      | 12268/37963 [27:45:06<61:46:00,  8.65s/it]
 32%|███▏      | 12269/37963 [27:45:13<59:14:00,  8.30s/it]
 32%|███▏      | 12270/37963 [27:45:21<57:45:00,  8.09s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '2.23', 'learning_rate': '1.582e-05', 'epoch': '0.3232'}
+
 32%|███▏      | 12270/37963 [27:45:21<57:45:00,  8.09s/it]
 32%|███▏      | 12271/37963 [27:45:29<57:20:47,  8.04s/it]
 32%|███▏      | 12272/37963 [27:45:36<56:26:35,  7.91s/it]
 32%|███▏      | 12273/37963 [27:45:44<55:52:58,  7.83s/it]
 32%|███▏      | 12274/37963 [27:45:52<55:23:02,  7.76s/it]
 32%|███▏      | 12275/37963 [27:46:05<66:41:47,  9.35s/it]
 32%|███▏      | 12276/37963 [27:46:12<62:53:08,  8.81s/it]
 32%|███▏      | 12277/37963 [27:46:20<60:33:50,  8.49s/it]
 32%|███▏      | 12278/37963 [27:46:27<58:38:47,  8.22s/it]
 32%|███▏      | 12279/37963 [27:46:35<57:20:50,  8.04s/it]
 32%|███▏      | 12280/37963 [27:46:45<61:10:10,  8.57s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '1.194', 'learning_rate': '1.581e-05', 'epoch': '0.3235'}
+
 32%|███▏      | 12280/37963 [27:46:45<61:10:10,  8.57s/it]
 32%|███▏      | 12281/37963 [27:46:52<59:01:36,  8.27s/it]
 32%|███▏      | 12282/37963 [27:47:00<57:30:40,  8.06s/it]
 32%|███▏      | 12283/37963 [27:47:08<56:31:44,  7.92s/it]
 32%|███▏      | 12284/37963 [27:47:15<55:44:01,  7.81s/it]
 32%|███▏      | 12285/37963 [27:47:25<60:57:57,  8.55s/it]
 32%|███▏      | 12286/37963 [27:47:33<59:20:16,  8.32s/it]
 32%|███▏      | 12287/37963 [27:47:41<57:51:54,  8.11s/it]
 32%|███▏      | 12288/37963 [27:47:49<56:54:07,  7.98s/it]
 32%|███▏      | 12289/37963 [27:47:56<56:13:28,  7.88s/it]
 32%|███▏      | 12290/37963 [27:48:04<55:35:34,  7.80s/it]
                                                           
{'loss': '0.1821', 'grad_norm': '1.478', 'learning_rate': '1.581e-05', 'epoch': '0.3237'}
+
 32%|███▏      | 12290/37963 [27:48:04<55:35:34,  7.80s/it]
 32%|███▏      | 12291/37963 [27:48:14<60:48:12,  8.53s/it]
 32%|███▏      | 12292/37963 [27:48:22<59:09:39,  8.30s/it]
 32%|███▏      | 12293/37963 [27:48:29<57:37:27,  8.08s/it]
 32%|███▏      | 12294/37963 [27:48:37<56:47:33,  7.97s/it]
 32%|███▏      | 12295/37963 [27:48:45<56:03:44,  7.86s/it]
 32%|███▏      | 12296/37963 [27:48:52<55:26:06,  7.78s/it]
 32%|███▏      | 12297/37963 [27:49:00<55:31:33,  7.79s/it]
 32%|███▏      | 12298/37963 [27:49:08<55:44:03,  7.82s/it]
 32%|███▏      | 12299/37963 [27:49:16<55:46:13,  7.82s/it]
 32%|███▏      | 12300/37963 [27:49:24<55:54:37,  7.84s/it]
                                                           
{'loss': '0.1766', 'grad_norm': '1.28', 'learning_rate': '1.58e-05', 'epoch': '0.324'}
+
 32%|███▏      | 12300/37963 [27:49:24<55:54:37,  7.84s/it]
 32%|███▏      | 12301/37963 [27:49:31<55:26:51,  7.78s/it]
 32%|███▏      | 12302/37963 [27:49:39<54:51:24,  7.70s/it]
 32%|███▏      | 12303/37963 [27:49:46<54:46:30,  7.68s/it]
 32%|███▏      | 12304/37963 [27:49:54<54:51:28,  7.70s/it]
 32%|███▏      | 12305/37963 [27:50:02<54:42:15,  7.68s/it]
 32%|███▏      | 12306/37963 [27:50:09<54:33:24,  7.66s/it]
 32%|███▏      | 12307/37963 [27:50:20<59:56:45,  8.41s/it]
 32%|███▏      | 12308/37963 [27:50:27<58:10:09,  8.16s/it]
 32%|███▏      | 12309/37963 [27:50:35<57:30:48,  8.07s/it]
 32%|███▏      | 12310/37963 [27:50:43<56:22:10,  7.91s/it]
                                                           
{'loss': '0.1826', 'grad_norm': '1.676', 'learning_rate': '1.579e-05', 'epoch': '0.3243'}
+
 32%|███▏      | 12310/37963 [27:50:43<56:22:10,  7.91s/it]
 32%|███▏      | 12311/37963 [27:50:50<55:45:44,  7.83s/it]
 32%|███▏      | 12312/37963 [27:50:58<55:30:51,  7.79s/it]
 32%|███▏      | 12313/37963 [27:51:09<61:47:50,  8.67s/it]
 32%|███▏      | 12314/37963 [27:51:17<60:19:33,  8.47s/it]
 32%|███▏      | 12315/37963 [27:51:24<58:38:28,  8.23s/it]
 32%|███▏      | 12316/37963 [27:51:32<57:04:33,  8.01s/it]
 32%|███▏      | 12317/37963 [27:51:39<56:16:51,  7.90s/it]
 32%|███▏      | 12318/37963 [27:51:47<55:48:41,  7.83s/it]
 32%|███▏      | 12319/37963 [27:51:55<55:42:14,  7.82s/it]
 32%|███▏      | 12320/37963 [27:52:03<55:45:09,  7.83s/it]
                                                           
{'loss': '0.1706', 'grad_norm': '3.859', 'learning_rate': '1.579e-05', 'epoch': '0.3245'}
+
 32%|███▏      | 12320/37963 [27:52:03<55:45:09,  7.83s/it]
 32%|███▏      | 12321/37963 [27:52:11<55:33:37,  7.80s/it]
 32%|███▏      | 12322/37963 [27:52:21<60:59:18,  8.56s/it]
 32%|███▏      | 12323/37963 [27:52:34<70:07:46,  9.85s/it]
 32%|███▏      | 12324/37963 [27:52:41<65:37:17,  9.21s/it]
 32%|██��▏      | 12325/37963 [27:52:49<62:24:51,  8.76s/it]
 32%|███▏      | 12326/37963 [27:52:57<60:30:40,  8.50s/it]
 32%|███▏      | 12327/37963 [27:53:05<58:45:03,  8.25s/it]
 32%|███▏      | 12328/37963 [27:53:12<57:29:32,  8.07s/it]
 32%|███▏      | 12329/37963 [27:53:23<62:23:55,  8.76s/it]
 32%|███▏      | 12330/37963 [27:53:30<60:04:32,  8.44s/it]
                                                           
{'loss': '0.1748', 'grad_norm': '1.539', 'learning_rate': '1.578e-05', 'epoch': '0.3248'}
+
 32%|███▏      | 12330/37963 [27:53:30<60:04:32,  8.44s/it]
 32%|███▏      | 12331/37963 [27:53:38<57:34:24,  8.09s/it]
 32%|███▏      | 12332/37963 [27:53:46<57:06:52,  8.02s/it]
 32%|███▏      | 12333/37963 [27:53:56<62:00:28,  8.71s/it]
 32%|███▏      | 12334/37963 [27:54:04<60:09:49,  8.45s/it]
 32%|███▏      | 12335/37963 [27:54:14<64:03:26,  9.00s/it]
 32%|███▏      | 12336/37963 [27:54:22<60:55:31,  8.56s/it]
 32%|███▏      | 12337/37963 [27:54:29<59:06:47,  8.30s/it]
 33%|███▎      | 12338/37963 [27:54:37<57:45:52,  8.12s/it]
 33%|███▎      | 12339/37963 [27:54:45<56:39:28,  7.96s/it]
 33%|███▎      | 12340/37963 [27:54:52<56:09:42,  7.89s/it]
                                                           
{'loss': '0.161', 'grad_norm': '1.928', 'learning_rate': '1.577e-05', 'epoch': '0.3251'}
+
 33%|███▎      | 12340/37963 [27:54:52<56:09:42,  7.89s/it]
 33%|███▎      | 12341/37963 [27:55:00<56:18:05,  7.91s/it]
 33%|███▎      | 12342/37963 [27:55:08<55:53:09,  7.85s/it]
 33%|███▎      | 12343/37963 [27:55:16<55:23:35,  7.78s/it]
 33%|███▎      | 12344/37963 [27:55:23<55:35:46,  7.81s/it]
 33%|███▎      | 12345/37963 [27:55:31<54:47:07,  7.70s/it]
 33%|███▎      | 12346/37963 [27:55:39<55:23:28,  7.78s/it]
 33%|███▎      | 12347/37963 [27:55:47<55:17:07,  7.77s/it]
 33%|███▎      | 12348/37963 [27:55:54<54:37:54,  7.68s/it]
 33%|███▎      | 12349/37963 [27:56:02<54:19:31,  7.64s/it]
 33%|███▎      | 12350/37963 [27:56:09<54:05:52,  7.60s/it]
                                                           
{'loss': '0.1832', 'grad_norm': '1.696', 'learning_rate': '1.576e-05', 'epoch': '0.3253'}
+
 33%|███▎      | 12350/37963 [27:56:09<54:05:52,  7.60s/it]
 33%|███▎      | 12351/37963 [27:56:19<59:42:39,  8.39s/it]
 33%|███▎      | 12352/37963 [27:56:27<58:18:49,  8.20s/it]
 33%|███▎      | 12353/37963 [27:56:35<57:05:53,  8.03s/it]
 33%|███▎      | 12354/37963 [27:56:42<56:23:19,  7.93s/it]
 33%|███▎      | 12355/37963 [27:56:50<55:43:56,  7.83s/it]
 33%|███▎      | 12356/37963 [27:56:58<55:15:31,  7.77s/it]
 33%|███▎      | 12357/37963 [27:57:05<55:04:04,  7.74s/it]
 33%|███▎      | 12358/37963 [27:57:16<60:57:13,  8.57s/it]
 33%|███▎      | 12359/37963 [27:57:24<59:11:15,  8.32s/it]
 33%|███▎      | 12360/37963 [27:57:31<57:35:29,  8.10s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '1.284', 'learning_rate': '1.576e-05', 'epoch': '0.3256'}
+
 33%|███▎      | 12360/37963 [27:57:31<57:35:29,  8.10s/it]
 33%|███▎      | 12361/37963 [27:57:39<57:01:03,  8.02s/it]
 33%|███▎      | 12362/37963 [27:57:47<56:58:17,  8.01s/it]
 33%|███▎      | 12363/37963 [27:57:54<55:55:01,  7.86s/it]
 33%|███▎      | 12364/37963 [27:58:02<55:47:36,  7.85s/it]
 33%|███▎      | 12365/37963 [27:58:10<55:43:02,  7.84s/it]
 33%|███▎      | 12366/37963 [27:58:18<55:13:14,  7.77s/it]
 33%|███▎      | 12367/37963 [27:58:28<60:04:04,  8.45s/it]
 33%|███▎      | 12368/37963 [27:58:36<58:40:20,  8.25s/it]
 33%|███▎      | 12369/37963 [27:58:43<57:16:29,  8.06s/it]
 33%|███▎      | 12370/37963 [27:58:51<56:21:44,  7.93s/it]
                                                           
{'loss': '0.1647', 'grad_norm': '1.154', 'learning_rate': '1.575e-05', 'epoch': '0.3258'}
+
 33%|███▎      | 12370/37963 [27:58:51<56:21:44,  7.93s/it]
 33%|███▎      | 12371/37963 [27:59:01<61:01:16,  8.58s/it]
 33%|███▎      | 12372/37963 [27:59:09<59:23:29,  8.35s/it]
 33%|███▎      | 12373/37963 [27:59:19<63:25:17,  8.92s/it]
 33%|███▎      | 12374/37963 [27:59:27<60:50:15,  8.56s/it]
 33%|███▎      | 12375/37963 [27:59:34<58:43:07,  8.26s/it]
 33%|███▎      | 12376/37963 [27:59:44<62:49:03,  8.84s/it]
 33%|███▎      | 12377/37963 [27:59:55<66:00:33,  9.29s/it]
 33%|███▎      | 12378/37963 [28:00:03<63:10:49,  8.89s/it]
 33%|███▎      | 12379/37963 [28:00:13<66:24:31,  9.34s/it]
 33%|███▎      | 12380/37963 [28:00:21<63:00:49,  8.87s/it]
                                                           
{'loss': '0.1795', 'grad_norm': '3.073', 'learning_rate': '1.574e-05', 'epoch': '0.3261'}
+
 33%|███▎      | 12380/37963 [28:00:21<63:00:49,  8.87s/it]
 33%|���██▎      | 12381/37963 [28:00:28<60:20:26,  8.49s/it]
 33%|███▎      | 12382/37963 [28:00:36<58:49:01,  8.28s/it]
 33%|███▎      | 12383/37963 [28:00:44<57:39:04,  8.11s/it]
 33%|███▎      | 12384/37963 [28:00:52<56:52:20,  8.00s/it]
 33%|███▎      | 12385/37963 [28:01:00<56:24:06,  7.94s/it]
 33%|███▎      | 12386/37963 [28:01:07<56:06:42,  7.90s/it]
 33%|███▎      | 12387/37963 [28:01:15<55:35:29,  7.82s/it]
 33%|███▎      | 12388/37963 [28:01:23<55:27:54,  7.81s/it]
 33%|███▎      | 12389/37963 [28:01:30<55:17:10,  7.78s/it]
 33%|███▎      | 12390/37963 [28:01:38<55:14:39,  7.78s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '2.048', 'learning_rate': '1.574e-05', 'epoch': '0.3264'}
+
 33%|███▎      | 12390/37963 [28:01:38<55:14:39,  7.78s/it]
 33%|███▎      | 12391/37963 [28:01:45<53:53:26,  7.59s/it]
 33%|███▎      | 12392/37963 [28:01:53<54:12:28,  7.63s/it]
 33%|███▎      | 12393/37963 [28:02:01<54:10:40,  7.63s/it]
 33%|███▎      | 12394/37963 [28:02:08<54:05:10,  7.62s/it]
 33%|███▎      | 12395/37963 [28:02:18<59:22:16,  8.36s/it]
 33%|███▎      | 12396/37963 [28:02:26<57:44:09,  8.13s/it]
 33%|███▎      | 12397/37963 [28:02:34<56:44:57,  7.99s/it]
 33%|███▎      | 12398/37963 [28:02:41<56:06:44,  7.90s/it]
 33%|███▎      | 12399/37963 [28:02:49<55:15:49,  7.78s/it]
 33%|███▎      | 12400/37963 [28:02:57<55:18:55,  7.79s/it]
                                                           
{'loss': '0.1627', 'grad_norm': '1.794', 'learning_rate': '1.573e-05', 'epoch': '0.3266'}
+
 33%|███▎      | 12400/37963 [28:02:57<55:18:55,  7.79s/it]
 33%|███▎      | 12401/37963 [28:03:04<55:12:56,  7.78s/it]
 33%|███▎      | 12402/37963 [28:03:15<61:02:05,  8.60s/it]
 33%|███▎      | 12403/37963 [28:03:23<59:10:39,  8.33s/it]
 33%|███▎      | 12404/37963 [28:03:30<58:04:45,  8.18s/it]
 33%|███▎      | 12405/37963 [28:03:38<57:04:46,  8.04s/it]
 33%|███▎      | 12406/37963 [28:03:46<56:03:25,  7.90s/it]
 33%|███▎      | 12407/37963 [28:03:53<55:34:15,  7.83s/it]
 33%|███▎      | 12408/37963 [28:04:01<55:32:22,  7.82s/it]
 33%|███▎      | 12409/37963 [28:04:08<54:11:05,  7.63s/it]
 33%|███▎      | 12410/37963 [28:04:16<54:19:41,  7.65s/it]
                                                           
{'loss': '0.4353', 'grad_norm': '26.11', 'learning_rate': '1.572e-05', 'epoch': '0.3269'}
+
 33%|███▎      | 12410/37963 [28:04:16<54:19:41,  7.65s/it]
 33%|███▎      | 12411/37963 [28:04:27<60:20:15,  8.50s/it]
 33%|███▎      | 12412/37963 [28:04:34<58:14:48,  8.21s/it]
 33%|███▎      | 12413/37963 [28:04:42<56:35:38,  7.97s/it]
 33%|███▎      | 12414/37963 [28:04:49<56:17:57,  7.93s/it]
 33%|███▎      | 12415/37963 [28:04:57<56:01:53,  7.90s/it]
 33%|███▎      | 12416/37963 [28:05:05<55:08:05,  7.77s/it]
 33%|███▎      | 12417/37963 [28:05:15<60:38:05,  8.54s/it]
 33%|███▎      | 12418/37963 [28:05:23<59:07:20,  8.33s/it]
 33%|███▎      | 12419/37963 [28:05:33<63:25:27,  8.94s/it]
 33%|███▎      | 12420/37963 [28:05:41<60:49:07,  8.57s/it]
                                                           
{'loss': '0.4211', 'grad_norm': '2.637', 'learning_rate': '1.572e-05', 'epoch': '0.3272'}
+
 33%|███▎      | 12420/37963 [28:05:41<60:49:07,  8.57s/it]
 33%|███▎      | 12421/37963 [28:05:49<59:09:21,  8.34s/it]
 33%|███▎      | 12422/37963 [28:05:59<63:30:38,  8.95s/it]
 33%|███▎      | 12423/37963 [28:06:07<61:02:55,  8.61s/it]
 33%|███▎      | 12424/37963 [28:06:17<64:30:11,  9.09s/it]
 33%|███▎      | 12425/37963 [28:06:28<67:18:23,  9.49s/it]
 33%|███▎      | 12426/37963 [28:06:35<63:33:04,  8.96s/it]
 33%|███▎      | 12427/37963 [28:06:43<60:05:54,  8.47s/it]
 33%|███▎      | 12428/37963 [28:06:50<58:45:11,  8.28s/it]
 33%|███▎      | 12429/37963 [28:06:58<58:06:48,  8.19s/it]
 33%|███▎      | 12430/37963 [28:07:06<56:40:08,  7.99s/it]
                                                           
{'loss': '0.2074', 'grad_norm': '4.88', 'learning_rate': '1.571e-05', 'epoch': '0.3274'}
+
 33%|███▎      | 12430/37963 [28:07:06<56:40:08,  7.99s/it]
 33%|███▎      | 12431/37963 [28:07:14<56:34:06,  7.98s/it]
 33%|███▎      | 12432/37963 [28:07:22<55:53:12,  7.88s/it]
 33%|███▎      | 12433/37963 [28:07:29<55:38:22,  7.85s/it]
 33%|███▎      | 12434/37963 [28:07:37<54:59:51,  7.76s/it]
 33%|███▎      | 12435/37963 [28:07:44<54:30:41,  7.69s/it]
 33%|███▎      | 12436/37963 [28:07:52<54:15:33,  7.65s/it]
 33%|███▎      | 12437/37963 [28:08:00<54:24:26,  7.67s/it]
 33%|███▎      | 12438/37963 [28:08:09<58:48:22,  8.29s/it]
 33%|███▎      | 12439/37963 [28:08:17<57:46:34,  8.15s/it]
 33%|███���      | 12440/37963 [28:08:25<56:48:03,  8.01s/it]
                                                           
{'loss': '0.1888', 'grad_norm': '1.225', 'learning_rate': '1.57e-05', 'epoch': '0.3277'}
+
 33%|███▎      | 12440/37963 [28:08:25<56:48:03,  8.01s/it]
 33%|███▎      | 12441/37963 [28:08:33<56:00:29,  7.90s/it]
 33%|███▎      | 12442/37963 [28:08:41<56:21:09,  7.95s/it]
 33%|███▎      | 12443/37963 [28:08:48<55:45:26,  7.87s/it]
 33%|███▎      | 12444/37963 [28:08:56<55:22:58,  7.81s/it]
 33%|███▎      | 12445/37963 [28:09:04<55:08:03,  7.78s/it]
 33%|███▎      | 12446/37963 [28:09:12<56:01:53,  7.91s/it]
 33%|███▎      | 12447/37963 [28:09:20<55:37:01,  7.85s/it]
 33%|███▎      | 12448/37963 [28:09:27<55:15:52,  7.80s/it]
 33%|███▎      | 12449/37963 [28:09:35<54:50:46,  7.74s/it]
 33%|███▎      | 12450/37963 [28:09:45<60:30:46,  8.54s/it]
                                                           
{'loss': '0.1872', 'grad_norm': '3.854', 'learning_rate': '1.57e-05', 'epoch': '0.328'}
+
 33%|███▎      | 12450/37963 [28:09:45<60:30:46,  8.54s/it]
 33%|███▎      | 12451/37963 [28:09:53<59:13:34,  8.36s/it]
 33%|███▎      | 12452/37963 [28:10:01<57:56:28,  8.18s/it]
 33%|███▎      | 12453/37963 [28:10:09<56:56:12,  8.03s/it]
 33%|███▎      | 12454/37963 [28:10:19<61:52:06,  8.73s/it]
 33%|███▎      | 12455/37963 [28:10:27<59:31:55,  8.40s/it]
 33%|███▎      | 12456/37963 [28:10:34<57:53:47,  8.17s/it]
 33%|███▎      | 12457/37963 [28:10:42<57:03:07,  8.05s/it]
 33%|███▎      | 12458/37963 [28:10:50<55:59:48,  7.90s/it]
 33%|███▎      | 12459/37963 [28:10:57<55:17:53,  7.81s/it]
 33%|███▎      | 12460/37963 [28:11:07<60:30:32,  8.54s/it]
                                                           
{'loss': '0.179', 'grad_norm': '4.249', 'learning_rate': '1.569e-05', 'epoch': '0.3282'}
+
 33%|███▎      | 12460/37963 [28:11:07<60:30:32,  8.54s/it]
 33%|███▎      | 12461/37963 [28:11:15<58:41:19,  8.28s/it]
 33%|███▎      | 12462/37963 [28:11:22<56:41:08,  8.00s/it]
 33%|███▎      | 12463/37963 [28:11:30<55:35:31,  7.85s/it]
 33%|███▎      | 12464/37963 [28:11:38<55:15:05,  7.80s/it]
 33%|███▎      | 12465/37963 [28:11:45<54:13:10,  7.66s/it]
 33%|███▎      | 12466/37963 [28:11:53<54:14:19,  7.66s/it]
 33%|███▎      | 12467/37963 [28:12:03<59:48:51,  8.45s/it]
 33%|███▎      | 12468/37963 [28:12:11<58:02:08,  8.19s/it]
 33%|███▎      | 12469/37963 [28:12:18<56:21:28,  7.96s/it]
 33%|███▎      | 12470/37963 [28:12:28<60:37:57,  8.56s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '2.615', 'learning_rate': '1.568e-05', 'epoch': '0.3285'}
+
 33%|███▎      | 12470/37963 [28:12:28<60:37:57,  8.56s/it]
 33%|███▎      | 12471/37963 [28:12:36<58:59:56,  8.33s/it]
 33%|███▎      | 12472/37963 [28:12:46<63:25:05,  8.96s/it]
 33%|███▎      | 12473/37963 [28:12:54<60:06:38,  8.49s/it]
 33%|███▎      | 12474/37963 [28:13:01<58:37:50,  8.28s/it]
 33%|███▎      | 12475/37963 [28:13:09<57:43:43,  8.15s/it]
 33%|███▎      | 12476/37963 [28:13:17<56:35:06,  7.99s/it]
 33%|███▎      | 12477/37963 [28:13:25<56:34:26,  7.99s/it]
 33%|███▎      | 12478/37963 [28:13:35<61:27:50,  8.68s/it]
 33%|███▎      | 12479/37963 [28:13:43<59:24:27,  8.39s/it]
 33%|███▎      | 12480/37963 [28:13:50<57:44:51,  8.16s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '4.424', 'learning_rate': '1.567e-05', 'epoch': '0.3287'}
+
 33%|███▎      | 12480/37963 [28:13:50<57:44:51,  8.16s/it]
 33%|███▎      | 12481/37963 [28:13:58<57:30:15,  8.12s/it]
 33%|███▎      | 12482/37963 [28:14:06<56:42:12,  8.01s/it]
 33%|███▎      | 12483/37963 [28:14:14<55:42:56,  7.87s/it]
 33%|███▎      | 12484/37963 [28:14:24<60:34:23,  8.56s/it]
 33%|███▎      | 12485/37963 [28:14:32<58:55:25,  8.33s/it]
 33%|███▎      | 12486/37963 [28:14:39<57:30:12,  8.13s/it]
 33%|███▎      | 12487/37963 [28:14:47<56:40:40,  8.01s/it]
 33%|███▎      | 12488/37963 [28:14:55<56:38:42,  8.00s/it]
 33%|███▎      | 12489/37963 [28:15:03<56:15:28,  7.95s/it]
 33%|███▎      | 12490/37963 [28:15:11<55:39:52,  7.87s/it]
                                                           
{'loss': '0.167', 'grad_norm': '3.443', 'learning_rate': '1.567e-05', 'epoch': '0.329'}
+
 33%|███▎      | 12490/37963 [28:15:11<55:39:52,  7.87s/it]
 33%|███▎      | 12491/37963 [28:15:18<54:52:16,  7.76s/it]
 33%|███▎      | 12492/37963 [28:15:26<55:01:41,  7.78s/it]
 33%|███▎      | 12493/37963 [28:15:34<55:15:54,  7.81s/it]
 33%|███▎      | 12494/37963 [28:15:41<54:50:12,  7.75s/it]
 33%|███▎      | 12495/37963 [28:15:49<55:07:17,  7.79s/it]
 33%|██��▎      | 12496/37963 [28:15:57<54:53:37,  7.76s/it]
 33%|███▎      | 12497/37963 [28:16:05<54:43:24,  7.74s/it]
 33%|███▎      | 12498/37963 [28:16:15<60:18:45,  8.53s/it]
 33%|███▎      | 12499/37963 [28:16:23<59:27:55,  8.41s/it]
 33%|███▎      | 12500/37963 [28:16:31<57:41:52,  8.16s/it]
                                                           
{'loss': '0.1773', 'grad_norm': '3.942', 'learning_rate': '1.566e-05', 'epoch': '0.3293'}
+
 33%|███▎      | 12500/37963 [28:16:31<57:41:52,  8.16s/it]
 33%|███▎      | 12501/37963 [28:16:38<56:38:31,  8.01s/it]
 33%|███▎      | 12502/37963 [28:16:46<55:41:24,  7.87s/it]
 33%|███▎      | 12503/37963 [28:16:54<55:14:44,  7.81s/it]
 33%|███▎      | 12504/37963 [28:17:01<54:58:17,  7.77s/it]
 33%|███▎      | 12505/37963 [28:17:09<55:03:48,  7.79s/it]
 33%|███▎      | 12506/37963 [28:17:17<54:49:11,  7.75s/it]
 33%|███▎      | 12507/37963 [28:17:24<54:39:01,  7.73s/it]
 33%|███▎      | 12508/37963 [28:17:35<59:42:55,  8.45s/it]
 33%|███▎      | 12509/37963 [28:17:42<57:56:44,  8.20s/it]
 33%|███▎      | 12510/37963 [28:17:50<57:01:08,  8.06s/it]
                                                           
{'loss': '0.1698', 'grad_norm': '2.491', 'learning_rate': '1.565e-05', 'epoch': '0.3295'}
+
 33%|███▎      | 12510/37963 [28:17:50<57:01:08,  8.06s/it]
 33%|███▎      | 12511/37963 [28:18:00<61:49:32,  8.74s/it]
 33%|███▎      | 12512/37963 [28:18:08<59:37:51,  8.43s/it]
 33%|███▎      | 12513/37963 [28:18:15<57:32:59,  8.14s/it]
 33%|███▎      | 12514/37963 [28:18:26<61:59:37,  8.77s/it]
 33%|███▎      | 12515/37963 [28:18:33<59:42:45,  8.45s/it]
 33%|███▎      | 12516/37963 [28:18:41<57:03:13,  8.07s/it]
 33%|███▎      | 12517/37963 [28:18:48<55:15:38,  7.82s/it]
 33%|███▎      | 12518/37963 [28:18:55<54:33:00,  7.72s/it]
 33%|███▎      | 12519/37963 [28:19:03<54:39:39,  7.73s/it]
 33%|███▎      | 12520/37963 [28:19:13<60:18:15,  8.53s/it]
                                                           
{'loss': '0.168', 'grad_norm': '2.308', 'learning_rate': '1.565e-05', 'epoch': '0.3298'}
+
 33%|███▎      | 12520/37963 [28:19:13<60:18:15,  8.53s/it]
 33%|███▎      | 12521/37963 [28:19:21<58:37:24,  8.30s/it]
 33%|███▎      | 12522/37963 [28:19:32<63:26:32,  8.98s/it]
 33%|███▎      | 12523/37963 [28:19:39<60:28:20,  8.56s/it]
 33%|███▎      | 12524/37963 [28:19:47<58:33:28,  8.29s/it]
 33%|███▎      | 12525/37963 [28:19:55<57:29:20,  8.14s/it]
 33%|███▎      | 12526/37963 [28:20:02<56:35:21,  8.01s/it]
 33%|███▎      | 12527/37963 [28:20:10<55:50:52,  7.90s/it]
 33%|███▎      | 12528/37963 [28:20:18<54:51:49,  7.77s/it]
 33%|███▎      | 12529/37963 [28:20:25<54:47:40,  7.76s/it]
 33%|███▎      | 12530/37963 [28:20:33<55:06:08,  7.80s/it]
                                                           
{'loss': '0.18', 'grad_norm': '1.028', 'learning_rate': '1.564e-05', 'epoch': '0.3301'}
+
 33%|███▎      | 12530/37963 [28:20:33<55:06:08,  7.80s/it]
 33%|███▎      | 12531/37963 [28:20:41<55:05:09,  7.80s/it]
 33%|███▎      | 12532/37963 [28:20:51<59:28:15,  8.42s/it]
 33%|███▎      | 12533/37963 [28:20:59<58:09:49,  8.23s/it]
 33%|███▎      | 12534/37963 [28:21:06<56:47:48,  8.04s/it]
 33%|███▎      | 12535/37963 [28:21:14<56:06:47,  7.94s/it]
 33%|███▎      | 12536/37963 [28:21:22<55:19:18,  7.83s/it]
 33%|███▎      | 12537/37963 [28:21:29<55:09:03,  7.81s/it]
 33%|███▎      | 12538/37963 [28:21:37<55:08:49,  7.81s/it]
 33%|███▎      | 12539/37963 [28:21:45<54:27:59,  7.71s/it]
 33%|███▎      | 12540/37963 [28:21:52<54:42:58,  7.75s/it]
                                                           
{'loss': '0.1716', 'grad_norm': '3.499', 'learning_rate': '1.563e-05', 'epoch': '0.3303'}
+
 33%|███▎      | 12540/37963 [28:21:52<54:42:58,  7.75s/it]
 33%|███▎      | 12541/37963 [28:22:00<54:49:03,  7.76s/it]
 33%|███▎      | 12542/37963 [28:22:08<54:17:13,  7.69s/it]
 33%|███▎      | 12543/37963 [28:22:16<54:48:07,  7.76s/it]
 33%|███▎      | 12544/37963 [28:22:23<53:47:54,  7.62s/it]
 33%|███▎      | 12545/37963 [28:22:31<54:16:44,  7.69s/it]
 33%|███▎      | 12546/37963 [28:22:38<53:55:05,  7.64s/it]
 33%|███▎      | 12547/37963 [28:22:46<53:51:16,  7.63s/it]
 33%|███▎      | 12548/37963 [28:22:54<54:06:09,  7.66s/it]
 33%|███▎      | 12549/37963 [28:23:01<53:51:44,  7.63s/it]
 33%|███▎      | 12550/37963 [28:23:09<53:12:52,  7.54s/it]
                                                           
{'loss': '0.1585', 'grad_norm': '1.316', 'learning_rate': '1.562e-05', 'epoch': '0.3306'}
+
 33%|███▎      | 12550/37963 [28:23:09<53:12:52,  7.54s/it]
 33%|███▎      | 12551/37963 [28:23:16<53:28:16,  7.58s/it]
 33%|███▎      | 12552/37963 [28:23:27<59:35:00,  8.44s/it]
 33%|███▎      | 12553/37963 [28:23:34<57:38:10,  8.17s/it]
 33%|███▎      | 12554/37963 [28:23:42<56:46:55,  8.04s/it]
 33%|███▎      | 12555/37963 [28:23:50<56:05:19,  7.95s/it]
 33%|███▎      | 12556/37963 [28:23:57<54:59:56,  7.79s/it]
 33%|███▎      | 12557/37963 [28:24:13<71:38:12, 10.15s/it]
 33%|███▎      | 12558/37963 [28:24:20<66:23:27,  9.41s/it]
 33%|███▎      | 12559/37963 [28:24:28<62:36:48,  8.87s/it]
 33%|███▎      | 12560/37963 [28:24:36<60:18:12,  8.55s/it]
                                                           
{'loss': '0.1625', 'grad_norm': '2.655', 'learning_rate': '1.562e-05', 'epoch': '0.3308'}
+
 33%|███▎      | 12560/37963 [28:24:36<60:18:12,  8.55s/it]
 33%|███▎      | 12561/37963 [28:24:46<63:39:54,  9.02s/it]
 33%|███▎      | 12562/37963 [28:24:54<61:03:36,  8.65s/it]
 33%|███▎      | 12563/37963 [28:25:01<58:32:07,  8.30s/it]
 33%|███▎      | 12564/37963 [28:25:12<62:41:24,  8.89s/it]
 33%|███▎      | 12565/37963 [28:25:19<60:00:54,  8.51s/it]
 33%|███▎      | 12566/37963 [28:25:27<58:18:18,  8.26s/it]
 33%|███▎      | 12567/37963 [28:25:34<56:32:56,  8.02s/it]
 33%|███▎      | 12568/37963 [28:25:42<55:46:28,  7.91s/it]
 33%|███▎      | 12569/37963 [28:25:50<55:27:12,  7.86s/it]
 33%|███▎      | 12570/37963 [28:25:57<55:14:36,  7.83s/it]
                                                           
{'loss': '0.1595', 'grad_norm': '2.182', 'learning_rate': '1.561e-05', 'epoch': '0.3311'}
+
 33%|███▎      | 12570/37963 [28:25:57<55:14:36,  7.83s/it]
 33%|███▎      | 12571/37963 [28:26:05<54:50:45,  7.78s/it]
 33%|███▎      | 12572/37963 [28:26:13<54:19:32,  7.70s/it]
 33%|███▎      | 12573/37963 [28:26:20<54:16:06,  7.69s/it]
 33%|███▎      | 12574/37963 [28:26:28<54:21:01,  7.71s/it]
 33%|███▎      | 12575/37963 [28:26:36<54:13:40,  7.69s/it]
 33%|███▎      | 12576/37963 [28:26:46<59:26:25,  8.43s/it]
 33%|███▎      | 12577/37963 [28:26:54<58:19:23,  8.27s/it]
 33%|███▎      | 12578/37963 [28:27:02<57:24:54,  8.14s/it]
 33%|███▎      | 12579/37963 [28:27:09<56:31:07,  8.02s/it]
 33%|███▎      | 12580/37963 [28:27:17<55:56:39,  7.93s/it]
                                                           
{'loss': '0.1703', 'grad_norm': '2.196', 'learning_rate': '1.56e-05', 'epoch': '0.3314'}
+
 33%|███▎      | 12580/37963 [28:27:17<55:56:39,  7.93s/it]
 33%|███▎      | 12581/37963 [28:27:24<54:36:15,  7.74s/it]
 33%|███▎      | 12582/37963 [28:27:32<54:28:23,  7.73s/it]
 33%|███▎      | 12583/37963 [28:27:40<54:15:34,  7.70s/it]
 33%|███▎      | 12584/37963 [28:27:47<54:14:13,  7.69s/it]
 33%|███▎      | 12585/37963 [28:27:55<54:35:27,  7.74s/it]
 33%|███▎      | 12586/37963 [28:28:05<59:46:03,  8.48s/it]
 33%|███▎      | 12587/37963 [28:28:13<57:59:57,  8.23s/it]
 33%|███▎      | 12588/37963 [28:28:20<56:13:52,  7.98s/it]
 33%|███▎      | 12589/37963 [28:28:28<56:03:45,  7.95s/it]
 33%|███▎      | 12590/37963 [28:28:36<55:35:12,  7.89s/it]
                                                           
{'loss': '0.1658', 'grad_norm': '2.956', 'learning_rate': '1.56e-05', 'epoch': '0.3316'}
+
 33%|███▎      | 12590/37963 [28:28:36<55:35:12,  7.89s/it]
 33%|███▎      | 12591/37963 [28:28:44<55:27:20,  7.87s/it]
 33%|███▎      | 12592/37963 [28:28:51<54:26:03,  7.72s/it]
 33%|███▎      | 12593/37963 [28:28:59<54:39:00,  7.75s/it]
 33%|███▎      | 12594/37963 [28:29:06<53:37:09,  7.61s/it]
 33%|███▎      | 12595/37963 [28:29:14<53:44:32,  7.63s/it]
 33%|███▎      | 12596/37963 [28:29:22<53:25:24,  7.58s/it]
 33%|███▎      | 12597/37963 [28:29:29<53:24:57,  7.58s/it]
 33%|███▎      | 12598/37963 [28:29:37<53:03:41,  7.53s/it]
 33%|███▎      | 12599/37963 [28:29:44<53:44:05,  7.63s/it]
 33%|███▎      | 12600/37963 [28:29:57<65:05:33,  9.24s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '1.064', 'learning_rate': '1.559e-05', 'epoch': '0.3319'}
+
 33%|███▎      | 12600/37963 [28:29:57<65:05:33,  9.24s/it]
 33%|███▎      | 12601/37963 [28:30:08<67:48:25,  9.62s/it]
 33%|███▎      | 12602/37963 [28:30:16<64:09:33,  9.11s/it]
 33%|███▎      | 12603/37963 [28:30:24<61:21:55,  8.71s/it]
 33%|███▎      | 12604/37963 [28:30:31<59:11:09,  8.40s/it]
 33%|███▎      | 12605/37963 [28:30:41<62:52:50,  8.93s/it]
 33%|███▎      | 12606/37963 [28:30:52<66:13:16,  9.40s/it]
 33%|███▎      | 12607/37963 [28:30:59<61:49:32,  8.78s/it]
 33%|███▎      | 12608/37963 [28:31:07<60:02:07,  8.52s/it]
 33%|███▎      | 12609/37963 [28:31:15<58:06:07,  8.25s/it]
 33%|███▎      | 12610/37963 [28:31:23<57:28:05,  8.16s/it]
                                                           
{'loss': '0.1876', 'grad_norm': '2.678', 'learning_rate': '1.558e-05', 'epoch': '0.3322'}
+
 33%|███▎      | 12610/37963 [28:31:23<57:28:05,  8.16s/it]
 33%|███▎      | 12611/37963 [28:31:33<61:32:27,  8.74s/it]
 33%|███▎      | 12612/37963 [28:31:40<59:06:47,  8.39s/it]
 33%|███▎      | 12613/37963 [28:31:48<57:10:32,  8.12s/it]
 33%|███▎      | 12614/37963 [28:31:56<56:34:48,  8.04s/it]
 33%|███▎      | 12615/37963 [28:32:03<55:46:18,  7.92s/it]
 33%|███▎      | 12616/37963 [28:32:11<54:18:45,  7.71s/it]
 33%|███▎      | 12617/37963 [28:32:18<54:19:10,  7.72s/it]
 33%|███▎      | 12618/37963 [28:32:26<54:06:30,  7.69s/it]
 33%|███▎      | 12619/37963 [28:32:34<54:18:07,  7.71s/it]
 33%|███▎      | 12620/37963 [28:32:42<54:31:12,  7.74s/it]
                                                           
{'loss': '0.152', 'grad_norm': '2.011', 'learning_rate': '1.558e-05', 'epoch': '0.3324'}
+
 33%|███▎      | 12620/37963 [28:32:42<54:31:12,  7.74s/it]
 33%|███▎      | 12621/37963 [28:32:49<54:08:27,  7.69s/it]
 33%|███▎      | 12622/37963 [28:32:57<54:02:18,  7.68s/it]
 33%|███▎      | 12623/37963 [28:33:04<53:50:19,  7.65s/it]
 33%|███▎      | 12624/37963 [28:33:12<53:59:56,  7.67s/it]
 33%|███▎      | 12625/37963 [28:33:22<59:21:03,  8.43s/it]
 33%|███▎      | 12626/37963 [28:33:30<58:07:33,  8.26s/it]
 33%|███▎      | 12627/37963 [28:33:38<57:08:59,  8.12s/it]
 33%|███▎      | 12628/37963 [28:33:46<56:10:01,  7.98s/it]
 33%|███▎      | 12629/37963 [28:33:53<55:23:43,  7.87s/it]
 33%|███▎      | 12630/37963 [28:34:01<54:56:25,  7.81s/it]
                                                           
{'loss': '0.1769', 'grad_norm': '1.688', 'learning_rate': '1.557e-05', 'epoch': '0.3327'}
+
 33%|███▎      | 12630/37963 [28:34:01<54:56:25,  7.81s/it]
 33%|███▎      | 12631/37963 [28:34:08<53:20:20,  7.58s/it]
 33%|███▎      | 12632/37963 [28:34:16<53:36:57,  7.62s/it]
 33%|███▎      | 12633/37963 [28:34:23<54:02:50,  7.68s/it]
 33%|███▎      | 12634/37963 [28:34:33<58:36:14,  8.33s/it]
 33%|███▎      | 12635/37963 [28:34:41<57:34:57,  8.18s/it]
 33%|███▎      | 12636/37963 [28:34:49<57:03:18,  8.11s/it]
 33%|███▎      | 12637/37963 [28:34:57<55:45:53,  7.93s/it]
 33%|███▎      | 12638/37963 [28:35:05<55:51:55,  7.94s/it]
 33%|███▎      | 12639/37963 [28:35:12<54:46:31,  7.79s/it]
 33%|███▎      | 12640/37963 [28:35:19<54:09:30,  7.70s/it]
                                                           
{'loss': '0.1783', 'grad_norm': '3.416', 'learning_rate': '1.556e-05', 'epoch': '0.333'}
+
 33%|███▎      | 12640/37963 [28:35:19<54:09:30,  7.70s/it]
 33%|███▎      | 12641/37963 [28:35:27<54:46:24,  7.79s/it]
 33%|███▎      | 12642/37963 [28:35:35<54:39:11,  7.77s/it]
 33%|███▎      | 12643/37963 [28:35:43<54:27:41,  7.74s/it]
 33%|███▎      | 12644/37963 [28:35:56<65:03:30,  9.25s/it]
 33%|███▎      | 12645/37963 [28:36:03<61:57:03,  8.81s/it]
 33%|███▎      | 12646/37963 [28:36:11<59:19:27,  8.44s/it]
 33%|███▎      | 12647/37963 [28:36:18<57:14:20,  8.14s/it]
 33%|███▎      | 12648/37963 [28:36:26<56:05:58,  7.98s/it]
 33%|███▎      | 12649/37963 [28:36:34<55:18:43,  7.87s/it]
 33%|███▎      | 12650/37963 [28:36:41<55:08:44,  7.84s/it]
                                                           
{'loss': '0.1712', 'grad_norm': '1.985', 'learning_rate': '1.555e-05', 'epoch': '0.3332'}
+
 33%|███▎      | 12650/37963 [28:36:41<55:08:44,  7.84s/it]
 33%|███▎      | 12651/37963 [28:36:49<54:17:43,  7.72s/it]
 33%|███▎      | 12652/37963 [28:36:56<53:34:29,  7.62s/it]
 33%|███▎      | 12653/37963 [28:37:06<58:19:54,  8.30s/it]
 33%|███▎      | 12654/37963 [28:37:20<69:02:57,  9.82s/it]
 33%|███▎      | 12655/37963 [28:37:30<70:15:18,  9.99s/it]
 33%|███▎      | 12656/37963 [28:37:38<65:45:34,  9.35s/it]
 33%|███▎      | 12657/37963 [28:37:46<62:20:47,  8.87s/it]
 33%|███▎      | 12658/37963 [28:37:53<59:30:11,  8.47s/it]
 33%|███▎      | 12659/37963 [28:38:01<57:57:29,  8.25s/it]
 33%|███▎      | 12660/37963 [28:38:08<56:43:17,  8.07s/it]
                                                           
{'loss': '0.1708', 'grad_norm': '2.121', 'learning_rate': '1.555e-05', 'epoch': '0.3335'}
+
 33%|███▎      | 12660/37963 [28:38:08<56:43:17,  8.07s/it]
 33%|███▎      | 12661/37963 [28:38:16<55:51:25,  7.95s/it]
 33%|███▎      | 12662/37963 [28:38:24<55:29:41,  7.90s/it]
 33%|███▎      | 12663/37963 [28:38:32<55:05:25,  7.84s/it]
 33%|███▎      | 12664/37963 [28:38:39<54:52:31,  7.81s/it]
 33%|███▎      | 12665/37963 [28:38:47<54:50:41,  7.80s/it]
 33%|███▎      | 12666/37963 [28:38:55<54:36:13,  7.77s/it]
 33%|██���▎      | 12667/37963 [28:39:03<54:49:36,  7.80s/it]
 33%|███▎      | 12668/37963 [28:39:10<54:23:44,  7.74s/it]
 33%|███▎      | 12669/37963 [28:39:18<54:13:26,  7.72s/it]
 33%|███▎      | 12670/37963 [28:39:25<53:41:21,  7.64s/it]
                                                           
{'loss': '0.1707', 'grad_norm': '2.455', 'learning_rate': '1.554e-05', 'epoch': '0.3337'}
+
 33%|███▎      | 12670/37963 [28:39:25<53:41:21,  7.64s/it]
 33%|███▎      | 12671/37963 [28:39:33<53:37:41,  7.63s/it]
 33%|███▎      | 12672/37963 [28:39:41<53:56:09,  7.68s/it]
 33%|███▎      | 12673/37963 [28:39:49<54:08:39,  7.71s/it]
 33%|███▎      | 12674/37963 [28:39:56<53:55:42,  7.68s/it]
 33%|███▎      | 12675/37963 [28:40:04<54:13:52,  7.72s/it]
 33%|███▎      | 12676/37963 [28:40:12<54:11:49,  7.72s/it]
 33%|███▎      | 12677/37963 [28:40:19<53:35:31,  7.63s/it]
 33%|███▎      | 12678/37963 [28:40:27<53:30:42,  7.62s/it]
 33%|███▎      | 12679/37963 [28:40:37<58:12:32,  8.29s/it]
 33%|███▎      | 12680/37963 [28:40:44<55:54:38,  7.96s/it]
                                                           
{'loss': '0.1621', 'grad_norm': '1.836', 'learning_rate': '1.553e-05', 'epoch': '0.334'}
+
 33%|███▎      | 12680/37963 [28:40:44<55:54:38,  7.96s/it]
 33%|███▎      | 12681/37963 [28:40:51<55:00:57,  7.83s/it]
 33%|███▎      | 12682/37963 [28:41:01<59:44:05,  8.51s/it]
 33%|███▎      | 12683/37963 [28:41:09<58:29:44,  8.33s/it]
 33%|███▎      | 12684/37963 [28:41:17<57:34:54,  8.20s/it]
 33%|███▎      | 12685/37963 [28:41:25<56:30:03,  8.05s/it]
 33%|███▎      | 12686/37963 [28:41:33<55:49:28,  7.95s/it]
 33%|███▎      | 12687/37963 [28:41:43<60:49:55,  8.66s/it]
 33%|███▎      | 12688/37963 [28:41:50<58:10:23,  8.29s/it]
 33%|███▎      | 12689/37963 [28:41:58<56:47:37,  8.09s/it]
 33%|███▎      | 12690/37963 [28:42:06<55:52:51,  7.96s/it]
                                                           
{'loss': '0.1686', 'grad_norm': '4.216', 'learning_rate': '1.553e-05', 'epoch': '0.3343'}
+
 33%|███▎      | 12690/37963 [28:42:06<55:52:51,  7.96s/it]
 33%|███▎      | 12691/37963 [28:42:13<55:37:50,  7.92s/it]
 33%|███▎      | 12692/37963 [28:42:24<60:34:42,  8.63s/it]
 33%|███▎      | 12693/37963 [28:42:31<58:29:56,  8.33s/it]
 33%|███▎      | 12694/37963 [28:42:39<57:23:53,  8.18s/it]
 33%|███▎      | 12695/37963 [28:42:47<56:33:45,  8.06s/it]
 33%|███▎      | 12696/37963 [28:42:55<55:54:50,  7.97s/it]
 33%|███▎      | 12697/37963 [28:43:02<54:56:29,  7.83s/it]
 33%|███▎      | 12698/37963 [28:43:12<58:55:24,  8.40s/it]
 33%|███▎      | 12699/37963 [28:43:20<57:41:05,  8.22s/it]
 33%|███▎      | 12700/37963 [28:43:27<56:33:47,  8.06s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '2.979', 'learning_rate': '1.552e-05', 'epoch': '0.3345'}
+
 33%|███▎      | 12700/37963 [28:43:27<56:33:47,  8.06s/it]
 33%|███▎      | 12701/37963 [28:43:38<61:12:17,  8.72s/it]
 33%|███▎      | 12702/37963 [28:43:45<58:57:51,  8.40s/it]
 33%|███▎      | 12703/37963 [28:43:56<63:49:17,  9.10s/it]
 33%|███▎      | 12704/37963 [28:44:04<61:19:09,  8.74s/it]
 33%|███▎      | 12705/37963 [28:44:12<58:54:09,  8.40s/it]
 33%|███▎      | 12706/37963 [28:44:19<56:58:15,  8.12s/it]
 33%|███▎      | 12707/37963 [28:44:27<55:58:03,  7.98s/it]
 33%|███▎      | 12708/37963 [28:44:37<60:35:48,  8.64s/it]
 33%|███▎      | 12709/37963 [28:44:45<58:52:43,  8.39s/it]
 33%|███▎      | 12710/37963 [28:44:52<57:12:36,  8.16s/it]
                                                           
{'loss': '0.1673', 'grad_norm': '1.41', 'learning_rate': '1.551e-05', 'epoch': '0.3348'}
+
 33%|███▎      | 12710/37963 [28:44:52<57:12:36,  8.16s/it]
 33%|███▎      | 12711/37963 [28:45:00<56:01:47,  7.99s/it]
 33%|███▎      | 12712/37963 [28:45:08<55:35:50,  7.93s/it]
 33%|███▎      | 12713/37963 [28:45:15<54:49:54,  7.82s/it]
 33%|███▎      | 12714/37963 [28:45:23<54:36:47,  7.79s/it]
 33%|███▎      | 12715/37963 [28:45:31<54:16:54,  7.74s/it]
 33%|███▎      | 12716/37963 [28:45:38<54:17:35,  7.74s/it]
 33%|███▎      | 12717/37963 [28:45:46<54:23:52,  7.76s/it]
 34%|███▎      | 12718/37963 [28:45:54<54:12:03,  7.73s/it]
 34%|███▎      | 12719/37963 [28:46:01<54:03:25,  7.71s/it]
 34%|███▎      | 12720/37963 [28:46:09<54:09:55,  7.72s/it]
                                                           
{'loss': '0.1693', 'grad_norm': '3.465', 'learning_rate': '1.55e-05', 'epoch': '0.3351'}
+
 34%|███▎      | 12720/37963 [28:46:09<54:09:55,  7.72s/it]
 34%|███▎      | 12721/37963 [28:46:17<54:00:36,  7.70s/it]
 34%|███▎      | 12722/37963 [28:46:25<53:58:31,  7.70s/it]
 34%|��██▎      | 12723/37963 [28:46:32<54:22:44,  7.76s/it]
 34%|███▎      | 12724/37963 [28:46:40<54:01:31,  7.71s/it]
 34%|███▎      | 12725/37963 [28:46:48<53:42:11,  7.66s/it]
 34%|███▎      | 12726/37963 [28:46:55<53:24:55,  7.62s/it]
 34%|███▎      | 12727/37963 [28:47:05<58:17:04,  8.31s/it]
 34%|███▎      | 12728/37963 [28:47:13<56:51:37,  8.11s/it]
 34%|███▎      | 12729/37963 [28:47:20<55:40:39,  7.94s/it]
 34%|███▎      | 12730/37963 [28:47:28<55:05:38,  7.86s/it]
                                                           
{'loss': '0.1703', 'grad_norm': '2.612', 'learning_rate': '1.55e-05', 'epoch': '0.3353'}
+
 34%|███▎      | 12730/37963 [28:47:28<55:05:38,  7.86s/it]
 34%|███▎      | 12731/37963 [28:47:38<60:42:12,  8.66s/it]
 34%|███▎      | 12732/37963 [28:47:46<59:02:42,  8.42s/it]
 34%|███▎      | 12733/37963 [28:47:57<62:47:18,  8.96s/it]
 34%|███▎      | 12734/37963 [28:48:04<60:00:48,  8.56s/it]
 34%|███▎      | 12735/37963 [28:48:12<57:57:34,  8.27s/it]
 34%|███▎      | 12736/37963 [28:48:19<56:26:47,  8.06s/it]
 34%|███▎      | 12737/37963 [28:48:27<55:48:38,  7.96s/it]
 34%|███▎      | 12738/37963 [28:48:35<54:56:16,  7.84s/it]
 34%|███▎      | 12739/37963 [28:48:42<54:10:44,  7.73s/it]
 34%|███▎      | 12740/37963 [28:48:52<59:18:55,  8.47s/it]
                                                           
{'loss': '0.1731', 'grad_norm': '1.468', 'learning_rate': '1.549e-05', 'epoch': '0.3356'}
+
 34%|███▎      | 12740/37963 [28:48:52<59:18:55,  8.47s/it]
 34%|███▎      | 12741/37963 [28:49:00<57:50:47,  8.26s/it]
 34%|███▎      | 12742/37963 [28:49:08<56:27:28,  8.06s/it]
 34%|███▎      | 12743/37963 [28:49:15<55:40:16,  7.95s/it]
 34%|███▎      | 12744/37963 [28:49:23<55:23:15,  7.91s/it]
 34%|███▎      | 12745/37963 [28:49:31<54:55:19,  7.84s/it]
 34%|███▎      | 12746/37963 [28:49:41<60:20:46,  8.62s/it]
 34%|███▎      | 12747/37963 [28:49:49<58:26:50,  8.34s/it]
 34%|███▎      | 12748/37963 [28:49:57<56:52:44,  8.12s/it]
 34%|███▎      | 12749/37963 [28:50:04<56:10:11,  8.02s/it]
 34%|███▎      | 12750/37963 [28:50:12<55:34:32,  7.94s/it]
                                                           
{'loss': '0.1675', 'grad_norm': '3.215', 'learning_rate': '1.548e-05', 'epoch': '0.3359'}
+
 34%|███▎      | 12750/37963 [28:50:12<55:34:32,  7.94s/it]
 34%|███▎      | 12751/37963 [28:50:22<60:46:57,  8.68s/it]
 34%|███▎      | 12752/37963 [28:50:30<58:40:35,  8.38s/it]
 34%|███▎      | 12753/37963 [28:50:40<62:06:00,  8.87s/it]
 34%|███▎      | 12754/37963 [28:50:48<60:22:08,  8.62s/it]
 34%|███▎      | 12755/37963 [28:50:56<58:41:20,  8.38s/it]
 34%|███▎      | 12756/37963 [28:51:04<57:14:14,  8.17s/it]
 34%|███▎      | 12757/37963 [28:51:12<56:53:11,  8.12s/it]
 34%|███▎      | 12758/37963 [28:51:20<56:18:31,  8.04s/it]
 34%|███▎      | 12759/37963 [28:51:27<55:39:40,  7.95s/it]
 34%|███▎      | 12760/37963 [28:51:35<54:53:35,  7.84s/it]
                                                           
{'loss': '0.1539', 'grad_norm': '1.13', 'learning_rate': '1.548e-05', 'epoch': '0.3361'}
+
 34%|███▎      | 12760/37963 [28:51:35<54:53:35,  7.84s/it]
 34%|███▎      | 12761/37963 [28:51:43<54:28:06,  7.78s/it]
 34%|███▎      | 12762/37963 [28:51:50<53:50:03,  7.69s/it]
 34%|███▎      | 12763/37963 [28:52:00<59:13:06,  8.46s/it]
 34%|███▎      | 12764/37963 [28:52:08<58:01:14,  8.29s/it]
 34%|███▎      | 12765/37963 [28:52:16<56:29:14,  8.07s/it]
 34%|███▎      | 12766/37963 [28:52:23<55:45:05,  7.97s/it]
 34%|███▎      | 12767/37963 [28:52:31<55:10:28,  7.88s/it]
 34%|███▎      | 12768/37963 [28:52:39<55:03:09,  7.87s/it]
 34%|███▎      | 12769/37963 [28:52:47<54:42:05,  7.82s/it]
 34%|███▎      | 12770/37963 [28:52:55<54:50:54,  7.84s/it]
                                                           
{'loss': '0.1849', 'grad_norm': '3.645', 'learning_rate': '1.547e-05', 'epoch': '0.3364'}
+
 34%|███▎      | 12770/37963 [28:52:55<54:50:54,  7.84s/it]
 34%|███▎      | 12771/37963 [28:53:05<60:07:40,  8.59s/it]
 34%|███▎      | 12772/37963 [28:53:12<57:56:41,  8.28s/it]
 34%|███▎      | 12773/37963 [28:53:20<56:59:15,  8.14s/it]
 34%|███▎      | 12774/37963 [28:53:28<55:48:30,  7.98s/it]
 34%|███▎      | 12775/37963 [28:53:36<55:26:43,  7.92s/it]
 34%|███▎      | 12776/37963 [28:53:44<55:11:30,  7.89s/it]
 34%|███▎      | 12777/37963 [28:53:51<55:07:35,  7.88s/it]
 34%|███▎      | 12778/37963 [28:53:59<54:39:17,  7.81s/it]
 34%|███▎      | 12779/37963 [28:54:09<59:20:54,  8.48s/it]
 34%|███▎      | 12780/37963 [28:54:17<57:38:37,  8.24s/it]
                                                           
{'loss': '0.1593', 'grad_norm': '3.175', 'learning_rate': '1.546e-05', 'epoch': '0.3366'}
+
 34%|███▎      | 12780/37963 [28:54:17<57:38:37,  8.24s/it]
 34%|███▎      | 12781/37963 [28:54:24<55:49:57,  7.98s/it]
 34%|███▎      | 12782/37963 [28:54:32<55:02:52,  7.87s/it]
 34%|███▎      | 12783/37963 [28:54:39<54:46:32,  7.83s/it]
 34%|███▎      | 12784/37963 [28:54:47<54:12:50,  7.75s/it]
 34%|███▎      | 12785/37963 [28:54:55<54:22:44,  7.78s/it]
 34%|███▎      | 12786/37963 [28:55:02<54:02:56,  7.73s/it]
 34%|███▎      | 12787/37963 [28:55:13<59:07:03,  8.45s/it]
 34%|███▎      | 12788/37963 [28:55:20<57:31:32,  8.23s/it]
 34%|███▎      | 12789/37963 [28:55:31<62:31:42,  8.94s/it]
 34%|███▎      | 12790/37963 [28:55:39<60:16:20,  8.62s/it]
                                                           
{'loss': '0.172', 'grad_norm': '2.619', 'learning_rate': '1.545e-05', 'epoch': '0.3369'}
+
 34%|███▎      | 12790/37963 [28:55:39<60:16:20,  8.62s/it]
 34%|███▎      | 12791/37963 [28:55:47<58:25:04,  8.35s/it]
 34%|███▎      | 12792/37963 [28:55:54<57:15:50,  8.19s/it]
 34%|███▎      | 12793/37963 [28:56:02<56:27:48,  8.08s/it]
 34%|███▎      | 12794/37963 [28:56:10<55:16:13,  7.91s/it]
 34%|███▎      | 12795/37963 [28:56:23<65:59:43,  9.44s/it]
 34%|███▎      | 12796/37963 [28:56:31<62:47:50,  8.98s/it]
 34%|███▎      | 12797/37963 [28:56:38<60:01:28,  8.59s/it]
 34%|███▎      | 12798/37963 [28:56:46<57:40:49,  8.25s/it]
 34%|███▎      | 12799/37963 [28:56:53<56:08:35,  8.03s/it]
 34%|███▎      | 12800/37963 [28:57:01<55:39:40,  7.96s/it]
                                                           
{'loss': '0.1779', 'grad_norm': '2.303', 'learning_rate': '1.545e-05', 'epoch': '0.3372'}
+
 34%|███▎      | 12800/37963 [28:57:01<55:39:40,  7.96s/it]
 34%|███▎      | 12801/37963 [28:57:11<60:02:01,  8.59s/it]
 34%|███▎      | 12802/37963 [28:57:19<58:20:07,  8.35s/it]
 34%|███▎      | 12803/37963 [28:57:26<55:45:54,  7.98s/it]
 34%|███▎      | 12804/37963 [28:57:34<55:20:18,  7.92s/it]
 34%|███▎      | 12805/37963 [28:57:41<54:23:07,  7.78s/it]
 34%|███▎      | 12806/37963 [28:57:49<54:55:09,  7.86s/it]
 34%|███▎      | 12807/37963 [28:57:57<55:08:03,  7.89s/it]
 34%|███▎      | 12808/37963 [28:58:05<54:44:17,  7.83s/it]
 34%|███▎      | 12809/37963 [28:58:13<54:38:24,  7.82s/it]
 34%|███▎      | 12810/37963 [28:58:20<54:31:05,  7.80s/it]
                                                           
{'loss': '0.1681', 'grad_norm': '3.608', 'learning_rate': '1.544e-05', 'epoch': '0.3374'}
+
 34%|███▎      | 12810/37963 [28:58:20<54:31:05,  7.80s/it]
 34%|███▎      | 12811/37963 [28:58:28<54:08:42,  7.75s/it]
 34%|███▎      | 12812/37963 [28:58:36<54:15:35,  7.77s/it]
 34%|███▍      | 12813/37963 [28:58:44<54:17:37,  7.77s/it]
 34%|███▍      | 12814/37963 [28:58:51<54:18:40,  7.77s/it]
 34%|███▍      | 12815/37963 [28:58:59<54:03:10,  7.74s/it]
 34%|███▍      | 12816/37963 [28:59:07<54:08:39,  7.75s/it]
 34%|███▍      | 12817/37963 [28:59:17<59:36:43,  8.53s/it]
 34%|███▍      | 12818/37963 [28:59:25<58:26:59,  8.37s/it]
 34%|███▍      | 12819/37963 [28:59:36<63:01:33,  9.02s/it]
 34%|███▍      | 12820/37963 [28:59:43<60:10:43,  8.62s/it]
                                                           
{'loss': '0.1529', 'grad_norm': '1.591', 'learning_rate': '1.543e-05', 'epoch': '0.3377'}
+
 34%|███▍      | 12820/37963 [28:59:43<60:10:43,  8.62s/it]
 34%|███▍      | 12821/37963 [28:59:51<57:39:58,  8.26s/it]
 34%|███▍      | 12822/37963 [28:59:58<56:02:42,  8.03s/it]
 34%|███▍      | 12823/37963 [29:00:09<60:54:15,  8.72s/it]
 34%|███▍      | 12824/37963 [29:00:16<58:19:37,  8.35s/it]
 34%|███▍      | 12825/37963 [29:00:24<56:45:20,  8.13s/it]
 34%|███▍      | 12826/37963 [29:00:31<55:32:05,  7.95s/it]
 34%|███▍      | 12827/37963 [29:00:39<54:43:36,  7.84s/it]
 34%|███▍      | 12828/37963 [29:00:47<54:28:49,  7.80s/it]
 34%|███▍      | 12829/37963 [29:00:54<54:27:30,  7.80s/it]
 34%|███▍      | 12830/37963 [29:01:02<53:31:05,  7.67s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '3.759', 'learning_rate': '1.543e-05', 'epoch': '0.338'}
+
 34%|███▍      | 12830/37963 [29:01:02<53:31:05,  7.67s/it]
 34%|███▍      | 12831/37963 [29:01:12<58:55:09,  8.44s/it]
 34%|███▍      | 12832/37963 [29:01:20<57:56:06,  8.30s/it]
 34%|███▍      | 12833/37963 [29:01:28<56:38:57,  8.12s/it]
 34%|███▍      | 12834/37963 [29:01:35<55:32:08,  7.96s/it]
 34%|███▍      | 12835/37963 [29:01:43<54:45:36,  7.85s/it]
 34%|███▍      | 12836/37963 [29:01:51<54:22:25,  7.79s/it]
 34%|███▍      | 12837/37963 [29:02:01<60:00:32,  8.60s/it]
 34%|███▍      | 12838/37963 [29:02:08<57:04:08,  8.18s/it]
 34%|███▍      | 12839/37963 [29:02:16<55:39:56,  7.98s/it]
 34%|███▍      | 12840/37963 [29:02:23<54:40:27,  7.83s/it]
                                                           
{'loss': '0.165', 'grad_norm': '1.703', 'learning_rate': '1.542e-05', 'epoch': '0.3382'}
+
 34%|███▍      | 12840/37963 [29:02:23<54:40:27,  7.83s/it]
 34%|███▍      | 12841/37963 [29:02:31<54:26:47,  7.80s/it]
 34%|███▍      | 12842/37963 [29:02:39<54:27:05,  7.80s/it]
 34%|███▍      | 12843/37963 [29:02:49<59:25:55,  8.52s/it]
 34%|███▍      | 12844/37963 [29:02:57<57:46:59,  8.28s/it]
 34%|███▍      | 12845/37963 [29:03:04<56:23:01,  8.08s/it]
 34%|███▍      | 12846/37963 [29:03:12<54:40:50,  7.84s/it]
 34%|███▍      | 12847/37963 [29:03:19<54:41:30,  7.84s/it]
 34%|███▍      | 12848/37963 [29:03:30<59:43:40,  8.56s/it]
 34%|███▍      | 12849/37963 [29:03:37<58:07:09,  8.33s/it]
 34%|███▍      | 12850/37963 [29:03:45<56:38:11,  8.12s/it]
                                                           
{'loss': '0.1603', 'grad_norm': '2.389', 'learning_rate': '1.541e-05', 'epoch': '0.3385'}
+
 34%|███▍      | 12850/37963 [29:03:45<56:38:11,  8.12s/it]
 34%|███▍      | 12851/37963 [29:03:53<55:40:08,  7.98s/it]
 34%|███▍      | 12852/37963 [29:04:03<60:40:33,  8.70s/it]
 34%|███▍      | 12853/37963 [29:04:11<58:42:24,  8.42s/it]
 34%|███▍      | 12854/37963 [29:04:19<57:15:45,  8.21s/it]
 34%|███▍      | 12855/37963 [29:04:27<56:43:25,  8.13s/it]
 34%|███▍      | 12856/37963 [29:04:34<55:58:29,  8.03s/it]
 34%|███▍      | 12857/37963 [29:04:42<55:13:46,  7.92s/it]
 34%|███▍      | 12858/37963 [29:04:50<54:50:00,  7.86s/it]
 34%|███▍      | 12859/37963 [29:04:58<55:00:16,  7.89s/it]
 34%|███▍      | 12860/37963 [29:05:05<54:31:10,  7.82s/it]
                                                           
{'loss': '0.1731', 'grad_norm': '2.38', 'learning_rate': '1.54e-05', 'epoch': '0.3388'}
+
 34%|███▍      | 12860/37963 [29:05:05<54:31:10,  7.82s/it]
 34%|███▍      | 12861/37963 [29:05:13<54:37:02,  7.83s/it]
 34%|███▍      | 12862/37963 [29:05:21<54:15:45,  7.78s/it]
 34%|███▍      | 12863/37963 [29:05:31<59:45:29,  8.57s/it]
 34%|███▍      | 12864/37963 [29:05:39<58:19:19,  8.37s/it]
 34%|███▍      | 12865/37963 [29:05:47<56:58:59,  8.17s/it]
 34%|███▍      | 12866/37963 [29:05:57<61:37:09,  8.84s/it]
 34%|███▍      | 12867/37963 [29:06:05<59:30:17,  8.54s/it]
 34%|███▍      | 12868/37963 [29:06:12<56:29:43,  8.10s/it]
 34%|███▍      | 12869/37963 [29:06:20<55:52:56,  8.02s/it]
 34%|███▍      | 12870/37963 [29:06:28<55:15:49,  7.93s/it]
                                                           
{'loss': '0.1695', 'grad_norm': '2.976', 'learning_rate': '1.54e-05', 'epoch': '0.339'}
+
 34%|███▍      | 12870/37963 [29:06:28<55:15:49,  7.93s/it]
 34%|███▍      | 12871/37963 [29:06:38<59:50:37,  8.59s/it]
 34%|███▍      | 12872/37963 [29:06:46<58:07:38,  8.34s/it]
 34%|███▍      | 12873/37963 [29:06:53<56:46:12,  8.15s/it]
 34%|███▍      | 12874/37963 [29:07:01<55:44:32,  8.00s/it]
 34%|███▍      | 12875/37963 [29:07:09<54:57:39,  7.89s/it]
 34%|███▍      | 12876/37963 [29:07:16<54:20:29,  7.80s/it]
 34%|███▍      | 12877/37963 [29:07:24<54:12:17,  7.78s/it]
 34%|███▍      | 12878/37963 [29:07:32<54:40:04,  7.85s/it]
 34%|███▍      | 12879/37963 [29:07:42<59:47:30,  8.58s/it]
 34%|███▍      | 12880/37963 [29:07:50<57:29:33,  8.25s/it]
                                                           
{'loss': '0.1666', 'grad_norm': '1.292', 'learning_rate': '1.539e-05', 'epoch': '0.3393'}
+
 34%|███▍      | 12880/37963 [29:07:50<57:29:33,  8.25s/it]
 34%|███▍      | 12881/37963 [29:07:57<56:06:53,  8.05s/it]
 34%|███▍      | 12882/37963 [29:08:05<55:07:52,  7.91s/it]
 34%|███▍      | 12883/37963 [29:08:13<54:42:25,  7.85s/it]
 34%|███▍      | 12884/37963 [29:08:20<54:18:31,  7.80s/it]
 34%|███▍      | 12885/37963 [29:08:31<59:50:13,  8.59s/it]
 34%|███▍      | 12886/37963 [29:08:39<58:13:08,  8.36s/it]
 34%|███▍      | 12887/37963 [29:08:46<57:03:42,  8.19s/it]
 34%|███▍      | 12888/37963 [29:08:54<56:01:39,  8.04s/it]
 34%|███▍      | 12889/37963 [29:09:02<55:12:52,  7.93s/it]
 34%|███▍      | 12890/37963 [29:09:09<54:37:35,  7.84s/it]
                                                           
{'loss': '0.1679', 'grad_norm': '1.075', 'learning_rate': '1.538e-05', 'epoch': '0.3395'}
+
 34%|███▍      | 12890/37963 [29:09:09<54:37:35,  7.84s/it]
 34%|███▍      | 12891/37963 [29:09:17<54:14:21,  7.79s/it]
 34%|███▍      | 12892/37963 [29:09:25<53:53:47,  7.74s/it]
 34%|███▍      | 12893/37963 [29:09:32<53:49:22,  7.73s/it]
 34%|███▍      | 12894/37963 [29:09:40<53:36:15,  7.70s/it]
 34%|███▍      | 12895/37963 [29:09:48<53:49:55,  7.73s/it]
 34%|███▍      | 12896/37963 [29:09:55<53:41:57,  7.71s/it]
 34%|███▍      | 12897/37963 [29:10:06<59:20:29,  8.52s/it]
 34%|███▍      | 12898/37963 [29:10:13<57:25:18,  8.25s/it]
 34%|███▍      | 12899/37963 [29:10:21<56:34:05,  8.13s/it]
 34%|███▍      | 12900/37963 [29:10:29<55:49:39,  8.02s/it]
                                                           
{'loss': '0.17', 'grad_norm': '3.791', 'learning_rate': '1.538e-05', 'epoch': '0.3398'}
+
 34%|███▍      | 12900/37963 [29:10:29<55:49:39,  8.02s/it]
 34%|███▍      | 12901/37963 [29:10:37<54:57:24,  7.89s/it]
 34%|███▍      | 12902/37963 [29:10:47<59:31:19,  8.55s/it]
 34%|███▍      | 12903/37963 [29:10:54<57:31:11,  8.26s/it]
 34%|███▍      | 12904/37963 [29:11:02<56:27:32,  8.11s/it]
 34%|███▍      | 12905/37963 [29:11:10<55:46:37,  8.01s/it]
 34%|███▍      | 12906/37963 [29:11:20<60:27:09,  8.69s/it]
 34%|███▍      | 12907/37963 [29:11:28<58:38:45,  8.43s/it]
 34%|███▍      | 12908/37963 [29:11:36<57:27:10,  8.26s/it]
 34%|███▍      | 12909/37963 [29:11:43<56:11:09,  8.07s/it]
 34%|███▍      | 12910/37963 [29:11:54<60:55:27,  8.75s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '3.607', 'learning_rate': '1.537e-05', 'epoch': '0.3401'}
+
 34%|███▍      | 12910/37963 [29:11:54<60:55:27,  8.75s/it]
 34%|███▍      | 12911/37963 [29:12:04<64:20:53,  9.25s/it]
 34%|███▍      | 12912/37963 [29:12:12<61:12:41,  8.80s/it]
 34%|███▍      | 12913/37963 [29:12:20<58:45:38,  8.44s/it]
 34%|███▍      | 12914/37963 [29:12:27<57:01:35,  8.20s/it]
 34%|███▍      | 12915/37963 [29:12:35<56:34:24,  8.13s/it]
 34%|███▍      | 12916/37963 [29:12:43<55:25:54,  7.97s/it]
 34%|███▍      | 12917/37963 [29:12:50<54:24:01,  7.82s/it]
 34%|███▍      | 12918/37963 [29:12:58<54:02:05,  7.77s/it]
 34%|███▍      | 12919/37963 [29:13:06<54:20:06,  7.81s/it]
 34%|███▍      | 12920/37963 [29:13:13<53:43:13,  7.72s/it]
                                                           
{'loss': '0.17', 'grad_norm': '2.531', 'learning_rate': '1.536e-05', 'epoch': '0.3403'}
+
 34%|███▍      | 12920/37963 [29:13:13<53:43:13,  7.72s/it]
 34%|███▍      | 12921/37963 [29:13:21<53:33:33,  7.70s/it]
 34%|███▍      | 12922/37963 [29:13:29<53:29:06,  7.69s/it]
 34%|███▍      | 12923/37963 [29:13:36<53:33:20,  7.70s/it]
 34%|███▍      | 12924/37963 [29:13:44<52:48:38,  7.59s/it]
 34%|███▍      | 12925/37963 [29:13:54<58:38:59,  8.43s/it]
 34%|███▍      | 12926/37963 [29:14:02<57:38:16,  8.29s/it]
 34%|███▍      | 12927/37963 [29:14:10<56:24:17,  8.11s/it]
 34%|███▍      | 12928/37963 [29:14:18<55:56:34,  8.04s/it]
 34%|███▍      | 12929/37963 [29:14:28<60:33:16,  8.71s/it]
 34%|███▍      | 12930/37963 [29:14:35<58:05:12,  8.35s/it]
                                                           
{'loss': '0.1704', 'grad_norm': '1.206', 'learning_rate': '1.535e-05', 'epoch': '0.3406'}
+
 34%|███▍      | 12930/37963 [29:14:35<58:05:12,  8.35s/it]
 34%|███▍      | 12931/37963 [29:14:43<56:45:18,  8.16s/it]
 34%|███▍      | 12932/37963 [29:14:51<55:58:34,  8.05s/it]
 34%|███▍      | 12933/37963 [29:15:01<59:45:26,  8.59s/it]
 34%|███▍      | 12934/37963 [29:15:09<58:10:56,  8.37s/it]
 34%|███▍      | 12935/37963 [29:15:16<56:45:27,  8.16s/it]
 34%|███▍      | 12936/37963 [29:15:24<55:38:10,  8.00s/it]
 34%|███▍      | 12937/37963 [29:15:32<55:35:30,  8.00s/it]
 34%|███▍      | 12938/37963 [29:15:40<55:12:21,  7.94s/it]
 34%|███▍      | 12939/37963 [29:15:47<54:42:23,  7.87s/it]
 34%|███▍      | 12940/37963 [29:15:58<59:46:04,  8.60s/it]
                                                           
{'loss': '0.1623', 'grad_norm': '4.659', 'learning_rate': '1.535e-05', 'epoch': '0.3409'}
+
 34%|███▍      | 12940/37963 [29:15:58<59:46:04,  8.60s/it]
 34%|███▍      | 12941/37963 [29:16:05<57:57:55,  8.34s/it]
 34%|███▍      | 12942/37963 [29:16:13<56:35:48,  8.14s/it]
 34%|███▍      | 12943/37963 [29:16:21<55:50:33,  8.03s/it]
 34%|███▍      | 12944/37963 [29:16:29<54:58:45,  7.91s/it]
 34%|███▍      | 12945/37963 [29:16:36<54:29:31,  7.84s/it]
 34%|███▍      | 12946/37963 [29:16:48<62:05:24,  8.93s/it]
 34%|███▍      | 12947/37963 [29:16:55<59:35:21,  8.58s/it]
 34%|███▍      | 12948/37963 [29:17:03<57:33:32,  8.28s/it]
 34%|███▍      | 12949/37963 [29:17:11<56:23:43,  8.12s/it]
 34%|███▍      | 12950/37963 [29:17:19<55:44:08,  8.02s/it]
                                                           
{'loss': '0.1586', 'grad_norm': '3.908', 'learning_rate': '1.534e-05', 'epoch': '0.3411'}
+
 34%|███▍      | 12950/37963 [29:17:19<55:44:08,  8.02s/it]
 34%|███▍      | 12951/37963 [29:17:26<54:39:48,  7.87s/it]
 34%|███▍      | 12952/37963 [29:17:34<53:58:38,  7.77s/it]
 34%|███▍      | 12953/37963 [29:17:41<53:39:20,  7.72s/it]
 34%|███▍      | 12954/37963 [29:17:49<53:47:20,  7.74s/it]
 34%|███▍      | 12955/37963 [29:17:57<53:29:14,  7.70s/it]
 34%|███▍      | 12956/37963 [29:18:05<53:58:01,  7.77s/it]
 34%|███▍      | 12957/37963 [29:18:12<53:35:38,  7.72s/it]
 34%|███▍      | 12958/37963 [29:18:20<53:33:25,  7.71s/it]
 34%|███▍      | 12959/37963 [29:18:27<52:29:43,  7.56s/it]
 34%|███▍      | 12960/37963 [29:18:38<58:51:50,  8.48s/it]
                                                           
{'loss': '0.1581', 'grad_norm': '1.266', 'learning_rate': '1.533e-05', 'epoch': '0.3414'}
+
 34%|███▍      | 12960/37963 [29:18:38<58:51:50,  8.48s/it]
 34%|███▍      | 12961/37963 [29:18:48<62:33:37,  9.01s/it]
 34%|███▍      | 12962/37963 [29:18:56<59:55:50,  8.63s/it]
 34%|███▍      | 12963/37963 [29:19:06<63:14:01,  9.11s/it]
 34%|███▍      | 12964/37963 [29:19:14<60:24:29,  8.70s/it]
 34%|███▍      | 12965/37963 [29:19:21<58:06:03,  8.37s/it]
 34%|███▍      | 12966/37963 [29:19:29<56:57:27,  8.20s/it]
 34%|███▍      | 12967/37963 [29:19:37<56:26:35,  8.13s/it]
 34%|███▍      | 12968/37963 [29:19:45<55:16:16,  7.96s/it]
 34%|███▍      | 12969/37963 [29:19:52<54:31:04,  7.85s/it]
 34%|███▍      | 12970/37963 [29:20:00<54:40:10,  7.87s/it]
                                                           
{'loss': '0.1677', 'grad_norm': '1.993', 'learning_rate': '1.532e-05', 'epoch': '0.3416'}
+
 34%|███▍      | 12970/37963 [29:20:00<54:40:10,  7.87s/it]
 34%|███▍      | 12971/37963 [29:20:08<54:30:19,  7.85s/it]
 34%|███▍      | 12972/37963 [29:20:16<54:03:55,  7.79s/it]
 34%|███▍      | 12973/37963 [29:20:23<54:06:44,  7.80s/it]
 34%|███▍      | 12974/37963 [29:20:31<53:47:36,  7.75s/it]
 34%|███▍      | 12975/37963 [29:20:39<54:04:09,  7.79s/it]
 34%|███▍      | 12976/37963 [29:20:47<54:27:07,  7.85s/it]
 34%|███▍      | 12977/37963 [29:21:00<65:00:18,  9.37s/it]
 34%|███▍      | 12978/37963 [29:21:08<61:53:25,  8.92s/it]
 34%|███▍      | 12979/37963 [29:21:18<64:33:41,  9.30s/it]
 34%|███▍      | 12980/37963 [29:21:26<61:27:57,  8.86s/it]
                                                           
{'loss': '0.1598', 'grad_norm': '2.99', 'learning_rate': '1.532e-05', 'epoch': '0.3419'}
+
 34%|███▍      | 12980/37963 [29:21:26<61:27:57,  8.86s/it]
 34%|███▍      | 12981/37963 [29:21:33<59:13:33,  8.53s/it]
 34%|███▍      | 12982/37963 [29:21:41<57:52:49,  8.34s/it]
 34%|███▍      | 12983/37963 [29:21:49<56:34:17,  8.15s/it]
 34%|███▍      | 12984/37963 [29:21:59<61:10:01,  8.82s/it]
 34%|███▍      | 12985/37963 [29:22:07<59:11:08,  8.53s/it]
 34%|███▍      | 12986/37963 [29:22:15<58:00:10,  8.36s/it]
 34%|███▍      | 12987/37963 [29:22:23<56:31:31,  8.15s/it]
 34%|███▍      | 12988/37963 [29:22:31<55:37:25,  8.02s/it]
 34%|███▍      | 12989/37963 [29:22:38<54:39:19,  7.88s/it]
 34%|███▍      | 12990/37963 [29:22:46<54:15:18,  7.82s/it]
                                                           
{'loss': '0.148', 'grad_norm': '1.25', 'learning_rate': '1.531e-05', 'epoch': '0.3422'}
+
 34%|███▍      | 12990/37963 [29:22:46<54:15:18,  7.82s/it]
 34%|███▍      | 12991/37963 [29:22:54<54:07:53,  7.80s/it]
 34%|███▍      | 12992/37963 [29:23:01<53:48:23,  7.76s/it]
 34%|███▍      | 12993/37963 [29:23:09<53:30:41,  7.71s/it]
 34%|███▍      | 12994/37963 [29:23:16<53:13:26,  7.67s/it]
 34%|███▍      | 12995/37963 [29:23:24<53:13:27,  7.67s/it]
 34%|███▍      | 12996/37963 [29:23:32<53:02:46,  7.65s/it]
 34%|███▍      | 12997/37963 [29:23:39<53:01:41,  7.65s/it]
 34%|███▍      | 12998/37963 [29:23:47<53:28:37,  7.71s/it]
 34%|███▍      | 12999/37963 [29:23:55<53:22:31,  7.70s/it]
 34%|███▍      | 13000/37963 [29:24:06<59:43:00,  8.61s/it]
                                                           
{'loss': '0.1693', 'grad_norm': '2.691', 'learning_rate': '1.53e-05', 'epoch': '0.3424'}
+
 34%|███▍      | 13000/37963 [29:24:06<59:43:00,  8.61s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.10s/it]
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.10s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 34%|███▍      | 13001/37963 [29:25:11<177:45:05, 25.64s/it]
 34%|███▍      | 13002/37963 [29:25:19<140:45:19, 20.30s/it]
 34%|███▍      | 13003/37963 [29:25:27<114:36:14, 16.53s/it]
 34%|███▍      | 13004/37963 [29:25:34<96:10:42, 13.87s/it] 
 34%|███▍      | 13005/37963 [29:25:42<83:39:37, 12.07s/it]
 34%|███▍      | 13006/37963 [29:25:50<74:27:16, 10.74s/it]
 34%|███▍      | 13007/37963 [29:26:00<73:24:52, 10.59s/it]
 34%|███▍      | 13008/37963 [29:26:10<72:17:38, 10.43s/it]
 34%|███▍      | 13009/37963 [29:26:20<72:14:56, 10.42s/it]
 34%|███▍      | 13010/37963 [29:26:28<67:12:36,  9.70s/it]
                                                           
{'loss': '0.1599', 'grad_norm': '3.613', 'learning_rate': '1.53e-05', 'epoch': '0.3427'}
+
 34%|███▍      | 13010/37963 [29:26:28<67:12:36,  9.70s/it]
 34%|███▍      | 13011/37963 [29:26:36<62:32:17,  9.02s/it]
 34%|███▍      | 13012/37963 [29:26:43<58:57:24,  8.51s/it]
 34%|███▍      | 13013/37963 [29:26:51<56:49:53,  8.20s/it]
 34%|███▍      | 13014/37963 [29:26:58<55:57:20,  8.07s/it]
 34%|███▍      | 13015/37963 [29:27:06<55:26:13,  8.00s/it]
 34%|███▍      | 13016/37963 [29:27:14<54:39:19,  7.89s/it]
 34%|███▍      | 13017/37963 [29:27:22<54:10:25,  7.82s/it]
 34%|███▍      | 13018/37963 [29:27:32<59:39:48,  8.61s/it]
 34%|███▍      | 13019/37963 [29:27:40<57:58:41,  8.37s/it]
 34%|███▍      | 13020/37963 [29:27:48<57:16:15,  8.27s/it]
                                                           
{'loss': '0.1704', 'grad_norm': '1.995', 'learning_rate': '1.529e-05', 'epoch': '0.343'}
+
 34%|███▍      | 13020/37963 [29:27:48<57:16:15,  8.27s/it]
 34%|███▍      | 13021/37963 [29:27:56<56:17:30,  8.12s/it]
 34%|███▍      | 13022/37963 [29:28:03<55:34:33,  8.02s/it]
 34%|███▍      | 13023/37963 [29:28:11<54:56:22,  7.93s/it]
 34%|███▍      | 13024/37963 [29:28:19<54:15:02,  7.83s/it]
 34%|███▍      | 13025/37963 [29:28:26<53:54:40,  7.78s/it]
 34%|███▍      | 13026/37963 [29:28:34<52:54:16,  7.64s/it]
 34%|███▍      | 13027/37963 [29:28:44<58:01:27,  8.38s/it]
 34%|███▍      | 13028/37963 [29:28:51<56:35:34,  8.17s/it]
 34%|███▍      | 13029/37963 [29:29:04<66:28:11,  9.60s/it]
 34%|███▍      | 13030/37963 [29:29:12<62:46:38,  9.06s/it]
                                                           
{'loss': '0.1854', 'grad_norm': '2.534', 'learning_rate': '1.528e-05', 'epoch': '0.3432'}
+
 34%|███▍      | 13030/37963 [29:29:12<62:46:38,  9.06s/it]
 34%|███▍      | 13031/37963 [29:29:20<59:41:56,  8.62s/it]
 34%|███▍      | 13032/37963 [29:29:27<57:43:16,  8.33s/it]
 34%|███▍      | 13033/37963 [29:29:35<56:13:35,  8.12s/it]
 34%|███▍      | 13034/37963 [29:29:43<55:07:29,  7.96s/it]
 34%|███▍      | 13035/37963 [29:29:50<54:29:17,  7.87s/it]
 34%|███▍      | 13036/37963 [29:29:58<53:48:58,  7.77s/it]
 34%|███▍      | 13037/37963 [29:30:06<53:35:11,  7.74s/it]
 34%|███▍      | 13038/37963 [29:30:13<53:15:50,  7.69s/it]
 34%|███▍      | 13039/37963 [29:30:21<53:02:18,  7.66s/it]
 34%|███▍      | 13040/37963 [29:30:28<52:54:16,  7.64s/it]
                                                           
{'loss': '0.1576', 'grad_norm': '2.479', 'learning_rate': '1.527e-05', 'epoch': '0.3435'}
+
 34%|███▍      | 13040/37963 [29:30:28<52:54:16,  7.64s/it]
 34%|███▍      | 13041/37963 [29:30:36<53:03:37,  7.66s/it]
 34%|███▍      | 13042/37963 [29:30:44<53:02:36,  7.66s/it]
 34%|███▍      | 13043/37963 [29:30:51<52:48:30,  7.63s/it]
 34%|███▍      | 13044/37963 [29:30:59<52:49:04,  7.63s/it]
 34%|███▍      | 13045/37963 [29:31:07<53:15:57,  7.70s/it]
 34%|███▍      | 13046/37963 [29:31:14<53:13:02,  7.69s/it]
 34%|███▍      | 13047/37963 [29:31:22<53:29:02,  7.73s/it]
 34%|███▍      | 13048/37963 [29:31:30<53:57:48,  7.80s/it]
 34%|███▍      | 13049/37963 [29:31:38<53:47:20,  7.77s/it]
 34%|███▍      | 13050/37963 [29:31:48<59:09:48,  8.55s/it]
                                                           
{'loss': '0.1648', 'grad_norm': '5.331', 'learning_rate': '1.527e-05', 'epoch': '0.3438'}
+
 34%|███▍      | 13050/37963 [29:31:48<59:09:48,  8.55s/it]
 34%|███▍      | 13051/37963 [29:31:56<57:31:05,  8.31s/it]
 34%|███▍      | 13052/37963 [29:32:04<56:12:55,  8.12s/it]
 34%|███▍      | 13053/37963 [29:32:13<59:37:26,  8.62s/it]
 34%|███▍      | 13054/37963 [29:32:21<57:43:03,  8.34s/it]
 34%|███▍      | 13055/37963 [29:32:31<61:48:15,  8.93s/it]
 34%|███▍      | 13056/37963 [29:32:39<59:09:23,  8.55s/it]
 34%|███▍      | 13057/37963 [29:32:49<62:36:47,  9.05s/it]
 34%|███▍      | 13058/37963 [29:32:57<59:56:44,  8.67s/it]
 34%|███▍      | 13059/37963 [29:33:05<57:49:49,  8.36s/it]
 34%|███▍      | 13060/37963 [29:33:12<56:12:47,  8.13s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '3.056', 'learning_rate': '1.526e-05', 'epoch': '0.344'}
+
 34%|███▍      | 13060/37963 [29:33:12<56:12:47,  8.13s/it]
 34%|███▍      | 13061/37963 [29:33:20<55:28:29,  8.02s/it]
 34%|███▍      | 13062/37963 [29:33:28<54:45:27,  7.92s/it]
 34%|███▍      | 13063/37963 [29:33:36<54:55:07,  7.94s/it]
 34%|███▍      | 13064/37963 [29:33:44<54:46:48,  7.92s/it]
 34%|███▍      | 13065/37963 [29:33:51<54:12:41,  7.84s/it]
 34%|███▍      | 13066/37963 [29:33:59<54:10:22,  7.83s/it]
 34%|███▍      | 13067/37963 [29:34:07<53:56:19,  7.80s/it]
 34%|███▍      | 13068/37963 [29:34:14<53:35:29,  7.75s/it]
 34%|███▍      | 13069/37963 [29:34:22<53:48:23,  7.78s/it]
 34%|███▍      | 13070/37963 [29:34:30<53:28:57,  7.73s/it]
                                                           
{'loss': '0.166', 'grad_norm': '2.701', 'learning_rate': '1.525e-05', 'epoch': '0.3443'}
+
 34%|███▍      | 13070/37963 [29:34:30<53:28:57,  7.73s/it]
 34%|███▍      | 13071/37963 [29:34:38<53:34:48,  7.75s/it]
 34%|███▍      | 13072/37963 [29:34:48<58:57:46,  8.53s/it]
 34%|███▍      | 13073/37963 [29:34:58<62:40:55,  9.07s/it]
 34%|███▍      | 13074/37963 [29:35:06<59:59:06,  8.68s/it]
 34%|███▍      | 13075/37963 [29:35:14<58:29:54,  8.46s/it]
 34%|███▍      | 13076/37963 [29:35:25<62:51:41,  9.09s/it]
 34%|███▍      | 13077/37963 [29:35:33<60:38:23,  8.77s/it]
 34%|███▍      | 13078/37963 [29:35:40<58:05:18,  8.40s/it]
 34%|███▍      | 13079/37963 [29:35:48<56:40:06,  8.20s/it]
 34%|███▍      | 13080/37963 [29:35:55<54:58:18,  7.95s/it]
                                                           
{'loss': '0.1675', 'grad_norm': '2.946', 'learning_rate': '1.525e-05', 'epoch': '0.3445'}
+
 34%|███▍      | 13080/37963 [29:35:55<54:58:18,  7.95s/it]
 34%|███▍      | 13081/37963 [29:36:06<60:15:39,  8.72s/it]
 34%|███▍      | 13082/37963 [29:36:14<58:46:25,  8.50s/it]
 34%|███▍      | 13083/37963 [29:36:22<57:31:57,  8.32s/it]
 34%|███▍      | 13084/37963 [29:36:30<56:27:50,  8.17s/it]
 34%|███▍      | 13085/37963 [29:36:37<55:28:34,  8.03s/it]
 34%|███▍      | 13086/37963 [29:36:45<54:54:03,  7.94s/it]
 34%|███▍      | 13087/37963 [29:36:52<53:45:34,  7.78s/it]
 34%|███▍      | 13088/37963 [29:37:00<53:28:02,  7.74s/it]
 34%|███▍      | 13089/37963 [29:37:08<53:45:41,  7.78s/it]
 34%|███▍      | 13090/37963 [29:37:16<53:26:43,  7.74s/it]
                                                           
{'loss': '0.172', 'grad_norm': '1.031', 'learning_rate': '1.524e-05', 'epoch': '0.3448'}
+
 34%|███▍      | 13090/37963 [29:37:16<53:26:43,  7.74s/it]
 34%|███▍      | 13091/37963 [29:37:23<53:22:47,  7.73s/it]
 34%|███▍      | 13092/37963 [29:37:31<53:39:41,  7.77s/it]
 34%|███▍      | 13093/37963 [29:37:39<53:25:39,  7.73s/it]
 34%|███▍      | 13094/37963 [29:37:47<53:23:47,  7.73s/it]
 34%|███▍      | 13095/37963 [29:37:54<53:16:52,  7.71s/it]
 34%|███▍      | 13096/37963 [29:38:02<53:12:50,  7.70s/it]
 34%|███▍      | 13097/37963 [29:38:10<53:26:35,  7.74s/it]
 35%|███▍      | 13098/37963 [29:38:18<53:40:05,  7.77s/it]
 35%|███▍      | 13099/37963 [29:38:25<53:18:34,  7.72s/it]
 35%|███▍      | 13100/37963 [29:38:33<53:39:44,  7.77s/it]
                                                           
{'loss': '0.16', 'grad_norm': '1.087', 'learning_rate': '1.523e-05', 'epoch': '0.3451'}
+
 35%|███▍      | 13100/37963 [29:38:33<53:39:44,  7.77s/it]
 35%|███▍      | 13101/37963 [29:38:41<53:31:05,  7.75s/it]
 35%|███▍      | 13102/37963 [29:38:48<53:16:43,  7.72s/it]
 35%|███▍      | 13103/37963 [29:38:59<59:24:07,  8.60s/it]
 35%|███▍      | 13104/37963 [29:39:10<63:27:15,  9.19s/it]
 35%|███▍      | 13105/37963 [29:39:17<60:09:20,  8.71s/it]
 35%|███▍      | 13106/37963 [29:39:25<58:21:01,  8.45s/it]
 35%|███▍      | 13107/37963 [29:39:33<56:34:21,  8.19s/it]
 35%|███▍      | 13108/37963 [29:39:40<55:09:52,  7.99s/it]
 35%|███▍      | 13109/37963 [29:39:50<59:51:27,  8.67s/it]
 35%|███▍      | 13110/37963 [29:39:58<58:25:41,  8.46s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '3.027', 'learning_rate': '1.522e-05', 'epoch': '0.3453'}
+
 35%|███▍      | 13110/37963 [29:39:58<58:25:41,  8.46s/it]
 35%|███▍      | 13111/37963 [29:40:09<62:22:32,  9.04s/it]
 35%|███▍      | 13112/37963 [29:40:16<59:40:14,  8.64s/it]
 35%|███▍      | 13113/37963 [29:40:24<57:45:02,  8.37s/it]
 35%|███▍      | 13114/37963 [29:40:32<56:30:42,  8.19s/it]
 35%|███▍      | 13115/37963 [29:40:40<55:12:09,  8.00s/it]
 35%|███▍      | 13116/37963 [29:40:47<54:49:47,  7.94s/it]
 35%|███▍      | 13117/37963 [29:40:55<54:16:27,  7.86s/it]
 35%|███▍      | 13118/37963 [29:41:03<53:57:15,  7.82s/it]
 35%|███▍      | 13119/37963 [29:41:10<53:44:03,  7.79s/it]
 35%|███▍      | 13120/37963 [29:41:18<53:20:08,  7.73s/it]
                                                           
{'loss': '0.1597', 'grad_norm': '3.226', 'learning_rate': '1.522e-05', 'epoch': '0.3456'}
+
 35%|███▍      | 13120/37963 [29:41:18<53:20:08,  7.73s/it]
 35%|███▍      | 13121/37963 [29:41:31<64:21:01,  9.33s/it]
 35%|███▍      | 13122/37963 [29:41:39<60:47:58,  8.81s/it]
 35%|███▍      | 13123/37963 [29:41:47<58:49:23,  8.53s/it]
 35%|███▍      | 13124/37963 [29:41:54<57:05:08,  8.27s/it]
 35%|███▍      | 13125/37963 [29:42:02<56:33:29,  8.20s/it]
 35%|███▍      | 13126/37963 [29:42:10<55:19:21,  8.02s/it]
 35%|███▍      | 13127/37963 [29:42:17<54:26:14,  7.89s/it]
 35%|███▍      | 13128/37963 [29:42:25<54:26:07,  7.89s/it]
 35%|███▍      | 13129/37963 [29:42:36<59:19:13,  8.60s/it]
 35%|███▍      | 13130/37963 [29:42:46<63:01:16,  9.14s/it]
                                                           
{'loss': '0.1831', 'grad_norm': '2.733', 'learning_rate': '1.521e-05', 'epoch': '0.3459'}
+
 35%|███▍      | 13130/37963 [29:42:46<63:01:16,  9.14s/it]
 35%|███▍      | 13131/37963 [29:42:54<60:16:04,  8.74s/it]
 35%|███▍      | 13132/37963 [29:43:02<58:12:06,  8.44s/it]
 35%|███▍      | 13133/37963 [29:43:09<56:47:33,  8.23s/it]
 35%|███▍      | 13134/37963 [29:43:17<55:53:26,  8.10s/it]
 35%|███▍      | 13135/37963 [29:43:25<54:59:06,  7.97s/it]
 35%|███▍      | 13136/37963 [29:43:33<54:44:19,  7.94s/it]
 35%|███▍      | 13137/37963 [29:43:40<54:05:41,  7.84s/it]
 35%|███▍      | 13138/37963 [29:43:48<53:50:07,  7.81s/it]
 35%|███▍      | 13139/37963 [29:43:55<53:08:22,  7.71s/it]
 35%|███▍      | 13140/37963 [29:44:03<52:43:13,  7.65s/it]
                                                           
{'loss': '0.1526', 'grad_norm': '1.597', 'learning_rate': '1.52e-05', 'epoch': '0.3461'}
+
 35%|███▍      | 13140/37963 [29:44:03<52:43:13,  7.65s/it]
 35%|███▍      | 13141/37963 [29:44:11<53:01:36,  7.69s/it]
 35%|███▍      | 13142/37963 [29:44:19<53:25:52,  7.75s/it]
 35%|███▍      | 13143/37963 [29:44:26<53:03:44,  7.70s/it]
 35%|███▍      | 13144/37963 [29:44:33<52:04:47,  7.55s/it]
 35%|███▍      | 13145/37963 [29:44:41<52:17:52,  7.59s/it]
 35%|███▍      | 13146/37963 [29:44:49<52:38:53,  7.64s/it]
 35%|███▍      | 13147/37963 [29:44:56<52:29:47,  7.62s/it]
 35%|███▍      | 13148/37963 [29:45:04<52:39:37,  7.64s/it]
 35%|███▍      | 13149/37963 [29:45:12<53:00:35,  7.69s/it]
 35%|███▍      | 13150/37963 [29:45:19<52:47:07,  7.66s/it]
                                                           
{'loss': '0.1775', 'grad_norm': '3.155', 'learning_rate': '1.519e-05', 'epoch': '0.3464'}
+
 35%|███▍      | 13150/37963 [29:45:19<52:47:07,  7.66s/it]
 35%|███▍      | 13151/37963 [29:45:27<52:49:38,  7.66s/it]
 35%|███▍      | 13152/37963 [29:45:35<53:01:29,  7.69s/it]
 35%|███▍      | 13153/37963 [29:45:45<58:11:35,  8.44s/it]
 35%|███▍      | 13154/37963 [29:45:58<66:35:06,  9.66s/it]
 35%|███▍      | 13155/37963 [29:46:05<62:45:47,  9.11s/it]
 35%|███▍      | 13156/37963 [29:46:13<59:38:12,  8.65s/it]
 35%|███▍      | 13157/37963 [29:46:21<57:47:13,  8.39s/it]
 35%|███▍      | 13158/37963 [29:46:31<62:16:24,  9.04s/it]
 35%|███▍      | 13159/37963 [29:46:39<59:47:15,  8.68s/it]
 35%|███▍      | 13160/37963 [29:46:47<57:56:21,  8.41s/it]
                                                           
{'loss': '0.1634', 'grad_norm': '1.334', 'learning_rate': '1.519e-05', 'epoch': '0.3467'}
+
 35%|███▍      | 13160/37963 [29:46:47<57:56:21,  8.41s/it]
 35%|███▍      | 13161/37963 [29:46:54<56:03:06,  8.14s/it]
 35%|███▍      | 13162/37963 [29:47:02<54:49:35,  7.96s/it]
 35%|███▍      | 13163/37963 [29:47:10<54:18:23,  7.88s/it]
 35%|███▍      | 13164/37963 [29:47:17<53:43:20,  7.80s/it]
 35%|███▍      | 13165/37963 [29:47:25<52:56:12,  7.69s/it]
 35%|███▍      | 13166/37963 [29:47:32<52:53:28,  7.68s/it]
 35%|███▍      | 13167/37963 [29:47:40<52:49:56,  7.67s/it]
 35%|███▍      | 13168/37963 [29:47:47<52:10:37,  7.58s/it]
 35%|███▍      | 13169/37963 [29:47:58<57:42:32,  8.38s/it]
 35%|███▍      | 13170/37963 [29:48:05<56:29:33,  8.20s/it]
                                                           
{'loss': '0.152', 'grad_norm': '1.431', 'learning_rate': '1.518e-05', 'epoch': '0.3469'}
+
 35%|███▍      | 13170/37963 [29:48:05<56:29:33,  8.20s/it]
 35%|███▍      | 13171/37963 [29:48:13<55:23:50,  8.04s/it]
 35%|███▍      | 13172/37963 [29:48:21<54:38:00,  7.93s/it]
 35%|███▍      | 13173/37963 [29:48:31<59:31:39,  8.64s/it]
 35%|███▍      | 13174/37963 [29:48:39<57:23:06,  8.33s/it]
 35%|███▍      | 13175/37963 [29:48:49<61:16:27,  8.90s/it]
 35%|███▍      | 13176/37963 [29:48:57<58:53:30,  8.55s/it]
 35%|███▍      | 13177/37963 [29:49:04<56:52:05,  8.26s/it]
 35%|███▍      | 13178/37963 [29:49:12<55:31:44,  8.07s/it]
 35%|███▍      | 13179/37963 [29:49:19<54:28:11,  7.91s/it]
 35%|███▍      | 13180/37963 [29:49:27<54:00:31,  7.85s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '3.075', 'learning_rate': '1.517e-05', 'epoch': '0.3472'}
+
 35%|███▍      | 13180/37963 [29:49:27<54:00:31,  7.85s/it]
 35%|███▍      | 13181/37963 [29:49:35<54:03:20,  7.85s/it]
 35%|███▍      | 13182/37963 [29:49:43<53:43:22,  7.80s/it]
 35%|███▍      | 13183/37963 [29:49:50<53:29:17,  7.77s/it]
 35%|███▍      | 13184/37963 [29:50:01<58:41:56,  8.53s/it]
 35%|███▍      | 13185/37963 [29:50:09<57:15:35,  8.32s/it]
 35%|███▍      | 13186/37963 [29:50:16<55:15:14,  8.03s/it]
 35%|███▍      | 13187/37963 [29:50:24<54:37:28,  7.94s/it]
 35%|███▍      | 13188/37963 [29:50:31<54:14:43,  7.88s/it]
 35%|███▍      | 13189/37963 [29:50:39<54:07:23,  7.86s/it]
 35%|███▍      | 13190/37963 [29:50:47<53:44:33,  7.81s/it]
                                                           
{'loss': '0.1681', 'grad_norm': '3.987', 'learning_rate': '1.517e-05', 'epoch': '0.3474'}
+
 35%|███▍      | 13190/37963 [29:50:47<53:44:33,  7.81s/it]
 35%|███▍      | 13191/37963 [29:50:55<53:38:40,  7.80s/it]
 35%|███▍      | 13192/37963 [29:51:02<53:30:08,  7.78s/it]
 35%|███▍      | 13193/37963 [29:51:10<52:54:31,  7.69s/it]
 35%|███▍      | 13194/37963 [29:51:17<52:15:53,  7.60s/it]
 35%|███▍      | 13195/37963 [29:51:25<52:21:04,  7.61s/it]
 35%|███▍      | 13196/37963 [29:51:33<52:32:36,  7.64s/it]
 35%|███▍      | 13197/37963 [29:51:43<57:54:22,  8.42s/it]
 35%|███▍      | 13198/37963 [29:51:50<55:34:06,  8.08s/it]
 35%|███▍      | 13199/37963 [29:51:58<54:42:04,  7.95s/it]
 35%|███▍      | 13200/37963 [29:52:05<54:09:05,  7.87s/it]
                                                           
{'loss': '0.177', 'grad_norm': '3.07', 'learning_rate': '1.516e-05', 'epoch': '0.3477'}
+
 35%|███▍      | 13200/37963 [29:52:05<54:09:05,  7.87s/it]
 35%|███▍      | 13201/37963 [29:52:16<59:11:45,  8.61s/it]
 35%|███▍      | 13202/37963 [29:52:23<57:21:12,  8.34s/it]
 35%|███▍      | 13203/37963 [29:52:31<55:53:47,  8.13s/it]
 35%|███▍      | 13204/37963 [29:52:39<54:32:39,  7.93s/it]
 35%|███▍      | 13205/37963 [29:52:46<53:24:44,  7.77s/it]
 35%|███▍      | 13206/37963 [29:52:53<52:25:35,  7.62s/it]
 35%|███▍      | 13207/37963 [29:53:01<52:27:03,  7.63s/it]
 35%|███▍      | 13208/37963 [29:53:11<57:46:44,  8.40s/it]
 35%|███▍      | 13209/37963 [29:53:19<56:13:48,  8.18s/it]
 35%|███▍      | 13210/37963 [29:53:27<55:42:03,  8.10s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '2.251', 'learning_rate': '1.515e-05', 'epoch': '0.348'}
+
 35%|███▍      | 13210/37963 [29:53:27<55:42:03,  8.10s/it]
 35%|███▍      | 13211/37963 [29:53:34<54:47:27,  7.97s/it]
 35%|███▍      | 13212/37963 [29:53:45<59:38:30,  8.67s/it]
 35%|███▍      | 13213/37963 [29:53:52<57:42:04,  8.39s/it]
 35%|███▍      | 13214/37963 [29:54:00<56:41:57,  8.25s/it]
 35%|███▍      | 13215/37963 [29:54:08<55:27:25,  8.07s/it]
 35%|███▍      | 13216/37963 [29:54:18<60:09:38,  8.75s/it]
 35%|███▍      | 13217/37963 [29:54:28<62:27:24,  9.09s/it]
 35%|███▍      | 13218/37963 [29:54:36<59:59:13,  8.73s/it]
 35%|███▍      | 13219/37963 [29:54:44<57:57:06,  8.43s/it]
 35%|███▍      | 13220/37963 [29:54:51<56:01:47,  8.15s/it]
                                                           
{'loss': '0.1596', 'grad_norm': '1.936', 'learning_rate': '1.514e-05', 'epoch': '0.3482'}
+
 35%|███▍      | 13220/37963 [29:54:51<56:01:47,  8.15s/it]
 35%|███▍      | 13221/37963 [29:54:59<55:05:17,  8.02s/it]
 35%|███▍      | 13222/37963 [29:55:07<54:24:09,  7.92s/it]
 35%|███▍      | 13223/37963 [29:55:17<59:27:39,  8.65s/it]
 35%|███▍      | 13224/37963 [29:55:25<58:09:45,  8.46s/it]
 35%|███▍      | 13225/37963 [29:55:33<56:27:55,  8.22s/it]
 35%|███▍      | 13226/37963 [29:55:40<55:35:00,  8.09s/it]
 35%|███▍      | 13227/37963 [29:55:48<54:35:41,  7.95s/it]
 35%|███▍      | 13228/37963 [29:55:56<53:58:44,  7.86s/it]
 35%|███▍      | 13229/37963 [29:56:03<53:44:17,  7.82s/it]
 35%|███▍      | 13230/37963 [29:56:11<53:39:47,  7.81s/it]
                                                           
{'loss': '0.1721', 'grad_norm': '2.547', 'learning_rate': '1.514e-05', 'epoch': '0.3485'}
+
 35%|███▍      | 13230/37963 [29:56:11<53:39:47,  7.81s/it]
 35%|███▍      | 13231/37963 [29:56:21<57:55:10,  8.43s/it]
 35%|███▍      | 13232/37963 [29:56:29<56:59:48,  8.30s/it]
 35%|███▍      | 13233/37963 [29:56:37<55:21:37,  8.06s/it]
 35%|███▍      | 13234/37963 [29:56:44<54:29:55,  7.93s/it]
 35%|███▍      | 13235/37963 [29:56:52<54:25:37,  7.92s/it]
 35%|███▍      | 13236/37963 [29:57:00<53:48:36,  7.83s/it]
 35%|███▍      | 13237/37963 [29:57:07<53:11:58,  7.75s/it]
 35%|███▍      | 13238/37963 [29:57:15<52:19:20,  7.62s/it]
 35%|███▍      | 13239/37963 [29:57:22<52:40:15,  7.67s/it]
 35%|███▍      | 13240/37963 [29:57:30<53:10:57,  7.74s/it]
                                                           
{'loss': '0.1516', 'grad_norm': '1.321', 'learning_rate': '1.513e-05', 'epoch': '0.3488'}
+
 35%|███▍      | 13240/37963 [29:57:30<53:10:57,  7.74s/it]
 35%|███▍      | 13241/37963 [29:57:38<53:38:29,  7.81s/it]
 35%|███▍      | 13242/37963 [29:57:46<53:03:20,  7.73s/it]
 35%|███▍      | 13243/37963 [29:57:54<53:59:30,  7.86s/it]
 35%|███▍      | 13244/37963 [29:58:02<53:40:23,  7.82s/it]
 35%|███▍      | 13245/37963 [29:58:09<53:23:58,  7.78s/it]
 35%|███▍      | 13246/37963 [29:58:20<58:30:41,  8.52s/it]
 35%|███▍      | 13247/37963 [29:58:27<56:54:52,  8.29s/it]
 35%|███▍      | 13248/37963 [29:58:35<55:57:36,  8.15s/it]
 35%|███▍      | 13249/37963 [29:58:43<55:03:15,  8.02s/it]
 35%|███▍      | 13250/37963 [29:58:51<54:51:26,  7.99s/it]
                                                           
{'loss': '0.1671', 'grad_norm': '1.883', 'learning_rate': '1.512e-05', 'epoch': '0.349'}
+
 35%|███▍      | 13250/37963 [29:58:51<54:51:26,  7.99s/it]
 35%|███▍      | 13251/37963 [29:59:01<59:10:13,  8.62s/it]
 35%|███▍      | 13252/37963 [29:59:09<57:24:06,  8.36s/it]
 35%|███▍      | 13253/37963 [29:59:16<56:07:49,  8.18s/it]
 35%|███▍      | 13254/37963 [29:59:24<54:57:44,  8.01s/it]
 35%|███▍      | 13255/37963 [29:59:32<54:16:15,  7.91s/it]
 35%|███▍      | 13256/37963 [29:59:39<53:13:31,  7.76s/it]
 35%|███▍      | 13257/37963 [29:59:47<53:32:10,  7.80s/it]
 35%|███▍      | 13258/37963 [29:59:55<52:51:52,  7.70s/it]
 35%|███▍      | 13259/37963 [30:00:02<52:44:12,  7.69s/it]
 35%|███▍      | 13260/37963 [30:00:13<58:18:33,  8.50s/it]
                                                           
{'loss': '0.1699', 'grad_norm': '3.036', 'learning_rate': '1.511e-05', 'epoch': '0.3493'}
+
 35%|███▍      | 13260/37963 [30:00:13<58:18:33,  8.50s/it]
 35%|███▍      | 13261/37963 [30:00:20<56:46:40,  8.27s/it]
 35%|███▍      | 13262/37963 [30:00:31<60:58:38,  8.89s/it]
 35%|███▍      | 13263/37963 [30:00:39<59:13:28,  8.63s/it]
 35%|███▍      | 13264/37963 [30:00:46<57:27:18,  8.37s/it]
 35%|███▍      | 13265/37963 [30:00:57<61:17:35,  8.93s/it]
 35%|███▍      | 13266/37963 [30:01:07<64:22:34,  9.38s/it]
 35%|███▍      | 13267/37963 [30:01:15<60:39:17,  8.84s/it]
 35%|███▍      | 13268/37963 [30:01:23<58:34:44,  8.54s/it]
 35%|███▍      | 13269/37963 [30:01:30<56:37:36,  8.26s/it]
 35%|███▍      | 13270/37963 [30:01:38<56:00:38,  8.17s/it]
                                                           
{'loss': '0.1654', 'grad_norm': '1.7', 'learning_rate': '1.511e-05', 'epoch': '0.3496'}
+
 35%|███▍      | 13270/37963 [30:01:38<56:00:38,  8.17s/it]
 35%|███▍      | 13271/37963 [30:01:46<54:57:28,  8.01s/it]
 35%|███▍      | 13272/37963 [30:01:56<59:23:25,  8.66s/it]
 35%|███▍      | 13273/37963 [30:02:04<57:50:21,  8.43s/it]
 35%|███▍      | 13274/37963 [30:02:12<56:15:05,  8.20s/it]
 35%|███▍      | 13275/37963 [30:02:19<55:46:57,  8.13s/it]
 35%|███▍      | 13276/37963 [30:02:27<54:30:24,  7.95s/it]
 35%|███▍      | 13277/37963 [30:02:35<54:02:43,  7.88s/it]
 35%|███▍      | 13278/37963 [30:02:42<53:27:53,  7.80s/it]
 35%|███▍      | 13279/37963 [30:02:50<53:37:56,  7.82s/it]
 35%|███▍      | 13280/37963 [30:03:01<59:07:13,  8.62s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '1.59', 'learning_rate': '1.51e-05', 'epoch': '0.3498'}
+
 35%|███▍      | 13280/37963 [30:03:01<59:07:13,  8.62s/it]
 35%|███▍      | 13281/37963 [30:03:08<57:13:23,  8.35s/it]
 35%|███▍      | 13282/37963 [30:03:16<55:55:13,  8.16s/it]
 35%|███▍      | 13283/37963 [30:03:24<54:50:20,  8.00s/it]
 35%|███▍      | 13284/37963 [30:03:31<54:07:15,  7.89s/it]
 35%|███▍      | 13285/37963 [30:03:39<53:31:23,  7.81s/it]
 35%|███▍      | 13286/37963 [30:03:47<53:02:52,  7.74s/it]
 35%|███▍      | 13287/37963 [30:03:54<52:18:58,  7.63s/it]
 35%|███▌      | 13288/37963 [30:04:02<52:33:08,  7.67s/it]
 35%|███▌      | 13289/37963 [30:04:09<52:20:23,  7.64s/it]
 35%|███▌      | 13290/37963 [30:04:17<52:16:58,  7.63s/it]
                                                           
{'loss': '0.1957', 'grad_norm': '4.09', 'learning_rate': '1.509e-05', 'epoch': '0.3501'}
+
 35%|███▌      | 13290/37963 [30:04:17<52:16:58,  7.63s/it]
 35%|███▌      | 13291/37963 [30:04:25<52:23:30,  7.64s/it]
 35%|███▌      | 13292/37963 [30:04:32<52:14:28,  7.62s/it]
 35%|███▌      | 13293/37963 [30:04:40<52:33:45,  7.67s/it]
 35%|███▌      | 13294/37963 [30:04:48<52:46:06,  7.70s/it]
 35%|███▌      | 13295/37963 [30:04:56<53:03:16,  7.74s/it]
 35%|███▌      | 13296/37963 [30:05:03<52:30:21,  7.66s/it]
 35%|███▌      | 13297/37963 [30:05:11<52:31:34,  7.67s/it]
 35%|███▌      | 13298/37963 [30:05:18<52:43:21,  7.70s/it]
 35%|███▌      | 13299/37963 [30:05:29<58:34:12,  8.55s/it]
 35%|███▌      | 13300/37963 [30:05:37<56:54:08,  8.31s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '4.454', 'learning_rate': '1.508e-05', 'epoch': '0.3503'}
+
 35%|███▌      | 13300/37963 [30:05:37<56:54:08,  8.31s/it]
 35%|███▌      | 13301/37963 [30:05:44<55:11:28,  8.06s/it]
 35%|███▌      | 13302/37963 [30:05:55<59:57:16,  8.75s/it]
 35%|███▌      | 13303/37963 [30:06:02<58:11:02,  8.49s/it]
 35%|███▌      | 13304/37963 [30:06:13<61:49:53,  9.03s/it]
 35%|███▌      | 13305/37963 [30:06:20<59:13:10,  8.65s/it]
 35%|███▌      | 13306/37963 [30:06:28<57:19:53,  8.37s/it]
 35%|███▌      | 13307/37963 [30:06:36<55:13:32,  8.06s/it]
 35%|███▌      | 13308/37963 [30:06:43<54:55:25,  8.02s/it]
 35%|███▌      | 13309/37963 [30:06:51<54:08:39,  7.91s/it]
 35%|███▌      | 13310/37963 [30:07:02<59:46:01,  8.73s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '1.929', 'learning_rate': '1.508e-05', 'epoch': '0.3506'}
+
 35%|███▌      | 13310/37963 [30:07:02<59:46:01,  8.73s/it]
 35%|███▌      | 13311/37963 [30:07:12<63:06:01,  9.21s/it]
 35%|███▌      | 13312/37963 [30:07:20<60:09:36,  8.79s/it]
 35%|███▌      | 13313/37963 [30:07:28<58:05:30,  8.48s/it]
 35%|███▌      | 13314/37963 [30:07:38<61:18:55,  8.96s/it]
 35%|███▌      | 13315/37963 [30:07:45<58:43:07,  8.58s/it]
 35%|███▌      | 13316/37963 [30:07:53<56:55:59,  8.32s/it]
 35%|███▌      | 13317/37963 [30:08:01<55:37:53,  8.13s/it]
 35%|███▌      | 13318/37963 [30:08:08<54:21:44,  7.94s/it]
 35%|███▌      | 13319/37963 [30:08:16<53:12:26,  7.77s/it]
 35%|███▌      | 13320/37963 [30:08:26<58:49:46,  8.59s/it]
                                                           
{'loss': '0.1596', 'grad_norm': '0.9499', 'learning_rate': '1.507e-05', 'epoch': '0.3509'}
+
 35%|███▌      | 13320/37963 [30:08:26<58:49:46,  8.59s/it]
 35%|███▌      | 13321/37963 [30:08:34<56:57:23,  8.32s/it]
 35%|███▌      | 13322/37963 [30:08:42<55:44:35,  8.14s/it]
 35%|███▌      | 13323/37963 [30:08:49<53:56:39,  7.88s/it]
 35%|███▌      | 13324/37963 [30:08:59<59:02:12,  8.63s/it]
 35%|███▌      | 13325/37963 [30:09:07<57:09:21,  8.35s/it]
 35%|███▌      | 13326/37963 [30:09:15<55:52:46,  8.17s/it]
 35%|███▌      | 13327/37963 [30:09:22<54:44:10,  8.00s/it]
 35%|███▌      | 13328/37963 [30:09:30<54:19:05,  7.94s/it]
 35%|███▌      | 13329/37963 [30:09:38<54:11:13,  7.92s/it]
 35%|███▌      | 13330/37963 [30:09:45<53:19:14,  7.79s/it]
                                                           
{'loss': '0.1868', 'grad_norm': '2.542', 'learning_rate': '1.506e-05', 'epoch': '0.3511'}
+
 35%|███▌      | 13330/37963 [30:09:45<53:19:14,  7.79s/it]
 35%|███▌      | 13331/37963 [30:09:53<53:20:53,  7.80s/it]
 35%|███▌      | 13332/37963 [30:10:01<53:21:31,  7.80s/it]
 35%|███▌      | 13333/37963 [30:10:09<52:35:12,  7.69s/it]
 35%|███▌      | 13334/37963 [30:10:16<52:21:59,  7.65s/it]
 35%|███▌      | 13335/37963 [30:10:24<52:15:27,  7.64s/it]
 35%|███▌      | 13336/37963 [30:10:32<52:39:11,  7.70s/it]
 35%|███▌      | 13337/37963 [30:10:39<52:36:40,  7.69s/it]
 35%|███▌      | 13338/37963 [30:10:47<51:48:51,  7.57s/it]
 35%|███▌      | 13339/37963 [30:10:54<52:34:49,  7.69s/it]
 35%|███▌      | 13340/37963 [30:11:02<52:25:43,  7.67s/it]
                                                           
{'loss': '0.1565', 'grad_norm': '2.615', 'learning_rate': '1.506e-05', 'epoch': '0.3514'}
+
 35%|███▌      | 13340/37963 [30:11:02<52:25:43,  7.67s/it]
 35%|███▌      | 13341/37963 [30:11:10<52:45:59,  7.72s/it]
 35%|███▌      | 13342/37963 [30:11:17<52:21:38,  7.66s/it]
 35%|███▌      | 13343/37963 [30:11:25<52:33:11,  7.68s/it]
 35%|███▌      | 13344/37963 [30:11:33<52:32:28,  7.68s/it]
 35%|███▌      | 13345/37963 [30:11:41<52:34:44,  7.69s/it]
 35%|███▌      | 13346/37963 [30:11:51<57:33:02,  8.42s/it]
 35%|███▌      | 13347/37963 [30:11:59<56:33:18,  8.27s/it]
 35%|███▌      | 13348/37963 [30:12:06<54:39:13,  7.99s/it]
 35%|███▌      | 13349/37963 [30:12:14<54:19:45,  7.95s/it]
 35%|███▌      | 13350/37963 [30:12:21<53:41:14,  7.85s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '3.087', 'learning_rate': '1.505e-05', 'epoch': '0.3517'}
+
 35%|███▌      | 13350/37963 [30:12:21<53:41:14,  7.85s/it]
 35%|███▌      | 13351/37963 [30:12:29<53:19:06,  7.80s/it]
 35%|███▌      | 13352/37963 [30:12:40<58:46:45,  8.60s/it]
 35%|███▌      | 13353/37963 [30:12:47<56:19:12,  8.24s/it]
 35%|███▌      | 13354/37963 [30:12:57<60:51:56,  8.90s/it]
 35%|███▌      | 13355/37963 [30:13:05<58:00:03,  8.49s/it]
 35%|███▌      | 13356/37963 [30:13:13<56:38:21,  8.29s/it]
 35%|███▌      | 13357/37963 [30:13:20<55:23:34,  8.10s/it]
 35%|███▌      | 13358/37963 [30:13:30<59:13:09,  8.66s/it]
 35%|███▌      | 13359/37963 [30:13:38<57:49:45,  8.46s/it]
 35%|███▌      | 13360/37963 [30:13:46<56:52:32,  8.32s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '1.859', 'learning_rate': '1.504e-05', 'epoch': '0.3519'}
+
 35%|███▌      | 13360/37963 [30:13:46<56:52:32,  8.32s/it]
 35%|███▌      | 13361/37963 [30:13:54<55:30:57,  8.12s/it]
 35%|███▌      | 13362/37963 [30:14:04<59:40:15,  8.73s/it]
 35%|███▌      | 13363/37963 [30:14:14<62:49:27,  9.19s/it]
 35%|███▌      | 13364/37963 [30:14:22<59:52:20,  8.76s/it]
 35%|███▌      | 13365/37963 [30:14:30<57:48:13,  8.46s/it]
 35%|███▌      | 13366/37963 [30:14:38<56:00:57,  8.20s/it]
 35%|███▌      | 13367/37963 [30:14:48<60:25:08,  8.84s/it]
 35%|███▌      | 13368/37963 [30:14:55<57:46:06,  8.46s/it]
 35%|███▌      | 13369/37963 [30:15:03<56:26:24,  8.26s/it]
 35%|███▌      | 13370/37963 [30:15:11<54:55:01,  8.04s/it]
                                                           
{'loss': '0.1661', 'grad_norm': '3.177', 'learning_rate': '1.503e-05', 'epoch': '0.3522'}
+
 35%|███▌      | 13370/37963 [30:15:11<54:55:01,  8.04s/it]
 35%|███▌      | 13371/37963 [30:15:19<54:35:33,  7.99s/it]
 35%|███▌      | 13372/37963 [30:15:26<53:53:06,  7.89s/it]
 35%|███▌      | 13373/37963 [30:15:34<53:42:26,  7.86s/it]
 35%|███▌      | 13374/37963 [30:15:42<53:43:29,  7.87s/it]
 35%|███▌      | 13375/37963 [30:15:50<53:27:38,  7.83s/it]
 35%|███▌      | 13376/37963 [30:15:57<53:10:06,  7.78s/it]
 35%|███▌      | 13377/37963 [30:16:05<53:13:39,  7.79s/it]
 35%|███▌      | 13378/37963 [30:16:13<52:44:54,  7.72s/it]
 35%|███▌      | 13379/37963 [30:16:20<52:28:18,  7.68s/it]
 35%|███▌      | 13380/37963 [30:16:28<52:22:35,  7.67s/it]
                                                           
{'loss': '0.1838', 'grad_norm': '1.441', 'learning_rate': '1.503e-05', 'epoch': '0.3524'}
+
 35%|███▌      | 13380/37963 [30:16:28<52:22:35,  7.67s/it]
 35%|███▌      | 13381/37963 [30:16:36<52:25:03,  7.68s/it]
 35%|███▌      | 13382/37963 [30:16:44<52:39:08,  7.71s/it]
 35%|███▌      | 13383/37963 [30:16:52<53:13:40,  7.80s/it]
 35%|███▌      | 13384/37963 [30:16:59<53:19:04,  7.81s/it]
 35%|███▌      | 13385/37963 [30:17:07<53:15:28,  7.80s/it]
 35%|███▌      | 13386/37963 [30:17:15<52:40:01,  7.71s/it]
 35%|███▌      | 13387/37963 [30:17:22<52:53:38,  7.75s/it]
 35%|███▌      | 13388/37963 [30:17:30<52:50:51,  7.74s/it]
 35%|███▌      | 13389/37963 [30:17:38<52:56:31,  7.76s/it]
 35%|███▌      | 13390/37963 [30:17:46<52:56:34,  7.76s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '3.573', 'learning_rate': '1.502e-05', 'epoch': '0.3527'}
+
 35%|███▌      | 13390/37963 [30:17:46<52:56:34,  7.76s/it]
 35%|███▌      | 13391/37963 [30:17:53<52:11:38,  7.65s/it]
 35%|███▌      | 13392/37963 [30:18:01<52:20:45,  7.67s/it]
 35%|███▌      | 13393/37963 [30:18:09<52:49:03,  7.74s/it]
 35%|███▌      | 13394/37963 [30:18:17<53:01:23,  7.77s/it]
 35%|███▌      | 13395/37963 [30:18:27<58:19:08,  8.55s/it]
 35%|███▌      | 13396/37963 [30:18:35<56:20:18,  8.26s/it]
 35%|███▌      | 13397/37963 [30:18:42<55:05:41,  8.07s/it]
 35%|███▌      | 13398/37963 [30:18:53<60:04:20,  8.80s/it]
 35%|███▌      | 13399/37963 [30:19:01<58:04:02,  8.51s/it]
 35%|███▌      | 13400/37963 [30:19:11<61:59:14,  9.08s/it]
                                                           
{'loss': '0.17', 'grad_norm': '2.372', 'learning_rate': '1.501e-05', 'epoch': '0.353'}
+
 35%|███▌      | 13400/37963 [30:19:11<61:59:14,  9.08s/it]
 35%|███▌      | 13401/37963 [30:19:19<59:00:01,  8.65s/it]
 35%|███▌      | 13402/37963 [30:19:26<56:59:37,  8.35s/it]
 35%|███▌      | 13403/37963 [30:19:34<55:45:34,  8.17s/it]
 35%|███▌      | 13404/37963 [30:19:42<55:24:33,  8.12s/it]
 35%|███▌      | 13405/37963 [30:19:50<54:33:12,  8.00s/it]
 35%|███▌      | 13406/37963 [30:20:03<64:37:26,  9.47s/it]
 35%|███▌      | 13407/37963 [30:20:11<61:25:08,  9.00s/it]
 35%|███▌      | 13408/37963 [30:20:21<63:28:21,  9.31s/it]
 35%|███▌      | 13409/37963 [30:20:28<60:10:01,  8.82s/it]
 35%|███▌      | 13410/37963 [30:20:36<57:51:08,  8.48s/it]
                                                           
{'loss': '0.169', 'grad_norm': '5.286', 'learning_rate': '1.5e-05', 'epoch': '0.3532'}
+
 35%|███▌      | 13410/37963 [30:20:36<57:51:08,  8.48s/it]
 35%|███▌      | 13411/37963 [30:20:46<61:20:30,  8.99s/it]
 35%|███▌      | 13412/37963 [30:20:54<58:54:11,  8.64s/it]
 35%|███▌      | 13413/37963 [30:21:02<57:23:27,  8.42s/it]
 35%|███▌      | 13414/37963 [30:21:09<55:45:32,  8.18s/it]
 35%|███▌      | 13415/37963 [30:21:17<54:23:07,  7.98s/it]
 35%|███▌      | 13416/37963 [30:21:25<53:50:31,  7.90s/it]
 35%|███▌      | 13417/37963 [30:21:35<58:38:44,  8.60s/it]
 35%|███▌      | 13418/37963 [30:21:43<57:08:11,  8.38s/it]
 35%|███▌      | 13419/37963 [30:21:50<55:46:45,  8.18s/it]
 35%|███▌      | 13420/37963 [30:21:58<54:39:30,  8.02s/it]
                                                           
{'loss': '0.1739', 'grad_norm': '4.882', 'learning_rate': '1.5e-05', 'epoch': '0.3535'}
+
 35%|███▌      | 13420/37963 [30:21:58<54:39:30,  8.02s/it]
 35%|███▌      | 13421/37963 [30:22:06<53:48:00,  7.89s/it]
 35%|███▌      | 13422/37963 [30:22:13<52:37:52,  7.72s/it]
 35%|███▌      | 13423/37963 [30:22:20<52:00:03,  7.63s/it]
 35%|███▌      | 13424/37963 [30:22:28<51:55:43,  7.62s/it]
 35%|███▌      | 13425/37963 [30:22:36<52:02:10,  7.63s/it]
 35%|███▌      | 13426/37963 [30:22:43<52:01:18,  7.63s/it]
 35%|███▌      | 13427/37963 [30:22:51<52:34:47,  7.71s/it]
 35%|███▌      | 13428/37963 [30:22:59<51:49:39,  7.60s/it]
 35%|███▌      | 13429/37963 [30:23:06<51:10:21,  7.51s/it]
 35%|███▌      | 13430/37963 [30:23:14<51:34:25,  7.57s/it]
                                                           
{'loss': '0.1595', 'grad_norm': '1.121', 'learning_rate': '1.499e-05', 'epoch': '0.3538'}
+
 35%|███▌      | 13430/37963 [30:23:14<51:34:25,  7.57s/it]
 35%|███▌      | 13431/37963 [30:23:21<51:29:08,  7.56s/it]
 35%|███▌      | 13432/37963 [30:23:29<51:33:55,  7.57s/it]
 35%|███▌      | 13433/37963 [30:23:36<51:22:43,  7.54s/it]
 35%|███▌      | 13434/37963 [30:23:44<51:48:03,  7.60s/it]
 35%|███▌      | 13435/37963 [30:23:51<51:28:13,  7.55s/it]
 35%|███▌      | 13436/37963 [30:23:59<52:01:05,  7.64s/it]
 35%|███▌      | 13437/37963 [30:24:07<51:59:47,  7.63s/it]
 35%|███▌      | 13438/37963 [30:24:15<52:17:05,  7.67s/it]
 35%|███▌      | 13439/37963 [30:24:25<57:54:33,  8.50s/it]
 35%|███▌      | 13440/37963 [30:24:33<56:31:20,  8.30s/it]
                                                           
{'loss': '0.1574', 'grad_norm': '4.607', 'learning_rate': '1.498e-05', 'epoch': '0.354'}
+
 35%|███▌      | 13440/37963 [30:24:33<56:31:20,  8.30s/it]
 35%|███▌      | 13441/37963 [30:24:43<60:12:45,  8.84s/it]
 35%|███▌      | 13442/37963 [30:24:50<57:18:33,  8.41s/it]
 35%|███▌      | 13443/37963 [30:24:58<56:31:07,  8.30s/it]
 35%|███▌      | 13444/37963 [30:25:06<55:01:46,  8.08s/it]
 35%|███▌      | 13445/37963 [30:25:14<54:12:59,  7.96s/it]
 35%|███▌      | 13446/37963 [30:25:24<58:55:37,  8.65s/it]
 35%|███▌      | 13447/37963 [30:25:32<56:57:38,  8.36s/it]
 35%|███▌      | 13448/37963 [30:25:39<55:35:39,  8.16s/it]
 35%|███▌      | 13449/37963 [30:25:47<54:41:13,  8.03s/it]
 35%|███▌      | 13450/37963 [30:25:57<59:12:58,  8.70s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '3.758', 'learning_rate': '1.497e-05', 'epoch': '0.3543'}
+
 35%|███▌      | 13450/37963 [30:25:57<59:12:58,  8.70s/it]
 35%|███▌      | 13451/37963 [30:26:05<57:23:06,  8.43s/it]
 35%|███▌      | 13452/37963 [30:26:13<56:30:02,  8.30s/it]
 35%|███▌      | 13453/37963 [30:26:21<55:01:50,  8.08s/it]
 35%|███▌      | 13454/37963 [30:26:33<64:18:50,  9.45s/it]
 35%|███▌      | 13455/37963 [30:26:41<60:39:21,  8.91s/it]
 35%|███▌      | 13456/37963 [30:26:49<58:33:29,  8.60s/it]
 35%|███▌      | 13457/37963 [30:26:59<62:06:07,  9.12s/it]
 35%|███▌      | 13458/37963 [30:27:07<59:45:56,  8.78s/it]
 35%|███▌      | 13459/37963 [30:27:15<57:07:30,  8.39s/it]
 35%|███▌      | 13460/37963 [30:27:22<55:17:07,  8.12s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '3.264', 'learning_rate': '1.497e-05', 'epoch': '0.3546'}
+
 35%|███▌      | 13460/37963 [30:27:22<55:17:07,  8.12s/it]
 35%|███▌      | 13461/37963 [30:27:30<54:17:25,  7.98s/it]
 35%|███▌      | 13462/37963 [30:27:37<53:31:05,  7.86s/it]
 35%|███▌      | 13463/37963 [30:27:45<53:52:37,  7.92s/it]
 35%|███▌      | 13464/37963 [30:27:53<53:43:01,  7.89s/it]
 35%|███▌      | 13465/37963 [30:28:01<53:51:10,  7.91s/it]
 35%|███▌      | 13466/37963 [30:28:12<59:19:32,  8.72s/it]
 35%|███▌      | 13467/37963 [30:28:20<57:20:38,  8.43s/it]
 35%|███▌      | 13468/37963 [30:28:27<55:34:34,  8.17s/it]
 35%|███▌      | 13469/37963 [30:28:35<55:19:04,  8.13s/it]
 35%|███▌      | 13470/37963 [30:28:43<54:56:14,  8.07s/it]
                                                           
{'loss': '0.1679', 'grad_norm': '4.872', 'learning_rate': '1.496e-05', 'epoch': '0.3548'}
+
 35%|███▌      | 13470/37963 [30:28:43<54:56:14,  8.07s/it]
 35%|███▌      | 13471/37963 [30:28:51<53:53:21,  7.92s/it]
 35%|███▌      | 13472/37963 [30:28:58<53:20:47,  7.84s/it]
 35%|███▌      | 13473/37963 [30:29:06<52:16:03,  7.68s/it]
 35%|███▌      | 13474/37963 [30:29:13<52:11:27,  7.67s/it]
 35%|███▌      | 13475/37963 [30:29:21<52:48:40,  7.76s/it]
 35%|███▌      | 13476/37963 [30:29:29<52:34:23,  7.73s/it]
 36%|███▌      | 13477/37963 [30:29:36<52:18:16,  7.69s/it]
 36%|███▌      | 13478/37963 [30:29:44<52:15:00,  7.68s/it]
 36%|███▌      | 13479/37963 [30:29:52<51:36:39,  7.59s/it]
 36%|███▌      | 13480/37963 [30:29:59<50:46:56,  7.47s/it]
                                                           
{'loss': '0.1792', 'grad_norm': '1.989', 'learning_rate': '1.495e-05', 'epoch': '0.3551'}
+
 36%|███▌      | 13480/37963 [30:29:59<50:46:56,  7.47s/it]
 36%|███▌      | 13481/37963 [30:30:06<51:01:07,  7.50s/it]
 36%|███▌      | 13482/37963 [30:30:14<51:08:39,  7.52s/it]
 36%|███▌      | 13483/37963 [30:30:22<51:31:00,  7.58s/it]
 36%|███▌      | 13484/37963 [30:30:29<51:09:00,  7.52s/it]
 36%|███▌      | 13485/37963 [30:30:37<51:28:40,  7.57s/it]
 36%|███▌      | 13486/37963 [30:30:44<51:32:48,  7.58s/it]
 36%|███▌      | 13487/37963 [30:30:52<51:31:59,  7.58s/it]
 36%|███▌      | 13488/37963 [30:31:00<52:02:24,  7.65s/it]
 36%|███▌      | 13489/37963 [30:31:10<57:10:38,  8.41s/it]
 36%|███▌      | 13490/37963 [30:31:20<61:27:38,  9.04s/it]
                                                           
{'loss': '0.1542', 'grad_norm': '1.014', 'learning_rate': '1.494e-05', 'epoch': '0.3553'}
+
 36%|███▌      | 13490/37963 [30:31:20<61:27:38,  9.04s/it]
 36%|███▌      | 13491/37963 [30:31:28<58:32:45,  8.61s/it]
 36%|███▌      | 13492/37963 [30:31:36<56:46:42,  8.35s/it]
 36%|███▌      | 13493/37963 [30:31:46<60:37:09,  8.92s/it]
 36%|███▌      | 13494/37963 [30:31:56<63:14:24,  9.30s/it]
 36%|███▌      | 13495/37963 [30:32:04<60:21:44,  8.88s/it]
 36%|███▌      | 13496/37963 [30:32:12<57:57:57,  8.53s/it]
 36%|███▌      | 13497/37963 [30:32:19<55:39:10,  8.19s/it]
 36%|███▌      | 13498/37963 [30:32:29<59:09:45,  8.71s/it]
 36%|███▌      | 13499/37963 [30:32:37<57:07:51,  8.41s/it]
 36%|███▌      | 13500/37963 [30:32:47<60:37:15,  8.92s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '1.124', 'learning_rate': '1.494e-05', 'epoch': '0.3556'}
+
 36%|███▌      | 13500/37963 [30:32:47<60:37:15,  8.92s/it]
 36%|███▌      | 13501/37963 [30:32:55<58:11:00,  8.56s/it]
 36%|███▌      | 13502/37963 [30:33:02<56:06:46,  8.26s/it]
 36%|███▌      | 13503/37963 [30:33:10<55:03:12,  8.10s/it]
 36%|███▌      | 13504/37963 [30:33:18<54:18:30,  7.99s/it]
 36%|███▌      | 13505/37963 [30:33:25<53:48:03,  7.92s/it]
 36%|███▌      | 13506/37963 [30:33:33<53:27:25,  7.87s/it]
 36%|███▌      | 13507/37963 [30:33:41<52:59:32,  7.80s/it]
 36%|███▌      | 13508/37963 [30:33:51<57:35:44,  8.48s/it]
 36%|███▌      | 13509/37963 [30:34:01<61:10:07,  9.00s/it]
 36%|███▌      | 13510/37963 [30:34:09<58:10:03,  8.56s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '3.042', 'learning_rate': '1.493e-05', 'epoch': '0.3559'}
+
 36%|███▌      | 13510/37963 [30:34:09<58:10:03,  8.56s/it]
 36%|███▌      | 13511/37963 [30:34:16<55:50:45,  8.22s/it]
 36%|███▌      | 13512/37963 [30:34:24<54:55:02,  8.09s/it]
 36%|███▌      | 13513/37963 [30:34:32<54:11:35,  7.98s/it]
 36%|███▌      | 13514/37963 [30:34:39<53:24:51,  7.87s/it]
 36%|███▌      | 13515/37963 [30:34:47<53:17:04,  7.85s/it]
 36%|███▌      | 13516/37963 [30:34:55<53:16:14,  7.84s/it]
 36%|███▌      | 13517/37963 [30:35:03<53:35:12,  7.89s/it]
 36%|███▌      | 13518/37963 [30:35:10<52:34:59,  7.74s/it]
 36%|███▌      | 13519/37963 [30:35:17<51:37:19,  7.60s/it]
 36%|███▌      | 13520/37963 [30:35:25<51:58:21,  7.65s/it]
                                                           
{'loss': '0.1604', 'grad_norm': '1.238', 'learning_rate': '1.492e-05', 'epoch': '0.3561'}
+
 36%|███▌      | 13520/37963 [30:35:25<51:58:21,  7.65s/it]
 36%|███▌      | 13521/37963 [30:35:33<52:22:33,  7.71s/it]
 36%|███▌      | 13522/37963 [30:35:41<52:07:50,  7.68s/it]
 36%|███▌      | 13523/37963 [30:35:48<52:01:43,  7.66s/it]
 36%|███▌      | 13524/37963 [30:35:56<51:34:03,  7.60s/it]
 36%|███▌      | 13525/37963 [30:36:03<51:42:19,  7.62s/it]
 36%|███▌      | 13526/37963 [30:36:11<51:47:19,  7.63s/it]
 36%|███▌      | 13527/37963 [30:36:19<51:39:59,  7.61s/it]
 36%|███▌      | 13528/37963 [30:36:26<51:56:54,  7.65s/it]
 36%|███▌      | 13529/37963 [30:36:34<51:46:21,  7.63s/it]
 36%|███▌      | 13530/37963 [30:36:42<52:13:54,  7.70s/it]
                                                           
{'loss': '0.1668', 'grad_norm': '2.517', 'learning_rate': '1.491e-05', 'epoch': '0.3564'}
+
 36%|███▌      | 13530/37963 [30:36:42<52:13:54,  7.70s/it]
 36%|███▌      | 13531/37963 [30:36:50<52:17:39,  7.71s/it]
 36%|███▌      | 13532/37963 [30:36:57<51:50:43,  7.64s/it]
 36%|███▌      | 13533/37963 [30:37:10<62:49:31,  9.26s/it]
 36%|███▌      | 13534/37963 [30:37:18<59:55:21,  8.83s/it]
 36%|███▌      | 13535/37963 [30:37:26<57:40:14,  8.50s/it]
 36%|███▌      | 13536/37963 [30:37:33<56:09:50,  8.28s/it]
 36%|███▌      | 13537/37963 [30:37:44<60:06:42,  8.86s/it]
 36%|███▌      | 13538/37963 [30:37:51<57:47:16,  8.52s/it]
 36%|███▌      | 13539/37963 [30:37:59<56:23:06,  8.31s/it]
 36%|███▌      | 13540/37963 [30:38:07<55:08:04,  8.13s/it]
                                                           
{'loss': '0.1627', 'grad_norm': '1.462', 'learning_rate': '1.491e-05', 'epoch': '0.3567'}
+
 36%|███▌      | 13540/37963 [30:38:07<55:08:04,  8.13s/it]
 36%|███▌      | 13541/37963 [30:38:14<53:54:51,  7.95s/it]
 36%|███▌      | 13542/37963 [30:38:27<64:12:27,  9.47s/it]
 36%|███▌      | 13543/37963 [30:38:35<60:49:05,  8.97s/it]
 36%|███▌      | 13544/37963 [30:38:43<57:55:06,  8.54s/it]
 36%|███▌      | 13545/37963 [30:38:50<56:05:47,  8.27s/it]
 36%|███▌      | 13546/37963 [30:38:58<54:50:52,  8.09s/it]
 36%|███▌      | 13547/37963 [30:39:06<54:05:46,  7.98s/it]
 36%|███▌      | 13548/37963 [30:39:13<53:28:50,  7.89s/it]
 36%|███▌      | 13549/37963 [30:39:21<53:25:45,  7.88s/it]
 36%|███▌      | 13550/37963 [30:39:29<53:07:05,  7.83s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '1.159', 'learning_rate': '1.49e-05', 'epoch': '0.3569'}
+
 36%|███▌      | 13550/37963 [30:39:29<53:07:05,  7.83s/it]
 36%|███▌      | 13551/37963 [30:39:37<52:43:46,  7.78s/it]
 36%|███▌      | 13552/37963 [30:39:44<52:35:43,  7.76s/it]
 36%|███▌      | 13553/37963 [30:39:54<57:12:48,  8.44s/it]
 36%|███▌      | 13554/37963 [30:40:05<60:59:43,  9.00s/it]
 36%|███▌      | 13555/37963 [30:40:13<58:41:35,  8.66s/it]
 36%|███▌      | 13556/37963 [30:40:23<61:47:14,  9.11s/it]
 36%|███▌      | 13557/37963 [30:40:31<59:06:24,  8.72s/it]
 36%|███▌      | 13558/37963 [30:40:38<57:29:24,  8.48s/it]
 36%|███▌      | 13559/37963 [30:40:46<55:54:04,  8.25s/it]
 36%|███▌      | 13560/37963 [30:40:54<54:59:03,  8.11s/it]
                                                           
{'loss': '0.1563', 'grad_norm': '2.567', 'learning_rate': '1.489e-05', 'epoch': '0.3572'}
+
 36%|███▌      | 13560/37963 [30:40:54<54:59:03,  8.11s/it]
 36%|███▌      | 13561/37963 [30:41:02<54:11:13,  7.99s/it]
 36%|███▌      | 13562/37963 [30:41:09<53:25:39,  7.88s/it]
 36%|███▌      | 13563/37963 [30:41:17<52:58:49,  7.82s/it]
 36%|███▌      | 13564/37963 [30:41:24<52:20:10,  7.72s/it]
 36%|███▌      | 13565/37963 [30:41:32<52:52:14,  7.80s/it]
 36%|███▌      | 13566/37963 [30:41:40<52:10:39,  7.70s/it]
 36%|███▌      | 13567/37963 [30:41:47<51:16:35,  7.57s/it]
 36%|███▌      | 13568/37963 [30:41:55<51:54:40,  7.66s/it]
 36%|███▌      | 13569/37963 [30:42:03<51:48:55,  7.65s/it]
 36%|███▌      | 13570/37963 [30:42:10<51:52:52,  7.66s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '1.311', 'learning_rate': '1.488e-05', 'epoch': '0.3575'}
+
 36%|███▌      | 13570/37963 [30:42:10<51:52:52,  7.66s/it]
 36%|███▌      | 13571/37963 [30:42:18<52:09:01,  7.70s/it]
 36%|███▌      | 13572/37963 [30:42:26<52:02:56,  7.68s/it]
 36%|███▌      | 13573/37963 [30:42:34<52:22:53,  7.73s/it]
 36%|███▌      | 13574/37963 [30:42:41<52:04:53,  7.69s/it]
 36%|███▌      | 13575/37963 [30:42:49<52:34:21,  7.76s/it]
 36%|███▌      | 13576/37963 [30:42:57<52:07:11,  7.69s/it]
 36%|███▌      | 13577/37963 [30:43:05<52:35:37,  7.76s/it]
 36%|███▌      | 13578/37963 [30:43:12<52:23:26,  7.73s/it]
 36%|███▌      | 13579/37963 [30:43:20<52:42:23,  7.78s/it]
 36%|███▌      | 13580/37963 [30:43:31<57:56:40,  8.56s/it]
                                                           
{'loss': '0.1652', 'grad_norm': '1.402', 'learning_rate': '1.488e-05', 'epoch': '0.3577'}
+
 36%|███▌      | 13580/37963 [30:43:31<57:56:40,  8.56s/it]
 36%|███▌      | 13581/37963 [30:43:41<61:36:05,  9.10s/it]
 36%|███▌      | 13582/37963 [30:43:48<58:36:18,  8.65s/it]
 36%|███▌      | 13583/37963 [30:43:56<57:12:03,  8.45s/it]
 36%|███▌      | 13584/37963 [30:44:07<61:01:53,  9.01s/it]
 36%|███▌      | 13585/37963 [30:44:15<58:35:44,  8.65s/it]
 36%|███▌      | 13586/37963 [30:44:22<56:22:03,  8.32s/it]
 36%|███▌      | 13587/37963 [30:44:30<55:41:09,  8.22s/it]
 36%|███▌      | 13588/37963 [30:44:38<55:05:13,  8.14s/it]
 36%|███▌      | 13589/37963 [30:44:46<54:06:10,  7.99s/it]
 36%|███▌      | 13590/37963 [30:44:56<58:40:08,  8.67s/it]
                                                           
{'loss': '0.172', 'grad_norm': '1.841', 'learning_rate': '1.487e-05', 'epoch': '0.358'}
+
 36%|███▌      | 13590/37963 [30:44:56<58:40:08,  8.67s/it]
 36%|███▌      | 13591/37963 [30:45:04<56:33:49,  8.36s/it]
 36%|███▌      | 13592/37963 [30:45:11<55:02:45,  8.13s/it]
 36%|███▌      | 13593/37963 [30:45:19<54:17:49,  8.02s/it]
 36%|███▌      | 13594/37963 [30:45:27<53:22:44,  7.89s/it]
 36%|███▌      | 13595/37963 [30:45:34<52:54:17,  7.82s/it]
 36%|███▌      | 13596/37963 [30:45:44<57:43:40,  8.53s/it]
 36%|███▌      | 13597/37963 [30:45:52<56:13:19,  8.31s/it]
 36%|███▌      | 13598/37963 [30:46:00<55:00:20,  8.13s/it]
 36%|███▌      | 13599/37963 [30:46:08<54:16:47,  8.02s/it]
 36%|███▌      | 13600/37963 [30:46:15<53:32:51,  7.91s/it]
                                                           
{'loss': '0.161', 'grad_norm': '1.954', 'learning_rate': '1.486e-05', 'epoch': '0.3582'}
+
 36%|███▌      | 13600/37963 [30:46:15<53:32:51,  7.91s/it]
 36%|███▌      | 13601/37963 [30:46:23<53:41:23,  7.93s/it]
 36%|███▌      | 13602/37963 [30:46:31<53:04:56,  7.84s/it]
 36%|███▌      | 13603/37963 [30:46:39<53:16:07,  7.87s/it]
 36%|███▌      | 13604/37963 [30:46:47<53:07:36,  7.85s/it]
 36%|███▌      | 13605/37963 [30:46:57<57:56:29,  8.56s/it]
 36%|███▌      | 13606/37963 [30:47:05<56:37:04,  8.37s/it]
 36%|███▌      | 13607/37963 [30:47:15<60:10:25,  8.89s/it]
 36%|███▌      | 13608/37963 [30:47:25<62:20:14,  9.21s/it]
 36%|███▌      | 13609/37963 [30:47:32<58:33:05,  8.66s/it]
 36%|███▌      | 13610/37963 [30:47:40<56:25:39,  8.34s/it]
                                                           
{'loss': '0.1761', 'grad_norm': '2.34', 'learning_rate': '1.485e-05', 'epoch': '0.3585'}
+
 36%|███▌      | 13610/37963 [30:47:40<56:25:39,  8.34s/it]
 36%|███▌      | 13611/37963 [30:47:47<54:39:19,  8.08s/it]
 36%|███▌      | 13612/37963 [30:47:55<54:01:28,  7.99s/it]
 36%|███▌      | 13613/37963 [30:48:02<52:42:11,  7.79s/it]
 36%|███▌      | 13614/37963 [30:48:10<52:19:24,  7.74s/it]
 36%|███▌      | 13615/37963 [30:48:18<51:52:40,  7.67s/it]
 36%|███▌      | 13616/37963 [30:48:25<51:48:17,  7.66s/it]
 36%|███▌      | 13617/37963 [30:48:33<51:43:06,  7.65s/it]
 36%|███▌      | 13618/37963 [30:48:40<51:34:05,  7.63s/it]
 36%|███▌      | 13619/37963 [30:48:48<51:07:29,  7.56s/it]
 36%|███▌      | 13620/37963 [30:48:56<51:31:08,  7.62s/it]
                                                           
{'loss': '0.1616', 'grad_norm': '4.125', 'learning_rate': '1.485e-05', 'epoch': '0.3588'}
+
 36%|███▌      | 13620/37963 [30:48:56<51:31:08,  7.62s/it]
 36%|███▌      | 13621/37963 [30:49:03<51:50:10,  7.67s/it]
 36%|███▌      | 13622/37963 [30:49:11<51:36:45,  7.63s/it]
 36%|███▌      | 13623/37963 [30:49:19<51:44:07,  7.65s/it]
 36%|███▌      | 13624/37963 [30:49:29<56:59:12,  8.43s/it]
 36%|███▌      | 13625/37963 [30:49:37<56:06:03,  8.30s/it]
 36%|███▌      | 13626/37963 [30:49:44<54:49:07,  8.11s/it]
 36%|███▌      | 13627/37963 [30:49:52<53:49:04,  7.96s/it]
 36%|███▌      | 13628/37963 [30:50:00<52:55:35,  7.83s/it]
 36%|███▌      | 13629/37963 [30:50:07<52:38:39,  7.79s/it]
 36%|███▌      | 13630/37963 [30:50:15<52:09:26,  7.72s/it]
                                                           
{'loss': '0.1675', 'grad_norm': '0.8727', 'learning_rate': '1.484e-05', 'epoch': '0.359'}
+
 36%|███▌      | 13630/37963 [30:50:15<52:09:26,  7.72s/it]
 36%|███▌      | 13631/37963 [30:50:22<51:25:31,  7.61s/it]
 36%|███▌      | 13632/37963 [30:50:30<51:30:34,  7.62s/it]
 36%|███▌      | 13633/37963 [30:50:37<51:11:34,  7.57s/it]
 36%|███▌      | 13634/37963 [30:50:45<51:01:12,  7.55s/it]
 36%|███▌      | 13635/37963 [30:50:55<56:48:00,  8.41s/it]
 36%|███▌      | 13636/37963 [30:51:05<60:22:02,  8.93s/it]
 36%|███▌      | 13637/37963 [30:51:13<57:56:51,  8.58s/it]
 36%|███▌      | 13638/37963 [30:51:24<61:57:41,  9.17s/it]
 36%|███▌      | 13639/37963 [30:51:32<59:21:38,  8.79s/it]
 36%|███▌      | 13640/37963 [30:51:39<57:21:29,  8.49s/it]
                                                           
{'loss': '0.1451', 'grad_norm': '3.986', 'learning_rate': '1.483e-05', 'epoch': '0.3593'}
+
 36%|███▌      | 13640/37963 [30:51:39<57:21:29,  8.49s/it]
 36%|███▌      | 13641/37963 [30:51:47<55:36:51,  8.23s/it]
 36%|███▌      | 13642/37963 [30:51:54<54:02:14,  8.00s/it]
 36%|███▌      | 13643/37963 [30:52:02<53:14:22,  7.88s/it]
 36%|███▌      | 13644/37963 [30:52:10<53:27:56,  7.91s/it]
 36%|███▌      | 13645/37963 [30:52:18<52:36:00,  7.79s/it]
 36%|███▌      | 13646/37963 [30:52:25<52:24:42,  7.76s/it]
 36%|███▌      | 13647/37963 [30:52:33<52:22:53,  7.76s/it]
 36%|███▌      | 13648/37963 [30:52:43<56:59:01,  8.44s/it]
 36%|███▌      | 13649/37963 [30:52:51<55:29:17,  8.22s/it]
 36%|███▌      | 13650/37963 [30:53:01<60:00:15,  8.88s/it]
                                                           
{'loss': '0.1424', 'grad_norm': '2.024', 'learning_rate': '1.483e-05', 'epoch': '0.3596'}
+
 36%|███▌      | 13650/37963 [30:53:01<60:00:15,  8.88s/it]
 36%|███▌      | 13651/37963 [30:53:09<57:14:05,  8.48s/it]
 36%|███▌      | 13652/37963 [30:53:16<55:22:09,  8.20s/it]
 36%|███▌      | 13653/37963 [30:53:24<54:49:50,  8.12s/it]
 36%|███▌      | 13654/37963 [30:53:32<53:55:59,  7.99s/it]
 36%|███▌      | 13655/37963 [30:53:39<53:06:19,  7.86s/it]
 36%|███▌      | 13656/37963 [30:53:47<52:53:19,  7.83s/it]
 36%|███▌      | 13657/37963 [30:53:55<52:41:26,  7.80s/it]
 36%|███▌      | 13658/37963 [30:54:03<52:24:21,  7.76s/it]
 36%|███▌      | 13659/37963 [30:54:13<57:17:23,  8.49s/it]
 36%|███▌      | 13660/37963 [30:54:21<55:49:01,  8.27s/it]
                                                           
{'loss': '0.1726', 'grad_norm': '2.028', 'learning_rate': '1.482e-05', 'epoch': '0.3598'}
+
 36%|███▌      | 13660/37963 [30:54:21<55:49:01,  8.27s/it]
 36%|███▌      | 13661/37963 [30:54:31<59:16:55,  8.78s/it]
 36%|███▌      | 13662/37963 [30:54:38<57:38:22,  8.54s/it]
 36%|███▌      | 13663/37963 [30:54:46<55:17:05,  8.19s/it]
 36%|███▌      | 13664/37963 [30:54:53<54:04:44,  8.01s/it]
 36%|███▌      | 13665/37963 [30:55:01<53:15:29,  7.89s/it]
 36%|███▌      | 13666/37963 [30:55:09<53:18:53,  7.90s/it]
 36%|███▌      | 13667/37963 [30:55:19<58:27:20,  8.66s/it]
 36%|███▌      | 13668/37963 [30:55:27<56:37:55,  8.39s/it]
 36%|███▌      | 13669/37963 [30:55:35<55:02:56,  8.16s/it]
 36%|███▌      | 13670/37963 [30:55:43<54:13:09,  8.03s/it]
                                                           
{'loss': '0.1708', 'grad_norm': '0.9625', 'learning_rate': '1.481e-05', 'epoch': '0.3601'}
+
 36%|███▌      | 13670/37963 [30:55:43<54:13:09,  8.03s/it]
 36%|███▌      | 13671/37963 [30:55:50<53:29:46,  7.93s/it]
 36%|███▌      | 13672/37963 [30:55:58<52:44:58,  7.82s/it]
 36%|███▌      | 13673/37963 [30:56:06<53:05:28,  7.87s/it]
 36%|███▌      | 13674/37963 [30:56:13<52:28:44,  7.78s/it]
 36%|███▌      | 13675/37963 [30:56:21<52:22:46,  7.76s/it]
 36%|███▌      | 13676/37963 [30:56:29<52:24:54,  7.77s/it]
 36%|███▌      | 13677/37963 [30:56:37<52:39:38,  7.81s/it]
 36%|███▌      | 13678/37963 [30:56:47<57:24:43,  8.51s/it]
 36%|███▌      | 13679/37963 [30:56:55<55:48:06,  8.27s/it]
 36%|███▌      | 13680/37963 [30:57:05<59:50:11,  8.87s/it]
                                                           
{'loss': '0.1684', 'grad_norm': '2.137', 'learning_rate': '1.48e-05', 'epoch': '0.3604'}
+
 36%|███▌      | 13680/37963 [30:57:05<59:50:11,  8.87s/it]
 36%|███▌      | 13681/37963 [30:57:13<57:35:56,  8.54s/it]
 36%|███▌      | 13682/37963 [30:57:20<55:10:37,  8.18s/it]
 36%|███▌      | 13683/37963 [30:57:28<53:58:41,  8.00s/it]
 36%|███▌      | 13684/37963 [30:57:35<52:35:24,  7.80s/it]
 36%|███▌      | 13685/37963 [30:57:43<52:25:21,  7.77s/it]
 36%|███▌      | 13686/37963 [30:57:50<52:30:58,  7.79s/it]
 36%|███▌      | 13687/37963 [30:57:58<52:28:55,  7.78s/it]
 36%|███▌      | 13688/37963 [30:58:06<52:22:44,  7.77s/it]
 36%|███▌      | 13689/37963 [30:58:14<52:09:39,  7.74s/it]
 36%|███▌      | 13690/37963 [30:58:21<51:56:38,  7.70s/it]
                                                           
{'loss': '0.1658', 'grad_norm': '2.802', 'learning_rate': '1.48e-05', 'epoch': '0.3606'}
+
 36%|███▌      | 13690/37963 [30:58:21<51:56:38,  7.70s/it]
 36%|███▌      | 13691/37963 [30:58:29<51:54:43,  7.70s/it]
 36%|███▌      | 13692/37963 [30:58:42<62:44:52,  9.31s/it]
 36%|███▌      | 13693/37963 [30:58:50<59:42:36,  8.86s/it]
 36%|███▌      | 13694/37963 [30:59:00<62:23:15,  9.25s/it]
 36%|███▌      | 13695/37963 [30:59:08<59:14:28,  8.79s/it]
 36%|███▌      | 13696/37963 [30:59:15<56:53:19,  8.44s/it]
 36%|███▌      | 13697/37963 [30:59:23<55:17:07,  8.20s/it]
 36%|███▌      | 13698/37963 [30:59:30<53:42:25,  7.97s/it]
 36%|███▌      | 13699/37963 [30:59:38<53:34:57,  7.95s/it]
 36%|███▌      | 13700/37963 [30:59:46<52:58:31,  7.86s/it]
                                                           
{'loss': '0.1527', 'grad_norm': '1.451', 'learning_rate': '1.479e-05', 'epoch': '0.3609'}
+
 36%|███▌      | 13700/37963 [30:59:46<52:58:31,  7.86s/it]
 36%|███▌      | 13701/37963 [30:59:54<52:57:04,  7.86s/it]
 36%|███▌      | 13702/37963 [31:00:02<52:43:05,  7.82s/it]
 36%|███▌      | 13703/37963 [31:00:09<52:44:28,  7.83s/it]
 36%|███▌      | 13704/37963 [31:00:17<53:18:53,  7.91s/it]
 36%|███▌      | 13705/37963 [31:00:25<52:56:20,  7.86s/it]
 36%|███▌      | 13706/37963 [31:00:33<52:33:15,  7.80s/it]
 36%|███▌      | 13707/37963 [31:00:41<52:45:39,  7.83s/it]
 36%|███▌      | 13708/37963 [31:00:51<57:15:18,  8.50s/it]
 36%|███▌      | 13709/37963 [31:00:59<55:40:21,  8.26s/it]
 36%|███▌      | 13710/37963 [31:01:06<54:43:08,  8.12s/it]
                                                           
{'loss': '0.1653', 'grad_norm': '3.819', 'learning_rate': '1.478e-05', 'epoch': '0.3611'}
+
 36%|███▌      | 13710/37963 [31:01:06<54:43:08,  8.12s/it]
 36%|███▌      | 13711/37963 [31:01:17<59:15:23,  8.80s/it]
 36%|███▌      | 13712/37963 [31:01:24<56:54:37,  8.45s/it]
 36%|███▌      | 13713/37963 [31:01:32<55:41:01,  8.27s/it]
 36%|███▌      | 13714/37963 [31:01:40<54:25:46,  8.08s/it]
 36%|███▌      | 13715/37963 [31:01:50<58:52:46,  8.74s/it]
 36%|███▌      | 13716/37963 [31:01:58<56:32:32,  8.39s/it]
 36%|███▌      | 13717/37963 [31:02:06<55:27:42,  8.23s/it]
 36%|███▌      | 13718/37963 [31:02:13<54:36:03,  8.11s/it]
 36%|███▌      | 13719/37963 [31:02:21<53:37:27,  7.96s/it]
 36%|███▌      | 13720/37963 [31:02:29<53:38:58,  7.97s/it]
                                                           
{'loss': '0.1649', 'grad_norm': '1.477', 'learning_rate': '1.477e-05', 'epoch': '0.3614'}
+
 36%|███▌      | 13720/37963 [31:02:29<53:38:58,  7.97s/it]
 36%|███▌      | 13721/37963 [31:02:37<53:41:54,  7.97s/it]
 36%|███▌      | 13722/37963 [31:02:47<58:30:55,  8.69s/it]
 36%|███▌      | 13723/37963 [31:02:55<56:17:05,  8.36s/it]
 36%|███▌      | 13724/37963 [31:03:03<54:49:53,  8.14s/it]
 36%|███▌      | 13725/37963 [31:03:10<54:04:11,  8.03s/it]
 36%|███▌      | 13726/37963 [31:03:18<54:14:25,  8.06s/it]
 36%|███▌      | 13727/37963 [31:03:26<53:04:14,  7.88s/it]
 36%|███▌      | 13728/37963 [31:03:34<52:55:19,  7.86s/it]
 36%|███▌      | 13729/37963 [31:03:41<52:25:34,  7.79s/it]
 36%|███▌      | 13730/37963 [31:03:49<52:11:04,  7.75s/it]
                                                           
{'loss': '0.1677', 'grad_norm': '1.722', 'learning_rate': '1.477e-05', 'epoch': '0.3617'}
+
 36%|███▌      | 13730/37963 [31:03:49<52:11:04,  7.75s/it]
 36%|███▌      | 13731/37963 [31:03:56<51:37:30,  7.67s/it]
 36%|███▌      | 13732/37963 [31:04:04<51:28:48,  7.65s/it]
 36%|███▌      | 13733/37963 [31:04:12<51:24:42,  7.64s/it]
 36%|███▌      | 13734/37963 [31:04:22<56:40:24,  8.42s/it]
 36%|███▌      | 13735/37963 [31:04:30<55:06:25,  8.19s/it]
 36%|███▌      | 13736/37963 [31:04:40<59:18:46,  8.81s/it]
 36%|███▌      | 13737/37963 [31:04:50<62:17:17,  9.26s/it]
 36%|███▌      | 13738/37963 [31:04:58<59:24:58,  8.83s/it]
 36%|███▌      | 13739/37963 [31:05:06<57:32:08,  8.55s/it]
 36%|███▌      | 13740/37963 [31:05:16<61:37:44,  9.16s/it]
                                                           
{'loss': '0.1769', 'grad_norm': '3.12', 'learning_rate': '1.476e-05', 'epoch': '0.3619'}
+
 36%|███▌      | 13740/37963 [31:05:16<61:37:44,  9.16s/it]
 36%|███▌      | 13741/37963 [31:05:24<59:00:38,  8.77s/it]
 36%|███▌      | 13742/37963 [31:05:32<56:30:54,  8.40s/it]
 36%|███▌      | 13743/37963 [31:05:39<54:51:46,  8.15s/it]
 36%|███▌      | 13744/37963 [31:05:47<53:54:54,  8.01s/it]
 36%|███▌      | 13745/37963 [31:05:55<54:03:23,  8.04s/it]
 36%|███▌      | 13746/37963 [31:06:03<52:41:16,  7.83s/it]
 36%|███▌      | 13747/37963 [31:06:10<52:26:46,  7.80s/it]
 36%|███▌      | 13748/37963 [31:06:18<52:33:36,  7.81s/it]
 36%|███▌      | 13749/37963 [31:06:26<52:17:41,  7.77s/it]
 36%|███▌      | 13750/37963 [31:06:33<51:45:41,  7.70s/it]
                                                           
{'loss': '0.1625', 'grad_norm': '1.961', 'learning_rate': '1.475e-05', 'epoch': '0.3622'}
+
 36%|███▌      | 13750/37963 [31:06:33<51:45:41,  7.70s/it]
 36%|███▌      | 13751/37963 [31:06:41<52:08:19,  7.75s/it]
 36%|███▌      | 13752/37963 [31:06:49<51:52:31,  7.71s/it]
 36%|███▌      | 13753/37963 [31:06:57<52:30:38,  7.81s/it]
 36%|███▌      | 13754/37963 [31:07:04<51:55:10,  7.72s/it]
 36%|███▌      | 13755/37963 [31:07:12<52:00:15,  7.73s/it]
 36%|███▌      | 13756/37963 [31:07:20<52:06:51,  7.75s/it]
 36%|███▌      | 13757/37963 [31:07:28<52:10:23,  7.76s/it]
 36%|███▌      | 13758/37963 [31:07:35<51:26:41,  7.65s/it]
 36%|███▌      | 13759/37963 [31:07:46<57:12:28,  8.51s/it]
 36%|███▌      | 13760/37963 [31:07:53<55:56:23,  8.32s/it]
                                                           
{'loss': '0.166', 'grad_norm': '3.994', 'learning_rate': '1.474e-05', 'epoch': '0.3625'}
+
 36%|███▌      | 13760/37963 [31:07:53<55:56:23,  8.32s/it]
 36%|███▌      | 13761/37963 [31:08:04<59:45:22,  8.89s/it]
 36%|███▋      | 13762/37963 [31:08:11<56:53:06,  8.46s/it]
 36%|███▋      | 13763/37963 [31:08:21<59:55:25,  8.91s/it]
 36%|███▋      | 13764/37963 [31:08:29<57:58:03,  8.62s/it]
 36%|███▋      | 13765/37963 [31:08:37<55:59:34,  8.33s/it]
 36%|███▋      | 13766/37963 [31:08:44<54:08:23,  8.05s/it]
 36%|███▋      | 13767/37963 [31:08:52<53:21:20,  7.94s/it]
 36%|███▋      | 13768/37963 [31:09:00<53:26:24,  7.95s/it]
 36%|███▋      | 13769/37963 [31:09:08<53:22:59,  7.94s/it]
 36%|███▋      | 13770/37963 [31:09:18<57:57:54,  8.63s/it]
                                                           
{'loss': '0.1691', 'grad_norm': '2.224', 'learning_rate': '1.474e-05', 'epoch': '0.3627'}
+
 36%|███▋      | 13770/37963 [31:09:18<57:57:54,  8.63s/it]
 36%|███▋      | 13771/37963 [31:09:26<56:07:15,  8.35s/it]
 36%|███▋      | 13772/37963 [31:09:33<54:05:25,  8.05s/it]
 36%|███▋      | 13773/37963 [31:09:40<52:57:22,  7.88s/it]
 36%|███▋      | 13774/37963 [31:09:48<52:20:18,  7.79s/it]
 36%|███▋      | 13775/37963 [31:09:56<52:06:28,  7.76s/it]
 36%|███▋      | 13776/37963 [31:10:03<51:50:37,  7.72s/it]
 36%|███▋      | 13777/37963 [31:10:11<51:55:43,  7.73s/it]
 36%|███▋      | 13778/37963 [31:10:19<51:36:31,  7.68s/it]
 36%|███▋      | 13779/37963 [31:10:29<56:40:59,  8.44s/it]
 36%|███▋      | 13780/37963 [31:10:37<55:24:53,  8.25s/it]
                                                           
{'loss': '0.1749', 'grad_norm': '2.741', 'learning_rate': '1.473e-05', 'epoch': '0.363'}
+
 36%|███▋      | 13780/37963 [31:10:37<55:24:53,  8.25s/it]
 36%|███▋      | 13781/37963 [31:10:44<54:20:44,  8.09s/it]
 36%|███▋      | 13782/37963 [31:10:55<59:10:17,  8.81s/it]
 36%|███▋      | 13783/37963 [31:11:02<55:47:38,  8.31s/it]
 36%|███▋      | 13784/37963 [31:11:10<54:26:39,  8.11s/it]
 36%|███▋      | 13785/37963 [31:11:17<53:37:23,  7.98s/it]
 36%|███▋      | 13786/37963 [31:11:25<53:21:08,  7.94s/it]
 36%|███▋      | 13787/37963 [31:11:33<52:45:46,  7.86s/it]
 36%|███▋      | 13788/37963 [31:11:41<52:25:28,  7.81s/it]
 36%|███▋      | 13789/37963 [31:11:48<52:22:30,  7.80s/it]
 36%|███▋      | 13790/37963 [31:11:56<52:05:50,  7.76s/it]
                                                           
{'loss': '0.1681', 'grad_norm': '5.917', 'learning_rate': '1.472e-05', 'epoch': '0.3632'}
+
 36%|███▋      | 13790/37963 [31:11:56<52:05:50,  7.76s/it]
 36%|███▋      | 13791/37963 [31:12:06<57:13:38,  8.52s/it]
 36%|███▋      | 13792/37963 [31:12:14<55:11:33,  8.22s/it]
 36%|███▋      | 13793/37963 [31:12:21<53:30:41,  7.97s/it]
 36%|███▋      | 13794/37963 [31:12:32<58:56:08,  8.78s/it]
 36%|███▋      | 13795/37963 [31:12:40<56:37:23,  8.43s/it]
 36%|███▋      | 13796/37963 [31:12:47<55:08:09,  8.21s/it]
 36%|███▋      | 13797/37963 [31:12:55<53:57:17,  8.04s/it]
 36%|███▋      | 13798/37963 [31:13:02<52:30:15,  7.82s/it]
 36%|███▋      | 13799/37963 [31:13:10<52:03:46,  7.76s/it]
 36%|███▋      | 13800/37963 [31:13:17<51:05:25,  7.61s/it]
                                                           
{'loss': '0.1696', 'grad_norm': '2.33', 'learning_rate': '1.471e-05', 'epoch': '0.3635'}
+
 36%|███▋      | 13800/37963 [31:13:17<51:05:25,  7.61s/it]
 36%|███▋      | 13801/37963 [31:13:25<51:30:00,  7.67s/it]
 36%|███▋      | 13802/37963 [31:13:33<51:39:02,  7.70s/it]
 36%|███▋      | 13803/37963 [31:13:43<56:56:55,  8.49s/it]
 36%|███▋      | 13804/37963 [31:13:51<55:12:32,  8.23s/it]
 36%|███▋      | 13805/37963 [31:13:58<54:19:16,  8.09s/it]
 36%|███▋      | 13806/37963 [31:14:06<53:36:49,  7.99s/it]
 36%|███▋      | 13807/37963 [31:14:14<53:00:41,  7.90s/it]
 36%|███▋      | 13808/37963 [31:14:21<51:59:29,  7.75s/it]
 36%|███▋      | 13809/37963 [31:14:29<51:51:34,  7.73s/it]
 36%|███▋      | 13810/37963 [31:14:37<52:04:22,  7.76s/it]
                                                           
{'loss': '0.182', 'grad_norm': '3.47', 'learning_rate': '1.471e-05', 'epoch': '0.3638'}
+
 36%|███▋      | 13810/37963 [31:14:37<52:04:22,  7.76s/it]
 36%|███▋      | 13811/37963 [31:14:44<52:01:10,  7.75s/it]
 36%|███▋      | 13812/37963 [31:14:55<56:44:38,  8.46s/it]
 36%|███▋      | 13813/37963 [31:15:05<60:06:27,  8.96s/it]
 36%|███▋      | 13814/37963 [31:15:12<56:50:34,  8.47s/it]
 36%|███▋      | 13815/37963 [31:15:20<55:40:33,  8.30s/it]
 36%|███▋      | 13816/37963 [31:15:27<54:14:42,  8.09s/it]
 36%|███▋      | 13817/37963 [31:15:35<53:25:26,  7.97s/it]
 36%|███▋      | 13818/37963 [31:15:43<52:44:58,  7.86s/it]
 36%|███▋      | 13819/37963 [31:15:51<52:37:57,  7.85s/it]
 36%|███▋      | 13820/37963 [31:15:58<52:15:56,  7.79s/it]
                                                           
{'loss': '0.1765', 'grad_norm': '2.797', 'learning_rate': '1.47e-05', 'epoch': '0.364'}
+
 36%|███▋      | 13820/37963 [31:15:58<52:15:56,  7.79s/it]
 36%|███▋      | 13821/37963 [31:16:09<57:17:24,  8.54s/it]
 36%|███▋      | 13822/37963 [31:16:16<54:56:38,  8.19s/it]
 36%|███▋      | 13823/37963 [31:16:26<58:52:29,  8.78s/it]
 36%|███▋      | 13824/37963 [31:16:34<56:52:24,  8.48s/it]
 36%|███▋      | 13825/37963 [31:16:41<54:31:53,  8.13s/it]
 36%|███▋      | 13826/37963 [31:16:51<58:35:28,  8.74s/it]
 36%|███▋      | 13827/37963 [31:16:59<56:47:50,  8.47s/it]
 36%|███▋      | 13828/37963 [31:17:07<55:15:06,  8.24s/it]
 36%|███▋      | 13829/37963 [31:17:15<54:02:39,  8.06s/it]
 36%|███▋      | 13830/37963 [31:17:22<53:00:29,  7.91s/it]
                                                           
{'loss': '0.1648', 'grad_norm': '0.9529', 'learning_rate': '1.469e-05', 'epoch': '0.3643'}
+
 36%|███▋      | 13830/37963 [31:17:22<53:00:29,  7.91s/it]
 36%|███▋      | 13831/37963 [31:17:30<52:34:23,  7.84s/it]
 36%|███▋      | 13832/37963 [31:17:38<52:46:18,  7.87s/it]
 36%|███▋      | 13833/37963 [31:17:46<52:37:59,  7.85s/it]
 36%|███▋      | 13834/37963 [31:17:53<52:20:06,  7.81s/it]
 36%|███▋      | 13835/37963 [31:18:01<51:59:27,  7.76s/it]
 36%|███▋      | 13836/37963 [31:18:08<51:28:06,  7.68s/it]
 36%|███▋      | 13837/37963 [31:18:16<51:26:34,  7.68s/it]
 36%|███▋      | 13838/37963 [31:18:24<51:42:23,  7.72s/it]
 36%|███▋      | 13839/37963 [31:18:32<51:40:14,  7.71s/it]
 36%|███▋      | 13840/37963 [31:18:39<50:27:47,  7.53s/it]
                                                           
{'loss': '0.1782', 'grad_norm': '2.353', 'learning_rate': '1.468e-05', 'epoch': '0.3646'}
+
 36%|███▋      | 13840/37963 [31:18:39<50:27:47,  7.53s/it]
 36%|███▋      | 13841/37963 [31:18:46<50:37:39,  7.56s/it]
 36%|███▋      | 13842/37963 [31:18:57<56:24:06,  8.42s/it]
 36%|███▋      | 13843/37963 [31:19:04<55:06:57,  8.23s/it]
 36%|███▋      | 13844/37963 [31:19:12<53:54:10,  8.05s/it]
 36%|███▋      | 13845/37963 [31:19:22<58:13:30,  8.69s/it]
 36%|███▋      | 13846/37963 [31:19:30<56:40:26,  8.46s/it]
 36%|███▋      | 13847/37963 [31:19:38<55:27:20,  8.28s/it]
 36%|███▋      | 13848/37963 [31:19:46<54:29:50,  8.14s/it]
 36%|███▋      | 13849/37963 [31:19:53<53:25:45,  7.98s/it]
 36%|███▋      | 13850/37963 [31:20:01<52:45:00,  7.88s/it]
                                                           
{'loss': '0.1748', 'grad_norm': '1.256', 'learning_rate': '1.467e-05', 'epoch': '0.3648'}
+
 36%|███▋      | 13850/37963 [31:20:01<52:45:00,  7.88s/it]
 36%|███▋      | 13851/37963 [31:20:09<52:07:46,  7.78s/it]
 36%|███▋      | 13852/37963 [31:20:16<51:21:48,  7.67s/it]
 36%|███▋      | 13853/37963 [31:20:24<51:18:29,  7.66s/it]
 36%|███▋      | 13854/37963 [31:20:31<51:15:59,  7.66s/it]
 36%|███▋      | 13855/37963 [31:20:39<51:28:07,  7.69s/it]
 36%|███▋      | 13856/37963 [31:20:47<51:34:58,  7.70s/it]
 37%|███▋      | 13857/37963 [31:20:57<56:29:42,  8.44s/it]
 37%|███▋      | 13858/37963 [31:21:05<55:31:32,  8.29s/it]
 37%|███▋      | 13859/37963 [31:21:13<54:10:58,  8.09s/it]
 37%|███▋      | 13860/37963 [31:21:23<57:54:16,  8.65s/it]
                                                           
{'loss': '0.1705', 'grad_norm': '3.943', 'learning_rate': '1.467e-05', 'epoch': '0.3651'}
+
 37%|███▋      | 13860/37963 [31:21:23<57:54:16,  8.65s/it]
 37%|███▋      | 13861/37963 [31:21:31<56:39:54,  8.46s/it]
 37%|███▋      | 13862/37963 [31:21:38<54:58:04,  8.21s/it]
 37%|███▋      | 13863/37963 [31:21:46<54:12:34,  8.10s/it]
 37%|███▋      | 13864/37963 [31:21:54<53:09:12,  7.94s/it]
 37%|███▋      | 13865/37963 [31:22:01<52:52:58,  7.90s/it]
 37%|███▋      | 13866/37963 [31:22:09<52:37:29,  7.86s/it]
 37%|███▋      | 13867/37963 [31:22:19<57:15:34,  8.55s/it]
 37%|███▋      | 13868/37963 [31:22:27<54:40:28,  8.17s/it]
 37%|███▋      | 13869/37963 [31:22:34<53:31:15,  8.00s/it]
 37%|███▋      | 13870/37963 [31:22:44<57:46:33,  8.63s/it]
                                                           
{'loss': '0.1649', 'grad_norm': '1.149', 'learning_rate': '1.466e-05', 'epoch': '0.3654'}
+
 37%|███▋      | 13870/37963 [31:22:44<57:46:33,  8.63s/it]
 37%|███▋      | 13871/37963 [31:22:55<61:17:14,  9.16s/it]
 37%|███▋      | 13872/37963 [31:23:02<58:24:35,  8.73s/it]
 37%|███▋      | 13873/37963 [31:23:10<56:28:23,  8.44s/it]
 37%|███▋      | 13874/37963 [31:23:18<54:59:20,  8.22s/it]
 37%|███▋      | 13875/37963 [31:23:26<53:46:29,  8.04s/it]
 37%|███▋      | 13876/37963 [31:23:33<53:01:45,  7.93s/it]
 37%|███▋      | 13877/37963 [31:23:41<52:30:27,  7.85s/it]
 37%|███▋      | 13878/37963 [31:23:49<52:06:52,  7.79s/it]
 37%|███▋      | 13879/37963 [31:23:56<51:36:27,  7.71s/it]
 37%|███▋      | 13880/37963 [31:24:07<57:09:24,  8.54s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '3.188', 'learning_rate': '1.465e-05', 'epoch': '0.3656'}
+
 37%|███▋      | 13880/37963 [31:24:07<57:09:24,  8.54s/it]
 37%|███▋      | 13881/37963 [31:24:14<55:20:08,  8.27s/it]
 37%|███▋      | 13882/37963 [31:24:22<54:10:04,  8.10s/it]
 37%|███▋      | 13883/37963 [31:24:29<53:03:20,  7.93s/it]
 37%|███▋      | 13884/37963 [31:24:38<53:25:48,  7.99s/it]
 37%|███▋      | 13885/37963 [31:24:45<52:54:26,  7.91s/it]
 37%|███▋      | 13886/37963 [31:24:53<52:41:12,  7.88s/it]
 37%|███▋      | 13887/37963 [31:25:01<52:14:13,  7.81s/it]
 37%|███▋      | 13888/37963 [31:25:08<51:53:51,  7.76s/it]
 37%|███▋      | 13889/37963 [31:25:16<51:35:27,  7.71s/it]
 37%|███▋      | 13890/37963 [31:25:24<51:17:13,  7.67s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '2.496', 'learning_rate': '1.464e-05', 'epoch': '0.3659'}
+
 37%|███▋      | 13890/37963 [31:25:24<51:17:13,  7.67s/it]
 37%|███▋      | 13891/37963 [31:25:31<50:53:48,  7.61s/it]
 37%|███▋      | 13892/37963 [31:25:39<50:55:57,  7.62s/it]
 37%|███▋      | 13893/37963 [31:25:46<51:09:54,  7.65s/it]
 37%|███▋      | 13894/37963 [31:25:57<56:19:22,  8.42s/it]
 37%|███▋      | 13895/37963 [31:26:04<54:58:26,  8.22s/it]
 37%|███▋      | 13896/37963 [31:26:15<59:46:01,  8.94s/it]
 37%|███▋      | 13897/37963 [31:26:22<56:38:43,  8.47s/it]
 37%|███▋      | 13898/37963 [31:26:30<55:19:09,  8.28s/it]
 37%|███▋      | 13899/37963 [31:26:38<54:12:53,  8.11s/it]
 37%|███▋      | 13900/37963 [31:26:46<53:28:02,  8.00s/it]
                                                           
{'loss': '0.1683', 'grad_norm': '2.706', 'learning_rate': '1.464e-05', 'epoch': '0.3661'}
+
 37%|███▋      | 13900/37963 [31:26:46<53:28:02,  8.00s/it]
 37%|███▋      | 13901/37963 [31:26:53<52:48:10,  7.90s/it]
 37%|███▋      | 13902/37963 [31:27:01<52:19:17,  7.83s/it]
 37%|███▋      | 13903/37963 [31:27:09<52:15:54,  7.82s/it]
 37%|███▋      | 13904/37963 [31:27:19<57:00:37,  8.53s/it]
 37%|███▋      | 13905/37963 [31:27:29<60:47:59,  9.10s/it]
 37%|███▋      | 13906/37963 [31:27:37<58:45:11,  8.79s/it]
 37%|███▋      | 13907/37963 [31:27:45<56:13:02,  8.41s/it]
 37%|███▋      | 13908/37963 [31:27:53<54:42:21,  8.19s/it]
 37%|███▋      | 13909/37963 [31:28:00<53:31:40,  8.01s/it]
 37%|███▋      | 13910/37963 [31:28:08<52:26:07,  7.85s/it]
                                                           
{'loss': '0.1648', 'grad_norm': '1.032', 'learning_rate': '1.463e-05', 'epoch': '0.3664'}
+
 37%|███▋      | 13910/37963 [31:28:08<52:26:07,  7.85s/it]
 37%|███▋      | 13911/37963 [31:28:15<51:56:59,  7.78s/it]
 37%|███▋      | 13912/37963 [31:28:23<51:56:17,  7.77s/it]
 37%|███▋      | 13913/37963 [31:28:31<52:07:07,  7.80s/it]
 37%|███▋      | 13914/37963 [31:28:38<51:33:22,  7.72s/it]
 37%|███▋      | 13915/37963 [31:28:46<51:23:08,  7.69s/it]
 37%|███▋      | 13916/37963 [31:28:54<51:26:11,  7.70s/it]
 37%|███▋      | 13917/37963 [31:29:01<50:58:16,  7.63s/it]
 37%|███▋      | 13918/37963 [31:29:09<50:54:10,  7.62s/it]
 37%|███▋      | 13919/37963 [31:29:17<51:27:34,  7.70s/it]
 37%|███▋      | 13920/37963 [31:29:27<56:16:44,  8.43s/it]
                                                           
{'loss': '0.1727', 'grad_norm': '2.637', 'learning_rate': '1.462e-05', 'epoch': '0.3667'}
+
 37%|███▋      | 13920/37963 [31:29:27<56:16:44,  8.43s/it]
 37%|███▋      | 13921/37963 [31:29:37<60:07:16,  9.00s/it]
 37%|███▋      | 13922/37963 [31:29:45<57:53:17,  8.67s/it]
 37%|███▋      | 13923/37963 [31:29:52<55:05:27,  8.25s/it]
 37%|███▋      | 13924/37963 [31:30:03<58:57:22,  8.83s/it]
 37%|███▋      | 13925/37963 [31:30:10<56:31:09,  8.46s/it]
 37%|███▋      | 13926/37963 [31:30:18<54:55:27,  8.23s/it]
 37%|███▋      | 13927/37963 [31:30:26<54:21:24,  8.14s/it]
 37%|███▋      | 13928/37963 [31:30:33<53:17:08,  7.98s/it]
 37%|███▋      | 13929/37963 [31:30:41<52:31:25,  7.87s/it]
 37%|███▋      | 13930/37963 [31:30:49<51:53:04,  7.77s/it]
                                                           
{'loss': '0.1763', 'grad_norm': '1.334', 'learning_rate': '1.461e-05', 'epoch': '0.3669'}
+
 37%|███▋      | 13930/37963 [31:30:49<51:53:04,  7.77s/it]
 37%|███▋      | 13931/37963 [31:30:57<52:14:32,  7.83s/it]
 37%|███▋      | 13932/37963 [31:31:04<51:52:14,  7.77s/it]
 37%|███▋      | 13933/37963 [31:31:12<51:57:34,  7.78s/it]
 37%|███▋      | 13934/37963 [31:31:22<57:18:08,  8.58s/it]
 37%|███▋      | 13935/37963 [31:31:30<55:26:29,  8.31s/it]
 37%|███▋      | 13936/37963 [31:31:38<53:59:03,  8.09s/it]
 37%|███▋      | 13937/37963 [31:31:45<53:04:07,  7.95s/it]
 37%|███▋      | 13938/37963 [31:31:53<52:23:20,  7.85s/it]
 37%|███▋      | 13939/37963 [31:32:01<52:20:14,  7.84s/it]
 37%|███▋      | 13940/37963 [31:32:09<52:09:34,  7.82s/it]
                                                           
{'loss': '0.1663', 'grad_norm': '1.05', 'learning_rate': '1.461e-05', 'epoch': '0.3672'}
+
 37%|███▋      | 13940/37963 [31:32:09<52:09:34,  7.82s/it]
 37%|███▋      | 13941/37963 [31:32:16<52:07:11,  7.81s/it]
 37%|███▋      | 13942/37963 [31:32:24<52:04:54,  7.81s/it]
 37%|███▋      | 13943/37963 [31:32:32<52:18:11,  7.84s/it]
 37%|███▋      | 13944/37963 [31:32:43<57:41:21,  8.65s/it]
 37%|███▋      | 13945/37963 [31:32:50<55:49:16,  8.37s/it]
 37%|███▋      | 13946/37963 [31:32:58<53:53:09,  8.08s/it]
 37%|███▋      | 13947/37963 [31:33:08<58:08:28,  8.72s/it]
 37%|███▋      | 13948/37963 [31:33:18<61:28:40,  9.22s/it]
 37%|███▋      | 13949/37963 [31:33:29<63:53:46,  9.58s/it]
 37%|███▋      | 13950/37963 [31:33:36<60:05:40,  9.01s/it]
                                                           
{'loss': '0.162', 'grad_norm': '2.861', 'learning_rate': '1.46e-05', 'epoch': '0.3675'}
+
 37%|███▋      | 13950/37963 [31:33:36<60:05:40,  9.01s/it]
 37%|███▋      | 13951/37963 [31:33:44<56:52:02,  8.53s/it]
 37%|███▋      | 13952/37963 [31:33:51<55:08:22,  8.27s/it]
 37%|███▋      | 13953/37963 [31:33:59<53:45:30,  8.06s/it]
 37%|███▋      | 13954/37963 [31:34:07<53:04:02,  7.96s/it]
 37%|███▋      | 13955/37963 [31:34:15<53:00:00,  7.95s/it]
 37%|███▋      | 13956/37963 [31:34:22<52:42:19,  7.90s/it]
 37%|███▋      | 13957/37963 [31:34:30<51:45:57,  7.76s/it]
 37%|███▋      | 13958/37963 [31:34:38<51:38:43,  7.75s/it]
 37%|███▋      | 13959/37963 [31:34:45<51:17:54,  7.69s/it]
 37%|███▋      | 13960/37963 [31:34:53<51:06:06,  7.66s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '1.054', 'learning_rate': '1.459e-05', 'epoch': '0.3677'}
+
 37%|███▋      | 13960/37963 [31:34:53<51:06:06,  7.66s/it]
 37%|███▋      | 13961/37963 [31:35:00<51:04:41,  7.66s/it]
 37%|███▋      | 13962/37963 [31:35:08<51:04:23,  7.66s/it]
 37%|███▋      | 13963/37963 [31:35:16<50:38:54,  7.60s/it]
 37%|███▋      | 13964/37963 [31:35:23<50:51:23,  7.63s/it]
 37%|███▋      | 13965/37963 [31:35:33<56:00:59,  8.40s/it]
 37%|███▋      | 13966/37963 [31:35:41<55:02:52,  8.26s/it]
 37%|███▋      | 13967/37963 [31:35:49<54:00:09,  8.10s/it]
 37%|███▋      | 13968/37963 [31:36:02<63:26:38,  9.52s/it]
 37%|███▋      | 13969/37963 [31:36:10<59:58:07,  9.00s/it]
 37%|███▋      | 13970/37963 [31:36:17<57:17:08,  8.60s/it]
                                                           
{'loss': '0.1714', 'grad_norm': '1.259', 'learning_rate': '1.458e-05', 'epoch': '0.368'}
+
 37%|███▋      | 13970/37963 [31:36:17<57:17:08,  8.60s/it]
 37%|███▋      | 13971/37963 [31:36:25<55:15:43,  8.29s/it]
 37%|███▋      | 13972/37963 [31:36:33<53:58:04,  8.10s/it]
 37%|███▋      | 13973/37963 [31:36:40<53:11:08,  7.98s/it]
 37%|███▋      | 13974/37963 [31:36:48<52:27:24,  7.87s/it]
 37%|███▋      | 13975/37963 [31:36:56<52:04:48,  7.82s/it]
 37%|███▋      | 13976/37963 [31:37:03<51:35:08,  7.74s/it]
 37%|███▋      | 13977/37963 [31:37:11<51:03:56,  7.66s/it]
 37%|███▋      | 13978/37963 [31:37:18<51:22:40,  7.71s/it]
 37%|███▋      | 13979/37963 [31:37:26<50:52:35,  7.64s/it]
 37%|███▋      | 13980/37963 [31:37:34<51:11:49,  7.69s/it]
                                                           
{'loss': '0.1717', 'grad_norm': '1.153', 'learning_rate': '1.458e-05', 'epoch': '0.3683'}
+
 37%|███▋      | 13980/37963 [31:37:34<51:11:49,  7.69s/it]
 37%|███▋      | 13981/37963 [31:37:41<51:15:05,  7.69s/it]
 37%|███▋      | 13982/37963 [31:37:52<56:27:40,  8.48s/it]
 37%|███▋      | 13983/37963 [31:38:00<55:24:19,  8.32s/it]
 37%|███▋      | 13984/37963 [31:38:07<54:00:16,  8.11s/it]
 37%|███▋      | 13985/37963 [31:38:15<53:25:50,  8.02s/it]
 37%|███▋      | 13986/37963 [31:38:23<52:48:22,  7.93s/it]
 37%|███▋      | 13987/37963 [31:38:30<52:09:30,  7.83s/it]
 37%|███▋      | 13988/37963 [31:38:38<51:23:57,  7.72s/it]
 37%|███▋      | 13989/37963 [31:38:46<51:35:12,  7.75s/it]
 37%|███▋      | 13990/37963 [31:38:53<51:40:14,  7.76s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '2.126', 'learning_rate': '1.457e-05', 'epoch': '0.3685'}
+
 37%|███▋      | 13990/37963 [31:38:53<51:40:14,  7.76s/it]
 37%|███▋      | 13991/37963 [31:39:01<51:42:54,  7.77s/it]
 37%|███▋      | 13992/37963 [31:39:14<62:18:27,  9.36s/it]
 37%|███▋      | 13993/37963 [31:39:22<58:48:17,  8.83s/it]
 37%|███▋      | 13994/37963 [31:39:30<56:25:38,  8.48s/it]
 37%|███▋      | 13995/37963 [31:39:37<54:01:45,  8.12s/it]
 37%|███▋      | 13996/37963 [31:39:44<52:24:10,  7.87s/it]
 37%|███▋      | 13997/37963 [31:39:52<52:01:27,  7.81s/it]
 37%|███▋      | 13998/37963 [31:40:00<51:49:27,  7.79s/it]
 37%|███▋      | 13999/37963 [31:40:07<51:32:33,  7.74s/it]
 37%|███▋      | 14000/37963 [31:40:15<51:13:43,  7.70s/it]
                                                           
{'loss': '0.165', 'grad_norm': '1.597', 'learning_rate': '1.456e-05', 'epoch': '0.3688'}
+
 37%|███▋      | 14000/37963 [31:40:15<51:13:43,  7.70s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.86s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.86s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 37%|███▋      | 14001/37963 [31:41:22<169:59:36, 25.54s/it]
 37%|███▋      | 14002/37963 [31:41:30<134:18:20, 20.18s/it]
 37%|███▋      | 14003/37963 [31:41:37<109:04:49, 16.39s/it]
 37%|███▋      | 14004/37963 [31:41:45<92:00:36, 13.83s/it] 
 37%|███▋      | 14005/37963 [31:41:53<79:40:32, 11.97s/it]
 37%|███▋      | 14006/37963 [31:42:00<70:50:36, 10.65s/it]
 37%|███▋      | 14007/37963 [31:42:08<65:20:43,  9.82s/it]
 37%|███▋      | 14008/37963 [31:42:16<61:09:32,  9.19s/it]
 37%|███▋      | 14009/37963 [31:42:23<57:57:46,  8.71s/it]
 37%|███▋      | 14010/37963 [31:42:31<56:25:31,  8.48s/it]
                                                           
{'loss': '0.1798', 'grad_norm': '3.063', 'learning_rate': '1.455e-05', 'epoch': '0.369'}
+
 37%|███▋      | 14010/37963 [31:42:31<56:25:31,  8.48s/it]
 37%|███▋      | 14011/37963 [31:42:39<55:13:50,  8.30s/it]
 37%|███▋      | 14012/37963 [31:42:47<53:47:34,  8.09s/it]
 37%|███▋      | 14013/37963 [31:42:54<52:43:36,  7.93s/it]
 37%|███▋      | 14014/37963 [31:43:05<57:31:01,  8.65s/it]
 37%|███▋      | 14015/37963 [31:43:12<55:39:00,  8.37s/it]
 37%|███▋      | 14016/37963 [31:43:23<59:06:05,  8.88s/it]
 37%|███▋      | 14017/37963 [31:43:33<61:56:50,  9.31s/it]
 37%|███▋      | 14018/37963 [31:43:41<58:55:17,  8.86s/it]
 37%|███▋      | 14019/37963 [31:43:48<56:40:40,  8.52s/it]
 37%|███▋      | 14020/37963 [31:43:56<55:12:38,  8.30s/it]
                                                           
{'loss': '0.1513', 'grad_norm': '0.6711', 'learning_rate': '1.455e-05', 'epoch': '0.3693'}
+
 37%|███▋      | 14020/37963 [31:43:56<55:12:38,  8.30s/it]
 37%|███▋      | 14021/37963 [31:44:04<54:09:37,  8.14s/it]
 37%|███▋      | 14022/37963 [31:44:12<53:16:30,  8.01s/it]
 37%|███▋      | 14023/37963 [31:44:19<52:39:57,  7.92s/it]
 37%|███▋      | 14024/37963 [31:44:27<52:16:18,  7.86s/it]
 37%|███▋      | 14025/37963 [31:44:35<51:44:39,  7.78s/it]
 37%|███▋      | 14026/37963 [31:44:42<51:00:04,  7.67s/it]
 37%|███▋      | 14027/37963 [31:44:50<51:02:05,  7.68s/it]
 37%|███▋      | 14028/37963 [31:44:57<50:47:29,  7.64s/it]
 37%|███▋      | 14029/37963 [31:45:05<50:48:28,  7.64s/it]
 37%|███▋      | 14030/37963 [31:45:12<50:20:08,  7.57s/it]
                                                           
{'loss': '0.1551', 'grad_norm': '1.025', 'learning_rate': '1.454e-05', 'epoch': '0.3696'}
+
 37%|███▋      | 14030/37963 [31:45:12<50:20:08,  7.57s/it]
 37%|███▋      | 14031/37963 [31:45:20<50:07:49,  7.54s/it]
 37%|███▋      | 14032/37963 [31:45:30<55:02:40,  8.28s/it]
 37%|███▋      | 14033/37963 [31:45:38<54:31:25,  8.20s/it]
 37%|███▋      | 14034/37963 [31:45:46<53:26:14,  8.04s/it]
 37%|███▋      | 14035/37963 [31:45:53<52:55:35,  7.96s/it]
 37%|███▋      | 14036/37963 [31:46:06<62:51:02,  9.46s/it]
 37%|███▋      | 14037/37963 [31:46:14<59:17:30,  8.92s/it]
 37%|███▋      | 14038/37963 [31:46:22<56:44:12,  8.54s/it]
 37%|███▋      | 14039/37963 [31:46:29<55:15:06,  8.31s/it]
 37%|███▋      | 14040/37963 [31:46:37<53:59:01,  8.12s/it]
                                                           
{'loss': '0.1702', 'grad_norm': '4.651', 'learning_rate': '1.453e-05', 'epoch': '0.3698'}
+
 37%|███▋      | 14040/37963 [31:46:37<53:59:01,  8.12s/it]
 37%|███▋      | 14041/37963 [31:46:45<53:16:09,  8.02s/it]
 37%|███▋      | 14042/37963 [31:46:53<52:38:49,  7.92s/it]
 37%|███▋      | 14043/37963 [31:47:00<51:56:18,  7.82s/it]
 37%|███▋      | 14044/37963 [31:47:08<51:32:51,  7.76s/it]
 37%|███▋      | 14045/37963 [31:47:18<56:27:22,  8.50s/it]
 37%|███▋      | 14046/37963 [31:47:26<54:37:50,  8.22s/it]
 37%|███▋      | 14047/37963 [31:47:33<53:08:06,  8.00s/it]
 37%|███▋      | 14048/37963 [31:47:40<51:58:21,  7.82s/it]
 37%|███▋      | 14049/37963 [31:47:48<51:47:48,  7.80s/it]
 37%|███▋      | 14050/37963 [31:47:56<52:11:24,  7.86s/it]
                                                           
{'loss': '0.1811', 'grad_norm': '1.34', 'learning_rate': '1.452e-05', 'epoch': '0.3701'}
+
 37%|███▋      | 14050/37963 [31:47:56<52:11:24,  7.86s/it]
 37%|███▋      | 14051/37963 [31:48:04<52:02:09,  7.83s/it]
 37%|███▋      | 14052/37963 [31:48:12<51:47:06,  7.80s/it]
 37%|███▋      | 14053/37963 [31:48:19<51:31:29,  7.76s/it]
 37%|███▋      | 14054/37963 [31:48:27<51:30:38,  7.76s/it]
 37%|███▋      | 14055/37963 [31:48:37<56:44:17,  8.54s/it]
 37%|███▋      | 14056/37963 [31:48:46<55:55:41,  8.42s/it]
 37%|███▋      | 14057/37963 [31:48:54<55:02:13,  8.29s/it]
 37%|███▋      | 14058/37963 [31:49:01<53:55:26,  8.12s/it]
 37%|███▋      | 14059/37963 [31:49:09<53:46:46,  8.10s/it]
 37%|███▋      | 14060/37963 [31:49:17<52:46:06,  7.95s/it]
                                                           
{'loss': '0.1645', 'grad_norm': '1.82', 'learning_rate': '1.452e-05', 'epoch': '0.3704'}
+
 37%|███▋      | 14060/37963 [31:49:17<52:46:06,  7.95s/it]
 37%|███▋      | 14061/37963 [31:49:25<52:27:07,  7.90s/it]
 37%|███▋      | 14062/37963 [31:49:35<57:32:41,  8.67s/it]
 37%|███▋      | 14063/37963 [31:49:43<55:40:38,  8.39s/it]
 37%|███▋      | 14064/37963 [31:49:50<54:05:14,  8.15s/it]
 37%|███▋      | 14065/37963 [31:50:01<58:33:46,  8.82s/it]
 37%|███▋      | 14066/37963 [31:50:09<56:31:09,  8.51s/it]
 37%|███▋      | 14067/37963 [31:50:16<54:16:26,  8.18s/it]
 37%|███▋      | 14068/37963 [31:50:24<53:17:13,  8.03s/it]
 37%|███▋      | 14069/37963 [31:50:31<52:08:41,  7.86s/it]
 37%|███▋      | 14070/37963 [31:50:42<57:02:10,  8.59s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '3.002', 'learning_rate': '1.451e-05', 'epoch': '0.3706'}
+
 37%|███▋      | 14070/37963 [31:50:42<57:02:10,  8.59s/it]
 37%|███▋      | 14071/37963 [31:50:49<55:17:21,  8.33s/it]
 37%|███▋      | 14072/37963 [31:50:57<53:41:50,  8.09s/it]
 37%|███▋      | 14073/37963 [31:51:04<52:45:17,  7.95s/it]
 37%|███▋      | 14074/37963 [31:51:12<52:25:49,  7.90s/it]
 37%|███▋      | 14075/37963 [31:51:22<56:30:03,  8.51s/it]
 37%|███▋      | 14076/37963 [31:51:30<54:46:58,  8.26s/it]
 37%|███▋      | 14077/37963 [31:51:38<53:51:06,  8.12s/it]
 37%|███▋      | 14078/37963 [31:51:45<53:11:26,  8.02s/it]
 37%|███▋      | 14079/37963 [31:51:53<52:52:21,  7.97s/it]
 37%|███▋      | 14080/37963 [31:52:01<52:16:59,  7.88s/it]
                                                           
{'loss': '0.1762', 'grad_norm': '1.759', 'learning_rate': '1.45e-05', 'epoch': '0.3709'}
+
 37%|███▋      | 14080/37963 [31:52:01<52:16:59,  7.88s/it]
 37%|███▋      | 14081/37963 [31:52:08<51:39:41,  7.79s/it]
 37%|███▋      | 14082/37963 [31:52:16<51:31:03,  7.77s/it]
 37%|███▋      | 14083/37963 [31:52:24<51:37:09,  7.78s/it]
 37%|███▋      | 14084/37963 [31:52:34<56:31:39,  8.52s/it]
 37%|███▋      | 14085/37963 [31:52:42<55:39:49,  8.39s/it]
 37%|███▋      | 14086/37963 [31:52:50<54:18:42,  8.19s/it]
 37%|███▋      | 14087/37963 [31:52:58<53:29:30,  8.07s/it]
 37%|███▋      | 14088/37963 [31:53:05<52:42:52,  7.95s/it]
 37%|███▋      | 14089/37963 [31:53:13<52:04:13,  7.85s/it]
 37%|███▋      | 14090/37963 [31:53:23<56:31:27,  8.52s/it]
                                                           
{'loss': '0.1673', 'grad_norm': '1.675', 'learning_rate': '1.449e-05', 'epoch': '0.3712'}
+
 37%|███▋      | 14090/37963 [31:53:23<56:31:27,  8.52s/it]
 37%|███▋      | 14091/37963 [31:53:31<54:51:36,  8.27s/it]
 37%|███▋      | 14092/37963 [31:53:39<54:04:50,  8.16s/it]
 37%|███▋      | 14093/37963 [31:53:49<57:35:46,  8.69s/it]
 37%|███▋      | 14094/37963 [31:53:56<55:03:41,  8.30s/it]
 37%|███▋      | 14095/37963 [31:54:04<53:50:44,  8.12s/it]
 37%|███▋      | 14096/37963 [31:54:11<52:24:33,  7.91s/it]
 37%|███▋      | 14097/37963 [31:54:19<51:14:31,  7.73s/it]
 37%|███▋      | 14098/37963 [31:54:26<51:29:49,  7.77s/it]
 37%|███▋      | 14099/37963 [31:54:37<56:13:42,  8.48s/it]
 37%|███▋      | 14100/37963 [31:54:44<54:51:49,  8.28s/it]
                                                           
{'loss': '0.1678', 'grad_norm': '2.43', 'learning_rate': '1.449e-05', 'epoch': '0.3714'}
+
 37%|███▋      | 14100/37963 [31:54:44<54:51:49,  8.28s/it]
 37%|███▋      | 14101/37963 [31:54:52<53:30:57,  8.07s/it]
 37%|███▋      | 14102/37963 [31:55:00<52:32:21,  7.93s/it]
 37%|███▋      | 14103/37963 [31:55:07<52:12:15,  7.88s/it]
 37%|███▋      | 14104/37963 [31:55:15<51:32:04,  7.78s/it]
 37%|███▋      | 14105/37963 [31:55:22<50:52:55,  7.68s/it]
 37%|███▋      | 14106/37963 [31:55:30<50:46:03,  7.66s/it]
 37%|███▋      | 14107/37963 [31:55:37<50:38:42,  7.64s/it]
 37%|███▋      | 14108/37963 [31:55:45<51:08:12,  7.72s/it]
 37%|███▋      | 14109/37963 [31:55:53<51:30:29,  7.77s/it]
 37%|███▋      | 14110/37963 [31:56:01<51:07:33,  7.72s/it]
                                                           
{'loss': '0.1615', 'grad_norm': '2.767', 'learning_rate': '1.448e-05', 'epoch': '0.3717'}
+
 37%|███▋      | 14110/37963 [31:56:01<51:07:33,  7.72s/it]
 37%|███▋      | 14111/37963 [31:56:09<51:34:00,  7.78s/it]
 37%|███▋      | 14112/37963 [31:56:17<51:40:03,  7.80s/it]
 37%|███▋      | 14113/37963 [31:56:27<57:06:28,  8.62s/it]
 37%|███▋      | 14114/37963 [31:56:35<55:15:52,  8.34s/it]
 37%|███▋      | 14115/37963 [31:56:43<53:55:07,  8.14s/it]
 37%|███▋      | 14116/37963 [31:56:53<57:40:17,  8.71s/it]
 37%|███▋      | 14117/37963 [31:57:00<55:37:24,  8.40s/it]
 37%|███▋      | 14118/37963 [31:57:08<54:26:32,  8.22s/it]
 37%|███▋      | 14119/37963 [31:57:16<53:21:14,  8.06s/it]
 37%|███▋      | 14120/37963 [31:57:23<52:12:59,  7.88s/it]
                                                           
{'loss': '0.1667', 'grad_norm': '1.418', 'learning_rate': '1.447e-05', 'epoch': '0.3719'}
+
 37%|███▋      | 14120/37963 [31:57:23<52:12:59,  7.88s/it]
 37%|███▋      | 14121/37963 [31:57:31<51:53:45,  7.84s/it]
 37%|███▋      | 14122/37963 [31:57:39<51:32:30,  7.78s/it]
 37%|███▋      | 14123/37963 [31:57:46<51:03:02,  7.71s/it]
 37%|███▋      | 14124/37963 [31:57:56<56:03:50,  8.47s/it]
 37%|███▋      | 14125/37963 [31:58:04<54:43:14,  8.26s/it]
 37%|███▋      | 14126/37963 [31:58:12<53:37:36,  8.10s/it]
 37%|███▋      | 14127/37963 [31:58:20<53:24:24,  8.07s/it]
 37%|███▋      | 14128/37963 [31:58:27<51:33:45,  7.79s/it]
 37%|███▋      | 14129/37963 [31:58:37<56:06:37,  8.48s/it]
 37%|███▋      | 14130/37963 [31:58:45<54:15:57,  8.20s/it]
                                                           
{'loss': '0.1647', 'grad_norm': '4.477', 'learning_rate': '1.446e-05', 'epoch': '0.3722'}
+
 37%|███▋      | 14130/37963 [31:58:45<54:15:57,  8.20s/it]
 37%|███▋      | 14131/37963 [31:58:52<53:28:34,  8.08s/it]
 37%|███▋      | 14132/37963 [31:59:00<52:55:38,  8.00s/it]
 37%|███▋      | 14133/37963 [31:59:11<58:31:43,  8.84s/it]
 37%|███▋      | 14134/37963 [31:59:19<56:07:02,  8.48s/it]
 37%|███▋      | 14135/37963 [31:59:26<54:21:22,  8.21s/it]
 37%|███▋      | 14136/37963 [31:59:34<53:11:08,  8.04s/it]
 37%|███▋      | 14137/37963 [31:59:42<52:39:21,  7.96s/it]
 37%|███▋      | 14138/37963 [31:59:49<51:47:24,  7.83s/it]
 37%|███▋      | 14139/37963 [31:59:57<51:49:03,  7.83s/it]
 37%|███▋      | 14140/37963 [32:00:05<51:44:37,  7.82s/it]
                                                           
{'loss': '0.166', 'grad_norm': '2.196', 'learning_rate': '1.445e-05', 'epoch': '0.3725'}
+
 37%|███▋      | 14140/37963 [32:00:05<51:44:37,  7.82s/it]
 37%|███▋      | 14141/37963 [32:00:15<56:21:55,  8.52s/it]
 37%|███▋      | 14142/37963 [32:00:23<54:53:26,  8.30s/it]
 37%|███▋      | 14143/37963 [32:00:30<53:29:51,  8.09s/it]
 37%|███▋      | 14144/37963 [32:00:41<57:48:59,  8.74s/it]
 37%|███▋      | 14145/37963 [32:00:48<55:53:12,  8.45s/it]
 37%|███▋      | 14146/37963 [32:00:56<54:10:50,  8.19s/it]
 37%|███▋      | 14147/37963 [32:01:04<53:10:39,  8.04s/it]
 37%|███▋      | 14148/37963 [32:01:14<57:06:11,  8.63s/it]
 37%|███▋      | 14149/37963 [32:01:21<54:33:32,  8.25s/it]
 37%|███▋      | 14150/37963 [32:01:29<53:17:21,  8.06s/it]
                                                           
{'loss': '0.1671', 'grad_norm': '1.418', 'learning_rate': '1.445e-05', 'epoch': '0.3727'}
+
 37%|███▋      | 14150/37963 [32:01:29<53:17:21,  8.06s/it]
 37%|███▋      | 14151/37963 [32:01:36<52:28:14,  7.93s/it]
 37%|███▋      | 14152/37963 [32:01:44<52:03:11,  7.87s/it]
 37%|███▋      | 14153/37963 [32:01:52<51:43:09,  7.82s/it]
 37%|███▋      | 14154/37963 [32:01:59<51:40:51,  7.81s/it]
 37%|███▋      | 14155/37963 [32:02:07<51:14:40,  7.75s/it]
 37%|███▋      | 14156/37963 [32:02:15<51:26:39,  7.78s/it]
 37%|███▋      | 14157/37963 [32:02:25<56:39:46,  8.57s/it]
 37%|███▋      | 14158/37963 [32:02:33<54:26:57,  8.23s/it]
 37%|███▋      | 14159/37963 [32:02:41<53:49:34,  8.14s/it]
 37%|███▋      | 14160/37963 [32:02:48<52:47:41,  7.98s/it]
                                                           
{'loss': '0.1646', 'grad_norm': '0.9043', 'learning_rate': '1.444e-05', 'epoch': '0.373'}
+
 37%|███▋      | 14160/37963 [32:02:48<52:47:41,  7.98s/it]
 37%|███▋      | 14161/37963 [32:02:56<52:22:40,  7.92s/it]
 37%|███▋      | 14162/37963 [32:03:04<52:00:52,  7.87s/it]
 37%|███▋      | 14163/37963 [32:03:12<51:50:12,  7.84s/it]
 37%|███▋      | 14164/37963 [32:03:19<51:27:38,  7.78s/it]
 37%|███▋      | 14165/37963 [32:03:27<51:06:13,  7.73s/it]
 37%|███▋      | 14166/37963 [32:03:35<51:03:05,  7.72s/it]
 37%|███▋      | 14167/37963 [32:03:44<55:08:07,  8.34s/it]
 37%|███▋      | 14168/37963 [32:03:52<53:56:41,  8.16s/it]
 37%|███▋      | 14169/37963 [32:04:00<52:52:11,  8.00s/it]
 37%|███▋      | 14170/37963 [32:04:10<57:44:17,  8.74s/it]
                                                           
{'loss': '0.1695', 'grad_norm': '2.535', 'learning_rate': '1.443e-05', 'epoch': '0.3733'}
+
 37%|███▋      | 14170/37963 [32:04:10<57:44:17,  8.74s/it]
 37%|███▋      | 14171/37963 [32:04:18<55:47:45,  8.44s/it]
 37%|███▋      | 14172/37963 [32:04:26<54:10:08,  8.20s/it]
 37%|███▋      | 14173/37963 [32:04:33<53:00:48,  8.02s/it]
 37%|███▋      | 14174/37963 [32:04:41<52:22:41,  7.93s/it]
 37%|███▋      | 14175/37963 [32:04:49<52:11:28,  7.90s/it]
 37%|███▋      | 14176/37963 [32:04:57<51:59:12,  7.87s/it]
 37%|███▋      | 14177/37963 [32:05:04<51:40:19,  7.82s/it]
 37%|███▋      | 14178/37963 [32:05:12<51:02:41,  7.73s/it]
 37%|███▋      | 14179/37963 [32:05:20<51:10:46,  7.75s/it]
 37%|███▋      | 14180/37963 [32:05:27<50:37:53,  7.66s/it]
                                                           
{'loss': '0.1744', 'grad_norm': '2.308', 'learning_rate': '1.442e-05', 'epoch': '0.3735'}
+
 37%|███▋      | 14180/37963 [32:05:27<50:37:53,  7.66s/it]
 37%|███▋      | 14181/37963 [32:05:35<51:00:27,  7.72s/it]
 37%|███▋      | 14182/37963 [32:05:42<50:39:25,  7.67s/it]
 37%|███▋      | 14183/37963 [32:05:53<56:16:24,  8.52s/it]
 37%|███▋      | 14184/37963 [32:06:01<55:04:49,  8.34s/it]
 37%|███▋      | 14185/37963 [32:06:14<64:32:40,  9.77s/it]
 37%|███▋      | 14186/37963 [32:06:22<61:12:21,  9.27s/it]
 37%|███▋      | 14187/37963 [32:06:30<58:15:46,  8.82s/it]
 37%|███▋      | 14188/37963 [32:06:37<55:58:01,  8.47s/it]
 37%|███▋      | 14189/37963 [32:06:45<54:22:40,  8.23s/it]
 37%|███▋      | 14190/37963 [32:06:53<53:04:18,  8.04s/it]
                                                           
{'loss': '0.155', 'grad_norm': '1.575', 'learning_rate': '1.442e-05', 'epoch': '0.3738'}
+
 37%|███▋      | 14190/37963 [32:06:53<53:04:18,  8.04s/it]
 37%|███▋      | 14191/37963 [32:07:03<57:28:11,  8.70s/it]
 37%|███▋      | 14192/37963 [32:07:11<55:34:04,  8.42s/it]
 37%|███▋      | 14193/37963 [32:07:18<53:21:16,  8.08s/it]
 37%|███▋      | 14194/37963 [32:07:26<52:35:10,  7.96s/it]
 37%|███▋      | 14195/37963 [32:07:33<52:07:10,  7.89s/it]
 37%|███▋      | 14196/37963 [32:07:41<51:48:41,  7.85s/it]
 37%|███▋      | 14197/37963 [32:07:49<51:35:54,  7.82s/it]
 37%|███▋      | 14198/37963 [32:07:59<56:07:49,  8.50s/it]
 37%|███▋      | 14199/37963 [32:08:07<54:23:10,  8.24s/it]
 37%|███▋      | 14200/37963 [32:08:14<53:07:53,  8.05s/it]
                                                           
{'loss': '0.1668', 'grad_norm': '2.82', 'learning_rate': '1.441e-05', 'epoch': '0.374'}
+
 37%|███▋      | 14200/37963 [32:08:14<53:07:53,  8.05s/it]
 37%|███▋      | 14201/37963 [32:08:22<52:01:47,  7.88s/it]
 37%|███▋      | 14202/37963 [32:08:29<50:40:21,  7.68s/it]
 37%|███▋      | 14203/37963 [32:08:37<50:52:51,  7.71s/it]
 37%|███▋      | 14204/37963 [32:08:44<50:41:46,  7.68s/it]
 37%|███▋      | 14205/37963 [32:08:52<50:40:50,  7.68s/it]
 37%|███▋      | 14206/37963 [32:09:00<50:31:52,  7.66s/it]
 37%|███▋      | 14207/37963 [32:09:07<50:36:37,  7.67s/it]
 37%|███▋      | 14208/37963 [32:09:15<51:04:49,  7.74s/it]
 37%|███▋      | 14209/37963 [32:09:23<51:08:43,  7.75s/it]
 37%|███▋      | 14210/37963 [32:09:31<51:16:20,  7.77s/it]
                                                           
{'loss': '0.1635', 'grad_norm': '2.969', 'learning_rate': '1.44e-05', 'epoch': '0.3743'}
+
 37%|███▋      | 14210/37963 [32:09:31<51:16:20,  7.77s/it]
 37%|███▋      | 14211/37963 [32:09:41<56:16:47,  8.53s/it]
 37%|███▋      | 14212/37963 [32:09:49<54:42:47,  8.29s/it]
 37%|███▋      | 14213/37963 [32:09:57<53:27:27,  8.10s/it]
 37%|███▋      | 14214/37963 [32:10:07<58:04:42,  8.80s/it]
 37%|███▋      | 14215/37963 [32:10:15<56:28:36,  8.56s/it]
 37%|███▋      | 14216/37963 [32:10:23<54:42:36,  8.29s/it]
 37%|███▋      | 14217/37963 [32:10:30<52:55:58,  8.02s/it]
 37%|███▋      | 14218/37963 [32:10:38<52:16:13,  7.92s/it]
 37%|███▋      | 14219/37963 [32:10:45<51:47:24,  7.85s/it]
 37%|███▋      | 14220/37963 [32:10:53<51:26:57,  7.80s/it]
                                                           
{'loss': '0.1776', 'grad_norm': '1.78', 'learning_rate': '1.439e-05', 'epoch': '0.3746'}
+
 37%|███▋      | 14220/37963 [32:10:53<51:26:57,  7.80s/it]
 37%|███▋      | 14221/37963 [32:11:03<56:10:44,  8.52s/it]
 37%|███▋      | 14222/37963 [32:11:11<54:24:55,  8.25s/it]
 37%|███▋      | 14223/37963 [32:11:19<53:44:45,  8.15s/it]
 37%|███▋      | 14224/37963 [32:11:27<52:46:47,  8.00s/it]
 37%|███▋      | 14225/37963 [32:11:34<52:06:31,  7.90s/it]
 37%|███▋      | 14226/37963 [32:11:42<51:37:31,  7.83s/it]
 37%|███▋      | 14227/37963 [32:11:50<51:34:33,  7.82s/it]
 37%|███▋      | 14228/37963 [32:12:00<56:39:44,  8.59s/it]
 37%|███▋      | 14229/37963 [32:12:08<55:02:29,  8.35s/it]
 37%|███▋      | 14230/37963 [32:12:15<52:57:56,  8.03s/it]
                                                           
{'loss': '0.1608', 'grad_norm': '3.417', 'learning_rate': '1.439e-05', 'epoch': '0.3748'}
+
 37%|███▋      | 14230/37963 [32:12:15<52:57:56,  8.03s/it]
 37%|███▋      | 14231/37963 [32:12:25<57:36:07,  8.74s/it]
 37%|███▋      | 14232/37963 [32:12:33<55:28:36,  8.42s/it]
 37%|███▋      | 14233/37963 [32:12:41<53:32:00,  8.12s/it]
 37%|███▋      | 14234/37963 [32:12:48<52:46:55,  8.01s/it]
 37%|███▋      | 14235/37963 [32:12:58<56:13:06,  8.53s/it]
 37%|███▋      | 14236/37963 [32:13:06<54:37:33,  8.29s/it]
 38%|███▊      | 14237/37963 [32:13:13<53:24:48,  8.10s/it]
 38%|███▊      | 14238/37963 [32:13:21<52:31:59,  7.97s/it]
 38%|███▊      | 14239/37963 [32:13:32<57:39:46,  8.75s/it]
 38%|███▊      | 14240/37963 [32:13:39<55:30:02,  8.42s/it]
                                                           
{'loss': '0.1631', 'grad_norm': '1.866', 'learning_rate': '1.438e-05', 'epoch': '0.3751'}
+
 38%|███▊      | 14240/37963 [32:13:39<55:30:02,  8.42s/it]
 38%|███▊      | 14241/37963 [32:13:47<53:42:26,  8.15s/it]
 38%|███▊      | 14242/37963 [32:13:54<52:26:18,  7.96s/it]
 38%|███▊      | 14243/37963 [32:14:02<51:41:05,  7.84s/it]
 38%|███▊      | 14244/37963 [32:14:10<51:34:34,  7.83s/it]
 38%|███▊      | 14245/37963 [32:14:18<51:28:57,  7.81s/it]
 38%|███▊      | 14246/37963 [32:14:25<51:06:08,  7.76s/it]
 38%|███▊      | 14247/37963 [32:14:33<50:50:20,  7.72s/it]
 38%|███▊      | 14248/37963 [32:14:40<50:49:53,  7.72s/it]
 38%|███▊      | 14249/37963 [32:14:48<51:04:17,  7.75s/it]
 38%|███▊      | 14250/37963 [32:14:56<51:12:17,  7.77s/it]
                                                           
{'loss': '0.176', 'grad_norm': '1.208', 'learning_rate': '1.437e-05', 'epoch': '0.3754'}
+
 38%|███▊      | 14250/37963 [32:14:56<51:12:17,  7.77s/it]
 38%|███▊      | 14251/37963 [32:15:04<51:13:04,  7.78s/it]
 38%|███▊      | 14252/37963 [32:15:14<56:00:18,  8.50s/it]
 38%|███▊      | 14253/37963 [32:15:22<54:49:59,  8.33s/it]
 38%|███▊      | 14254/37963 [32:15:30<53:29:10,  8.12s/it]
 38%|███▊      | 14255/37963 [32:15:40<57:51:52,  8.79s/it]
 38%|███▊      | 14256/37963 [32:15:48<55:19:17,  8.40s/it]
 38%|███▊      | 14257/37963 [32:15:55<54:00:57,  8.20s/it]
 38%|███▊      | 14258/37963 [32:16:05<57:47:10,  8.78s/it]
 38%|███▊      | 14259/37963 [32:16:13<55:03:01,  8.36s/it]
 38%|███▊      | 14260/37963 [32:16:21<53:59:21,  8.20s/it]
                                                           
{'loss': '0.1713', 'grad_norm': '2.003', 'learning_rate': '1.436e-05', 'epoch': '0.3756'}
+
 38%|███▊      | 14260/37963 [32:16:21<53:59:21,  8.20s/it]
 38%|███▊      | 14261/37963 [32:16:28<52:47:32,  8.02s/it]
 38%|███▊      | 14262/37963 [32:16:36<51:33:56,  7.83s/it]
 38%|███▊      | 14263/37963 [32:16:43<51:15:42,  7.79s/it]
 38%|███▊      | 14264/37963 [32:16:51<51:00:59,  7.75s/it]
 38%|███▊      | 14265/37963 [32:16:59<50:43:37,  7.71s/it]
 38%|███▊      | 14266/37963 [32:17:06<51:12:30,  7.78s/it]
 38%|███▊      | 14267/37963 [32:17:14<51:02:39,  7.75s/it]
 38%|███▊      | 14268/37963 [32:17:22<50:41:41,  7.70s/it]
 38%|███▊      | 14269/37963 [32:17:30<50:47:09,  7.72s/it]
 38%|███▊      | 14270/37963 [32:17:40<55:41:38,  8.46s/it]
                                                           
{'loss': '0.1652', 'grad_norm': '0.8674', 'learning_rate': '1.436e-05', 'epoch': '0.3759'}
+
 38%|███▊      | 14270/37963 [32:17:40<55:41:38,  8.46s/it]
 38%|███▊      | 14271/37963 [32:17:47<54:15:06,  8.24s/it]
 38%|███▊      | 14272/37963 [32:17:55<53:00:31,  8.06s/it]
 38%|███▊      | 14273/37963 [32:18:03<52:33:52,  7.99s/it]
 38%|███▊      | 14274/37963 [32:18:11<52:16:00,  7.94s/it]
 38%|███▊      | 14275/37963 [32:18:19<51:55:02,  7.89s/it]
 38%|███▊      | 14276/37963 [32:18:26<51:25:37,  7.82s/it]
 38%|███▊      | 14277/37963 [32:18:34<50:57:32,  7.75s/it]
 38%|███▊      | 14278/37963 [32:18:41<50:52:40,  7.73s/it]
 38%|███▊      | 14279/37963 [32:18:52<55:54:42,  8.50s/it]
 38%|███▊      | 14280/37963 [32:19:02<59:31:09,  9.05s/it]
                                                           
{'loss': '0.1915', 'grad_norm': '0.877', 'learning_rate': '1.435e-05', 'epoch': '0.3762'}
+
 38%|███▊      | 14280/37963 [32:19:02<59:31:09,  9.05s/it]
 38%|███▊      | 14281/37963 [32:19:10<56:41:18,  8.62s/it]
 38%|███▊      | 14282/37963 [32:19:20<60:01:49,  9.13s/it]
 38%|███▊      | 14283/37963 [32:19:30<62:35:34,  9.52s/it]
 38%|███▊      | 14284/37963 [32:19:38<59:04:14,  8.98s/it]
 38%|███▊      | 14285/37963 [32:19:46<56:25:09,  8.58s/it]
 38%|███▊      | 14286/37963 [32:19:53<53:52:53,  8.19s/it]
 38%|███▊      | 14287/37963 [32:20:01<53:02:13,  8.06s/it]
 38%|███▊      | 14288/37963 [32:20:08<52:08:46,  7.93s/it]
 38%|███▊      | 14289/37963 [32:20:16<51:33:49,  7.84s/it]
 38%|███▊      | 14290/37963 [32:20:24<51:29:33,  7.83s/it]
                                                           
{'loss': '0.1514', 'grad_norm': '2.394', 'learning_rate': '1.434e-05', 'epoch': '0.3764'}
+
 38%|███▊      | 14290/37963 [32:20:24<51:29:33,  7.83s/it]
 38%|███▊      | 14291/37963 [32:20:32<51:16:07,  7.80s/it]
 38%|███▊      | 14292/37963 [32:20:39<51:22:00,  7.81s/it]
 38%|███▊      | 14293/37963 [32:20:47<50:59:59,  7.76s/it]
 38%|███▊      | 14294/37963 [32:20:55<50:45:41,  7.72s/it]
 38%|███▊      | 14295/37963 [32:21:03<50:58:49,  7.75s/it]
 38%|███▊      | 14296/37963 [32:21:10<51:16:08,  7.80s/it]
 38%|███▊      | 14297/37963 [32:21:18<51:07:17,  7.78s/it]
 38%|███▊      | 14298/37963 [32:21:29<56:28:39,  8.59s/it]
 38%|███▊      | 14299/37963 [32:21:36<54:48:58,  8.34s/it]
 38%|███▊      | 14300/37963 [32:21:47<58:31:01,  8.90s/it]
                                                           
{'loss': '0.1819', 'grad_norm': '4.906', 'learning_rate': '1.433e-05', 'epoch': '0.3767'}
+
 38%|███▊      | 14300/37963 [32:21:47<58:31:01,  8.90s/it]
 38%|███▊      | 14301/37963 [32:21:55<56:33:12,  8.60s/it]
 38%|███▊      | 14302/37963 [32:22:02<54:50:44,  8.34s/it]
 38%|███▊      | 14303/37963 [32:22:10<53:48:49,  8.19s/it]
 38%|███▊      | 14304/37963 [32:22:18<53:00:06,  8.06s/it]
 38%|███▊      | 14305/37963 [32:22:25<52:03:25,  7.92s/it]
 38%|���██▊      | 14306/37963 [32:22:33<50:52:14,  7.74s/it]
 38%|███▊      | 14307/37963 [32:22:41<51:14:22,  7.80s/it]
 38%|███▊      | 14308/37963 [32:22:48<50:55:13,  7.75s/it]
 38%|███▊      | 14309/37963 [32:22:56<50:42:01,  7.72s/it]
 38%|███▊      | 14310/37963 [32:23:04<50:22:33,  7.67s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '1.228', 'learning_rate': '1.432e-05', 'epoch': '0.3769'}
+
 38%|███▊      | 14310/37963 [32:23:04<50:22:33,  7.67s/it]
 38%|███▊      | 14311/37963 [32:23:11<49:39:09,  7.56s/it]
 38%|███▊      | 14312/37963 [32:23:21<55:28:24,  8.44s/it]
 38%|███▊      | 14313/37963 [32:23:29<54:18:21,  8.27s/it]
 38%|███▊      | 14314/37963 [32:23:37<52:34:44,  8.00s/it]
 38%|███▊      | 14315/37963 [32:23:44<51:41:01,  7.87s/it]
 38%|███▊      | 14316/37963 [32:23:52<51:14:41,  7.80s/it]
 38%|███▊      | 14317/37963 [32:23:59<50:51:48,  7.74s/it]
 38%|███▊      | 14318/37963 [32:24:10<56:01:02,  8.53s/it]
 38%|███▊      | 14319/37963 [32:24:17<53:59:14,  8.22s/it]
 38%|███▊      | 14320/37963 [32:24:25<53:37:16,  8.16s/it]
                                                           
{'loss': '0.1561', 'grad_norm': '1.375', 'learning_rate': '1.432e-05', 'epoch': '0.3772'}
+
 38%|███▊      | 14320/37963 [32:24:25<53:37:16,  8.16s/it]
 38%|███▊      | 14321/37963 [32:24:33<52:30:26,  8.00s/it]
 38%|███▊      | 14322/37963 [32:24:43<57:10:42,  8.71s/it]
 38%|███▊      | 14323/37963 [32:24:54<60:21:56,  9.19s/it]
 38%|███▊      | 14324/37963 [32:25:01<57:27:54,  8.75s/it]
 38%|███▊      | 14325/37963 [32:25:09<55:14:55,  8.41s/it]
 38%|███▊      | 14326/37963 [32:25:17<53:35:37,  8.16s/it]
 38%|███▊      | 14327/37963 [32:25:24<52:29:56,  8.00s/it]
 38%|███▊      | 14328/37963 [32:25:32<52:03:41,  7.93s/it]
 38%|███▊      | 14329/37963 [32:25:40<51:46:54,  7.89s/it]
 38%|███▊      | 14330/37963 [32:25:50<56:22:42,  8.59s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '1.651', 'learning_rate': '1.431e-05', 'epoch': '0.3775'}
+
 38%|███▊      | 14330/37963 [32:25:50<56:22:42,  8.59s/it]
 38%|███▊      | 14331/37963 [32:26:00<59:41:41,  9.09s/it]
 38%|███▊      | 14332/37963 [32:26:08<57:07:49,  8.70s/it]
 38%|███▊      | 14333/37963 [32:26:15<54:28:34,  8.30s/it]
 38%|███▊      | 14334/37963 [32:26:23<53:07:22,  8.09s/it]
 38%|███▊      | 14335/37963 [32:26:31<52:20:54,  7.98s/it]
 38%|███▊      | 14336/37963 [32:26:38<51:46:52,  7.89s/it]
 38%|███▊      | 14337/37963 [32:26:46<51:24:19,  7.83s/it]
 38%|███▊      | 14338/37963 [32:26:54<51:02:51,  7.78s/it]
 38%|███▊      | 14339/37963 [32:27:01<50:31:25,  7.70s/it]
 38%|███▊      | 14340/37963 [32:27:09<50:19:29,  7.67s/it]
                                                           
{'loss': '0.1656', 'grad_norm': '1.599', 'learning_rate': '1.43e-05', 'epoch': '0.3777'}
+
 38%|███▊      | 14340/37963 [32:27:09<50:19:29,  7.67s/it]
 38%|███▊      | 14341/37963 [32:27:17<50:38:28,  7.72s/it]
 38%|███▊      | 14342/37963 [32:27:24<50:19:14,  7.67s/it]
 38%|███▊      | 14343/37963 [32:27:32<50:46:43,  7.74s/it]
 38%|███▊      | 14344/37963 [32:27:40<50:50:47,  7.75s/it]
 38%|███▊      | 14345/37963 [32:27:48<50:38:40,  7.72s/it]
 38%|███▊      | 14346/37963 [32:27:55<50:13:16,  7.66s/it]
 38%|███▊      | 14347/37963 [32:28:03<50:29:03,  7.70s/it]
 38%|███▊      | 14348/37963 [32:28:10<50:19:10,  7.67s/it]
 38%|███▊      | 14349/37963 [32:28:18<50:18:11,  7.67s/it]
 38%|███▊      | 14350/37963 [32:28:26<50:27:17,  7.69s/it]
                                                           
{'loss': '0.1644', 'grad_norm': '3.026', 'learning_rate': '1.429e-05', 'epoch': '0.378'}
+
 38%|███▊      | 14350/37963 [32:28:26<50:27:17,  7.69s/it]
 38%|███▊      | 14351/37963 [32:28:33<50:20:15,  7.67s/it]
 38%|███▊      | 14352/37963 [32:28:44<55:28:52,  8.46s/it]
 38%|███▊      | 14353/37963 [32:28:52<54:37:31,  8.33s/it]
 38%|███▊      | 14354/37963 [32:29:02<58:39:41,  8.94s/it]
 38%|███▊      | 14355/37963 [32:29:10<56:20:58,  8.59s/it]
 38%|███▊      | 14356/37963 [32:29:18<54:31:22,  8.31s/it]
 38%|███▊      | 14357/37963 [32:29:25<53:14:08,  8.12s/it]
 38%|███▊      | 14358/37963 [32:29:33<52:37:45,  8.03s/it]
 38%|███▊      | 14359/37963 [32:29:40<50:59:45,  7.78s/it]
 38%|███▊      | 14360/37963 [32:29:48<50:42:44,  7.73s/it]
                                                           
{'loss': '0.1613', 'grad_norm': '2.618', 'learning_rate': '1.429e-05', 'epoch': '0.3783'}
+
 38%|███▊      | 14360/37963 [32:29:48<50:42:44,  7.73s/it]
 38%|███▊      | 14361/37963 [32:29:55<50:11:19,  7.66s/it]
 38%|███▊      | 14362/37963 [32:30:03<50:07:14,  7.65s/it]
 38%|███▊      | 14363/37963 [32:30:11<50:17:16,  7.67s/it]
 38%|███▊      | 14364/37963 [32:30:21<55:20:16,  8.44s/it]
 38%|███▊      | 14365/37963 [32:30:29<54:06:34,  8.25s/it]
 38%|███▊      | 14366/37963 [32:30:39<58:00:57,  8.85s/it]
 38%|███▊      | 14367/37963 [32:30:47<55:43:11,  8.50s/it]
 38%|███▊      | 14368/37963 [32:30:54<53:57:40,  8.23s/it]
 38%|███▊      | 14369/37963 [32:31:02<52:05:01,  7.95s/it]
 38%|███▊      | 14370/37963 [32:31:09<51:34:28,  7.87s/it]
                                                           
{'loss': '0.1582', 'grad_norm': '1.373', 'learning_rate': '1.428e-05', 'epoch': '0.3785'}
+
 38%|███▊      | 14370/37963 [32:31:09<51:34:28,  7.87s/it]
 38%|███▊      | 14371/37963 [32:31:20<56:23:03,  8.60s/it]
 38%|███▊      | 14372/37963 [32:31:30<60:03:32,  9.17s/it]
 38%|███▊      | 14373/37963 [32:31:38<57:48:36,  8.82s/it]
 38%|███▊      | 14374/37963 [32:31:46<55:31:54,  8.47s/it]
 38%|███▊      | 14375/37963 [32:31:53<53:34:26,  8.18s/it]
 38%|███▊      | 14376/37963 [32:32:01<52:35:48,  8.03s/it]
 38%|███▊      | 14377/37963 [32:32:09<51:58:48,  7.93s/it]
 38%|███▊      | 14378/37963 [32:32:19<56:37:32,  8.64s/it]
 38%|███▊      | 14379/37963 [32:32:29<60:08:40,  9.18s/it]
 38%|███▊      | 14380/37963 [32:32:37<57:25:06,  8.77s/it]
                                                           
{'loss': '0.1764', 'grad_norm': '2.249', 'learning_rate': '1.427e-05', 'epoch': '0.3788'}
+
 38%|███▊      | 14380/37963 [32:32:37<57:25:06,  8.77s/it]
 38%|███▊      | 14381/37963 [32:32:45<55:16:44,  8.44s/it]
 38%|███▊      | 14382/37963 [32:32:52<53:33:06,  8.18s/it]
 38%|███▊      | 14383/37963 [32:33:00<52:56:57,  8.08s/it]
 38%|███▊      | 14384/37963 [32:33:08<52:36:30,  8.03s/it]
 38%|███▊      | 14385/37963 [32:33:16<51:14:04,  7.82s/it]
 38%|███▊      | 14386/37963 [32:33:23<50:48:16,  7.76s/it]
 38%|███▊      | 14387/37963 [32:33:31<50:38:12,  7.73s/it]
 38%|███▊      | 14388/37963 [32:33:39<50:40:00,  7.74s/it]
 38%|███▊      | 14389/37963 [32:33:46<50:37:07,  7.73s/it]
 38%|███▊      | 14390/37963 [32:33:54<50:18:46,  7.68s/it]
                                                           
{'loss': '0.1552', 'grad_norm': '3.168', 'learning_rate': '1.426e-05', 'epoch': '0.3791'}
+
 38%|███▊      | 14390/37963 [32:33:54<50:18:46,  7.68s/it]
 38%|███▊      | 14391/37963 [32:34:02<50:19:08,  7.68s/it]
 38%|███▊      | 14392/37963 [32:34:09<50:38:34,  7.73s/it]
 38%|███▊      | 14393/37963 [32:34:17<49:48:08,  7.61s/it]
 38%|███▊      | 14394/37963 [32:34:24<49:44:28,  7.60s/it]
 38%|███▊      | 14395/37963 [32:34:32<49:41:04,  7.59s/it]
 38%|███▊      | 14396/37963 [32:34:40<49:56:48,  7.63s/it]
 38%|███▊      | 14397/37963 [32:34:47<49:28:09,  7.56s/it]
 38%|███▊      | 14398/37963 [32:34:57<55:16:26,  8.44s/it]
 38%|███▊      | 14399/37963 [32:35:05<53:26:37,  8.16s/it]
 38%|███▊      | 14400/37963 [32:35:13<52:27:59,  8.02s/it]
                                                           
{'loss': '0.1611', 'grad_norm': '2.982', 'learning_rate': '1.426e-05', 'epoch': '0.3793'}
+
 38%|███▊      | 14400/37963 [32:35:13<52:27:59,  8.02s/it]
 38%|███▊      | 14401/37963 [32:35:20<51:21:10,  7.85s/it]
 38%|███▊      | 14402/37963 [32:35:28<50:47:43,  7.76s/it]
 38%|███▊      | 14403/37963 [32:35:35<50:49:21,  7.77s/it]
 38%|███▊      | 14404/37963 [32:35:43<50:44:11,  7.75s/it]
 38%|███▊      | 14405/37963 [32:35:51<50:41:22,  7.75s/it]
 38%|███▊      | 14406/37963 [32:36:01<55:50:15,  8.53s/it]
 38%|███▊      | 14407/37963 [32:36:09<54:16:06,  8.29s/it]
 38%|███▊      | 14408/37963 [32:36:19<57:42:35,  8.82s/it]
 38%|███▊      | 14409/37963 [32:36:27<55:29:33,  8.48s/it]
 38%|███▊      | 14410/37963 [32:36:34<53:28:12,  8.17s/it]
                                                           
{'loss': '0.1653', 'grad_norm': '2.29', 'learning_rate': '1.425e-05', 'epoch': '0.3796'}
+
 38%|███▊      | 14410/37963 [32:36:34<53:28:12,  8.17s/it]
 38%|███▊      | 14411/37963 [32:36:42<52:13:23,  7.98s/it]
 38%|███▊      | 14412/37963 [32:36:50<51:53:52,  7.93s/it]
 38%|███▊      | 14413/37963 [32:36:57<51:14:49,  7.83s/it]
 38%|███▊      | 14414/37963 [32:37:04<50:14:06,  7.68s/it]
 38%|███▊      | 14415/37963 [32:37:12<50:04:12,  7.65s/it]
 38%|███▊      | 14416/37963 [32:37:22<55:19:00,  8.46s/it]
 38%|███▊      | 14417/37963 [32:37:30<53:40:34,  8.21s/it]
 38%|███▊      | 14418/37963 [32:37:38<52:35:26,  8.04s/it]
 38%|███▊      | 14419/37963 [32:37:45<51:49:23,  7.92s/it]
 38%|███▊      | 14420/37963 [32:37:53<51:20:57,  7.85s/it]
                                                           
{'loss': '0.167', 'grad_norm': '0.7604', 'learning_rate': '1.424e-05', 'epoch': '0.3798'}
+
 38%|███▊      | 14420/37963 [32:37:53<51:20:57,  7.85s/it]
 38%|███▊      | 14421/37963 [32:38:01<50:54:53,  7.79s/it]
 38%|███▊      | 14422/37963 [32:38:14<61:13:46,  9.36s/it]
 38%|███▊      | 14423/37963 [32:38:21<57:40:47,  8.82s/it]
 38%|███▊      | 14424/37963 [32:38:29<55:21:14,  8.47s/it]
 38%|███▊      | 14425/37963 [32:38:42<64:10:27,  9.82s/it]
 38%|███▊      | 14426/37963 [32:38:50<60:51:33,  9.31s/it]
 38%|███▊      | 14427/37963 [32:38:58<57:50:53,  8.85s/it]
 38%|███▊      | 14428/37963 [32:39:05<55:30:09,  8.49s/it]
 38%|███▊      | 14429/37963 [32:39:13<53:24:27,  8.17s/it]
 38%|███▊      | 14430/37963 [32:39:21<52:38:11,  8.05s/it]
                                                           
{'loss': '0.1499', 'grad_norm': '3.669', 'learning_rate': '1.423e-05', 'epoch': '0.3801'}
+
 38%|███▊      | 14430/37963 [32:39:21<52:38:11,  8.05s/it]
 38%|███▊      | 14431/37963 [32:39:28<52:16:40,  8.00s/it]
 38%|███▊      | 14432/37963 [32:39:36<51:36:04,  7.89s/it]
 38%|███▊      | 14433/37963 [32:39:44<51:04:37,  7.81s/it]
 38%|███▊      | 14434/37963 [32:39:51<50:24:21,  7.71s/it]
 38%|███▊      | 14435/37963 [32:39:59<50:48:01,  7.77s/it]
 38%|███▊      | 14436/37963 [32:40:07<50:27:18,  7.72s/it]
 38%|███▊      | 14437/37963 [32:40:15<50:32:26,  7.73s/it]
 38%|███▊      | 14438/37963 [32:40:22<50:17:28,  7.70s/it]
 38%|███▊      | 14439/37963 [32:40:30<50:02:12,  7.66s/it]
 38%|███▊      | 14440/37963 [32:40:38<50:27:40,  7.72s/it]
                                                           
{'loss': '0.1743', 'grad_norm': '1.504', 'learning_rate': '1.422e-05', 'epoch': '0.3804'}
+
 38%|███▊      | 14440/37963 [32:40:38<50:27:40,  7.72s/it]
 38%|███▊      | 14441/37963 [32:40:45<50:01:13,  7.66s/it]
 38%|███▊      | 14442/37963 [32:40:55<55:22:39,  8.48s/it]
 38%|███▊      | 14443/37963 [32:41:03<54:29:52,  8.34s/it]
 38%|███▊      | 14444/37963 [32:41:11<53:06:55,  8.13s/it]
 38%|███▊      | 14445/37963 [32:41:19<52:15:29,  8.00s/it]
 38%|███▊      | 14446/37963 [32:41:27<51:46:23,  7.93s/it]
 38%|███▊      | 14447/37963 [32:41:34<51:42:46,  7.92s/it]
 38%|███▊      | 14448/37963 [32:41:42<51:10:25,  7.83s/it]
 38%|███▊      | 14449/37963 [32:41:50<50:50:47,  7.78s/it]
 38%|███▊      | 14450/37963 [32:41:57<50:43:25,  7.77s/it]
                                                           
{'loss': '0.1729', 'grad_norm': '3.519', 'learning_rate': '1.422e-05', 'epoch': '0.3806'}
+
 38%|███▊      | 14450/37963 [32:41:57<50:43:25,  7.77s/it]
 38%|███▊      | 14451/37963 [32:42:08<55:22:22,  8.48s/it]
 38%|███▊      | 14452/37963 [32:42:15<53:37:32,  8.21s/it]
 38%|███▊      | 14453/37963 [32:42:23<52:57:11,  8.11s/it]
 38%|███▊      | 14454/37963 [32:42:31<52:11:12,  7.99s/it]
 38%|███▊      | 14455/37963 [32:42:38<51:35:30,  7.90s/it]
 38%|███▊      | 14456/37963 [32:42:46<51:15:24,  7.85s/it]
 38%|███▊      | 14457/37963 [32:42:54<51:15:36,  7.85s/it]
 38%|███▊      | 14458/37963 [32:43:02<50:59:15,  7.81s/it]
 38%|███▊      | 14459/37963 [32:43:09<50:38:44,  7.76s/it]
 38%|███▊      | 14460/37963 [32:43:20<55:37:58,  8.52s/it]
                                                           
{'loss': '0.1689', 'grad_norm': '2.506', 'learning_rate': '1.421e-05', 'epoch': '0.3809'}
+
 38%|███▊      | 14460/37963 [32:43:20<55:37:58,  8.52s/it]
 38%|███▊      | 14461/37963 [32:43:27<53:54:35,  8.26s/it]
 38%|███▊      | 14462/37963 [32:43:35<52:28:32,  8.04s/it]
 38%|███▊      | 14463/37963 [32:43:43<52:00:09,  7.97s/it]
 38%|███▊      | 14464/37963 [32:43:51<51:41:18,  7.92s/it]
 38%|███▊      | 14465/37963 [32:43:58<50:59:03,  7.81s/it]
 38%|███▊      | 14466/37963 [32:44:08<55:54:24,  8.57s/it]
 38%|███▊      | 14467/37963 [32:44:16<54:00:29,  8.28s/it]
 38%|███▊      | 14468/37963 [32:44:24<52:49:35,  8.09s/it]
 38%|███▊      | 14469/37963 [32:44:34<57:23:37,  8.79s/it]
 38%|███▊      | 14470/37963 [32:44:44<59:51:02,  9.17s/it]
                                                           
{'loss': '0.1768', 'grad_norm': '2.972', 'learning_rate': '1.42e-05', 'epoch': '0.3812'}
+
 38%|███▊      | 14470/37963 [32:44:44<59:51:02,  9.17s/it]
 38%|███▊      | 14471/37963 [32:44:51<56:13:52,  8.62s/it]
 38%|███▊      | 14472/37963 [32:44:59<54:48:53,  8.40s/it]
 38%|███▊      | 14473/37963 [32:45:07<53:15:39,  8.16s/it]
 38%|███▊      | 14474/37963 [32:45:15<52:09:26,  7.99s/it]
 38%|███▊      | 14475/37963 [32:45:23<52:07:15,  7.99s/it]
 38%|███▊      | 14476/37963 [32:45:33<56:53:03,  8.72s/it]
 38%|███▊      | 14477/37963 [32:45:41<54:56:45,  8.42s/it]
 38%|███▊      | 14478/37963 [32:45:48<53:01:15,  8.13s/it]
 38%|███▊      | 14479/37963 [32:45:58<57:08:01,  8.76s/it]
 38%|███▊      | 14480/37963 [32:46:06<55:28:04,  8.50s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '1.731', 'learning_rate': '1.419e-05', 'epoch': '0.3814'}
+
 38%|███▊      | 14480/37963 [32:46:06<55:28:04,  8.50s/it]
 38%|███▊      | 14481/37963 [32:46:14<54:09:21,  8.30s/it]
 38%|███▊      | 14482/37963 [32:46:22<52:52:15,  8.11s/it]
 38%|███▊      | 14483/37963 [32:46:29<51:54:04,  7.96s/it]
 38%|███▊      | 14484/37963 [32:46:37<50:52:08,  7.80s/it]
 38%|███▊      | 14485/37963 [32:46:47<56:07:40,  8.61s/it]
 38%|███▊      | 14486/37963 [32:46:55<54:34:17,  8.37s/it]
 38%|███▊      | 14487/37963 [32:47:03<53:35:24,  8.22s/it]
 38%|███▊      | 14488/37963 [32:47:11<52:35:53,  8.07s/it]
 38%|███▊      | 14489/37963 [32:47:18<51:33:24,  7.91s/it]
 38%|███▊      | 14490/37963 [32:47:26<51:10:17,  7.85s/it]
                                                           
{'loss': '0.1632', 'grad_norm': '1.315', 'learning_rate': '1.419e-05', 'epoch': '0.3817'}
+
 38%|███▊      | 14490/37963 [32:47:26<51:10:17,  7.85s/it]
 38%|███▊      | 14491/37963 [32:47:34<51:20:59,  7.88s/it]
 38%|███▊      | 14492/37963 [32:47:42<50:54:14,  7.81s/it]
 38%|███▊      | 14493/37963 [32:47:49<50:34:49,  7.76s/it]
 38%|███▊      | 14494/37963 [32:47:57<50:00:29,  7.67s/it]
 38%|███▊      | 14495/37963 [32:48:04<50:03:06,  7.68s/it]
 38%|███▊      | 14496/37963 [32:48:12<49:54:57,  7.66s/it]
 38%|███▊      | 14497/37963 [32:48:20<49:46:44,  7.64s/it]
 38%|███▊      | 14498/37963 [32:48:27<49:53:55,  7.66s/it]
 38%|███▊      | 14499/37963 [32:48:37<54:46:26,  8.40s/it]
 38%|███▊      | 14500/37963 [32:48:45<53:00:53,  8.13s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '5.197', 'learning_rate': '1.418e-05', 'epoch': '0.382'}
+
 38%|███▊      | 14500/37963 [32:48:45<53:00:53,  8.13s/it]
 38%|███▊      | 14501/37963 [32:48:53<52:40:55,  8.08s/it]
 38%|███▊      | 14502/37963 [32:49:01<52:27:12,  8.05s/it]
 38%|███▊      | 14503/37963 [32:49:08<51:18:14,  7.87s/it]
 38%|███▊      | 14504/37963 [32:49:15<49:59:48,  7.67s/it]
 38%|███▊      | 14505/37963 [32:49:23<50:00:43,  7.68s/it]
 38%|███▊      | 14506/37963 [32:49:31<50:01:15,  7.68s/it]
 38%|███▊      | 14507/37963 [32:49:38<49:36:25,  7.61s/it]
 38%|███▊      | 14508/37963 [32:49:46<49:50:35,  7.65s/it]
 38%|███▊      | 14509/37963 [32:49:56<55:04:05,  8.45s/it]
 38%|███▊      | 14510/37963 [32:50:07<58:48:47,  9.03s/it]
                                                           
{'loss': '0.1513', 'grad_norm': '5.092', 'learning_rate': '1.417e-05', 'epoch': '0.3822'}
+
 38%|███▊      | 14510/37963 [32:50:07<58:48:47,  9.03s/it]
 38%|███▊      | 14511/37963 [32:50:14<56:04:34,  8.61s/it]
 38%|███▊      | 14512/37963 [32:50:22<54:31:55,  8.37s/it]
 38%|███▊      | 14513/37963 [32:50:32<58:07:44,  8.92s/it]
 38%|███▊      | 14514/37963 [32:50:42<60:19:33,  9.26s/it]
 38%|███▊      | 14515/37963 [32:50:50<56:29:18,  8.67s/it]
 38%|███▊      | 14516/37963 [32:50:57<54:22:48,  8.35s/it]
 38%|███▊      | 14517/37963 [32:51:05<53:22:34,  8.20s/it]
 38%|███▊      | 14518/37963 [32:51:13<52:13:10,  8.02s/it]
 38%|███▊      | 14519/37963 [32:51:20<51:17:18,  7.88s/it]
 38%|███▊      | 14520/37963 [32:51:28<51:02:56,  7.84s/it]
                                                           
{'loss': '0.1787', 'grad_norm': '3.465', 'learning_rate': '1.416e-05', 'epoch': '0.3825'}
+
 38%|███▊      | 14520/37963 [32:51:28<51:02:56,  7.84s/it]
 38%|███▊      | 14521/37963 [32:51:36<50:31:00,  7.76s/it]
 38%|███▊      | 14522/37963 [32:51:43<50:35:07,  7.77s/it]
 38%|███▊      | 14523/37963 [32:51:51<50:32:09,  7.76s/it]
 38%|███▊      | 14524/37963 [32:52:02<55:56:42,  8.59s/it]
 38%|███▊      | 14525/37963 [32:52:09<54:08:49,  8.32s/it]
 38%|███▊      | 14526/37963 [32:52:18<53:49:00,  8.27s/it]
 38%|███▊      | 14527/37963 [32:52:25<53:01:58,  8.15s/it]
 38%|███▊      | 14528/37963 [32:52:33<52:37:47,  8.08s/it]
 38%|███▊      | 14529/37963 [32:52:41<52:03:38,  8.00s/it]
 38%|███▊      | 14530/37963 [32:52:51<55:48:35,  8.57s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '3.331', 'learning_rate': '1.415e-05', 'epoch': '0.3827'}
+
 38%|███▊      | 14530/37963 [32:52:51<55:48:35,  8.57s/it]
 38%|███▊      | 14531/37963 [32:52:59<54:24:27,  8.36s/it]
 38%|███▊      | 14532/37963 [32:53:06<52:27:37,  8.06s/it]
 38%|███▊      | 14533/37963 [32:53:14<51:34:07,  7.92s/it]
 38%|███▊      | 14534/37963 [32:53:24<56:34:18,  8.69s/it]
 38%|███▊      | 14535/37963 [32:53:32<54:32:29,  8.38s/it]
 38%|███▊      | 14536/37963 [32:53:40<53:24:20,  8.21s/it]
 38%|███▊      | 14537/37963 [32:53:48<52:32:18,  8.07s/it]
 38%|███▊      | 14538/37963 [32:53:55<51:40:06,  7.94s/it]
 38%|███▊      | 14539/37963 [32:54:03<51:08:12,  7.86s/it]
 38%|███▊      | 14540/37963 [32:54:11<50:47:32,  7.81s/it]
                                                           
{'loss': '0.1677', 'grad_norm': '1.459', 'learning_rate': '1.415e-05', 'epoch': '0.383'}
+
 38%|███▊      | 14540/37963 [32:54:11<50:47:32,  7.81s/it]
 38%|███▊      | 14541/37963 [32:54:18<49:52:27,  7.67s/it]
 38%|███▊      | 14542/37963 [32:54:25<49:22:06,  7.59s/it]
 38%|███▊      | 14543/37963 [32:54:33<49:32:28,  7.62s/it]
 38%|███▊      | 14544/37963 [32:54:41<49:29:31,  7.61s/it]
 38%|███▊      | 14545/37963 [32:54:48<49:38:04,  7.63s/it]
 38%|███▊      | 14546/37963 [32:54:56<50:05:35,  7.70s/it]
 38%|███▊      | 14547/37963 [32:55:04<49:52:58,  7.67s/it]
 38%|███▊      | 14548/37963 [32:55:14<55:13:45,  8.49s/it]
 38%|███▊      | 14549/37963 [32:55:22<53:35:21,  8.24s/it]
 38%|███▊      | 14550/37963 [32:55:30<52:45:21,  8.11s/it]
                                                           
{'loss': '0.1773', 'grad_norm': '1.7', 'learning_rate': '1.414e-05', 'epoch': '0.3833'}
+
 38%|███▊      | 14550/37963 [32:55:30<52:45:21,  8.11s/it]
 38%|███▊      | 14551/37963 [32:55:37<50:58:37,  7.84s/it]
 38%|███▊      | 14552/37963 [32:55:44<50:34:01,  7.78s/it]
 38%|███▊      | 14553/37963 [32:55:55<55:31:28,  8.54s/it]
 38%|███▊      | 14554/37963 [32:56:02<53:54:46,  8.29s/it]
 38%|███▊      | 14555/37963 [32:56:10<52:47:17,  8.12s/it]
 38%|███▊      | 14556/37963 [32:56:18<51:53:47,  7.98s/it]
 38%|███▊      | 14557/37963 [32:56:33<66:11:24, 10.18s/it]
 38%|███▊      | 14558/37963 [32:56:41<60:47:18,  9.35s/it]
 38%|███▊      | 14559/37963 [32:56:48<57:27:07,  8.84s/it]
 38%|███▊      | 14560/37963 [32:56:56<55:16:36,  8.50s/it]
                                                           
{'loss': '0.1926', 'grad_norm': '1.591', 'learning_rate': '1.413e-05', 'epoch': '0.3835'}
+
 38%|███▊      | 14560/37963 [32:56:56<55:16:36,  8.50s/it]
 38%|███▊      | 14561/37963 [32:57:03<53:09:56,  8.18s/it]
 38%|███▊      | 14562/37963 [32:57:11<52:16:02,  8.04s/it]
 38%|███▊      | 14563/37963 [32:57:19<51:46:38,  7.97s/it]
 38%|███▊      | 14564/37963 [32:57:27<51:31:29,  7.93s/it]
 38%|███▊      | 14565/37963 [32:57:35<51:23:26,  7.91s/it]
 38%|███▊      | 14566/37963 [32:57:42<50:11:19,  7.72s/it]
 38%|███▊      | 14567/37963 [32:57:52<54:37:10,  8.40s/it]
 38%|███▊      | 14568/37963 [32:57:59<53:01:57,  8.16s/it]
 38%|███▊      | 14569/37963 [32:58:07<52:03:20,  8.01s/it]
 38%|███▊      | 14570/37963 [32:58:15<51:44:27,  7.96s/it]
                                                           
{'loss': '0.1613', 'grad_norm': '0.9814', 'learning_rate': '1.412e-05', 'epoch': '0.3838'}
+
 38%|███▊      | 14570/37963 [32:58:15<51:44:27,  7.96s/it]
 38%|███▊      | 14571/37963 [32:58:23<51:31:07,  7.93s/it]
 38%|███▊      | 14572/37963 [32:58:31<51:18:08,  7.90s/it]
 38%|███▊      | 14573/37963 [32:58:38<51:06:52,  7.87s/it]
 38%|███▊      | 14574/37963 [32:58:48<55:14:43,  8.50s/it]
 38%|███▊      | 14575/37963 [32:58:56<53:53:44,  8.30s/it]
 38%|███▊      | 14576/37963 [32:59:04<52:47:51,  8.13s/it]
 38%|███▊      | 14577/37963 [32:59:12<52:05:44,  8.02s/it]
 38%|███▊      | 14578/37963 [32:59:19<51:18:47,  7.90s/it]
 38%|███▊      | 14579/37963 [32:59:27<51:29:30,  7.93s/it]
 38%|███▊      | 14580/37963 [32:59:35<50:33:18,  7.78s/it]
                                                           
{'loss': '0.1788', 'grad_norm': '1.982', 'learning_rate': '1.412e-05', 'epoch': '0.3841'}
+
 38%|███▊      | 14580/37963 [32:59:35<50:33:18,  7.78s/it]
 38%|███▊      | 14581/37963 [32:59:42<49:48:06,  7.67s/it]
 38%|███▊      | 14582/37963 [32:59:53<55:04:10,  8.48s/it]
 38%|███▊      | 14583/37963 [33:00:00<53:39:22,  8.26s/it]
 38%|███▊      | 14584/37963 [33:00:08<52:40:39,  8.11s/it]
 38%|███▊      | 14585/37963 [33:00:16<52:05:05,  8.02s/it]
 38%|███▊      | 14586/37963 [33:00:23<51:15:14,  7.89s/it]
 38%|███▊      | 14587/37963 [33:00:31<50:42:43,  7.81s/it]
 38%|███▊      | 14588/37963 [33:00:39<50:45:22,  7.82s/it]
 38%|███▊      | 14589/37963 [33:00:46<50:15:54,  7.74s/it]
 38%|███▊      | 14590/37963 [33:00:54<50:08:15,  7.72s/it]
                                                           
{'loss': '0.1733', 'grad_norm': '5.498', 'learning_rate': '1.411e-05', 'epoch': '0.3843'}
+
 38%|███▊      | 14590/37963 [33:00:54<50:08:15,  7.72s/it]
 38%|███▊      | 14591/37963 [33:01:02<49:52:24,  7.68s/it]
 38%|███▊      | 14592/37963 [33:01:09<49:51:24,  7.68s/it]
 38%|███▊      | 14593/37963 [33:01:17<50:16:37,  7.74s/it]
 38%|███▊      | 14594/37963 [33:01:25<50:00:05,  7.70s/it]
 38%|███▊      | 14595/37963 [33:01:33<50:17:42,  7.75s/it]
 38%|███▊      | 14596/37963 [33:01:41<50:25:45,  7.77s/it]
 38%|███▊      | 14597/37963 [33:01:48<50:17:42,  7.75s/it]
 38%|███▊      | 14598/37963 [33:01:56<50:17:31,  7.75s/it]
 38%|███▊      | 14599/37963 [33:02:04<50:29:02,  7.78s/it]
 38%|███▊      | 14600/37963 [33:02:12<50:27:02,  7.77s/it]
                                                           
{'loss': '0.173', 'grad_norm': '4.367', 'learning_rate': '1.41e-05', 'epoch': '0.3846'}
+
 38%|███▊      | 14600/37963 [33:02:12<50:27:02,  7.77s/it]
 38%|███▊      | 14601/37963 [33:02:27<65:09:55, 10.04s/it]
 38%|███▊      | 14602/37963 [33:02:35<60:20:57,  9.30s/it]
 38%|███▊      | 14603/37963 [33:02:42<57:00:17,  8.79s/it]
 38%|███▊      | 14604/37963 [33:02:50<54:26:43,  8.39s/it]
 38%|███▊      | 14605/37963 [33:02:57<52:59:17,  8.17s/it]
 38%|███▊      | 14606/37963 [33:03:05<51:21:24,  7.92s/it]
 38%|███▊      | 14607/37963 [33:03:15<56:20:12,  8.68s/it]
 38%|███▊      | 14608/37963 [33:03:23<54:12:17,  8.36s/it]
 38%|███▊      | 14609/37963 [33:03:31<53:13:48,  8.21s/it]
 38%|███▊      | 14610/37963 [33:03:38<52:29:19,  8.09s/it]
                                                           
{'loss': '0.1708', 'grad_norm': '1.353', 'learning_rate': '1.409e-05', 'epoch': '0.3848'}
+
 38%|███▊      | 14610/37963 [33:03:38<52:29:19,  8.09s/it]
 38%|███▊      | 14611/37963 [33:03:51<62:21:59,  9.61s/it]
 38%|███▊      | 14612/37963 [33:03:59<58:34:23,  9.03s/it]
 38%|███▊      | 14613/37963 [33:04:07<55:24:15,  8.54s/it]
 38%|███▊      | 14614/37963 [33:04:15<54:31:14,  8.41s/it]
 38%|███▊      | 14615/37963 [33:04:22<52:07:33,  8.04s/it]
 39%|███▊      | 14616/37963 [33:04:29<51:20:40,  7.92s/it]
 39%|███▊      | 14617/37963 [33:04:37<50:57:06,  7.86s/it]
 39%|███▊      | 14618/37963 [33:04:45<50:13:58,  7.75s/it]
 39%|███▊      | 14619/37963 [33:04:52<49:44:34,  7.67s/it]
 39%|███▊      | 14620/37963 [33:05:00<49:43:03,  7.67s/it]
                                                           
{'loss': '0.1761', 'grad_norm': '2.16', 'learning_rate': '1.408e-05', 'epoch': '0.3851'}
+
 39%|███▊      | 14620/37963 [33:05:00<49:43:03,  7.67s/it]
 39%|███▊      | 14621/37963 [33:05:08<50:10:57,  7.74s/it]
 39%|███▊      | 14622/37963 [33:05:16<50:22:21,  7.77s/it]
 39%|███▊      | 14623/37963 [33:05:24<50:44:52,  7.83s/it]
 39%|███▊      | 14624/37963 [33:05:31<50:16:30,  7.75s/it]
 39%|███▊      | 14625/37963 [33:05:41<55:00:49,  8.49s/it]
 39%|███▊      | 14626/37963 [33:05:49<53:30:48,  8.26s/it]
 39%|███▊      | 14627/37963 [33:05:59<57:23:47,  8.85s/it]
 39%|███▊      | 14628/37963 [33:06:07<54:20:21,  8.38s/it]
 39%|███▊      | 14629/37963 [33:06:14<53:22:44,  8.24s/it]
 39%|███▊      | 14630/37963 [33:06:22<52:03:15,  8.03s/it]
                                                           
{'loss': '0.1639', 'grad_norm': '2.272', 'learning_rate': '1.408e-05', 'epoch': '0.3854'}
+
 39%|███▊      | 14630/37963 [33:06:22<52:03:15,  8.03s/it]
 39%|███▊      | 14631/37963 [33:06:29<50:54:12,  7.85s/it]
 39%|███▊      | 14632/37963 [33:06:37<51:03:17,  7.88s/it]
 39%|███▊      | 14633/37963 [33:06:45<50:37:45,  7.81s/it]
 39%|███▊      | 14634/37963 [33:06:53<50:10:37,  7.74s/it]
 39%|███▊      | 14635/37963 [33:07:00<50:18:23,  7.76s/it]
 39%|███▊      | 14636/37963 [33:07:08<50:08:05,  7.74s/it]
 39%|███▊      | 14637/37963 [33:07:16<49:52:41,  7.70s/it]
 39%|███▊      | 14638/37963 [33:07:24<50:04:44,  7.73s/it]
 39%|███▊      | 14639/37963 [33:07:31<50:00:57,  7.72s/it]
 39%|███▊      | 14640/37963 [33:07:39<50:02:20,  7.72s/it]
                                                           
{'loss': '0.1872', 'grad_norm': '1.196', 'learning_rate': '1.407e-05', 'epoch': '0.3856'}
+
 39%|███▊      | 14640/37963 [33:07:39<50:02:20,  7.72s/it]
 39%|███▊      | 14641/37963 [33:07:47<49:55:36,  7.71s/it]
 39%|███▊      | 14642/37963 [33:07:54<49:50:54,  7.69s/it]
 39%|███▊      | 14643/37963 [33:08:02<50:07:45,  7.74s/it]
 39%|███▊      | 14644/37963 [33:08:10<49:48:17,  7.69s/it]
 39%|███▊      | 14645/37963 [33:08:23<59:56:33,  9.25s/it]
 39%|███▊      | 14646/37963 [33:08:30<56:48:34,  8.77s/it]
 39%|███▊      | 14647/37963 [33:08:38<55:00:23,  8.49s/it]
 39%|███▊      | 14648/37963 [33:08:46<53:20:44,  8.24s/it]
 39%|███▊      | 14649/37963 [33:08:53<52:01:14,  8.03s/it]
 39%|███▊      | 14650/37963 [33:09:03<56:11:19,  8.68s/it]
                                                           
{'loss': '0.1759', 'grad_norm': '2.004', 'learning_rate': '1.406e-05', 'epoch': '0.3859'}
+
 39%|███▊      | 14650/37963 [33:09:03<56:11:19,  8.68s/it]
 39%|███▊      | 14651/37963 [33:09:11<53:45:01,  8.30s/it]
 39%|███▊      | 14652/37963 [33:09:19<52:42:00,  8.14s/it]
 39%|███▊      | 14653/37963 [33:09:26<51:18:03,  7.92s/it]
 39%|███▊      | 14654/37963 [33:09:34<51:05:25,  7.89s/it]
 39%|███▊      | 14655/37963 [33:09:44<56:04:17,  8.66s/it]
 39%|███▊      | 14656/37963 [33:09:52<54:46:38,  8.46s/it]
 39%|███▊      | 14657/37963 [33:10:00<53:33:13,  8.27s/it]
 39%|███▊      | 14658/37963 [33:10:08<52:10:28,  8.06s/it]
 39%|███▊      | 14659/37963 [33:10:15<51:32:17,  7.96s/it]
 39%|███▊      | 14660/37963 [33:10:23<51:17:55,  7.92s/it]
                                                           
{'loss': '0.1683', 'grad_norm': '2.093', 'learning_rate': '1.405e-05', 'epoch': '0.3862'}
+
 39%|███▊      | 14660/37963 [33:10:23<51:17:55,  7.92s/it]
 39%|███▊      | 14661/37963 [33:10:31<51:21:53,  7.94s/it]
 39%|███▊      | 14662/37963 [33:10:39<50:41:40,  7.83s/it]
 39%|███▊      | 14663/37963 [33:10:47<50:23:27,  7.79s/it]
 39%|███▊      | 14664/37963 [33:10:54<50:12:41,  7.76s/it]
 39%|███▊      | 14665/37963 [33:11:05<55:47:01,  8.62s/it]
 39%|███▊      | 14666/37963 [33:11:13<54:33:18,  8.43s/it]
 39%|███▊      | 14667/37963 [33:11:20<52:55:57,  8.18s/it]
 39%|███▊      | 14668/37963 [33:11:28<52:28:20,  8.11s/it]
 39%|███▊      | 14669/37963 [33:11:39<56:48:56,  8.78s/it]
 39%|███▊      | 14670/37963 [33:11:49<59:39:21,  9.22s/it]
                                                           
{'loss': '0.1749', 'grad_norm': '1.597', 'learning_rate': '1.405e-05', 'epoch': '0.3864'}
+
 39%|███▊      | 14670/37963 [33:11:49<59:39:21,  9.22s/it]
 39%|███▊      | 14671/37963 [33:11:57<56:37:18,  8.75s/it]
 39%|███▊      | 14672/37963 [33:12:05<55:01:15,  8.50s/it]
 39%|███▊      | 14673/37963 [33:12:12<53:23:03,  8.25s/it]
 39%|███▊      | 14674/37963 [33:12:20<52:46:42,  8.16s/it]
 39%|███▊      | 14675/37963 [33:12:28<52:05:12,  8.05s/it]
 39%|███▊      | 14676/37963 [33:12:36<51:26:19,  7.95s/it]
 39%|███▊      | 14677/37963 [33:12:43<51:06:34,  7.90s/it]
 39%|███▊      | 14678/37963 [33:12:51<50:13:35,  7.77s/it]
 39%|███▊      | 14679/37963 [33:12:59<50:11:42,  7.76s/it]
 39%|███▊      | 14680/37963 [33:13:06<50:09:28,  7.76s/it]
                                                           
{'loss': '0.1506', 'grad_norm': '1.07', 'learning_rate': '1.404e-05', 'epoch': '0.3867'}
+
 39%|███▊      | 14680/37963 [33:13:06<50:09:28,  7.76s/it]
 39%|███▊      | 14681/37963 [33:13:14<49:23:25,  7.64s/it]
 39%|███▊      | 14682/37963 [33:13:22<49:50:32,  7.71s/it]
 39%|███▊      | 14683/37963 [33:13:30<50:15:48,  7.77s/it]
 39%|███▊      | 14684/37963 [33:13:37<50:27:38,  7.80s/it]
 39%|███▊      | 14685/37963 [33:13:45<49:52:27,  7.71s/it]
 39%|███▊      | 14686/37963 [33:13:53<49:55:54,  7.72s/it]
 39%|███▊      | 14687/37963 [33:14:00<50:01:58,  7.74s/it]
 39%|███▊      | 14688/37963 [33:14:11<55:15:17,  8.55s/it]
 39%|███▊      | 14689/37963 [33:14:21<58:51:29,  9.10s/it]
 39%|███▊      | 14690/37963 [33:14:29<56:11:00,  8.69s/it]
                                                           
{'loss': '0.162', 'grad_norm': '1.402', 'learning_rate': '1.403e-05', 'epoch': '0.387'}
+
 39%|███▊      | 14690/37963 [33:14:29<56:11:00,  8.69s/it]
 39%|███▊      | 14691/37963 [33:14:37<54:31:15,  8.43s/it]
 39%|███▊      | 14692/37963 [33:14:45<53:26:39,  8.27s/it]
 39%|███▊      | 14693/37963 [33:14:53<52:34:25,  8.13s/it]
 39%|███▊      | 14694/37963 [33:15:00<51:52:43,  8.03s/it]
 39%|███▊      | 14695/37963 [33:15:08<51:02:33,  7.90s/it]
 39%|███▊      | 14696/37963 [33:15:15<50:10:01,  7.76s/it]
 39%|███▊      | 14697/37963 [33:15:23<50:06:10,  7.75s/it]
 39%|███▊      | 14698/37963 [33:15:33<54:52:58,  8.49s/it]
 39%|███▊      | 14699/37963 [33:15:43<58:00:45,  8.98s/it]
 39%|███▊      | 14700/37963 [33:15:51<55:46:05,  8.63s/it]
                                                           
{'loss': '0.1502', 'grad_norm': '2.065', 'learning_rate': '1.402e-05', 'epoch': '0.3872'}
+
 39%|███▊      | 14700/37963 [33:15:51<55:46:05,  8.63s/it]
 39%|███▊      | 14701/37963 [33:15:59<53:45:39,  8.32s/it]
 39%|███▊      | 14702/37963 [33:16:07<52:36:45,  8.14s/it]
 39%|███▊      | 14703/37963 [33:16:14<51:03:03,  7.90s/it]
 39%|███▊      | 14704/37963 [33:16:22<50:44:48,  7.85s/it]
 39%|███▊      | 14705/37963 [33:16:29<50:34:38,  7.83s/it]
 39%|███▊      | 14706/37963 [33:16:37<50:08:35,  7.76s/it]
 39%|███▊      | 14707/37963 [33:16:45<50:15:14,  7.78s/it]
 39%|███▊      | 14708/37963 [33:16:53<50:26:00,  7.81s/it]
 39%|███▊      | 14709/37963 [33:17:03<55:41:18,  8.62s/it]
 39%|███▊      | 14710/37963 [33:17:11<54:27:06,  8.43s/it]
                                                           
{'loss': '0.171', 'grad_norm': '1.479', 'learning_rate': '1.401e-05', 'epoch': '0.3875'}
+
 39%|███▊      | 14710/37963 [33:17:11<54:27:06,  8.43s/it]
 39%|███▉      | 14711/37963 [33:17:19<53:35:40,  8.30s/it]
 39%|███▉      | 14712/37963 [33:17:27<52:16:51,  8.09s/it]
 39%|███▉      | 14713/37963 [33:17:37<56:43:15,  8.78s/it]
 39%|███▉      | 14714/37963 [33:17:48<59:36:34,  9.23s/it]
 39%|███▉      | 14715/37963 [33:17:55<56:29:42,  8.75s/it]
 39%|███▉      | 14716/37963 [33:18:03<54:06:35,  8.38s/it]
 39%|███▉      | 14717/37963 [33:18:10<52:37:03,  8.15s/it]
 39%|███▉      | 14718/37963 [33:18:18<51:46:18,  8.02s/it]
 39%|███▉      | 14719/37963 [33:18:26<51:29:15,  7.97s/it]
 39%|███▉      | 14720/37963 [33:18:34<51:23:19,  7.96s/it]
                                                           
{'loss': '0.1624', 'grad_norm': '3.122', 'learning_rate': '1.401e-05', 'epoch': '0.3877'}
+
 39%|███▉      | 14720/37963 [33:18:34<51:23:19,  7.96s/it]
 39%|███▉      | 14721/37963 [33:18:41<50:44:02,  7.86s/it]
 39%|███▉      | 14722/37963 [33:18:49<50:48:25,  7.87s/it]
 39%|███▉      | 14723/37963 [33:19:00<55:37:55,  8.62s/it]
 39%|███▉      | 14724/37963 [33:19:07<53:16:00,  8.25s/it]
 39%|███▉      | 14725/37963 [33:19:15<52:01:33,  8.06s/it]
 39%|███▉      | 14726/37963 [33:19:22<51:14:36,  7.94s/it]
 39%|███▉      | 14727/37963 [33:19:30<50:25:41,  7.81s/it]
 39%|███▉      | 14728/37963 [33:19:37<50:05:55,  7.76s/it]
 39%|███▉      | 14729/37963 [33:19:45<49:39:10,  7.69s/it]
 39%|███▉      | 14730/37963 [33:19:53<49:26:52,  7.66s/it]
                                                           
{'loss': '0.1681', 'grad_norm': '3.315', 'learning_rate': '1.4e-05', 'epoch': '0.388'}
+
 39%|███▉      | 14730/37963 [33:19:53<49:26:52,  7.66s/it]
 39%|███▉      | 14731/37963 [33:20:00<49:20:04,  7.64s/it]
 39%|███▉      | 14732/37963 [33:20:10<54:20:05,  8.42s/it]
 39%|███▉      | 14733/37963 [33:20:18<53:18:11,  8.26s/it]
 39%|███▉      | 14734/37963 [33:20:26<51:44:17,  8.02s/it]
 39%|███▉      | 14735/37963 [33:20:34<51:13:10,  7.94s/it]
 39%|███▉      | 14736/37963 [33:20:41<50:16:08,  7.79s/it]
 39%|███▉      | 14737/37963 [33:20:51<54:29:48,  8.45s/it]
 39%|███▉      | 14738/37963 [33:20:59<52:51:00,  8.19s/it]
 39%|███▉      | 14739/37963 [33:21:06<51:33:46,  7.99s/it]
 39%|███▉      | 14740/37963 [33:21:14<51:00:52,  7.91s/it]
                                                           
{'loss': '0.1661', 'grad_norm': '2.603', 'learning_rate': '1.399e-05', 'epoch': '0.3883'}
+
 39%|███▉      | 14740/37963 [33:21:14<51:00:52,  7.91s/it]
 39%|███▉      | 14741/37963 [33:21:22<50:42:00,  7.86s/it]
 39%|███▉      | 14742/37963 [33:21:31<54:41:47,  8.48s/it]
 39%|███▉      | 14743/37963 [33:21:42<58:09:21,  9.02s/it]
 39%|███▉      | 14744/37963 [33:21:50<55:46:31,  8.65s/it]
 39%|███▉      | 14745/37963 [33:21:57<54:00:08,  8.37s/it]
 39%|███▉      | 14746/37963 [33:22:04<51:45:09,  8.02s/it]
 39%|███▉      | 14747/37963 [33:22:12<50:59:16,  7.91s/it]
 39%|███▉      | 14748/37963 [33:22:19<49:48:57,  7.73s/it]
 39%|███▉      | 14749/37963 [33:22:27<49:33:12,  7.68s/it]
 39%|███▉      | 14750/37963 [33:22:35<49:30:44,  7.68s/it]
                                                           
{'loss': '0.1728', 'grad_norm': '1.12', 'learning_rate': '1.398e-05', 'epoch': '0.3885'}
+
 39%|███▉      | 14750/37963 [33:22:35<49:30:44,  7.68s/it]
 39%|███▉      | 14751/37963 [33:22:42<49:18:34,  7.65s/it]
 39%|███▉      | 14752/37963 [33:22:50<49:14:03,  7.64s/it]
 39%|███▉      | 14753/37963 [33:23:00<54:41:22,  8.48s/it]
 39%|███▉      | 14754/37963 [33:23:08<52:42:17,  8.18s/it]
 39%|███▉      | 14755/37963 [33:23:16<51:57:09,  8.06s/it]
 39%|███▉      | 14756/37963 [33:23:23<51:08:37,  7.93s/it]
 39%|███▉      | 14757/37963 [33:23:34<56:00:48,  8.69s/it]
 39%|███▉      | 14758/37963 [33:23:41<53:55:00,  8.36s/it]
 39%|███▉      | 14759/37963 [33:23:49<52:25:19,  8.13s/it]
 39%|███▉      | 14760/37963 [33:23:57<51:46:31,  8.03s/it]
                                                           
{'loss': '0.1564', 'grad_norm': '4.019', 'learning_rate': '1.398e-05', 'epoch': '0.3888'}
+
 39%|███▉      | 14760/37963 [33:23:57<51:46:31,  8.03s/it]
 39%|███▉      | 14761/37963 [33:24:07<56:27:19,  8.76s/it]
 39%|███▉      | 14762/37963 [33:24:15<54:49:48,  8.51s/it]
 39%|███▉      | 14763/37963 [33:24:23<53:08:41,  8.25s/it]
 39%|███▉      | 14764/37963 [33:24:31<52:24:42,  8.13s/it]
 39%|███▉      | 14765/37963 [33:24:38<51:29:27,  7.99s/it]
 39%|███▉      | 14766/37963 [33:24:46<50:37:00,  7.86s/it]
 39%|███▉      | 14767/37963 [33:24:53<50:12:47,  7.79s/it]
 39%|███▉      | 14768/37963 [33:25:01<50:19:32,  7.81s/it]
 39%|███▉      | 14769/37963 [33:25:09<50:32:56,  7.85s/it]
 39%|███▉      | 14770/37963 [33:25:17<50:15:38,  7.80s/it]
                                                           
{'loss': '0.1673', 'grad_norm': '2.305', 'learning_rate': '1.397e-05', 'epoch': '0.3891'}
+
 39%|███▉      | 14770/37963 [33:25:17<50:15:38,  7.80s/it]
 39%|███▉      | 14771/37963 [33:25:25<50:34:48,  7.85s/it]
 39%|███▉      | 14772/37963 [33:25:32<50:08:22,  7.78s/it]
 39%|███▉      | 14773/37963 [33:25:40<49:41:44,  7.71s/it]
 39%|███▉      | 14774/37963 [33:25:48<49:37:01,  7.70s/it]
 39%|███▉      | 14775/37963 [33:25:58<54:12:27,  8.42s/it]
 39%|███▉      | 14776/37963 [33:26:06<53:11:06,  8.26s/it]
 39%|███▉      | 14777/37963 [33:26:16<57:00:33,  8.85s/it]
 39%|███▉      | 14778/37963 [33:26:24<54:59:28,  8.54s/it]
 39%|███▉      | 14779/37963 [33:26:32<53:41:57,  8.34s/it]
 39%|███▉      | 14780/37963 [33:26:42<57:21:59,  8.91s/it]
                                                           
{'loss': '0.1609', 'grad_norm': '1.726', 'learning_rate': '1.396e-05', 'epoch': '0.3893'}
+
 39%|███▉      | 14780/37963 [33:26:42<57:21:59,  8.91s/it]
 39%|███▉      | 14781/37963 [33:26:49<55:01:03,  8.54s/it]
 39%|███▉      | 14782/37963 [33:26:57<53:20:00,  8.28s/it]
 39%|███▉      | 14783/37963 [33:27:05<52:13:56,  8.11s/it]
 39%|███▉      | 14784/37963 [33:27:13<51:19:41,  7.97s/it]
 39%|███▉      | 14785/37963 [33:27:23<56:08:32,  8.72s/it]
 39%|███▉      | 14786/37963 [33:27:34<59:42:50,  9.28s/it]
 39%|███▉      | 14787/37963 [33:27:41<56:53:31,  8.84s/it]
 39%|███▉      | 14788/37963 [33:27:49<54:51:09,  8.52s/it]
 39%|███▉      | 14789/37963 [33:27:57<53:05:27,  8.25s/it]
 39%|███▉      | 14790/37963 [33:28:04<51:48:02,  8.05s/it]
                                                           
{'loss': '0.1736', 'grad_norm': '3.325', 'learning_rate': '1.395e-05', 'epoch': '0.3896'}
+
 39%|███▉      | 14790/37963 [33:28:04<51:48:02,  8.05s/it]
 39%|███▉      | 14791/37963 [33:28:12<51:46:19,  8.04s/it]
 39%|███▉      | 14792/37963 [33:28:20<51:25:09,  7.99s/it]
 39%|███▉      | 14793/37963 [33:28:28<50:48:03,  7.89s/it]
 39%|███▉      | 14794/37963 [33:28:35<50:09:10,  7.79s/it]
 39%|███▉      | 14795/37963 [33:28:43<49:39:40,  7.72s/it]
 39%|███▉      | 14796/37963 [33:28:51<49:33:08,  7.70s/it]
 39%|███▉      | 14797/37963 [33:28:58<49:23:07,  7.67s/it]
 39%|███▉      | 14798/37963 [33:29:06<49:45:08,  7.73s/it]
 39%|███▉      | 14799/37963 [33:29:14<49:38:34,  7.72s/it]
 39%|███▉      | 14800/37963 [33:29:21<49:21:11,  7.67s/it]
                                                           
{'loss': '0.1627', 'grad_norm': '1.159', 'learning_rate': '1.394e-05', 'epoch': '0.3899'}
+
 39%|███▉      | 14800/37963 [33:29:21<49:21:11,  7.67s/it]
 39%|███▉      | 14801/37963 [33:29:29<49:05:24,  7.63s/it]
 39%|███▉      | 14802/37963 [33:29:37<49:19:32,  7.67s/it]
 39%|███▉      | 14803/37963 [33:29:44<49:28:56,  7.69s/it]
 39%|███▉      | 14804/37963 [33:29:52<49:21:33,  7.67s/it]
 39%|███▉      | 14805/37963 [33:30:03<55:03:28,  8.56s/it]
 39%|███▉      | 14806/37963 [33:30:11<53:42:52,  8.35s/it]
 39%|███▉      | 14807/37963 [33:30:23<61:53:56,  9.62s/it]
 39%|███▉      | 14808/37963 [33:30:31<58:18:22,  9.07s/it]
 39%|███▉      | 14809/37963 [33:30:39<55:55:23,  8.69s/it]
 39%|███▉      | 14810/37963 [33:30:46<53:50:31,  8.37s/it]
                                                           
{'loss': '0.1818', 'grad_norm': '3.291', 'learning_rate': '1.394e-05', 'epoch': '0.3901'}
+
 39%|███▉      | 14810/37963 [33:30:46<53:50:31,  8.37s/it]
 39%|███▉      | 14811/37963 [33:30:54<52:18:07,  8.13s/it]
 39%|███▉      | 14812/37963 [33:31:01<51:11:38,  7.96s/it]
 39%|███▉      | 14813/37963 [33:31:09<50:57:23,  7.92s/it]
 39%|███▉      | 14814/37963 [33:31:17<50:32:14,  7.86s/it]
 39%|███▉      | 14815/37963 [33:31:25<50:19:57,  7.83s/it]
 39%|███▉      | 14816/37963 [33:31:33<50:46:03,  7.90s/it]
 39%|███▉      | 14817/37963 [33:31:40<50:16:18,  7.82s/it]
 39%|███▉      | 14818/37963 [33:31:48<49:56:17,  7.77s/it]
 39%|███▉      | 14819/37963 [33:31:59<55:02:31,  8.56s/it]
 39%|███▉      | 14820/37963 [33:32:06<53:48:44,  8.37s/it]
                                                           
{'loss': '0.1599', 'grad_norm': '4.411', 'learning_rate': '1.393e-05', 'epoch': '0.3904'}
+
 39%|███▉      | 14820/37963 [33:32:06<53:48:44,  8.37s/it]
 39%|███▉      | 14821/37963 [33:32:14<52:56:06,  8.23s/it]
 39%|███▉      | 14822/37963 [33:32:22<52:38:23,  8.19s/it]
 39%|███▉      | 14823/37963 [33:32:30<51:33:28,  8.02s/it]
 39%|███▉      | 14824/37963 [33:32:40<55:37:56,  8.66s/it]
 39%|███▉      | 14825/37963 [33:32:48<53:59:51,  8.40s/it]
 39%|███▉      | 14826/37963 [33:32:56<52:36:56,  8.19s/it]
 39%|███▉      | 14827/37963 [33:33:06<56:34:18,  8.80s/it]
 39%|███▉      | 14828/37963 [33:33:14<54:25:45,  8.47s/it]
 39%|███▉      | 14829/37963 [33:33:22<53:14:54,  8.29s/it]
 39%|███▉      | 14830/37963 [33:33:32<57:10:10,  8.90s/it]
                                                           
{'loss': '0.1598', 'grad_norm': '2.85', 'learning_rate': '1.392e-05', 'epoch': '0.3906'}
+
 39%|███▉      | 14830/37963 [33:33:32<57:10:10,  8.90s/it]
 39%|███▉      | 14831/37963 [33:33:40<55:11:45,  8.59s/it]
 39%|███▉      | 14832/37963 [33:33:47<53:31:35,  8.33s/it]
 39%|███▉      | 14833/37963 [33:33:55<52:12:58,  8.13s/it]
 39%|███▉      | 14834/37963 [33:34:05<56:25:46,  8.78s/it]
 39%|███▉      | 14835/37963 [33:34:13<54:34:11,  8.49s/it]
 39%|███▉      | 14836/37963 [33:34:21<52:49:45,  8.22s/it]
 39%|███▉      | 14837/37963 [33:34:28<51:21:16,  7.99s/it]
 39%|███▉      | 14838/37963 [33:34:36<51:25:06,  8.00s/it]
 39%|███▉      | 14839/37963 [33:34:44<50:41:26,  7.89s/it]
 39%|███▉      | 14840/37963 [33:34:51<49:32:35,  7.71s/it]
                                                           
{'loss': '0.1691', 'grad_norm': '2.1', 'learning_rate': '1.391e-05', 'epoch': '0.3909'}
+
 39%|███▉      | 14840/37963 [33:34:51<49:32:35,  7.71s/it]
 39%|███▉      | 14841/37963 [33:34:59<49:43:32,  7.74s/it]
 39%|███▉      | 14842/37963 [33:35:07<49:41:25,  7.74s/it]
 39%|███▉      | 14843/37963 [33:35:14<49:34:56,  7.72s/it]
 39%|███▉      | 14844/37963 [33:35:22<49:17:10,  7.67s/it]
 39%|███▉      | 14845/37963 [33:35:30<49:21:42,  7.69s/it]
 39%|███▉      | 14846/37963 [33:35:37<49:18:01,  7.68s/it]
 39%|███▉      | 14847/37963 [33:35:45<49:14:50,  7.67s/it]
 39%|███▉      | 14848/37963 [33:35:53<49:34:11,  7.72s/it]
 39%|███▉      | 14849/37963 [33:36:01<49:38:39,  7.73s/it]
 39%|███▉      | 14850/37963 [33:36:08<49:28:08,  7.71s/it]
                                                           
{'loss': '0.1742', 'grad_norm': '2.516', 'learning_rate': '1.39e-05', 'epoch': '0.3912'}
+
 39%|███▉      | 14850/37963 [33:36:08<49:28:08,  7.71s/it]
 39%|███▉      | 14851/37963 [33:36:19<54:23:00,  8.47s/it]
 39%|███▉      | 14852/37963 [33:36:26<52:31:49,  8.18s/it]
 39%|███▉      | 14853/37963 [33:36:34<51:31:31,  8.03s/it]
 39%|███▉      | 14854/37963 [33:36:41<50:55:20,  7.93s/it]
 39%|███▉      | 14855/37963 [33:36:52<55:32:20,  8.65s/it]
 39%|███▉      | 14856/37963 [33:37:00<54:10:26,  8.44s/it]
 39%|███▉      | 14857/37963 [33:37:07<52:41:48,  8.21s/it]
 39%|███▉      | 14858/37963 [33:37:15<52:15:44,  8.14s/it]
 39%|███▉      | 14859/37963 [33:37:26<57:02:40,  8.89s/it]
 39%|███▉      | 14860/37963 [33:37:34<55:17:34,  8.62s/it]
                                                           
{'loss': '0.1581', 'grad_norm': '1.86', 'learning_rate': '1.39e-05', 'epoch': '0.3914'}
+
 39%|███▉      | 14860/37963 [33:37:34<55:17:34,  8.62s/it]
 39%|███▉      | 14861/37963 [33:37:42<53:44:11,  8.37s/it]
 39%|███▉      | 14862/37963 [33:37:49<51:57:29,  8.10s/it]
 39%|███▉      | 14863/37963 [33:37:57<51:30:30,  8.03s/it]
 39%|███▉      | 14864/37963 [33:38:05<50:39:56,  7.90s/it]
 39%|███▉      | 14865/37963 [33:38:12<50:05:25,  7.81s/it]
 39%|███▉      | 14866/37963 [33:38:20<50:05:59,  7.81s/it]
 39%|███▉      | 14867/37963 [33:38:28<50:02:26,  7.80s/it]
 39%|███▉      | 14868/37963 [33:38:38<54:27:22,  8.49s/it]
 39%|███▉      | 14869/37963 [33:38:46<52:55:31,  8.25s/it]
 39%|███▉      | 14870/37963 [33:38:53<51:39:14,  8.05s/it]
                                                           
{'loss': '0.1631', 'grad_norm': '3.985', 'learning_rate': '1.389e-05', 'epoch': '0.3917'}
+
 39%|███▉      | 14870/37963 [33:38:53<51:39:14,  8.05s/it]
 39%|███▉      | 14871/37963 [33:39:04<56:29:58,  8.81s/it]
 39%|███▉      | 14872/37963 [33:39:11<53:30:20,  8.34s/it]
 39%|███▉      | 14873/37963 [33:39:21<57:05:48,  8.90s/it]
 39%|███▉      | 14874/37963 [33:39:29<54:43:21,  8.53s/it]
 39%|███▉      | 14875/37963 [33:39:37<52:54:50,  8.25s/it]
 39%|███▉      | 14876/37963 [33:39:44<51:48:58,  8.08s/it]
 39%|███▉      | 14877/37963 [33:39:54<55:54:06,  8.72s/it]
 39%|███▉      | 14878/37963 [33:40:05<59:14:11,  9.24s/it]
 39%|███▉      | 14879/37963 [33:40:13<56:42:52,  8.84s/it]
 39%|███▉      | 14880/37963 [33:40:20<54:18:00,  8.47s/it]
                                                           
{'loss': '0.1657', 'grad_norm': '1.591', 'learning_rate': '1.388e-05', 'epoch': '0.392'}
+
 39%|███▉      | 14880/37963 [33:40:20<54:18:00,  8.47s/it]
 39%|███▉      | 14881/37963 [33:40:28<53:01:29,  8.27s/it]
 39%|███▉      | 14882/37963 [33:40:36<51:44:31,  8.07s/it]
 39%|███▉      | 14883/37963 [33:40:43<50:50:55,  7.93s/it]
 39%|███▉      | 14884/37963 [33:40:51<50:13:17,  7.83s/it]
 39%|███▉      | 14885/37963 [33:40:59<49:44:21,  7.76s/it]
 39%|███▉      | 14886/37963 [33:41:06<49:47:31,  7.77s/it]
 39%|███▉      | 14887/37963 [33:41:14<48:49:48,  7.62s/it]
 39%|███▉      | 14888/37963 [33:41:22<49:20:24,  7.70s/it]
 39%|███▉      | 14889/37963 [33:41:30<49:57:14,  7.79s/it]
 39%|███▉      | 14890/37963 [33:41:37<50:01:22,  7.80s/it]
                                                           
{'loss': '0.1646', 'grad_norm': '1.652', 'learning_rate': '1.387e-05', 'epoch': '0.3922'}
+
 39%|███▉      | 14890/37963 [33:41:37<50:01:22,  7.80s/it]
 39%|███▉      | 14891/37963 [33:41:45<50:02:54,  7.81s/it]
 39%|███▉      | 14892/37963 [33:41:53<49:49:57,  7.78s/it]
 39%|███▉      | 14893/37963 [33:42:00<49:26:11,  7.71s/it]
 39%|███▉      | 14894/37963 [33:42:10<53:43:21,  8.38s/it]
 39%|███▉      | 14895/37963 [33:42:18<52:33:42,  8.20s/it]
 39%|███▉      | 14896/37963 [33:42:26<51:53:20,  8.10s/it]
 39%|███▉      | 14897/37963 [33:42:34<51:36:20,  8.05s/it]
 39%|███▉      | 14898/37963 [33:42:42<51:23:29,  8.02s/it]
 39%|███▉      | 14899/37963 [33:42:50<50:50:58,  7.94s/it]
 39%|███▉      | 14900/37963 [33:42:57<50:22:35,  7.86s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '2.99', 'learning_rate': '1.387e-05', 'epoch': '0.3925'}
+
 39%|███▉      | 14900/37963 [33:42:57<50:22:35,  7.86s/it]
 39%|███▉      | 14901/37963 [33:43:05<49:57:52,  7.80s/it]
 39%|███▉      | 14902/37963 [33:43:13<49:50:30,  7.78s/it]
 39%|███▉      | 14903/37963 [33:43:23<55:02:25,  8.59s/it]
 39%|███▉      | 14904/37963 [33:43:31<52:38:44,  8.22s/it]
 39%|███▉      | 14905/37963 [33:43:38<51:29:55,  8.04s/it]
 39%|███▉      | 14906/37963 [33:43:46<50:31:52,  7.89s/it]
 39%|███▉      | 14907/37963 [33:43:53<49:44:24,  7.77s/it]
 39%|███▉      | 14908/37963 [33:44:01<49:41:43,  7.76s/it]
 39%|███▉      | 14909/37963 [33:44:11<54:35:54,  8.53s/it]
 39%|███▉      | 14910/37963 [33:44:19<52:50:27,  8.25s/it]
                                                           
{'loss': '0.184', 'grad_norm': '1.449', 'learning_rate': '1.386e-05', 'epoch': '0.3928'}
+
 39%|███▉      | 14910/37963 [33:44:19<52:50:27,  8.25s/it]
 39%|███▉      | 14911/37963 [33:44:27<51:47:37,  8.09s/it]
 39%|███▉      | 14912/37963 [33:44:34<50:52:53,  7.95s/it]
 39%|███▉      | 14913/37963 [33:44:42<50:18:06,  7.86s/it]
 39%|███▉      | 14914/37963 [33:44:50<50:13:05,  7.84s/it]
 39%|███▉      | 14915/37963 [33:45:00<54:54:18,  8.58s/it]
 39%|███▉      | 14916/37963 [33:45:10<58:08:11,  9.08s/it]
 39%|███▉      | 14917/37963 [33:45:18<55:20:56,  8.65s/it]
 39%|███▉      | 14918/37963 [33:45:25<53:12:32,  8.31s/it]
 39%|███▉      | 14919/37963 [33:45:33<51:44:09,  8.08s/it]
 39%|███▉      | 14920/37963 [33:45:40<50:33:11,  7.90s/it]
                                                           
{'loss': '0.169', 'grad_norm': '1.358', 'learning_rate': '1.385e-05', 'epoch': '0.393'}
+
 39%|███▉      | 14920/37963 [33:45:40<50:33:11,  7.90s/it]
 39%|███▉      | 14921/37963 [33:45:50<54:18:31,  8.49s/it]
 39%|███▉      | 14922/37963 [33:45:58<52:42:48,  8.24s/it]
 39%|███▉      | 14923/37963 [33:46:06<51:48:58,  8.10s/it]
 39%|███▉      | 14924/37963 [33:46:13<50:51:26,  7.95s/it]
 39%|███▉      | 14925/37963 [33:46:21<50:14:36,  7.85s/it]
 39%|███▉      | 14926/37963 [33:46:31<55:02:14,  8.60s/it]
 39%|███▉      | 14927/37963 [33:46:39<53:21:32,  8.34s/it]
 39%|███▉      | 14928/37963 [33:46:46<51:26:19,  8.04s/it]
 39%|███▉      | 14929/37963 [33:46:54<51:03:47,  7.98s/it]
 39%|███▉      | 14930/37963 [33:47:02<50:16:49,  7.86s/it]
                                                           
{'loss': '0.1817', 'grad_norm': '1.649', 'learning_rate': '1.384e-05', 'epoch': '0.3933'}
+
 39%|███▉      | 14930/37963 [33:47:02<50:16:49,  7.86s/it]
 39%|███▉      | 14931/37963 [33:47:09<49:06:55,  7.68s/it]
 39%|███▉      | 14932/37963 [33:47:17<48:45:50,  7.62s/it]
 39%|███▉      | 14933/37963 [33:47:24<49:14:14,  7.70s/it]
 39%|███▉      | 14934/37963 [33:47:32<48:36:01,  7.60s/it]
 39%|███▉      | 14935/37963 [33:47:39<48:43:21,  7.62s/it]
 39%|███▉      | 14936/37963 [33:47:47<48:35:56,  7.60s/it]
 39%|███▉      | 14937/37963 [33:47:55<48:58:31,  7.66s/it]
 39%|███▉      | 14938/37963 [33:48:03<49:08:21,  7.68s/it]
 39%|███▉      | 14939/37963 [33:48:10<49:25:40,  7.73s/it]
 39%|███▉      | 14940/37963 [33:48:18<49:16:16,  7.70s/it]
                                                           
{'loss': '0.1714', 'grad_norm': '4.364', 'learning_rate': '1.383e-05', 'epoch': '0.3935'}
+
 39%|███▉      | 14940/37963 [33:48:18<49:16:16,  7.70s/it]
 39%|███▉      | 14941/37963 [33:48:26<49:27:04,  7.73s/it]
 39%|███▉      | 14942/37963 [33:48:33<49:14:53,  7.70s/it]
 39%|███▉      | 14943/37963 [33:48:41<49:18:14,  7.71s/it]
 39%|███▉      | 14944/37963 [33:48:49<49:45:09,  7.78s/it]
 39%|███▉      | 14945/37963 [33:48:57<49:53:05,  7.80s/it]
 39%|███▉      | 14946/37963 [33:49:08<55:14:36,  8.64s/it]
 39%|███▉      | 14947/37963 [33:49:15<53:15:48,  8.33s/it]
 39%|███▉      | 14948/37963 [33:49:25<56:52:44,  8.90s/it]
 39%|███▉      | 14949/37963 [33:49:33<54:43:45,  8.56s/it]
 39%|███▉      | 14950/37963 [33:49:41<53:14:03,  8.33s/it]
                                                           
{'loss': '0.1732', 'grad_norm': '3.002', 'learning_rate': '1.383e-05', 'epoch': '0.3938'}
+
 39%|███▉      | 14950/37963 [33:49:41<53:14:03,  8.33s/it]
 39%|███▉      | 14951/37963 [33:49:49<52:38:01,  8.23s/it]
 39%|███▉      | 14952/37963 [33:49:56<51:07:40,  8.00s/it]
 39%|███▉      | 14953/37963 [33:50:04<49:47:10,  7.79s/it]
 39%|███▉      | 14954/37963 [33:50:11<49:27:46,  7.74s/it]
 39%|███▉      | 14955/37963 [33:50:19<49:06:26,  7.68s/it]
 39%|███▉      | 14956/37963 [33:50:27<48:59:13,  7.67s/it]
 39%|███▉      | 14957/37963 [33:50:34<48:50:01,  7.64s/it]
 39%|███▉      | 14958/37963 [33:50:42<49:09:46,  7.69s/it]
 39%|███▉      | 14959/37963 [33:50:50<49:15:16,  7.71s/it]
 39%|███▉      | 14960/37963 [33:51:00<54:30:58,  8.53s/it]
                                                           
{'loss': '0.1699', 'grad_norm': '1.228', 'learning_rate': '1.382e-05', 'epoch': '0.3941'}
+
 39%|███▉      | 14960/37963 [33:51:00<54:30:58,  8.53s/it]
 39%|███▉      | 14961/37963 [33:51:08<53:04:27,  8.31s/it]
 39%|███▉      | 14962/37963 [33:51:15<51:34:00,  8.07s/it]
 39%|███▉      | 14963/37963 [33:51:28<60:11:48,  9.42s/it]
 39%|███▉      | 14964/37963 [33:51:36<56:44:55,  8.88s/it]
 39%|███▉      | 14965/37963 [33:51:43<54:24:02,  8.52s/it]
 39%|███▉      | 14966/37963 [33:51:51<52:57:31,  8.29s/it]
 39%|███▉      | 14967/37963 [33:51:59<51:51:57,  8.12s/it]
 39%|███▉      | 14968/37963 [33:52:06<51:06:43,  8.00s/it]
 39%|███▉      | 14969/37963 [33:52:17<55:33:27,  8.70s/it]
 39%|███▉      | 14970/37963 [33:52:25<53:40:36,  8.40s/it]
                                                           
{'loss': '0.1547', 'grad_norm': '1.654', 'learning_rate': '1.381e-05', 'epoch': '0.3943'}
+
 39%|███▉      | 14970/37963 [33:52:25<53:40:36,  8.40s/it]
 39%|███▉      | 14971/37963 [33:52:32<52:32:26,  8.23s/it]
 39%|███▉      | 14972/37963 [33:52:40<51:31:17,  8.07s/it]
 39%|███▉      | 14973/37963 [33:52:48<50:56:00,  7.98s/it]
 39%|███▉      | 14974/37963 [33:52:56<50:34:40,  7.92s/it]
 39%|███▉      | 14975/37963 [33:53:06<54:56:09,  8.60s/it]
 39%|███▉      | 14976/37963 [33:53:13<52:46:22,  8.26s/it]
 39%|███▉      | 14977/37963 [33:53:21<51:40:53,  8.09s/it]
 39%|███▉      | 14978/37963 [33:53:29<50:58:32,  7.98s/it]
 39%|███▉      | 14979/37963 [33:53:36<50:16:17,  7.87s/it]
 39%|███▉      | 14980/37963 [33:53:46<54:40:22,  8.56s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '1.389', 'learning_rate': '1.38e-05', 'epoch': '0.3946'}
+
 39%|███▉      | 14980/37963 [33:53:46<54:40:22,  8.56s/it]
 39%|███▉      | 14981/37963 [33:53:54<52:38:05,  8.24s/it]
 39%|███▉      | 14982/37963 [33:54:02<51:23:22,  8.05s/it]
 39%|███▉      | 14983/37963 [33:54:09<50:39:27,  7.94s/it]
 39%|███▉      | 14984/37963 [33:54:17<50:07:41,  7.85s/it]
 39%|███▉      | 14985/37963 [33:54:25<49:59:15,  7.83s/it]
 39%|███▉      | 14986/37963 [33:54:32<49:36:19,  7.77s/it]
 39%|███▉      | 14987/37963 [33:54:40<49:29:35,  7.75s/it]
 39%|███▉      | 14988/37963 [33:54:48<49:12:04,  7.71s/it]
 39%|███▉      | 14989/37963 [33:54:55<48:37:07,  7.62s/it]
 39%|███▉      | 14990/37963 [33:55:06<54:11:02,  8.49s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '2.195', 'learning_rate': '1.379e-05', 'epoch': '0.3949'}
+
 39%|███▉      | 14990/37963 [33:55:06<54:11:02,  8.49s/it]
 39%|███▉      | 14991/37963 [33:55:13<52:26:16,  8.22s/it]
 39%|███▉      | 14992/37963 [33:55:21<51:25:30,  8.06s/it]
 39%|███▉      | 14993/37963 [33:55:28<50:39:04,  7.94s/it]
 39%|███▉      | 14994/37963 [33:55:36<50:04:50,  7.85s/it]
 39%|███▉      | 14995/37963 [33:55:44<49:36:52,  7.78s/it]
 40%|███▉      | 14996/37963 [33:55:54<54:34:01,  8.55s/it]
 40%|███▉      | 14997/37963 [33:56:02<52:56:24,  8.30s/it]
 40%|███▉      | 14998/37963 [33:56:09<51:29:50,  8.07s/it]
 40%|███▉      | 14999/37963 [33:56:17<50:22:56,  7.90s/it]
 40%|███▉      | 15000/37963 [33:56:24<49:44:58,  7.80s/it]
                                                           
{'loss': '0.1742', 'grad_norm': '1.864', 'learning_rate': '1.379e-05', 'epoch': '0.3951'}
+
 40%|███▉      | 15000/37963 [33:56:24<49:44:58,  7.80s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.74s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.74s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 40%|███▉      | 15001/37963 [33:57:27<154:17:58, 24.19s/it]
 40%|███▉      | 15002/37963 [33:57:34<122:32:41, 19.21s/it]
 40%|███▉      | 15003/37963 [33:57:42<100:44:14, 15.80s/it]
 40%|███▉      | 15004/37963 [33:57:50<85:12:04, 13.36s/it] 
 40%|███▉      | 15005/37963 [33:57:58<74:06:38, 11.62s/it]
 40%|███▉      | 15006/37963 [33:58:05<66:37:01, 10.45s/it]
 40%|███▉      | 15007/37963 [33:58:15<66:08:01, 10.37s/it]
 40%|███▉      | 15008/37963 [33:58:23<60:52:10,  9.55s/it]
 40%|███▉      | 15009/37963 [33:58:31<57:29:21,  9.02s/it]
 40%|███▉      | 15010/37963 [33:58:41<59:45:41,  9.37s/it]
                                                           
{'loss': '0.16', 'grad_norm': '3.426', 'learning_rate': '1.378e-05', 'epoch': '0.3954'}
+
 40%|███▉      | 15010/37963 [33:58:41<59:45:41,  9.37s/it]
 40%|███▉      | 15011/37963 [33:58:49<56:55:36,  8.93s/it]
 40%|███▉      | 15012/37963 [33:58:57<54:36:20,  8.57s/it]
 40%|███▉      | 15013/37963 [33:59:04<52:49:56,  8.29s/it]
 40%|███▉      | 15014/37963 [33:59:12<51:27:35,  8.07s/it]
 40%|███▉      | 15015/37963 [33:59:25<60:30:46,  9.49s/it]
 40%|███▉      | 15016/37963 [33:59:32<57:15:19,  8.98s/it]
 40%|███▉      | 15017/37963 [33:59:40<54:27:11,  8.54s/it]
 40%|███▉      | 15018/37963 [33:59:48<52:54:36,  8.30s/it]
 40%|███▉      | 15019/37963 [33:59:55<51:46:37,  8.12s/it]
 40%|███▉      | 15020/37963 [34:00:03<51:01:16,  8.01s/it]
                                                           
{'loss': '0.1758', 'grad_norm': '2.091', 'learning_rate': '1.377e-05', 'epoch': '0.3956'}
+
 40%|███▉      | 15020/37963 [34:00:03<51:01:16,  8.01s/it]
 40%|███▉      | 15021/37963 [34:00:11<50:14:14,  7.88s/it]
 40%|███▉      | 15022/37963 [34:00:19<50:18:25,  7.89s/it]
 40%|███▉      | 15023/37963 [34:00:26<50:08:56,  7.87s/it]
 40%|███▉      | 15024/37963 [34:00:34<49:46:49,  7.81s/it]
 40%|███▉      | 15025/37963 [34:00:42<49:23:38,  7.75s/it]
 40%|███▉      | 15026/37963 [34:00:52<54:08:08,  8.50s/it]
 40%|███▉      | 15027/37963 [34:00:59<52:11:50,  8.19s/it]
 40%|███▉      | 15028/37963 [34:01:07<51:10:50,  8.03s/it]
 40%|███▉      | 15029/37963 [34:01:17<55:20:08,  8.69s/it]
 40%|███▉      | 15030/37963 [34:01:25<53:34:18,  8.41s/it]
                                                           
{'loss': '0.1753', 'grad_norm': '1.055', 'learning_rate': '1.376e-05', 'epoch': '0.3959'}
+
 40%|███▉      | 15030/37963 [34:01:25<53:34:18,  8.41s/it]
 40%|███▉      | 15031/37963 [34:01:33<52:23:45,  8.23s/it]
 40%|███▉      | 15032/37963 [34:01:41<51:22:06,  8.06s/it]
 40%|███▉      | 15033/37963 [34:01:48<50:40:38,  7.96s/it]
 40%|███▉      | 15034/37963 [34:01:56<50:08:42,  7.87s/it]
 40%|███▉      | 15035/37963 [34:02:04<49:53:02,  7.83s/it]
 40%|███▉      | 15036/37963 [34:02:11<49:25:16,  7.76s/it]
 40%|███▉      | 15037/37963 [34:02:19<48:36:27,  7.63s/it]
 40%|███▉      | 15038/37963 [34:02:26<48:36:15,  7.63s/it]
 40%|███▉      | 15039/37963 [34:02:34<48:45:43,  7.66s/it]
 40%|███▉      | 15040/37963 [34:02:44<53:33:30,  8.41s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '3.848', 'learning_rate': '1.375e-05', 'epoch': '0.3962'}
+
 40%|███▉      | 15040/37963 [34:02:44<53:33:30,  8.41s/it]
 40%|███▉      | 15041/37963 [34:02:54<57:04:24,  8.96s/it]
 40%|███▉      | 15042/37963 [34:03:02<54:43:17,  8.59s/it]
 40%|███▉      | 15043/37963 [34:03:10<53:05:57,  8.34s/it]
 40%|███▉      | 15044/37963 [34:03:18<52:11:19,  8.20s/it]
 40%|███▉      | 15045/37963 [34:03:26<51:25:58,  8.08s/it]
 40%|███▉      | 15046/37963 [34:03:33<50:26:34,  7.92s/it]
 40%|███▉      | 15047/37963 [34:03:41<50:14:20,  7.89s/it]
 40%|███▉      | 15048/37963 [34:03:49<50:35:47,  7.95s/it]
 40%|███▉      | 15049/37963 [34:03:57<50:13:20,  7.89s/it]
 40%|███▉      | 15050/37963 [34:04:05<50:20:18,  7.91s/it]
                                                           
{'loss': '0.1623', 'grad_norm': '1.83', 'learning_rate': '1.375e-05', 'epoch': '0.3964'}
+
 40%|███▉      | 15050/37963 [34:04:05<50:20:18,  7.91s/it]
 40%|███▉      | 15051/37963 [34:04:13<50:10:43,  7.88s/it]
 40%|███▉      | 15052/37963 [34:04:20<50:00:14,  7.86s/it]
 40%|███▉      | 15053/37963 [34:04:28<49:39:06,  7.80s/it]
 40%|███▉      | 15054/37963 [34:04:36<49:46:55,  7.82s/it]
 40%|███▉      | 15055/37963 [34:04:46<54:10:50,  8.51s/it]
 40%|███▉      | 15056/37963 [34:04:54<52:15:44,  8.21s/it]
 40%|███▉      | 15057/37963 [34:05:01<51:34:13,  8.11s/it]
 40%|███▉      | 15058/37963 [34:05:09<50:52:13,  8.00s/it]
 40%|███▉      | 15059/37963 [34:05:19<54:59:13,  8.64s/it]
 40%|███▉      | 15060/37963 [34:05:27<53:28:24,  8.41s/it]
                                                           
{'loss': '0.1654', 'grad_norm': '1.849', 'learning_rate': '1.374e-05', 'epoch': '0.3967'}
+
 40%|███▉      | 15060/37963 [34:05:27<53:28:24,  8.41s/it]
 40%|███▉      | 15061/37963 [34:05:35<52:09:07,  8.20s/it]
 40%|███▉      | 15062/37963 [34:05:43<51:15:43,  8.06s/it]
 40%|███▉      | 15063/37963 [34:05:50<50:45:44,  7.98s/it]
 40%|███▉      | 15064/37963 [34:06:01<55:08:42,  8.67s/it]
 40%|███▉      | 15065/37963 [34:06:08<53:12:52,  8.37s/it]
 40%|███▉      | 15066/37963 [34:06:16<52:01:55,  8.18s/it]
 40%|███▉      | 15067/37963 [34:06:24<51:53:16,  8.16s/it]
 40%|███▉      | 15068/37963 [34:06:32<51:15:10,  8.06s/it]
 40%|███▉      | 15069/37963 [34:06:42<55:09:24,  8.67s/it]
 40%|███▉      | 15070/37963 [34:06:50<53:00:34,  8.34s/it]
                                                           
{'loss': '0.1526', 'grad_norm': '1.743', 'learning_rate': '1.373e-05', 'epoch': '0.397'}
+
 40%|███▉      | 15070/37963 [34:06:50<53:00:34,  8.34s/it]
 40%|███▉      | 15071/37963 [34:06:57<51:23:20,  8.08s/it]
 40%|███▉      | 15072/37963 [34:07:05<50:30:23,  7.94s/it]
 40%|███▉      | 15073/37963 [34:07:12<50:08:46,  7.89s/it]
 40%|███▉      | 15074/37963 [34:07:20<49:37:28,  7.80s/it]
 40%|███▉      | 15075/37963 [34:07:28<49:09:06,  7.73s/it]
 40%|███▉      | 15076/37963 [34:07:35<49:19:37,  7.76s/it]
 40%|███▉      | 15077/37963 [34:07:43<49:12:45,  7.74s/it]
 40%|███▉      | 15078/37963 [34:07:51<48:28:56,  7.63s/it]
 40%|███▉      | 15079/37963 [34:07:58<48:24:29,  7.62s/it]
 40%|███▉      | 15080/37963 [34:08:08<53:26:55,  8.41s/it]
                                                           
{'loss': '0.1662', 'grad_norm': '3.92', 'learning_rate': '1.372e-05', 'epoch': '0.3972'}
+
 40%|███▉      | 15080/37963 [34:08:08<53:26:55,  8.41s/it]
 40%|███▉      | 15081/37963 [34:08:16<52:17:17,  8.23s/it]
 40%|███▉      | 15082/37963 [34:08:24<51:18:01,  8.07s/it]
 40%|███▉      | 15083/37963 [34:08:34<55:32:12,  8.74s/it]
 40%|███▉      | 15084/37963 [34:08:45<58:45:48,  9.25s/it]
 40%|███▉      | 15085/37963 [34:08:53<56:16:21,  8.85s/it]
 40%|███▉      | 15086/37963 [34:09:00<53:41:42,  8.45s/it]
 40%|███▉      | 15087/37963 [34:09:08<52:03:55,  8.19s/it]
 40%|███▉      | 15088/37963 [34:09:15<51:11:16,  8.06s/it]
 40%|███▉      | 15089/37963 [34:09:25<55:01:46,  8.66s/it]
 40%|███▉      | 15090/37963 [34:09:33<53:00:31,  8.34s/it]
                                                           
{'loss': '0.1615', 'grad_norm': '1.28', 'learning_rate': '1.372e-05', 'epoch': '0.3975'}
+
 40%|███▉      | 15090/37963 [34:09:33<53:00:31,  8.34s/it]
 40%|███▉      | 15091/37963 [34:09:41<51:16:23,  8.07s/it]
 40%|███▉      | 15092/37963 [34:09:48<49:27:41,  7.79s/it]
 40%|███▉      | 15093/37963 [34:09:55<49:09:07,  7.74s/it]
 40%|███▉      | 15094/37963 [34:10:03<48:35:57,  7.65s/it]
 40%|███▉      | 15095/37963 [34:10:10<48:47:41,  7.68s/it]
 40%|███▉      | 15096/37963 [34:10:18<48:51:36,  7.69s/it]
 40%|███▉      | 15097/37963 [34:10:26<48:55:45,  7.70s/it]
 40%|███▉      | 15098/37963 [34:10:34<48:50:27,  7.69s/it]
 40%|███▉      | 15099/37963 [34:10:41<48:48:43,  7.69s/it]
 40%|███▉      | 15100/37963 [34:10:49<49:06:41,  7.73s/it]
                                                           
{'loss': '0.1741', 'grad_norm': '2.919', 'learning_rate': '1.371e-05', 'epoch': '0.3978'}
+
 40%|███▉      | 15100/37963 [34:10:49<49:06:41,  7.73s/it]
 40%|███▉      | 15101/37963 [34:10:57<49:09:06,  7.74s/it]
 40%|███▉      | 15102/37963 [34:11:04<48:29:04,  7.64s/it]
 40%|███▉      | 15103/37963 [34:11:12<48:35:42,  7.65s/it]
 40%|███▉      | 15104/37963 [34:11:20<48:30:25,  7.64s/it]
 40%|███▉      | 15105/37963 [34:11:27<48:28:17,  7.63s/it]
 40%|███▉      | 15106/37963 [34:11:35<48:46:35,  7.68s/it]
 40%|███▉      | 15107/37963 [34:11:45<53:31:03,  8.43s/it]
 40%|███▉      | 15108/37963 [34:11:53<52:22:35,  8.25s/it]
 40%|███▉      | 15109/37963 [34:12:03<56:28:44,  8.90s/it]
 40%|███▉      | 15110/37963 [34:12:11<54:21:51,  8.56s/it]
                                                           
{'loss': '0.1685', 'grad_norm': '1.631', 'learning_rate': '1.37e-05', 'epoch': '0.398'}
+
 40%|███▉      | 15110/37963 [34:12:11<54:21:51,  8.56s/it]
 40%|███▉      | 15111/37963 [34:12:19<52:31:55,  8.28s/it]
 40%|███▉      | 15112/37963 [34:12:26<51:26:39,  8.10s/it]
 40%|███▉      | 15113/37963 [34:12:34<50:32:18,  7.96s/it]
 40%|███▉      | 15114/37963 [34:12:42<50:38:32,  7.98s/it]
 40%|███▉      | 15115/37963 [34:12:50<50:17:19,  7.92s/it]
 40%|███▉      | 15116/37963 [34:12:58<50:14:41,  7.92s/it]
 40%|███▉      | 15117/37963 [34:13:05<49:38:05,  7.82s/it]
 40%|███▉      | 15118/37963 [34:13:16<54:19:31,  8.56s/it]
 40%|███▉      | 15119/37963 [34:13:23<52:49:42,  8.33s/it]
 40%|███▉      | 15120/37963 [34:13:31<51:34:42,  8.13s/it]
                                                           
{'loss': '0.1703', 'grad_norm': '1.7', 'learning_rate': '1.369e-05', 'epoch': '0.3983'}
+
 40%|███▉      | 15120/37963 [34:13:31<51:34:42,  8.13s/it]
 40%|███▉      | 15121/37963 [34:13:39<50:47:56,  8.01s/it]
 40%|███▉      | 15122/37963 [34:13:47<50:11:29,  7.91s/it]
 40%|███▉      | 15123/37963 [34:13:57<55:10:28,  8.70s/it]
 40%|███▉      | 15124/37963 [34:14:07<58:11:22,  9.17s/it]
 40%|███▉      | 15125/37963 [34:14:15<55:30:11,  8.75s/it]
 40%|███▉      | 15126/37963 [34:14:23<53:20:49,  8.41s/it]
 40%|███▉      | 15127/37963 [34:14:33<56:57:23,  8.98s/it]
 40%|███▉      | 15128/37963 [34:14:41<54:45:28,  8.63s/it]
 40%|███▉      | 15129/37963 [34:14:49<53:04:16,  8.37s/it]
 40%|███▉      | 15130/37963 [34:14:56<51:34:57,  8.13s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '1.14', 'learning_rate': '1.368e-05', 'epoch': '0.3985'}
+
 40%|███▉      | 15130/37963 [34:14:56<51:34:57,  8.13s/it]
 40%|███▉      | 15131/37963 [34:15:04<50:23:07,  7.94s/it]
 40%|███▉      | 15132/37963 [34:15:11<50:01:27,  7.89s/it]
 40%|███▉      | 15133/37963 [34:15:19<50:08:00,  7.91s/it]
 40%|███▉      | 15134/37963 [34:15:27<50:05:10,  7.90s/it]
 40%|███▉      | 15135/37963 [34:15:35<49:31:37,  7.81s/it]
 40%|███▉      | 15136/37963 [34:15:43<49:56:01,  7.87s/it]
 40%|███▉      | 15137/37963 [34:15:53<54:28:02,  8.59s/it]
 40%|███▉      | 15138/37963 [34:16:04<58:09:14,  9.17s/it]
 40%|███▉      | 15139/37963 [34:16:12<55:45:03,  8.79s/it]
 40%|███▉      | 15140/37963 [34:16:19<53:53:06,  8.50s/it]
                                                           
{'loss': '0.1621', 'grad_norm': '2.183', 'learning_rate': '1.368e-05', 'epoch': '0.3988'}
+
 40%|███▉      | 15140/37963 [34:16:19<53:53:06,  8.50s/it]
 40%|███▉      | 15141/37963 [34:16:27<52:22:53,  8.26s/it]
 40%|███▉      | 15142/37963 [34:16:35<51:46:43,  8.17s/it]
 40%|███▉      | 15143/37963 [34:16:43<50:29:11,  7.96s/it]
 40%|███▉      | 15144/37963 [34:16:50<50:08:10,  7.91s/it]
 40%|███▉      | 15145/37963 [34:16:58<49:39:00,  7.83s/it]
 40%|███▉      | 15146/37963 [34:17:06<49:12:18,  7.76s/it]
 40%|███▉      | 15147/37963 [34:17:13<48:57:06,  7.72s/it]
 40%|███▉      | 15148/37963 [34:17:21<49:19:50,  7.78s/it]
 40%|███▉      | 15149/37963 [34:17:29<49:25:09,  7.80s/it]
 40%|███▉      | 15150/37963 [34:17:37<49:28:35,  7.81s/it]
                                                           
{'loss': '0.1632', 'grad_norm': '2.838', 'learning_rate': '1.367e-05', 'epoch': '0.3991'}
+
 40%|███▉      | 15150/37963 [34:17:37<49:28:35,  7.81s/it]
 40%|███▉      | 15151/37963 [34:17:44<49:05:46,  7.75s/it]
 40%|███▉      | 15152/37963 [34:17:52<49:19:06,  7.78s/it]
 40%|███▉      | 15153/37963 [34:18:03<54:04:00,  8.53s/it]
 40%|███▉      | 15154/37963 [34:18:10<52:26:31,  8.28s/it]
 40%|███▉      | 15155/37963 [34:18:20<55:58:18,  8.83s/it]
 40%|███▉      | 15156/37963 [34:18:28<54:05:06,  8.54s/it]
 40%|███▉      | 15157/37963 [34:18:35<51:23:43,  8.11s/it]
 40%|███▉      | 15158/37963 [34:18:43<50:40:28,  8.00s/it]
 40%|███▉      | 15159/37963 [34:18:51<50:21:40,  7.95s/it]
 40%|███▉      | 15160/37963 [34:18:59<49:45:54,  7.86s/it]
                                                           
{'loss': '0.1727', 'grad_norm': '3.305', 'learning_rate': '1.366e-05', 'epoch': '0.3993'}
+
 40%|███▉      | 15160/37963 [34:18:59<49:45:54,  7.86s/it]
 40%|███▉      | 15161/37963 [34:19:06<48:36:31,  7.67s/it]
 40%|███▉      | 15162/37963 [34:19:16<53:27:15,  8.44s/it]
 40%|███▉      | 15163/37963 [34:19:24<51:59:44,  8.21s/it]
 40%|███▉      | 15164/37963 [34:19:31<50:36:04,  7.99s/it]
 40%|███▉      | 15165/37963 [34:19:39<50:12:02,  7.93s/it]
 40%|███▉      | 15166/37963 [34:19:46<49:07:36,  7.76s/it]
 40%|███▉      | 15167/37963 [34:19:54<49:26:21,  7.81s/it]
 40%|███▉      | 15168/37963 [34:20:02<49:12:57,  7.77s/it]
 40%|███▉      | 15169/37963 [34:20:10<48:59:25,  7.74s/it]
 40%|███▉      | 15170/37963 [34:20:17<48:58:39,  7.74s/it]
                                                           
{'loss': '0.1604', 'grad_norm': '3.835', 'learning_rate': '1.365e-05', 'epoch': '0.3996'}
+
 40%|███▉      | 15170/37963 [34:20:17<48:58:39,  7.74s/it]
 40%|███▉      | 15171/37963 [34:20:28<54:11:46,  8.56s/it]
 40%|███▉      | 15172/37963 [34:20:36<52:53:54,  8.36s/it]
 40%|███▉      | 15173/37963 [34:20:44<51:49:23,  8.19s/it]
 40%|███▉      | 15174/37963 [34:20:51<51:11:28,  8.09s/it]
 40%|███▉      | 15175/37963 [34:20:59<50:17:52,  7.95s/it]
 40%|███▉      | 15176/37963 [34:21:07<50:03:40,  7.91s/it]
 40%|███▉      | 15177/37963 [34:21:17<54:55:56,  8.68s/it]
 40%|███▉      | 15178/37963 [34:21:28<58:18:55,  9.21s/it]
 40%|███▉      | 15179/37963 [34:21:35<55:04:53,  8.70s/it]
 40%|███▉      | 15180/37963 [34:21:43<53:18:13,  8.42s/it]
                                                           
{'loss': '0.1513', 'grad_norm': '2.353', 'learning_rate': '1.364e-05', 'epoch': '0.3999'}
+
 40%|███▉      | 15180/37963 [34:21:43<53:18:13,  8.42s/it]
 40%|███▉      | 15181/37963 [34:21:51<52:09:27,  8.24s/it]
 40%|███▉      | 15182/37963 [34:21:58<50:50:34,  8.03s/it]
 40%|███▉      | 15183/37963 [34:22:06<50:15:14,  7.94s/it]
 40%|███▉      | 15184/37963 [34:22:14<50:33:14,  7.99s/it]
 40%|███▉      | 15185/37963 [34:22:24<54:44:40,  8.65s/it]
 40%|████      | 15186/37963 [34:22:32<53:22:55,  8.44s/it]
 40%|████      | 15187/37963 [34:22:40<52:15:06,  8.26s/it]
 40%|████      | 15188/37963 [34:22:48<51:16:10,  8.10s/it]
 40%|████      | 15189/37963 [34:22:56<50:43:07,  8.02s/it]
 40%|████      | 15190/37963 [34:23:03<49:49:04,  7.88s/it]
                                                           
{'loss': '0.1677', 'grad_norm': '1.272', 'learning_rate': '1.364e-05', 'epoch': '0.4001'}
+
 40%|████      | 15190/37963 [34:23:03<49:49:04,  7.88s/it]
 40%|████      | 15191/37963 [34:23:14<54:16:46,  8.58s/it]
 40%|████      | 15192/37963 [34:23:21<52:33:06,  8.31s/it]
 40%|████      | 15193/37963 [34:23:29<50:53:41,  8.05s/it]
 40%|████      | 15194/37963 [34:23:36<50:11:28,  7.94s/it]
 40%|████      | 15195/37963 [34:23:44<49:30:26,  7.83s/it]
 40%|████      | 15196/37963 [34:23:52<49:29:03,  7.82s/it]
 40%|████      | 15197/37963 [34:24:03<56:16:52,  8.90s/it]
 40%|████      | 15198/37963 [34:24:11<53:51:13,  8.52s/it]
 40%|████      | 15199/37963 [34:24:18<52:22:14,  8.28s/it]
 40%|████      | 15200/37963 [34:24:26<51:35:54,  8.16s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '2.906', 'learning_rate': '1.363e-05', 'epoch': '0.4004'}
+
 40%|████      | 15200/37963 [34:24:26<51:35:54,  8.16s/it]
 40%|████      | 15201/37963 [34:24:34<50:57:30,  8.06s/it]
 40%|████      | 15202/37963 [34:24:42<50:26:45,  7.98s/it]
 40%|████      | 15203/37963 [34:24:50<50:39:04,  8.01s/it]
 40%|████      | 15204/37963 [34:24:58<49:41:36,  7.86s/it]
 40%|████      | 15205/37963 [34:25:05<49:18:32,  7.80s/it]
 40%|████      | 15206/37963 [34:25:13<49:29:23,  7.83s/it]
 40%|████      | 15207/37963 [34:25:21<49:22:54,  7.81s/it]
 40%|████      | 15208/37963 [34:25:29<49:03:04,  7.76s/it]
 40%|████      | 15209/37963 [34:25:39<53:30:21,  8.47s/it]
 40%|████      | 15210/37963 [34:25:46<52:11:02,  8.26s/it]
                                                           
{'loss': '0.1597', 'grad_norm': '1.816', 'learning_rate': '1.362e-05', 'epoch': '0.4007'}
+
 40%|████      | 15210/37963 [34:25:46<52:11:02,  8.26s/it]
 40%|████      | 15211/37963 [34:25:57<55:50:59,  8.84s/it]
 40%|████      | 15212/37963 [34:26:04<53:34:58,  8.48s/it]
 40%|████      | 15213/37963 [34:26:12<51:59:57,  8.23s/it]
 40%|████      | 15214/37963 [34:26:22<55:04:49,  8.72s/it]
 40%|████      | 15215/37963 [34:26:30<53:32:00,  8.47s/it]
 40%|████      | 15216/37963 [34:26:37<52:18:05,  8.28s/it]
 40%|████      | 15217/37963 [34:26:45<51:21:06,  8.13s/it]
 40%|████      | 15218/37963 [34:26:53<50:44:40,  8.03s/it]
 40%|████      | 15219/37963 [34:27:01<49:59:24,  7.91s/it]
 40%|████      | 15220/37963 [34:27:08<49:31:26,  7.84s/it]
                                                           
{'loss': '0.1584', 'grad_norm': '3.164', 'learning_rate': '1.361e-05', 'epoch': '0.4009'}
+
 40%|████      | 15220/37963 [34:27:08<49:31:26,  7.84s/it]
 40%|████      | 15221/37963 [34:27:16<49:12:26,  7.79s/it]
 40%|████      | 15222/37963 [34:27:24<49:02:18,  7.76s/it]
 40%|████      | 15223/37963 [34:27:31<48:26:05,  7.67s/it]
 40%|████      | 15224/37963 [34:27:39<47:51:17,  7.58s/it]
 40%|████      | 15225/37963 [34:27:46<48:07:03,  7.62s/it]
 40%|████      | 15226/37963 [34:27:54<49:00:01,  7.76s/it]
 40%|████      | 15227/37963 [34:28:02<49:03:50,  7.77s/it]
 40%|████      | 15228/37963 [34:28:10<49:11:11,  7.79s/it]
 40%|████      | 15229/37963 [34:28:20<54:01:01,  8.55s/it]
 40%|████      | 15230/37963 [34:28:28<52:49:56,  8.37s/it]
                                                           
{'loss': '0.1706', 'grad_norm': '3.288', 'learning_rate': '1.36e-05', 'epoch': '0.4012'}
+
 40%|████      | 15230/37963 [34:28:28<52:49:56,  8.37s/it]
 40%|████      | 15231/37963 [34:28:39<56:45:32,  8.99s/it]
 40%|████      | 15232/37963 [34:28:49<59:02:16,  9.35s/it]
 40%|████      | 15233/37963 [34:28:56<55:22:30,  8.77s/it]
 40%|████      | 15234/37963 [34:29:04<53:54:31,  8.54s/it]
 40%|████      | 15235/37963 [34:29:12<52:14:01,  8.27s/it]
 40%|████      | 15236/37963 [34:29:20<51:15:02,  8.12s/it]
 40%|████      | 15237/37963 [34:29:28<50:59:56,  8.08s/it]
 40%|████      | 15238/37963 [34:29:36<50:31:33,  8.00s/it]
 40%|████      | 15239/37963 [34:29:43<49:15:54,  7.80s/it]
 40%|████      | 15240/37963 [34:29:51<49:06:37,  7.78s/it]
                                                           
{'loss': '0.175', 'grad_norm': '0.8803', 'learning_rate': '1.36e-05', 'epoch': '0.4014'}
+
 40%|████      | 15240/37963 [34:29:51<49:06:37,  7.78s/it]
 40%|████      | 15241/37963 [34:30:01<54:06:24,  8.57s/it]
 40%|████      | 15242/37963 [34:30:09<52:17:50,  8.29s/it]
 40%|████      | 15243/37963 [34:30:16<51:11:37,  8.11s/it]
 40%|████      | 15244/37963 [34:30:24<49:58:37,  7.92s/it]
 40%|████      | 15245/37963 [34:30:31<48:32:32,  7.69s/it]
 40%|████      | 15246/37963 [34:30:39<48:19:40,  7.66s/it]
 40%|████      | 15247/37963 [34:30:46<48:14:12,  7.64s/it]
 40%|████      | 15248/37963 [34:30:57<55:10:56,  8.75s/it]
 40%|████      | 15249/37963 [34:31:05<53:00:18,  8.40s/it]
 40%|████      | 15250/37963 [34:31:13<51:50:47,  8.22s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '1.65', 'learning_rate': '1.359e-05', 'epoch': '0.4017'}
+
 40%|████      | 15250/37963 [34:31:13<51:50:47,  8.22s/it]
 40%|████      | 15251/37963 [34:31:21<50:52:39,  8.06s/it]
 40%|████      | 15252/37963 [34:31:29<50:48:46,  8.05s/it]
 40%|████      | 15253/37963 [34:31:39<54:49:44,  8.69s/it]
 40%|████      | 15254/37963 [34:31:47<53:15:36,  8.44s/it]
 40%|████      | 15255/37963 [34:31:54<51:49:56,  8.22s/it]
 40%|████      | 15256/37963 [34:32:02<50:49:47,  8.06s/it]
 40%|████      | 15257/37963 [34:32:10<50:06:11,  7.94s/it]
 40%|████      | 15258/37963 [34:32:17<49:32:03,  7.85s/it]
 40%|████      | 15259/37963 [34:32:25<49:06:35,  7.79s/it]
 40%|████      | 15260/37963 [34:32:32<48:38:02,  7.71s/it]
                                                           
{'loss': '0.1594', 'grad_norm': '1.812', 'learning_rate': '1.358e-05', 'epoch': '0.402'}
+
 40%|████      | 15260/37963 [34:32:32<48:38:02,  7.71s/it]
 40%|████      | 15261/37963 [34:32:40<48:30:14,  7.69s/it]
 40%|████      | 15262/37963 [34:32:50<53:33:44,  8.49s/it]
 40%|████      | 15263/37963 [34:32:58<52:25:25,  8.31s/it]
 40%|████      | 15264/37963 [34:33:08<55:40:46,  8.83s/it]
 40%|████      | 15265/37963 [34:33:16<53:47:37,  8.53s/it]
 40%|████      | 15266/37963 [34:33:24<52:20:42,  8.30s/it]
 40%|████      | 15267/37963 [34:33:32<51:05:03,  8.10s/it]
 40%|████      | 15268/37963 [34:33:39<50:27:47,  8.00s/it]
 40%|████      | 15269/37963 [34:33:47<49:14:09,  7.81s/it]
 40%|████      | 15270/37963 [34:33:55<49:06:39,  7.79s/it]
                                                           
{'loss': '0.1545', 'grad_norm': '1.941', 'learning_rate': '1.357e-05', 'epoch': '0.4022'}
+
 40%|████      | 15270/37963 [34:33:55<49:06:39,  7.79s/it]
 40%|████      | 15271/37963 [34:34:03<49:41:05,  7.88s/it]
 40%|████      | 15272/37963 [34:34:13<54:13:04,  8.60s/it]
 40%|████      | 15273/37963 [34:34:21<52:57:57,  8.40s/it]
 40%|████      | 15274/37963 [34:34:29<51:43:15,  8.21s/it]
 40%|████      | 15275/37963 [34:34:36<51:07:21,  8.11s/it]
 40%|████      | 15276/37963 [34:34:44<50:15:39,  7.98s/it]
 40%|████      | 15277/37963 [34:34:52<49:56:28,  7.93s/it]
 40%|████      | 15278/37963 [34:35:00<49:32:56,  7.86s/it]
 40%|████      | 15279/37963 [34:35:07<49:07:22,  7.80s/it]
 40%|████      | 15280/37963 [34:35:15<49:06:42,  7.79s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '2.906', 'learning_rate': '1.356e-05', 'epoch': '0.4025'}
+
 40%|████      | 15280/37963 [34:35:15<49:06:42,  7.79s/it]
 40%|████      | 15281/37963 [34:35:23<49:32:03,  7.86s/it]
 40%|████      | 15282/37963 [34:35:31<49:20:36,  7.83s/it]
 40%|████      | 15283/37963 [34:35:39<49:24:03,  7.84s/it]
 40%|████      | 15284/37963 [34:35:46<49:02:04,  7.78s/it]
 40%|████      | 15285/37963 [34:35:57<53:49:22,  8.54s/it]
 40%|████      | 15286/37963 [34:36:07<56:56:39,  9.04s/it]
 40%|████      | 15287/37963 [34:36:15<54:37:27,  8.67s/it]
 40%|████      | 15288/37963 [34:36:23<53:02:54,  8.42s/it]
 40%|████      | 15289/37963 [34:36:30<51:47:33,  8.22s/it]
 40%|████      | 15290/37963 [34:36:38<51:06:37,  8.12s/it]
                                                           
{'loss': '0.1556', 'grad_norm': '1.491', 'learning_rate': '1.356e-05', 'epoch': '0.4028'}
+
 40%|████      | 15290/37963 [34:36:38<51:06:37,  8.12s/it]
 40%|████      | 15291/37963 [34:36:46<50:01:29,  7.94s/it]
 40%|████      | 15292/37963 [34:36:54<49:48:18,  7.91s/it]
 40%|████      | 15293/37963 [34:37:01<49:39:48,  7.89s/it]
 40%|████      | 15294/37963 [34:37:09<49:13:00,  7.82s/it]
 40%|████      | 15295/37963 [34:37:20<54:21:49,  8.63s/it]
 40%|████      | 15296/37963 [34:37:30<57:30:20,  9.13s/it]
 40%|████      | 15297/37963 [34:37:37<54:31:24,  8.66s/it]
 40%|████      | 15298/37963 [34:37:45<52:27:06,  8.33s/it]
 40%|████      | 15299/37963 [34:37:52<50:41:38,  8.05s/it]
 40%|████      | 15300/37963 [34:38:00<49:28:17,  7.86s/it]
                                                           
{'loss': '0.1431', 'grad_norm': '3.202', 'learning_rate': '1.355e-05', 'epoch': '0.403'}
+
 40%|████      | 15300/37963 [34:38:00<49:28:17,  7.86s/it]
 40%|████      | 15301/37963 [34:38:07<48:59:07,  7.78s/it]
 40%|████      | 15302/37963 [34:38:15<48:40:54,  7.73s/it]
 40%|████      | 15303/37963 [34:38:23<48:33:06,  7.71s/it]
 40%|████      | 15304/37963 [34:38:33<53:51:10,  8.56s/it]
 40%|████      | 15305/37963 [34:38:41<51:58:44,  8.26s/it]
 40%|████      | 15306/37963 [34:38:49<50:56:40,  8.09s/it]
 40%|████      | 15307/37963 [34:38:56<50:39:49,  8.05s/it]
 40%|████      | 15308/37963 [34:39:04<50:15:38,  7.99s/it]
 40%|████      | 15309/37963 [34:39:12<49:34:44,  7.88s/it]
 40%|████      | 15310/37963 [34:39:19<48:57:13,  7.78s/it]
                                                           
{'loss': '0.1758', 'grad_norm': '1.955', 'learning_rate': '1.354e-05', 'epoch': '0.4033'}
+
 40%|████      | 15310/37963 [34:39:19<48:57:13,  7.78s/it]
 40%|████      | 15311/37963 [34:39:27<48:57:29,  7.78s/it]
 40%|████      | 15312/37963 [34:39:35<48:54:46,  7.77s/it]
 40%|████      | 15313/37963 [34:39:43<48:34:53,  7.72s/it]
 40%|████      | 15314/37963 [34:39:51<48:57:28,  7.78s/it]
 40%|████      | 15315/37963 [34:39:58<48:57:17,  7.78s/it]
 40%|████      | 15316/37963 [34:40:09<53:55:52,  8.57s/it]
 40%|████      | 15317/37963 [34:40:17<52:32:10,  8.35s/it]
 40%|████      | 15318/37963 [34:40:27<56:14:30,  8.94s/it]
 40%|████      | 15319/37963 [34:40:35<53:47:37,  8.55s/it]
 40%|████      | 15320/37963 [34:40:45<57:26:48,  9.13s/it]
                                                           
{'loss': '0.168', 'grad_norm': '1.731', 'learning_rate': '1.353e-05', 'epoch': '0.4036'}
+
 40%|████      | 15320/37963 [34:40:45<57:26:48,  9.13s/it]
 40%|████      | 15321/37963 [34:40:53<54:58:36,  8.74s/it]
 40%|████      | 15322/37963 [34:41:00<52:26:54,  8.34s/it]
 40%|████      | 15323/37963 [34:41:08<51:01:05,  8.11s/it]
 40%|████      | 15324/37963 [34:41:15<50:07:18,  7.97s/it]
 40%|████      | 15325/37963 [34:41:23<49:27:26,  7.86s/it]
 40%|████      | 15326/37963 [34:41:31<49:06:34,  7.81s/it]
 40%|████      | 15327/37963 [34:41:38<48:47:54,  7.76s/it]
 40%|████      | 15328/37963 [34:41:46<48:36:25,  7.73s/it]
 40%|████      | 15329/37963 [34:41:54<48:30:51,  7.72s/it]
 40%|████      | 15330/37963 [34:42:01<48:23:26,  7.70s/it]
                                                           
{'loss': '0.1703', 'grad_norm': '2.28', 'learning_rate': '1.352e-05', 'epoch': '0.4038'}
+
 40%|████      | 15330/37963 [34:42:01<48:23:26,  7.70s/it]
 40%|████      | 15331/37963 [34:42:09<47:41:33,  7.59s/it]
 40%|████      | 15332/37963 [34:42:16<47:47:38,  7.60s/it]
 40%|████      | 15333/37963 [34:42:24<47:53:27,  7.62s/it]
 40%|████      | 15334/37963 [34:42:34<52:55:49,  8.42s/it]
 40%|████      | 15335/37963 [34:42:42<51:27:08,  8.19s/it]
 40%|████      | 15336/37963 [34:42:50<50:35:17,  8.05s/it]
 40%|████      | 15337/37963 [34:42:57<49:49:40,  7.93s/it]
 40%|████      | 15338/37963 [34:43:05<48:52:23,  7.78s/it]
 40%|████      | 15339/37963 [34:43:15<53:59:13,  8.59s/it]
 40%|████      | 15340/37963 [34:43:23<52:22:44,  8.34s/it]
                                                           
{'loss': '0.1602', 'grad_norm': '1.956', 'learning_rate': '1.352e-05', 'epoch': '0.4041'}
+
 40%|████      | 15340/37963 [34:43:23<52:22:44,  8.34s/it]
 40%|████      | 15341/37963 [34:43:31<50:55:30,  8.10s/it]
 40%|████      | 15342/37963 [34:43:38<50:08:49,  7.98s/it]
 40%|████      | 15343/37963 [34:43:46<49:38:28,  7.90s/it]
 40%|████      | 15344/37963 [34:43:54<49:52:05,  7.94s/it]
 40%|████      | 15345/37963 [34:44:05<54:44:07,  8.71s/it]
 40%|████      | 15346/37963 [34:44:12<53:02:54,  8.44s/it]
 40%|████      | 15347/37963 [34:44:20<51:28:14,  8.19s/it]
 40%|████      | 15348/37963 [34:44:28<50:21:30,  8.02s/it]
 40%|████      | 15349/37963 [34:44:38<55:24:44,  8.82s/it]
 40%|████      | 15350/37963 [34:44:46<53:52:53,  8.58s/it]
                                                           
{'loss': '0.172', 'grad_norm': '1.331', 'learning_rate': '1.351e-05', 'epoch': '0.4043'}
+
 40%|████      | 15350/37963 [34:44:46<53:52:53,  8.58s/it]
 40%|████      | 15351/37963 [34:44:54<52:05:38,  8.29s/it]
 40%|████      | 15352/37963 [34:45:04<55:44:10,  8.87s/it]
 40%|████      | 15353/37963 [34:45:12<53:25:15,  8.51s/it]
 40%|████      | 15354/37963 [34:45:19<51:57:33,  8.27s/it]
 40%|████      | 15355/37963 [34:45:27<50:48:33,  8.09s/it]
 40%|████      | 15356/37963 [34:45:35<50:12:27,  8.00s/it]
 40%|████      | 15357/37963 [34:45:43<49:49:18,  7.93s/it]
 40%|████      | 15358/37963 [34:45:50<49:20:18,  7.86s/it]
 40%|████      | 15359/37963 [34:45:58<48:55:26,  7.79s/it]
 40%|████      | 15360/37963 [34:46:05<48:08:08,  7.67s/it]
                                                           
{'loss': '0.1647', 'grad_norm': '1.525', 'learning_rate': '1.35e-05', 'epoch': '0.4046'}
+
 40%|████      | 15360/37963 [34:46:05<48:08:08,  7.67s/it]
 40%|████      | 15361/37963 [34:46:13<48:10:23,  7.67s/it]
 40%|████      | 15362/37963 [34:46:23<53:06:24,  8.46s/it]
 40%|████      | 15363/37963 [34:46:34<56:15:20,  8.96s/it]
 40%|████      | 15364/37963 [34:46:44<58:59:21,  9.40s/it]
 40%|████      | 15365/37963 [34:46:52<56:12:35,  8.95s/it]
 40%|████      | 15366/37963 [34:47:00<53:52:39,  8.58s/it]
 40%|████      | 15367/37963 [34:47:07<52:08:10,  8.31s/it]
 40%|████      | 15368/37963 [34:47:15<50:55:58,  8.11s/it]
 40%|████      | 15369/37963 [34:47:23<50:04:16,  7.98s/it]
 40%|████      | 15370/37963 [34:47:30<49:31:35,  7.89s/it]
                                                           
{'loss': '0.1681', 'grad_norm': '3.732', 'learning_rate': '1.349e-05', 'epoch': '0.4049'}
+
 40%|████      | 15370/37963 [34:47:30<49:31:35,  7.89s/it]
 40%|████      | 15371/37963 [34:47:38<49:38:26,  7.91s/it]
 40%|████      | 15372/37963 [34:47:46<49:28:49,  7.88s/it]
 40%|████      | 15373/37963 [34:47:54<49:07:40,  7.83s/it]
 40%|████      | 15374/37963 [34:48:01<48:52:34,  7.79s/it]
 40%|████      | 15375/37963 [34:48:09<48:21:00,  7.71s/it]
 41%|████      | 15376/37963 [34:48:17<48:28:41,  7.73s/it]
 41%|████      | 15377/37963 [34:48:25<48:37:44,  7.75s/it]
 41%|████      | 15378/37963 [34:48:35<53:24:11,  8.51s/it]
 41%|████      | 15379/37963 [34:48:42<51:07:58,  8.15s/it]
 41%|████      | 15380/37963 [34:48:50<50:36:47,  8.07s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '1.111', 'learning_rate': '1.348e-05', 'epoch': '0.4051'}
+
 41%|████      | 15380/37963 [34:48:50<50:36:47,  8.07s/it]
 41%|████      | 15381/37963 [34:48:57<49:13:32,  7.85s/it]
 41%|████      | 15382/37963 [34:49:05<49:04:57,  7.83s/it]
 41%|████      | 15383/37963 [34:49:13<49:06:07,  7.83s/it]
 41%|████      | 15384/37963 [34:49:21<48:40:50,  7.76s/it]
 41%|████      | 15385/37963 [34:49:28<48:36:19,  7.75s/it]
 41%|████      | 15386/37963 [34:49:36<48:43:57,  7.77s/it]
 41%|████      | 15387/37963 [34:49:44<48:22:02,  7.71s/it]
 41%|████      | 15388/37963 [34:49:51<48:27:38,  7.73s/it]
 41%|████      | 15389/37963 [34:49:59<47:41:32,  7.61s/it]
 41%|████      | 15390/37963 [34:50:06<47:51:47,  7.63s/it]
                                                           
{'loss': '0.1616', 'grad_norm': '5.229', 'learning_rate': '1.348e-05', 'epoch': '0.4054'}
+
 41%|████      | 15390/37963 [34:50:06<47:51:47,  7.63s/it]
 41%|████      | 15391/37963 [34:50:14<47:45:12,  7.62s/it]
 41%|████      | 15392/37963 [34:50:24<53:08:01,  8.47s/it]
 41%|████      | 15393/37963 [34:50:35<57:01:45,  9.10s/it]
 41%|████      | 15394/37963 [34:50:43<54:27:02,  8.69s/it]
 41%|████      | 15395/37963 [34:50:50<52:22:51,  8.36s/it]
 41%|████      | 15396/37963 [34:50:58<51:23:50,  8.20s/it]
 41%|████      | 15397/37963 [34:51:06<50:09:30,  8.00s/it]
 41%|████      | 15398/37963 [34:51:16<54:52:35,  8.75s/it]
 41%|████      | 15399/37963 [34:51:24<52:53:50,  8.44s/it]
 41%|████      | 15400/37963 [34:51:32<51:22:20,  8.20s/it]
                                                           
{'loss': '0.155', 'grad_norm': '1.069', 'learning_rate': '1.347e-05', 'epoch': '0.4057'}
+
 41%|████      | 15400/37963 [34:51:32<51:22:20,  8.20s/it]
 41%|████      | 15401/37963 [34:51:42<55:16:09,  8.82s/it]
 41%|████      | 15402/37963 [34:51:50<53:09:10,  8.48s/it]
 41%|████      | 15403/37963 [34:51:57<52:07:26,  8.32s/it]
 41%|████      | 15404/37963 [34:52:05<51:04:19,  8.15s/it]
 41%|████      | 15405/37963 [34:52:13<50:15:23,  8.02s/it]
 41%|████      | 15406/37963 [34:52:21<49:25:54,  7.89s/it]
 41%|████      | 15407/37963 [34:52:28<48:53:34,  7.80s/it]
 41%|████      | 15408/37963 [34:52:36<49:03:15,  7.83s/it]
 41%|████      | 15409/37963 [34:52:46<53:10:00,  8.49s/it]
 41%|████      | 15410/37963 [34:52:54<51:46:53,  8.27s/it]
                                                           
{'loss': '0.1704', 'grad_norm': '1.643', 'learning_rate': '1.346e-05', 'epoch': '0.4059'}
+
 41%|████      | 15410/37963 [34:52:54<51:46:53,  8.27s/it]
 41%|████      | 15411/37963 [34:53:01<50:26:35,  8.05s/it]
 41%|████      | 15412/37963 [34:53:09<49:53:16,  7.96s/it]
 41%|████      | 15413/37963 [34:53:17<49:37:42,  7.92s/it]
 41%|████      | 15414/37963 [34:53:25<49:23:13,  7.88s/it]
 41%|████      | 15415/37963 [34:53:32<48:52:51,  7.80s/it]
 41%|████      | 15416/37963 [34:53:42<53:02:09,  8.47s/it]
 41%|████      | 15417/37963 [34:53:50<51:51:09,  8.28s/it]
 41%|████      | 15418/37963 [34:54:00<55:25:29,  8.85s/it]
 41%|████      | 15419/37963 [34:54:08<53:25:31,  8.53s/it]
 41%|████      | 15420/37963 [34:54:16<52:01:17,  8.31s/it]
                                                           
{'loss': '0.1656', 'grad_norm': '2.661', 'learning_rate': '1.345e-05', 'epoch': '0.4062'}
+
 41%|████      | 15420/37963 [34:54:16<52:01:17,  8.31s/it]
 41%|████      | 15421/37963 [34:54:26<55:50:09,  8.92s/it]
 41%|████      | 15422/37963 [34:54:34<53:50:45,  8.60s/it]
 41%|████      | 15423/37963 [34:54:42<51:30:27,  8.23s/it]
 41%|████      | 15424/37963 [34:54:49<50:09:38,  8.01s/it]
 41%|████      | 15425/37963 [34:54:57<49:31:55,  7.91s/it]
 41%|████      | 15426/37963 [34:55:04<49:17:03,  7.87s/it]
 41%|████      | 15427/37963 [34:55:12<49:14:12,  7.87s/it]
 41%|████      | 15428/37963 [34:55:20<48:38:44,  7.77s/it]
 41%|████      | 15429/37963 [34:55:28<48:26:56,  7.74s/it]
 41%|████      | 15430/37963 [34:55:35<48:10:54,  7.70s/it]
                                                           
{'loss': '0.1669', 'grad_norm': '2.981', 'learning_rate': '1.344e-05', 'epoch': '0.4064'}
+
 41%|████      | 15430/37963 [34:55:35<48:10:54,  7.70s/it]
 41%|████      | 15431/37963 [34:55:43<48:14:57,  7.71s/it]
 41%|████      | 15432/37963 [34:55:51<48:30:04,  7.75s/it]
 41%|████      | 15433/37963 [34:55:58<48:21:04,  7.73s/it]
 41%|████      | 15434/37963 [34:56:06<47:33:36,  7.60s/it]
 41%|████      | 15435/37963 [34:56:13<47:28:01,  7.59s/it]
 41%|████      | 15436/37963 [34:56:23<52:26:58,  8.38s/it]
 41%|████      | 15437/37963 [34:56:34<56:14:29,  8.99s/it]
 41%|████      | 15438/37963 [34:56:42<54:01:45,  8.64s/it]
 41%|████      | 15439/37963 [34:56:49<52:22:58,  8.37s/it]
 41%|████      | 15440/37963 [34:56:57<51:00:48,  8.15s/it]
                                                           
{'loss': '0.1603', 'grad_norm': '2.57', 'learning_rate': '1.344e-05', 'epoch': '0.4067'}
+
 41%|████      | 15440/37963 [34:56:57<51:00:48,  8.15s/it]
 41%|████      | 15441/37963 [34:57:05<49:58:41,  7.99s/it]
 41%|████      | 15442/37963 [34:57:12<48:59:55,  7.83s/it]
 41%|████      | 15443/37963 [34:57:20<48:35:12,  7.77s/it]
 41%|████      | 15444/37963 [34:57:30<53:03:17,  8.48s/it]
 41%|████      | 15445/37963 [34:57:38<52:03:44,  8.32s/it]
 41%|████      | 15446/37963 [34:57:48<55:46:50,  8.92s/it]
 41%|████      | 15447/37963 [34:57:56<53:28:08,  8.55s/it]
 41%|████      | 15448/37963 [34:58:04<51:48:37,  8.28s/it]
 41%|████      | 15449/37963 [34:58:11<50:38:05,  8.10s/it]
 41%|████      | 15450/37963 [34:58:19<49:50:09,  7.97s/it]
                                                           
{'loss': '0.176', 'grad_norm': '1.784', 'learning_rate': '1.343e-05', 'epoch': '0.407'}
+
 41%|████      | 15450/37963 [34:58:19<49:50:09,  7.97s/it]
 41%|████      | 15451/37963 [34:58:27<49:36:21,  7.93s/it]
 41%|████      | 15452/37963 [34:58:35<50:00:16,  8.00s/it]
 41%|████      | 15453/37963 [34:58:43<49:22:50,  7.90s/it]
 41%|████      | 15454/37963 [34:58:50<48:42:17,  7.79s/it]
 41%|████      | 15455/37963 [34:58:58<48:25:08,  7.74s/it]
 41%|████      | 15456/37963 [34:59:05<47:46:48,  7.64s/it]
 41%|████      | 15457/37963 [34:59:13<47:40:24,  7.63s/it]
 41%|████      | 15458/37963 [34:59:20<47:29:48,  7.60s/it]
 41%|████      | 15459/37963 [34:59:28<47:48:16,  7.65s/it]
 41%|████      | 15460/37963 [34:59:36<47:49:30,  7.65s/it]
                                                           
{'loss': '0.1675', 'grad_norm': '4.354', 'learning_rate': '1.342e-05', 'epoch': '0.4072'}
+
 41%|████      | 15460/37963 [34:59:36<47:49:30,  7.65s/it]
 41%|████      | 15461/37963 [34:59:43<47:43:07,  7.63s/it]
 41%|████      | 15462/37963 [34:59:51<47:39:45,  7.63s/it]
 41%|████      | 15463/37963 [35:00:01<52:34:16,  8.41s/it]
 41%|████      | 15464/37963 [35:00:09<52:08:22,  8.34s/it]
 41%|████      | 15465/37963 [35:00:17<50:58:07,  8.16s/it]
 41%|████      | 15466/37963 [35:00:25<50:15:55,  8.04s/it]
 41%|████      | 15467/37963 [35:00:35<54:47:30,  8.77s/it]
 41%|████      | 15468/37963 [35:00:43<52:33:29,  8.41s/it]
 41%|████      | 15469/37963 [35:00:53<55:47:21,  8.93s/it]
 41%|████      | 15470/37963 [35:01:03<58:12:07,  9.32s/it]
                                                           
{'loss': '0.1459', 'grad_norm': '1.382', 'learning_rate': '1.341e-05', 'epoch': '0.4075'}
+
 41%|████      | 15470/37963 [35:01:03<58:12:07,  9.32s/it]
 41%|████      | 15471/37963 [35:01:11<54:39:43,  8.75s/it]
 41%|████      | 15472/37963 [35:01:18<52:14:51,  8.36s/it]
 41%|████      | 15473/37963 [35:01:25<50:21:26,  8.06s/it]
 41%|████      | 15474/37963 [35:01:33<49:03:01,  7.85s/it]
 41%|████      | 15475/37963 [35:01:41<48:49:01,  7.81s/it]
 41%|████      | 15476/37963 [35:01:48<48:54:08,  7.83s/it]
 41%|████      | 15477/37963 [35:01:56<48:15:45,  7.73s/it]
 41%|████      | 15478/37963 [35:02:04<48:31:23,  7.77s/it]
 41%|████      | 15479/37963 [35:02:14<53:02:39,  8.49s/it]
 41%|████      | 15480/37963 [35:02:21<51:14:54,  8.21s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '1.194', 'learning_rate': '1.34e-05', 'epoch': '0.4078'}
+
 41%|████      | 15480/37963 [35:02:21<51:14:54,  8.21s/it]
 41%|████      | 15481/37963 [35:02:32<54:59:44,  8.81s/it]
 41%|████      | 15482/37963 [35:02:39<52:50:30,  8.46s/it]
 41%|████      | 15483/37963 [35:02:47<51:40:46,  8.28s/it]
 41%|████      | 15484/37963 [35:02:55<50:18:29,  8.06s/it]
 41%|████      | 15485/37963 [35:03:02<49:13:15,  7.88s/it]
 41%|████      | 15486/37963 [35:03:10<48:31:25,  7.77s/it]
 41%|████      | 15487/37963 [35:03:17<48:13:55,  7.73s/it]
 41%|████      | 15488/37963 [35:03:25<48:09:45,  7.71s/it]
 41%|████      | 15489/37963 [35:03:33<48:04:35,  7.70s/it]
 41%|████      | 15490/37963 [35:03:40<48:04:02,  7.70s/it]
                                                           
{'loss': '0.1549', 'grad_norm': '1.897', 'learning_rate': '1.34e-05', 'epoch': '0.408'}
+
 41%|████      | 15490/37963 [35:03:40<48:04:02,  7.70s/it]
 41%|████      | 15491/37963 [35:03:48<47:58:33,  7.69s/it]
 41%|████      | 15492/37963 [35:03:56<48:01:57,  7.70s/it]
 41%|████      | 15493/37963 [35:04:04<48:17:27,  7.74s/it]
 41%|████      | 15494/37963 [35:04:14<53:31:53,  8.58s/it]
 41%|████      | 15495/37963 [35:04:22<51:54:54,  8.32s/it]
 41%|████      | 15496/37963 [35:04:30<50:50:50,  8.15s/it]
 41%|████      | 15497/37963 [35:04:40<54:53:59,  8.80s/it]
 41%|████      | 15498/37963 [35:04:48<52:40:48,  8.44s/it]
 41%|████      | 15499/37963 [35:04:55<51:17:19,  8.22s/it]
 41%|████      | 15500/37963 [35:05:03<50:20:02,  8.07s/it]
                                                           
{'loss': '0.1697', 'grad_norm': '4.012', 'learning_rate': '1.339e-05', 'epoch': '0.4083'}
+
 41%|████      | 15500/37963 [35:05:03<50:20:02,  8.07s/it]
 41%|████      | 15501/37963 [35:05:11<49:27:20,  7.93s/it]
 41%|████      | 15502/37963 [35:05:18<48:54:11,  7.84s/it]
 41%|████      | 15503/37963 [35:05:25<47:53:45,  7.68s/it]
 41%|████      | 15504/37963 [35:05:33<47:40:44,  7.64s/it]
 41%|████      | 15505/37963 [35:05:40<47:21:38,  7.59s/it]
 41%|████      | 15506/37963 [35:05:48<47:25:10,  7.60s/it]
 41%|████      | 15507/37963 [35:05:56<47:32:11,  7.62s/it]
 41%|████      | 15508/37963 [35:06:03<47:34:30,  7.63s/it]
 41%|████      | 15509/37963 [35:06:11<48:01:49,  7.70s/it]
 41%|████      | 15510/37963 [35:06:19<48:18:50,  7.75s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '1.47', 'learning_rate': '1.338e-05', 'epoch': '0.4086'}
+
 41%|████      | 15510/37963 [35:06:19<48:18:50,  7.75s/it]
 41%|████      | 15511/37963 [35:06:27<48:41:16,  7.81s/it]
 41%|████      | 15512/37963 [35:06:35<48:24:27,  7.76s/it]
 41%|████      | 15513/37963 [35:06:45<52:51:20,  8.48s/it]
 41%|████      | 15514/37963 [35:06:53<51:43:01,  8.29s/it]
 41%|████      | 15515/37963 [35:07:03<55:20:35,  8.88s/it]
 41%|████      | 15516/37963 [35:07:11<52:46:13,  8.46s/it]
 41%|████      | 15517/37963 [35:07:21<55:59:20,  8.98s/it]
 41%|████      | 15518/37963 [35:07:29<53:47:57,  8.63s/it]
 41%|████      | 15519/37963 [35:07:36<52:16:33,  8.39s/it]
 41%|████      | 15520/37963 [35:07:46<54:56:11,  8.81s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '3.227', 'learning_rate': '1.337e-05', 'epoch': '0.4088'}
+
 41%|████      | 15520/37963 [35:07:46<54:56:11,  8.81s/it]
 41%|████      | 15521/37963 [35:07:54<52:49:09,  8.47s/it]
 41%|████      | 15522/37963 [35:08:01<51:17:12,  8.23s/it]
 41%|████      | 15523/37963 [35:08:09<49:59:54,  8.02s/it]
 41%|████      | 15524/37963 [35:08:17<49:39:08,  7.97s/it]
 41%|████      | 15525/37963 [35:08:27<54:15:37,  8.71s/it]
 41%|████      | 15526/37963 [35:08:35<52:40:28,  8.45s/it]
 41%|████      | 15527/37963 [35:08:43<51:13:08,  8.22s/it]
 41%|████      | 15528/37963 [35:08:51<50:46:14,  8.15s/it]
 41%|████      | 15529/37963 [35:08:58<49:15:59,  7.91s/it]
 41%|████      | 15530/37963 [35:09:06<49:12:08,  7.90s/it]
                                                           
{'loss': '0.1673', 'grad_norm': '2.329', 'learning_rate': '1.336e-05', 'epoch': '0.4091'}
+
 41%|████      | 15530/37963 [35:09:06<49:12:08,  7.90s/it]
 41%|████      | 15531/37963 [35:09:14<49:37:19,  7.96s/it]
 41%|████      | 15532/37963 [35:09:22<48:47:10,  7.83s/it]
 41%|████      | 15533/37963 [35:09:32<53:40:46,  8.62s/it]
 41%|████      | 15534/37963 [35:09:40<52:14:13,  8.38s/it]
 41%|████      | 15535/37963 [35:09:48<51:14:49,  8.23s/it]
 41%|████      | 15536/37963 [35:09:55<50:16:37,  8.07s/it]
 41%|████      | 15537/37963 [35:10:03<50:03:59,  8.04s/it]
 41%|████      | 15538/37963 [35:10:11<49:39:24,  7.97s/it]
 41%|████      | 15539/37963 [35:10:19<49:07:38,  7.89s/it]
 41%|████      | 15540/37963 [35:10:27<48:28:52,  7.78s/it]
                                                           
{'loss': '0.1738', 'grad_norm': '2.086', 'learning_rate': '1.336e-05', 'epoch': '0.4093'}
+
 41%|████      | 15540/37963 [35:10:27<48:28:52,  7.78s/it]
 41%|████      | 15541/37963 [35:10:34<47:59:30,  7.71s/it]
 41%|████      | 15542/37963 [35:10:42<47:43:45,  7.66s/it]
 41%|████      | 15543/37963 [35:10:52<52:50:31,  8.48s/it]
 41%|████      | 15544/37963 [35:11:00<51:24:46,  8.26s/it]
 41%|████      | 15545/37963 [35:11:07<50:09:52,  8.06s/it]
 41%|████      | 15546/37963 [35:11:15<49:57:54,  8.02s/it]
 41%|████      | 15547/37963 [35:11:23<49:22:14,  7.93s/it]
 41%|████      | 15548/37963 [35:11:31<48:39:54,  7.82s/it]
 41%|████      | 15549/37963 [35:11:38<47:28:02,  7.62s/it]
 41%|████      | 15550/37963 [35:11:45<47:27:42,  7.62s/it]
                                                           
{'loss': '0.1699', 'grad_norm': '1.949', 'learning_rate': '1.335e-05', 'epoch': '0.4096'}
+
 41%|████      | 15550/37963 [35:11:45<47:27:42,  7.62s/it]
 41%|████      | 15551/37963 [35:11:56<52:22:32,  8.41s/it]
 41%|████      | 15552/37963 [35:12:03<50:55:38,  8.18s/it]
 41%|████      | 15553/37963 [35:12:11<50:10:22,  8.06s/it]
 41%|████      | 15554/37963 [35:12:19<49:37:30,  7.97s/it]
 41%|████      | 15555/37963 [35:12:26<49:04:49,  7.89s/it]
 41%|████      | 15556/37963 [35:12:34<48:38:22,  7.81s/it]
 41%|████      | 15557/37963 [35:12:44<53:08:18,  8.54s/it]
 41%|████      | 15558/37963 [35:12:52<51:48:42,  8.33s/it]
 41%|████      | 15559/37963 [35:13:00<50:30:30,  8.12s/it]
 41%|████      | 15560/37963 [35:13:07<49:38:44,  7.98s/it]
                                                           
{'loss': '0.1592', 'grad_norm': '2.201', 'learning_rate': '1.334e-05', 'epoch': '0.4099'}
+
 41%|████      | 15560/37963 [35:13:07<49:38:44,  7.98s/it]
 41%|████      | 15561/37963 [35:13:15<49:05:49,  7.89s/it]
 41%|████      | 15562/37963 [35:13:23<49:06:38,  7.89s/it]
 41%|████      | 15563/37963 [35:13:34<54:00:56,  8.68s/it]
 41%|████      | 15564/37963 [35:13:41<52:04:33,  8.37s/it]
 41%|████      | 15565/37963 [35:13:49<50:36:17,  8.13s/it]
 41%|████      | 15566/37963 [35:13:56<49:43:02,  7.99s/it]
 41%|████      | 15567/37963 [35:14:04<48:49:50,  7.85s/it]
 41%|████      | 15568/37963 [35:14:14<53:35:08,  8.61s/it]
 41%|████      | 15569/37963 [35:14:25<56:43:27,  9.12s/it]
 41%|████      | 15570/37963 [35:14:32<54:02:43,  8.69s/it]
                                                           
{'loss': '0.1591', 'grad_norm': '0.9065', 'learning_rate': '1.333e-05', 'epoch': '0.4101'}
+
 41%|████      | 15570/37963 [35:14:32<54:02:43,  8.69s/it]
 41%|████      | 15571/37963 [35:14:43<57:08:10,  9.19s/it]
 41%|████      | 15572/37963 [35:14:51<54:40:10,  8.79s/it]
 41%|████      | 15573/37963 [35:14:58<52:59:39,  8.52s/it]
 41%|████      | 15574/37963 [35:15:06<51:37:36,  8.30s/it]
 41%|████      | 15575/37963 [35:15:14<50:29:07,  8.12s/it]
 41%|████      | 15576/37963 [35:15:21<49:31:21,  7.96s/it]
 41%|████      | 15577/37963 [35:15:29<49:18:20,  7.93s/it]
 41%|████      | 15578/37963 [35:15:37<48:41:55,  7.83s/it]
 41%|████      | 15579/37963 [35:15:45<48:21:37,  7.78s/it]
 41%|████      | 15580/37963 [35:15:52<48:15:54,  7.76s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '0.9145', 'learning_rate': '1.332e-05', 'epoch': '0.4104'}
+
 41%|████      | 15580/37963 [35:15:52<48:15:54,  7.76s/it]
 41%|████      | 15581/37963 [35:16:03<53:32:09,  8.61s/it]
 41%|████      | 15582/37963 [35:16:11<52:25:06,  8.43s/it]
 41%|████      | 15583/37963 [35:16:19<50:53:58,  8.19s/it]
 41%|████      | 15584/37963 [35:16:26<49:17:24,  7.93s/it]
 41%|████      | 15585/37963 [35:16:33<48:37:48,  7.82s/it]
 41%|████      | 15586/37963 [35:16:41<48:26:55,  7.79s/it]
 41%|████      | 15587/37963 [35:16:49<48:09:30,  7.75s/it]
 41%|████      | 15588/37963 [35:16:57<48:02:48,  7.73s/it]
 41%|████      | 15589/37963 [35:17:04<48:10:39,  7.75s/it]
 41%|████      | 15590/37963 [35:17:12<47:51:03,  7.70s/it]
                                                           
{'loss': '0.1453', 'grad_norm': '4.455', 'learning_rate': '1.332e-05', 'epoch': '0.4107'}
+
 41%|████      | 15590/37963 [35:17:12<47:51:03,  7.70s/it]
 41%|████      | 15591/37963 [35:17:20<47:59:19,  7.72s/it]
 41%|████      | 15592/37963 [35:17:27<47:41:56,  7.68s/it]
 41%|████      | 15593/37963 [35:17:35<47:43:04,  7.68s/it]
 41%|████      | 15594/37963 [35:17:43<48:03:15,  7.73s/it]
 41%|████      | 15595/37963 [35:17:53<52:28:56,  8.45s/it]
 41%|████      | 15596/37963 [35:18:03<55:48:24,  8.98s/it]
 41%|████      | 15597/37963 [35:18:11<53:31:31,  8.62s/it]
 41%|████      | 15598/37963 [35:18:19<51:47:00,  8.34s/it]
 41%|████      | 15599/37963 [35:18:26<50:49:08,  8.18s/it]
 41%|████      | 15600/37963 [35:18:34<49:45:08,  8.01s/it]
                                                           
{'loss': '0.1685', 'grad_norm': '1.474', 'learning_rate': '1.331e-05', 'epoch': '0.4109'}
+
 41%|████      | 15600/37963 [35:18:34<49:45:08,  8.01s/it]
 41%|████      | 15601/37963 [35:18:42<49:34:50,  7.98s/it]
 41%|████      | 15602/37963 [35:18:50<48:57:50,  7.88s/it]
 41%|████      | 15603/37963 [35:18:58<49:08:35,  7.91s/it]
 41%|████      | 15604/37963 [35:19:05<48:32:28,  7.82s/it]
 41%|████      | 15605/37963 [35:19:15<53:09:09,  8.56s/it]
 41%|████      | 15606/37963 [35:19:23<52:02:53,  8.38s/it]
 41%|████      | 15607/37963 [35:19:33<55:03:00,  8.86s/it]
 41%|████      | 15608/37963 [35:19:41<52:45:53,  8.50s/it]
 41%|████      | 15609/37963 [35:19:48<50:29:22,  8.13s/it]
 41%|████      | 15610/37963 [35:19:56<49:39:38,  8.00s/it]
                                                           
{'loss': '0.1797', 'grad_norm': '3.29', 'learning_rate': '1.33e-05', 'epoch': '0.4112'}
+
 41%|████      | 15610/37963 [35:19:56<49:39:38,  8.00s/it]
 41%|████      | 15611/37963 [35:20:04<49:07:57,  7.91s/it]
 41%|████      | 15612/37963 [35:20:11<48:38:28,  7.83s/it]
 41%|████      | 15613/37963 [35:20:19<48:13:10,  7.77s/it]
 41%|████      | 15614/37963 [35:20:27<47:53:51,  7.72s/it]
 41%|████      | 15615/37963 [35:20:34<47:43:47,  7.69s/it]
 41%|████      | 15616/37963 [35:20:45<52:58:57,  8.54s/it]
 41%|████      | 15617/37963 [35:20:55<56:02:25,  9.03s/it]
 41%|████      | 15618/37963 [35:21:03<53:47:14,  8.67s/it]
 41%|████      | 15619/37963 [35:21:13<57:35:06,  9.28s/it]
 41%|████      | 15620/37963 [35:21:21<54:52:21,  8.84s/it]
                                                           
{'loss': '0.1648', 'grad_norm': '2.247', 'learning_rate': '1.329e-05', 'epoch': '0.4115'}
+
 41%|████      | 15620/37963 [35:21:21<54:52:21,  8.84s/it]
 41%|████      | 15621/37963 [35:21:29<52:55:35,  8.53s/it]
 41%|████      | 15622/37963 [35:21:37<51:08:28,  8.24s/it]
 41%|████      | 15623/37963 [35:21:44<50:12:14,  8.09s/it]
 41%|████      | 15624/37963 [35:21:52<49:18:05,  7.95s/it]
 41%|████      | 15625/37963 [35:22:00<48:57:36,  7.89s/it]
 41%|████      | 15626/37963 [35:22:07<47:45:05,  7.70s/it]
 41%|████      | 15627/37963 [35:22:15<48:03:29,  7.75s/it]
 41%|████      | 15628/37963 [35:22:23<48:14:33,  7.78s/it]
 41%|████      | 15629/37963 [35:22:30<47:59:52,  7.74s/it]
 41%|████      | 15630/37963 [35:22:41<53:15:14,  8.58s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '1.519', 'learning_rate': '1.328e-05', 'epoch': '0.4117'}
+
 41%|████      | 15630/37963 [35:22:41<53:15:14,  8.58s/it]
 41%|████      | 15631/37963 [35:22:49<51:41:01,  8.33s/it]
 41%|████      | 15632/37963 [35:22:56<50:28:58,  8.14s/it]
 41%|████      | 15633/37963 [35:23:04<48:56:25,  7.89s/it]
 41%|████      | 15634/37963 [35:23:11<47:58:35,  7.74s/it]
 41%|████      | 15635/37963 [35:23:19<47:39:46,  7.68s/it]
 41%|████      | 15636/37963 [35:23:26<47:45:36,  7.70s/it]
 41%|████      | 15637/37963 [35:23:34<48:04:06,  7.75s/it]
 41%|████      | 15638/37963 [35:23:42<47:48:18,  7.71s/it]
 41%|████      | 15639/37963 [35:23:52<52:13:53,  8.42s/it]
 41%|████      | 15640/37963 [35:24:00<51:06:15,  8.24s/it]
                                                           
{'loss': '0.151', 'grad_norm': '1.681', 'learning_rate': '1.328e-05', 'epoch': '0.412'}
+
 41%|████      | 15640/37963 [35:24:00<51:06:15,  8.24s/it]
 41%|████      | 15641/37963 [35:24:07<50:08:40,  8.09s/it]
 41%|████      | 15642/37963 [35:24:15<49:14:12,  7.94s/it]
 41%|████      | 15643/37963 [35:24:23<48:45:19,  7.86s/it]
 41%|████      | 15644/37963 [35:24:30<47:52:01,  7.72s/it]
 41%|████      | 15645/37963 [35:24:38<47:30:02,  7.66s/it]
 41%|████      | 15646/37963 [35:24:45<47:32:37,  7.67s/it]
 41%|████      | 15647/37963 [35:24:53<47:56:09,  7.73s/it]
 41%|████      | 15648/37963 [35:25:01<48:16:05,  7.79s/it]
 41%|████      | 15649/37963 [35:25:09<47:50:43,  7.72s/it]
 41%|████      | 15650/37963 [35:25:19<53:19:12,  8.60s/it]
                                                           
{'loss': '0.1689', 'grad_norm': '4.649', 'learning_rate': '1.327e-05', 'epoch': '0.4122'}
+
 41%|████      | 15650/37963 [35:25:19<53:19:12,  8.60s/it]
 41%|████      | 15651/37963 [35:25:28<52:35:49,  8.49s/it]
 41%|████      | 15652/37963 [35:25:35<51:30:28,  8.31s/it]
 41%|████      | 15653/37963 [35:25:46<55:01:42,  8.88s/it]
 41%|████      | 15654/37963 [35:25:53<53:00:42,  8.55s/it]
 41%|████      | 15655/37963 [35:26:04<56:38:01,  9.14s/it]
 41%|████      | 15656/37963 [35:26:12<54:01:37,  8.72s/it]
 41%|████      | 15657/37963 [35:26:19<51:58:02,  8.39s/it]
 41%|████      | 15658/37963 [35:26:27<51:23:38,  8.29s/it]
 41%|████      | 15659/37963 [35:26:35<49:26:45,  7.98s/it]
 41%|████▏     | 15660/37963 [35:26:45<54:17:19,  8.76s/it]
                                                           
{'loss': '0.1714', 'grad_norm': '1.153', 'learning_rate': '1.326e-05', 'epoch': '0.4125'}
+
 41%|████▏     | 15660/37963 [35:26:45<54:17:19,  8.76s/it]
 41%|████▏     | 15661/37963 [35:26:53<53:04:29,  8.57s/it]
 41%|████▏     | 15662/37963 [35:27:01<51:17:36,  8.28s/it]
 41%|████▏     | 15663/37963 [35:27:09<50:25:34,  8.14s/it]
 41%|████▏     | 15664/37963 [35:27:17<49:59:41,  8.07s/it]
 41%|████▏     | 15665/37963 [35:27:24<49:28:21,  7.99s/it]
 41%|████���     | 15666/37963 [35:27:32<48:53:30,  7.89s/it]
 41%|████▏     | 15667/37963 [35:27:40<48:27:40,  7.82s/it]
 41%|████▏     | 15668/37963 [35:27:47<48:08:54,  7.77s/it]
 41%|████▏     | 15669/37963 [35:27:55<47:47:58,  7.72s/it]
 41%|████▏     | 15670/37963 [35:28:05<52:14:26,  8.44s/it]
                                                           
{'loss': '0.165', 'grad_norm': '2.574', 'learning_rate': '1.325e-05', 'epoch': '0.4128'}
+
 41%|████▏     | 15670/37963 [35:28:05<52:14:26,  8.44s/it]
 41%|████▏     | 15671/37963 [35:28:15<55:05:27,  8.90s/it]
 41%|████▏     | 15672/37963 [35:28:23<52:48:45,  8.53s/it]
 41%|████▏     | 15673/37963 [35:28:30<51:02:01,  8.24s/it]
 41%|████▏     | 15674/37963 [35:28:38<50:13:32,  8.11s/it]
 41%|████▏     | 15675/37963 [35:28:46<49:17:47,  7.96s/it]
 41%|████▏     | 15676/37963 [35:28:54<49:06:11,  7.93s/it]
 41%|████▏     | 15677/37963 [35:29:01<48:43:31,  7.87s/it]
 41%|████▏     | 15678/37963 [35:29:12<53:18:20,  8.61s/it]
 41%|████▏     | 15679/37963 [35:29:20<51:52:34,  8.38s/it]
 41%|████▏     | 15680/37963 [35:29:27<50:30:25,  8.16s/it]
                                                           
{'loss': '0.1635', 'grad_norm': '2.363', 'learning_rate': '1.324e-05', 'epoch': '0.413'}
+
 41%|████▏     | 15680/37963 [35:29:27<50:30:25,  8.16s/it]
 41%|████▏     | 15681/37963 [35:29:35<49:56:04,  8.07s/it]
 41%|████▏     | 15682/37963 [35:29:45<53:57:11,  8.72s/it]
 41%|████▏     | 15683/37963 [35:29:53<51:16:02,  8.28s/it]
 41%|████▏     | 15684/37963 [35:30:00<50:13:00,  8.11s/it]
 41%|████▏     | 15685/37963 [35:30:08<49:05:34,  7.93s/it]
 41%|████▏     | 15686/37963 [35:30:15<48:28:53,  7.83s/it]
 41%|████▏     | 15687/37963 [35:30:23<48:13:29,  7.79s/it]
 41%|████▏     | 15688/37963 [35:30:31<48:38:07,  7.86s/it]
 41%|████▏     | 15689/37963 [35:30:39<48:13:36,  7.79s/it]
 41%|████▏     | 15690/37963 [35:30:46<48:07:48,  7.78s/it]
                                                           
{'loss': '0.1683', 'grad_norm': '1.59', 'learning_rate': '1.324e-05', 'epoch': '0.4133'}
+
 41%|████▏     | 15690/37963 [35:30:46<48:07:48,  7.78s/it]
 41%|████▏     | 15691/37963 [35:30:54<47:52:17,  7.74s/it]
 41%|████▏     | 15692/37963 [35:31:02<47:33:03,  7.69s/it]
 41%|████▏     | 15693/37963 [35:31:09<47:35:04,  7.69s/it]
 41%|████▏     | 15694/37963 [35:31:17<47:27:40,  7.67s/it]
 41%|████▏     | 15695/37963 [35:31:25<48:05:46,  7.78s/it]
 41%|████▏     | 15696/37963 [35:31:32<47:29:32,  7.68s/it]
 41%|████▏     | 15697/37963 [35:31:40<46:56:21,  7.59s/it]
 41%|████▏     | 15698/37963 [35:31:47<47:01:36,  7.60s/it]
 41%|████▏     | 15699/37963 [35:31:58<51:48:10,  8.38s/it]
 41%|████▏     | 15700/37963 [35:32:05<50:34:35,  8.18s/it]
                                                           
{'loss': '0.1672', 'grad_norm': '3.37', 'learning_rate': '1.323e-05', 'epoch': '0.4136'}
+
 41%|████▏     | 15700/37963 [35:32:05<50:34:35,  8.18s/it]
 41%|████▏     | 15701/37963 [35:32:16<54:13:17,  8.77s/it]
 41%|████▏     | 15702/37963 [35:32:23<52:00:25,  8.41s/it]
 41%|████▏     | 15703/37963 [35:32:31<50:14:27,  8.13s/it]
 41%|████▏     | 15704/37963 [35:32:38<49:10:02,  7.95s/it]
 41%|████▏     | 15705/37963 [35:32:46<48:55:00,  7.91s/it]
 41%|████▏     | 15706/37963 [35:32:54<48:35:52,  7.86s/it]
 41%|████▏     | 15707/37963 [35:33:02<48:41:09,  7.88s/it]
 41%|████▏     | 15708/37963 [35:33:12<53:05:54,  8.59s/it]
 41%|████▏     | 15709/37963 [35:33:20<51:28:27,  8.33s/it]
 41%|████▏     | 15710/37963 [35:33:27<50:18:56,  8.14s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '4.437', 'learning_rate': '1.322e-05', 'epoch': '0.4138'}
+
 41%|████▏     | 15710/37963 [35:33:27<50:18:56,  8.14s/it]
 41%|████▏     | 15711/37963 [35:33:35<49:29:45,  8.01s/it]
 41%|████▏     | 15712/37963 [35:33:43<48:45:09,  7.89s/it]
 41%|████▏     | 15713/37963 [35:33:50<47:58:10,  7.76s/it]
 41%|████▏     | 15714/37963 [35:33:58<48:09:10,  7.79s/it]
 41%|████▏     | 15715/37963 [35:34:08<52:34:51,  8.51s/it]
 41%|████▏     | 15716/37963 [35:34:16<51:19:47,  8.31s/it]
 41%|████▏     | 15717/37963 [35:34:24<50:37:41,  8.19s/it]
 41%|████▏     | 15718/37963 [35:34:34<54:14:36,  8.78s/it]
 41%|████▏     | 15719/37963 [35:34:42<52:29:04,  8.49s/it]
 41%|████▏     | 15720/37963 [35:34:49<50:41:59,  8.21s/it]
                                                           
{'loss': '0.1703', 'grad_norm': '2.197', 'learning_rate': '1.321e-05', 'epoch': '0.4141'}
+
 41%|████▏     | 15720/37963 [35:34:49<50:41:59,  8.21s/it]
 41%|████▏     | 15721/37963 [35:34:57<49:32:02,  8.02s/it]
 41%|████▏     | 15722/37963 [35:35:05<49:07:22,  7.95s/it]
 41%|████▏     | 15723/37963 [35:35:12<48:27:45,  7.84s/it]
 41%|████▏     | 15724/37963 [35:35:20<47:59:11,  7.77s/it]
 41%|████▏     | 15725/37963 [35:35:28<47:46:34,  7.73s/it]
 41%|████▏     | 15726/37963 [35:35:38<53:06:12,  8.60s/it]
 41%|████▏     | 15727/37963 [35:35:46<51:41:29,  8.37s/it]
 41%|████▏     | 15728/37963 [35:35:54<50:36:29,  8.19s/it]
 41%|████▏     | 15729/37963 [35:36:01<49:34:37,  8.03s/it]
 41%|████▏     | 15730/37963 [35:36:12<53:39:37,  8.69s/it]
                                                           
{'loss': '0.1752', 'grad_norm': '2.412', 'learning_rate': '1.32e-05', 'epoch': '0.4144'}
+
 41%|████▏     | 15730/37963 [35:36:12<53:39:37,  8.69s/it]
 41%|████▏     | 15731/37963 [35:36:19<51:24:01,  8.32s/it]
 41%|████▏     | 15732/37963 [35:36:27<50:29:14,  8.18s/it]
 41%|████▏     | 15733/37963 [35:36:35<49:34:23,  8.03s/it]
 41%|████▏     | 15734/37963 [35:36:42<48:48:49,  7.91s/it]
 41%|████▏     | 15735/37963 [35:36:50<48:22:01,  7.83s/it]
 41%|████▏     | 15736/37963 [35:36:58<48:12:09,  7.81s/it]
 41%|████▏     | 15737/37963 [35:37:06<48:26:06,  7.85s/it]
 41%|████▏     | 15738/37963 [35:37:13<47:50:08,  7.75s/it]
 41%|████▏     | 15739/37963 [35:37:21<47:23:21,  7.68s/it]
 41%|████▏     | 15740/37963 [35:37:28<47:41:29,  7.73s/it]
                                                           
{'loss': '0.1606', 'grad_norm': '3.068', 'learning_rate': '1.32e-05', 'epoch': '0.4146'}
+
 41%|████▏     | 15740/37963 [35:37:28<47:41:29,  7.73s/it]
 41%|████▏     | 15741/37963 [35:37:36<47:26:33,  7.69s/it]
 41%|████▏     | 15742/37963 [35:37:47<52:49:19,  8.56s/it]
 41%|████▏     | 15743/37963 [35:37:54<51:13:45,  8.30s/it]
 41%|████▏     | 15744/37963 [35:38:02<50:21:46,  8.16s/it]
 41%|████▏     | 15745/37963 [35:38:10<49:25:48,  8.01s/it]
 41%|████▏     | 15746/37963 [35:38:17<48:34:01,  7.87s/it]
 41%|████▏     | 15747/37963 [35:38:28<53:28:59,  8.67s/it]
 41%|████▏     | 15748/37963 [35:38:36<51:47:10,  8.39s/it]
 41%|████▏     | 15749/37963 [35:38:43<50:15:15,  8.14s/it]
 41%|████▏     | 15750/37963 [35:38:54<54:17:00,  8.80s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '3.421', 'learning_rate': '1.319e-05', 'epoch': '0.4149'}
+
 41%|████▏     | 15750/37963 [35:38:54<54:17:00,  8.80s/it]
 41%|████▏     | 15751/37963 [35:39:01<52:25:35,  8.50s/it]
 41%|████▏     | 15752/37963 [35:39:12<55:48:16,  9.04s/it]
 41%|████▏     | 15753/37963 [35:39:19<53:04:44,  8.60s/it]
 41%|████▏     | 15754/37963 [35:39:27<51:24:51,  8.33s/it]
 42%|████▏     | 15755/37963 [35:39:34<49:33:44,  8.03s/it]
 42%|████▏     | 15756/37963 [35:39:42<49:04:04,  7.95s/it]
 42%|████▏     | 15757/37963 [35:39:50<48:11:34,  7.81s/it]
 42%|████▏     | 15758/37963 [35:39:57<48:08:11,  7.80s/it]
 42%|████▏     | 15759/37963 [35:40:05<47:48:03,  7.75s/it]
 42%|████▏     | 15760/37963 [35:40:15<52:07:14,  8.45s/it]
                                                           
{'loss': '0.1702', 'grad_norm': '2.383', 'learning_rate': '1.318e-05', 'epoch': '0.4151'}
+
 42%|████▏     | 15760/37963 [35:40:15<52:07:14,  8.45s/it]
 42%|████▏     | 15761/37963 [35:40:23<50:46:34,  8.23s/it]
 42%|████▏     | 15762/37963 [35:40:30<49:43:12,  8.06s/it]
 42%|████▏     | 15763/37963 [35:40:38<48:53:41,  7.93s/it]
 42%|████▏     | 15764/37963 [35:40:46<48:03:47,  7.79s/it]
 42%|████▏     | 15765/37963 [35:40:56<52:34:24,  8.53s/it]
 42%|████▏     | 15766/37963 [35:41:04<51:28:42,  8.35s/it]
 42%|████▏     | 15767/37963 [35:41:11<49:50:03,  8.08s/it]
 42%|████▏     | 15768/37963 [35:41:19<49:29:51,  8.03s/it]
 42%|████▏     | 15769/37963 [35:41:27<49:14:06,  7.99s/it]
 42%|████▏     | 15770/37963 [35:41:35<48:40:11,  7.89s/it]
                                                           
{'loss': '0.1792', 'grad_norm': '2.878', 'learning_rate': '1.317e-05', 'epoch': '0.4154'}
+
 42%|████▏     | 15770/37963 [35:41:35<48:40:11,  7.89s/it]
 42%|████▏     | 15771/37963 [35:41:42<48:02:53,  7.79s/it]
 42%|████▏     | 15772/37963 [35:41:50<47:56:28,  7.78s/it]
 42%|████▏     | 15773/37963 [35:41:58<47:56:56,  7.78s/it]
 42%|████▏     | 15774/37963 [35:42:11<57:42:00,  9.36s/it]
 42%|████▏     | 15775/37963 [35:42:18<54:15:02,  8.80s/it]
 42%|████▏     | 15776/37963 [35:42:26<52:06:30,  8.45s/it]
 42%|████▏     | 15777/37963 [35:42:34<50:36:50,  8.21s/it]
 42%|████▏     | 15778/37963 [35:42:41<49:12:04,  7.98s/it]
 42%|████▏     | 15779/37963 [35:42:49<48:28:47,  7.87s/it]
 42%|████▏     | 15780/37963 [35:42:57<48:38:41,  7.89s/it]
                                                           
{'loss': '0.1616', 'grad_norm': '1.343', 'learning_rate': '1.316e-05', 'epoch': '0.4157'}
+
 42%|████▏     | 15780/37963 [35:42:57<48:38:41,  7.89s/it]
 42%|████▏     | 15781/37963 [35:43:04<48:00:32,  7.79s/it]
 42%|████▏     | 15782/37963 [35:43:12<47:38:30,  7.73s/it]
 42%|████▏     | 15783/37963 [35:43:19<47:30:02,  7.71s/it]
 42%|████▏     | 15784/37963 [35:43:27<47:08:44,  7.65s/it]
 42%|████▏     | 15785/37963 [35:43:35<47:44:33,  7.75s/it]
 42%|████▏     | 15786/37963 [35:43:45<52:41:30,  8.55s/it]
 42%|████▏     | 15787/37963 [35:43:53<51:27:19,  8.35s/it]
 42%|████▏     | 15788/37963 [35:44:01<50:10:25,  8.15s/it]
 42%|████▏     | 15789/37963 [35:44:09<49:32:15,  8.04s/it]
 42%|████▏     | 15790/37963 [35:44:16<48:33:46,  7.88s/it]
                                                           
{'loss': '0.1742', 'grad_norm': '1.554', 'learning_rate': '1.315e-05', 'epoch': '0.4159'}
+
 42%|████▏     | 15790/37963 [35:44:16<48:33:46,  7.88s/it]
 42%|████▏     | 15791/37963 [35:44:24<48:22:31,  7.85s/it]
 42%|████▏     | 15792/37963 [35:44:32<48:05:19,  7.81s/it]
 42%|████▏     | 15793/37963 [35:44:39<48:08:18,  7.82s/it]
 42%|████▏     | 15794/37963 [35:44:47<48:02:03,  7.80s/it]
 42%|████▏     | 15795/37963 [35:45:00<57:33:48,  9.35s/it]
 42%|████▏     | 15796/37963 [35:45:08<54:27:34,  8.84s/it]
 42%|████▏     | 15797/37963 [35:45:16<52:24:49,  8.51s/it]
 42%|████▏     | 15798/37963 [35:45:23<50:38:38,  8.23s/it]
 42%|████▏     | 15799/37963 [35:45:31<49:13:19,  7.99s/it]
 42%|████▏     | 15800/37963 [35:45:39<49:09:50,  7.99s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '1.365', 'learning_rate': '1.315e-05', 'epoch': '0.4162'}
+
 42%|████▏     | 15800/37963 [35:45:39<49:09:50,  7.99s/it]
 42%|████▏     | 15801/37963 [35:45:46<48:45:01,  7.92s/it]
 42%|████▏     | 15802/37963 [35:45:54<48:16:17,  7.84s/it]
 42%|████▏     | 15803/37963 [35:46:02<47:53:13,  7.78s/it]
 42%|████▏     | 15804/37963 [35:46:12<52:06:59,  8.47s/it]
 42%|████▏     | 15805/37963 [35:46:19<50:46:28,  8.25s/it]
 42%|████▏     | 15806/37963 [35:46:27<49:55:16,  8.11s/it]
 42%|████▏     | 15807/37963 [35:46:35<49:55:32,  8.11s/it]
 42%|████▏     | 15808/37963 [35:46:48<58:03:22,  9.43s/it]
 42%|████▏     | 15809/37963 [35:46:56<55:22:35,  9.00s/it]
 42%|████▏     | 15810/37963 [35:47:04<53:01:45,  8.62s/it]
                                                           
{'loss': '0.1546', 'grad_norm': '1.854', 'learning_rate': '1.314e-05', 'epoch': '0.4165'}
+
 42%|████▏     | 15810/37963 [35:47:04<53:01:45,  8.62s/it]
 42%|████▏     | 15811/37963 [35:47:11<51:01:36,  8.29s/it]
 42%|████▏     | 15812/37963 [35:47:19<49:50:29,  8.10s/it]
 42%|████▏     | 15813/37963 [35:47:27<49:15:54,  8.01s/it]
 42%|████▏     | 15814/37963 [35:47:34<48:47:09,  7.93s/it]
 42%|████▏     | 15815/37963 [35:47:42<48:05:05,  7.82s/it]
 42%|████▏     | 15816/37963 [35:47:50<47:50:52,  7.78s/it]
 42%|████▏     | 15817/37963 [35:47:57<47:53:46,  7.79s/it]
 42%|████▏     | 15818/37963 [35:48:08<52:21:02,  8.51s/it]
 42%|████▏     | 15819/37963 [35:48:15<50:59:03,  8.29s/it]
 42%|████▏     | 15820/37963 [35:48:23<49:33:30,  8.06s/it]
                                                           
{'loss': '0.17', 'grad_norm': '3.986', 'learning_rate': '1.313e-05', 'epoch': '0.4167'}
+
 42%|████▏     | 15820/37963 [35:48:23<49:33:30,  8.06s/it]
 42%|████▏     | 15821/37963 [35:48:31<48:58:10,  7.96s/it]
 42%|████▏     | 15822/37963 [35:48:41<53:34:15,  8.71s/it]
 42%|████▏     | 15823/37963 [35:48:49<52:01:28,  8.46s/it]
 42%|████▏     | 15824/37963 [35:48:57<51:01:23,  8.30s/it]
 42%|████▏     | 15825/37963 [35:49:05<49:53:41,  8.11s/it]
 42%|████▏     | 15826/37963 [35:49:12<48:06:08,  7.82s/it]
 42%|████▏     | 15827/37963 [35:49:19<47:46:01,  7.77s/it]
 42%|████▏     | 15828/37963 [35:49:27<47:40:52,  7.75s/it]
 42%|████▏     | 15829/37963 [35:49:35<47:25:38,  7.71s/it]
 42%|████▏     | 15830/37963 [35:49:42<47:36:09,  7.74s/it]
                                                           
{'loss': '0.1618', 'grad_norm': '1.372', 'learning_rate': '1.312e-05', 'epoch': '0.417'}
+
 42%|████▏     | 15830/37963 [35:49:42<47:36:09,  7.74s/it]
 42%|████▏     | 15831/37963 [35:49:50<48:03:59,  7.82s/it]
 42%|████▏     | 15832/37963 [35:49:58<48:05:53,  7.82s/it]
 42%|████▏     | 15833/37963 [35:50:06<47:11:45,  7.68s/it]
 42%|████▏     | 15834/37963 [35:50:16<51:38:18,  8.40s/it]
 42%|████▏     | 15835/37963 [35:50:24<50:32:29,  8.22s/it]
 42%|████▏     | 15836/37963 [35:50:31<49:26:13,  8.04s/it]
 42%|████▏     | 15837/37963 [35:50:39<48:35:36,  7.91s/it]
 42%|████▏     | 15838/37963 [35:50:49<52:58:13,  8.62s/it]
 42%|████▏     | 15839/37963 [35:50:59<56:22:59,  9.17s/it]
 42%|████▏     | 15840/37963 [35:51:07<53:34:16,  8.72s/it]
                                                           
{'loss': '0.1653', 'grad_norm': '1.308', 'learning_rate': '1.311e-05', 'epoch': '0.4172'}
+
 42%|████▏     | 15840/37963 [35:51:07<53:34:16,  8.72s/it]
 42%|████▏     | 15841/37963 [35:51:15<51:16:47,  8.34s/it]
 42%|████▏     | 15842/37963 [35:51:22<49:56:04,  8.13s/it]
 42%|████▏     | 15843/37963 [35:51:30<49:12:16,  8.01s/it]
 42%|████▏     | 15844/37963 [35:51:38<48:45:54,  7.94s/it]
 42%|████▏     | 15845/37963 [35:51:46<48:47:20,  7.94s/it]
 42%|████▏     | 15846/37963 [35:51:54<48:37:23,  7.91s/it]
 42%|████▏     | 15847/37963 [35:52:01<47:45:21,  7.77s/it]
 42%|████▏     | 15848/37963 [35:52:09<47:49:27,  7.79s/it]
 42%|████▏     | 15849/37963 [35:52:16<46:38:55,  7.59s/it]
 42%|████▏     | 15850/37963 [35:52:24<46:49:50,  7.62s/it]
                                                           
{'loss': '0.1485', 'grad_norm': '1.633', 'learning_rate': '1.311e-05', 'epoch': '0.4175'}
+
 42%|████▏     | 15850/37963 [35:52:24<46:49:50,  7.62s/it]
 42%|████▏     | 15851/37963 [35:52:31<46:36:14,  7.59s/it]
 42%|████▏     | 15852/37963 [35:52:44<56:14:07,  9.16s/it]
 42%|████▏     | 15853/37963 [35:52:52<53:28:23,  8.71s/it]
 42%|████▏     | 15854/37963 [35:53:00<52:00:58,  8.47s/it]
 42%|████▏     | 15855/37963 [35:53:07<50:32:00,  8.23s/it]
 42%|████▏     | 15856/37963 [35:53:15<49:33:18,  8.07s/it]
 42%|████▏     | 15857/37963 [35:53:23<48:58:21,  7.98s/it]
 42%|████▏     | 15858/37963 [35:53:30<48:32:23,  7.91s/it]
 42%|████▏     | 15859/37963 [35:53:38<48:10:36,  7.85s/it]
 42%|████▏     | 15860/37963 [35:53:48<52:32:07,  8.56s/it]
                                                           
{'loss': '0.1602', 'grad_norm': '1.342', 'learning_rate': '1.31e-05', 'epoch': '0.4178'}
+
 42%|████▏     | 15860/37963 [35:53:48<52:32:07,  8.56s/it]
 42%|████▏     | 15861/37963 [35:53:56<51:00:59,  8.31s/it]
 42%|████▏     | 15862/37963 [35:54:04<50:03:08,  8.15s/it]
 42%|████▏     | 15863/37963 [35:54:12<49:24:47,  8.05s/it]
 42%|████▏     | 15864/37963 [35:54:19<48:36:46,  7.92s/it]
 42%|████▏     | 15865/37963 [35:54:27<47:42:36,  7.77s/it]
 42%|████▏     | 15866/37963 [35:54:37<52:13:27,  8.51s/it]
 42%|████▏     | 15867/37963 [35:54:45<50:36:28,  8.25s/it]
 42%|████▏     | 15868/37963 [35:54:52<48:48:42,  7.95s/it]
 42%|████▏     | 15869/37963 [35:55:00<48:22:24,  7.88s/it]
 42%|████▏     | 15870/37963 [35:55:10<52:58:04,  8.63s/it]
                                                           
{'loss': '0.1566', 'grad_norm': '4.86', 'learning_rate': '1.309e-05', 'epoch': '0.418'}
+
 42%|████▏     | 15870/37963 [35:55:10<52:58:04,  8.63s/it]
 42%|████▏     | 15871/37963 [35:55:17<50:55:44,  8.30s/it]
 42%|████▏     | 15872/37963 [35:55:25<50:09:29,  8.17s/it]
 42%|████▏     | 15873/37963 [35:55:33<49:33:21,  8.08s/it]
 42%|████▏     | 15874/37963 [35:55:41<48:48:04,  7.95s/it]
 42%|████▏     | 15875/37963 [35:55:48<48:06:57,  7.84s/it]
 42%|████▏     | 15876/37963 [35:55:56<47:55:36,  7.81s/it]
 42%|████▏     | 15877/37963 [35:56:04<47:47:12,  7.79s/it]
 42%|████▏     | 15878/37963 [35:56:14<52:50:00,  8.61s/it]
 42%|████▏     | 15879/37963 [35:56:22<51:05:16,  8.33s/it]
 42%|████▏     | 15880/37963 [35:56:30<49:46:56,  8.12s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '1.803', 'learning_rate': '1.308e-05', 'epoch': '0.4183'}
+
 42%|████▏     | 15880/37963 [35:56:30<49:46:56,  8.12s/it]
 42%|████▏     | 15881/37963 [35:56:38<49:20:36,  8.04s/it]
 42%|████▏     | 15882/37963 [35:56:48<54:08:39,  8.83s/it]
 42%|████▏     | 15883/37963 [35:56:56<52:16:03,  8.52s/it]
 42%|████▏     | 15884/37963 [35:57:04<50:58:01,  8.31s/it]
 42%|████▏     | 15885/37963 [35:57:11<49:16:25,  8.03s/it]
 42%|████▏     | 15886/37963 [35:57:19<48:42:02,  7.94s/it]
 42%|████▏     | 15887/37963 [35:57:27<48:05:24,  7.84s/it]
 42%|████▏     | 15888/37963 [35:57:34<48:13:03,  7.86s/it]
 42%|███��▏     | 15889/37963 [35:57:42<47:52:02,  7.81s/it]
 42%|████▏     | 15890/37963 [35:57:50<48:15:16,  7.87s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '1.686', 'learning_rate': '1.307e-05', 'epoch': '0.4186'}
+
 42%|████▏     | 15890/37963 [35:57:50<48:15:16,  7.87s/it]
 42%|████▏     | 15891/37963 [35:57:58<48:02:46,  7.84s/it]
 42%|████▏     | 15892/37963 [35:58:06<47:54:56,  7.82s/it]
 42%|████▏     | 15893/37963 [35:58:16<52:42:12,  8.60s/it]
 42%|████▏     | 15894/37963 [35:58:24<51:25:15,  8.39s/it]
 42%|████▏     | 15895/37963 [35:58:34<54:22:58,  8.87s/it]
 42%|████▏     | 15896/37963 [35:58:44<56:44:23,  9.26s/it]
 42%|████▏     | 15897/37963 [35:58:52<53:57:14,  8.80s/it]
 42%|████▏     | 15898/37963 [35:58:59<51:36:25,  8.42s/it]
 42%|████▏     | 15899/37963 [35:59:07<49:59:28,  8.16s/it]
 42%|████▏     | 15900/37963 [35:59:15<48:47:43,  7.96s/it]
                                                           
{'loss': '0.1751', 'grad_norm': '3.465', 'learning_rate': '1.307e-05', 'epoch': '0.4188'}
+
 42%|████▏     | 15900/37963 [35:59:15<48:47:43,  7.96s/it]
 42%|████▏     | 15901/37963 [35:59:22<48:44:48,  7.95s/it]
 42%|████▏     | 15902/37963 [35:59:30<48:32:56,  7.92s/it]
 42%|████▏     | 15903/37963 [35:59:38<48:11:50,  7.87s/it]
 42%|████▏     | 15904/37963 [35:59:46<48:18:20,  7.88s/it]
 42%|████▏     | 15905/37963 [35:59:54<47:43:01,  7.79s/it]
 42%|████▏     | 15906/37963 [36:00:01<47:04:04,  7.68s/it]
 42%|████▏     | 15907/37963 [36:00:08<46:46:08,  7.63s/it]
 42%|████▏     | 15908/37963 [36:00:16<47:09:37,  7.70s/it]
 42%|████▏     | 15909/37963 [36:00:27<51:46:43,  8.45s/it]
 42%|████▏     | 15910/37963 [36:00:34<50:39:11,  8.27s/it]
                                                           
{'loss': '0.1576', 'grad_norm': '1.309', 'learning_rate': '1.306e-05', 'epoch': '0.4191'}
+
 42%|████▏     | 15910/37963 [36:00:34<50:39:11,  8.27s/it]
 42%|████▏     | 15911/37963 [36:00:42<49:25:34,  8.07s/it]
 42%|████▏     | 15912/37963 [36:00:50<48:28:22,  7.91s/it]
 42%|████▏     | 15913/37963 [36:00:57<48:20:58,  7.89s/it]
 42%|████▏     | 15914/37963 [36:01:10<57:10:49,  9.34s/it]
 42%|████▏     | 15915/37963 [36:01:18<54:20:30,  8.87s/it]
 42%|████▏     | 15916/37963 [36:01:26<52:06:27,  8.51s/it]
 42%|████▏     | 15917/37963 [36:01:33<50:31:18,  8.25s/it]
 42%|████▏     | 15918/37963 [36:01:41<49:30:23,  8.08s/it]
 42%|████▏     | 15919/37963 [36:01:48<48:10:18,  7.87s/it]
 42%|████▏     | 15920/37963 [36:01:56<47:20:06,  7.73s/it]
                                                           
{'loss': '0.1616', 'grad_norm': '2.15', 'learning_rate': '1.305e-05', 'epoch': '0.4194'}
+
 42%|████▏     | 15920/37963 [36:01:56<47:20:06,  7.73s/it]
 42%|████▏     | 15921/37963 [36:02:04<47:37:44,  7.78s/it]
 42%|████▏     | 15922/37963 [36:02:11<47:33:24,  7.77s/it]
 42%|████▏     | 15923/37963 [36:02:19<47:28:03,  7.75s/it]
 42%|████▏     | 15924/37963 [36:02:26<46:49:16,  7.65s/it]
 42%|████▏     | 15925/37963 [36:02:34<46:53:46,  7.66s/it]
 42%|████▏     | 15926/37963 [36:02:44<51:29:22,  8.41s/it]
 42%|████▏     | 15927/37963 [36:02:52<50:13:57,  8.21s/it]
 42%|████▏     | 15928/37963 [36:02:59<48:50:00,  7.98s/it]
 42%|████▏     | 15929/37963 [36:03:07<48:12:08,  7.88s/it]
 42%|████▏     | 15930/37963 [36:03:18<53:06:05,  8.68s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '2.016', 'learning_rate': '1.304e-05', 'epoch': '0.4196'}
+
 42%|████▏     | 15930/37963 [36:03:18<53:06:05,  8.68s/it]
 42%|████▏     | 15931/37963 [36:03:25<51:24:50,  8.40s/it]
 42%|████▏     | 15932/37963 [36:03:33<49:56:48,  8.16s/it]
 42%|████▏     | 15933/37963 [36:03:41<49:11:12,  8.04s/it]
 42%|████▏     | 15934/37963 [36:03:48<48:22:40,  7.91s/it]
 42%|████▏     | 15935/37963 [36:03:56<48:00:05,  7.84s/it]
 42%|████▏     | 15936/37963 [36:04:04<47:38:38,  7.79s/it]
 42%|████▏     | 15937/37963 [36:04:11<47:37:34,  7.78s/it]
 42%|████▏     | 15938/37963 [36:04:19<47:36:19,  7.78s/it]
 42%|████▏     | 15939/37963 [36:04:27<47:22:41,  7.74s/it]
 42%|████▏     | 15940/37963 [36:04:35<47:16:13,  7.73s/it]
                                                           
{'loss': '0.1592', 'grad_norm': '1.486', 'learning_rate': '1.303e-05', 'epoch': '0.4199'}
+
 42%|████▏     | 15940/37963 [36:04:35<47:16:13,  7.73s/it]
 42%|████▏     | 15941/37963 [36:04:42<46:48:58,  7.65s/it]
 42%|████▏     | 15942/37963 [36:04:50<47:24:34,  7.75s/it]
 42%|████▏     | 15943/37963 [36:05:00<51:45:56,  8.46s/it]
 42%|████▏     | 15944/37963 [36:05:10<55:12:45,  9.03s/it]
 42%|████▏     | 15945/37963 [36:05:18<52:34:34,  8.60s/it]
 42%|████▏     | 15946/37963 [36:05:26<50:48:49,  8.31s/it]
 42%|████▏     | 15947/37963 [36:05:36<54:34:10,  8.92s/it]
 42%|████▏     | 15948/37963 [36:05:43<51:46:32,  8.47s/it]
 42%|████▏     | 15949/37963 [36:05:51<50:04:47,  8.19s/it]
 42%|████▏     | 15950/37963 [36:05:58<48:31:58,  7.94s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '0.9788', 'learning_rate': '1.302e-05', 'epoch': '0.4201'}
+
 42%|████▏     | 15950/37963 [36:05:58<48:31:58,  7.94s/it]
 42%|████▏     | 15951/37963 [36:06:06<48:06:15,  7.87s/it]
 42%|████▏     | 15952/37963 [36:06:14<47:38:02,  7.79s/it]
 42%|████▏     | 15953/37963 [36:06:24<51:41:55,  8.46s/it]
 42%|████▏     | 15954/37963 [36:06:31<50:09:40,  8.20s/it]
 42%|████▏     | 15955/37963 [36:06:39<48:51:15,  7.99s/it]
 42%|████▏     | 15956/37963 [36:06:46<48:18:18,  7.90s/it]
 42%|████▏     | 15957/37963 [36:06:54<47:43:26,  7.81s/it]
 42%|████▏     | 15958/37963 [36:07:02<47:11:19,  7.72s/it]
 42%|████▏     | 15959/37963 [36:07:09<47:03:08,  7.70s/it]
 42%|████▏     | 15960/37963 [36:07:17<47:06:15,  7.71s/it]
                                                           
{'loss': '0.1703', 'grad_norm': '1.422', 'learning_rate': '1.302e-05', 'epoch': '0.4204'}
+
 42%|████▏     | 15960/37963 [36:07:17<47:06:15,  7.71s/it]
 42%|████▏     | 15961/37963 [36:07:25<46:52:38,  7.67s/it]
 42%|████▏     | 15962/37963 [36:07:37<56:24:14,  9.23s/it]
 42%|████▏     | 15963/37963 [36:07:45<53:20:21,  8.73s/it]
 42%|████▏     | 15964/37963 [36:07:53<51:36:55,  8.45s/it]
 42%|████▏     | 15965/37963 [36:08:01<50:24:32,  8.25s/it]
 42%|████▏     | 15966/37963 [36:08:08<49:08:49,  8.04s/it]
 42%|████▏     | 15967/37963 [36:08:16<48:29:52,  7.94s/it]
 42%|████▏     | 15968/37963 [36:08:24<48:13:07,  7.89s/it]
 42%|████▏     | 15969/37963 [36:08:31<47:51:38,  7.83s/it]
 42%|████▏     | 15970/37963 [36:08:39<47:31:47,  7.78s/it]
                                                           
{'loss': '0.1673', 'grad_norm': '1.659', 'learning_rate': '1.301e-05', 'epoch': '0.4207'}
+
 42%|████▏     | 15970/37963 [36:08:39<47:31:47,  7.78s/it]
 42%|████▏     | 15971/37963 [36:08:47<47:21:52,  7.75s/it]
 42%|████▏     | 15972/37963 [36:08:54<47:21:06,  7.75s/it]
 42%|████▏     | 15973/37963 [36:09:02<47:35:05,  7.79s/it]
 42%|████▏     | 15974/37963 [36:09:13<52:49:56,  8.65s/it]
 42%|████▏     | 15975/37963 [36:09:21<51:00:39,  8.35s/it]
 42%|████▏     | 15976/37963 [36:09:28<49:49:11,  8.16s/it]
 42%|████▏     | 15977/37963 [36:09:36<49:15:23,  8.07s/it]
 42%|████▏     | 15978/37963 [36:09:44<48:01:14,  7.86s/it]
 42%|████▏     | 15979/37963 [36:09:51<47:15:22,  7.74s/it]
 42%|████▏     | 15980/37963 [36:10:01<52:18:33,  8.57s/it]
                                                           
{'loss': '0.1662', 'grad_norm': '3.559', 'learning_rate': '1.3e-05', 'epoch': '0.4209'}
+
 42%|████▏     | 15980/37963 [36:10:01<52:18:33,  8.57s/it]
 42%|████▏     | 15981/37963 [36:10:09<50:53:23,  8.33s/it]
 42%|████▏     | 15982/37963 [36:10:17<49:53:10,  8.17s/it]
 42%|████▏     | 15983/37963 [36:10:25<49:14:49,  8.07s/it]
 42%|████▏     | 15984/37963 [36:10:33<48:31:03,  7.95s/it]
 42%|████▏     | 15985/37963 [36:10:40<48:10:52,  7.89s/it]
 42%|████▏     | 15986/37963 [36:10:48<47:51:42,  7.84s/it]
 42%|████▏     | 15987/37963 [36:10:56<47:45:45,  7.82s/it]
 42%|████▏     | 15988/37963 [36:11:03<47:11:18,  7.73s/it]
 42%|████▏     | 15989/37963 [36:11:14<52:01:16,  8.52s/it]
 42%|████▏     | 15990/37963 [36:11:21<49:54:07,  8.18s/it]
                                                           
{'loss': '0.1699', 'grad_norm': '2.962', 'learning_rate': '1.299e-05', 'epoch': '0.4212'}
+
 42%|████▏     | 15990/37963 [36:11:21<49:54:07,  8.18s/it]
 42%|████▏     | 15991/37963 [36:11:29<49:18:51,  8.08s/it]
 42%|████▏     | 15992/37963 [36:11:39<53:17:44,  8.73s/it]
 42%|████▏     | 15993/37963 [36:11:47<51:55:04,  8.51s/it]
 42%|████▏     | 15994/37963 [36:11:55<50:45:30,  8.32s/it]
 42%|████▏     | 15995/37963 [36:12:03<49:38:46,  8.14s/it]
 42%|████▏     | 15996/37963 [36:12:11<49:01:54,  8.04s/it]
 42%|████▏     | 15997/37963 [36:12:21<52:51:29,  8.66s/it]
 42%|████▏     | 15998/37963 [36:12:28<50:35:44,  8.29s/it]
 42%|████▏     | 15999/37963 [36:12:36<49:21:11,  8.09s/it]
 42%|████▏     | 16000/37963 [36:12:43<48:11:47,  7.90s/it]
                                                           
{'loss': '0.1647', 'grad_norm': '1.75', 'learning_rate': '1.298e-05', 'epoch': '0.4215'}
+
 42%|████▏     | 16000/37963 [36:12:43<48:11:47,  7.90s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.86s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.86s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 42%|████▏     | 16001/37963 [36:13:47<150:28:06, 24.66s/it]
 42%|████▏     | 16002/37963 [36:13:55<119:52:23, 19.65s/it]
 42%|████▏     | 16003/37963 [36:14:03<98:23:16, 16.13s/it] 
 42%|████▏     | 16004/37963 [36:14:10<82:43:43, 13.56s/it]
 42%|████▏     | 16005/37963 [36:14:18<72:15:01, 11.85s/it]
 42%|████▏     | 16006/37963 [36:14:26<64:46:54, 10.62s/it]
 42%|████▏     | 16007/37963 [36:14:34<59:19:54,  9.73s/it]
 42%|████▏     | 16008/37963 [36:14:42<56:02:51,  9.19s/it]
 42%|████▏     | 16009/37963 [36:14:52<57:47:38,  9.48s/it]
 42%|████▏     | 16010/37963 [36:14:59<53:42:38,  8.81s/it]
                                                           
{'loss': '0.1632', 'grad_norm': '1.339', 'learning_rate': '1.298e-05', 'epoch': '0.4217'}
+
 42%|████▏     | 16010/37963 [36:14:59<53:42:38,  8.81s/it]
 42%|████▏     | 16011/37963 [36:15:07<52:04:43,  8.54s/it]
 42%|████▏     | 16012/37963 [36:15:15<50:36:47,  8.30s/it]
 42%|████▏     | 16013/37963 [36:15:23<50:06:14,  8.22s/it]
 42%|████▏     | 16014/37963 [36:15:33<54:10:18,  8.89s/it]
 42%|████▏     | 16015/37963 [36:15:41<51:43:35,  8.48s/it]
 42%|████▏     | 16016/37963 [36:15:48<50:23:33,  8.27s/it]
 42%|████▏     | 16017/37963 [36:15:56<49:36:46,  8.14s/it]
 42%|████▏     | 16018/37963 [36:16:04<48:35:32,  7.97s/it]
 42%|████▏     | 16019/37963 [36:16:12<48:05:17,  7.89s/it]
 42%|████▏     | 16020/37963 [36:16:19<47:10:17,  7.74s/it]
                                                           
{'loss': '0.1543', 'grad_norm': '3.92', 'learning_rate': '1.297e-05', 'epoch': '0.422'}
+
 42%|████▏     | 16020/37963 [36:16:19<47:10:17,  7.74s/it]
 42%|████▏     | 16021/37963 [36:16:26<46:53:14,  7.69s/it]
 42%|████▏     | 16022/37963 [36:16:34<46:54:46,  7.70s/it]
 42%|████▏     | 16023/37963 [36:16:42<47:00:49,  7.71s/it]
 42%|████▏     | 16024/37963 [36:16:50<47:00:37,  7.71s/it]
 42%|████▏     | 16025/37963 [36:17:00<51:26:29,  8.44s/it]
 42%|████▏     | 16026/37963 [36:17:08<50:20:16,  8.26s/it]
 42%|████▏     | 16027/37963 [36:17:15<49:11:46,  8.07s/it]
 42%|████▏     | 16028/37963 [36:17:23<48:55:20,  8.03s/it]
 42%|████▏     | 16029/37963 [36:17:34<53:07:57,  8.72s/it]
 42%|████▏     | 16030/37963 [36:17:41<51:34:35,  8.47s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '2.604', 'learning_rate': '1.296e-05', 'epoch': '0.4223'}
+
 42%|████▏     | 16030/37963 [36:17:41<51:34:35,  8.47s/it]
 42%|████▏     | 16031/37963 [36:17:49<50:17:11,  8.25s/it]
 42%|████▏     | 16032/37963 [36:17:57<49:27:26,  8.12s/it]
 42%|████▏     | 16033/37963 [36:18:05<48:38:56,  7.99s/it]
 42%|████▏     | 16034/37963 [36:18:12<47:58:05,  7.87s/it]
 42%|████▏     | 16035/37963 [36:18:23<52:29:20,  8.62s/it]
 42%|████▏     | 16036/37963 [36:18:30<50:38:27,  8.31s/it]
 42%|████▏     | 16037/37963 [36:18:38<49:24:31,  8.11s/it]
 42%|████▏     | 16038/37963 [36:18:48<53:22:27,  8.76s/it]
 42%|████▏     | 16039/37963 [36:18:56<51:20:54,  8.43s/it]
 42%|████▏     | 16040/37963 [36:19:03<49:53:39,  8.19s/it]
                                                           
{'loss': '0.1587', 'grad_norm': '1.904', 'learning_rate': '1.295e-05', 'epoch': '0.4225'}
+
 42%|████▏     | 16040/37963 [36:19:03<49:53:39,  8.19s/it]
 42%|████▏     | 16041/37963 [36:19:11<48:56:23,  8.04s/it]
 42%|████▏     | 16042/37963 [36:19:19<48:19:36,  7.94s/it]
 42%|████▏     | 16043/37963 [36:19:27<48:01:27,  7.89s/it]
 42%|████▏     | 16044/37963 [36:19:34<47:11:21,  7.75s/it]
 42%|████▏     | 16045/37963 [36:19:42<46:48:33,  7.69s/it]
 42%|████▏     | 16046/37963 [36:19:49<46:54:26,  7.70s/it]
 42%|████▏     | 16047/37963 [36:19:57<47:20:36,  7.78s/it]
 42%|████▏     | 16048/37963 [36:20:05<47:32:36,  7.81s/it]
 42%|████▏     | 16049/37963 [36:20:15<51:53:09,  8.52s/it]
 42%|████▏     | 16050/37963 [36:20:26<55:24:34,  9.10s/it]
                                                           
{'loss': '0.1667', 'grad_norm': '1.323', 'learning_rate': '1.294e-05', 'epoch': '0.4228'}
+
 42%|████▏     | 16050/37963 [36:20:26<55:24:34,  9.10s/it]
 42%|████▏     | 16051/37963 [36:20:34<53:29:57,  8.79s/it]
 42%|████▏     | 16052/37963 [36:20:41<51:18:35,  8.43s/it]
 42%|████▏     | 16053/37963 [36:20:49<50:01:26,  8.22s/it]
 42%|████▏     | 16054/37963 [36:20:57<49:08:39,  8.08s/it]
 42%|████▏     | 16055/37963 [36:21:04<48:15:19,  7.93s/it]
 42%|████▏     | 16056/37963 [36:21:12<47:35:06,  7.82s/it]
 42%|████▏     | 16057/37963 [36:21:20<47:30:27,  7.81s/it]
 42%|████▏     | 16058/37963 [36:21:30<51:46:54,  8.51s/it]
 42%|████▏     | 16059/37963 [36:21:38<50:09:49,  8.24s/it]
 42%|████▏     | 16060/37963 [36:21:45<49:16:02,  8.10s/it]
                                                           
{'loss': '0.1782', 'grad_norm': '1.112', 'learning_rate': '1.294e-05', 'epoch': '0.423'}
+
 42%|████▏     | 16060/37963 [36:21:45<49:16:02,  8.10s/it]
 42%|████▏     | 16061/37963 [36:21:53<48:30:00,  7.97s/it]
 42%|████▏     | 16062/37963 [36:22:01<47:49:13,  7.86s/it]
 42%|████▏     | 16063/37963 [36:22:11<52:25:02,  8.62s/it]
 42%|████▏     | 16064/37963 [36:22:19<50:37:18,  8.32s/it]
 42%|████▏     | 16065/37963 [36:22:27<49:48:53,  8.19s/it]
 42%|████▏     | 16066/37963 [36:22:34<48:35:11,  7.99s/it]
 42%|████▏     | 16067/37963 [36:22:42<48:52:40,  8.04s/it]
 42%|████▏     | 16068/37963 [36:22:50<48:13:01,  7.93s/it]
 42%|████▏     | 16069/37963 [36:22:58<48:01:49,  7.90s/it]
 42%|████▏     | 16070/37963 [36:23:06<47:55:13,  7.88s/it]
                                                           
{'loss': '0.167', 'grad_norm': '3.011', 'learning_rate': '1.293e-05', 'epoch': '0.4233'}
+
 42%|████▏     | 16070/37963 [36:23:06<47:55:13,  7.88s/it]
 42%|████▏     | 16071/37963 [36:23:13<47:32:47,  7.82s/it]
 42%|████▏     | 16072/37963 [36:23:21<47:25:46,  7.80s/it]
 42%|████▏     | 16073/37963 [36:23:31<51:34:29,  8.48s/it]
 42%|████▏     | 16074/37963 [36:23:42<55:43:22,  9.16s/it]
 42%|████▏     | 16075/37963 [36:23:50<53:12:00,  8.75s/it]
 42%|████▏     | 16076/37963 [36:23:57<51:03:57,  8.40s/it]
 42%|████▏     | 16077/37963 [36:24:05<49:56:32,  8.21s/it]
 42%|████▏     | 16078/37963 [36:24:13<49:29:40,  8.14s/it]
 42%|████▏     | 16079/37963 [36:24:21<48:54:44,  8.05s/it]
 42%|████▏     | 16080/37963 [36:24:28<48:08:26,  7.92s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '3.236', 'learning_rate': '1.292e-05', 'epoch': '0.4236'}
+
 42%|████▏     | 16080/37963 [36:24:28<48:08:26,  7.92s/it]
 42%|████▏     | 16081/37963 [36:24:36<47:24:48,  7.80s/it]
 42%|████▏     | 16082/37963 [36:24:44<47:21:14,  7.79s/it]
 42%|████▏     | 16083/37963 [36:24:52<47:32:38,  7.82s/it]
 42%|████▏     | 16084/37963 [36:25:02<52:13:15,  8.59s/it]
 42%|████▏     | 16085/37963 [36:25:10<50:50:42,  8.37s/it]
 42%|████▏     | 16086/37963 [36:25:18<50:07:58,  8.25s/it]
 42%|████▏     | 16087/37963 [36:25:25<49:00:49,  8.07s/it]
 42%|████▏     | 16088/37963 [36:25:33<48:07:46,  7.92s/it]
 42%|████▏     | 16089/37963 [36:25:43<52:30:16,  8.64s/it]
 42%|████▏     | 16090/37963 [36:25:51<50:34:40,  8.32s/it]
                                                           
{'loss': '0.1718', 'grad_norm': '1.966', 'learning_rate': '1.291e-05', 'epoch': '0.4238'}
+
 42%|████▏     | 16090/37963 [36:25:51<50:34:40,  8.32s/it]
 42%|████▏     | 16091/37963 [36:25:59<49:37:00,  8.17s/it]
 42%|████▏     | 16092/37963 [36:26:06<48:55:25,  8.05s/it]
 42%|████▏     | 16093/37963 [36:26:17<53:07:52,  8.75s/it]
 42%|████▏     | 16094/37963 [36:26:24<50:33:04,  8.32s/it]
 42%|████▏     | 16095/37963 [36:26:32<49:41:13,  8.18s/it]
 42%|████▏     | 16096/37963 [36:26:40<48:48:54,  8.04s/it]
 42%|████▏     | 16097/37963 [36:26:48<48:29:54,  7.98s/it]
 42%|████▏     | 16098/37963 [36:26:55<48:10:04,  7.93s/it]
 42%|████▏     | 16099/37963 [36:27:03<47:37:03,  7.84s/it]
 42%|████▏     | 16100/37963 [36:27:11<47:18:57,  7.79s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '1.118', 'learning_rate': '1.29e-05', 'epoch': '0.4241'}
+
 42%|████▏     | 16100/37963 [36:27:11<47:18:57,  7.79s/it]
 42%|████▏     | 16101/37963 [36:27:18<46:19:47,  7.63s/it]
 42%|████▏     | 16102/37963 [36:27:26<46:24:45,  7.64s/it]
 42%|████▏     | 16103/37963 [36:27:34<46:51:55,  7.72s/it]
 42%|████▏     | 16104/37963 [36:27:44<51:39:21,  8.51s/it]
 42%|████▏     | 16105/37963 [36:27:54<54:34:56,  8.99s/it]
 42%|████▏     | 16106/37963 [36:28:02<52:38:59,  8.67s/it]
 42%|████▏     | 16107/37963 [36:28:10<51:02:03,  8.41s/it]
 42%|████▏     | 16108/37963 [36:28:17<48:56:35,  8.06s/it]
 42%|████▏     | 16109/37963 [36:28:25<48:07:53,  7.93s/it]
 42%|████▏     | 16110/37963 [36:28:32<47:44:56,  7.87s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '0.753', 'learning_rate': '1.289e-05', 'epoch': '0.4244'}
+
 42%|████▏     | 16110/37963 [36:28:32<47:44:56,  7.87s/it]
 42%|████▏     | 16111/37963 [36:28:40<47:30:58,  7.83s/it]
 42%|████▏     | 16112/37963 [36:28:50<51:55:11,  8.55s/it]
 42%|████▏     | 16113/37963 [36:28:58<50:06:14,  8.26s/it]
 42%|████▏     | 16114/37963 [36:29:06<49:46:01,  8.20s/it]
 42%|████▏     | 16115/37963 [36:29:14<48:53:55,  8.06s/it]
 42%|████▏     | 16116/37963 [36:29:24<52:51:46,  8.71s/it]
 42%|████▏     | 16117/37963 [36:29:32<51:12:54,  8.44s/it]
 42%|████▏     | 16118/37963 [36:29:40<50:35:26,  8.34s/it]
 42%|████▏     | 16119/37963 [36:29:48<49:37:33,  8.18s/it]
 42%|████▏     | 16120/37963 [36:29:55<48:42:51,  8.03s/it]
                                                           
{'loss': '0.1593', 'grad_norm': '1.002', 'learning_rate': '1.289e-05', 'epoch': '0.4246'}
+
 42%|████▏     | 16120/37963 [36:29:55<48:42:51,  8.03s/it]
 42%|████▏     | 16121/37963 [36:30:03<48:15:31,  7.95s/it]
 42%|████▏     | 16122/37963 [36:30:11<47:54:28,  7.90s/it]
 42%|████▏     | 16123/37963 [36:30:21<52:43:14,  8.69s/it]
 42%|████▏     | 16124/37963 [36:30:29<51:15:13,  8.45s/it]
 42%|████▏     | 16125/37963 [36:30:37<49:46:09,  8.20s/it]
 42%|████▏     | 16126/37963 [36:30:44<48:04:02,  7.92s/it]
 42%|████▏     | 16127/37963 [36:30:55<52:42:53,  8.69s/it]
 42%|████▏     | 16128/37963 [36:31:02<51:07:56,  8.43s/it]
 42%|████▏     | 16129/37963 [36:31:10<50:03:52,  8.25s/it]
 42%|████▏     | 16130/37963 [36:31:18<48:52:31,  8.06s/it]
                                                           
{'loss': '0.1726', 'grad_norm': '2.088', 'learning_rate': '1.288e-05', 'epoch': '0.4249'}
+
 42%|████▏     | 16130/37963 [36:31:18<48:52:31,  8.06s/it]
 42%|████▏     | 16131/37963 [36:31:26<48:25:22,  7.98s/it]
 42%|████▏     | 16132/37963 [36:31:33<47:50:01,  7.89s/it]
 42%|████▏     | 16133/37963 [36:31:41<47:40:19,  7.86s/it]
 42%|████▏     | 16134/37963 [36:31:49<47:38:25,  7.86s/it]
 43%|████▎     | 16135/37963 [36:31:57<47:39:06,  7.86s/it]
 43%|████▎     | 16136/37963 [36:32:04<47:11:14,  7.78s/it]
 43%|████▎     | 16137/37963 [36:32:15<51:34:42,  8.51s/it]
 43%|████▎     | 16138/37963 [36:32:22<49:59:56,  8.25s/it]
 43%|████▎     | 16139/37963 [36:32:30<49:30:47,  8.17s/it]
 43%|████▎     | 16140/37963 [36:32:40<52:58:29,  8.74s/it]
                                                           
{'loss': '0.1734', 'grad_norm': '2.319', 'learning_rate': '1.287e-05', 'epoch': '0.4252'}
+
 43%|████▎     | 16140/37963 [36:32:40<52:58:29,  8.74s/it]
 43%|████▎     | 16141/37963 [36:32:48<51:02:49,  8.42s/it]
 43%|████▎     | 16142/37963 [36:32:56<49:32:52,  8.17s/it]
 43%|████▎     | 16143/37963 [36:33:03<48:50:43,  8.06s/it]
 43%|████▎     | 16144/37963 [36:33:11<48:01:58,  7.93s/it]
 43%|████▎     | 16145/37963 [36:33:19<47:29:02,  7.83s/it]
 43%|████▎     | 16146/37963 [36:33:26<47:20:03,  7.81s/it]
 43%|████▎     | 16147/37963 [36:33:34<46:47:13,  7.72s/it]
 43%|████▎     | 16148/37963 [36:33:42<47:12:07,  7.79s/it]
 43%|████▎     | 16149/37963 [36:33:50<47:26:24,  7.83s/it]
 43%|████▎     | 16150/37963 [36:33:58<47:29:57,  7.84s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '2.499', 'learning_rate': '1.286e-05', 'epoch': '0.4254'}
+
 43%|████▎     | 16150/37963 [36:33:58<47:29:57,  7.84s/it]
 43%|████▎     | 16151/37963 [36:34:06<47:39:04,  7.86s/it]
 43%|████▎     | 16152/37963 [36:34:19<56:58:21,  9.40s/it]
 43%|████▎     | 16153/37963 [36:34:27<54:20:47,  8.97s/it]
 43%|████▎     | 16154/37963 [36:34:34<51:54:17,  8.57s/it]
 43%|████▎     | 16155/37963 [36:34:42<50:21:18,  8.31s/it]
 43%|████▎     | 16156/37963 [36:34:50<49:18:24,  8.14s/it]
 43%|████▎     | 16157/37963 [36:35:00<52:57:09,  8.74s/it]
 43%|████▎     | 16158/37963 [36:35:08<51:17:08,  8.47s/it]
 43%|████▎     | 16159/37963 [36:35:15<49:46:55,  8.22s/it]
 43%|████▎     | 16160/37963 [36:35:26<53:48:28,  8.88s/it]
                                                           
{'loss': '0.1818', 'grad_norm': '2.035', 'learning_rate': '1.285e-05', 'epoch': '0.4257'}
+
 43%|████▎     | 16160/37963 [36:35:26<53:48:28,  8.88s/it]
 43%|████▎     | 16161/37963 [36:35:33<51:28:48,  8.50s/it]
 43%|████▎     | 16162/37963 [36:35:41<49:48:53,  8.23s/it]
 43%|████▎     | 16163/37963 [36:35:48<48:29:23,  8.01s/it]
 43%|████▎     | 16164/37963 [36:35:56<47:41:18,  7.88s/it]
 43%|████▎     | 16165/37963 [36:36:04<47:56:09,  7.92s/it]
 43%|████▎     | 16166/37963 [36:36:12<47:24:03,  7.83s/it]
 43%|████▎     | 16167/37963 [36:36:19<47:00:17,  7.76s/it]
 43%|████▎     | 16168/37963 [36:36:27<46:58:40,  7.76s/it]
 43%|████▎     | 16169/37963 [36:36:35<47:20:51,  7.82s/it]
 43%|████▎     | 16170/37963 [36:36:43<47:12:41,  7.80s/it]
                                                           
{'loss': '0.1594', 'grad_norm': '2.157', 'learning_rate': '1.285e-05', 'epoch': '0.4259'}
+
 43%|████▎     | 16170/37963 [36:36:43<47:12:41,  7.80s/it]
 43%|████▎     | 16171/37963 [36:36:50<46:59:47,  7.76s/it]
 43%|████▎     | 16172/37963 [36:36:58<46:50:20,  7.74s/it]
 43%|████▎     | 16173/37963 [36:37:06<46:35:15,  7.70s/it]
 43%|████▎     | 16174/37963 [36:37:13<46:13:47,  7.64s/it]
 43%|████▎     | 16175/37963 [36:37:21<46:34:06,  7.69s/it]
 43%|████▎     | 16176/37963 [36:37:31<51:07:22,  8.45s/it]
 43%|████▎     | 16177/37963 [36:37:42<55:00:43,  9.09s/it]
 43%|████▎     | 16178/37963 [36:37:49<52:25:01,  8.66s/it]
 43%|████▎     | 16179/37963 [36:37:57<50:51:01,  8.40s/it]
 43%|████▎     | 16180/37963 [36:38:05<49:06:38,  8.12s/it]
                                                           
{'loss': '0.1629', 'grad_norm': '1.681', 'learning_rate': '1.284e-05', 'epoch': '0.4262'}
+
 43%|████▎     | 16180/37963 [36:38:05<49:06:38,  8.12s/it]
 43%|████▎     | 16181/37963 [36:38:12<48:07:36,  7.95s/it]
 43%|████▎     | 16182/37963 [36:38:20<47:27:00,  7.84s/it]
 43%|████▎     | 16183/37963 [36:38:28<47:47:19,  7.90s/it]
 43%|████▎     | 16184/37963 [36:38:38<52:16:07,  8.64s/it]
 43%|████▎     | 16185/37963 [36:38:46<50:48:36,  8.40s/it]
 43%|████▎     | 16186/37963 [36:38:56<54:25:00,  9.00s/it]
 43%|████▎     | 16187/37963 [36:39:04<52:34:48,  8.69s/it]
 43%|████▎     | 16188/37963 [36:39:12<50:39:24,  8.37s/it]
 43%|████▎     | 16189/37963 [36:39:19<48:54:57,  8.09s/it]
 43%|████▎     | 16190/37963 [36:39:27<48:05:12,  7.95s/it]
                                                           
{'loss': '0.1748', 'grad_norm': '0.9204', 'learning_rate': '1.283e-05', 'epoch': '0.4265'}
+
 43%|████▎     | 16190/37963 [36:39:27<48:05:12,  7.95s/it]
 43%|████▎     | 16191/37963 [36:39:35<47:28:50,  7.85s/it]
 43%|████▎     | 16192/37963 [36:39:42<47:15:57,  7.82s/it]
 43%|████▎     | 16193/37963 [36:39:50<47:28:41,  7.85s/it]
 43%|████▎     | 16194/37963 [36:39:58<47:10:18,  7.80s/it]
 43%|████▎     | 16195/37963 [36:40:06<47:20:48,  7.83s/it]
 43%|████▎     | 16196/37963 [36:40:14<47:12:10,  7.81s/it]
 43%|████▎     | 16197/37963 [36:40:21<46:52:31,  7.75s/it]
 43%|████▎     | 16198/37963 [36:40:29<47:01:40,  7.78s/it]
 43%|████▎     | 16199/37963 [36:40:37<46:59:01,  7.77s/it]
 43%|████▎     | 16200/37963 [36:40:44<46:21:14,  7.67s/it]
                                                           
{'loss': '0.1773', 'grad_norm': '2.334', 'learning_rate': '1.282e-05', 'epoch': '0.4267'}
+
 43%|████▎     | 16200/37963 [36:40:44<46:21:14,  7.67s/it]
 43%|████▎     | 16201/37963 [36:40:57<56:02:13,  9.27s/it]
 43%|████▎     | 16202/37963 [36:41:05<53:41:17,  8.88s/it]
 43%|████▎     | 16203/37963 [36:41:13<51:33:43,  8.53s/it]
 43%|████▎     | 16204/37963 [36:41:20<49:16:57,  8.15s/it]
 43%|████▎     | 16205/37963 [36:41:28<48:09:36,  7.97s/it]
 43%|████▎     | 16206/37963 [36:41:38<52:14:35,  8.64s/it]
 43%|████▎     | 16207/37963 [36:41:46<50:47:25,  8.40s/it]
 43%|████▎     | 16208/37963 [36:41:56<53:48:25,  8.90s/it]
 43%|████▎     | 16209/37963 [36:42:04<51:32:48,  8.53s/it]
 43%|████▎     | 16210/37963 [36:42:11<50:13:16,  8.31s/it]
                                                           
{'loss': '0.1624', 'grad_norm': '1.866', 'learning_rate': '1.281e-05', 'epoch': '0.427'}
+
 43%|████▎     | 16210/37963 [36:42:11<50:13:16,  8.31s/it]
 43%|████▎     | 16211/37963 [36:42:19<49:10:35,  8.14s/it]
 43%|████▎     | 16212/37963 [36:42:27<48:15:00,  7.99s/it]
 43%|████▎     | 16213/37963 [36:42:35<47:57:52,  7.94s/it]
 43%|████▎     | 16214/37963 [36:42:42<47:35:44,  7.88s/it]
 43%|████▎     | 16215/37963 [36:42:50<47:22:51,  7.84s/it]
 43%|███���▎     | 16216/37963 [36:42:58<47:05:09,  7.79s/it]
 43%|████▎     | 16217/37963 [36:43:06<46:55:07,  7.77s/it]
 43%|████▎     | 16218/37963 [36:43:13<46:19:00,  7.67s/it]
 43%|████▎     | 16219/37963 [36:43:23<51:23:44,  8.51s/it]
 43%|████▎     | 16220/37963 [36:43:31<49:48:27,  8.25s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '1.318', 'learning_rate': '1.28e-05', 'epoch': '0.4273'}
+
 43%|████▎     | 16220/37963 [36:43:31<49:48:27,  8.25s/it]
 43%|████▎     | 16221/37963 [36:43:39<48:45:03,  8.07s/it]
 43%|████▎     | 16222/37963 [36:43:46<48:07:36,  7.97s/it]
 43%|████▎     | 16223/37963 [36:43:54<47:22:15,  7.84s/it]
 43%|████▎     | 16224/37963 [36:44:02<46:52:33,  7.76s/it]
 43%|████▎     | 16225/37963 [36:44:09<46:32:16,  7.71s/it]
 43%|████▎     | 16226/37963 [36:44:17<46:12:56,  7.65s/it]
 43%|████▎     | 16227/37963 [36:44:27<51:17:35,  8.50s/it]
 43%|████▎     | 16228/37963 [36:44:35<49:53:11,  8.26s/it]
 43%|████▎     | 16229/37963 [36:44:43<48:59:54,  8.12s/it]
 43%|████▎     | 16230/37963 [36:44:51<48:37:48,  8.06s/it]
                                                           
{'loss': '0.1658', 'grad_norm': '2.097', 'learning_rate': '1.28e-05', 'epoch': '0.4275'}
+
 43%|████▎     | 16230/37963 [36:44:51<48:37:48,  8.06s/it]
 43%|████▎     | 16231/37963 [36:44:58<48:17:00,  8.00s/it]
 43%|████▎     | 16232/37963 [36:45:09<52:48:32,  8.75s/it]
 43%|████▎     | 16233/37963 [36:45:17<51:23:07,  8.51s/it]
 43%|████▎     | 16234/37963 [36:45:27<54:55:36,  9.10s/it]
 43%|████▎     | 16235/37963 [36:45:35<52:25:26,  8.69s/it]
 43%|████▎     | 16236/37963 [36:45:43<50:36:41,  8.39s/it]
 43%|████▎     | 16237/37963 [36:45:50<49:16:12,  8.16s/it]
 43%|████▎     | 16238/37963 [36:45:58<48:20:58,  8.01s/it]
 43%|████▎     | 16239/37963 [36:46:06<47:28:04,  7.87s/it]
 43%|████▎     | 16240/37963 [36:46:13<47:06:41,  7.81s/it]
                                                           
{'loss': '0.1694', 'grad_norm': '3.29', 'learning_rate': '1.279e-05', 'epoch': '0.4278'}
+
 43%|████▎     | 16240/37963 [36:46:13<47:06:41,  7.81s/it]
 43%|████▎     | 16241/37963 [36:46:21<46:51:48,  7.77s/it]
 43%|████▎     | 16242/37963 [36:46:29<47:00:16,  7.79s/it]
 43%|████▎     | 16243/37963 [36:46:36<46:44:29,  7.75s/it]
 43%|████▎     | 16244/37963 [36:46:44<46:49:30,  7.76s/it]
 43%|████▎     | 16245/37963 [36:46:52<46:59:55,  7.79s/it]
 43%|████▎     | 16246/37963 [36:47:00<47:01:07,  7.79s/it]
 43%|████▎     | 16247/37963 [36:47:08<47:08:30,  7.81s/it]
 43%|████▎     | 16248/37963 [36:47:16<47:08:49,  7.82s/it]
 43%|████▎     | 16249/37963 [36:47:26<51:50:11,  8.59s/it]
 43%|████▎     | 16250/37963 [36:47:37<55:47:37,  9.25s/it]
                                                           
{'loss': '0.1598', 'grad_norm': '1.268', 'learning_rate': '1.278e-05', 'epoch': '0.428'}
+
 43%|████▎     | 16250/37963 [36:47:37<55:47:37,  9.25s/it]
 43%|████▎     | 16251/37963 [36:47:44<51:56:52,  8.61s/it]
 43%|████▎     | 16252/37963 [36:47:52<50:14:45,  8.33s/it]
 43%|████▎     | 16253/37963 [36:47:59<48:42:10,  8.08s/it]
 43%|████▎     | 16254/37963 [36:48:07<48:00:59,  7.96s/it]
 43%|████▎     | 16255/37963 [36:48:17<52:01:52,  8.63s/it]
 43%|████▎     | 16256/37963 [36:48:27<55:30:04,  9.20s/it]
 43%|████▎     | 16257/37963 [36:48:35<52:52:53,  8.77s/it]
 43%|████▎     | 16258/37963 [36:48:43<51:21:14,  8.52s/it]
 43%|████▎     | 16259/37963 [36:48:51<50:20:58,  8.35s/it]
 43%|████▎     | 16260/37963 [36:48:59<48:35:54,  8.06s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '1.645', 'learning_rate': '1.277e-05', 'epoch': '0.4283'}
+
 43%|████▎     | 16260/37963 [36:48:59<48:35:54,  8.06s/it]
 43%|████▎     | 16261/37963 [36:49:06<47:52:51,  7.94s/it]
 43%|████▎     | 16262/37963 [36:49:14<47:13:15,  7.83s/it]
 43%|████▎     | 16263/37963 [36:49:21<46:57:21,  7.79s/it]
 43%|████▎     | 16264/37963 [36:49:29<46:07:04,  7.65s/it]
 43%|████▎     | 16265/37963 [36:49:37<46:21:17,  7.69s/it]
 43%|████▎     | 16266/37963 [36:49:44<46:22:41,  7.70s/it]
 43%|████▎     | 16267/37963 [36:49:52<46:40:06,  7.74s/it]
 43%|████▎     | 16268/37963 [36:50:00<46:32:25,  7.72s/it]
 43%|████▎     | 16269/37963 [36:50:07<46:11:41,  7.67s/it]
 43%|████▎     | 16270/37963 [36:50:15<45:47:56,  7.60s/it]
                                                           
{'loss': '0.1644', 'grad_norm': '5.549', 'learning_rate': '1.276e-05', 'epoch': '0.4286'}
+
 43%|████▎     | 16270/37963 [36:50:15<45:47:56,  7.60s/it]
 43%|████▎     | 16271/37963 [36:50:22<45:50:15,  7.61s/it]
 43%|████▎     | 16272/37963 [36:50:30<45:55:26,  7.62s/it]
 43%|████▎     | 16273/37963 [36:50:40<50:24:27,  8.37s/it]
 43%|████▎     | 16274/37963 [36:50:48<49:06:57,  8.15s/it]
 43%|████▎     | 16275/37963 [36:50:58<53:29:31,  8.88s/it]
 43%|████▎     | 16276/37963 [36:51:06<50:48:59,  8.44s/it]
 43%|████▎     | 16277/37963 [36:51:13<49:25:04,  8.20s/it]
 43%|████▎     | 16278/37963 [36:51:21<47:44:07,  7.92s/it]
 43%|████▎     | 16279/37963 [36:51:28<47:12:14,  7.84s/it]
 43%|████▎     | 16280/37963 [36:51:36<47:12:58,  7.84s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '1.007', 'learning_rate': '1.276e-05', 'epoch': '0.4288'}
+
 43%|████▎     | 16280/37963 [36:51:36<47:12:58,  7.84s/it]
 43%|████▎     | 16281/37963 [36:51:44<47:28:02,  7.88s/it]
 43%|████▎     | 16282/37963 [36:51:54<51:50:07,  8.61s/it]
 43%|████▎     | 16283/37963 [36:52:02<49:44:38,  8.26s/it]
 43%|████▎     | 16284/37963 [36:52:09<48:15:33,  8.01s/it]
 43%|████▎     | 16285/37963 [36:52:17<47:34:14,  7.90s/it]
 43%|████▎     | 16286/37963 [36:52:27<51:40:04,  8.58s/it]
 43%|████▎     | 16287/37963 [36:52:35<50:04:32,  8.32s/it]
 43%|████▎     | 16288/37963 [36:52:43<49:05:29,  8.15s/it]
 43%|████▎     | 16289/37963 [36:52:50<48:14:29,  8.01s/it]
 43%|████▎     | 16290/37963 [36:52:58<47:08:40,  7.83s/it]
                                                           
{'loss': '0.1734', 'grad_norm': '2.605', 'learning_rate': '1.275e-05', 'epoch': '0.4291'}
+
 43%|████▎     | 16290/37963 [36:52:58<47:08:40,  7.83s/it]
 43%|████▎     | 16291/37963 [36:53:05<46:10:49,  7.67s/it]
 43%|████▎     | 16292/37963 [36:53:13<46:15:20,  7.68s/it]
 43%|████▎     | 16293/37963 [36:53:21<46:34:32,  7.74s/it]
 43%|████▎     | 16294/37963 [36:53:28<45:41:16,  7.59s/it]
 43%|████▎     | 16295/37963 [36:53:36<46:24:14,  7.71s/it]
 43%|████▎     | 16296/37963 [36:53:44<46:32:12,  7.73s/it]
 43%|████▎     | 16297/37963 [36:53:54<51:52:34,  8.62s/it]
 43%|████▎     | 16298/37963 [36:54:02<50:51:29,  8.45s/it]
 43%|████▎     | 16299/37963 [36:54:13<54:19:12,  9.03s/it]
 43%|████▎     | 16300/37963 [36:54:23<56:44:37,  9.43s/it]
                                                           
{'loss': '0.1557', 'grad_norm': '1.141', 'learning_rate': '1.274e-05', 'epoch': '0.4294'}
+
 43%|████▎     | 16300/37963 [36:54:23<56:44:37,  9.43s/it]
 43%|████▎     | 16301/37963 [36:54:31<53:12:39,  8.84s/it]
 43%|████▎     | 16302/37963 [36:54:38<51:14:47,  8.52s/it]
 43%|████▎     | 16303/37963 [36:54:46<49:59:28,  8.31s/it]
 43%|████▎     | 16304/37963 [36:54:54<48:17:07,  8.03s/it]
 43%|████▎     | 16305/37963 [36:55:01<47:53:44,  7.96s/it]
 43%|████▎     | 16306/37963 [36:55:09<46:54:05,  7.80s/it]
 43%|████▎     | 16307/37963 [36:55:16<46:36:09,  7.75s/it]
 43%|████▎     | 16308/37963 [36:55:24<46:51:17,  7.79s/it]
 43%|████▎     | 16309/37963 [36:55:35<51:41:59,  8.60s/it]
 43%|████▎     | 16310/37963 [36:55:42<49:49:05,  8.28s/it]
                                                           
{'loss': '0.1488', 'grad_norm': '3.943', 'learning_rate': '1.273e-05', 'epoch': '0.4296'}
+
 43%|████▎     | 16310/37963 [36:55:42<49:49:05,  8.28s/it]
 43%|████▎     | 16311/37963 [36:55:50<48:49:51,  8.12s/it]
 43%|████▎     | 16312/37963 [36:55:58<47:56:13,  7.97s/it]
 43%|████▎     | 16313/37963 [36:56:05<47:23:56,  7.88s/it]
 43%|████▎     | 16314/37963 [36:56:13<46:54:32,  7.80s/it]
 43%|████▎     | 16315/37963 [36:56:21<47:11:21,  7.85s/it]
 43%|████▎     | 16316/37963 [36:56:29<46:43:56,  7.77s/it]
 43%|████▎     | 16317/37963 [36:56:36<46:40:38,  7.76s/it]
 43%|████▎     | 16318/37963 [36:56:44<46:34:30,  7.75s/it]
 43%|████▎     | 16319/37963 [36:56:52<46:24:33,  7.72s/it]
 43%|████▎     | 16320/37963 [36:56:59<46:22:04,  7.71s/it]
                                                           
{'loss': '0.1718', 'grad_norm': '4.785', 'learning_rate': '1.272e-05', 'epoch': '0.4299'}
+
 43%|████▎     | 16320/37963 [36:56:59<46:22:04,  7.71s/it]
 43%|████▎     | 16321/37963 [36:57:07<46:29:05,  7.73s/it]
 43%|████▎     | 16322/37963 [36:57:20<55:57:21,  9.31s/it]
 43%|████▎     | 16323/37963 [36:57:28<53:20:45,  8.87s/it]
 43%|████▎     | 16324/37963 [36:57:36<51:01:33,  8.49s/it]
 43%|████▎     | 16325/37963 [36:57:43<49:09:15,  8.18s/it]
 43%|████▎     | 16326/37963 [36:57:51<48:32:55,  8.08s/it]
 43%|████▎     | 16327/37963 [36:57:58<47:45:38,  7.95s/it]
 43%|████▎     | 16328/37963 [36:58:06<47:21:12,  7.88s/it]
 43%|████▎     | 16329/37963 [36:58:14<47:16:31,  7.87s/it]
 43%|████▎     | 16330/37963 [36:58:24<51:26:07,  8.56s/it]
                                                           
{'loss': '0.158', 'grad_norm': '1.456', 'learning_rate': '1.271e-05', 'epoch': '0.4302'}
+
 43%|████▎     | 16330/37963 [36:58:24<51:26:07,  8.56s/it]
 43%|████▎     | 16331/37963 [36:58:35<55:02:49,  9.16s/it]
 43%|████▎     | 16332/37963 [36:58:43<52:31:25,  8.74s/it]
 43%|████▎     | 16333/37963 [36:58:51<51:08:45,  8.51s/it]
 43%|████▎     | 16334/37963 [36:58:58<49:59:10,  8.32s/it]
 43%|████▎     | 16335/37963 [36:59:06<48:46:52,  8.12s/it]
 43%|████▎     | 16336/37963 [36:59:14<47:52:50,  7.97s/it]
 43%|████▎     | 16337/37963 [36:59:21<47:16:57,  7.87s/it]
 43%|████▎     | 16338/37963 [36:59:29<46:59:41,  7.82s/it]
 43%|████▎     | 16339/37963 [36:59:37<46:49:55,  7.80s/it]
 43%|████▎     | 16340/37963 [36:59:45<47:01:21,  7.83s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '2.788', 'learning_rate': '1.271e-05', 'epoch': '0.4304'}
+
 43%|████▎     | 16340/37963 [36:59:45<47:01:21,  7.83s/it]
 43%|████▎     | 16341/37963 [36:59:55<51:52:25,  8.64s/it]
 43%|████▎     | 16342/37963 [37:00:03<50:21:27,  8.38s/it]
 43%|████▎     | 16343/37963 [37:00:11<48:53:01,  8.14s/it]
 43%|████▎     | 16344/37963 [37:00:21<52:34:03,  8.75s/it]
 43%|████▎     | 16345/37963 [37:00:28<50:24:49,  8.40s/it]
 43%|████▎     | 16346/37963 [37:00:36<49:11:49,  8.19s/it]
 43%|████▎     | 16347/37963 [37:00:44<48:36:07,  8.09s/it]
 43%|████▎     | 16348/37963 [37:00:54<52:08:44,  8.68s/it]
 43%|████▎     | 16349/37963 [37:01:02<50:38:15,  8.43s/it]
 43%|████▎     | 16350/37963 [37:01:09<49:16:17,  8.21s/it]
                                                           
{'loss': '0.1674', 'grad_norm': '3.559', 'learning_rate': '1.27e-05', 'epoch': '0.4307'}
+
 43%|████▎     | 16350/37963 [37:01:09<49:16:17,  8.21s/it]
 43%|████▎     | 16351/37963 [37:01:17<48:18:04,  8.05s/it]
 43%|████▎     | 16352/37963 [37:01:25<47:34:17,  7.92s/it]
 43%|████▎     | 16353/37963 [37:01:33<47:37:44,  7.93s/it]
 43%|████▎     | 16354/37963 [37:01:40<46:57:36,  7.82s/it]
 43%|████▎     | 16355/37963 [37:01:48<47:09:38,  7.86s/it]
 43%|████▎     | 16356/37963 [37:01:56<47:02:11,  7.84s/it]
 43%|████▎     | 16357/37963 [37:02:04<46:48:04,  7.80s/it]
 43%|████▎     | 16358/37963 [37:02:11<46:34:16,  7.76s/it]
 43%|████▎     | 16359/37963 [37:02:19<46:17:35,  7.71s/it]
 43%|████▎     | 16360/37963 [37:02:27<46:18:57,  7.72s/it]
                                                           
{'loss': '0.1784', 'grad_norm': '2.311', 'learning_rate': '1.269e-05', 'epoch': '0.4309'}
+
 43%|████▎     | 16360/37963 [37:02:27<46:18:57,  7.72s/it]
 43%|████▎     | 16361/37963 [37:02:35<46:28:00,  7.74s/it]
 43%|████▎     | 16362/37963 [37:02:42<45:55:48,  7.65s/it]
 43%|████▎     | 16363/37963 [37:02:52<50:44:58,  8.46s/it]
 43%|████▎     | 16364/37963 [37:03:00<50:02:32,  8.34s/it]
 43%|████▎     | 16365/37963 [37:03:08<48:20:01,  8.06s/it]
 43%|████▎     | 16366/37963 [37:03:15<47:36:36,  7.94s/it]
 43%|████▎     | 16367/37963 [37:03:23<47:17:40,  7.88s/it]
 43%|████▎     | 16368/37963 [37:03:31<47:16:06,  7.88s/it]
 43%|████▎     | 16369/37963 [37:03:41<51:44:23,  8.63s/it]
 43%|████▎     | 16370/37963 [37:03:52<55:06:28,  9.19s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '2.204', 'learning_rate': '1.268e-05', 'epoch': '0.4312'}
+
 43%|████▎     | 16370/37963 [37:03:52<55:06:28,  9.19s/it]
 43%|████▎     | 16371/37963 [37:04:00<52:27:12,  8.75s/it]
 43%|████▎     | 16372/37963 [37:04:07<50:35:59,  8.44s/it]
 43%|████▎     | 16373/37963 [37:04:15<49:06:40,  8.19s/it]
 43%|████▎     | 16374/37963 [37:04:23<48:46:55,  8.13s/it]
 43%|████▎     | 16375/37963 [37:04:33<52:44:18,  8.79s/it]
 43%|████▎     | 16376/37963 [37:04:41<50:52:09,  8.48s/it]
 43%|████▎     | 16377/37963 [37:04:49<49:29:39,  8.25s/it]
 43%|████▎     | 16378/37963 [37:04:56<48:19:16,  8.06s/it]
 43%|████▎     | 16379/37963 [37:05:04<47:27:23,  7.92s/it]
 43%|████▎     | 16380/37963 [37:05:12<47:12:16,  7.87s/it]
                                                           
{'loss': '0.1692', 'grad_norm': '2.998', 'learning_rate': '1.267e-05', 'epoch': '0.4315'}
+
 43%|████▎     | 16380/37963 [37:05:12<47:12:16,  7.87s/it]
 43%|████▎     | 16381/37963 [37:05:19<45:57:29,  7.67s/it]
 43%|████▎     | 16382/37963 [37:05:27<45:52:15,  7.65s/it]
 43%|████▎     | 16383/37963 [37:05:34<45:47:14,  7.64s/it]
 43%|████▎     | 16384/37963 [37:05:45<50:52:06,  8.49s/it]
 43%|████▎     | 16385/37963 [37:05:52<49:19:40,  8.23s/it]
 43%|████▎     | 16386/37963 [37:06:00<48:40:36,  8.12s/it]
 43%|████▎     | 16387/37963 [37:06:08<47:57:10,  8.00s/it]
 43%|████▎     | 16388/37963 [37:06:15<47:15:26,  7.89s/it]
 43%|████▎     | 16389/37963 [37:06:26<51:44:14,  8.63s/it]
 43%|████▎     | 16390/37963 [37:06:33<49:59:41,  8.34s/it]
                                                           
{'loss': '0.1678', 'grad_norm': '1.02', 'learning_rate': '1.267e-05', 'epoch': '0.4317'}
+
 43%|████▎     | 16390/37963 [37:06:33<49:59:41,  8.34s/it]
 43%|████▎     | 16391/37963 [37:06:41<48:27:04,  8.09s/it]
 43%|████▎     | 16392/37963 [37:06:51<52:19:55,  8.73s/it]
 43%|████▎     | 16393/37963 [37:06:59<50:48:34,  8.48s/it]
 43%|████▎     | 16394/37963 [37:07:07<49:27:41,  8.26s/it]
 43%|████▎     | 16395/37963 [37:07:15<48:25:47,  8.08s/it]
 43%|████▎     | 16396/37963 [37:07:25<52:17:39,  8.73s/it]
 43%|████▎     | 16397/37963 [37:07:32<50:26:32,  8.42s/it]
 43%|████▎     | 16398/37963 [37:07:40<49:09:28,  8.21s/it]
 43%|████▎     | 16399/37963 [37:07:48<48:15:42,  8.06s/it]
 43%|████▎     | 16400/37963 [37:07:56<47:50:08,  7.99s/it]
                                                           
{'loss': '0.1676', 'grad_norm': '3.412', 'learning_rate': '1.266e-05', 'epoch': '0.432'}
+
 43%|████▎     | 16400/37963 [37:07:56<47:50:08,  7.99s/it]
 43%|████▎     | 16401/37963 [37:08:04<47:51:59,  7.99s/it]
 43%|████▎     | 16402/37963 [37:08:11<47:24:58,  7.92s/it]
 43%|████▎     | 16403/37963 [37:08:19<46:51:38,  7.82s/it]
 43%|████▎     | 16404/37963 [37:08:27<46:54:37,  7.83s/it]
 43%|████▎     | 16405/37963 [37:08:35<46:52:46,  7.83s/it]
 43%|████▎     | 16406/37963 [37:08:42<46:10:35,  7.71s/it]
 43%|████▎     | 16407/37963 [37:08:50<46:04:04,  7.69s/it]
 43%|████▎     | 16408/37963 [37:08:57<45:53:42,  7.67s/it]
 43%|████▎     | 16409/37963 [37:09:05<45:38:04,  7.62s/it]
 43%|████▎     | 16410/37963 [37:09:12<45:21:48,  7.58s/it]
                                                           
{'loss': '0.1535', 'grad_norm': '1.404', 'learning_rate': '1.265e-05', 'epoch': '0.4323'}
+
 43%|████▎     | 16410/37963 [37:09:12<45:21:48,  7.58s/it]
 43%|████▎     | 16411/37963 [37:09:20<45:17:44,  7.57s/it]
 43%|████▎     | 16412/37963 [37:09:28<45:33:56,  7.61s/it]
 43%|████▎     | 16413/37963 [37:09:35<45:31:09,  7.60s/it]
 43%|████▎     | 16414/37963 [37:09:43<45:07:02,  7.54s/it]
 43%|████▎     | 16415/37963 [37:09:50<44:53:21,  7.50s/it]
 43%|████▎     | 16416/37963 [37:09:57<44:46:48,  7.48s/it]
 43%|████▎     | 16417/37963 [37:10:11<54:47:00,  9.15s/it]
 43%|████▎     | 16418/37963 [37:10:21<56:43:29,  9.48s/it]
 43%|████▎     | 16419/37963 [37:10:29<53:47:08,  8.99s/it]
 43%|████▎     | 16420/37963 [37:10:37<51:57:46,  8.68s/it]
                                                           
{'loss': '0.1632', 'grad_norm': '1.374', 'learning_rate': '1.264e-05', 'epoch': '0.4325'}
+
 43%|████▎     | 16420/37963 [37:10:37<51:57:46,  8.68s/it]
 43%|████▎     | 16421/37963 [37:10:47<54:53:00,  9.17s/it]
 43%|████▎     | 16422/37963 [37:10:55<52:41:43,  8.81s/it]
 43%|████▎     | 16423/37963 [37:11:03<50:49:07,  8.49s/it]
 43%|████▎     | 16424/37963 [37:11:10<49:24:49,  8.26s/it]
 43%|████▎     | 16425/37963 [37:11:18<48:31:09,  8.11s/it]
 43%|████▎     | 16426/37963 [37:11:26<47:34:24,  7.95s/it]
 43%|████▎     | 16427/37963 [37:11:33<46:48:42,  7.83s/it]
 43%|████▎     | 16428/37963 [37:11:41<46:09:24,  7.72s/it]
 43%|████▎     | 16429/37963 [37:11:49<46:43:39,  7.81s/it]
 43%|████▎     | 16430/37963 [37:11:56<46:26:34,  7.76s/it]
                                                           
{'loss': '0.1791', 'grad_norm': '0.9282', 'learning_rate': '1.263e-05', 'epoch': '0.4328'}
+
 43%|████▎     | 16430/37963 [37:11:56<46:26:34,  7.76s/it]
 43%|████▎     | 16431/37963 [37:12:04<46:05:26,  7.71s/it]
 43%|████▎     | 16432/37963 [37:12:11<45:18:44,  7.58s/it]
 43%|████▎     | 16433/37963 [37:12:19<45:11:56,  7.56s/it]
 43%|████▎     | 16434/37963 [37:12:27<45:51:44,  7.67s/it]
 43%|████▎     | 16435/37963 [37:12:34<45:48:56,  7.66s/it]
 43%|████▎     | 16436/37963 [37:12:42<45:48:28,  7.66s/it]
 43%|████▎     | 16437/37963 [37:12:52<50:35:18,  8.46s/it]
 43%|████▎     | 16438/37963 [37:13:02<53:31:45,  8.95s/it]
 43%|████▎     | 16439/37963 [37:13:10<51:27:52,  8.61s/it]
 43%|████▎     | 16440/37963 [37:13:20<54:19:30,  9.09s/it]
                                                           
{'loss': '0.1646', 'grad_norm': '1.252', 'learning_rate': '1.262e-05', 'epoch': '0.4331'}
+
 43%|████▎     | 16440/37963 [37:13:20<54:19:30,  9.09s/it]
 43%|████▎     | 16441/37963 [37:13:28<51:45:01,  8.66s/it]
 43%|████▎     | 16442/37963 [37:13:36<50:38:03,  8.47s/it]
 43%|████▎     | 16443/37963 [37:13:44<48:50:19,  8.17s/it]
 43%|████▎     | 16444/37963 [37:13:54<52:35:23,  8.80s/it]
 43%|████▎     | 16445/37963 [37:14:02<51:06:23,  8.55s/it]
 43%|████▎     | 16446/37963 [37:14:09<49:37:36,  8.30s/it]
 43%|████▎     | 16447/37963 [37:14:17<48:32:09,  8.12s/it]
 43%|████▎     | 16448/37963 [37:14:25<47:43:22,  7.99s/it]
 43%|████▎     | 16449/37963 [37:14:33<47:41:04,  7.98s/it]
 43%|████▎     | 16450/37963 [37:14:41<47:20:15,  7.92s/it]
                                                           
{'loss': '0.1565', 'grad_norm': '2.024', 'learning_rate': '1.262e-05', 'epoch': '0.4333'}
+
 43%|████▎     | 16450/37963 [37:14:41<47:20:15,  7.92s/it]
 43%|████▎     | 16451/37963 [37:14:48<46:30:18,  7.78s/it]
 43%|████▎     | 16452/37963 [37:14:55<45:49:52,  7.67s/it]
 43%|████▎     | 16453/37963 [37:15:03<45:58:55,  7.70s/it]
 43%|████▎     | 16454/37963 [37:15:11<45:41:36,  7.65s/it]
 43%|████▎     | 16455/37963 [37:15:19<46:07:58,  7.72s/it]
 43%|████▎     | 16456/37963 [37:15:26<45:58:27,  7.70s/it]
 43%|████▎     | 16457/37963 [37:15:34<45:49:25,  7.67s/it]
 43%|████▎     | 16458/37963 [37:15:42<45:41:31,  7.65s/it]
 43%|████▎     | 16459/37963 [37:15:49<45:42:00,  7.65s/it]
 43%|████▎     | 16460/37963 [37:15:57<45:36:36,  7.64s/it]
                                                           
{'loss': '0.1594', 'grad_norm': '2.675', 'learning_rate': '1.261e-05', 'epoch': '0.4336'}
+
 43%|████▎     | 16460/37963 [37:15:57<45:36:36,  7.64s/it]
 43%|████▎     | 16461/37963 [37:16:05<45:59:32,  7.70s/it]
 43%|████▎     | 16462/37963 [37:16:12<45:56:49,  7.69s/it]
 43%|████▎     | 16463/37963 [37:16:20<45:18:06,  7.59s/it]
 43%|████▎     | 16464/37963 [37:16:30<50:46:16,  8.50s/it]
 43%|████▎     | 16465/37963 [37:16:38<49:46:17,  8.33s/it]
 43%|████▎     | 16466/37963 [37:16:45<47:43:00,  7.99s/it]
 43%|████▎     | 16467/37963 [37:16:56<51:42:09,  8.66s/it]
 43%|████▎     | 16468/37963 [37:17:06<54:17:34,  9.09s/it]
 43%|████▎     | 16469/37963 [37:17:14<52:15:28,  8.75s/it]
 43%|████▎     | 16470/37963 [37:17:21<50:25:11,  8.45s/it]
                                                           
{'loss': '0.1736', 'grad_norm': '1.017', 'learning_rate': '1.26e-05', 'epoch': '0.4338'}
+
 43%|████▎     | 16470/37963 [37:17:21<50:25:11,  8.45s/it]
 43%|████▎     | 16471/37963 [37:17:29<48:30:55,  8.13s/it]
 43%|████▎     | 16472/37963 [37:17:37<47:47:21,  8.01s/it]
 43%|████▎     | 16473/37963 [37:17:44<47:05:26,  7.89s/it]
 43%|████▎     | 16474/37963 [37:17:54<51:15:33,  8.59s/it]
 43%|████▎     | 16475/37963 [37:18:02<49:35:58,  8.31s/it]
 43%|████▎     | 16476/37963 [37:18:10<48:38:04,  8.15s/it]
 43%|████▎     | 16477/37963 [37:18:18<48:12:26,  8.08s/it]
 43%|████▎     | 16478/37963 [37:18:25<47:18:48,  7.93s/it]
 43%|████▎     | 16479/37963 [37:18:33<46:51:16,  7.85s/it]
 43%|████▎     | 16480/37963 [37:18:41<46:44:06,  7.83s/it]
                                                           
{'loss': '0.1459', 'grad_norm': '3.327', 'learning_rate': '1.259e-05', 'epoch': '0.4341'}
+
 43%|████▎     | 16480/37963 [37:18:41<46:44:06,  7.83s/it]
 43%|████▎     | 16481/37963 [37:18:51<51:43:42,  8.67s/it]
 43%|████▎     | 16482/37963 [37:18:59<50:08:47,  8.40s/it]
 43%|████▎     | 16483/37963 [37:19:07<48:38:36,  8.15s/it]
 43%|████▎     | 16484/37963 [37:19:14<47:36:50,  7.98s/it]
 43%|████▎     | 16485/37963 [37:19:22<47:13:09,  7.91s/it]
 43%|████▎     | 16486/37963 [37:19:30<47:18:34,  7.93s/it]
 43%|████▎     | 16487/37963 [37:19:37<46:28:30,  7.79s/it]
 43%|████▎     | 16488/37963 [37:19:45<46:23:45,  7.78s/it]
 43%|████▎     | 16489/37963 [37:19:53<46:05:17,  7.73s/it]
 43%|████▎     | 16490/37963 [37:20:01<46:23:54,  7.78s/it]
                                                           
{'loss': '0.1643', 'grad_norm': '1.669', 'learning_rate': '1.258e-05', 'epoch': '0.4344'}
+
 43%|████▎     | 16490/37963 [37:20:01<46:23:54,  7.78s/it]
 43%|████▎     | 16491/37963 [37:20:11<50:26:04,  8.46s/it]
 43%|████▎     | 16492/37963 [37:20:19<49:22:41,  8.28s/it]
 43%|████▎     | 16493/37963 [37:20:29<52:48:21,  8.85s/it]
 43%|████▎     | 16494/37963 [37:20:39<55:30:15,  9.31s/it]
 43%|████▎     | 16495/37963 [37:20:47<52:41:14,  8.84s/it]
 43%|████▎     | 16496/37963 [37:20:55<50:56:53,  8.54s/it]
 43%|████▎     | 16497/37963 [37:21:02<49:17:34,  8.27s/it]
 43%|████▎     | 16498/37963 [37:21:10<48:10:22,  8.08s/it]
 43%|████▎     | 16499/37963 [37:21:17<46:48:54,  7.85s/it]
 43%|████▎     | 16500/37963 [37:21:25<46:52:08,  7.86s/it]
                                                           
{'loss': '0.1655', 'grad_norm': '3.049', 'learning_rate': '1.257e-05', 'epoch': '0.4346'}
+
 43%|████▎     | 16500/37963 [37:21:25<46:52:08,  7.86s/it]
 43%|████▎     | 16501/37963 [37:21:33<46:40:31,  7.83s/it]
 43%|████▎     | 16502/37963 [37:21:41<46:18:18,  7.77s/it]
 43%|████▎     | 16503/37963 [37:21:48<46:06:45,  7.74s/it]
 43%|████▎     | 16504/37963 [37:21:56<46:25:35,  7.79s/it]
 43%|████▎     | 16505/37963 [37:22:04<46:39:00,  7.83s/it]
 43%|████▎     | 16506/37963 [37:22:12<46:17:24,  7.77s/it]
 43%|████▎     | 16507/37963 [37:22:19<46:02:46,  7.73s/it]
 43%|████▎     | 16508/37963 [37:22:27<46:12:17,  7.75s/it]
 43%|████▎     | 16509/37963 [37:22:35<45:42:38,  7.67s/it]
 43%|████▎     | 16510/37963 [37:22:43<46:02:20,  7.73s/it]
                                                           
{'loss': '0.1689', 'grad_norm': '1.673', 'learning_rate': '1.257e-05', 'epoch': '0.4349'}
+
 43%|████▎     | 16510/37963 [37:22:43<46:02:20,  7.73s/it]
 43%|████▎     | 16511/37963 [37:22:50<46:16:20,  7.77s/it]
 43%|████▎     | 16512/37963 [37:22:58<46:16:45,  7.77s/it]
 43%|████▎     | 16513/37963 [37:23:06<46:39:30,  7.83s/it]
 44%|████▎     | 16514/37963 [37:23:14<46:22:20,  7.78s/it]
 44%|████▎     | 16515/37963 [37:23:21<46:09:29,  7.75s/it]
 44%|████▎     | 16516/37963 [37:23:29<46:13:57,  7.76s/it]
 44%|████▎     | 16517/37963 [37:23:40<50:53:25,  8.54s/it]
 44%|████▎     | 16518/37963 [37:23:50<53:46:40,  9.03s/it]
 44%|████▎     | 16519/37963 [37:23:57<51:19:01,  8.62s/it]
 44%|████▎     | 16520/37963 [37:24:05<49:26:32,  8.30s/it]
                                                           
{'loss': '0.1559', 'grad_norm': '2.044', 'learning_rate': '1.256e-05', 'epoch': '0.4352'}
+
 44%|████▎     | 16520/37963 [37:24:05<49:26:32,  8.30s/it]
 44%|████▎     | 16521/37963 [37:24:15<52:04:41,  8.74s/it]
 44%|████▎     | 16522/37963 [37:24:22<50:08:40,  8.42s/it]
 44%|████▎     | 16523/37963 [37:24:30<49:22:49,  8.29s/it]
 44%|████▎     | 16524/37963 [37:24:38<48:26:29,  8.13s/it]
 44%|████▎     | 16525/37963 [37:24:46<47:28:21,  7.97s/it]
 44%|████▎     | 16526/37963 [37:24:53<46:30:56,  7.81s/it]
 44%|████▎     | 16527/37963 [37:25:01<46:05:41,  7.74s/it]
 44%|████▎     | 16528/37963 [37:25:09<46:06:15,  7.74s/it]
 44%|████▎     | 16529/37963 [37:25:19<51:19:38,  8.62s/it]
 44%|████▎     | 16530/37963 [37:25:27<49:39:05,  8.34s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '2.158', 'learning_rate': '1.255e-05', 'epoch': '0.4354'}
+
 44%|████▎     | 16530/37963 [37:25:27<49:39:05,  8.34s/it]
 44%|████▎     | 16531/37963 [37:25:35<48:42:57,  8.18s/it]
 44%|████▎     | 16532/37963 [37:25:42<47:35:44,  8.00s/it]
 44%|████▎     | 16533/37963 [37:25:50<46:52:07,  7.87s/it]
 44%|████▎     | 16534/37963 [37:25:57<46:24:08,  7.80s/it]
 44%|████▎     | 16535/37963 [37:26:05<46:04:47,  7.74s/it]
 44%|████▎     | 16536/37963 [37:26:13<45:47:51,  7.69s/it]
 44%|████▎     | 16537/37963 [37:26:20<45:45:58,  7.69s/it]
 44%|████▎     | 16538/37963 [37:26:28<45:35:23,  7.66s/it]
 44%|████▎     | 16539/37963 [37:26:36<45:52:51,  7.71s/it]
 44%|████▎     | 16540/37963 [37:26:44<46:00:56,  7.73s/it]
                                                           
{'loss': '0.1593', 'grad_norm': '1.308', 'learning_rate': '1.254e-05', 'epoch': '0.4357'}
+
 44%|████▎     | 16540/37963 [37:26:44<46:00:56,  7.73s/it]
 44%|████▎     | 16541/37963 [37:26:51<46:11:04,  7.76s/it]
 44%|████▎     | 16542/37963 [37:26:59<46:00:52,  7.73s/it]
 44%|████▎     | 16543/37963 [37:27:07<45:58:34,  7.73s/it]
 44%|████▎     | 16544/37963 [37:27:14<45:50:29,  7.70s/it]
 44%|████▎     | 16545/37963 [37:27:25<50:11:25,  8.44s/it]
 44%|████▎     | 16546/37963 [37:27:33<49:24:14,  8.30s/it]
 44%|████▎     | 16547/37963 [37:27:43<52:44:32,  8.87s/it]
 44%|████▎     | 16548/37963 [37:27:53<55:10:29,  9.28s/it]
 44%|████▎     | 16549/37963 [37:28:01<52:40:59,  8.86s/it]
 44%|████▎     | 16550/37963 [37:28:09<50:59:13,  8.57s/it]
                                                           
{'loss': '0.1519', 'grad_norm': '2.355', 'learning_rate': '1.253e-05', 'epoch': '0.436'}
+
 44%|████▎     | 16550/37963 [37:28:09<50:59:13,  8.57s/it]
 44%|████▎     | 16551/37963 [37:28:16<49:27:59,  8.32s/it]
 44%|████▎     | 16552/37963 [37:28:24<48:11:26,  8.10s/it]
 44%|████▎     | 16553/37963 [37:28:32<47:33:15,  8.00s/it]
 44%|████▎     | 16554/37963 [37:28:40<46:57:50,  7.90s/it]
 44%|████▎     | 16555/37963 [37:28:47<46:17:27,  7.78s/it]
 44%|████▎     | 16556/37963 [37:28:55<45:58:05,  7.73s/it]
 44%|████▎     | 16557/37963 [37:29:02<46:04:09,  7.75s/it]
 44%|████▎     | 16558/37963 [37:29:10<45:44:55,  7.69s/it]
 44%|████▎     | 16559/37963 [37:29:18<45:58:53,  7.73s/it]
 44%|████▎     | 16560/37963 [37:29:26<46:10:10,  7.77s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '1.043', 'learning_rate': '1.252e-05', 'epoch': '0.4362'}
+
 44%|████▎     | 16560/37963 [37:29:26<46:10:10,  7.77s/it]
 44%|████▎     | 16561/37963 [37:29:33<46:03:43,  7.75s/it]
 44%|████▎     | 16562/37963 [37:29:41<46:18:21,  7.79s/it]
 44%|████▎     | 16563/37963 [37:29:52<51:15:49,  8.62s/it]
 44%|████▎     | 16564/37963 [37:30:00<49:47:35,  8.38s/it]
 44%|████▎     | 16565/37963 [37:30:10<53:01:30,  8.92s/it]
 44%|████▎     | 16566/37963 [37:30:18<51:03:14,  8.59s/it]
 44%|████▎     | 16567/37963 [37:30:28<54:46:58,  9.22s/it]
 44%|████▎     | 16568/37963 [37:30:36<52:09:27,  8.78s/it]
 44%|████▎     | 16569/37963 [37:30:44<50:24:03,  8.48s/it]
 44%|████▎     | 16570/37963 [37:30:52<49:16:29,  8.29s/it]
                                                           
{'loss': '0.16', 'grad_norm': '1.036', 'learning_rate': '1.252e-05', 'epoch': '0.4365'}
+
 44%|████▎     | 16570/37963 [37:30:52<49:16:29,  8.29s/it]
 44%|████▎     | 16571/37963 [37:30:59<47:26:14,  7.98s/it]
 44%|████▎     | 16572/37963 [37:31:09<51:14:32,  8.62s/it]
 44%|████▎     | 16573/37963 [37:31:17<49:35:49,  8.35s/it]
 44%|████▎     | 16574/37963 [37:31:25<48:45:41,  8.21s/it]
 44%|████▎     | 16575/37963 [37:31:32<47:57:12,  8.07s/it]
 44%|████▎     | 16576/37963 [37:31:40<47:06:13,  7.93s/it]
 44%|████▎     | 16577/37963 [37:31:48<46:59:28,  7.91s/it]
 44%|████▎     | 16578/37963 [37:31:55<45:48:24,  7.71s/it]
 44%|████▎     | 16579/37963 [37:32:03<45:54:09,  7.73s/it]
 44%|████▎     | 16580/37963 [37:32:11<45:41:34,  7.69s/it]
                                                           
{'loss': '0.159', 'grad_norm': '1.912', 'learning_rate': '1.251e-05', 'epoch': '0.4367'}
+
 44%|████▎     | 16580/37963 [37:32:11<45:41:34,  7.69s/it]
 44%|████▎     | 16581/37963 [37:32:18<45:50:51,  7.72s/it]
 44%|████▎     | 16582/37963 [37:32:26<45:54:56,  7.73s/it]
 44%|████▎     | 16583/37963 [37:32:36<50:42:43,  8.54s/it]
 44%|████▎     | 16584/37963 [37:32:44<48:58:00,  8.25s/it]
 44%|████▎     | 16585/37963 [37:32:52<48:13:22,  8.12s/it]
 44%|████▎     | 16586/37963 [37:32:59<46:56:11,  7.90s/it]
 44%|████▎     | 16587/37963 [37:33:07<46:35:08,  7.85s/it]
 44%|████▎     | 16588/37963 [37:33:15<46:19:05,  7.80s/it]
 44%|████▎     | 16589/37963 [37:33:22<45:39:41,  7.69s/it]
 44%|████▎     | 16590/37963 [37:33:29<44:48:32,  7.55s/it]
                                                           
{'loss': '0.172', 'grad_norm': '1.667', 'learning_rate': '1.25e-05', 'epoch': '0.437'}
+
 44%|████▎     | 16590/37963 [37:33:29<44:48:32,  7.55s/it]
 44%|████▎     | 16591/37963 [37:33:40<49:42:07,  8.37s/it]
 44%|████▎     | 16592/37963 [37:33:50<52:57:22,  8.92s/it]
 44%|████▎     | 16593/37963 [37:33:58<50:53:52,  8.57s/it]
 44%|████▎     | 16594/37963 [37:34:05<49:20:50,  8.31s/it]
 44%|████▎     | 16595/37963 [37:34:13<48:23:11,  8.15s/it]
 44%|████▎     | 16596/37963 [37:34:21<47:43:58,  8.04s/it]
 44%|████▎     | 16597/37963 [37:34:28<47:00:46,  7.92s/it]
 44%|████▎     | 16598/37963 [37:34:36<46:37:52,  7.86s/it]
 44%|████▎     | 16599/37963 [37:34:47<51:08:45,  8.62s/it]
 44%|████▎     | 16600/37963 [37:34:54<49:45:26,  8.38s/it]
                                                           
{'loss': '0.1723', 'grad_norm': '4.519', 'learning_rate': '1.249e-05', 'epoch': '0.4373'}
+
 44%|████▎     | 16600/37963 [37:34:54<49:45:26,  8.38s/it]
 44%|████▎     | 16601/37963 [37:35:02<48:59:56,  8.26s/it]
 44%|████▎     | 16602/37963 [37:35:10<48:19:57,  8.15s/it]
 44%|████▎     | 16603/37963 [37:35:18<47:33:51,  8.02s/it]
 44%|████▎     | 16604/37963 [37:35:26<46:55:17,  7.91s/it]
 44%|████▎     | 16605/37963 [37:35:33<46:31:55,  7.84s/it]
 44%|████▎     | 16606/37963 [37:35:41<46:07:32,  7.78s/it]
 44%|████▎     | 16607/37963 [37:35:49<45:50:15,  7.73s/it]
 44%|████▎     | 16608/37963 [37:35:56<45:49:06,  7.72s/it]
 44%|████▍     | 16609/37963 [37:36:04<46:05:53,  7.77s/it]
 44%|████▍     | 16610/37963 [37:36:12<45:58:05,  7.75s/it]
                                                           
{'loss': '0.1706', 'grad_norm': '3.455', 'learning_rate': '1.248e-05', 'epoch': '0.4375'}
+
 44%|████▍     | 16610/37963 [37:36:12<45:58:05,  7.75s/it]
 44%|████▍     | 16611/37963 [37:36:22<50:44:46,  8.56s/it]
 44%|████▍     | 16612/37963 [37:36:33<53:40:45,  9.05s/it]
 44%|████▍     | 16613/37963 [37:36:40<51:22:22,  8.66s/it]
 44%|████▍     | 16614/37963 [37:36:48<49:07:44,  8.28s/it]
 44%|████▍     | 16615/37963 [37:36:56<48:29:50,  8.18s/it]
 44%|████▍     | 16616/37963 [37:37:06<52:04:31,  8.78s/it]
 44%|████▍     | 16617/37963 [37:37:14<50:45:24,  8.56s/it]
 44%|████▍     | 16618/37963 [37:37:21<49:03:45,  8.27s/it]
 44%|████▍     | 16619/37963 [37:37:29<48:01:14,  8.10s/it]
 44%|████▍     | 16620/37963 [37:37:37<47:14:48,  7.97s/it]
                                                           
{'loss': '0.1529', 'grad_norm': '1.261', 'learning_rate': '1.248e-05', 'epoch': '0.4378'}
+
 44%|████▍     | 16620/37963 [37:37:37<47:14:48,  7.97s/it]
 44%|████▍     | 16621/37963 [37:37:44<46:28:37,  7.84s/it]
 44%|████▍     | 16622/37963 [37:37:52<46:32:52,  7.85s/it]
 44%|████▍     | 16623/37963 [37:38:00<45:55:11,  7.75s/it]
 44%|████▍     | 16624/37963 [37:38:08<46:03:16,  7.77s/it]
 44%|████▍     | 16625/37963 [37:38:15<45:46:16,  7.72s/it]
 44%|████▍     | 16626/37963 [37:38:25<50:17:19,  8.48s/it]
 44%|████▍     | 16627/37963 [37:38:36<53:26:28,  9.02s/it]
 44%|████▍     | 16628/37963 [37:38:44<51:53:24,  8.76s/it]
 44%|████▍     | 16629/37963 [37:38:52<50:38:36,  8.55s/it]
 44%|████▍     | 16630/37963 [37:39:00<49:08:19,  8.29s/it]
                                                           
{'loss': '0.1493', 'grad_norm': '2.44', 'learning_rate': '1.247e-05', 'epoch': '0.4381'}
+
 44%|████▍     | 16630/37963 [37:39:00<49:08:19,  8.29s/it]
 44%|████▍     | 16631/37963 [37:39:07<47:53:07,  8.08s/it]
 44%|████▍     | 16632/37963 [37:39:15<47:52:21,  8.08s/it]
 44%|████▍     | 16633/37963 [37:39:23<47:48:13,  8.07s/it]
 44%|████▍     | 16634/37963 [37:39:31<47:00:55,  7.94s/it]
 44%|████▍     | 16635/37963 [37:39:39<46:56:14,  7.92s/it]
 44%|████▍     | 16636/37963 [37:39:46<46:07:01,  7.78s/it]
 44%|████▍     | 16637/37963 [37:39:54<45:44:06,  7.72s/it]
 44%|████▍     | 16638/37963 [37:40:01<45:27:16,  7.67s/it]
 44%|████▍     | 16639/37963 [37:40:12<50:26:04,  8.51s/it]
 44%|████▍     | 16640/37963 [37:40:22<53:43:29,  9.07s/it]
                                                           
{'loss': '0.163', 'grad_norm': '1.939', 'learning_rate': '1.246e-05', 'epoch': '0.4383'}
+
 44%|████▍     | 16640/37963 [37:40:22<53:43:29,  9.07s/it]
 44%|████▍     | 16641/37963 [37:40:30<51:22:51,  8.68s/it]
 44%|████▍     | 16642/37963 [37:40:38<49:25:46,  8.35s/it]
 44%|████▍     | 16643/37963 [37:40:45<48:17:05,  8.15s/it]
 44%|████▍     | 16644/37963 [37:40:53<47:27:18,  8.01s/it]
 44%|████▍     | 16645/37963 [37:41:01<46:54:09,  7.92s/it]
 44%|████▍     | 16646/37963 [37:41:09<46:51:10,  7.91s/it]
 44%|████▍     | 16647/37963 [37:41:16<46:34:31,  7.87s/it]
 44%|████▍     | 16648/37963 [37:41:24<46:04:08,  7.78s/it]
 44%|████▍     | 16649/37963 [37:41:32<46:12:55,  7.81s/it]
 44%|████▍     | 16650/37963 [37:41:39<45:43:17,  7.72s/it]
                                                           
{'loss': '0.1671', 'grad_norm': '0.8789', 'learning_rate': '1.245e-05', 'epoch': '0.4386'}
+
 44%|████▍     | 16650/37963 [37:41:39<45:43:17,  7.72s/it]
 44%|████▍     | 16651/37963 [37:41:47<45:41:46,  7.72s/it]
 44%|████▍     | 16652/37963 [37:41:55<45:31:16,  7.69s/it]
 44%|████▍     | 16653/37963 [37:42:05<49:41:57,  8.40s/it]
 44%|████▍     | 16654/37963 [37:42:13<49:03:27,  8.29s/it]
 44%|████▍     | 16655/37963 [37:42:20<48:02:00,  8.12s/it]
 44%|████▍     | 16656/37963 [37:42:28<47:26:11,  8.01s/it]
 44%|████▍     | 16657/37963 [37:42:36<47:03:30,  7.95s/it]
 44%|████▍     | 16658/37963 [37:42:44<46:24:44,  7.84s/it]
 44%|████▍     | 16659/37963 [37:42:54<51:21:48,  8.68s/it]
 44%|████▍     | 16660/37963 [37:43:02<49:48:42,  8.42s/it]
                                                           
{'loss': '0.1761', 'grad_norm': '1.19', 'learning_rate': '1.244e-05', 'epoch': '0.4388'}
+
 44%|████▍     | 16660/37963 [37:43:02<49:48:42,  8.42s/it]
 44%|████▍     | 16661/37963 [37:43:15<57:13:04,  9.67s/it]
 44%|████▍     | 16662/37963 [37:43:23<54:03:19,  9.14s/it]
 44%|████▍     | 16663/37963 [37:43:30<51:13:03,  8.66s/it]
 44%|████▍     | 16664/37963 [37:43:38<49:50:48,  8.43s/it]
 44%|████▍     | 16665/37963 [37:43:45<48:07:43,  8.14s/it]
 44%|████▍     | 16666/37963 [37:43:53<47:26:07,  8.02s/it]
 44%|████▍     | 16667/37963 [37:44:01<46:28:53,  7.86s/it]
 44%|████▍     | 16668/37963 [37:44:08<46:24:29,  7.85s/it]
 44%|████▍     | 16669/37963 [37:44:16<46:01:51,  7.78s/it]
 44%|████▍     | 16670/37963 [37:44:24<46:05:29,  7.79s/it]
                                                           
{'loss': '0.1586', 'grad_norm': '2.946', 'learning_rate': '1.243e-05', 'epoch': '0.4391'}
+
 44%|████▍     | 16670/37963 [37:44:24<46:05:29,  7.79s/it]
 44%|████▍     | 16671/37963 [37:44:32<46:01:57,  7.78s/it]
 44%|████▍     | 16672/37963 [37:44:40<46:13:05,  7.81s/it]
 44%|████▍     | 16673/37963 [37:44:47<45:53:42,  7.76s/it]
 44%|████▍     | 16674/37963 [37:44:55<45:54:42,  7.76s/it]
 44%|████▍     | 16675/37963 [37:45:03<45:54:16,  7.76s/it]
 44%|████▍     | 16676/37963 [37:45:10<45:48:42,  7.75s/it]
 44%|████▍     | 16677/37963 [37:45:18<45:41:02,  7.73s/it]
 44%|████▍     | 16678/37963 [37:45:26<45:51:35,  7.76s/it]
 44%|████▍     | 16679/37963 [37:45:33<45:32:08,  7.70s/it]
 44%|████▍     | 16680/37963 [37:45:44<49:51:44,  8.43s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '1.567', 'learning_rate': '1.243e-05', 'epoch': '0.4394'}
+
 44%|████▍     | 16680/37963 [37:45:44<49:51:44,  8.43s/it]
 44%|████▍     | 16681/37963 [37:45:54<53:41:39,  9.08s/it]
 44%|████▍     | 16682/37963 [37:46:02<51:15:00,  8.67s/it]
 44%|████▍     | 16683/37963 [37:46:10<49:43:34,  8.41s/it]
 44%|████▍     | 16684/37963 [37:46:18<48:43:29,  8.24s/it]
 44%|████▍     | 16685/37963 [37:46:25<47:28:28,  8.03s/it]
 44%|████▍     | 16686/37963 [37:46:33<46:53:33,  7.93s/it]
 44%|████▍     | 16687/37963 [37:46:43<50:41:10,  8.58s/it]
 44%|████▍     | 16688/37963 [37:46:53<53:44:15,  9.09s/it]
 44%|████▍     | 16689/37963 [37:47:01<51:11:33,  8.66s/it]
 44%|████▍     | 16690/37963 [37:47:08<49:07:34,  8.31s/it]
                                                           
{'loss': '0.159', 'grad_norm': '2.356', 'learning_rate': '1.242e-05', 'epoch': '0.4396'}
+
 44%|████▍     | 16690/37963 [37:47:08<49:07:34,  8.31s/it]
 44%|████▍     | 16691/37963 [37:47:16<47:51:09,  8.10s/it]
 44%|████▍     | 16692/37963 [37:47:24<46:52:40,  7.93s/it]
 44%|████▍     | 16693/37963 [37:47:31<46:25:32,  7.86s/it]
 44%|████▍     | 16694/37963 [37:47:39<45:34:03,  7.71s/it]
 44%|████▍     | 16695/37963 [37:47:47<45:59:35,  7.79s/it]
 44%|████▍     | 16696/37963 [37:47:54<45:44:23,  7.74s/it]
 44%|████▍     | 16697/37963 [37:48:02<45:13:16,  7.66s/it]
 44%|████▍     | 16698/37963 [37:48:09<44:55:05,  7.60s/it]
 44%|████▍     | 16699/37963 [37:48:17<44:52:47,  7.60s/it]
 44%|████▍     | 16700/37963 [37:48:24<45:06:12,  7.64s/it]
                                                           
{'loss': '0.1464', 'grad_norm': '2.006', 'learning_rate': '1.241e-05', 'epoch': '0.4399'}
+
 44%|████▍     | 16700/37963 [37:48:24<45:06:12,  7.64s/it]
 44%|████▍     | 16701/37963 [37:48:32<45:16:07,  7.66s/it]
 44%|████▍     | 16702/37963 [37:48:39<44:33:11,  7.54s/it]
 44%|████▍     | 16703/37963 [37:48:47<44:50:09,  7.59s/it]
 44%|████▍     | 16704/37963 [37:49:00<54:19:15,  9.20s/it]
 44%|████▍     | 16705/37963 [37:49:08<51:31:46,  8.73s/it]
 44%|████▍     | 16706/37963 [37:49:15<49:46:13,  8.43s/it]
 44%|████▍     | 16707/37963 [37:49:26<53:28:59,  9.06s/it]
 44%|████▍     | 16708/37963 [37:49:34<51:12:45,  8.67s/it]
 44%|████▍     | 16709/37963 [37:49:44<54:17:04,  9.19s/it]
 44%|████▍     | 16710/37963 [37:49:52<51:48:31,  8.78s/it]
                                                           
{'loss': '0.1653', 'grad_norm': '2.208', 'learning_rate': '1.24e-05', 'epoch': '0.4402'}
+
 44%|████▍     | 16710/37963 [37:49:52<51:48:31,  8.78s/it]
 44%|████▍     | 16711/37963 [37:50:00<49:44:18,  8.43s/it]
 44%|████▍     | 16712/37963 [37:50:07<48:21:55,  8.19s/it]
 44%|████▍     | 16713/37963 [37:50:15<47:18:30,  8.01s/it]
 44%|████▍     | 16714/37963 [37:50:23<46:50:43,  7.94s/it]
 44%|████▍     | 16715/37963 [37:50:30<45:50:50,  7.77s/it]
 44%|████▍     | 16716/37963 [37:50:38<45:36:49,  7.73s/it]
 44%|████▍     | 16717/37963 [37:50:45<45:19:23,  7.68s/it]
 44%|████▍     | 16718/37963 [37:50:53<45:06:05,  7.64s/it]
 44%|████▍     | 16719/37963 [37:51:00<44:57:22,  7.62s/it]
 44%|████▍     | 16720/37963 [37:51:08<44:48:02,  7.59s/it]
                                                           
{'loss': '0.1766', 'grad_norm': '3.439', 'learning_rate': '1.239e-05', 'epoch': '0.4404'}
+
 44%|████▍     | 16720/37963 [37:51:08<44:48:02,  7.59s/it]
 44%|████▍     | 16721/37963 [37:51:16<45:09:17,  7.65s/it]
 44%|████▍     | 16722/37963 [37:51:23<45:29:44,  7.71s/it]
 44%|████▍     | 16723/37963 [37:51:31<45:24:51,  7.70s/it]
 44%|████▍     | 16724/37963 [37:51:38<44:53:56,  7.61s/it]
 44%|████▍     | 16725/37963 [37:51:46<45:15:11,  7.67s/it]
 44%|████▍     | 16726/37963 [37:51:54<45:32:59,  7.72s/it]
 44%|████▍     | 16727/37963 [37:52:02<45:33:42,  7.72s/it]
 44%|████▍     | 16728/37963 [37:52:10<45:39:59,  7.74s/it]
 44%|████▍     | 16729/37963 [37:52:17<45:49:23,  7.77s/it]
 44%|████▍     | 16730/37963 [37:52:25<45:41:03,  7.75s/it]
                                                           
{'loss': '0.1686', 'grad_norm': '1.62', 'learning_rate': '1.238e-05', 'epoch': '0.4407'}
+
 44%|████▍     | 16730/37963 [37:52:25<45:41:03,  7.75s/it]
 44%|████▍     | 16731/37963 [37:52:33<45:34:44,  7.73s/it]
 44%|████▍     | 16732/37963 [37:52:40<45:21:06,  7.69s/it]
 44%|████▍     | 16733/37963 [37:52:48<45:23:02,  7.70s/it]
 44%|████▍     | 16734/37963 [37:52:58<50:02:08,  8.49s/it]
 44%|████▍     | 16735/37963 [37:53:12<58:14:58,  9.88s/it]
 44%|████▍     | 16736/37963 [37:53:22<58:59:12, 10.00s/it]
 44%|████▍     | 16737/37963 [37:53:30<55:26:18,  9.40s/it]
 44%|████▍     | 16738/37963 [37:53:38<52:23:51,  8.89s/it]
 44%|████▍     | 16739/37963 [37:53:45<50:28:09,  8.56s/it]
 44%|████▍     | 16740/37963 [37:53:53<48:49:13,  8.28s/it]
                                                           
{'loss': '0.1721', 'grad_norm': '1.354', 'learning_rate': '1.238e-05', 'epoch': '0.441'}
+
 44%|████▍     | 16740/37963 [37:53:53<48:49:13,  8.28s/it]
 44%|████▍     | 16741/37963 [37:54:01<47:45:02,  8.10s/it]
 44%|████▍     | 16742/37963 [37:54:08<46:41:55,  7.92s/it]
 44%|████▍     | 16743/37963 [37:54:16<46:13:52,  7.84s/it]
 44%|████▍     | 16744/37963 [37:54:24<46:05:37,  7.82s/it]
 44%|████▍     | 16745/37963 [37:54:32<46:14:20,  7.85s/it]
 44%|████▍     | 16746/37963 [37:54:39<45:12:43,  7.67s/it]
 44%|████▍     | 16747/37963 [37:54:46<44:38:42,  7.58s/it]
 44%|████▍     | 16748/37963 [37:54:54<45:20:43,  7.69s/it]
 44%|████▍     | 16749/37963 [37:55:02<45:12:24,  7.67s/it]
 44%|████▍     | 16750/37963 [37:55:10<45:20:54,  7.70s/it]
                                                           
{'loss': '0.1616', 'grad_norm': '2.526', 'learning_rate': '1.237e-05', 'epoch': '0.4412'}
+
 44%|████▍     | 16750/37963 [37:55:10<45:20:54,  7.70s/it]
 44%|████▍     | 16751/37963 [37:55:20<50:28:13,  8.57s/it]
 44%|████▍     | 16752/37963 [37:55:33<58:25:15,  9.92s/it]
 44%|████▍     | 16753/37963 [37:55:41<54:49:45,  9.31s/it]
 44%|████▍     | 16754/37963 [37:55:49<52:16:17,  8.87s/it]
 44%|████▍     | 16755/37963 [37:55:57<50:32:34,  8.58s/it]
 44%|████▍     | 16756/37963 [37:56:05<49:03:22,  8.33s/it]
 44%|████▍     | 16757/37963 [37:56:12<47:34:11,  8.08s/it]
 44%|████▍     | 16758/37963 [37:56:20<46:49:32,  7.95s/it]
 44%|████▍     | 16759/37963 [37:56:30<50:58:55,  8.66s/it]
 44%|████▍     | 16760/37963 [37:56:38<49:38:51,  8.43s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '3.176', 'learning_rate': '1.236e-05', 'epoch': '0.4415'}
+
 44%|████▍     | 16760/37963 [37:56:38<49:38:51,  8.43s/it]
 44%|████▍     | 16761/37963 [37:56:46<48:24:16,  8.22s/it]
 44%|████▍     | 16762/37963 [37:56:53<47:25:51,  8.05s/it]
 44%|████▍     | 16763/37963 [37:57:01<46:52:31,  7.96s/it]
 44%|████▍     | 16764/37963 [37:57:09<46:46:22,  7.94s/it]
 44%|████▍     | 16765/37963 [37:57:17<46:36:58,  7.92s/it]
 44%|████▍     | 16766/37963 [37:57:25<46:33:15,  7.91s/it]
 44%|████▍     | 16767/37963 [37:57:32<46:07:09,  7.83s/it]
 44%|████▍     | 16768/37963 [37:57:40<46:16:11,  7.86s/it]
 44%|████▍     | 16769/37963 [37:57:48<45:52:22,  7.79s/it]
 44%|████▍     | 16770/37963 [37:57:56<45:36:06,  7.75s/it]
                                                           
{'loss': '0.1704', 'grad_norm': '1.517', 'learning_rate': '1.235e-05', 'epoch': '0.4417'}
+
 44%|████▍     | 16770/37963 [37:57:56<45:36:06,  7.75s/it]
 44%|████▍     | 16771/37963 [37:58:03<45:15:11,  7.69s/it]
 44%|████▍     | 16772/37963 [37:58:11<45:12:59,  7.68s/it]
 44%|████▍     | 16773/37963 [37:58:19<45:53:13,  7.80s/it]
 44%|████▍     | 16774/37963 [37:58:27<46:05:14,  7.83s/it]
 44%|████▍     | 16775/37963 [37:58:35<46:04:34,  7.83s/it]
 44%|████▍     | 16776/37963 [37:58:42<45:38:02,  7.75s/it]
 44%|████▍     | 16777/37963 [37:58:50<45:16:43,  7.69s/it]
 44%|████▍     | 16778/37963 [37:58:57<45:14:24,  7.69s/it]
 44%|████▍     | 16779/37963 [37:59:05<45:04:51,  7.66s/it]
 44%|████▍     | 16780/37963 [37:59:13<45:05:18,  7.66s/it]
                                                           
{'loss': '0.1726', 'grad_norm': '2.9', 'learning_rate': '1.234e-05', 'epoch': '0.442'}
+
 44%|████▍     | 16780/37963 [37:59:13<45:05:18,  7.66s/it]
 44%|████▍     | 16781/37963 [37:59:20<45:04:55,  7.66s/it]
 44%|████▍     | 16782/37963 [37:59:28<45:21:54,  7.71s/it]
 44%|████▍     | 16783/37963 [37:59:41<54:22:30,  9.24s/it]
 44%|████▍     | 16784/37963 [37:59:51<56:06:42,  9.54s/it]
 44%|████▍     | 16785/37963 [37:59:59<52:38:52,  8.95s/it]
 44%|████▍     | 16786/37963 [38:00:06<50:10:35,  8.53s/it]
 44%|████▍     | 16787/37963 [38:00:14<48:28:42,  8.24s/it]
 44%|████▍     | 16788/37963 [38:00:24<51:24:05,  8.74s/it]
 44%|████▍     | 16789/37963 [38:00:32<49:53:13,  8.48s/it]
 44%|████▍     | 16790/37963 [38:00:40<48:54:44,  8.32s/it]
                                                           
{'loss': '0.157', 'grad_norm': '1.677', 'learning_rate': '1.233e-05', 'epoch': '0.4423'}
+
 44%|████▍     | 16790/37963 [38:00:40<48:54:44,  8.32s/it]
 44%|████▍     | 16791/37963 [38:00:47<47:46:33,  8.12s/it]
 44%|████▍     | 16792/37963 [38:00:55<47:09:43,  8.02s/it]
 44%|████▍     | 16793/37963 [38:01:03<46:56:50,  7.98s/it]
 44%|████▍     | 16794/37963 [38:01:11<46:25:03,  7.89s/it]
 44%|████▍     | 16795/37963 [38:01:18<45:51:53,  7.80s/it]
 44%|████▍     | 16796/37963 [38:01:31<54:27:58,  9.26s/it]
 44%|████▍     | 16797/37963 [38:01:39<52:13:18,  8.88s/it]
 44%|████▍     | 16798/37963 [38:01:49<55:00:51,  9.36s/it]
 44%|████▍     | 16799/37963 [38:01:57<51:57:15,  8.84s/it]
 44%|████▍     | 16800/37963 [38:02:05<50:03:34,  8.52s/it]
                                                           
{'loss': '0.1701', 'grad_norm': '3.455', 'learning_rate': '1.233e-05', 'epoch': '0.4425'}
+
 44%|████▍     | 16800/37963 [38:02:05<50:03:34,  8.52s/it]
 44%|████▍     | 16801/37963 [38:02:12<48:25:40,  8.24s/it]
 44%|████▍     | 16802/37963 [38:02:20<47:43:32,  8.12s/it]
 44%|████▍     | 16803/37963 [38:02:31<52:02:34,  8.85s/it]
 44%|████▍     | 16804/37963 [38:02:39<50:20:20,  8.56s/it]
 44%|████▍     | 16805/37963 [38:02:46<48:48:20,  8.30s/it]
 44%|████▍     | 16806/37963 [38:02:54<47:54:31,  8.15s/it]
 44%|████▍     | 16807/37963 [38:03:02<46:50:33,  7.97s/it]
 44%|████▍     | 16808/37963 [38:03:09<46:21:32,  7.89s/it]
 44%|████▍     | 16809/37963 [38:03:17<46:19:48,  7.88s/it]
 44%|████▍     | 16810/37963 [38:03:25<45:54:19,  7.81s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '3.54', 'learning_rate': '1.232e-05', 'epoch': '0.4428'}
+
 44%|████▍     | 16810/37963 [38:03:25<45:54:19,  7.81s/it]
 44%|████▍     | 16811/37963 [38:03:32<45:35:07,  7.76s/it]
 44%|████▍     | 16812/37963 [38:03:40<45:27:17,  7.74s/it]
 44%|████▍     | 16813/37963 [38:03:48<45:45:41,  7.79s/it]
 44%|████▍     | 16814/37963 [38:03:56<45:12:10,  7.69s/it]
 44%|████▍     | 16815/37963 [38:04:03<45:13:11,  7.70s/it]
 44%|████▍     | 16816/37963 [38:04:11<45:30:58,  7.75s/it]
 44%|████▍     | 16817/37963 [38:04:19<45:27:57,  7.74s/it]
 44%|████▍     | 16818/37963 [38:04:26<44:56:39,  7.65s/it]
 44%|████▍     | 16819/37963 [38:04:34<45:06:42,  7.68s/it]
 44%|████▍     | 16820/37963 [38:04:42<45:18:00,  7.71s/it]
                                                           
{'loss': '0.1576', 'grad_norm': '2.182', 'learning_rate': '1.231e-05', 'epoch': '0.4431'}
+
 44%|████▍     | 16820/37963 [38:04:42<45:18:00,  7.71s/it]
 44%|████▍     | 16821/37963 [38:04:49<45:06:30,  7.68s/it]
 44%|████▍     | 16822/37963 [38:04:57<45:43:09,  7.79s/it]
 44%|████▍     | 16823/37963 [38:05:05<45:25:44,  7.74s/it]
 44%|████▍     | 16824/37963 [38:05:13<45:04:05,  7.68s/it]
 44%|████▍     | 16825/37963 [38:05:20<44:37:35,  7.60s/it]
 44%|████▍     | 16826/37963 [38:05:28<44:38:48,  7.60s/it]
 44%|████▍     | 16827/37963 [38:05:38<48:57:24,  8.34s/it]
 44%|████▍     | 16828/37963 [38:05:46<48:13:14,  8.21s/it]
 44%|████▍     | 16829/37963 [38:05:53<47:24:30,  8.08s/it]
 44%|████▍     | 16830/37963 [38:06:01<46:51:47,  7.98s/it]
                                                           
{'loss': '0.1699', 'grad_norm': '0.9301', 'learning_rate': '1.23e-05', 'epoch': '0.4433'}
+
 44%|████▍     | 16830/37963 [38:06:01<46:51:47,  7.98s/it]
 44%|████▍     | 16831/37963 [38:06:09<46:23:40,  7.90s/it]
 44%|████▍     | 16832/37963 [38:06:19<50:37:52,  8.63s/it]
 44%|████▍     | 16833/37963 [38:06:27<49:29:47,  8.43s/it]
 44%|████▍     | 16834/37963 [38:06:35<48:20:42,  8.24s/it]
 44%|████▍     | 16835/37963 [38:06:45<52:25:20,  8.93s/it]
 44%|████▍     | 16836/37963 [38:06:53<50:30:56,  8.61s/it]
 44%|████▍     | 16837/37963 [38:07:04<53:18:34,  9.08s/it]
 44%|████▍     | 16838/37963 [38:07:11<51:05:01,  8.71s/it]
 44%|████▍     | 16839/37963 [38:07:19<49:15:43,  8.40s/it]
 44%|████▍     | 16840/37963 [38:07:27<47:44:04,  8.14s/it]
                                                           
{'loss': '0.1554', 'grad_norm': '2.796', 'learning_rate': '1.229e-05', 'epoch': '0.4436'}
+
 44%|████▍     | 16840/37963 [38:07:27<47:44:04,  8.14s/it]
 44%|████▍     | 16841/37963 [38:07:37<51:42:53,  8.81s/it]
 44%|████▍     | 16842/37963 [38:07:44<49:10:28,  8.38s/it]
 44%|████▍     | 16843/37963 [38:07:52<47:59:05,  8.18s/it]
 44%|████▍     | 16844/37963 [38:08:00<47:00:04,  8.01s/it]
 44%|████▍     | 16845/37963 [38:08:08<46:42:02,  7.96s/it]
 44%|████▍     | 16846/37963 [38:08:15<46:20:44,  7.90s/it]
 44%|████▍     | 16847/37963 [38:08:23<46:10:16,  7.87s/it]
 44%|████▍     | 16848/37963 [38:08:34<50:54:08,  8.68s/it]
 44%|████▍     | 16849/37963 [38:08:42<49:46:54,  8.49s/it]
 44%|████▍     | 16850/37963 [38:08:52<52:11:11,  8.90s/it]
                                                           
{'loss': '0.1465', 'grad_norm': '1.085', 'learning_rate': '1.228e-05', 'epoch': '0.4439'}
+
 44%|████▍     | 16850/37963 [38:08:52<52:11:11,  8.90s/it]
 44%|████▍     | 16851/37963 [38:09:01<53:35:53,  9.14s/it]
 44%|████▍     | 16852/37963 [38:09:09<51:21:19,  8.76s/it]
 44%|████▍     | 16853/37963 [38:09:17<49:22:26,  8.42s/it]
 44%|████▍     | 16854/37963 [38:09:24<47:48:51,  8.15s/it]
 44%|████▍     | 16855/37963 [38:09:32<46:31:27,  7.93s/it]
 44%|████▍     | 16856/37963 [38:09:40<46:31:37,  7.94s/it]
 44%|████▍     | 16857/37963 [38:09:47<46:23:09,  7.91s/it]
 44%|████▍     | 16858/37963 [38:09:55<45:45:34,  7.81s/it]
 44%|████▍     | 16859/37963 [38:10:03<45:57:25,  7.84s/it]
 44%|████▍     | 16860/37963 [38:10:11<45:43:01,  7.80s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '1.705', 'learning_rate': '1.228e-05', 'epoch': '0.4441'}
+
 44%|████▍     | 16860/37963 [38:10:11<45:43:01,  7.80s/it]
 44%|████▍     | 16861/37963 [38:10:18<45:18:56,  7.73s/it]
 44%|████▍     | 16862/37963 [38:10:26<45:34:25,  7.78s/it]
 44%|████▍     | 16863/37963 [38:10:34<45:31:35,  7.77s/it]
 44%|████▍     | 16864/37963 [38:10:42<45:22:00,  7.74s/it]
 44%|████▍     | 16865/37963 [38:10:49<44:36:34,  7.61s/it]
 44%|████▍     | 16866/37963 [38:10:56<44:16:06,  7.55s/it]
 44%|████▍     | 16867/37963 [38:11:04<44:10:27,  7.54s/it]
 44%|████▍     | 16868/37963 [38:11:11<43:59:17,  7.51s/it]
 44%|████▍     | 16869/37963 [38:11:19<44:11:21,  7.54s/it]
 44%|████▍     | 16870/37963 [38:11:27<44:38:18,  7.62s/it]
                                                           
{'loss': '0.1611', 'grad_norm': '4.113', 'learning_rate': '1.227e-05', 'epoch': '0.4444'}
+
 44%|████▍     | 16870/37963 [38:11:27<44:38:18,  7.62s/it]
 44%|████▍     | 16871/37963 [38:11:35<45:05:51,  7.70s/it]
 44%|████▍     | 16872/37963 [38:11:42<44:54:58,  7.67s/it]
 44%|████▍     | 16873/37963 [38:11:50<44:50:03,  7.65s/it]
 44%|████▍     | 16874/37963 [38:11:58<45:10:04,  7.71s/it]
 44%|████▍     | 16875/37963 [38:12:06<45:44:47,  7.81s/it]
 44%|████▍     | 16876/37963 [38:12:13<45:16:07,  7.73s/it]
 44%|████▍     | 16877/37963 [38:12:24<50:06:40,  8.56s/it]
 44%|████▍     | 16878/37963 [38:12:31<48:43:44,  8.32s/it]
 44%|████▍     | 16879/37963 [38:12:39<48:14:45,  8.24s/it]
 44%|████▍     | 16880/37963 [38:12:47<46:50:54,  8.00s/it]
                                                           
{'loss': '0.1639', 'grad_norm': '1.743', 'learning_rate': '1.226e-05', 'epoch': '0.4446'}
+
 44%|████▍     | 16880/37963 [38:12:47<46:50:54,  8.00s/it]
 44%|████▍     | 16881/37963 [38:12:55<46:41:13,  7.97s/it]
 44%|████▍     | 16882/37963 [38:13:05<50:50:12,  8.68s/it]
 44%|████▍     | 16883/37963 [38:13:13<48:57:45,  8.36s/it]
 44%|████▍     | 16884/37963 [38:13:23<52:17:27,  8.93s/it]
 44%|████▍     | 16885/37963 [38:13:34<55:08:54,  9.42s/it]
 44%|████▍     | 16886/37963 [38:13:44<56:22:19,  9.63s/it]
 44%|████▍     | 16887/37963 [38:13:51<52:25:44,  8.96s/it]
 44%|████▍     | 16888/37963 [38:13:59<50:47:57,  8.68s/it]
 44%|████▍     | 16889/37963 [38:14:07<48:55:27,  8.36s/it]
 44%|████▍     | 16890/37963 [38:14:14<47:15:14,  8.07s/it]
                                                           
{'loss': '0.161', 'grad_norm': '3.04', 'learning_rate': '1.225e-05', 'epoch': '0.4449'}
+
 44%|████▍     | 16890/37963 [38:14:14<47:15:14,  8.07s/it]
 44%|████▍     | 16891/37963 [38:14:22<46:44:49,  7.99s/it]
 44%|████▍     | 16892/37963 [38:14:30<46:24:54,  7.93s/it]
 44%|████▍     | 16893/37963 [38:14:37<46:02:27,  7.87s/it]
 45%|████▍     | 16894/37963 [38:14:45<45:46:35,  7.82s/it]
 45%|████▍     | 16895/37963 [38:14:53<45:16:29,  7.74s/it]
 45%|████▍     | 16896/37963 [38:15:03<50:18:34,  8.60s/it]
 45%|████▍     | 16897/37963 [38:15:11<48:45:50,  8.33s/it]
 45%|████▍     | 16898/37963 [38:15:24<57:03:56,  9.75s/it]
 45%|████▍     | 16899/37963 [38:15:32<53:37:40,  9.17s/it]
 45%|████▍     | 16900/37963 [38:15:39<50:53:58,  8.70s/it]
                                                           
{'loss': '0.1566', 'grad_norm': '1.531', 'learning_rate': '1.224e-05', 'epoch': '0.4452'}
+
 45%|████▍     | 16900/37963 [38:15:39<50:53:58,  8.70s/it]
 45%|████▍     | 16901/37963 [38:15:47<48:53:53,  8.36s/it]
 45%|████▍     | 16902/37963 [38:15:55<47:40:30,  8.15s/it]
 45%|████▍     | 16903/37963 [38:16:02<46:44:47,  7.99s/it]
 45%|████▍     | 16904/37963 [38:16:10<45:57:32,  7.86s/it]
 45%|████▍     | 16905/37963 [38:16:18<45:41:52,  7.81s/it]
 45%|████▍     | 16906/37963 [38:16:25<45:32:28,  7.79s/it]
 45%|████▍     | 16907/37963 [38:16:33<44:53:04,  7.67s/it]
 45%|████▍     | 16908/37963 [38:16:40<45:02:56,  7.70s/it]
 45%|████▍     | 16909/37963 [38:16:48<45:01:32,  7.70s/it]
 45%|████▍     | 16910/37963 [38:16:56<44:46:18,  7.66s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '2.054', 'learning_rate': '1.223e-05', 'epoch': '0.4454'}
+
 45%|████▍     | 16910/37963 [38:16:56<44:46:18,  7.66s/it]
 45%|████▍     | 16911/37963 [38:17:04<45:02:38,  7.70s/it]
 45%|████▍     | 16912/37963 [38:17:11<44:47:51,  7.66s/it]
 45%|████▍     | 16913/37963 [38:17:19<44:53:05,  7.68s/it]
 45%|████▍     | 16914/37963 [38:17:26<44:36:33,  7.63s/it]
 45%|████▍     | 16915/37963 [38:17:34<45:11:35,  7.73s/it]
 45%|████▍     | 16916/37963 [38:17:42<45:00:57,  7.70s/it]
 45%|████▍     | 16917/37963 [38:17:50<45:06:39,  7.72s/it]
 45%|████▍     | 16918/37963 [38:17:57<45:11:16,  7.73s/it]
 45%|████▍     | 16919/37963 [38:18:05<45:06:28,  7.72s/it]
 45%|████▍     | 16920/37963 [38:18:13<45:12:33,  7.73s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '1.471', 'learning_rate': '1.223e-05', 'epoch': '0.4457'}
+
 45%|████▍     | 16920/37963 [38:18:13<45:12:33,  7.73s/it]
 45%|████▍     | 16921/37963 [38:18:21<44:59:25,  7.70s/it]
 45%|████▍     | 16922/37963 [38:18:28<44:48:01,  7.67s/it]
 45%|████▍     | 16923/37963 [38:18:36<44:39:23,  7.64s/it]
 45%|████▍     | 16924/37963 [38:18:46<49:38:25,  8.49s/it]
 45%|████▍     | 16925/37963 [38:18:54<48:15:39,  8.26s/it]
 45%|████▍     | 16926/37963 [38:19:02<47:37:34,  8.15s/it]
 45%|████▍     | 16927/37963 [38:19:09<46:49:06,  8.01s/it]
 45%|████▍     | 16928/37963 [38:19:20<51:03:23,  8.74s/it]
 45%|████▍     | 16929/37963 [38:19:28<49:26:39,  8.46s/it]
 45%|████▍     | 16930/37963 [38:19:36<48:51:23,  8.36s/it]
                                                           
{'loss': '0.1526', 'grad_norm': '2.686', 'learning_rate': '1.222e-05', 'epoch': '0.446'}
+
 45%|████▍     | 16930/37963 [38:19:36<48:51:23,  8.36s/it]
 45%|████▍     | 16931/37963 [38:19:46<52:24:27,  8.97s/it]
 45%|████▍     | 16932/37963 [38:19:54<50:36:59,  8.66s/it]
 45%|████▍     | 16933/37963 [38:20:04<53:19:10,  9.13s/it]
 45%|████▍     | 16934/37963 [38:20:15<55:33:18,  9.51s/it]
 45%|████▍     | 16935/37963 [38:20:22<52:18:33,  8.96s/it]
 45%|████▍     | 16936/37963 [38:20:30<49:57:14,  8.55s/it]
 45%|████▍     | 16937/37963 [38:20:38<48:27:56,  8.30s/it]
 45%|████▍     | 16938/37963 [38:20:46<47:28:13,  8.13s/it]
 45%|█��██▍     | 16939/37963 [38:20:53<46:11:05,  7.91s/it]
 45%|████▍     | 16940/37963 [38:21:01<45:53:10,  7.86s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '3.81', 'learning_rate': '1.221e-05', 'epoch': '0.4462'}
+
 45%|████▍     | 16940/37963 [38:21:01<45:53:10,  7.86s/it]
 45%|████▍     | 16941/37963 [38:21:08<45:38:15,  7.82s/it]
 45%|████▍     | 16942/37963 [38:21:16<45:33:38,  7.80s/it]
 45%|████▍     | 16943/37963 [38:21:24<45:26:01,  7.78s/it]
 45%|████▍     | 16944/37963 [38:21:31<45:00:05,  7.71s/it]
 45%|████▍     | 16945/37963 [38:21:39<45:04:58,  7.72s/it]
 45%|████▍     | 16946/37963 [38:21:47<45:01:37,  7.71s/it]
 45%|████▍     | 16947/37963 [38:21:54<44:46:12,  7.67s/it]
 45%|████▍     | 16948/37963 [38:22:02<44:49:45,  7.68s/it]
 45%|████▍     | 16949/37963 [38:22:10<44:44:17,  7.66s/it]
 45%|████▍     | 16950/37963 [38:22:20<49:30:55,  8.48s/it]
                                                           
{'loss': '0.1727', 'grad_norm': '4.578', 'learning_rate': '1.22e-05', 'epoch': '0.4465'}
+
 45%|████▍     | 16950/37963 [38:22:20<49:30:55,  8.48s/it]
 45%|████▍     | 16951/37963 [38:22:30<52:18:12,  8.96s/it]
 45%|████▍     | 16952/37963 [38:22:40<54:36:24,  9.36s/it]
 45%|████▍     | 16953/37963 [38:22:48<51:38:16,  8.85s/it]
 45%|████▍     | 16954/37963 [38:22:56<49:37:35,  8.50s/it]
 45%|████▍     | 16955/37963 [38:23:03<47:28:56,  8.14s/it]
 45%|████▍     | 16956/37963 [38:23:11<46:50:28,  8.03s/it]
 45%|████▍     | 16957/37963 [38:23:19<46:21:51,  7.95s/it]
 45%|████▍     | 16958/37963 [38:23:26<45:49:48,  7.85s/it]
 45%|████▍     | 16959/37963 [38:23:34<45:48:10,  7.85s/it]
 45%|████▍     | 16960/37963 [38:23:42<45:50:57,  7.86s/it]
                                                           
{'loss': '0.1652', 'grad_norm': '1.232', 'learning_rate': '1.219e-05', 'epoch': '0.4468'}
+
 45%|████▍     | 16960/37963 [38:23:42<45:50:57,  7.86s/it]
 45%|████▍     | 16961/37963 [38:23:50<45:39:40,  7.83s/it]
 45%|████▍     | 16962/37963 [38:23:58<45:48:28,  7.85s/it]
 45%|████▍     | 16963/37963 [38:24:06<46:03:31,  7.90s/it]
 45%|████▍     | 16964/37963 [38:24:13<45:45:20,  7.84s/it]
 45%|████▍     | 16965/37963 [38:24:21<44:36:30,  7.65s/it]
 45%|████▍     | 16966/37963 [38:24:28<44:27:25,  7.62s/it]
 45%|████▍     | 16967/37963 [38:24:36<44:51:38,  7.69s/it]
 45%|████▍     | 16968/37963 [38:24:44<45:05:47,  7.73s/it]
 45%|████▍     | 16969/37963 [38:24:52<45:23:19,  7.78s/it]
 45%|████▍     | 16970/37963 [38:25:02<49:42:22,  8.52s/it]
                                                           
{'loss': '0.16', 'grad_norm': '0.987', 'learning_rate': '1.219e-05', 'epoch': '0.447'}
+
 45%|████▍     | 16970/37963 [38:25:02<49:42:22,  8.52s/it]
 45%|████▍     | 16971/37963 [38:25:10<48:00:42,  8.23s/it]
 45%|████▍     | 16972/37963 [38:25:17<47:00:36,  8.06s/it]
 45%|████▍     | 16973/37963 [38:25:25<46:17:11,  7.94s/it]
 45%|████▍     | 16974/37963 [38:25:33<46:00:18,  7.89s/it]
 45%|████▍     | 16975/37963 [38:25:40<45:09:40,  7.75s/it]
 45%|████▍     | 16976/37963 [38:25:50<49:50:15,  8.55s/it]
 45%|████▍     | 16977/37963 [38:25:58<48:53:54,  8.39s/it]
 45%|████▍     | 16978/37963 [38:26:06<48:11:26,  8.27s/it]
 45%|████▍     | 16979/37963 [38:26:14<47:07:36,  8.09s/it]
 45%|████▍     | 16980/37963 [38:26:22<46:34:40,  7.99s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '2.409', 'learning_rate': '1.218e-05', 'epoch': '0.4473'}
+
 45%|████▍     | 16980/37963 [38:26:22<46:34:40,  7.99s/it]
 45%|████▍     | 16981/37963 [38:26:30<46:11:07,  7.92s/it]
 45%|████▍     | 16982/37963 [38:26:40<50:13:51,  8.62s/it]
 45%|████▍     | 16983/37963 [38:26:48<48:37:12,  8.34s/it]
 45%|████▍     | 16984/37963 [38:26:56<47:55:33,  8.22s/it]
 45%|████▍     | 16985/37963 [38:27:03<47:00:21,  8.07s/it]
 45%|████▍     | 16986/37963 [38:27:11<46:20:24,  7.95s/it]
 45%|████▍     | 16987/37963 [38:27:21<49:40:01,  8.52s/it]
 45%|████▍     | 16988/37963 [38:27:31<52:31:52,  9.02s/it]
 45%|████▍     | 16989/37963 [38:27:39<50:27:35,  8.66s/it]
 45%|████▍     | 16990/37963 [38:27:47<48:51:14,  8.39s/it]
                                                           
{'loss': '0.164', 'grad_norm': '3.942', 'learning_rate': '1.217e-05', 'epoch': '0.4475'}
+
 45%|████▍     | 16990/37963 [38:27:47<48:51:14,  8.39s/it]
 45%|████▍     | 16991/37963 [38:27:54<47:34:05,  8.17s/it]
 45%|████▍     | 16992/37963 [38:28:02<46:42:22,  8.02s/it]
 45%|████▍     | 16993/37963 [38:28:10<46:20:30,  7.96s/it]
 45%|████▍     | 16994/37963 [38:28:17<45:40:54,  7.84s/it]
 45%|████▍     | 16995/37963 [38:28:25<45:30:56,  7.81s/it]
 45%|████▍     | 16996/37963 [38:28:35<50:00:07,  8.59s/it]
 45%|████▍     | 16997/37963 [38:28:46<52:56:31,  9.09s/it]
 45%|████▍     | 16998/37963 [38:28:54<50:51:49,  8.73s/it]
 45%|████▍     | 16999/37963 [38:29:04<53:47:17,  9.24s/it]
 45%|████▍     | 17000/37963 [38:29:12<50:56:29,  8.75s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '0.8299', 'learning_rate': '1.216e-05', 'epoch': '0.4478'}
+
 45%|████▍     | 17000/37963 [38:29:12<50:56:29,  8.75s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.22s/it]
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.22s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 45%|████▍     | 17001/37963 [38:30:18<150:58:36, 25.93s/it]
 45%|████▍     | 17002/37963 [38:30:25<119:23:37, 20.51s/it]
 45%|████▍     | 17003/37963 [38:30:33<97:36:32, 16.76s/it] 
 45%|████▍     | 17004/37963 [38:30:41<81:41:16, 14.03s/it]
 45%|████▍     | 17005/37963 [38:30:49<70:32:15, 12.12s/it]
 45%|████▍     | 17006/37963 [38:30:56<62:35:13, 10.75s/it]
 45%|████▍     | 17007/37963 [38:31:04<57:09:03,  9.82s/it]
 45%|████▍     | 17008/37963 [38:31:12<53:31:34,  9.20s/it]
 45%|████▍     | 17009/37963 [38:31:19<50:48:12,  8.73s/it]
 45%|████▍     | 17010/37963 [38:31:27<49:06:04,  8.44s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '2.573', 'learning_rate': '1.215e-05', 'epoch': '0.4481'}
+
 45%|████▍     | 17010/37963 [38:31:27<49:06:04,  8.44s/it]
 45%|████▍     | 17011/37963 [38:31:35<48:05:03,  8.26s/it]
 45%|████▍     | 17012/37963 [38:31:43<46:58:23,  8.07s/it]
 45%|████▍     | 17013/37963 [38:31:50<46:11:15,  7.94s/it]
 45%|████▍     | 17014/37963 [38:31:58<45:39:21,  7.85s/it]
 45%|████▍     | 17015/37963 [38:32:06<45:50:19,  7.88s/it]
 45%|████▍     | 17016/37963 [38:32:14<45:52:38,  7.88s/it]
 45%|████▍     | 17017/37963 [38:32:24<49:52:00,  8.57s/it]
 45%|████▍     | 17018/37963 [38:32:32<48:36:15,  8.35s/it]
 45%|████▍     | 17019/37963 [38:32:39<47:18:35,  8.13s/it]
 45%|████▍     | 17020/37963 [38:32:47<46:29:38,  7.99s/it]
                                                           
{'loss': '0.1585', 'grad_norm': '3.339', 'learning_rate': '1.214e-05', 'epoch': '0.4483'}
+
 45%|████▍     | 17020/37963 [38:32:47<46:29:38,  7.99s/it]
 45%|████▍     | 17021/37963 [38:32:55<46:01:03,  7.91s/it]
 45%|████▍     | 17022/37963 [38:33:02<45:37:03,  7.84s/it]
 45%|████▍     | 17023/37963 [38:33:10<45:38:14,  7.85s/it]
 45%|████▍     | 17024/37963 [38:33:18<45:22:34,  7.80s/it]
 45%|████▍     | 17025/37963 [38:33:25<44:41:01,  7.68s/it]
 45%|████▍     | 17026/37963 [38:33:36<49:57:04,  8.59s/it]
 45%|████▍     | 17027/37963 [38:33:44<48:34:56,  8.35s/it]
 45%|████▍     | 17028/37963 [38:33:52<47:31:59,  8.17s/it]
 45%|████▍     | 17029/37963 [38:33:59<46:26:13,  7.99s/it]
 45%|████▍     | 17030/37963 [38:34:07<45:37:12,  7.85s/it]
                                                           
{'loss': '0.1679', 'grad_norm': '3.663', 'learning_rate': '1.214e-05', 'epoch': '0.4486'}
+
 45%|████▍     | 17030/37963 [38:34:07<45:37:12,  7.85s/it]
 45%|████▍     | 17031/37963 [38:34:15<45:33:16,  7.83s/it]
 45%|████▍     | 17032/37963 [38:34:25<49:21:29,  8.49s/it]
 45%|████▍     | 17033/37963 [38:34:32<47:56:18,  8.25s/it]
 45%|████▍     | 17034/37963 [38:34:40<46:45:38,  8.04s/it]
 45%|████▍     | 17035/37963 [38:34:47<46:04:45,  7.93s/it]
 45%|████▍     | 17036/37963 [38:34:55<45:07:54,  7.76s/it]
 45%|████▍     | 17037/37963 [38:35:05<50:03:22,  8.61s/it]
 45%|████▍     | 17038/37963 [38:35:13<48:24:07,  8.33s/it]
 45%|████▍     | 17039/37963 [38:35:23<51:45:42,  8.91s/it]
 45%|████▍     | 17040/37963 [38:35:34<54:34:13,  9.39s/it]
                                                           
{'loss': '0.1635', 'grad_norm': '1.141', 'learning_rate': '1.213e-05', 'epoch': '0.4489'}
+
 45%|████▍     | 17040/37963 [38:35:34<54:34:13,  9.39s/it]
 45%|████▍     | 17041/37963 [38:35:41<51:24:55,  8.85s/it]
 45%|████▍     | 17042/37963 [38:35:49<49:10:50,  8.46s/it]
 45%|████▍     | 17043/37963 [38:35:56<47:06:44,  8.11s/it]
 45%|████▍     | 17044/37963 [38:36:04<46:18:03,  7.97s/it]
 45%|████▍     | 17045/37963 [38:36:12<45:40:12,  7.86s/it]
 45%|████▍     | 17046/37963 [38:36:19<44:57:56,  7.74s/it]
 45%|████▍     | 17047/37963 [38:36:27<44:45:06,  7.70s/it]
 45%|████▍     | 17048/37963 [38:36:37<49:10:27,  8.46s/it]
 45%|████▍     | 17049/37963 [38:36:44<47:25:11,  8.16s/it]
 45%|████▍     | 17050/37963 [38:36:52<46:23:01,  7.98s/it]
                                                           
{'loss': '0.1681', 'grad_norm': '1.386', 'learning_rate': '1.212e-05', 'epoch': '0.4491'}
+
 45%|████▍     | 17050/37963 [38:36:52<46:23:01,  7.98s/it]
 45%|████▍     | 17051/37963 [38:37:02<50:43:13,  8.73s/it]
 45%|████▍     | 17052/37963 [38:37:10<49:05:35,  8.45s/it]
 45%|████▍     | 17053/37963 [38:37:18<47:44:45,  8.22s/it]
 45%|████▍     | 17054/37963 [38:37:25<46:16:24,  7.97s/it]
 45%|████▍     | 17055/37963 [38:37:33<45:10:35,  7.78s/it]
 45%|████▍     | 17056/37963 [38:37:40<45:01:14,  7.75s/it]
 45%|████▍     | 17057/37963 [38:37:48<45:04:11,  7.76s/it]
 45%|████▍     | 17058/37963 [38:37:55<44:35:00,  7.68s/it]
 45%|████▍     | 17059/37963 [38:38:03<44:24:50,  7.65s/it]
 45%|████▍     | 17060/37963 [38:38:11<44:24:06,  7.65s/it]
                                                           
{'loss': '0.1655', 'grad_norm': '5.228', 'learning_rate': '1.211e-05', 'epoch': '0.4494'}
+
 45%|████▍     | 17060/37963 [38:38:11<44:24:06,  7.65s/it]
 45%|████▍     | 17061/37963 [38:38:19<44:47:51,  7.72s/it]
 45%|████▍     | 17062/37963 [38:38:26<44:13:27,  7.62s/it]
 45%|████▍     | 17063/37963 [38:38:36<48:30:56,  8.36s/it]
 45%|████▍     | 17064/37963 [38:38:44<47:57:54,  8.26s/it]
 45%|████▍     | 17065/37963 [38:38:52<46:38:14,  8.03s/it]
 45%|████▍     | 17066/37963 [38:39:00<46:25:17,  8.00s/it]
 45%|████▍     | 17067/37963 [38:39:07<45:19:21,  7.81s/it]
 45%|████▍     | 17068/37963 [38:39:15<45:05:41,  7.77s/it]
 45%|████▍     | 17069/37963 [38:39:22<45:00:06,  7.75s/it]
 45%|████▍     | 17070/37963 [38:39:30<44:55:31,  7.74s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '1.352', 'learning_rate': '1.21e-05', 'epoch': '0.4496'}
+
 45%|████▍     | 17070/37963 [38:39:30<44:55:31,  7.74s/it]
 45%|████▍     | 17071/37963 [38:39:38<45:10:56,  7.79s/it]
 45%|████▍     | 17072/37963 [38:39:46<45:10:26,  7.78s/it]
 45%|████▍     | 17073/37963 [38:39:54<45:16:22,  7.80s/it]
 45%|████▍     | 17074/37963 [38:40:04<49:55:35,  8.60s/it]
 45%|████▍     | 17075/37963 [38:40:12<48:29:31,  8.36s/it]
 45%|████▍     | 17076/37963 [38:40:19<47:23:07,  8.17s/it]
 45%|████▍     | 17077/37963 [38:40:27<46:45:13,  8.06s/it]
 45%|████▍     | 17078/37963 [38:40:35<46:09:57,  7.96s/it]
 45%|████▍     | 17079/37963 [38:40:43<45:42:18,  7.88s/it]
 45%|████▍     | 17080/37963 [38:40:50<45:15:23,  7.80s/it]
                                                           
{'loss': '0.1495', 'grad_norm': '1.764', 'learning_rate': '1.209e-05', 'epoch': '0.4499'}
+
 45%|████▍     | 17080/37963 [38:40:50<45:15:23,  7.80s/it]
 45%|████▍     | 17081/37963 [38:41:01<49:58:26,  8.62s/it]
 45%|████▍     | 17082/37963 [38:41:09<49:00:29,  8.45s/it]
 45%|████▍     | 17083/37963 [38:41:19<52:14:28,  9.01s/it]
 45%|████▌     | 17084/37963 [38:41:27<50:04:44,  8.63s/it]
 45%|████▌     | 17085/37963 [38:41:34<47:59:23,  8.27s/it]
 45%|████▌     | 17086/37963 [38:41:45<52:10:41,  9.00s/it]
 45%|████▌     | 17087/37963 [38:41:53<49:46:58,  8.58s/it]
 45%|████▌     | 17088/37963 [38:42:03<53:06:03,  9.16s/it]
 45%|████▌     | 17089/37963 [38:42:11<51:13:51,  8.84s/it]
 45%|████▌     | 17090/37963 [38:42:19<49:08:23,  8.48s/it]
                                                           
{'loss': '0.1668', 'grad_norm': '3.213', 'learning_rate': '1.209e-05', 'epoch': '0.4502'}
+
 45%|████▌     | 17090/37963 [38:42:19<49:08:23,  8.48s/it]
 45%|████▌     | 17091/37963 [38:42:27<48:08:34,  8.30s/it]
 45%|████▌     | 17092/37963 [38:42:35<47:50:19,  8.25s/it]
 45%|████▌     | 17093/37963 [38:42:43<47:09:28,  8.13s/it]
 45%|████▌     | 17094/37963 [38:42:53<51:14:08,  8.84s/it]
 45%|████▌     | 17095/37963 [38:43:01<49:26:53,  8.53s/it]
 45%|████▌     | 17096/37963 [38:43:09<48:15:26,  8.33s/it]
 45%|████▌     | 17097/37963 [38:43:17<47:00:18,  8.11s/it]
 45%|████▌     | 17098/37963 [38:43:24<46:32:37,  8.03s/it]
 45%|████▌     | 17099/37963 [38:43:32<45:46:11,  7.90s/it]
 45%|████▌     | 17100/37963 [38:43:40<45:13:58,  7.81s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '2.14', 'learning_rate': '1.208e-05', 'epoch': '0.4504'}
+
 45%|████▌     | 17100/37963 [38:43:40<45:13:58,  7.81s/it]
 45%|████▌     | 17101/37963 [38:43:48<45:25:11,  7.84s/it]
 45%|████▌     | 17102/37963 [38:43:58<49:30:18,  8.54s/it]
 45%|████▌     | 17103/37963 [38:44:05<47:59:09,  8.28s/it]
 45%|████▌     | 17104/37963 [38:44:13<46:18:44,  7.99s/it]
 45%|████▌     | 17105/37963 [38:44:20<45:39:17,  7.88s/it]
 45%|████▌     | 17106/37963 [38:44:28<45:10:29,  7.80s/it]
 45%|████▌     | 17107/37963 [38:44:36<45:11:12,  7.80s/it]
 45%|████▌     | 17108/37963 [38:44:44<45:19:15,  7.82s/it]
 45%|████▌     | 17109/37963 [38:44:51<45:03:52,  7.78s/it]
 45%|████▌     | 17110/37963 [38:44:59<45:11:17,  7.80s/it]
                                                           
{'loss': '0.1711', 'grad_norm': '4.454', 'learning_rate': '1.207e-05', 'epoch': '0.4507'}
+
 45%|████▌     | 17110/37963 [38:44:59<45:11:17,  7.80s/it]
 45%|████▌     | 17111/37963 [38:45:07<44:49:32,  7.74s/it]
 45%|████▌     | 17112/37963 [38:45:14<44:17:19,  7.65s/it]
 45%|████▌     | 17113/37963 [38:45:22<44:22:12,  7.66s/it]
 45%|████▌     | 17114/37963 [38:45:30<44:36:52,  7.70s/it]
 45%|████▌     | 17115/37963 [38:45:37<44:25:59,  7.67s/it]
 45%|████▌     | 17116/37963 [38:45:45<44:17:57,  7.65s/it]
 45%|████▌     | 17117/37963 [38:45:55<48:49:39,  8.43s/it]
 45%|████▌     | 17118/37963 [38:46:03<47:58:29,  8.29s/it]
 45%|████▌     | 17119/37963 [38:46:11<46:32:07,  8.04s/it]
 45%|████▌     | 17120/37963 [38:46:21<50:59:09,  8.81s/it]
                                                           
{'loss': '0.1645', 'grad_norm': '2.02', 'learning_rate': '1.206e-05', 'epoch': '0.451'}
+
 45%|████▌     | 17120/37963 [38:46:21<50:59:09,  8.81s/it]
 45%|████▌     | 17121/37963 [38:46:29<49:15:19,  8.51s/it]
 45%|████▌     | 17122/37963 [38:46:37<48:07:44,  8.31s/it]
 45%|████▌     | 17123/37963 [38:46:44<46:47:41,  8.08s/it]
 45%|████▌     | 17124/37963 [38:46:52<46:06:32,  7.97s/it]
 45%|████▌     | 17125/37963 [38:46:59<44:58:10,  7.77s/it]
 45%|████▌     | 17126/37963 [38:47:07<44:12:58,  7.64s/it]
 45%|████▌     | 17127/37963 [38:47:14<44:12:11,  7.64s/it]
 45%|████▌     | 17128/37963 [38:47:22<44:23:22,  7.67s/it]
 45%|████▌     | 17129/37963 [38:47:32<48:47:24,  8.43s/it]
 45%|████▌     | 17130/37963 [38:47:40<47:09:58,  8.15s/it]
                                                           
{'loss': '0.1584', 'grad_norm': '4.519', 'learning_rate': '1.205e-05', 'epoch': '0.4512'}
+
 45%|████▌     | 17130/37963 [38:47:40<47:09:58,  8.15s/it]
 45%|████▌     | 17131/37963 [38:47:47<46:26:39,  8.03s/it]
 45%|████▌     | 17132/37963 [38:47:55<45:43:04,  7.90s/it]
 45%|████▌     | 17133/37963 [38:48:03<45:12:21,  7.81s/it]
 45%|████▌     | 17134/37963 [38:48:13<49:26:45,  8.55s/it]
 45%|████▌     | 17135/37963 [38:48:20<47:28:52,  8.21s/it]
 45%|████▌     | 17136/37963 [38:48:28<46:45:37,  8.08s/it]
 45%|████▌     | 17137/37963 [38:48:41<55:43:15,  9.63s/it]
 45%|████▌     | 17138/37963 [38:48:49<52:45:18,  9.12s/it]
 45%|████▌     | 17139/37963 [38:48:57<50:08:12,  8.67s/it]
 45%|████▌     | 17140/37963 [38:49:07<52:47:03,  9.13s/it]
                                                           
{'loss': '0.1649', 'grad_norm': '1.099', 'learning_rate': '1.204e-05', 'epoch': '0.4515'}
+
 45%|████▌     | 17140/37963 [38:49:07<52:47:03,  9.13s/it]
 45%|████▌     | 17141/37963 [38:49:15<50:16:06,  8.69s/it]
 45%|████▌     | 17142/37963 [38:49:22<48:26:55,  8.38s/it]
 45%|████▌     | 17143/37963 [38:49:30<47:09:10,  8.15s/it]
 45%|████▌     | 17144/37963 [38:49:38<46:28:46,  8.04s/it]
 45%|████▌     | 17145/37963 [38:49:46<45:54:10,  7.94s/it]
 45%|████▌     | 17146/37963 [38:49:56<49:47:06,  8.61s/it]
 45%|████▌     | 17147/37963 [38:50:04<48:43:19,  8.43s/it]
 45%|████▌     | 17148/37963 [38:50:11<47:11:37,  8.16s/it]
 45%|████▌     | 17149/37963 [38:50:19<46:16:24,  8.00s/it]
 45%|████▌     | 17150/37963 [38:50:27<45:44:28,  7.91s/it]
                                                           
{'loss': '0.1629', 'grad_norm': '1.634', 'learning_rate': '1.203e-05', 'epoch': '0.4518'}
+
 45%|████▌     | 17150/37963 [38:50:27<45:44:28,  7.91s/it]
 45%|████▌     | 17151/37963 [38:50:35<45:43:06,  7.91s/it]
 45%|████▌     | 17152/37963 [38:50:42<45:16:22,  7.83s/it]
 45%|████▌     | 17153/37963 [38:50:50<45:05:40,  7.80s/it]
 45%|████▌     | 17154/37963 [38:50:57<44:23:02,  7.68s/it]
 45%|████▌     | 17155/37963 [38:51:05<44:34:17,  7.71s/it]
 45%|████▌     | 17156/37963 [38:51:13<44:14:58,  7.66s/it]
 45%|████▌     | 17157/37963 [38:51:20<44:21:55,  7.68s/it]
 45%|████▌     | 17158/37963 [38:51:28<44:25:23,  7.69s/it]
 45%|████▌     | 17159/37963 [38:51:36<44:41:06,  7.73s/it]
 45%|████▌     | 17160/37963 [38:51:46<49:01:00,  8.48s/it]
                                                           
{'loss': '0.1523', 'grad_norm': '2.991', 'learning_rate': '1.203e-05', 'epoch': '0.452'}
+
 45%|████▌     | 17160/37963 [38:51:46<49:01:00,  8.48s/it]
 45%|████▌     | 17161/37963 [38:51:54<47:18:34,  8.19s/it]
 45%|████▌     | 17162/37963 [38:52:01<46:22:19,  8.03s/it]
 45%|████▌     | 17163/37963 [38:52:09<45:40:25,  7.91s/it]
 45%|████▌     | 17164/37963 [38:52:16<44:37:40,  7.72s/it]
 45%|████▌     | 17165/37963 [38:52:24<44:30:50,  7.71s/it]
 45%|████▌     | 17166/37963 [38:52:31<44:24:01,  7.69s/it]
 45%|████▌     | 17167/37963 [38:52:39<44:30:54,  7.71s/it]
 45%|████▌     | 17168/37963 [38:52:47<44:33:00,  7.71s/it]
 45%|████▌     | 17169/37963 [38:52:54<44:13:43,  7.66s/it]
 45%|████▌     | 17170/37963 [38:53:05<49:15:44,  8.53s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '1.326', 'learning_rate': '1.202e-05', 'epoch': '0.4523'}
+
 45%|████▌     | 17170/37963 [38:53:05<49:15:44,  8.53s/it]
 45%|████▌     | 17171/37963 [38:53:13<47:39:11,  8.25s/it]
 45%|████▌     | 17172/37963 [38:53:20<46:39:40,  8.08s/it]
 45%|████▌     | 17173/37963 [38:53:31<50:24:06,  8.73s/it]
 45%|████▌     | 17174/37963 [38:53:38<48:24:08,  8.38s/it]
 45%|████▌     | 17175/37963 [38:53:46<47:14:18,  8.18s/it]
 45%|████▌     | 17176/37963 [38:53:54<46:26:02,  8.04s/it]
 45%|████▌     | 17177/37963 [38:54:01<45:41:20,  7.91s/it]
 45%|████▌     | 17178/37963 [38:54:09<45:13:14,  7.83s/it]
 45%|████▌     | 17179/37963 [38:54:17<45:02:37,  7.80s/it]
 45%|████▌     | 17180/37963 [38:54:24<44:41:24,  7.74s/it]
                                                           
{'loss': '0.149', 'grad_norm': '1.2', 'learning_rate': '1.201e-05', 'epoch': '0.4525'}
+
 45%|████▌     | 17180/37963 [38:54:24<44:41:24,  7.74s/it]
 45%|████▌     | 17181/37963 [38:54:32<44:09:54,  7.65s/it]
 45%|████▌     | 17182/37963 [38:54:42<49:06:50,  8.51s/it]
 45%|████▌     | 17183/37963 [38:54:50<47:55:33,  8.30s/it]
 45%|████▌     | 17184/37963 [38:54:57<46:18:03,  8.02s/it]
 45%|████▌     | 17185/37963 [38:55:08<50:19:39,  8.72s/it]
 45%|████▌     | 17186/37963 [38:55:15<48:16:15,  8.36s/it]
 45%|████▌     | 17187/37963 [38:55:23<46:59:01,  8.14s/it]
 45%|████▌     | 17188/37963 [38:55:30<46:08:05,  7.99s/it]
 45%|████▌     | 17189/37963 [38:55:38<45:37:05,  7.91s/it]
 45%|████▌     | 17190/37963 [38:55:48<48:58:52,  8.49s/it]
                                                           
{'loss': '0.147', 'grad_norm': '3.735', 'learning_rate': '1.2e-05', 'epoch': '0.4528'}
+
 45%|████▌     | 17190/37963 [38:55:48<48:58:52,  8.49s/it]
 45%|████▌     | 17191/37963 [38:55:56<47:45:01,  8.28s/it]
 45%|████▌     | 17192/37963 [38:56:03<46:37:59,  8.08s/it]
 45%|████▌     | 17193/37963 [38:56:14<50:31:10,  8.76s/it]
 45%|████▌     | 17194/37963 [38:56:22<48:49:57,  8.46s/it]
 45%|████▌     | 17195/37963 [38:56:30<48:18:05,  8.37s/it]
 45%|████▌     | 17196/37963 [38:56:37<46:57:59,  8.14s/it]
 45%|████▌     | 17197/37963 [38:56:45<46:33:44,  8.07s/it]
 45%|████▌     | 17198/37963 [38:56:53<46:08:02,  8.00s/it]
 45%|████▌     | 17199/37963 [38:57:01<45:27:31,  7.88s/it]
 45%|████▌     | 17200/37963 [38:57:11<49:37:23,  8.60s/it]
                                                           
{'loss': '0.1654', 'grad_norm': '1.59', 'learning_rate': '1.199e-05', 'epoch': '0.4531'}
+
 45%|████▌     | 17200/37963 [38:57:11<49:37:23,  8.60s/it]
 45%|████▌     | 17201/37963 [38:57:19<48:21:56,  8.39s/it]
 45%|████▌     | 17202/37963 [38:57:26<46:52:06,  8.13s/it]
 45%|████▌     | 17203/37963 [38:57:34<46:25:57,  8.05s/it]
 45%|████▌     | 17204/37963 [38:57:42<45:47:28,  7.94s/it]
 45%|████▌     | 17205/37963 [38:57:49<44:46:52,  7.77s/it]
 45%|████▌     | 17206/37963 [38:57:57<44:40:40,  7.75s/it]
 45%|████▌     | 17207/37963 [38:58:05<44:35:26,  7.73s/it]
 45%|████▌     | 17208/37963 [38:58:12<44:40:32,  7.75s/it]
 45%|████▌     | 17209/37963 [38:58:20<44:27:12,  7.71s/it]
 45%|████▌     | 17210/37963 [38:58:28<44:38:23,  7.74s/it]
                                                           
{'loss': '0.1615', 'grad_norm': '1.265', 'learning_rate': '1.198e-05', 'epoch': '0.4533'}
+
 45%|████▌     | 17210/37963 [38:58:28<44:38:23,  7.74s/it]
 45%|████▌     | 17211/37963 [38:58:38<49:03:35,  8.51s/it]
 45%|████▌     | 17212/37963 [38:58:46<47:26:54,  8.23s/it]
 45%|████▌     | 17213/37963 [38:58:53<46:21:51,  8.04s/it]
 45%|████▌     | 17214/37963 [38:59:01<46:01:08,  7.98s/it]
 45%|████▌     | 17215/37963 [38:59:09<45:31:01,  7.90s/it]
 45%|████▌     | 17216/37963 [38:59:17<45:27:20,  7.89s/it]
 45%|████▌     | 17217/37963 [38:59:27<49:58:26,  8.67s/it]
 45%|████▌     | 17218/37963 [38:59:35<48:35:49,  8.43s/it]
 45%|████▌     | 17219/37963 [38:59:43<47:21:11,  8.22s/it]
 45%|████▌     | 17220/37963 [38:59:51<46:29:43,  8.07s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '2.563', 'learning_rate': '1.198e-05', 'epoch': '0.4536'}
+
 45%|████▌     | 17220/37963 [38:59:51<46:29:43,  8.07s/it]
 45%|████▌     | 17221/37963 [38:59:58<45:48:45,  7.95s/it]
 45%|████▌     | 17222/37963 [39:00:06<45:12:55,  7.85s/it]
 45%|████▌     | 17223/37963 [39:00:14<45:23:55,  7.88s/it]
 45%|████▌     | 17224/37963 [39:00:21<44:57:58,  7.81s/it]
 45%|████▌     | 17225/37963 [39:00:29<44:39:41,  7.75s/it]
 45%|████▌     | 17226/37963 [39:00:39<49:11:32,  8.54s/it]
 45%|████▌     | 17227/37963 [39:00:50<52:40:11,  9.14s/it]
 45%|████▌     | 17228/37963 [39:01:00<54:56:47,  9.54s/it]
 45%|████▌     | 17229/37963 [39:01:08<51:17:12,  8.90s/it]
 45%|████▌     | 17230/37963 [39:01:16<49:05:49,  8.53s/it]
                                                           
{'loss': '0.1524', 'grad_norm': '1.831', 'learning_rate': '1.197e-05', 'epoch': '0.4539'}
+
 45%|████▌     | 17230/37963 [39:01:16<49:05:49,  8.53s/it]
 45%|████▌     | 17231/37963 [39:01:23<47:43:23,  8.29s/it]
 45%|████▌     | 17232/37963 [39:01:31<46:32:00,  8.08s/it]
 45%|████▌     | 17233/37963 [39:01:39<45:51:18,  7.96s/it]
 45%|████▌     | 17234/37963 [39:01:49<49:49:19,  8.65s/it]
 45%|████▌     | 17235/37963 [39:01:57<48:31:09,  8.43s/it]
 45%|████▌     | 17236/37963 [39:02:04<46:34:25,  8.09s/it]
 45%|████▌     | 17237/37963 [39:02:12<46:00:44,  7.99s/it]
 45%|████▌     | 17238/37963 [39:02:19<45:23:39,  7.89s/it]
 45%|████▌     | 17239/37963 [39:02:27<45:30:01,  7.90s/it]
 45%|████▌     | 17240/37963 [39:02:38<50:08:26,  8.71s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '2.702', 'learning_rate': '1.196e-05', 'epoch': '0.4541'}
+
 45%|████▌     | 17240/37963 [39:02:38<50:08:26,  8.71s/it]
 45%|████▌     | 17241/37963 [39:02:46<48:31:29,  8.43s/it]
 45%|████▌     | 17242/37963 [39:02:54<47:41:57,  8.29s/it]
 45%|████▌     | 17243/37963 [39:03:02<46:52:37,  8.14s/it]
 45%|████▌     | 17244/37963 [39:03:11<49:55:58,  8.68s/it]
 45%|████▌     | 17245/37963 [39:03:19<48:14:52,  8.38s/it]
 45%|████▌     | 17246/37963 [39:03:27<47:04:17,  8.18s/it]
 45%|████▌     | 17247/37963 [39:03:35<46:49:30,  8.14s/it]
 45%|████▌     | 17248/37963 [39:03:43<46:21:44,  8.06s/it]
 45%|████▌     | 17249/37963 [39:03:50<45:50:30,  7.97s/it]
 45%|████▌     | 17250/37963 [39:03:58<44:48:21,  7.79s/it]
                                                           
{'loss': '0.1653', 'grad_norm': '2.668', 'learning_rate': '1.195e-05', 'epoch': '0.4544'}
+
 45%|████▌     | 17250/37963 [39:03:58<44:48:21,  7.79s/it]
 45%|████▌     | 17251/37963 [39:04:06<44:54:36,  7.81s/it]
 45%|████▌     | 17252/37963 [39:04:13<44:27:28,  7.73s/it]
 45%|████▌     | 17253/37963 [39:04:21<44:14:26,  7.69s/it]
 45%|████▌     | 17254/37963 [39:04:28<44:04:03,  7.66s/it]
 45%|████▌     | 17255/37963 [39:04:36<44:16:39,  7.70s/it]
 45%|████▌     | 17256/37963 [39:04:44<44:16:05,  7.70s/it]
 45%|████▌     | 17257/37963 [39:04:52<44:26:06,  7.73s/it]
 45%|████▌     | 17258/37963 [39:04:59<44:15:20,  7.69s/it]
 45%|████▌     | 17259/37963 [39:05:10<48:32:32,  8.44s/it]
 45%|████▌     | 17260/37963 [39:05:17<46:38:41,  8.11s/it]
                                                           
{'loss': '0.1741', 'grad_norm': '3.67', 'learning_rate': '1.194e-05', 'epoch': '0.4547'}
+
 45%|████▌     | 17260/37963 [39:05:17<46:38:41,  8.11s/it]
 45%|████▌     | 17261/37963 [39:05:24<45:30:51,  7.91s/it]
 45%|████▌     | 17262/37963 [39:05:32<44:44:40,  7.78s/it]
 45%|████▌     | 17263/37963 [39:05:39<44:25:22,  7.73s/it]
 45%|████▌     | 17264/37963 [39:05:47<44:08:57,  7.68s/it]
 45%|████▌     | 17265/37963 [39:05:55<43:59:39,  7.65s/it]
 45%|████��     | 17266/37963 [39:06:02<44:17:14,  7.70s/it]
 45%|████▌     | 17267/37963 [39:06:10<43:51:30,  7.63s/it]
 45%|████▌     | 17268/37963 [39:06:20<48:41:08,  8.47s/it]
 45%|████▌     | 17269/37963 [39:06:28<47:28:48,  8.26s/it]
 45%|████▌     | 17270/37963 [39:06:36<46:31:33,  8.09s/it]
                                                           
{'loss': '0.1613', 'grad_norm': '2.05', 'learning_rate': '1.193e-05', 'epoch': '0.4549'}
+
 45%|████▌     | 17270/37963 [39:06:36<46:31:33,  8.09s/it]
 45%|████▌     | 17271/37963 [39:06:43<45:54:07,  7.99s/it]
 45%|████▌     | 17272/37963 [39:06:51<45:23:03,  7.90s/it]
 45%|████▌     | 17273/37963 [39:07:02<50:22:24,  8.76s/it]
 46%|████▌     | 17274/37963 [39:07:12<53:18:14,  9.28s/it]
 46%|████▌     | 17275/37963 [39:07:20<50:40:08,  8.82s/it]
 46%|████▌     | 17276/37963 [39:07:28<48:31:56,  8.45s/it]
 46%|████▌     | 17277/37963 [39:07:35<47:05:27,  8.20s/it]
 46%|████▌     | 17278/37963 [39:07:45<50:18:55,  8.76s/it]
 46%|████▌     | 17279/37963 [39:07:53<48:22:17,  8.42s/it]
 46%|████▌     | 17280/37963 [39:08:01<47:00:12,  8.18s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '1.234', 'learning_rate': '1.193e-05', 'epoch': '0.4552'}
+
 46%|████▌     | 17280/37963 [39:08:01<47:00:12,  8.18s/it]
 46%|████▌     | 17281/37963 [39:08:11<50:36:37,  8.81s/it]
 46%|████▌     | 17282/37963 [39:08:19<48:43:41,  8.48s/it]
 46%|████▌     | 17283/37963 [39:08:26<47:24:13,  8.25s/it]
 46%|████▌     | 17284/37963 [39:08:34<46:23:25,  8.08s/it]
 46%|████▌     | 17285/37963 [39:08:42<45:46:37,  7.97s/it]
 46%|████▌     | 17286/37963 [39:08:50<45:34:34,  7.94s/it]
 46%|████▌     | 17287/37963 [39:08:58<45:39:12,  7.95s/it]
 46%|████▌     | 17288/37963 [39:09:05<45:10:55,  7.87s/it]
 46%|████▌     | 17289/37963 [39:09:15<48:44:31,  8.49s/it]
 46%|████▌     | 17290/37963 [39:09:23<47:23:06,  8.25s/it]
                                                           
{'loss': '0.1713', 'grad_norm': '2.38', 'learning_rate': '1.192e-05', 'epoch': '0.4554'}
+
 46%|████▌     | 17290/37963 [39:09:23<47:23:06,  8.25s/it]
 46%|████▌     | 17291/37963 [39:09:30<46:08:35,  8.04s/it]
 46%|████▌     | 17292/37963 [39:09:41<50:27:49,  8.79s/it]
 46%|████▌     | 17293/37963 [39:09:49<48:38:48,  8.47s/it]
 46%|████▌     | 17294/37963 [39:09:57<47:27:38,  8.27s/it]
 46%|████▌     | 17295/37963 [39:10:04<46:25:50,  8.09s/it]
 46%|████▌     | 17296/37963 [39:10:12<45:53:02,  7.99s/it]
 46%|████▌     | 17297/37963 [39:10:20<45:13:11,  7.88s/it]
 46%|████▌     | 17298/37963 [39:10:27<44:43:12,  7.79s/it]
 46%|████▌     | 17299/37963 [39:10:35<44:27:04,  7.74s/it]
 46%|████▌     | 17300/37963 [39:10:42<44:11:55,  7.70s/it]
                                                           
{'loss': '0.1755', 'grad_norm': '1.387', 'learning_rate': '1.191e-05', 'epoch': '0.4557'}
+
 46%|████▌     | 17300/37963 [39:10:42<44:11:55,  7.70s/it]
 46%|████▌     | 17301/37963 [39:10:50<44:12:23,  7.70s/it]
 46%|████▌     | 17302/37963 [39:10:58<44:10:29,  7.70s/it]
 46%|████▌     | 17303/37963 [39:11:06<44:13:13,  7.71s/it]
 46%|████▌     | 17304/37963 [39:11:13<44:04:06,  7.68s/it]
 46%|████▌     | 17305/37963 [39:11:21<43:54:14,  7.65s/it]
 46%|████▌     | 17306/37963 [39:11:29<44:22:15,  7.73s/it]
 46%|████▌     | 17307/37963 [39:11:36<44:24:39,  7.74s/it]
 46%|████▌     | 17308/37963 [39:11:44<44:46:38,  7.80s/it]
 46%|████▌     | 17309/37963 [39:11:52<44:32:13,  7.76s/it]
 46%|████▌     | 17310/37963 [39:12:00<44:23:09,  7.74s/it]
                                                           
{'loss': '0.1646', 'grad_norm': '2.635', 'learning_rate': '1.19e-05', 'epoch': '0.456'}
+
 46%|████▌     | 17310/37963 [39:12:00<44:23:09,  7.74s/it]
 46%|████▌     | 17311/37963 [39:12:07<43:30:30,  7.58s/it]
 46%|████▌     | 17312/37963 [39:12:20<52:19:56,  9.12s/it]
 46%|████▌     | 17313/37963 [39:12:28<50:18:57,  8.77s/it]
 46%|████▌     | 17314/37963 [39:12:35<48:26:30,  8.45s/it]
 46%|████▌     | 17315/37963 [39:12:43<46:56:54,  8.19s/it]
 46%|████▌     | 17316/37963 [39:12:51<46:02:24,  8.03s/it]
 46%|████▌     | 17317/37963 [39:13:01<49:51:55,  8.69s/it]
 46%|████▌     | 17318/37963 [39:13:09<48:16:15,  8.42s/it]
 46%|████▌     | 17319/37963 [39:13:16<47:00:38,  8.20s/it]
 46%|████▌     | 17320/37963 [39:13:24<45:47:13,  7.98s/it]
                                                           
{'loss': '0.1731', 'grad_norm': '2.607', 'learning_rate': '1.189e-05', 'epoch': '0.4562'}
+
 46%|████▌     | 17320/37963 [39:13:24<45:47:13,  7.98s/it]
 46%|████▌     | 17321/37963 [39:13:32<45:35:58,  7.95s/it]
 46%|████▌     | 17322/37963 [39:13:42<50:00:43,  8.72s/it]
 46%|████▌     | 17323/37963 [39:13:50<48:09:53,  8.40s/it]
 46%|████▌     | 17324/37963 [39:13:57<46:58:33,  8.19s/it]
 46%|████▌     | 17325/37963 [39:14:05<46:08:09,  8.05s/it]
 46%|████▌     | 17326/37963 [39:14:15<49:48:24,  8.69s/it]
 46%|████▌     | 17327/37963 [39:14:23<48:07:06,  8.39s/it]
 46%|████▌     | 17328/37963 [39:14:31<47:24:52,  8.27s/it]
 46%|████▌     | 17329/37963 [39:14:38<45:49:37,  8.00s/it]
 46%|████▌     | 17330/37963 [39:14:46<45:09:34,  7.88s/it]
                                                           
{'loss': '0.1564', 'grad_norm': '0.882', 'learning_rate': '1.188e-05', 'epoch': '0.4565'}
+
 46%|████▌     | 17330/37963 [39:14:46<45:09:34,  7.88s/it]
 46%|████▌     | 17331/37963 [39:14:54<44:44:25,  7.81s/it]
 46%|████▌     | 17332/37963 [39:15:01<44:39:49,  7.79s/it]
 46%|████▌     | 17333/37963 [39:15:09<44:32:57,  7.77s/it]
 46%|████▌     | 17334/37963 [39:15:19<48:39:21,  8.49s/it]
 46%|████▌     | 17335/37963 [39:15:29<51:35:38,  9.00s/it]
 46%|████▌     | 17336/37963 [39:15:37<49:05:08,  8.57s/it]
 46%|████▌     | 17337/37963 [39:15:45<47:31:17,  8.29s/it]
 46%|████▌     | 17338/37963 [39:15:52<46:39:46,  8.14s/it]
 46%|████▌     | 17339/37963 [39:16:00<45:52:18,  8.01s/it]
 46%|████▌     | 17340/37963 [39:16:08<45:19:46,  7.91s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '1.807', 'learning_rate': '1.188e-05', 'epoch': '0.4568'}
+
 46%|████▌     | 17340/37963 [39:16:08<45:19:46,  7.91s/it]
 46%|████▌     | 17341/37963 [39:16:15<44:46:01,  7.82s/it]
 46%|████▌     | 17342/37963 [39:16:23<45:06:47,  7.88s/it]
 46%|████▌     | 17343/37963 [39:16:31<44:55:25,  7.84s/it]
 46%|████▌     | 17344/37963 [39:16:39<44:40:45,  7.80s/it]
 46%|████▌     | 17345/37963 [39:16:47<44:41:43,  7.80s/it]
 46%|████▌     | 17346/37963 [39:16:57<48:54:10,  8.54s/it]
 46%|████▌     | 17347/37963 [39:17:05<47:40:12,  8.32s/it]
 46%|████▌     | 17348/37963 [39:17:12<46:06:27,  8.05s/it]
 46%|████▌     | 17349/37963 [39:17:20<45:30:37,  7.95s/it]
 46%|████▌     | 17350/37963 [39:17:28<44:53:01,  7.84s/it]
                                                           
{'loss': '0.1615', 'grad_norm': '4.426', 'learning_rate': '1.187e-05', 'epoch': '0.457'}
+
 46%|████▌     | 17350/37963 [39:17:28<44:53:01,  7.84s/it]
 46%|████▌     | 17351/37963 [39:17:35<44:09:31,  7.71s/it]
 46%|████▌     | 17352/37963 [39:17:43<44:30:21,  7.77s/it]
 46%|████▌     | 17353/37963 [39:17:50<44:10:05,  7.71s/it]
 46%|████▌     | 17354/37963 [39:17:58<44:13:02,  7.72s/it]
 46%|████▌     | 17355/37963 [39:18:06<44:03:19,  7.70s/it]
 46%|████▌     | 17356/37963 [39:18:13<43:59:36,  7.69s/it]
 46%|████▌     | 17357/37963 [39:18:21<43:59:02,  7.68s/it]
 46%|████▌     | 17358/37963 [39:18:31<48:29:51,  8.47s/it]
 46%|████▌     | 17359/37963 [39:18:41<50:58:27,  8.91s/it]
 46%|████▌     | 17360/37963 [39:18:49<49:05:15,  8.58s/it]
                                                           
{'loss': '0.1645', 'grad_norm': '2.905', 'learning_rate': '1.186e-05', 'epoch': '0.4573'}
+
 46%|████▌     | 17360/37963 [39:18:49<49:05:15,  8.58s/it]
 46%|████▌     | 17361/37963 [39:18:57<47:41:04,  8.33s/it]
 46%|████▌     | 17362/37963 [39:19:05<46:47:17,  8.18s/it]
 46%|████▌     | 17363/37963 [39:19:12<45:52:00,  8.02s/it]
 46%|████▌     | 17364/37963 [39:19:20<45:07:38,  7.89s/it]
 46%|████▌     | 17365/37963 [39:19:28<45:01:31,  7.87s/it]
 46%|████▌     | 17366/37963 [39:19:41<54:14:47,  9.48s/it]
 46%|████▌     | 17367/37963 [39:19:49<51:29:26,  9.00s/it]
 46%|████▌     | 17368/37963 [39:19:57<49:29:35,  8.65s/it]
 46%|████▌     | 17369/37963 [39:20:05<47:57:53,  8.38s/it]
 46%|████▌     | 17370/37963 [39:20:12<46:16:53,  8.09s/it]
                                                           
{'loss': '0.1699', 'grad_norm': '6.035', 'learning_rate': '1.185e-05', 'epoch': '0.4576'}
+
 46%|████▌     | 17370/37963 [39:20:12<46:16:53,  8.09s/it]
 46%|████▌     | 17371/37963 [39:20:20<46:08:38,  8.07s/it]
 46%|████▌     | 17372/37963 [39:20:28<45:33:27,  7.97s/it]
 46%|████▌     | 17373/37963 [39:20:36<45:18:37,  7.92s/it]
 46%|████▌     | 17374/37963 [39:20:46<49:42:53,  8.69s/it]
 46%|████▌     | 17375/37963 [39:20:54<47:42:48,  8.34s/it]
 46%|████▌     | 17376/37963 [39:21:01<46:57:14,  8.21s/it]
 46%|████▌     | 17377/37963 [39:21:09<45:57:52,  8.04s/it]
 46%|████▌     | 17378/37963 [39:21:17<45:46:43,  8.01s/it]
 46%|████▌     | 17379/37963 [39:21:25<45:06:47,  7.89s/it]
 46%|████▌     | 17380/37963 [39:21:32<44:46:55,  7.83s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '1.74', 'learning_rate': '1.184e-05', 'epoch': '0.4578'}
+
 46%|████▌     | 17380/37963 [39:21:32<44:46:55,  7.83s/it]
 46%|████▌     | 17381/37963 [39:21:40<44:28:21,  7.78s/it]
 46%|████▌     | 17382/37963 [39:21:48<44:25:07,  7.77s/it]
 46%|████▌     | 17383/37963 [39:21:55<44:18:06,  7.75s/it]
 46%|████▌     | 17384/37963 [39:22:03<44:25:40,  7.77s/it]
 46%|████▌     | 17385/37963 [39:22:14<48:48:22,  8.54s/it]
 46%|████▌     | 17386/37963 [39:22:21<47:32:53,  8.32s/it]
 46%|████▌     | 17387/37963 [39:22:29<46:22:53,  8.11s/it]
 46%|████▌     | 17388/37963 [39:22:37<46:00:10,  8.05s/it]
 46%|████▌     | 17389/37963 [39:22:47<49:50:20,  8.72s/it]
 46%|████▌     | 17390/37963 [39:22:55<48:33:41,  8.50s/it]
                                                           
{'loss': '0.1709', 'grad_norm': '2.971', 'learning_rate': '1.183e-05', 'epoch': '0.4581'}
+
 46%|████▌     | 17390/37963 [39:22:55<48:33:41,  8.50s/it]
 46%|████▌     | 17391/37963 [39:23:03<46:53:43,  8.21s/it]
 46%|████▌     | 17392/37963 [39:23:10<45:59:36,  8.05s/it]
 46%|████▌     | 17393/37963 [39:23:18<45:29:35,  7.96s/it]
 46%|████▌     | 17394/37963 [39:23:26<45:11:43,  7.91s/it]
 46%|████▌     | 17395/37963 [39:23:34<45:30:25,  7.97s/it]
 46%|████▌     | 17396/37963 [39:23:42<45:02:04,  7.88s/it]
 46%|████▌     | 17397/37963 [39:23:49<44:36:27,  7.81s/it]
 46%|████▌     | 17398/37963 [39:23:57<44:34:04,  7.80s/it]
 46%|████▌     | 17399/37963 [39:24:05<44:16:05,  7.75s/it]
 46%|████▌     | 17400/37963 [39:24:15<48:33:26,  8.50s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '2.227', 'learning_rate': '1.183e-05', 'epoch': '0.4583'}
+
 46%|████▌     | 17400/37963 [39:24:15<48:33:26,  8.50s/it]
 46%|████▌     | 17401/37963 [39:24:23<47:25:27,  8.30s/it]
 46%|████▌     | 17402/37963 [39:24:34<51:28:33,  9.01s/it]
 46%|████▌     | 17403/37963 [39:24:41<49:18:57,  8.64s/it]
 46%|████▌     | 17404/37963 [39:24:49<47:54:32,  8.39s/it]
 46%|████▌     | 17405/37963 [39:24:57<46:27:50,  8.14s/it]
 46%|████▌     | 17406/37963 [39:25:07<49:47:00,  8.72s/it]
 46%|████▌     | 17407/37963 [39:25:15<48:29:55,  8.49s/it]
 46%|████▌     | 17408/37963 [39:25:22<47:13:09,  8.27s/it]
 46%|████▌     | 17409/37963 [39:25:30<46:04:54,  8.07s/it]
 46%|████▌     | 17410/37963 [39:25:43<54:56:17,  9.62s/it]
                                                           
{'loss': '0.1695', 'grad_norm': '2.831', 'learning_rate': '1.182e-05', 'epoch': '0.4586'}
+
 46%|████▌     | 17410/37963 [39:25:43<54:56:17,  9.62s/it]
 46%|████▌     | 17411/37963 [39:25:51<52:05:29,  9.12s/it]
 46%|████▌     | 17412/37963 [39:25:59<49:53:22,  8.74s/it]
 46%|████▌     | 17413/37963 [39:26:07<48:07:24,  8.43s/it]
 46%|████▌     | 17414/37963 [39:26:15<47:37:55,  8.34s/it]
 46%|████▌     | 17415/37963 [39:26:23<46:36:59,  8.17s/it]
 46%|████▌     | 17416/37963 [39:26:30<45:42:58,  8.01s/it]
 46%|████▌     | 17417/37963 [39:26:38<45:11:22,  7.92s/it]
 46%|████▌     | 17418/37963 [39:26:46<45:04:25,  7.90s/it]
 46%|████▌     | 17419/37963 [39:26:54<44:39:52,  7.83s/it]
 46%|████▌     | 17420/37963 [39:27:01<44:40:23,  7.83s/it]
                                                           
{'loss': '0.1669', 'grad_norm': '0.9239', 'learning_rate': '1.181e-05', 'epoch': '0.4589'}
+
 46%|████▌     | 17420/37963 [39:27:01<44:40:23,  7.83s/it]
 46%|████▌     | 17421/37963 [39:27:09<44:20:28,  7.77s/it]
 46%|████▌     | 17422/37963 [39:27:17<44:26:36,  7.79s/it]
 46%|████▌     | 17423/37963 [39:27:25<44:20:01,  7.77s/it]
 46%|████▌     | 17424/37963 [39:27:32<44:13:14,  7.75s/it]
 46%|████▌     | 17425/37963 [39:27:40<43:55:45,  7.70s/it]
 46%|████▌     | 17426/37963 [39:27:48<43:47:06,  7.68s/it]
 46%|████▌     | 17427/37963 [39:27:55<43:41:14,  7.66s/it]
 46%|████▌     | 17428/37963 [39:28:06<48:32:55,  8.51s/it]
 46%|████▌     | 17429/37963 [39:28:14<47:30:39,  8.33s/it]
 46%|████▌     | 17430/37963 [39:28:21<46:15:12,  8.11s/it]
                                                           
{'loss': '0.1587', 'grad_norm': '3.817', 'learning_rate': '1.18e-05', 'epoch': '0.4591'}
+
 46%|████▌     | 17430/37963 [39:28:21<46:15:12,  8.11s/it]
 46%|████▌     | 17431/37963 [39:28:29<45:34:56,  7.99s/it]
 46%|████▌     | 17432/37963 [39:28:39<49:17:34,  8.64s/it]
 46%|████▌     | 17433/37963 [39:28:47<47:48:40,  8.38s/it]
 46%|████▌     | 17434/37963 [39:28:54<46:37:51,  8.18s/it]
 46%|████▌     | 17435/37963 [39:29:02<45:44:39,  8.02s/it]
 46%|████▌     | 17436/37963 [39:29:10<44:58:02,  7.89s/it]
 46%|████▌     | 17437/37963 [39:29:17<44:10:44,  7.75s/it]
 46%|████▌     | 17438/37963 [39:29:25<44:00:43,  7.72s/it]
 46%|████▌     | 17439/37963 [39:29:33<44:17:54,  7.77s/it]
 46%|████▌     | 17440/37963 [39:29:40<43:58:10,  7.71s/it]
                                                           
{'loss': '0.154', 'grad_norm': '2.822', 'learning_rate': '1.179e-05', 'epoch': '0.4594'}
+
 46%|████▌     | 17440/37963 [39:29:40<43:58:10,  7.71s/it]
 46%|████▌     | 17441/37963 [39:29:48<43:40:08,  7.66s/it]
 46%|████▌     | 17442/37963 [39:29:55<43:32:26,  7.64s/it]
 46%|████▌     | 17443/37963 [39:30:06<47:59:41,  8.42s/it]
 46%|████▌     | 17444/37963 [39:30:16<51:31:26,  9.04s/it]
 46%|████▌     | 17445/37963 [39:30:24<49:12:49,  8.63s/it]
 46%|████▌     | 17446/37963 [39:30:31<47:33:10,  8.34s/it]
 46%|████▌     | 17447/37963 [39:30:39<46:44:20,  8.20s/it]
 46%|████▌     | 17448/37963 [39:30:47<46:07:29,  8.09s/it]
 46%|████▌     | 17449/37963 [39:30:55<44:55:07,  7.88s/it]
 46%|████▌     | 17450/37963 [39:31:05<49:14:01,  8.64s/it]
                                                           
{'loss': '0.1609', 'grad_norm': '5.654', 'learning_rate': '1.178e-05', 'epoch': '0.4597'}
+
 46%|████▌     | 17450/37963 [39:31:05<49:14:01,  8.64s/it]
 46%|████▌     | 17451/37963 [39:31:13<47:30:35,  8.34s/it]
 46%|████▌     | 17452/37963 [39:31:20<46:18:07,  8.13s/it]
 46%|████▌     | 17453/37963 [39:31:28<45:40:20,  8.02s/it]
 46%|████▌     | 17454/37963 [39:31:36<45:02:51,  7.91s/it]
 46%|████▌     | 17455/37963 [39:31:49<54:00:21,  9.48s/it]
 46%|████▌     | 17456/37963 [39:31:56<50:21:40,  8.84s/it]
 46%|████▌     | 17457/37963 [39:32:03<47:47:23,  8.39s/it]
 46%|████▌     | 17458/37963 [39:32:14<50:48:56,  8.92s/it]
 46%|████▌     | 17459/37963 [39:32:21<48:36:31,  8.53s/it]
 46%|████▌     | 17460/37963 [39:32:29<46:56:22,  8.24s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '1.65', 'learning_rate': '1.178e-05', 'epoch': '0.4599'}
+
 46%|████▌     | 17460/37963 [39:32:29<46:56:22,  8.24s/it]
 46%|████▌     | 17461/37963 [39:32:37<46:05:27,  8.09s/it]
 46%|████▌     | 17462/37963 [39:32:44<45:30:11,  7.99s/it]
 46%|████▌     | 17463/37963 [39:32:52<44:53:53,  7.88s/it]
 46%|████▌     | 17464/37963 [39:33:00<44:29:10,  7.81s/it]
 46%|████▌     | 17465/37963 [39:33:08<44:49:37,  7.87s/it]
 46%|████▌     | 17466/37963 [39:33:15<44:44:26,  7.86s/it]
 46%|████▌     | 17467/37963 [39:33:23<43:49:52,  7.70s/it]
 46%|████▌     | 17468/37963 [39:33:31<44:05:31,  7.74s/it]
 46%|████▌     | 17469/37963 [39:33:38<44:01:21,  7.73s/it]
 46%|████▌     | 17470/37963 [39:33:46<43:57:51,  7.72s/it]
                                                           
{'loss': '0.1714', 'grad_norm': '2.001', 'learning_rate': '1.177e-05', 'epoch': '0.4602'}
+
 46%|████▌     | 17470/37963 [39:33:46<43:57:51,  7.72s/it]
 46%|████▌     | 17471/37963 [39:33:54<44:11:22,  7.76s/it]
 46%|████▌     | 17472/37963 [39:34:02<44:40:22,  7.85s/it]
 46%|████▌     | 17473/37963 [39:34:10<44:55:42,  7.89s/it]
 46%|████▌     | 17474/37963 [39:34:18<44:46:11,  7.87s/it]
 46%|████▌     | 17475/37963 [39:34:26<44:43:14,  7.86s/it]
 46%|████▌     | 17476/37963 [39:34:34<44:55:57,  7.90s/it]
 46%|████▌     | 17477/37963 [39:34:41<44:45:36,  7.87s/it]
 46%|████▌     | 17478/37963 [39:34:49<44:15:19,  7.78s/it]
 46%|████▌     | 17479/37963 [39:34:59<48:41:12,  8.56s/it]
 46%|████▌     | 17480/37963 [39:35:07<46:59:49,  8.26s/it]
                                                           
{'loss': '0.1677', 'grad_norm': '0.9514', 'learning_rate': '1.176e-05', 'epoch': '0.4604'}
+
 46%|████▌     | 17480/37963 [39:35:07<46:59:49,  8.26s/it]
 46%|████▌     | 17481/37963 [39:35:14<45:44:14,  8.04s/it]
 46%|████▌     | 17482/37963 [39:35:25<49:29:33,  8.70s/it]
 46%|████▌     | 17483/37963 [39:35:32<47:59:07,  8.43s/it]
 46%|████▌     | 17484/37963 [39:35:40<46:49:45,  8.23s/it]
 46%|████▌     | 17485/37963 [39:35:48<45:27:47,  7.99s/it]
 46%|████▌     | 17486/37963 [39:35:55<44:51:19,  7.89s/it]
 46%|████▌     | 17487/37963 [39:36:03<44:40:13,  7.85s/it]
 46%|████▌     | 17488/37963 [39:36:11<44:33:08,  7.83s/it]
 46%|██���█▌     | 17489/37963 [39:36:18<43:52:56,  7.72s/it]
 46%|████▌     | 17490/37963 [39:36:26<43:55:23,  7.72s/it]
                                                           
{'loss': '0.1493', 'grad_norm': '1.44', 'learning_rate': '1.175e-05', 'epoch': '0.4607'}
+
 46%|████▌     | 17490/37963 [39:36:26<43:55:23,  7.72s/it]
 46%|████▌     | 17491/37963 [39:36:34<43:47:43,  7.70s/it]
 46%|████▌     | 17492/37963 [39:36:47<52:40:44,  9.26s/it]
 46%|████▌     | 17493/37963 [39:36:54<50:12:18,  8.83s/it]
 46%|████▌     | 17494/37963 [39:37:02<48:12:18,  8.48s/it]
 46%|████▌     | 17495/37963 [39:37:10<47:19:49,  8.32s/it]
 46%|████▌     | 17496/37963 [39:37:18<46:23:39,  8.16s/it]
 46%|████▌     | 17497/37963 [39:37:25<44:50:05,  7.89s/it]
 46%|████▌     | 17498/37963 [39:37:33<44:29:38,  7.83s/it]
 46%|████▌     | 17499/37963 [39:37:40<44:06:35,  7.76s/it]
 46%|████▌     | 17500/37963 [39:37:48<43:31:06,  7.66s/it]
                                                           
{'loss': '0.148', 'grad_norm': '2.91', 'learning_rate': '1.174e-05', 'epoch': '0.461'}
+
 46%|████▌     | 17500/37963 [39:37:48<43:31:06,  7.66s/it]
 46%|████▌     | 17501/37963 [39:37:56<43:46:24,  7.70s/it]
 46%|████▌     | 17502/37963 [39:38:03<43:44:08,  7.70s/it]
 46%|████▌     | 17503/37963 [39:38:13<48:00:49,  8.45s/it]
 46%|████▌     | 17504/37963 [39:38:24<51:13:30,  9.01s/it]
 46%|████▌     | 17505/37963 [39:38:32<49:00:46,  8.62s/it]
 46%|████▌     | 17506/37963 [39:38:39<47:28:23,  8.35s/it]
 46%|████▌     | 17507/37963 [39:38:50<50:48:35,  8.94s/it]
 46%|████▌     | 17508/37963 [39:39:00<53:14:28,  9.37s/it]
 46%|████▌     | 17509/37963 [39:39:07<49:55:48,  8.79s/it]
 46%|████▌     | 17510/37963 [39:39:15<48:21:07,  8.51s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '3.056', 'learning_rate': '1.173e-05', 'epoch': '0.4612'}
+
 46%|████▌     | 17510/37963 [39:39:15<48:21:07,  8.51s/it]
 46%|████▌     | 17511/37963 [39:39:23<46:59:44,  8.27s/it]
 46%|████▌     | 17512/37963 [39:39:31<46:04:49,  8.11s/it]
 46%|████▌     | 17513/37963 [39:39:38<44:42:42,  7.87s/it]
 46%|████▌     | 17514/37963 [39:39:46<44:18:09,  7.80s/it]
 46%|████▌     | 17515/37963 [39:39:53<44:07:35,  7.77s/it]
 46%|████▌     | 17516/37963 [39:40:01<43:57:41,  7.74s/it]
 46%|████▌     | 17517/37963 [39:40:09<43:48:16,  7.71s/it]
 46%|████▌     | 17518/37963 [39:40:17<44:15:01,  7.79s/it]
 46%|████▌     | 17519/37963 [39:40:24<43:49:28,  7.72s/it]
 46%|████▌     | 17520/37963 [39:40:32<44:06:17,  7.77s/it]
                                                           
{'loss': '0.1507', 'grad_norm': '1.876', 'learning_rate': '1.172e-05', 'epoch': '0.4615'}
+
 46%|████▌     | 17520/37963 [39:40:32<44:06:17,  7.77s/it]
 46%|████▌     | 17521/37963 [39:40:40<44:09:14,  7.78s/it]
 46%|████▌     | 17522/37963 [39:40:47<43:46:38,  7.71s/it]
 46%|████▌     | 17523/37963 [39:40:57<47:44:28,  8.41s/it]
 46%|████▌     | 17524/37963 [39:41:05<46:04:01,  8.11s/it]
 46%|████▌     | 17525/37963 [39:41:13<45:18:38,  7.98s/it]
 46%|████▌     | 17526/37963 [39:41:23<49:22:27,  8.70s/it]
 46%|████▌     | 17527/37963 [39:41:30<47:17:13,  8.33s/it]
 46%|████▌     | 17528/37963 [39:41:38<46:14:17,  8.15s/it]
 46%|████▌     | 17529/37963 [39:41:46<45:08:47,  7.95s/it]
 46%|████▌     | 17530/37963 [39:41:53<44:19:31,  7.81s/it]
                                                           
{'loss': '0.1729', 'grad_norm': '1.246', 'learning_rate': '1.172e-05', 'epoch': '0.4618'}
+
 46%|████▌     | 17530/37963 [39:41:53<44:19:31,  7.81s/it]
 46%|████▌     | 17531/37963 [39:42:01<44:32:33,  7.85s/it]
 46%|████▌     | 17532/37963 [39:42:09<44:15:04,  7.80s/it]
 46%|████▌     | 17533/37963 [39:42:16<44:03:34,  7.76s/it]
 46%|████▌     | 17534/37963 [39:42:24<43:52:34,  7.73s/it]
 46%|████▌     | 17535/37963 [39:42:32<43:36:54,  7.69s/it]
 46%|████▌     | 17536/37963 [39:42:39<43:34:19,  7.68s/it]
 46%|████▌     | 17537/37963 [39:42:47<43:56:25,  7.74s/it]
 46%|████▌     | 17538/37963 [39:42:55<43:45:10,  7.71s/it]
 46%|████▌     | 17539/37963 [39:43:02<43:41:46,  7.70s/it]
 46%|████▌     | 17540/37963 [39:43:10<44:00:12,  7.76s/it]
                                                           
{'loss': '0.1574', 'grad_norm': '2.424', 'learning_rate': '1.171e-05', 'epoch': '0.462'}
+
 46%|████▌     | 17540/37963 [39:43:10<44:00:12,  7.76s/it]
 46%|████▌     | 17541/37963 [39:43:18<43:35:50,  7.69s/it]
 46%|████▌     | 17542/37963 [39:43:26<43:51:25,  7.73s/it]
 46%|████▌     | 17543/37963 [39:43:34<44:19:04,  7.81s/it]
 46%|████▌     | 17544/37963 [39:43:42<44:18:58,  7.81s/it]
 46%|████▌     | 17545/37963 [39:43:49<44:29:09,  7.84s/it]
 46%|████▌     | 17546/37963 [39:44:02<52:46:10,  9.30s/it]
 46%|████▌     | 17547/37963 [39:44:10<49:59:29,  8.82s/it]
 46%|████▌     | 17548/37963 [39:44:20<52:49:11,  9.31s/it]
 46%|████▌     | 17549/37963 [39:44:28<49:50:04,  8.79s/it]
 46%|████▌     | 17550/37963 [39:44:38<52:02:00,  9.18s/it]
                                                           
{'loss': '0.1504', 'grad_norm': '2.029', 'learning_rate': '1.17e-05', 'epoch': '0.4623'}
+
 46%|████▌     | 17550/37963 [39:44:38<52:02:00,  9.18s/it]
 46%|████▌     | 17551/37963 [39:44:48<54:01:46,  9.53s/it]
 46%|████▌     | 17552/37963 [39:44:56<51:07:05,  9.02s/it]
 46%|████▌     | 17553/37963 [39:45:04<48:41:48,  8.59s/it]
 46%|████▌     | 17554/37963 [39:45:12<47:29:02,  8.38s/it]
 46%|████▌     | 17555/37963 [39:45:19<46:25:41,  8.19s/it]
 46%|████▌     | 17556/37963 [39:45:27<45:37:34,  8.05s/it]
 46%|████▌     | 17557/37963 [39:45:37<49:39:41,  8.76s/it]
 46%|████▋     | 17558/37963 [39:45:45<48:12:50,  8.51s/it]
 46%|████▋     | 17559/37963 [39:45:53<46:06:31,  8.14s/it]
 46%|████▋     | 17560/37963 [39:46:00<45:13:08,  7.98s/it]
                                                           
{'loss': '0.1618', 'grad_norm': '3.032', 'learning_rate': '1.169e-05', 'epoch': '0.4626'}
+
 46%|████▋     | 17560/37963 [39:46:00<45:13:08,  7.98s/it]
 46%|████▋     | 17561/37963 [39:46:08<44:33:51,  7.86s/it]
 46%|████▋     | 17562/37963 [39:46:15<44:07:03,  7.79s/it]
 46%|████▋     | 17563/37963 [39:46:23<43:47:36,  7.73s/it]
 46%|████▋     | 17564/37963 [39:46:31<43:38:48,  7.70s/it]
 46%|████▋     | 17565/37963 [39:46:38<43:41:13,  7.71s/it]
 46%|████▋     | 17566/37963 [39:46:46<43:59:14,  7.76s/it]
 46%|████▋     | 17567/37963 [39:46:57<48:20:37,  8.53s/it]
 46%|████▋     | 17568/37963 [39:47:05<47:26:40,  8.37s/it]
 46%|████▋     | 17569/37963 [39:47:13<46:53:23,  8.28s/it]
 46%|████▋     | 17570/37963 [39:47:20<46:00:29,  8.12s/it]
                                                           
{'loss': '0.1669', 'grad_norm': '2.338', 'learning_rate': '1.168e-05', 'epoch': '0.4628'}
+
 46%|████▋     | 17570/37963 [39:47:20<46:00:29,  8.12s/it]
 46%|████▋     | 17571/37963 [39:47:28<45:46:09,  8.08s/it]
 46%|████▋     | 17572/37963 [39:47:36<44:33:58,  7.87s/it]
 46%|████▋     | 17573/37963 [39:47:44<44:12:43,  7.81s/it]
 46%|████▋     | 17574/37963 [39:47:51<44:17:29,  7.82s/it]
 46%|████▋     | 17575/37963 [39:47:59<43:56:32,  7.76s/it]
 46%|████▋     | 17576/37963 [39:48:07<44:07:55,  7.79s/it]
 46%|████▋     | 17577/37963 [39:48:15<43:57:44,  7.76s/it]
 46%|████▋     | 17578/37963 [39:48:22<44:01:50,  7.78s/it]
 46%|████▋     | 17579/37963 [39:48:30<43:50:04,  7.74s/it]
 46%|████▋     | 17580/37963 [39:48:40<47:57:58,  8.47s/it]
                                                           
{'loss': '0.1629', 'grad_norm': '3.014', 'learning_rate': '1.167e-05', 'epoch': '0.4631'}
+
 46%|████▋     | 17580/37963 [39:48:40<47:57:58,  8.47s/it]
 46%|████▋     | 17581/37963 [39:48:48<46:34:01,  8.22s/it]
 46%|████▋     | 17582/37963 [39:48:56<45:41:00,  8.07s/it]
 46%|████▋     | 17583/37963 [39:49:03<44:22:51,  7.84s/it]
 46%|████▋     | 17584/37963 [39:49:10<43:39:20,  7.71s/it]
 46%|████▋     | 17585/37963 [39:49:18<43:28:00,  7.68s/it]
 46%|████▋     | 17586/37963 [39:49:26<43:40:13,  7.72s/it]
 46%|████▋     | 17587/37963 [39:49:33<43:01:15,  7.60s/it]
 46%|████▋     | 17588/37963 [39:49:40<42:41:55,  7.54s/it]
 46%|████▋     | 17589/37963 [39:49:51<47:08:12,  8.33s/it]
 46%|████▋     | 17590/37963 [39:49:58<46:18:33,  8.18s/it]
                                                           
{'loss': '0.1679', 'grad_norm': '4.061', 'learning_rate': '1.167e-05', 'epoch': '0.4633'}
+
 46%|████▋     | 17590/37963 [39:49:58<46:18:33,  8.18s/it]
 46%|████▋     | 17591/37963 [39:50:06<45:30:43,  8.04s/it]
 46%|████▋     | 17592/37963 [39:50:14<44:58:09,  7.95s/it]
 46%|████▋     | 17593/37963 [39:50:24<49:02:27,  8.67s/it]
 46%|████▋     | 17594/37963 [39:50:32<47:32:59,  8.40s/it]
 46%|████▋     | 17595/37963 [39:50:45<55:16:55,  9.77s/it]
 46%|████▋     | 17596/37963 [39:50:53<51:56:29,  9.18s/it]
 46%|████▋     | 17597/37963 [39:51:00<49:13:55,  8.70s/it]
 46%|████▋     | 17598/37963 [39:51:10<51:42:25,  9.14s/it]
 46%|████▋     | 17599/37963 [39:51:18<49:11:12,  8.70s/it]
 46%|████▋     | 17600/37963 [39:51:26<47:22:12,  8.37s/it]
                                                           
{'loss': '0.1459', 'grad_norm': '1.243', 'learning_rate': '1.166e-05', 'epoch': '0.4636'}
+
 46%|████▋     | 17600/37963 [39:51:26<47:22:12,  8.37s/it]
 46%|████▋     | 17601/37963 [39:51:33<45:53:34,  8.11s/it]
 46%|████▋     | 17602/37963 [39:51:41<45:08:24,  7.98s/it]
 46%|████▋     | 17603/37963 [39:51:49<44:33:24,  7.88s/it]
 46%|████▋     | 17604/37963 [39:51:56<44:11:30,  7.81s/it]
 46%|████▋     | 17605/37963 [39:52:07<48:46:15,  8.62s/it]
 46%|████▋     | 17606/37963 [39:52:14<47:13:31,  8.35s/it]
 46%|████▋     | 17607/37963 [39:52:22<46:01:24,  8.14s/it]
 46%|████▋     | 17608/37963 [39:52:30<45:23:26,  8.03s/it]
 46%|████▋     | 17609/37963 [39:52:38<44:41:49,  7.91s/it]
 46%|████▋     | 17610/37963 [39:52:45<44:17:45,  7.84s/it]
                                                           
{'loss': '0.1695', 'grad_norm': '1.356', 'learning_rate': '1.165e-05', 'epoch': '0.4639'}
+
 46%|████▋     | 17610/37963 [39:52:45<44:17:45,  7.84s/it]
 46%|████▋     | 17611/37963 [39:52:53<43:59:56,  7.78s/it]
 46%|████▋     | 17612/37963 [39:53:01<44:01:15,  7.79s/it]
 46%|████▋     | 17613/37963 [39:53:08<43:43:23,  7.73s/it]
 46%|████▋     | 17614/37963 [39:53:16<43:38:12,  7.72s/it]
 46%|████▋     | 17615/37963 [39:53:23<42:56:55,  7.60s/it]
 46%|████▋     | 17616/37963 [39:53:31<43:02:42,  7.62s/it]
 46%|████▋     | 17617/37963 [39:53:39<43:28:17,  7.69s/it]
 46%|████▋     | 17618/37963 [39:53:46<42:55:41,  7.60s/it]
 46%|████▋     | 17619/37963 [39:53:54<43:11:25,  7.64s/it]
 46%|████▋     | 17620/37963 [39:54:02<43:29:36,  7.70s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '3.366', 'learning_rate': '1.164e-05', 'epoch': '0.4641'}
+
 46%|████▋     | 17620/37963 [39:54:02<43:29:36,  7.70s/it]
 46%|████▋     | 17621/37963 [39:54:12<47:46:38,  8.46s/it]
 46%|████▋     | 17622/37963 [39:54:20<46:55:09,  8.30s/it]
 46%|████▋     | 17623/37963 [39:54:28<45:57:20,  8.13s/it]
 46%|████▋     | 17624/37963 [39:54:35<45:05:54,  7.98s/it]
 46%|████▋     | 17625/37963 [39:54:43<44:39:20,  7.90s/it]
 46%|████▋     | 17626/37963 [39:54:50<43:29:06,  7.70s/it]
 46%|████▋     | 17627/37963 [39:54:58<43:24:04,  7.68s/it]
 46%|████▋     | 17628/37963 [39:55:06<43:30:01,  7.70s/it]
 46%|████▋     | 17629/37963 [39:55:16<47:57:57,  8.49s/it]
 46%|████▋     | 17630/37963 [39:55:23<46:17:13,  8.20s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '1.948', 'learning_rate': '1.163e-05', 'epoch': '0.4644'}
+
 46%|████▋     | 17630/37963 [39:55:23<46:17:13,  8.20s/it]
 46%|████▋     | 17631/37963 [39:55:31<45:00:45,  7.97s/it]
 46%|████▋     | 17632/37963 [39:55:39<44:26:54,  7.87s/it]
 46%|████▋     | 17633/37963 [39:55:46<43:41:50,  7.74s/it]
 46%|████▋     | 17634/37963 [39:55:53<43:21:33,  7.68s/it]
 46%|████▋     | 17635/37963 [39:56:01<43:38:39,  7.73s/it]
 46%|████▋     | 17636/37963 [39:56:12<48:04:41,  8.51s/it]
 46%|████▋     | 17637/37963 [39:56:19<46:40:39,  8.27s/it]
 46%|████▋     | 17638/37963 [39:56:30<50:08:34,  8.88s/it]
 46%|████▋     | 17639/37963 [39:56:37<48:15:24,  8.55s/it]
 46%|████▋     | 17640/37963 [39:56:45<46:44:13,  8.28s/it]
                                                           
{'loss': '0.1599', 'grad_norm': '1.845', 'learning_rate': '1.162e-05', 'epoch': '0.4647'}
+
 46%|████▋     | 17640/37963 [39:56:45<46:44:13,  8.28s/it]
 46%|████▋     | 17641/37963 [39:56:56<50:26:28,  8.94s/it]
 46%|████▋     | 17642/37963 [39:57:06<52:39:53,  9.33s/it]
 46%|████▋     | 17643/37963 [39:57:14<49:55:35,  8.85s/it]
 46%|████▋     | 17644/37963 [39:57:24<52:22:32,  9.28s/it]
 46%|████▋     | 17645/37963 [39:57:32<49:51:10,  8.83s/it]
 46%|████▋     | 17646/37963 [39:57:39<47:52:44,  8.48s/it]
 46%|████▋     | 17647/37963 [39:57:47<46:13:36,  8.19s/it]
 46%|████▋     | 17648/37963 [39:57:54<45:08:49,  8.00s/it]
 46%|████▋     | 17649/37963 [39:58:02<44:43:42,  7.93s/it]
 46%|████▋     | 17650/37963 [39:58:10<44:21:17,  7.86s/it]
                                                           
{'loss': '0.1618', 'grad_norm': '3.051', 'learning_rate': '1.162e-05', 'epoch': '0.4649'}
+
 46%|████▋     | 17650/37963 [39:58:10<44:21:17,  7.86s/it]
 46%|████▋     | 17651/37963 [39:58:17<43:36:20,  7.73s/it]
 46%|████▋     | 17652/37963 [39:58:28<48:15:37,  8.55s/it]
 47%|████▋     | 17653/37963 [39:58:35<46:19:46,  8.21s/it]
 47%|████▋     | 17654/37963 [39:58:43<45:13:11,  8.02s/it]
 47%|████▋     | 17655/37963 [39:58:50<44:45:01,  7.93s/it]
 47%|████▋     | 17656/37963 [39:58:58<43:58:14,  7.80s/it]
 47%|████▋     | 17657/37963 [39:59:06<43:56:27,  7.79s/it]
 47%|████▋     | 17658/37963 [39:59:13<43:57:41,  7.79s/it]
 47%|████▋     | 17659/37963 [39:59:21<43:56:16,  7.79s/it]
 47%|████▋     | 17660/37963 [39:59:29<43:25:53,  7.70s/it]
                                                           
{'loss': '0.1683', 'grad_norm': '1.854', 'learning_rate': '1.161e-05', 'epoch': '0.4652'}
+
 47%|████▋     | 17660/37963 [39:59:29<43:25:53,  7.70s/it]
 47%|████▋     | 17661/37963 [39:59:37<43:32:54,  7.72s/it]
 47%|████▋     | 17662/37963 [39:59:44<43:42:46,  7.75s/it]
 47%|████▋     | 17663/37963 [39:59:52<43:45:17,  7.76s/it]
 47%|████▋     | 17664/37963 [40:00:00<43:30:18,  7.72s/it]
 47%|████▋     | 17665/37963 [40:00:10<47:25:04,  8.41s/it]
 47%|████▋     | 17666/37963 [40:00:17<46:06:33,  8.18s/it]
 47%|████▋     | 17667/37963 [40:00:25<44:51:45,  7.96s/it]
 47%|████▋     | 17668/37963 [40:00:33<44:45:57,  7.94s/it]
 47%|████▋     | 17669/37963 [40:00:40<43:47:36,  7.77s/it]
 47%|████▋     | 17670/37963 [40:00:48<43:20:24,  7.69s/it]
                                                           
{'loss': '0.1634', 'grad_norm': '1.77', 'learning_rate': '1.16e-05', 'epoch': '0.4655'}
+
 47%|████▋     | 17670/37963 [40:00:48<43:20:24,  7.69s/it]
 47%|████▋     | 17671/37963 [40:00:55<43:09:47,  7.66s/it]
 47%|████▋     | 17672/37963 [40:01:03<43:01:24,  7.63s/it]
 47%|████▋     | 17673/37963 [40:01:11<43:29:51,  7.72s/it]
 47%|████▋     | 17674/37963 [40:01:18<42:55:20,  7.62s/it]
 47%|████▋     | 17675/37963 [40:01:26<42:56:07,  7.62s/it]
 47%|████▋     | 17676/37963 [40:01:33<43:02:13,  7.64s/it]
 47%|████▋     | 17677/37963 [40:01:43<47:06:44,  8.36s/it]
 47%|████▋     | 17678/37963 [40:01:51<46:28:06,  8.25s/it]
 47%|████▋     | 17679/37963 [40:01:59<45:33:02,  8.08s/it]
 47%|████▋     | 17680/37963 [40:02:09<49:23:59,  8.77s/it]
                                                           
{'loss': '0.1722', 'grad_norm': '2.561', 'learning_rate': '1.159e-05', 'epoch': '0.4657'}
+
 47%|████▋     | 17680/37963 [40:02:09<49:23:59,  8.77s/it]
 47%|████▋     | 17681/37963 [40:02:17<47:23:13,  8.41s/it]
 47%|████▋     | 17682/37963 [40:02:27<50:41:50,  9.00s/it]
 47%|████▋     | 17683/37963 [40:02:35<48:43:37,  8.65s/it]
 47%|████▋     | 17684/37963 [40:02:43<47:02:06,  8.35s/it]
 47%|████▋     | 17685/37963 [40:02:51<45:47:05,  8.13s/it]
 47%|████▋     | 17686/37963 [40:02:58<45:18:53,  8.05s/it]
 47%|████▋     | 17687/37963 [40:03:06<44:50:56,  7.96s/it]
 47%|████▋     | 17688/37963 [40:03:14<44:25:00,  7.89s/it]
 47%|████▋     | 17689/37963 [40:03:22<44:20:22,  7.87s/it]
 47%|████▋     | 17690/37963 [40:03:32<48:39:49,  8.64s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '2.09', 'learning_rate': '1.158e-05', 'epoch': '0.466'}
+
 47%|████▋     | 17690/37963 [40:03:32<48:39:49,  8.64s/it]
 47%|████▋     | 17691/37963 [40:03:40<47:15:28,  8.39s/it]
 47%|████▋     | 17692/37963 [40:03:48<46:25:04,  8.24s/it]
 47%|████▋     | 17693/37963 [40:03:56<45:36:03,  8.10s/it]
 47%|████▋     | 17694/37963 [40:04:03<44:50:35,  7.96s/it]
 47%|████▋     | 17695/37963 [40:04:14<49:13:18,  8.74s/it]
 47%|████▋     | 17696/37963 [40:04:22<47:26:46,  8.43s/it]
 47%|████▋     | 17697/37963 [40:04:32<50:57:24,  9.05s/it]
 47%|████▋     | 17698/37963 [40:04:42<52:39:40,  9.36s/it]
 47%|████▋     | 17699/37963 [40:04:50<49:52:28,  8.86s/it]
 47%|████▋     | 17700/37963 [40:04:57<47:28:47,  8.44s/it]
                                                           
{'loss': '0.1524', 'grad_norm': '4.154', 'learning_rate': '1.157e-05', 'epoch': '0.4662'}
+
 47%|████▋     | 17700/37963 [40:04:57<47:28:47,  8.44s/it]
 47%|████▋     | 17701/37963 [40:05:05<45:43:57,  8.13s/it]
 47%|████▋     | 17702/37963 [40:05:12<45:08:49,  8.02s/it]
 47%|████▋     | 17703/37963 [40:05:20<44:37:56,  7.93s/it]
 47%|████▋     | 17704/37963 [40:05:28<44:06:32,  7.84s/it]
 47%|████▋     | 17705/37963 [40:05:35<43:30:59,  7.73s/it]
 47%|████▋     | 17706/37963 [40:05:43<43:25:40,  7.72s/it]
 47%|████▋     | 17707/37963 [40:05:51<43:32:43,  7.74s/it]
 47%|████▋     | 17708/37963 [40:05:58<43:36:47,  7.75s/it]
 47%|████▋     | 17709/37963 [40:06:09<48:01:23,  8.54s/it]
 47%|████▋     | 17710/37963 [40:06:17<46:49:19,  8.32s/it]
                                                           
{'loss': '0.1647', 'grad_norm': '1.871', 'learning_rate': '1.157e-05', 'epoch': '0.4665'}
+
 47%|████▋     | 17710/37963 [40:06:17<46:49:19,  8.32s/it]
 47%|████▋     | 17711/37963 [40:06:25<46:00:05,  8.18s/it]
 47%|████▋     | 17712/37963 [40:06:32<45:16:01,  8.05s/it]
 47%|████▋     | 17713/37963 [40:06:40<44:53:46,  7.98s/it]
 47%|████▋     | 17714/37963 [40:06:48<45:00:51,  8.00s/it]
 47%|████▋     | 17715/37963 [40:06:56<43:55:38,  7.81s/it]
 47%|████▋     | 17716/37963 [40:07:03<43:39:43,  7.76s/it]
 47%|████▋     | 17717/37963 [40:07:11<43:44:08,  7.78s/it]
 47%|████▋     | 17718/37963 [40:07:19<43:27:45,  7.73s/it]
 47%|████▋     | 17719/37963 [40:07:26<43:27:55,  7.73s/it]
 47%|████▋     | 17720/37963 [40:07:34<43:28:10,  7.73s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '1.253', 'learning_rate': '1.156e-05', 'epoch': '0.4668'}
+
 47%|████▋     | 17720/37963 [40:07:34<43:28:10,  7.73s/it]
 47%|████▋     | 17721/37963 [40:07:42<43:32:42,  7.74s/it]
 47%|████▋     | 17722/37963 [40:07:50<43:29:10,  7.73s/it]
 47%|████▋     | 17723/37963 [40:07:57<43:06:01,  7.67s/it]
 47%|████▋     | 17724/37963 [40:08:05<43:04:35,  7.66s/it]
 47%|████▋     | 17725/37963 [40:08:15<47:41:47,  8.48s/it]
 47%|████▋     | 17726/37963 [40:08:25<50:54:33,  9.06s/it]
 47%|████▋     | 17727/37963 [40:08:33<48:47:50,  8.68s/it]
 47%|████▋     | 17728/37963 [40:08:41<47:11:56,  8.40s/it]
 47%|████▋     | 17729/37963 [40:08:48<45:17:17,  8.06s/it]
 47%|████▋     | 17730/37963 [40:08:56<44:23:39,  7.90s/it]
                                                           
{'loss': '0.1552', 'grad_norm': '4.088', 'learning_rate': '1.155e-05', 'epoch': '0.467'}
+
 47%|████▋     | 17730/37963 [40:08:56<44:23:39,  7.90s/it]
 47%|████▋     | 17731/37963 [40:09:03<43:34:16,  7.75s/it]
 47%|████▋     | 17732/37963 [40:09:11<43:31:13,  7.74s/it]
 47%|████▋     | 17733/37963 [40:09:19<43:17:08,  7.70s/it]
 47%|████▋     | 17734/37963 [40:09:29<47:25:10,  8.44s/it]
 47%|████▋     | 17735/37963 [40:09:36<46:16:01,  8.23s/it]
 47%|████▋     | 17736/37963 [40:09:44<45:23:17,  8.08s/it]
 47%|████▋     | 17737/37963 [40:09:52<44:45:45,  7.97s/it]
 47%|████▋     | 17738/37963 [40:10:00<44:33:24,  7.93s/it]
 47%|████▋     | 17739/37963 [40:10:10<49:01:00,  8.73s/it]
 47%|████▋     | 17740/37963 [40:10:18<46:48:01,  8.33s/it]
                                                           
{'loss': '0.162', 'grad_norm': '1.555', 'learning_rate': '1.154e-05', 'epoch': '0.4673'}
+
 47%|████▋     | 17740/37963 [40:10:18<46:48:01,  8.33s/it]
 47%|████▋     | 17741/37963 [40:10:25<45:11:28,  8.05s/it]
 47%|████▋     | 17742/37963 [40:10:33<44:44:00,  7.96s/it]
 47%|████▋     | 17743/37963 [40:10:41<44:19:50,  7.89s/it]
 47%|████▋     | 17744/37963 [40:10:51<48:23:34,  8.62s/it]
 47%|████▋     | 17745/37963 [40:10:59<46:39:46,  8.31s/it]
 47%|████▋     | 17746/37963 [40:11:06<45:33:59,  8.11s/it]
 47%|████▋     | 17747/37963 [40:11:14<44:35:37,  7.94s/it]
 47%|████▋     | 17748/37963 [40:11:21<43:56:46,  7.83s/it]
 47%|████▋     | 17749/37963 [40:11:29<44:09:49,  7.87s/it]
 47%|████▋     | 17750/37963 [40:11:37<44:05:54,  7.85s/it]
                                                           
{'loss': '0.1484', 'grad_norm': '1.535', 'learning_rate': '1.153e-05', 'epoch': '0.4676'}
+
 47%|████▋     | 17750/37963 [40:11:37<44:05:54,  7.85s/it]
 47%|████▋     | 17751/37963 [40:11:48<48:33:22,  8.65s/it]
 47%|████▋     | 17752/37963 [40:12:01<55:59:09,  9.97s/it]
 47%|████▋     | 17753/37963 [40:12:08<52:24:42,  9.34s/it]
 47%|████▋     | 17754/37963 [40:12:16<49:31:38,  8.82s/it]
 47%|████▋     | 17755/37963 [40:12:24<47:24:56,  8.45s/it]
 47%|████▋     | 17756/37963 [40:12:32<46:34:48,  8.30s/it]
 47%|████▋     | 17757/37963 [40:12:40<46:00:43,  8.20s/it]
 47%|████▋     | 17758/37963 [40:12:47<45:05:49,  8.04s/it]
 47%|████▋     | 17759/37963 [40:12:55<44:46:25,  7.98s/it]
 47%|████▋     | 17760/37963 [40:13:03<44:22:14,  7.91s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '3.437', 'learning_rate': '1.152e-05', 'epoch': '0.4678'}
+
 47%|████▋     | 17760/37963 [40:13:03<44:22:14,  7.91s/it]
 47%|████▋     | 17761/37963 [40:13:11<44:00:01,  7.84s/it]
 47%|████▋     | 17762/37963 [40:13:18<43:53:10,  7.82s/it]
 47%|████▋     | 17763/37963 [40:13:26<44:04:50,  7.86s/it]
 47%|████▋     | 17764/37963 [40:13:34<44:07:55,  7.87s/it]
 47%|████▋     | 17765/37963 [40:13:42<44:10:20,  7.87s/it]
 47%|████���     | 17766/37963 [40:13:50<44:04:43,  7.86s/it]
 47%|████▋     | 17767/37963 [40:13:57<43:34:40,  7.77s/it]
 47%|████▋     | 17768/37963 [40:14:05<43:31:57,  7.76s/it]
 47%|████▋     | 17769/37963 [40:14:13<43:15:38,  7.71s/it]
 47%|████▋     | 17770/37963 [40:14:21<43:24:57,  7.74s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '1.525', 'learning_rate': '1.151e-05', 'epoch': '0.4681'}
+
 47%|████▋     | 17770/37963 [40:14:21<43:24:57,  7.74s/it]
 47%|████▋     | 17771/37963 [40:14:28<43:16:35,  7.72s/it]
 47%|████▋     | 17772/37963 [40:14:36<43:36:22,  7.77s/it]
 47%|████▋     | 17773/37963 [40:14:46<47:52:29,  8.54s/it]
 47%|████▋     | 17774/37963 [40:14:57<50:44:13,  9.05s/it]
 47%|████▋     | 17775/37963 [40:15:05<49:05:41,  8.75s/it]
 47%|████▋     | 17776/37963 [40:15:12<47:18:08,  8.44s/it]
 47%|████▋     | 17777/37963 [40:15:20<46:38:49,  8.32s/it]
 47%|████▋     | 17778/37963 [40:15:28<45:05:25,  8.04s/it]
 47%|████▋     | 17779/37963 [40:15:36<44:28:13,  7.93s/it]
 47%|████▋     | 17780/37963 [40:15:43<43:47:28,  7.81s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '1.299', 'learning_rate': '1.151e-05', 'epoch': '0.4684'}
+
 47%|████▋     | 17780/37963 [40:15:43<43:47:28,  7.81s/it]
 47%|████▋     | 17781/37963 [40:15:51<43:52:52,  7.83s/it]
 47%|████▋     | 17782/37963 [40:15:59<43:56:16,  7.84s/it]
 47%|████▋     | 17783/37963 [40:16:07<43:45:26,  7.81s/it]
 47%|████▋     | 17784/37963 [40:16:14<43:58:20,  7.84s/it]
 47%|████▋     | 17785/37963 [40:16:22<43:51:15,  7.82s/it]
 47%|████▋     | 17786/37963 [40:16:32<47:56:41,  8.55s/it]
 47%|████▋     | 17787/37963 [40:16:40<46:08:36,  8.23s/it]
 47%|████▋     | 17788/37963 [40:16:53<53:54:12,  9.62s/it]
 47%|████▋     | 17789/37963 [40:17:01<51:08:08,  9.13s/it]
 47%|████▋     | 17790/37963 [40:17:08<48:29:03,  8.65s/it]
                                                           
{'loss': '0.1577', 'grad_norm': '4.61', 'learning_rate': '1.15e-05', 'epoch': '0.4686'}
+
 47%|████▋     | 17790/37963 [40:17:08<48:29:03,  8.65s/it]
 47%|████▋     | 17791/37963 [40:17:16<46:58:07,  8.38s/it]
 47%|████▋     | 17792/37963 [40:17:24<45:56:14,  8.20s/it]
 47%|████▋     | 17793/37963 [40:17:32<45:19:31,  8.09s/it]
 47%|████▋     | 17794/37963 [40:17:39<44:25:57,  7.93s/it]
 47%|████▋     | 17795/37963 [40:17:47<44:08:16,  7.88s/it]
 47%|████▋     | 17796/37963 [40:17:55<43:41:21,  7.80s/it]
 47%|████▋     | 17797/37963 [40:18:02<43:28:42,  7.76s/it]
 47%|████▋     | 17798/37963 [40:18:10<43:15:09,  7.72s/it]
 47%|████▋     | 17799/37963 [40:18:18<43:27:55,  7.76s/it]
 47%|████▋     | 17800/37963 [40:18:28<47:46:28,  8.53s/it]
                                                           
{'loss': '0.1677', 'grad_norm': '3.43', 'learning_rate': '1.149e-05', 'epoch': '0.4689'}
+
 47%|████▋     | 17800/37963 [40:18:28<47:46:28,  8.53s/it]
 47%|████▋     | 17801/37963 [40:18:39<50:53:27,  9.09s/it]
 47%|████▋     | 17802/37963 [40:18:46<48:26:51,  8.65s/it]
 47%|████▋     | 17803/37963 [40:18:54<46:30:42,  8.31s/it]
 47%|████▋     | 17804/37963 [40:19:01<45:41:36,  8.16s/it]
 47%|████▋     | 17805/37963 [40:19:09<44:50:58,  8.01s/it]
 47%|████▋     | 17806/37963 [40:19:19<48:13:37,  8.61s/it]
 47%|████▋     | 17807/37963 [40:19:27<46:53:12,  8.37s/it]
 47%|████▋     | 17808/37963 [40:19:35<45:56:44,  8.21s/it]
 47%|████▋     | 17809/37963 [40:19:42<45:06:25,  8.06s/it]
 47%|████▋     | 17810/37963 [40:19:50<44:35:25,  7.97s/it]
                                                           
{'loss': '0.1667', 'grad_norm': '0.8537', 'learning_rate': '1.148e-05', 'epoch': '0.4691'}
+
 47%|████▋     | 17810/37963 [40:19:50<44:35:25,  7.97s/it]
 47%|████▋     | 17811/37963 [40:19:58<43:39:40,  7.80s/it]
 47%|████▋     | 17812/37963 [40:20:05<42:55:36,  7.67s/it]
 47%|████▋     | 17813/37963 [40:20:13<43:03:15,  7.69s/it]
 47%|████▋     | 17814/37963 [40:20:20<42:59:49,  7.68s/it]
 47%|████▋     | 17815/37963 [40:20:28<42:55:08,  7.67s/it]
 47%|████▋     | 17816/37963 [40:20:36<42:58:10,  7.68s/it]
 47%|████▋     | 17817/37963 [40:20:46<47:13:02,  8.44s/it]
 47%|████▋     | 17818/37963 [40:20:54<46:40:00,  8.34s/it]
 47%|████▋     | 17819/37963 [40:21:02<45:31:50,  8.14s/it]
 47%|████▋     | 17820/37963 [40:21:10<45:10:48,  8.07s/it]
                                                           
{'loss': '0.1675', 'grad_norm': '2.361', 'learning_rate': '1.147e-05', 'epoch': '0.4694'}
+
 47%|████▋     | 17820/37963 [40:21:10<45:10:48,  8.07s/it]
 47%|████▋     | 17821/37963 [40:21:17<44:36:06,  7.97s/it]
 47%|████▋     | 17822/37963 [40:21:28<48:38:04,  8.69s/it]
 47%|████▋     | 17823/37963 [40:21:35<46:57:15,  8.39s/it]
 47%|████▋     | 17824/37963 [40:21:43<45:51:43,  8.20s/it]
 47%|████▋     | 17825/37963 [40:21:50<44:11:25,  7.90s/it]
 47%|████▋     | 17826/37963 [40:21:58<43:57:48,  7.86s/it]
 47%|████▋     | 17827/37963 [40:22:06<43:19:12,  7.74s/it]
 47%|████▋     | 17828/37963 [40:22:13<43:12:59,  7.73s/it]
 47%|████▋     | 17829/37963 [40:22:21<42:57:45,  7.68s/it]
 47%|████▋     | 17830/37963 [40:22:29<42:58:02,  7.68s/it]
                                                           
{'loss': '0.1618', 'grad_norm': '1.555', 'learning_rate': '1.146e-05', 'epoch': '0.4697'}
+
 47%|████▋     | 17830/37963 [40:22:29<42:58:02,  7.68s/it]
 47%|████▋     | 17831/37963 [40:22:36<43:03:38,  7.70s/it]
 47%|████▋     | 17832/37963 [40:22:44<42:58:10,  7.68s/it]
 47%|████▋     | 17833/37963 [40:22:52<43:05:39,  7.71s/it]
 47%|████▋     | 17834/37963 [40:23:00<43:14:54,  7.73s/it]
 47%|████▋     | 17835/37963 [40:23:10<48:21:33,  8.65s/it]
 47%|████▋     | 17836/37963 [40:23:21<51:31:05,  9.21s/it]
 47%|████▋     | 17837/37963 [40:23:29<49:07:54,  8.79s/it]
 47%|████▋     | 17838/37963 [40:23:36<46:54:55,  8.39s/it]
 47%|████▋     | 17839/37963 [40:23:44<45:32:15,  8.15s/it]
 47%|████▋     | 17840/37963 [40:23:51<44:26:58,  7.95s/it]
                                                           
{'loss': '0.1541', 'grad_norm': '2.192', 'learning_rate': '1.146e-05', 'epoch': '0.4699'}
+
 47%|████▋     | 17840/37963 [40:23:51<44:26:58,  7.95s/it]
 47%|████▋     | 17841/37963 [40:23:59<43:29:14,  7.78s/it]
 47%|████▋     | 17842/37963 [40:24:09<47:48:09,  8.55s/it]
 47%|████▋     | 17843/37963 [40:24:17<46:35:24,  8.34s/it]
 47%|████▋     | 17844/37963 [40:24:25<45:48:31,  8.20s/it]
 47%|████▋     | 17845/37963 [40:24:32<44:17:44,  7.93s/it]
 47%|████▋     | 17846/37963 [40:24:40<43:44:49,  7.83s/it]
 47%|████▋     | 17847/37963 [40:24:47<43:21:05,  7.76s/it]
 47%|████▋     | 17848/37963 [40:24:57<47:21:03,  8.47s/it]
 47%|████▋     | 17849/37963 [40:25:05<46:26:20,  8.31s/it]
 47%|████▋     | 17850/37963 [40:25:13<45:38:40,  8.17s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '2.772', 'learning_rate': '1.145e-05', 'epoch': '0.4702'}
+
 47%|████▋     | 17850/37963 [40:25:13<45:38:40,  8.17s/it]
 47%|████▋     | 17851/37963 [40:25:21<45:01:05,  8.06s/it]
 47%|████▋     | 17852/37963 [40:25:28<44:15:21,  7.92s/it]
 47%|████▋     | 17853/37963 [40:25:39<48:14:15,  8.64s/it]
 47%|████▋     | 17854/37963 [40:25:49<51:10:30,  9.16s/it]
 47%|████▋     | 17855/37963 [40:25:57<48:34:03,  8.70s/it]
 47%|████▋     | 17856/37963 [40:26:04<46:43:35,  8.37s/it]
 47%|████▋     | 17857/37963 [40:26:12<45:07:01,  8.08s/it]
 47%|████▋     | 17858/37963 [40:26:19<44:27:26,  7.96s/it]
 47%|████▋     | 17859/37963 [40:26:27<44:04:14,  7.89s/it]
 47%|████▋     | 17860/37963 [40:26:35<43:18:58,  7.76s/it]
                                                           
{'loss': '0.1541', 'grad_norm': '2.261', 'learning_rate': '1.144e-05', 'epoch': '0.4705'}
+
 47%|████▋     | 17860/37963 [40:26:35<43:18:58,  7.76s/it]
 47%|████▋     | 17861/37963 [40:26:42<43:16:38,  7.75s/it]
 47%|████▋     | 17862/37963 [40:26:50<43:04:17,  7.71s/it]
 47%|████▋     | 17863/37963 [40:26:58<43:10:36,  7.73s/it]
 47%|████▋     | 17864/37963 [40:27:05<43:06:01,  7.72s/it]
 47%|████▋     | 17865/37963 [40:27:13<43:02:30,  7.71s/it]
 47%|████▋     | 17866/37963 [40:27:23<47:23:14,  8.49s/it]
 47%|████▋     | 17867/37963 [40:27:31<46:05:24,  8.26s/it]
 47%|████▋     | 17868/37963 [40:27:39<45:03:56,  8.07s/it]
 47%|████▋     | 17869/37963 [40:27:47<44:35:14,  7.99s/it]
 47%|████▋     | 17870/37963 [40:27:54<44:11:43,  7.92s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '1.966', 'learning_rate': '1.143e-05', 'epoch': '0.4707'}
+
 47%|████▋     | 17870/37963 [40:27:54<44:11:43,  7.92s/it]
 47%|████▋     | 17871/37963 [40:28:05<48:17:33,  8.65s/it]
 47%|████▋     | 17872/37963 [40:28:13<47:01:23,  8.43s/it]
 47%|████▋     | 17873/37963 [40:28:20<45:36:10,  8.17s/it]
 47%|████▋     | 17874/37963 [40:28:28<44:48:36,  8.03s/it]
 47%|████▋     | 17875/37963 [40:28:35<43:48:45,  7.85s/it]
 47%|████▋     | 17876/37963 [40:28:43<43:40:19,  7.83s/it]
 47%|████▋     | 17877/37963 [40:28:51<43:54:19,  7.87s/it]
 47%|████▋     | 17878/37963 [40:28:59<43:27:27,  7.79s/it]
 47%|████▋     | 17879/37963 [40:29:06<43:09:46,  7.74s/it]
 47%|████▋     | 17880/37963 [40:29:14<42:52:16,  7.68s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '1.713', 'learning_rate': '1.142e-05', 'epoch': '0.471'}
+
 47%|████▋     | 17880/37963 [40:29:14<42:52:16,  7.68s/it]
 47%|████▋     | 17881/37963 [40:29:22<42:55:09,  7.69s/it]
 47%|████▋     | 17882/37963 [40:29:29<42:58:17,  7.70s/it]
 47%|████▋     | 17883/37963 [40:29:37<42:48:24,  7.67s/it]
 47%|████▋     | 17884/37963 [40:29:45<43:05:11,  7.73s/it]
 47%|████▋     | 17885/37963 [40:29:53<43:22:48,  7.78s/it]
 47%|████▋     | 17886/37963 [40:30:00<43:05:16,  7.73s/it]
 47%|████▋     | 17887/37963 [40:30:08<42:52:27,  7.69s/it]
 47%|████▋     | 17888/37963 [40:30:16<42:57:34,  7.70s/it]
 47%|████▋     | 17889/37963 [40:30:26<48:02:53,  8.62s/it]
 47%|████▋     | 17890/37963 [40:30:37<50:59:06,  9.14s/it]
                                                           
{'loss': '0.1684', 'grad_norm': '2.197', 'learning_rate': '1.141e-05', 'epoch': '0.4712'}
+
 47%|████▋     | 17890/37963 [40:30:37<50:59:06,  9.14s/it]
 47%|████▋     | 17891/37963 [40:30:47<53:05:26,  9.52s/it]
 47%|████▋     | 17892/37963 [40:30:55<49:52:54,  8.95s/it]
 47%|████▋     | 17893/37963 [40:31:03<48:02:57,  8.62s/it]
 47%|████▋     | 17894/37963 [40:31:10<46:38:03,  8.37s/it]
 47%|████▋     | 17895/37963 [40:31:18<45:38:41,  8.19s/it]
 47%|████▋     | 17896/37963 [40:31:28<49:19:08,  8.85s/it]
 47%|████▋     | 17897/37963 [40:31:39<52:11:38,  9.36s/it]
 47%|████▋     | 17898/37963 [40:31:47<49:21:14,  8.85s/it]
 47%|████▋     | 17899/37963 [40:31:54<46:56:45,  8.42s/it]
 47%|████▋     | 17900/37963 [40:32:02<46:18:44,  8.31s/it]
                                                           
{'loss': '0.1644', 'grad_norm': '1.975', 'learning_rate': '1.14e-05', 'epoch': '0.4715'}
+
 47%|████▋     | 17900/37963 [40:32:02<46:18:44,  8.31s/it]
 47%|████▋     | 17901/37963 [40:32:10<45:17:58,  8.13s/it]
 47%|████▋     | 17902/37963 [40:32:18<44:29:04,  7.98s/it]
 47%|████▋     | 17903/37963 [40:32:25<43:56:42,  7.89s/it]
 47%|████▋     | 17904/37963 [40:32:33<43:23:03,  7.79s/it]
 47%|████▋     | 17905/37963 [40:32:41<43:41:18,  7.84s/it]
 47%|████▋     | 17906/37963 [40:32:49<43:39:28,  7.84s/it]
 47%|████▋     | 17907/37963 [40:32:56<42:51:07,  7.69s/it]
 47%|████▋     | 17908/37963 [40:33:06<47:17:26,  8.49s/it]
 47%|████▋     | 17909/37963 [40:33:16<50:10:02,  9.01s/it]
 47%|████▋     | 17910/37963 [40:33:24<48:10:23,  8.65s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '1.902', 'learning_rate': '1.14e-05', 'epoch': '0.4718'}
+
 47%|████▋     | 17910/37963 [40:33:24<48:10:23,  8.65s/it]
 47%|████▋     | 17911/37963 [40:33:32<46:30:14,  8.35s/it]
 47%|████▋     | 17912/37963 [40:33:40<45:47:06,  8.22s/it]
 47%|████▋     | 17913/37963 [40:33:47<44:48:26,  8.05s/it]
 47%|████▋     | 17914/37963 [40:33:55<44:08:54,  7.93s/it]
 47%|████▋     | 17915/37963 [40:34:03<43:15:19,  7.77s/it]
 47%|████▋     | 17916/37963 [40:34:10<43:03:07,  7.73s/it]
 47%|████▋     | 17917/37963 [40:34:18<42:36:30,  7.65s/it]
 47%|████▋     | 17918/37963 [40:34:25<42:41:15,  7.67s/it]
 47%|████▋     | 17919/37963 [40:34:35<46:42:09,  8.39s/it]
 47%|████▋     | 17920/37963 [40:34:43<45:36:26,  8.19s/it]
                                                           
{'loss': '0.1629', 'grad_norm': '1.963', 'learning_rate': '1.139e-05', 'epoch': '0.472'}
+
 47%|████▋     | 17920/37963 [40:34:43<45:36:26,  8.19s/it]
 47%|████▋     | 17921/37963 [40:34:51<44:37:09,  8.01s/it]
 47%|████▋     | 17922/37963 [40:34:58<44:08:41,  7.93s/it]
 47%|████▋     | 17923/37963 [40:35:06<44:00:29,  7.91s/it]
 47%|████▋     | 17924/37963 [40:35:14<43:01:30,  7.73s/it]
 47%|████▋     | 17925/37963 [40:35:21<42:41:55,  7.67s/it]
 47%|████▋     | 17926/37963 [40:35:29<43:01:46,  7.73s/it]
 47%|████▋     | 17927/37963 [40:35:37<42:40:23,  7.67s/it]
 47%|████▋     | 17928/37963 [40:35:44<42:45:11,  7.68s/it]
 47%|████▋     | 17929/37963 [40:35:52<42:45:57,  7.68s/it]
 47%|████▋     | 17930/37963 [40:36:00<42:54:18,  7.71s/it]
                                                           
{'loss': '0.1484', 'grad_norm': '1.453', 'learning_rate': '1.138e-05', 'epoch': '0.4723'}
+
 47%|████▋     | 17930/37963 [40:36:00<42:54:18,  7.71s/it]
 47%|████▋     | 17931/37963 [40:36:07<42:51:25,  7.70s/it]
 47%|████▋     | 17932/37963 [40:36:15<42:41:10,  7.67s/it]
 47%|████▋     | 17933/37963 [40:36:23<42:53:34,  7.71s/it]
 47%|████▋     | 17934/37963 [40:36:30<42:48:49,  7.70s/it]
 47%|████▋     | 17935/37963 [40:36:38<42:30:21,  7.64s/it]
 47%|████▋     | 17936/37963 [40:36:45<42:11:47,  7.59s/it]
 47%|████▋     | 17937/37963 [40:36:53<42:18:55,  7.61s/it]
 47%|████▋     | 17938/37963 [40:37:01<42:55:15,  7.72s/it]
 47%|████▋     | 17939/37963 [40:37:09<42:49:22,  7.70s/it]
 47%|████▋     | 17940/37963 [40:37:19<47:06:15,  8.47s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '1.117', 'learning_rate': '1.137e-05', 'epoch': '0.4726'}
+
 47%|████▋     | 17940/37963 [40:37:19<47:06:15,  8.47s/it]
 47%|████▋     | 17941/37963 [40:37:27<46:15:51,  8.32s/it]
 47%|████▋     | 17942/37963 [40:37:35<45:16:27,  8.14s/it]
 47%|████▋     | 17943/37963 [40:37:45<49:16:10,  8.86s/it]
 47%|████▋     | 17944/37963 [40:37:56<51:49:58,  9.32s/it]
 47%|████▋     | 17945/37963 [40:38:09<58:43:00, 10.56s/it]
 47%|████▋     | 17946/37963 [40:38:17<53:45:43,  9.67s/it]
 47%|████▋     | 17947/37963 [40:38:24<50:35:36,  9.10s/it]
 47%|████▋     | 17948/37963 [40:38:32<48:22:22,  8.70s/it]
 47%|████▋     | 17949/37963 [40:38:40<46:38:19,  8.39s/it]
 47%|████▋     | 17950/37963 [40:38:48<45:33:36,  8.20s/it]
                                                           
{'loss': '0.1655', 'grad_norm': '4.234', 'learning_rate': '1.136e-05', 'epoch': '0.4728'}
+
 47%|████▋     | 17950/37963 [40:38:48<45:33:36,  8.20s/it]
 47%|████▋     | 17951/37963 [40:38:55<44:38:58,  8.03s/it]
 47%|████▋     | 17952/37963 [40:39:03<43:56:01,  7.90s/it]
 47%|████▋     | 17953/37963 [40:39:10<43:18:04,  7.79s/it]
 47%|████▋     | 17954/37963 [40:39:18<43:08:18,  7.76s/it]
 47%|████▋     | 17955/37963 [40:39:26<43:06:41,  7.76s/it]
 47%|████▋     | 17956/37963 [40:39:36<47:12:08,  8.49s/it]
 47%|████▋     | 17957/37963 [40:39:44<45:44:58,  8.23s/it]
 47%|████▋     | 17958/37963 [40:39:51<44:37:05,  8.03s/it]
 47%|████▋     | 17959/37963 [40:39:59<43:51:20,  7.89s/it]
 47%|████▋     | 17960/37963 [40:40:06<43:22:06,  7.81s/it]
                                                           
{'loss': '0.1542', 'grad_norm': '1.391', 'learning_rate': '1.135e-05', 'epoch': '0.4731'}
+
 47%|████▋     | 17960/37963 [40:40:06<43:22:06,  7.81s/it]
 47%|████▋     | 17961/37963 [40:40:14<43:15:37,  7.79s/it]
 47%|████▋     | 17962/37963 [40:40:24<47:03:49,  8.47s/it]
 47%|████▋     | 17963/37963 [40:40:32<46:11:35,  8.31s/it]
 47%|████▋     | 17964/37963 [40:40:40<45:23:02,  8.17s/it]
 47%|████▋     | 17965/37963 [40:40:48<44:34:46,  8.03s/it]
 47%|████▋     | 17966/37963 [40:40:55<43:33:04,  7.84s/it]
 47%|████▋     | 17967/37963 [40:41:05<47:28:38,  8.55s/it]
 47%|████▋     | 17968/37963 [40:41:13<46:14:47,  8.33s/it]
 47%|████▋     | 17969/37963 [40:41:21<45:14:30,  8.15s/it]
 47%|████▋     | 17970/37963 [40:41:29<44:33:06,  8.02s/it]
                                                           
{'loss': '0.1637', 'grad_norm': '1.447', 'learning_rate': '1.135e-05', 'epoch': '0.4734'}
+
 47%|████▋     | 17970/37963 [40:41:29<44:33:06,  8.02s/it]
 47%|████▋     | 17971/37963 [40:41:36<44:06:00,  7.94s/it]
 47%|████▋     | 17972/37963 [40:41:44<43:44:55,  7.88s/it]
 47%|████▋     | 17973/37963 [40:41:52<43:16:18,  7.79s/it]
 47%|████▋     | 17974/37963 [40:41:59<42:59:56,  7.74s/it]
 47%|████▋     | 17975/37963 [40:42:07<43:11:26,  7.78s/it]
 47%|████▋     | 17976/37963 [40:42:15<43:00:13,  7.75s/it]
 47%|████▋     | 17977/37963 [40:42:22<42:47:37,  7.71s/it]
 47%|████▋     | 17978/37963 [40:42:30<42:30:46,  7.66s/it]
 47%|████▋     | 17979/37963 [40:42:37<42:12:10,  7.60s/it]
 47%|████▋     | 17980/37963 [40:42:45<42:41:44,  7.69s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '3.427', 'learning_rate': '1.134e-05', 'epoch': '0.4736'}
+
 47%|████▋     | 17980/37963 [40:42:45<42:41:44,  7.69s/it]
 47%|████▋     | 17981/37963 [40:42:53<43:12:05,  7.78s/it]
 47%|████▋     | 17982/37963 [40:43:01<43:20:56,  7.81s/it]
 47%|████▋     | 17983/37963 [40:43:09<43:02:28,  7.76s/it]
 47%|████▋     | 17984/37963 [40:43:17<43:05:54,  7.77s/it]
 47%|████▋     | 17985/37963 [40:43:25<43:26:22,  7.83s/it]
 47%|████▋     | 17986/37963 [40:43:35<47:30:45,  8.56s/it]
 47%|████▋     | 17987/37963 [40:43:43<46:20:25,  8.35s/it]
 47%|████▋     | 17988/37963 [40:43:55<53:41:18,  9.68s/it]
 47%|█��██▋     | 17989/37963 [40:44:03<50:39:55,  9.13s/it]
 47%|████▋     | 17990/37963 [40:44:11<47:46:12,  8.61s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '1.598', 'learning_rate': '1.133e-05', 'epoch': '0.4739'}
+
 47%|████▋     | 17990/37963 [40:44:11<47:46:12,  8.61s/it]
 47%|████▋     | 17991/37963 [40:44:22<51:20:28,  9.25s/it]
 47%|████▋     | 17992/37963 [40:44:32<53:15:18,  9.60s/it]
 47%|████▋     | 17993/37963 [40:44:40<50:17:10,  9.07s/it]
 47%|████▋     | 17994/37963 [40:44:47<47:55:22,  8.64s/it]
 47%|████▋     | 17995/37963 [40:44:55<46:11:33,  8.33s/it]
 47%|████▋     | 17996/37963 [40:45:03<45:08:24,  8.14s/it]
 47%|████▋     | 17997/37963 [40:45:10<44:19:42,  7.99s/it]
 47%|████▋     | 17998/37963 [40:45:18<43:46:35,  7.89s/it]
 47%|████▋     | 17999/37963 [40:45:26<43:20:54,  7.82s/it]
 47%|████▋     | 18000/37963 [40:45:33<43:00:14,  7.76s/it]
                                                           
{'loss': '0.1646', 'grad_norm': '2.134', 'learning_rate': '1.132e-05', 'epoch': '0.4741'}
+
 47%|████▋     | 18000/37963 [40:45:33<43:00:14,  7.76s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.73s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.73s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 47%|████▋     | 18001/37963 [40:46:35<133:09:42, 24.01s/it]
 47%|████▋     | 18002/37963 [40:46:43<106:18:16, 19.17s/it]
 47%|████▋     | 18003/37963 [40:46:51<87:08:33, 15.72s/it] 
 47%|████▋     | 18004/37963 [40:46:58<73:28:56, 13.25s/it]
 47%|████▋     | 18005/37963 [40:47:06<64:26:32, 11.62s/it]
 47%|████▋     | 18006/37963 [40:47:16<62:05:37, 11.20s/it]
 47%|████▋     | 18007/37963 [40:47:27<60:51:54, 10.98s/it]
 47%|████▋     | 18008/37963 [40:47:35<55:49:03, 10.07s/it]
 47%|████▋     | 18009/37963 [40:47:45<55:40:52, 10.05s/it]
 47%|████▋     | 18010/37963 [40:47:52<51:31:36,  9.30s/it]
                                                           
{'loss': '0.1708', 'grad_norm': '4.632', 'learning_rate': '1.131e-05', 'epoch': '0.4744'}
+
 47%|████▋     | 18010/37963 [40:47:52<51:31:36,  9.30s/it]
 47%|████▋     | 18011/37963 [40:48:00<48:50:10,  8.81s/it]
 47%|████▋     | 18012/37963 [40:48:08<46:53:25,  8.46s/it]
 47%|████▋     | 18013/37963 [40:48:15<45:47:04,  8.26s/it]
 47%|████▋     | 18014/37963 [40:48:23<45:00:32,  8.12s/it]
 47%|████▋     | 18015/37963 [40:48:31<44:04:44,  7.95s/it]
 47%|████▋     | 18016/37963 [40:48:38<43:23:07,  7.83s/it]
 47%|████▋     | 18017/37963 [40:48:46<43:05:03,  7.78s/it]
 47%|████▋     | 18018/37963 [40:48:54<43:11:42,  7.80s/it]
 47%|████▋     | 18019/37963 [40:49:02<43:27:24,  7.84s/it]
 47%|████▋     | 18020/37963 [40:49:09<42:55:52,  7.75s/it]
                                                           
{'loss': '0.1552', 'grad_norm': '2.853', 'learning_rate': '1.13e-05', 'epoch': '0.4747'}
+
 47%|████▋     | 18020/37963 [40:49:09<42:55:52,  7.75s/it]
 47%|████▋     | 18021/37963 [40:49:17<43:14:51,  7.81s/it]
 47%|████▋     | 18022/37963 [40:49:25<43:33:04,  7.86s/it]
 47%|████▋     | 18023/37963 [40:49:33<43:26:10,  7.84s/it]
 47%|████▋     | 18024/37963 [40:49:41<43:03:45,  7.78s/it]
 47%|████▋     | 18025/37963 [40:49:48<43:14:58,  7.81s/it]
 47%|████▋     | 18026/37963 [40:49:56<43:01:18,  7.77s/it]
 47%|████▋     | 18027/37963 [40:50:04<43:03:33,  7.78s/it]
 47%|████▋     | 18028/37963 [40:50:12<43:06:00,  7.78s/it]
 47%|████▋     | 18029/37963 [40:50:20<43:16:58,  7.82s/it]
 47%|████▋     | 18030/37963 [40:50:28<43:25:30,  7.84s/it]
                                                           
{'loss': '0.1536', 'grad_norm': '1.631', 'learning_rate': '1.129e-05', 'epoch': '0.4749'}
+
 47%|████▋     | 18030/37963 [40:50:28<43:25:30,  7.84s/it]
 47%|████▋     | 18031/37963 [40:50:38<47:44:00,  8.62s/it]
 47%|████▋     | 18032/37963 [40:50:48<50:07:51,  9.05s/it]
 48%|████▊     | 18033/37963 [40:50:56<47:55:09,  8.66s/it]
 48%|████▊     | 18034/37963 [40:51:04<46:44:57,  8.44s/it]
 48%|████▊     | 18035/37963 [40:51:12<45:50:19,  8.28s/it]
 48%|████▊     | 18036/37963 [40:51:19<44:43:03,  8.08s/it]
 48%|████▊     | 18037/37963 [40:51:27<43:53:52,  7.93s/it]
 48%|████▊     | 18038/37963 [40:51:37<48:11:44,  8.71s/it]
 48%|████▊     | 18039/37963 [40:51:48<51:05:54,  9.23s/it]
 48%|████▊     | 18040/37963 [40:51:58<53:29:50,  9.67s/it]
                                                           
{'loss': '0.1695', 'grad_norm': '1.524', 'learning_rate': '1.129e-05', 'epoch': '0.4752'}
+
 48%|████▊     | 18040/37963 [40:51:58<53:29:50,  9.67s/it]
 48%|████▊     | 18041/37963 [40:52:06<50:16:46,  9.09s/it]
 48%|████▊     | 18042/37963 [40:52:14<48:13:12,  8.71s/it]
 48%|████▊     | 18043/37963 [40:52:22<47:06:30,  8.51s/it]
 48%|████▊     | 18044/37963 [40:52:30<46:02:18,  8.32s/it]
 48%|████▊     | 18045/37963 [40:52:38<45:21:43,  8.20s/it]
 48%|████▊     | 18046/37963 [40:52:46<44:46:10,  8.09s/it]
 48%|████▊     | 18047/37963 [40:52:53<44:01:22,  7.96s/it]
 48%|████▊     | 18048/37963 [40:53:01<43:43:28,  7.90s/it]
 48%|████▊     | 18049/37963 [40:53:09<43:30:48,  7.87s/it]
 48%|████▊     | 18050/37963 [40:53:19<46:46:04,  8.46s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '2.051', 'learning_rate': '1.128e-05', 'epoch': '0.4755'}
+
 48%|████▊     | 18050/37963 [40:53:19<46:46:04,  8.46s/it]
 48%|████▊     | 18051/37963 [40:53:29<50:12:34,  9.08s/it]
 48%|████▊     | 18052/37963 [40:53:37<48:49:16,  8.83s/it]
 48%|████▊     | 18053/37963 [40:53:45<47:02:42,  8.51s/it]
 48%|████▊     | 18054/37963 [40:53:53<46:04:38,  8.33s/it]
 48%|████▊     | 18055/37963 [40:54:01<45:04:33,  8.15s/it]
 48%|████▊     | 18056/37963 [40:54:08<44:07:17,  7.98s/it]
 48%|████▊     | 18057/37963 [40:54:16<43:11:16,  7.81s/it]
 48%|████▊     | 18058/37963 [40:54:26<47:16:25,  8.55s/it]
 48%|████▊     | 18059/37963 [40:54:34<45:58:19,  8.31s/it]
 48%|████▊     | 18060/37963 [40:54:42<44:50:54,  8.11s/it]
                                                           
{'loss': '0.1593', 'grad_norm': '2.364', 'learning_rate': '1.127e-05', 'epoch': '0.4757'}
+
 48%|████▊     | 18060/37963 [40:54:42<44:50:54,  8.11s/it]
 48%|████▊     | 18061/37963 [40:54:49<43:59:08,  7.96s/it]
 48%|████▊     | 18062/37963 [40:54:57<43:30:42,  7.87s/it]
 48%|████▊     | 18063/37963 [40:55:05<43:08:56,  7.81s/it]
 48%|████▊     | 18064/37963 [40:55:12<42:50:21,  7.75s/it]
 48%|████▊     | 18065/37963 [40:55:20<42:52:00,  7.76s/it]
 48%|████▊     | 18066/37963 [40:55:28<43:04:36,  7.79s/it]
 48%|████▊     | 18067/37963 [40:55:35<42:47:48,  7.74s/it]
 48%|████▊     | 18068/37963 [40:55:43<42:57:45,  7.77s/it]
 48%|████▊     | 18069/37963 [40:55:51<42:38:04,  7.72s/it]
 48%|████▊     | 18070/37963 [40:55:58<42:30:12,  7.69s/it]
                                                           
{'loss': '0.1495', 'grad_norm': '1.62', 'learning_rate': '1.126e-05', 'epoch': '0.476'}
+
 48%|████▊     | 18070/37963 [40:55:58<42:30:12,  7.69s/it]
 48%|████▊     | 18071/37963 [40:56:06<42:25:20,  7.68s/it]
 48%|████▊     | 18072/37963 [40:56:14<42:23:44,  7.67s/it]
 48%|████▊     | 18073/37963 [40:56:21<41:46:19,  7.56s/it]
 48%|████▊     | 18074/37963 [40:56:29<42:02:55,  7.61s/it]
 48%|████▊     | 18075/37963 [40:56:36<42:04:08,  7.62s/it]
 48%|████▊     | 18076/37963 [40:56:44<42:05:57,  7.62s/it]
 48%|████▊     | 18077/37963 [40:56:52<42:28:02,  7.69s/it]
 48%|████▊     | 18078/37963 [40:56:59<41:39:51,  7.54s/it]
 48%|████▊     | 18079/37963 [40:57:09<45:57:14,  8.32s/it]
 48%|████▊     | 18080/37963 [40:57:19<48:41:09,  8.82s/it]
                                                           
{'loss': '0.1627', 'grad_norm': '2.896', 'learning_rate': '1.125e-05', 'epoch': '0.4763'}
+
 48%|████▊     | 18080/37963 [40:57:19<48:41:09,  8.82s/it]
 48%|████▊     | 18081/37963 [40:57:30<51:39:37,  9.35s/it]
 48%|████▊     | 18082/37963 [40:57:38<49:04:20,  8.89s/it]
 48%|████▊     | 18083/37963 [40:57:45<47:01:45,  8.52s/it]
 48%|████▊     | 18084/37963 [40:57:53<45:51:48,  8.31s/it]
 48%|████▊     | 18085/37963 [40:58:01<44:54:52,  8.13s/it]
 48%|████▊     | 18086/37963 [40:58:09<44:26:09,  8.05s/it]
 48%|████▊     | 18087/37963 [40:58:19<47:57:25,  8.69s/it]
 48%|████▊     | 18088/37963 [40:58:30<51:25:53,  9.32s/it]
 48%|████▊     | 18089/37963 [40:58:38<49:07:27,  8.90s/it]
 48%|████▊     | 18090/37963 [40:58:45<47:15:43,  8.56s/it]
                                                           
{'loss': '0.1514', 'grad_norm': '3.675', 'learning_rate': '1.124e-05', 'epoch': '0.4765'}
+
 48%|████▊     | 18090/37963 [40:58:45<47:15:43,  8.56s/it]
 48%|████▊     | 18091/37963 [40:58:53<45:38:29,  8.27s/it]
 48%|████▊     | 18092/37963 [40:59:01<45:00:57,  8.16s/it]
 48%|████���     | 18093/37963 [40:59:08<43:38:56,  7.91s/it]
 48%|████▊     | 18094/37963 [40:59:19<47:54:16,  8.68s/it]
 48%|████▊     | 18095/37963 [40:59:26<46:05:07,  8.35s/it]
 48%|████▊     | 18096/37963 [40:59:34<44:27:24,  8.06s/it]
 48%|████▊     | 18097/37963 [40:59:41<43:44:39,  7.93s/it]
 48%|████▊     | 18098/37963 [40:59:49<43:19:25,  7.85s/it]
 48%|████▊     | 18099/37963 [40:59:59<47:14:14,  8.56s/it]
 48%|████▊     | 18100/37963 [41:00:07<46:03:23,  8.35s/it]
                                                           
{'loss': '0.1627', 'grad_norm': '2.58', 'learning_rate': '1.124e-05', 'epoch': '0.4768'}
+
 48%|████▊     | 18100/37963 [41:00:07<46:03:23,  8.35s/it]
 48%|████▊     | 18101/37963 [41:00:15<45:00:44,  8.16s/it]
 48%|████▊     | 18102/37963 [41:00:22<43:31:06,  7.89s/it]
 48%|████▊     | 18103/37963 [41:00:29<42:59:07,  7.79s/it]
 48%|████▊     | 18104/37963 [41:00:37<42:55:45,  7.78s/it]
 48%|████▊     | 18105/37963 [41:00:45<42:43:52,  7.75s/it]
 48%|████▊     | 18106/37963 [41:00:52<42:05:58,  7.63s/it]
 48%|████▊     | 18107/37963 [41:01:00<41:50:10,  7.59s/it]
 48%|████▊     | 18108/37963 [41:01:08<42:15:51,  7.66s/it]
 48%|████▊     | 18109/37963 [41:01:18<46:45:21,  8.48s/it]
 48%|████▊     | 18110/37963 [41:01:26<45:45:30,  8.30s/it]
                                                           
{'loss': '0.15', 'grad_norm': '2.233', 'learning_rate': '1.123e-05', 'epoch': '0.477'}
+
 48%|████▊     | 18110/37963 [41:01:26<45:45:30,  8.30s/it]
 48%|████▊     | 18111/37963 [41:01:34<44:54:51,  8.14s/it]
 48%|████▊     | 18112/37963 [41:01:41<43:57:02,  7.97s/it]
 48%|████▊     | 18113/37963 [41:01:49<43:00:03,  7.80s/it]
 48%|████▊     | 18114/37963 [41:01:56<42:35:20,  7.72s/it]
 48%|████▊     | 18115/37963 [41:02:04<42:26:00,  7.70s/it]
 48%|████▊     | 18116/37963 [41:02:12<42:49:54,  7.77s/it]
 48%|████▊     | 18117/37963 [41:02:19<42:47:55,  7.76s/it]
 48%|████▊     | 18118/37963 [41:02:27<42:59:43,  7.80s/it]
 48%|████▊     | 18119/37963 [41:02:35<42:47:51,  7.76s/it]
 48%|████▊     | 18120/37963 [41:02:43<42:29:54,  7.71s/it]
                                                           
{'loss': '0.1634', 'grad_norm': '1.266', 'learning_rate': '1.122e-05', 'epoch': '0.4773'}
+
 48%|████▊     | 18120/37963 [41:02:43<42:29:54,  7.71s/it]
 48%|████▊     | 18121/37963 [41:02:50<42:25:12,  7.70s/it]
 48%|████▊     | 18122/37963 [41:02:58<42:19:20,  7.68s/it]
 48%|████▊     | 18123/37963 [41:03:06<42:32:02,  7.72s/it]
 48%|████▊     | 18124/37963 [41:03:16<46:45:18,  8.48s/it]
 48%|████▊     | 18125/37963 [41:03:26<50:02:45,  9.08s/it]
 48%|████▊     | 18126/37963 [41:03:34<47:53:40,  8.69s/it]
 48%|████▊     | 18127/37963 [41:03:42<45:43:59,  8.30s/it]
 48%|████▊     | 18128/37963 [41:03:49<44:18:09,  8.04s/it]
 48%|████▊     | 18129/37963 [41:03:57<43:32:51,  7.90s/it]
 48%|████▊     | 18130/37963 [41:04:04<43:17:27,  7.86s/it]
                                                           
{'loss': '0.1621', 'grad_norm': '2.254', 'learning_rate': '1.121e-05', 'epoch': '0.4776'}
+
 48%|████▊     | 18130/37963 [41:04:04<43:17:27,  7.86s/it]
 48%|████▊     | 18131/37963 [41:04:12<42:18:46,  7.68s/it]
 48%|████▊     | 18132/37963 [41:04:19<42:25:59,  7.70s/it]
 48%|████▊     | 18133/37963 [41:04:27<42:41:06,  7.75s/it]
 48%|████▊     | 18134/37963 [41:04:35<42:52:19,  7.78s/it]
 48%|████▊     | 18135/37963 [41:04:48<51:48:02,  9.40s/it]
 48%|████▊     | 18136/37963 [41:04:59<53:53:26,  9.78s/it]
 48%|████▊     | 18137/37963 [41:05:07<50:33:09,  9.18s/it]
 48%|████▊     | 18138/37963 [41:05:14<48:05:23,  8.73s/it]
 48%|████▊     | 18139/37963 [41:05:22<46:09:38,  8.38s/it]
 48%|████▊     | 18140/37963 [41:05:30<44:56:08,  8.16s/it]
                                                           
{'loss': '0.1705', 'grad_norm': '5.047', 'learning_rate': '1.12e-05', 'epoch': '0.4778'}
+
 48%|████▊     | 18140/37963 [41:05:30<44:56:08,  8.16s/it]
 48%|████▊     | 18141/37963 [41:05:37<43:34:55,  7.92s/it]
 48%|████▊     | 18142/37963 [41:05:45<43:21:34,  7.88s/it]
 48%|████▊     | 18143/37963 [41:05:55<47:19:23,  8.60s/it]
 48%|████▊     | 18144/37963 [41:06:03<45:29:21,  8.26s/it]
 48%|████▊     | 18145/37963 [41:06:10<44:30:09,  8.08s/it]
 48%|████▊     | 18146/37963 [41:06:18<44:18:27,  8.05s/it]
 48%|████▊     | 18147/37963 [41:06:26<43:47:58,  7.96s/it]
 48%|████▊     | 18148/37963 [41:06:36<47:39:32,  8.66s/it]
 48%|████▊     | 18149/37963 [41:06:44<46:00:53,  8.36s/it]
 48%|████▊     | 18150/37963 [41:06:52<44:48:00,  8.14s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '1.791', 'learning_rate': '1.119e-05', 'epoch': '0.4781'}
+
 48%|████▊     | 18150/37963 [41:06:52<44:48:00,  8.14s/it]
 48%|████▊     | 18151/37963 [41:06:59<43:40:40,  7.94s/it]
 48%|████▊     | 18152/37963 [41:07:07<43:06:36,  7.83s/it]
 48%|████▊     | 18153/37963 [41:07:14<42:53:20,  7.79s/it]
 48%|████▊     | 18154/37963 [41:07:22<42:47:33,  7.78s/it]
 48%|████▊     | 18155/37963 [41:07:30<43:03:16,  7.82s/it]
 48%|████▊     | 18156/37963 [41:07:38<43:00:16,  7.82s/it]
 48%|████▊     | 18157/37963 [41:07:46<43:18:21,  7.87s/it]
 48%|████▊     | 18158/37963 [41:07:53<43:03:01,  7.83s/it]
 48%|████▊     | 18159/37963 [41:08:01<42:50:55,  7.79s/it]
 48%|████▊     | 18160/37963 [41:08:09<43:00:09,  7.82s/it]
                                                           
{'loss': '0.1535', 'grad_norm': '2.278', 'learning_rate': '1.118e-05', 'epoch': '0.4784'}
+
 48%|████▊     | 18160/37963 [41:08:09<43:00:09,  7.82s/it]
 48%|████▊     | 18161/37963 [41:08:17<43:05:05,  7.83s/it]
 48%|████▊     | 18162/37963 [41:08:25<43:06:34,  7.84s/it]
 48%|████▊     | 18163/37963 [41:08:35<47:08:10,  8.57s/it]
 48%|████▊     | 18164/37963 [41:08:43<45:58:28,  8.36s/it]
 48%|████▊     | 18165/37963 [41:08:51<44:46:36,  8.14s/it]
 48%|████▊     | 18166/37963 [41:08:58<44:10:19,  8.03s/it]
 48%|████▊     | 18167/37963 [41:09:06<44:04:11,  8.01s/it]
 48%|████▊     | 18168/37963 [41:09:14<43:39:57,  7.94s/it]
 48%|████▊     | 18169/37963 [41:09:22<43:19:42,  7.88s/it]
 48%|████▊     | 18170/37963 [41:09:32<47:09:39,  8.58s/it]
                                                           
{'loss': '0.1704', 'grad_norm': '2.235', 'learning_rate': '1.118e-05', 'epoch': '0.4786'}
+
 48%|████▊     | 18170/37963 [41:09:32<47:09:39,  8.58s/it]
 48%|████▊     | 18171/37963 [41:09:40<45:48:30,  8.33s/it]
 48%|████▊     | 18172/37963 [41:09:48<45:08:20,  8.21s/it]
 48%|████▊     | 18173/37963 [41:09:58<48:36:16,  8.84s/it]
 48%|████▊     | 18174/37963 [41:10:06<47:03:56,  8.56s/it]
 48%|████▊     | 18175/37963 [41:10:14<45:37:49,  8.30s/it]
 48%|████▊     | 18176/37963 [41:10:21<44:39:31,  8.13s/it]
 48%|████▊     | 18177/37963 [41:10:29<44:15:44,  8.05s/it]
 48%|████▊     | 18178/37963 [41:10:37<43:44:46,  7.96s/it]
 48%|████▊     | 18179/37963 [41:10:45<43:31:38,  7.92s/it]
 48%|████▊     | 18180/37963 [41:10:55<47:56:11,  8.72s/it]
                                                           
{'loss': '0.1469', 'grad_norm': '1.496', 'learning_rate': '1.117e-05', 'epoch': '0.4789'}
+
 48%|████▊     | 18180/37963 [41:10:55<47:56:11,  8.72s/it]
 48%|████▊     | 18181/37963 [41:11:03<46:28:48,  8.46s/it]
 48%|████▊     | 18182/37963 [41:11:14<49:29:51,  9.01s/it]
 48%|████▊     | 18183/37963 [41:11:21<47:13:33,  8.60s/it]
 48%|████▊     | 18184/37963 [41:11:29<45:47:29,  8.33s/it]
 48%|████▊     | 18185/37963 [41:11:37<44:47:23,  8.15s/it]
 48%|████▊     | 18186/37963 [41:11:44<43:49:17,  7.98s/it]
 48%|████▊     | 18187/37963 [41:11:55<48:00:31,  8.74s/it]
 48%|████▊     | 18188/37963 [41:12:02<45:40:09,  8.31s/it]
 48%|████▊     | 18189/37963 [41:12:12<49:06:35,  8.94s/it]
 48%|████▊     | 18190/37963 [41:12:20<47:09:44,  8.59s/it]
                                                           
{'loss': '0.1627', 'grad_norm': '2.92', 'learning_rate': '1.116e-05', 'epoch': '0.4792'}
+
 48%|████▊     | 18190/37963 [41:12:20<47:09:44,  8.59s/it]
 48%|████▊     | 18191/37963 [41:12:28<45:49:13,  8.34s/it]
 48%|████▊     | 18192/37963 [41:12:36<44:52:00,  8.17s/it]
 48%|████▊     | 18193/37963 [41:12:43<44:12:40,  8.05s/it]
 48%|████▊     | 18194/37963 [41:12:51<43:41:40,  7.96s/it]
 48%|████▊     | 18195/37963 [41:12:59<43:21:43,  7.90s/it]
 48%|████▊     | 18196/37963 [41:13:09<47:19:13,  8.62s/it]
 48%|████▊     | 18197/37963 [41:13:17<46:25:04,  8.45s/it]
 48%|████▊     | 18198/37963 [41:13:25<45:41:28,  8.32s/it]
 48%|████▊     | 18199/37963 [41:13:33<44:33:13,  8.12s/it]
 48%|████▊     | 18200/37963 [41:13:41<43:51:52,  7.99s/it]
                                                           
{'loss': '0.1656', 'grad_norm': '3.617', 'learning_rate': '1.115e-05', 'epoch': '0.4794'}
+
 48%|████▊     | 18200/37963 [41:13:41<43:51:52,  7.99s/it]
 48%|████▊     | 18201/37963 [41:13:48<43:21:37,  7.90s/it]
 48%|████▊     | 18202/37963 [41:13:56<43:10:40,  7.87s/it]
 48%|████▊     | 18203/37963 [41:14:04<43:09:22,  7.86s/it]
 48%|████▊     | 18204/37963 [41:14:12<42:42:37,  7.78s/it]
 48%|████▊     | 18205/37963 [41:14:20<43:07:53,  7.86s/it]
 48%|████▊     | 18206/37963 [41:14:27<42:30:50,  7.75s/it]
 48%|████▊     | 18207/37963 [41:14:35<42:49:20,  7.80s/it]
 48%|████▊     | 18208/37963 [41:14:43<42:46:37,  7.80s/it]
 48%|████▊     | 18209/37963 [41:14:51<42:52:30,  7.81s/it]
 48%|████▊     | 18210/37963 [41:14:58<42:25:07,  7.73s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '1.914', 'learning_rate': '1.114e-05', 'epoch': '0.4797'}
+
 48%|████▊     | 18210/37963 [41:14:58<42:25:07,  7.73s/it]
 48%|████▊     | 18211/37963 [41:15:09<46:35:22,  8.49s/it]
 48%|████▊     | 18212/37963 [41:15:16<44:56:21,  8.19s/it]
 48%|████▊     | 18213/37963 [41:15:24<44:08:02,  8.04s/it]
 48%|████▊     | 18214/37963 [41:15:31<43:32:28,  7.94s/it]
 48%|████▊     | 18215/37963 [41:15:39<42:38:58,  7.77s/it]
 48%|████▊     | 18216/37963 [41:15:46<42:28:57,  7.74s/it]
 48%|████▊     | 18217/37963 [41:15:54<42:40:29,  7.78s/it]
 48%|████▊     | 18218/37963 [41:16:02<42:07:37,  7.68s/it]
 48%|████▊     | 18219/37963 [41:16:09<41:59:07,  7.66s/it]
 48%|████▊     | 18220/37963 [41:16:17<41:55:54,  7.65s/it]
                                                           
{'loss': '0.1797', 'grad_norm': '1.401', 'learning_rate': '1.113e-05', 'epoch': '0.4799'}
+
 48%|████▊     | 18220/37963 [41:16:17<41:55:54,  7.65s/it]
 48%|████▊     | 18221/37963 [41:16:27<45:47:52,  8.35s/it]
 48%|████▊     | 18222/37963 [41:16:35<44:35:33,  8.13s/it]
 48%|████▊     | 18223/37963 [41:16:45<48:32:51,  8.85s/it]
 48%|████▊     | 18224/37963 [41:16:55<50:33:02,  9.22s/it]
 48%|████▊     | 18225/37963 [41:17:03<48:07:36,  8.78s/it]
 48%|████▊     | 18226/37963 [41:17:11<46:24:30,  8.46s/it]
 48%|████▊     | 18227/37963 [41:17:18<45:02:38,  8.22s/it]
 48%|████▊     | 18228/37963 [41:17:26<43:57:01,  8.02s/it]
 48%|████▊     | 18229/37963 [41:17:36<47:20:52,  8.64s/it]
 48%|████▊     | 18230/37963 [41:17:43<45:24:57,  8.29s/it]
                                                           
{'loss': '0.1712', 'grad_norm': '1.174', 'learning_rate': '1.113e-05', 'epoch': '0.4802'}
+
 48%|████▊     | 18230/37963 [41:17:43<45:24:57,  8.29s/it]
 48%|████▊     | 18231/37963 [41:17:54<48:48:33,  8.91s/it]
 48%|████▊     | 18232/37963 [41:18:02<47:01:54,  8.58s/it]
 48%|████▊     | 18233/37963 [41:18:10<46:03:17,  8.40s/it]
 48%|████▊     | 18234/37963 [41:18:17<44:44:21,  8.16s/it]
 48%|████▊     | 18235/37963 [41:18:25<43:24:00,  7.92s/it]
 48%|████▊     | 18236/37963 [41:18:32<43:04:33,  7.86s/it]
 48%|████▊     | 18237/37963 [41:18:40<43:05:30,  7.86s/it]
 48%|████▊     | 18238/37963 [41:18:48<43:02:11,  7.85s/it]
 48%|████▊     | 18239/37963 [41:18:56<42:50:27,  7.82s/it]
 48%|████▊     | 18240/37963 [41:19:03<42:28:37,  7.75s/it]
                                                           
{'loss': '0.1616', 'grad_norm': '1.334', 'learning_rate': '1.112e-05', 'epoch': '0.4805'}
+
 48%|████▊     | 18240/37963 [41:19:03<42:28:37,  7.75s/it]
 48%|████▊     | 18241/37963 [41:19:11<42:30:09,  7.76s/it]
 48%|████▊     | 18242/37963 [41:19:19<42:40:37,  7.79s/it]
 48%|████▊     | 18243/37963 [41:19:29<47:01:47,  8.59s/it]
 48%|████▊     | 18244/37963 [41:19:40<50:04:55,  9.14s/it]
 48%|████▊     | 18245/37963 [41:19:47<47:35:23,  8.69s/it]
 48%|████▊     | 18246/37963 [41:19:55<45:49:16,  8.37s/it]
 48%|████▊     | 18247/37963 [41:20:03<44:47:50,  8.18s/it]
 48%|████▊     | 18248/37963 [41:20:10<43:50:59,  8.01s/it]
 48%|████▊     | 18249/37963 [41:20:18<43:28:37,  7.94s/it]
 48%|████▊     | 18250/37963 [41:20:26<43:01:12,  7.86s/it]
                                                           
{'loss': '0.1523', 'grad_norm': '2.279', 'learning_rate': '1.111e-05', 'epoch': '0.4807'}
+
 48%|████▊     | 18250/37963 [41:20:26<43:01:12,  7.86s/it]
 48%|████▊     | 18251/37963 [41:20:34<42:43:45,  7.80s/it]
 48%|████▊     | 18252/37963 [41:20:41<42:38:31,  7.79s/it]
 48%|████▊     | 18253/37963 [41:20:49<42:39:58,  7.79s/it]
 48%|████▊     | 18254/37963 [41:20:57<42:18:55,  7.73s/it]
 48%|████▊     | 18255/37963 [41:21:04<42:02:57,  7.68s/it]
 48%|████▊     | 18256/37963 [41:21:12<41:53:42,  7.65s/it]
 48%|████▊     | 18257/37963 [41:21:19<41:32:02,  7.59s/it]
 48%|████▊     | 18258/37963 [41:21:27<41:42:43,  7.62s/it]
 48%|████▊     | 18259/37963 [41:21:35<41:49:19,  7.64s/it]
 48%|████▊     | 18260/37963 [41:21:42<41:49:45,  7.64s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '2.165', 'learning_rate': '1.11e-05', 'epoch': '0.481'}
+
 48%|████▊     | 18260/37963 [41:21:42<41:49:45,  7.64s/it]
 48%|████▊     | 18261/37963 [41:21:50<41:17:28,  7.54s/it]
 48%|████▊     | 18262/37963 [41:21:57<41:22:28,  7.56s/it]
 48%|████▊     | 18263/37963 [41:22:05<41:25:18,  7.57s/it]
 48%|████▊     | 18264/37963 [41:22:13<41:43:19,  7.62s/it]
 48%|████▊     | 18265/37963 [41:22:23<45:40:56,  8.35s/it]
 48%|████▊     | 18266/37963 [41:22:30<44:47:48,  8.19s/it]
 48%|████▊     | 18267/37963 [41:22:38<44:08:21,  8.07s/it]
 48%|████▊     | 18268/37963 [41:22:49<47:47:23,  8.74s/it]
 48%|████▊     | 18269/37963 [41:22:59<50:30:46,  9.23s/it]
 48%|████▊     | 18270/37963 [41:23:06<47:17:29,  8.65s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '3.217', 'learning_rate': '1.109e-05', 'epoch': '0.4813'}
+
 48%|████▊     | 18270/37963 [41:23:06<47:17:29,  8.65s/it]
 48%|████▊     | 18271/37963 [41:23:14<45:30:54,  8.32s/it]
 48%|████▊     | 18272/37963 [41:23:21<44:23:57,  8.12s/it]
 48%|████▊     | 18273/37963 [41:23:29<43:40:11,  7.98s/it]
 48%|████▊     | 18274/37963 [41:23:40<47:42:39,  8.72s/it]
 48%|████▊     | 18275/37963 [41:23:50<50:40:49,  9.27s/it]
 48%|████▊     | 18276/37963 [41:23:58<47:53:15,  8.76s/it]
 48%|████▊     | 18277/37963 [41:24:05<46:20:10,  8.47s/it]
 48%|████▊     | 18278/37963 [41:24:13<45:34:03,  8.33s/it]
 48%|████▊     | 18279/37963 [41:24:23<48:24:04,  8.85s/it]
 48%|████▊     | 18280/37963 [41:24:31<46:16:02,  8.46s/it]
                                                           
{'loss': '0.1499', 'grad_norm': '1.505', 'learning_rate': '1.108e-05', 'epoch': '0.4815'}
+
 48%|████▊     | 18280/37963 [41:24:31<46:16:02,  8.46s/it]
 48%|████▊     | 18281/37963 [41:24:39<45:15:14,  8.28s/it]
 48%|████▊     | 18282/37963 [41:24:46<43:54:26,  8.03s/it]
 48%|████▊     | 18283/37963 [41:24:54<43:15:16,  7.91s/it]
 48%|████▊     | 18284/37963 [41:25:02<42:43:28,  7.82s/it]
 48%|████▊     | 18285/37963 [41:25:09<42:46:05,  7.82s/it]
 48%|████▊     | 18286/37963 [41:25:17<42:32:15,  7.78s/it]
 48%|████▊     | 18287/37963 [41:25:28<46:52:46,  8.58s/it]
 48%|████▊     | 18288/37963 [41:25:38<49:41:56,  9.09s/it]
 48%|████▊     | 18289/37963 [41:25:46<47:37:25,  8.71s/it]
 48%|████▊     | 18290/37963 [41:25:53<45:50:16,  8.39s/it]
                                                           
{'loss': '0.159', 'grad_norm': '2.253', 'learning_rate': '1.107e-05', 'epoch': '0.4818'}
+
 48%|████▊     | 18290/37963 [41:25:53<45:50:16,  8.39s/it]
 48%|████▊     | 18291/37963 [41:26:01<44:47:42,  8.20s/it]
 48%|████▊     | 18292/37963 [41:26:09<44:00:19,  8.05s/it]
 48%|████▊     | 18293/37963 [41:26:16<43:23:25,  7.94s/it]
 48%|████▊     | 18294/37963 [41:26:24<43:00:29,  7.87s/it]
 48%|████▊     | 18295/37963 [41:26:32<42:44:38,  7.82s/it]
 48%|████▊     | 18296/37963 [41:26:39<41:50:59,  7.66s/it]
 48%|████▊     | 18297/37963 [41:26:47<42:02:01,  7.69s/it]
 48%|████▊     | 18298/37963 [41:26:54<41:40:11,  7.63s/it]
 48%|████▊     | 18299/37963 [41:27:02<41:43:05,  7.64s/it]
 48%|████▊     | 18300/37963 [41:27:10<41:37:27,  7.62s/it]
                                                           
{'loss': '0.1635', 'grad_norm': '1.344', 'learning_rate': '1.107e-05', 'epoch': '0.482'}
+
 48%|████▊     | 18300/37963 [41:27:10<41:37:27,  7.62s/it]
 48%|████▊     | 18301/37963 [41:27:17<41:41:40,  7.63s/it]
 48%|████▊     | 18302/37963 [41:27:25<41:21:01,  7.57s/it]
 48%|████▊     | 18303/37963 [41:27:32<41:05:14,  7.52s/it]
 48%|████▊     | 18304/37963 [41:27:39<40:38:07,  7.44s/it]
 48%|████▊     | 18305/37963 [41:27:47<40:57:53,  7.50s/it]
 48%|████▊     | 18306/37963 [41:27:55<41:12:32,  7.55s/it]
 48%|████▊     | 18307/37963 [41:28:03<41:41:00,  7.63s/it]
 48%|████▊     | 18308/37963 [41:28:10<42:11:12,  7.73s/it]
 48%|████▊     | 18309/37963 [41:28:21<46:08:47,  8.45s/it]
 48%|████▊     | 18310/37963 [41:28:28<44:56:36,  8.23s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '1.178', 'learning_rate': '1.106e-05', 'epoch': '0.4823'}
+
 48%|████▊     | 18310/37963 [41:28:28<44:56:36,  8.23s/it]
 48%|████▊     | 18311/37963 [41:28:36<43:59:13,  8.06s/it]
 48%|████▊     | 18312/37963 [41:28:44<43:17:52,  7.93s/it]
 48%|████▊     | 18313/37963 [41:28:52<43:19:35,  7.94s/it]
 48%|████▊     | 18314/37963 [41:29:00<43:24:42,  7.95s/it]
 48%|████▊     | 18315/37963 [41:29:07<43:01:47,  7.88s/it]
 48%|████▊     | 18316/37963 [41:29:17<46:46:22,  8.57s/it]
 48%|████▊     | 18317/37963 [41:29:25<45:20:13,  8.31s/it]
 48%|████▊     | 18318/37963 [41:29:36<48:57:45,  8.97s/it]
 48%|████▊     | 18319/37963 [41:29:44<47:28:21,  8.70s/it]
 48%|████▊     | 18320/37963 [41:29:52<45:57:47,  8.42s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '0.8909', 'learning_rate': '1.105e-05', 'epoch': '0.4826'}
+
 48%|████▊     | 18320/37963 [41:29:52<45:57:47,  8.42s/it]
 48%|████▊     | 18321/37963 [41:29:59<44:49:13,  8.21s/it]
 48%|████▊     | 18322/37963 [41:30:10<48:15:21,  8.84s/it]
 48%|████▊     | 18323/37963 [41:30:17<46:36:48,  8.54s/it]
 48%|████▊     | 18324/37963 [41:30:25<45:45:48,  8.39s/it]
 48%|████▊     | 18325/37963 [41:30:36<48:55:21,  8.97s/it]
 48%|████▊     | 18326/37963 [41:30:44<47:07:07,  8.64s/it]
 48%|████▊     | 18327/37963 [41:30:51<45:36:43,  8.36s/it]
 48%|████▊     | 18328/37963 [41:31:02<49:16:58,  9.04s/it]
 48%|████▊     | 18329/37963 [41:31:10<47:05:52,  8.64s/it]
 48%|████▊     | 18330/37963 [41:31:17<45:45:05,  8.39s/it]
                                                           
{'loss': '0.1728', 'grad_norm': '1.202', 'learning_rate': '1.104e-05', 'epoch': '0.4828'}
+
 48%|████▊     | 18330/37963 [41:31:17<45:45:05,  8.39s/it]
 48%|████▊     | 18331/37963 [41:31:25<44:37:56,  8.18s/it]
 48%|████▊     | 18332/37963 [41:31:33<43:58:52,  8.07s/it]
 48%|████▊     | 18333/37963 [41:31:41<43:37:29,  8.00s/it]
 48%|████▊     | 18334/37963 [41:31:49<43:14:32,  7.93s/it]
 48%|████▊     | 18335/37963 [41:31:59<46:44:53,  8.57s/it]
 48%|████▊     | 18336/37963 [41:32:09<49:47:47,  9.13s/it]
 48%|████▊     | 18337/37963 [41:32:16<46:44:56,  8.58s/it]
 48%|████▊     | 18338/37963 [41:32:24<44:51:24,  8.23s/it]
 48%|████▊     | 18339/37963 [41:32:32<44:28:22,  8.16s/it]
 48%|████▊     | 18340/37963 [41:32:39<43:26:49,  7.97s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '2.079', 'learning_rate': '1.103e-05', 'epoch': '0.4831'}
+
 48%|████▊     | 18340/37963 [41:32:39<43:26:49,  7.97s/it]
 48%|████▊     | 18341/37963 [41:32:47<43:03:44,  7.90s/it]
 48%|████▊     | 18342/37963 [41:32:55<42:36:27,  7.82s/it]
 48%|████▊     | 18343/37963 [41:33:02<42:12:18,  7.74s/it]
 48%|████▊     | 18344/37963 [41:33:10<42:26:04,  7.79s/it]
 48%|████▊     | 18345/37963 [41:33:17<41:39:04,  7.64s/it]
 48%|████▊     | 18346/37963 [41:33:25<41:38:16,  7.64s/it]
 48%|████▊     | 18347/37963 [41:33:33<41:39:28,  7.65s/it]
 48%|████▊     | 18348/37963 [41:33:40<41:22:10,  7.59s/it]
 48%|████▊     | 18349/37963 [41:33:48<41:34:05,  7.63s/it]
 48%|████▊     | 18350/37963 [41:33:56<42:04:59,  7.72s/it]
                                                           
{'loss': '0.1649', 'grad_norm': '3.237', 'learning_rate': '1.102e-05', 'epoch': '0.4834'}
+
 48%|████▊     | 18350/37963 [41:33:56<42:04:59,  7.72s/it]
 48%|████▊     | 18351/37963 [41:34:04<42:17:58,  7.76s/it]
 48%|████▊     | 18352/37963 [41:34:11<41:31:29,  7.62s/it]
 48%|████▊     | 18353/37963 [41:34:21<45:38:11,  8.38s/it]
 48%|████▊     | 18354/37963 [41:34:29<44:51:09,  8.23s/it]
 48%|████▊     | 18355/37963 [41:34:37<44:02:53,  8.09s/it]
 48%|████▊     | 18356/37963 [41:34:45<43:39:47,  8.02s/it]
 48%|████▊     | 18357/37963 [41:34:52<43:05:19,  7.91s/it]
 48%|████▊     | 18358/37963 [41:35:00<42:34:38,  7.82s/it]
 48%|████▊     | 18359/37963 [41:35:08<42:21:06,  7.78s/it]
 48%|████▊     | 18360/37963 [41:35:18<46:40:07,  8.57s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '1.195', 'learning_rate': '1.102e-05', 'epoch': '0.4836'}
+
 48%|████▊     | 18360/37963 [41:35:18<46:40:07,  8.57s/it]
 48%|████▊     | 18361/37963 [41:35:26<45:12:45,  8.30s/it]
 48%|████▊     | 18362/37963 [41:35:33<44:21:31,  8.15s/it]
 48%|████▊     | 18363/37963 [41:35:41<43:45:15,  8.04s/it]
 48%|████▊     | 18364/37963 [41:35:49<43:23:57,  7.97s/it]
 48%|████▊     | 18365/37963 [41:35:57<43:22:24,  7.97s/it]
 48%|████▊     | 18366/37963 [41:36:07<47:04:36,  8.65s/it]
 48%|████▊     | 18367/37963 [41:36:15<45:33:19,  8.37s/it]
 48%|████▊     | 18368/37963 [41:36:23<44:21:57,  8.15s/it]
 48%|████▊     | 18369/37963 [41:36:33<47:18:35,  8.69s/it]
 48%|████▊     | 18370/37963 [41:36:40<45:38:26,  8.39s/it]
                                                           
{'loss': '0.1432', 'grad_norm': '1.242', 'learning_rate': '1.101e-05', 'epoch': '0.4839'}
+
 48%|████▊     | 18370/37963 [41:36:40<45:38:26,  8.39s/it]
 48%|████▊     | 18371/37963 [41:36:48<44:20:41,  8.15s/it]
 48%|████▊     | 18372/37963 [41:36:55<43:05:14,  7.92s/it]
 48%|████▊     | 18373/37963 [41:37:03<42:48:48,  7.87s/it]
 48%|████▊     | 18374/37963 [41:37:13<46:58:16,  8.63s/it]
 48%|████▊     | 18375/37963 [41:37:21<45:13:28,  8.31s/it]
 48%|████▊     | 18376/37963 [41:37:28<43:49:13,  8.05s/it]
 48%|████▊     | 18377/37963 [41:37:36<43:10:09,  7.93s/it]
 48%|████▊     | 18378/37963 [41:37:44<42:36:12,  7.83s/it]
 48%|████▊     | 18379/37963 [41:37:54<46:28:02,  8.54s/it]
 48%|████▊     | 18380/37963 [41:38:07<53:42:47,  9.87s/it]
                                                           
{'loss': '0.1615', 'grad_norm': '2.768', 'learning_rate': '1.1e-05', 'epoch': '0.4842'}
+
 48%|████▊     | 18380/37963 [41:38:07<53:42:47,  9.87s/it]
 48%|████▊     | 18381/37963 [41:38:15<50:06:55,  9.21s/it]
 48%|████▊     | 18382/37963 [41:38:22<47:10:59,  8.67s/it]
 48%|████▊     | 18383/37963 [41:38:29<45:14:38,  8.32s/it]
 48%|████▊     | 18384/37963 [41:38:37<44:08:11,  8.12s/it]
 48%|████▊     | 18385/37963 [41:38:45<43:39:56,  8.03s/it]
 48%|████▊     | 18386/37963 [41:38:53<43:19:18,  7.97s/it]
 48%|████▊     | 18387/37963 [41:39:00<42:51:33,  7.88s/it]
 48%|████▊     | 18388/37963 [41:39:08<42:07:29,  7.75s/it]
 48%|████▊     | 18389/37963 [41:39:15<41:46:43,  7.68s/it]
 48%|████▊     | 18390/37963 [41:39:23<41:53:12,  7.70s/it]
                                                           
{'loss': '0.1668', 'grad_norm': '2.32', 'learning_rate': '1.099e-05', 'epoch': '0.4844'}
+
 48%|████▊     | 18390/37963 [41:39:23<41:53:12,  7.70s/it]
 48%|████▊     | 18391/37963 [41:39:31<41:57:55,  7.72s/it]
 48%|████▊     | 18392/37963 [41:39:39<41:54:10,  7.71s/it]
 48%|████▊     | 18393/37963 [41:39:46<41:47:11,  7.69s/it]
 48%|████▊     | 18394/37963 [41:39:54<41:55:51,  7.71s/it]
 48%|████▊     | 18395/37963 [41:40:02<41:57:12,  7.72s/it]
 48%|████▊     | 18396/37963 [41:40:09<41:51:12,  7.70s/it]
 48%|████▊     | 18397/37963 [41:40:20<45:53:36,  8.44s/it]
 48%|████▊     | 18398/37963 [41:40:27<44:59:02,  8.28s/it]
 48%|████▊     | 18399/37963 [41:40:35<44:10:52,  8.13s/it]
 48%|████▊     | 18400/37963 [41:40:43<43:23:24,  7.98s/it]
                                                           
{'loss': '0.167', 'grad_norm': '2.054', 'learning_rate': '1.098e-05', 'epoch': '0.4847'}
+
 48%|████▊     | 18400/37963 [41:40:43<43:23:24,  7.98s/it]
 48%|████▊     | 18401/37963 [41:40:51<42:52:07,  7.89s/it]
 48%|████▊     | 18402/37963 [41:40:58<43:00:27,  7.92s/it]
 48%|████▊     | 18403/37963 [41:41:09<46:49:55,  8.62s/it]
 48%|████▊     | 18404/37963 [41:41:17<45:25:50,  8.36s/it]
 48%|████▊     | 18405/37963 [41:41:24<44:36:12,  8.21s/it]
 48%|████▊     | 18406/37963 [41:41:32<43:43:55,  8.05s/it]
 48%|████▊     | 18407/37963 [41:41:40<43:11:18,  7.95s/it]
 48%|████▊     | 18408/37963 [41:41:47<42:36:17,  7.84s/it]
 48%|████▊     | 18409/37963 [41:41:55<41:38:51,  7.67s/it]
 48%|████▊     | 18410/37963 [41:42:03<42:01:30,  7.74s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '2.641', 'learning_rate': '1.097e-05', 'epoch': '0.4849'}
+
 48%|████▊     | 18410/37963 [41:42:03<42:01:30,  7.74s/it]
 48%|████▊     | 18411/37963 [41:42:10<41:54:09,  7.72s/it]
 48%|████▊     | 18412/37963 [41:42:18<41:53:41,  7.71s/it]
 49%|████▊     | 18413/37963 [41:42:26<41:55:40,  7.72s/it]
 49%|████▊     | 18414/37963 [41:42:33<41:48:27,  7.70s/it]
 49%|████▊     | 18415/37963 [41:42:41<41:23:41,  7.62s/it]
 49%|████▊     | 18416/37963 [41:42:49<41:48:23,  7.70s/it]
 49%|████▊     | 18417/37963 [41:42:56<41:17:30,  7.61s/it]
 49%|████▊     | 18418/37963 [41:43:09<50:27:53,  9.30s/it]
 49%|████▊     | 18419/37963 [41:43:17<47:43:45,  8.79s/it]
 49%|████▊     | 18420/37963 [41:43:24<45:08:25,  8.32s/it]
                                                           
{'loss': '0.1565', 'grad_norm': '2.197', 'learning_rate': '1.096e-05', 'epoch': '0.4852'}
+
 49%|████▊     | 18420/37963 [41:43:24<45:08:25,  8.32s/it]
 49%|████▊     | 18421/37963 [41:43:34<48:18:56,  8.90s/it]
 49%|████▊     | 18422/37963 [41:43:42<46:36:23,  8.59s/it]
 49%|████▊     | 18423/37963 [41:43:50<45:27:12,  8.37s/it]
 49%|████▊     | 18424/37963 [41:43:58<44:45:14,  8.25s/it]
 49%|████▊     | 18425/37963 [41:44:08<47:49:46,  8.81s/it]
 49%|████▊     | 18426/37963 [41:44:19<50:33:21,  9.32s/it]
 49%|████▊     | 18427/37963 [41:44:26<47:46:36,  8.80s/it]
 49%|████▊     | 18428/37963 [41:44:34<45:49:22,  8.44s/it]
 49%|████▊     | 18429/37963 [41:44:42<44:38:31,  8.23s/it]
 49%|████▊     | 18430/37963 [41:44:49<43:59:47,  8.11s/it]
                                                           
{'loss': '0.1519', 'grad_norm': '1.414', 'learning_rate': '1.096e-05', 'epoch': '0.4855'}
+
 49%|████▊     | 18430/37963 [41:44:49<43:59:47,  8.11s/it]
 49%|████▊     | 18431/37963 [41:44:57<43:30:06,  8.02s/it]
 49%|████▊     | 18432/37963 [41:45:05<42:46:45,  7.89s/it]
 49%|████▊     | 18433/37963 [41:45:15<47:00:10,  8.66s/it]
 49%|████▊     | 18434/37963 [41:45:23<45:25:41,  8.37s/it]
 49%|████▊     | 18435/37963 [41:45:30<44:06:01,  8.13s/it]
 49%|████▊     | 18436/37963 [41:45:38<43:33:43,  8.03s/it]
 49%|████▊     | 18437/37963 [41:45:46<43:04:34,  7.94s/it]
 49%|████▊     | 18438/37963 [41:45:54<43:01:48,  7.93s/it]
 49%|████▊     | 18439/37963 [41:46:02<43:15:19,  7.98s/it]
 49%|████▊     | 18440/37963 [41:46:12<47:02:47,  8.68s/it]
                                                           
{'loss': '0.1384', 'grad_norm': '3.548', 'learning_rate': '1.095e-05', 'epoch': '0.4857'}
+
 49%|████▊     | 18440/37963 [41:46:12<47:02:47,  8.68s/it]
 49%|████▊     | 18441/37963 [41:46:20<45:19:52,  8.36s/it]
 49%|████▊     | 18442/37963 [41:46:27<43:30:44,  8.02s/it]
 49%|████▊     | 18443/37963 [41:46:35<42:52:51,  7.91s/it]
 49%|████▊     | 18444/37963 [41:46:42<42:28:12,  7.83s/it]
 49%|████▊     | 18445/37963 [41:46:50<42:04:19,  7.76s/it]
 49%|████▊     | 18446/37963 [41:46:58<42:04:10,  7.76s/it]
 49%|████▊     | 18447/37963 [41:47:06<42:07:21,  7.77s/it]
 49%|████▊     | 18448/37963 [41:47:13<42:01:34,  7.75s/it]
 49%|████▊     | 18449/37963 [41:47:21<41:36:28,  7.68s/it]
 49%|████▊     | 18450/37963 [41:47:28<40:57:38,  7.56s/it]
                                                           
{'loss': '0.164', 'grad_norm': '1.081', 'learning_rate': '1.094e-05', 'epoch': '0.486'}
+
 49%|████▊     | 18450/37963 [41:47:28<40:57:38,  7.56s/it]
 49%|████▊     | 18451/37963 [41:47:36<41:13:57,  7.61s/it]
 49%|████▊     | 18452/37963 [41:47:46<45:35:06,  8.41s/it]
 49%|████▊     | 18453/37963 [41:47:54<44:41:06,  8.25s/it]
 49%|████▊     | 18454/37963 [41:48:01<43:19:01,  7.99s/it]
 49%|████▊     | 18455/37963 [41:48:09<42:37:53,  7.87s/it]
 49%|████▊     | 18456/37963 [41:48:17<42:20:09,  7.81s/it]
 49%|████▊     | 18457/37963 [41:48:24<42:05:29,  7.77s/it]
 49%|████▊     | 18458/37963 [41:48:32<41:12:51,  7.61s/it]
 49%|████▊     | 18459/37963 [41:48:39<40:50:46,  7.54s/it]
 49%|████▊     | 18460/37963 [41:48:46<40:45:50,  7.52s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '1.41', 'learning_rate': '1.093e-05', 'epoch': '0.4863'}
+
 49%|████▊     | 18460/37963 [41:48:46<40:45:50,  7.52s/it]
 49%|████▊     | 18461/37963 [41:48:57<45:34:07,  8.41s/it]
 49%|████▊     | 18462/37963 [41:49:07<48:38:41,  8.98s/it]
 49%|████▊     | 18463/37963 [41:49:15<46:34:33,  8.60s/it]
 49%|████▊     | 18464/37963 [41:49:23<45:36:18,  8.42s/it]
 49%|████▊     | 18465/37963 [41:49:31<44:37:57,  8.24s/it]
 49%|████▊     | 18466/37963 [41:49:38<43:12:54,  7.98s/it]
 49%|████▊     | 18467/37963 [41:49:45<41:55:31,  7.74s/it]
 49%|████▊     | 18468/37963 [41:49:53<41:40:23,  7.70s/it]
 49%|████▊     | 18469/37963 [41:50:01<41:56:30,  7.75s/it]
 49%|████▊     | 18470/37963 [41:50:11<46:00:39,  8.50s/it]
                                                           
{'loss': '0.1494', 'grad_norm': '1.286', 'learning_rate': '1.092e-05', 'epoch': '0.4865'}
+
 49%|████▊     | 18470/37963 [41:50:11<46:00:39,  8.50s/it]
 49%|████▊     | 18471/37963 [41:50:19<44:45:41,  8.27s/it]
 49%|████▊     | 18472/37963 [41:50:27<44:12:42,  8.17s/it]
 49%|████▊     | 18473/37963 [41:50:35<43:49:42,  8.10s/it]
 49%|████▊     | 18474/37963 [41:50:45<47:23:59,  8.76s/it]
 49%|████▊     | 18475/37963 [41:50:53<46:21:02,  8.56s/it]
 49%|████▊     | 18476/37963 [41:51:01<45:34:02,  8.42s/it]
 49%|████▊     | 18477/37963 [41:51:11<48:42:43,  9.00s/it]
 49%|████▊     | 18478/37963 [41:51:19<46:53:58,  8.67s/it]
 49%|████▊     | 18479/37963 [41:51:27<45:20:38,  8.38s/it]
 49%|████▊     | 18480/37963 [41:51:38<49:05:52,  9.07s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '2.381', 'learning_rate': '1.091e-05', 'epoch': '0.4868'}
+
 49%|████▊     | 18480/37963 [41:51:38<49:05:52,  9.07s/it]
 49%|████▊     | 18481/37963 [41:51:46<47:12:04,  8.72s/it]
 49%|████▊     | 18482/37963 [41:51:53<45:34:34,  8.42s/it]
 49%|████▊     | 18483/37963 [41:52:01<44:30:16,  8.22s/it]
 49%|████▊     | 18484/37963 [41:52:09<44:08:27,  8.16s/it]
 49%|████▊     | 18485/37963 [41:52:17<42:53:32,  7.93s/it]
 49%|████▊     | 18486/37963 [41:52:24<42:34:14,  7.87s/it]
 49%|████▊     | 18487/37963 [41:52:32<42:06:36,  7.78s/it]
 49%|████▊     | 18488/37963 [41:52:39<41:43:14,  7.71s/it]
 49%|████▊     | 18489/37963 [41:52:49<45:33:15,  8.42s/it]
 49%|████▊     | 18490/37963 [41:52:57<43:53:35,  8.11s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '2.021', 'learning_rate': '1.09e-05', 'epoch': '0.4871'}
+
 49%|████▊     | 18490/37963 [41:52:57<43:53:35,  8.11s/it]
 49%|████▊     | 18491/37963 [41:53:05<43:20:39,  8.01s/it]
 49%|████▊     | 18492/37963 [41:53:12<42:52:56,  7.93s/it]
 49%|████▊     | 18493/37963 [41:53:20<42:14:19,  7.81s/it]
 49%|████▊     | 18494/37963 [41:53:28<42:08:45,  7.79s/it]
 49%|████▊     | 18495/37963 [41:53:38<46:09:17,  8.53s/it]
 49%|████▊     | 18496/37963 [41:53:45<44:02:53,  8.15s/it]
 49%|████▊     | 18497/37963 [41:53:53<43:10:07,  7.98s/it]
 49%|████▊     | 18498/37963 [41:54:00<42:34:48,  7.88s/it]
 49%|████▊     | 18499/37963 [41:54:08<42:44:21,  7.90s/it]
 49%|████▊     | 18500/37963 [41:54:16<42:30:37,  7.86s/it]
                                                           
{'loss': '0.1715', 'grad_norm': '2.165', 'learning_rate': '1.09e-05', 'epoch': '0.4873'}
+
 49%|████▊     | 18500/37963 [41:54:16<42:30:37,  7.86s/it]
 49%|████▊     | 18501/37963 [41:54:24<42:10:23,  7.80s/it]
 49%|████▊     | 18502/37963 [41:54:31<42:00:13,  7.77s/it]
 49%|████▊     | 18503/37963 [41:54:39<42:05:24,  7.79s/it]
 49%|████▊     | 18504/37963 [41:54:47<42:00:25,  7.77s/it]
 49%|████▊     | 18505/37963 [41:54:57<46:13:03,  8.55s/it]
 49%|████▊     | 18506/37963 [41:55:05<45:06:31,  8.35s/it]
 49%|████▉     | 18507/37963 [41:55:13<43:44:44,  8.09s/it]
 49%|████▉     | 18508/37963 [41:55:20<42:40:26,  7.90s/it]
 49%|████▉     | 18509/37963 [41:55:28<42:00:47,  7.77s/it]
 49%|████▉     | 18510/37963 [41:55:35<42:02:13,  7.78s/it]
                                                           
{'loss': '0.1496', 'grad_norm': '1.358', 'learning_rate': '1.089e-05', 'epoch': '0.4876'}
+
 49%|████▉     | 18510/37963 [41:55:35<42:02:13,  7.78s/it]
 49%|████▉     | 18511/37963 [41:55:46<46:35:21,  8.62s/it]
 49%|████▉     | 18512/37963 [41:55:54<45:02:35,  8.34s/it]
 49%|████▉     | 18513/37963 [41:56:04<48:30:36,  8.98s/it]
 49%|████▉     | 18514/37963 [41:56:12<46:16:57,  8.57s/it]
 49%|████▉     | 18515/37963 [41:56:20<44:56:23,  8.32s/it]
 49%|████▉     | 18516/37963 [41:56:27<44:17:45,  8.20s/it]
 49%|████▉     | 18517/37963 [41:56:35<43:25:15,  8.04s/it]
 49%|████▉     | 18518/37963 [41:56:43<43:28:26,  8.05s/it]
 49%|████▉     | 18519/37963 [41:56:51<43:04:17,  7.97s/it]
 49%|████▉     | 18520/37963 [41:57:02<47:20:51,  8.77s/it]
                                                           
{'loss': '0.1609', 'grad_norm': '1.248', 'learning_rate': '1.088e-05', 'epoch': '0.4878'}
+
 49%|████▉     | 18520/37963 [41:57:02<47:20:51,  8.77s/it]
 49%|████▉     | 18521/37963 [41:57:10<45:56:46,  8.51s/it]
 49%|████▉     | 18522/37963 [41:57:19<48:11:04,  8.92s/it]
 49%|████▉     | 18523/37963 [41:57:27<46:03:12,  8.53s/it]
 49%|████▉     | 18524/37963 [41:57:37<48:39:57,  9.01s/it]
 49%|████▉     | 18525/37963 [41:57:45<46:44:23,  8.66s/it]
 49%|████▉     | 18526/37963 [41:57:53<45:21:52,  8.40s/it]
 49%|████▉     | 18527/37963 [41:58:01<44:20:53,  8.21s/it]
 49%|████▉     | 18528/37963 [41:58:09<43:56:03,  8.14s/it]
 49%|████▉     | 18529/37963 [41:58:16<43:26:55,  8.05s/it]
 49%|████▉     | 18530/37963 [41:58:24<42:53:29,  7.95s/it]
                                                           
{'loss': '0.1561', 'grad_norm': '1.596', 'learning_rate': '1.087e-05', 'epoch': '0.4881'}
+
 49%|████▉     | 18530/37963 [41:58:24<42:53:29,  7.95s/it]
 49%|████▉     | 18531/37963 [41:58:32<42:16:30,  7.83s/it]
 49%|████▉     | 18532/37963 [41:58:42<46:00:28,  8.52s/it]
 49%|████▉     | 18533/37963 [41:58:50<44:42:43,  8.28s/it]
 49%|████▉     | 18534/37963 [41:58:57<43:47:48,  8.12s/it]
 49%|████▉     | 18535/37963 [41:59:05<43:00:06,  7.97s/it]
 49%|████▉     | 18536/37963 [41:59:13<42:39:58,  7.91s/it]
 49%|████▉     | 18537/37963 [41:59:20<42:22:12,  7.85s/it]
 49%|████▉     | 18538/37963 [41:59:28<41:58:21,  7.78s/it]
 49%|████▉     | 18539/37963 [41:59:36<41:43:36,  7.73s/it]
 49%|████▉     | 18540/37963 [41:59:44<42:02:46,  7.79s/it]
                                                           
{'loss': '0.1478', 'grad_norm': '1.542', 'learning_rate': '1.086e-05', 'epoch': '0.4884'}
+
 49%|████▉     | 18540/37963 [41:59:44<42:02:46,  7.79s/it]
 49%|████▉     | 18541/37963 [41:59:51<41:54:14,  7.77s/it]
 49%|████▉     | 18542/37963 [41:59:59<41:36:30,  7.71s/it]
 49%|████▉     | 18543/37963 [42:00:07<42:00:54,  7.79s/it]
 49%|████▉     | 18544/37963 [42:00:15<42:19:59,  7.85s/it]
 49%|████▉     | 18545/37963 [42:00:22<41:56:09,  7.77s/it]
 49%|████▉     | 18546/37963 [42:00:30<41:45:30,  7.74s/it]
 49%|████▉     | 18547/37963 [42:00:38<41:33:19,  7.70s/it]
 49%|████▉     | 18548/37963 [42:00:45<41:28:00,  7.69s/it]
 49%|████▉     | 18549/37963 [42:00:56<45:45:59,  8.49s/it]
 49%|████▉     | 18550/37963 [42:01:03<44:33:03,  8.26s/it]
                                                           
{'loss': '0.1599', 'grad_norm': '3.623', 'learning_rate': '1.085e-05', 'epoch': '0.4886'}
+
 49%|████▉     | 18550/37963 [42:01:03<44:33:03,  8.26s/it]
 49%|████▉     | 18551/37963 [42:01:11<43:26:31,  8.06s/it]
 49%|████▉     | 18552/37963 [42:01:19<43:07:11,  8.00s/it]
 49%|████▉     | 18553/37963 [42:01:27<43:00:28,  7.98s/it]
 49%|████▉     | 18554/37963 [42:01:37<46:13:27,  8.57s/it]
 49%|████▉     | 18555/37963 [42:01:44<44:53:47,  8.33s/it]
 49%|████▉     | 18556/37963 [42:01:52<43:50:59,  8.13s/it]
 49%|████▉     | 18557/37963 [42:02:00<43:16:00,  8.03s/it]
 49%|████▉     | 18558/37963 [42:02:08<42:52:16,  7.95s/it]
 49%|████▉     | 18559/37963 [42:02:15<42:05:29,  7.81s/it]
 49%|████▉     | 18560/37963 [42:02:23<42:16:31,  7.84s/it]
                                                           
{'loss': '0.1627', 'grad_norm': '3.898', 'learning_rate': '1.085e-05', 'epoch': '0.4889'}
+
 49%|████▉     | 18560/37963 [42:02:23<42:16:31,  7.84s/it]
 49%|████▉     | 18561/37963 [42:02:31<41:53:53,  7.77s/it]
 49%|████▉     | 18562/37963 [42:02:39<42:00:35,  7.80s/it]
 49%|████▉     | 18563/37963 [42:02:46<41:57:14,  7.79s/it]
 49%|████▉     | 18564/37963 [42:02:54<41:51:01,  7.77s/it]
 49%|████▉     | 18565/37963 [42:03:07<50:55:47,  9.45s/it]
 49%|████▉     | 18566/37963 [42:03:15<47:57:08,  8.90s/it]
 49%|████▉     | 18567/37963 [42:03:23<46:05:26,  8.55s/it]
 49%|████▉     | 18568/37963 [42:03:30<44:40:07,  8.29s/it]
 49%|████▉     | 18569/37963 [42:03:41<48:34:09,  9.02s/it]
 49%|████▉     | 18570/37963 [42:03:51<50:07:59,  9.31s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '2.292', 'learning_rate': '1.084e-05', 'epoch': '0.4892'}
+
 49%|████▉     | 18570/37963 [42:03:51<50:07:59,  9.31s/it]
 49%|████▉     | 18571/37963 [42:03:59<47:34:05,  8.83s/it]
 49%|████▉     | 18572/37963 [42:04:09<50:24:16,  9.36s/it]
 49%|████▉     | 18573/37963 [42:04:17<46:57:38,  8.72s/it]
 49%|████▉     | 18574/37963 [42:04:24<45:19:28,  8.42s/it]
 49%|████▉     | 18575/37963 [42:04:32<43:44:31,  8.12s/it]
 49%|████▉     | 18576/37963 [42:04:39<42:33:22,  7.90s/it]
 49%|████▉     | 18577/37963 [42:04:47<42:04:40,  7.81s/it]
 49%|████▉     | 18578/37963 [42:04:54<41:16:39,  7.67s/it]
 49%|████▉     | 18579/37963 [42:05:02<41:11:06,  7.65s/it]
 49%|████▉     | 18580/37963 [42:05:09<41:17:08,  7.67s/it]
                                                           
{'loss': '0.1527', 'grad_norm': '1.698', 'learning_rate': '1.083e-05', 'epoch': '0.4894'}
+
 49%|████▉     | 18580/37963 [42:05:09<41:17:08,  7.67s/it]
 49%|████▉     | 18581/37963 [42:05:17<41:16:44,  7.67s/it]
 49%|████▉     | 18582/37963 [42:05:25<41:05:42,  7.63s/it]
 49%|████▉     | 18583/37963 [42:05:32<41:00:41,  7.62s/it]
 49%|████▉     | 18584/37963 [42:05:40<41:05:57,  7.63s/it]
 49%|████▉     | 18585/37963 [42:05:48<41:18:25,  7.67s/it]
 49%|████▉     | 18586/37963 [42:05:58<45:26:02,  8.44s/it]
 49%|████▉     | 18587/37963 [42:06:06<44:27:37,  8.26s/it]
 49%|████▉     | 18588/37963 [42:06:13<43:25:07,  8.07s/it]
 49%|████▉     | 18589/37963 [42:06:21<42:57:07,  7.98s/it]
 49%|████▉     | 18590/37963 [42:06:29<42:41:49,  7.93s/it]
                                                           
{'loss': '0.1639', 'grad_norm': '1.82', 'learning_rate': '1.082e-05', 'epoch': '0.4897'}
+
 49%|████▉     | 18590/37963 [42:06:29<42:41:49,  7.93s/it]
 49%|████▉     | 18591/37963 [42:06:37<42:24:31,  7.88s/it]
 49%|████▉     | 18592/37963 [42:06:44<41:27:45,  7.71s/it]
 49%|████▉     | 18593/37963 [42:06:51<40:45:29,  7.58s/it]
 49%|████▉     | 18594/37963 [42:06:59<40:44:14,  7.57s/it]
 49%|████▉     | 18595/37963 [42:07:07<40:50:44,  7.59s/it]
 49%|████▉     | 18596/37963 [42:07:17<45:10:17,  8.40s/it]
 49%|████▉     | 18597/37963 [42:07:25<44:02:56,  8.19s/it]
 49%|████▉     | 18598/37963 [42:07:32<43:24:06,  8.07s/it]
 49%|████▉     | 18599/37963 [42:07:40<42:37:27,  7.92s/it]
 49%|████▉     | 18600/37963 [42:07:48<42:30:39,  7.90s/it]
                                                           
{'loss': '0.1539', 'grad_norm': '1.557', 'learning_rate': '1.081e-05', 'epoch': '0.49'}
+
 49%|████▉     | 18600/37963 [42:07:48<42:30:39,  7.90s/it]
 49%|████▉     | 18601/37963 [42:07:55<42:02:01,  7.82s/it]
 49%|████▉     | 18602/37963 [42:08:03<42:01:20,  7.81s/it]
 49%|████▉     | 18603/37963 [42:08:13<45:54:41,  8.54s/it]
 49%|████▉     | 18604/37963 [42:08:21<44:51:31,  8.34s/it]
 49%|████▉     | 18605/37963 [42:08:29<43:24:30,  8.07s/it]
 49%|████▉     | 18606/37963 [42:08:36<42:38:45,  7.93s/it]
 49%|████▉     | 18607/37963 [42:08:44<42:28:48,  7.90s/it]
 49%|████▉     | 18608/37963 [42:08:52<41:59:24,  7.81s/it]
 49%|████▉     | 18609/37963 [42:08:59<41:31:09,  7.72s/it]
 49%|████▉     | 18610/37963 [42:09:07<41:55:09,  7.80s/it]
                                                           
{'loss': '0.1653', 'grad_norm': '1.781', 'learning_rate': '1.08e-05', 'epoch': '0.4902'}
+
 49%|████▉     | 18610/37963 [42:09:07<41:55:09,  7.80s/it]
 49%|████▉     | 18611/37963 [42:09:15<42:04:58,  7.83s/it]
 49%|████▉     | 18612/37963 [42:09:25<45:59:52,  8.56s/it]
 49%|████▉     | 18613/37963 [42:09:33<44:14:12,  8.23s/it]
 49%|████▉     | 18614/37963 [42:09:41<43:27:20,  8.09s/it]
 49%|████▉     | 18615/37963 [42:09:48<42:46:17,  7.96s/it]
 49%|████▉     | 18616/37963 [42:09:56<41:44:24,  7.77s/it]
 49%|████▉     | 18617/37963 [42:10:06<45:42:44,  8.51s/it]
 49%|████▉     | 18618/37963 [42:10:16<48:44:33,  9.07s/it]
 49%|████▉     | 18619/37963 [42:10:27<51:21:18,  9.56s/it]
 49%|████▉     | 18620/37963 [42:10:34<47:46:44,  8.89s/it]
                                                           
{'loss': '0.1633', 'grad_norm': '2.7', 'learning_rate': '1.079e-05', 'epoch': '0.4905'}
+
 49%|████▉     | 18620/37963 [42:10:34<47:46:44,  8.89s/it]
 49%|████▉     | 18621/37963 [42:10:42<45:52:21,  8.54s/it]
 49%|████▉     | 18622/37963 [42:10:50<44:20:19,  8.25s/it]
 49%|████▉     | 18623/37963 [42:10:57<43:26:32,  8.09s/it]
 49%|████▉     | 18624/37963 [42:11:05<42:59:24,  8.00s/it]
 49%|████▉     | 18625/37963 [42:11:13<42:23:12,  7.89s/it]
 49%|████▉     | 18626/37963 [42:11:23<46:03:58,  8.58s/it]
 49%|████▉     | 18627/37963 [42:11:31<44:49:31,  8.35s/it]
 49%|████▉     | 18628/37963 [42:11:38<43:35:32,  8.12s/it]
 49%|████▉     | 18629/37963 [42:11:46<43:19:28,  8.07s/it]
 49%|████▉     | 18630/37963 [42:11:54<42:35:43,  7.93s/it]
                                                           
{'loss': '0.1516', 'grad_norm': '0.9184', 'learning_rate': '1.079e-05', 'epoch': '0.4907'}
+
 49%|████▉     | 18630/37963 [42:11:54<42:35:43,  7.93s/it]
 49%|████▉     | 18631/37963 [42:12:02<42:26:55,  7.90s/it]
 49%|████▉     | 18632/37963 [42:12:09<41:53:07,  7.80s/it]
 49%|████▉     | 18633/37963 [42:12:17<41:56:37,  7.81s/it]
 49%|████▉     | 18634/37963 [42:12:25<41:38:54,  7.76s/it]
 49%|████▉     | 18635/37963 [42:12:35<45:30:30,  8.48s/it]
 49%|████▉     | 18636/37963 [42:12:43<44:19:34,  8.26s/it]
 49%|████▉     | 18637/37963 [42:12:50<43:18:22,  8.07s/it]
 49%|████▉     | 18638/37963 [42:12:58<42:23:12,  7.90s/it]
 49%|████▉     | 18639/37963 [42:13:05<41:34:31,  7.75s/it]
 49%|████▉     | 18640/37963 [42:13:13<41:23:40,  7.71s/it]
                                                           
{'loss': '0.1554', 'grad_norm': '1.163', 'learning_rate': '1.078e-05', 'epoch': '0.491'}
+
 49%|████▉     | 18640/37963 [42:13:13<41:23:40,  7.71s/it]
 49%|████▉     | 18641/37963 [42:13:21<41:28:00,  7.73s/it]
 49%|████▉     | 18642/37963 [42:13:28<41:14:19,  7.68s/it]
 49%|████▉     | 18643/37963 [42:13:36<41:10:23,  7.67s/it]
 49%|████▉     | 18644/37963 [42:13:46<45:18:19,  8.44s/it]
 49%|████▉     | 18645/37963 [42:13:54<43:54:34,  8.18s/it]
 49%|████▉     | 18646/37963 [42:14:01<43:01:57,  8.02s/it]
 49%|████▉     | 18647/37963 [42:14:08<41:48:06,  7.79s/it]
 49%|████▉     | 18648/37963 [42:14:16<41:55:04,  7.81s/it]
 49%|████▉     | 18649/37963 [42:14:24<41:43:01,  7.78s/it]
 49%|████▉     | 18650/37963 [42:14:32<41:51:21,  7.80s/it]
                                                           
{'loss': '0.1677', 'grad_norm': '2.222', 'learning_rate': '1.077e-05', 'epoch': '0.4913'}
+
 49%|████▉     | 18650/37963 [42:14:32<41:51:21,  7.80s/it]
 49%|████▉     | 18651/37963 [42:14:42<45:43:54,  8.52s/it]
 49%|████▉     | 18652/37963 [42:14:50<44:10:54,  8.24s/it]
 49%|████▉     | 18653/37963 [42:14:57<42:55:54,  8.00s/it]
 49%|████▉     | 18654/37963 [42:15:05<42:08:53,  7.86s/it]
 49%|████▉     | 18655/37963 [42:15:12<41:53:11,  7.81s/it]
 49%|████▉     | 18656/37963 [42:15:20<41:30:30,  7.74s/it]
 49%|████▉     | 18657/37963 [42:15:28<41:24:30,  7.72s/it]
 49%|████▉     | 18658/37963 [42:15:35<41:05:42,  7.66s/it]
 49%|████▉     | 18659/37963 [42:15:43<41:15:18,  7.69s/it]
 49%|████▉     | 18660/37963 [42:15:53<45:43:26,  8.53s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '1.179', 'learning_rate': '1.076e-05', 'epoch': '0.4915'}
+
 49%|████▉     | 18660/37963 [42:15:53<45:43:26,  8.53s/it]
 49%|████▉     | 18661/37963 [42:16:01<44:39:53,  8.33s/it]
 49%|████▉     | 18662/37963 [42:16:09<43:45:19,  8.16s/it]
 49%|████▉     | 18663/37963 [42:16:20<47:41:24,  8.90s/it]
 49%|████▉     | 18664/37963 [42:16:27<45:59:09,  8.58s/it]
 49%|████▉     | 18665/37963 [42:16:35<44:55:36,  8.38s/it]
 49%|████▉     | 18666/37963 [42:16:43<43:53:00,  8.19s/it]
 49%|████▉     | 18667/37963 [42:16:53<47:12:31,  8.81s/it]
 49%|████▉     | 18668/37963 [42:17:01<45:25:46,  8.48s/it]
 49%|████▉     | 18669/37963 [42:17:09<43:58:34,  8.21s/it]
 49%|████▉     | 18670/37963 [42:17:16<43:02:13,  8.03s/it]
                                                           
{'loss': '0.1759', 'grad_norm': '2.434', 'learning_rate': '1.075e-05', 'epoch': '0.4918'}
+
 49%|████▉     | 18670/37963 [42:17:16<43:02:13,  8.03s/it]
 49%|████▉     | 18671/37963 [42:17:24<42:35:33,  7.95s/it]
 49%|████▉     | 18672/37963 [42:17:34<46:19:50,  8.65s/it]
 49%|████▉     | 18673/37963 [42:17:42<44:34:15,  8.32s/it]
 49%|████▉     | 18674/37963 [42:17:53<48:29:38,  9.05s/it]
 49%|████▉     | 18675/37963 [42:18:00<46:21:48,  8.65s/it]
 49%|████▉     | 18676/37963 [42:18:08<44:41:14,  8.34s/it]
 49%|████▉     | 18677/37963 [42:18:16<44:05:02,  8.23s/it]
 49%|████▉     | 18678/37963 [42:18:24<43:14:27,  8.07s/it]
 49%|████▉     | 18679/37963 [42:18:31<42:50:16,  8.00s/it]
 49%|████▉     | 18680/37963 [42:18:39<42:10:08,  7.87s/it]
                                                           
{'loss': '0.1585', 'grad_norm': '3.855', 'learning_rate': '1.074e-05', 'epoch': '0.4921'}
+
 49%|████▉     | 18680/37963 [42:18:39<42:10:08,  7.87s/it]
 49%|████▉     | 18681/37963 [42:18:47<41:52:52,  7.82s/it]
 49%|████▉     | 18682/37963 [42:18:54<41:49:47,  7.81s/it]
 49%|████▉     | 18683/37963 [42:19:05<45:42:56,  8.54s/it]
 49%|████▉     | 18684/37963 [42:19:13<44:46:41,  8.36s/it]
 49%|████▉     | 18685/37963 [42:19:20<43:46:20,  8.17s/it]
 49%|████▉     | 18686/37963 [42:19:28<43:11:12,  8.07s/it]
 49%|████▉     | 18687/37963 [42:19:36<42:29:36,  7.94s/it]
 49%|████▉     | 18688/37963 [42:19:43<41:58:37,  7.84s/it]
 49%|████▉     | 18689/37963 [42:19:51<42:03:45,  7.86s/it]
 49%|████▉     | 18690/37963 [42:19:59<41:41:51,  7.79s/it]
                                                           
{'loss': '0.1609', 'grad_norm': '1.463', 'learning_rate': '1.073e-05', 'epoch': '0.4923'}
+
 49%|████▉     | 18690/37963 [42:19:59<41:41:51,  7.79s/it]
 49%|████▉     | 18691/37963 [42:20:07<41:21:58,  7.73s/it]
 49%|████▉     | 18692/37963 [42:20:14<41:00:02,  7.66s/it]
 49%|████▉     | 18693/37963 [42:20:22<41:11:12,  7.69s/it]
 49%|████▉     | 18694/37963 [42:20:30<41:16:05,  7.71s/it]
 49%|████▉     | 18695/37963 [42:20:37<41:22:54,  7.73s/it]
 49%|████▉     | 18696/37963 [42:20:45<40:54:15,  7.64s/it]
 49%|████▉     | 18697/37963 [42:20:53<41:01:07,  7.66s/it]
 49%|████▉     | 18698/37963 [42:21:03<45:30:25,  8.50s/it]
 49%|████▉     | 18699/37963 [42:21:13<48:19:09,  9.03s/it]
 49%|████▉     | 18700/37963 [42:21:21<46:08:24,  8.62s/it]
                                                           
{'loss': '0.1594', 'grad_norm': '1.446', 'learning_rate': '1.073e-05', 'epoch': '0.4926'}
+
 49%|████▉     | 18700/37963 [42:21:21<46:08:24,  8.62s/it]
 49%|████▉     | 18701/37963 [42:21:28<44:20:53,  8.29s/it]
 49%|████▉     | 18702/37963 [42:21:36<43:11:46,  8.07s/it]
 49%|████▉     | 18703/37963 [42:21:43<42:14:17,  7.90s/it]
 49%|████▉     | 18704/37963 [42:21:51<42:07:45,  7.88s/it]
 49%|████▉     | 18705/37963 [42:21:59<41:42:55,  7.80s/it]
 49%|████▉     | 18706/37963 [42:22:06<41:03:06,  7.67s/it]
 49%|████▉     | 18707/37963 [42:22:14<41:13:38,  7.71s/it]
 49%|████▉     | 18708/37963 [42:22:24<45:16:28,  8.46s/it]
 49%|████▉     | 18709/37963 [42:22:32<44:14:09,  8.27s/it]
 49%|████▉     | 18710/37963 [42:22:40<43:21:11,  8.11s/it]
                                                           
{'loss': '0.1485', 'grad_norm': '2.196', 'learning_rate': '1.072e-05', 'epoch': '0.4928'}
+
 49%|████▉     | 18710/37963 [42:22:40<43:21:11,  8.11s/it]
 49%|████▉     | 18711/37963 [42:22:48<42:45:36,  8.00s/it]
 49%|████▉     | 18712/37963 [42:22:56<42:43:01,  7.99s/it]
 49%|████▉     | 18713/37963 [42:23:06<46:26:27,  8.69s/it]
 49%|████▉     | 18714/37963 [42:23:14<44:44:05,  8.37s/it]
 49%|████▉     | 18715/37963 [42:23:21<43:21:16,  8.11s/it]
 49%|████▉     | 18716/37963 [42:23:28<42:08:51,  7.88s/it]
 49%|████▉     | 18717/37963 [42:23:36<41:47:39,  7.82s/it]
 49%|████▉     | 18718/37963 [42:23:44<41:30:07,  7.76s/it]
 49%|████▉     | 18719/37963 [42:23:51<41:33:06,  7.77s/it]
 49%|████▉     | 18720/37963 [42:23:59<41:24:58,  7.75s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '2.78', 'learning_rate': '1.071e-05', 'epoch': '0.4931'}
+
 49%|████▉     | 18720/37963 [42:23:59<41:24:58,  7.75s/it]
 49%|████▉     | 18721/37963 [42:24:10<45:41:34,  8.55s/it]
 49%|████▉     | 18722/37963 [42:24:17<44:30:25,  8.33s/it]
 49%|████▉     | 18723/37963 [42:24:25<43:42:00,  8.18s/it]
 49%|████▉     | 18724/37963 [42:24:33<42:57:27,  8.04s/it]
 49%|████▉     | 18725/37963 [42:24:41<42:36:38,  7.97s/it]
 49%|████▉     | 18726/37963 [42:24:51<46:39:57,  8.73s/it]
 49%|████▉     | 18727/37963 [42:24:59<45:00:19,  8.42s/it]
 49%|████▉     | 18728/37963 [42:25:09<48:02:01,  8.99s/it]
 49%|████▉     | 18729/37963 [42:25:17<46:03:59,  8.62s/it]
 49%|████▉     | 18730/37963 [42:25:25<44:41:16,  8.36s/it]
                                                           
{'loss': '0.151', 'grad_norm': '4.44', 'learning_rate': '1.07e-05', 'epoch': '0.4934'}
+
 49%|████▉     | 18730/37963 [42:25:25<44:41:16,  8.36s/it]
 49%|████▉     | 18731/37963 [42:25:32<43:30:03,  8.14s/it]
 49%|████▉     | 18732/37963 [42:25:40<42:29:54,  7.96s/it]
 49%|████▉     | 18733/37963 [42:25:48<42:08:49,  7.89s/it]
 49%|████▉     | 18734/37963 [42:25:55<41:23:49,  7.75s/it]
 49%|████▉     | 18735/37963 [42:26:03<41:03:40,  7.69s/it]
 49%|████▉     | 18736/37963 [42:26:10<41:14:19,  7.72s/it]
 49%|████▉     | 18737/37963 [42:26:20<44:49:01,  8.39s/it]
 49%|████▉     | 18738/37963 [42:26:28<43:46:18,  8.20s/it]
 49%|████▉     | 18739/37963 [42:26:36<42:39:06,  7.99s/it]
 49%|████▉     | 18740/37963 [42:26:43<42:07:51,  7.89s/it]
                                                           
{'loss': '0.1632', 'grad_norm': '2.431', 'learning_rate': '1.069e-05', 'epoch': '0.4936'}
+
 49%|████▉     | 18740/37963 [42:26:43<42:07:51,  7.89s/it]
 49%|████▉     | 18741/37963 [42:26:51<41:56:30,  7.86s/it]
 49%|████▉     | 18742/37963 [42:26:59<41:46:15,  7.82s/it]
 49%|████▉     | 18743/37963 [42:27:07<41:38:43,  7.80s/it]
 49%|████▉     | 18744/37963 [42:27:14<41:42:21,  7.81s/it]
 49%|████▉     | 18745/37963 [42:27:22<41:53:50,  7.85s/it]
 49%|████▉     | 18746/37963 [42:27:33<45:58:06,  8.61s/it]
 49%|████▉     | 18747/37963 [42:27:40<44:09:59,  8.27s/it]
 49%|████▉     | 18748/37963 [42:27:48<43:28:21,  8.14s/it]
 49%|████▉     | 18749/37963 [42:27:56<42:30:24,  7.96s/it]
 49%|████▉     | 18750/37963 [42:28:03<41:46:58,  7.83s/it]
                                                           
{'loss': '0.1492', 'grad_norm': '0.9601', 'learning_rate': '1.068e-05', 'epoch': '0.4939'}
+
 49%|████▉     | 18750/37963 [42:28:03<41:46:58,  7.83s/it]
 49%|████▉     | 18751/37963 [42:28:11<41:25:55,  7.76s/it]
 49%|████▉     | 18752/37963 [42:28:18<41:08:49,  7.71s/it]
 49%|████▉     | 18753/37963 [42:28:29<45:11:46,  8.47s/it]
 49%|████▉     | 18754/37963 [42:28:36<43:46:10,  8.20s/it]
 49%|████▉     | 18755/37963 [42:28:44<42:56:18,  8.05s/it]
 49%|████▉     | 18756/37963 [42:28:52<42:27:32,  7.96s/it]
 49%|████▉     | 18757/37963 [42:29:02<46:01:59,  8.63s/it]
 49%|████▉     | 18758/37963 [42:29:10<44:43:18,  8.38s/it]
 49%|████▉     | 18759/37963 [42:29:20<48:30:20,  9.09s/it]
 49%|████▉     | 18760/37963 [42:29:28<46:33:08,  8.73s/it]
                                                           
{'loss': '0.1631', 'grad_norm': '1.785', 'learning_rate': '1.068e-05', 'epoch': '0.4942'}
+
 49%|████▉     | 18760/37963 [42:29:28<46:33:08,  8.73s/it]
 49%|████▉     | 18761/37963 [42:29:36<45:05:53,  8.46s/it]
 49%|████▉     | 18762/37963 [42:29:44<43:41:25,  8.19s/it]
 49%|████▉     | 18763/37963 [42:29:51<43:06:20,  8.08s/it]
 49%|████▉     | 18764/37963 [42:29:59<42:24:05,  7.95s/it]
 49%|████▉     | 18765/37963 [42:30:07<42:03:43,  7.89s/it]
 49%|████▉     | 18766/37963 [42:30:14<41:23:05,  7.76s/it]
 49%|████▉     | 18767/37963 [42:30:22<41:20:07,  7.75s/it]
 49%|████▉     | 18768/37963 [42:30:30<41:10:03,  7.72s/it]
 49%|████▉     | 18769/37963 [42:30:38<41:26:11,  7.77s/it]
 49%|████▉     | 18770/37963 [42:30:45<41:37:57,  7.81s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '2.988', 'learning_rate': '1.067e-05', 'epoch': '0.4944'}
+
 49%|████▉     | 18770/37963 [42:30:45<41:37:57,  7.81s/it]
 49%|████▉     | 18771/37963 [42:30:53<41:20:44,  7.76s/it]
 49%|████▉     | 18772/37963 [42:31:01<41:14:26,  7.74s/it]
 49%|████▉     | 18773/37963 [42:31:09<41:18:42,  7.75s/it]
 49%|████▉     | 18774/37963 [42:31:19<45:23:01,  8.51s/it]
 49%|████▉     | 18775/37963 [42:31:29<48:39:14,  9.13s/it]
 49%|████▉     | 18776/37963 [42:31:37<46:25:11,  8.71s/it]
 49%|████▉     | 18777/37963 [42:31:48<49:16:05,  9.24s/it]
 49%|████▉     | 18778/37963 [42:31:55<46:59:45,  8.82s/it]
 49%|████▉     | 18779/37963 [42:32:03<45:08:02,  8.47s/it]
 49%|████▉     | 18780/37963 [42:32:11<44:05:16,  8.27s/it]
                                                           
{'loss': '0.1667', 'grad_norm': '3.772', 'learning_rate': '1.066e-05', 'epoch': '0.4947'}
+
 49%|████▉     | 18780/37963 [42:32:11<44:05:16,  8.27s/it]
 49%|████▉     | 18781/37963 [42:32:19<43:18:05,  8.13s/it]
 49%|████▉     | 18782/37963 [42:32:27<42:55:04,  8.06s/it]
 49%|████▉     | 18783/37963 [42:32:34<42:08:04,  7.91s/it]
 49%|████▉     | 18784/37963 [42:32:42<41:54:10,  7.87s/it]
 49%|████▉     | 18785/37963 [42:32:52<45:53:36,  8.61s/it]
 49%|████▉     | 18786/37963 [42:33:00<44:47:10,  8.41s/it]
 49%|████▉     | 18787/37963 [42:33:08<43:26:30,  8.16s/it]
 49%|████▉     | 18788/37963 [42:33:16<42:47:36,  8.03s/it]
 49%|████▉     | 18789/37963 [42:33:23<42:14:40,  7.93s/it]
 49%|████▉     | 18790/37963 [42:33:31<41:49:56,  7.85s/it]
                                                           
{'loss': '0.1625', 'grad_norm': '1.957', 'learning_rate': '1.065e-05', 'epoch': '0.495'}
+
 49%|████▉     | 18790/37963 [42:33:31<41:49:56,  7.85s/it]
 49%|████▉     | 18791/37963 [42:33:38<41:24:00,  7.77s/it]
 50%|████▉     | 18792/37963 [42:33:46<41:03:52,  7.71s/it]
 50%|████▉     | 18793/37963 [42:33:56<44:59:43,  8.45s/it]
 50%|████▉     | 18794/37963 [42:34:04<43:13:18,  8.12s/it]
 50%|████▉     | 18795/37963 [42:34:11<42:45:15,  8.03s/it]
 50%|████▉     | 18796/37963 [42:34:19<41:57:24,  7.88s/it]
 50%|████▉     | 18797/37963 [42:34:29<45:40:06,  8.58s/it]
 50%|████▉     | 18798/37963 [42:34:37<44:14:19,  8.31s/it]
 50%|████▉     | 18799/37963 [42:34:45<43:37:34,  8.20s/it]
 50%|████▉     | 18800/37963 [42:34:52<42:38:18,  8.01s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '1.288', 'learning_rate': '1.064e-05', 'epoch': '0.4952'}
+
 50%|████▉     | 18800/37963 [42:34:52<42:38:18,  8.01s/it]
 50%|████▉     | 18801/37963 [42:35:03<46:35:09,  8.75s/it]
 50%|████▉     | 18802/37963 [42:35:11<45:09:14,  8.48s/it]
 50%|████▉     | 18803/37963 [42:35:21<48:24:13,  9.09s/it]
 50%|████▉     | 18804/37963 [42:35:29<46:30:36,  8.74s/it]
 50%|████▉     | 18805/37963 [42:35:37<45:32:37,  8.56s/it]
 50%|████▉     | 18806/37963 [42:35:45<44:08:43,  8.30s/it]
 50%|████▉     | 18807/37963 [42:35:53<43:19:40,  8.14s/it]
 50%|████▉     | 18808/37963 [42:36:00<42:30:40,  7.99s/it]
 50%|████▉     | 18809/37963 [42:36:08<42:11:03,  7.93s/it]
 50%|████▉     | 18810/37963 [42:36:16<41:41:56,  7.84s/it]
                                                           
{'loss': '0.1744', 'grad_norm': '0.8818', 'learning_rate': '1.063e-05', 'epoch': '0.4955'}
+
 50%|████▉     | 18810/37963 [42:36:16<41:41:56,  7.84s/it]
 50%|████▉     | 18811/37963 [42:36:23<41:23:49,  7.78s/it]
 50%|████▉     | 18812/37963 [42:36:31<40:42:53,  7.65s/it]
 50%|████▉     | 18813/37963 [42:36:39<41:19:23,  7.77s/it]
 50%|████▉     | 18814/37963 [42:36:47<41:23:27,  7.78s/it]
 50%|████▉     | 18815/37963 [42:36:54<41:13:26,  7.75s/it]
 50%|████▉     | 18816/37963 [42:37:02<41:05:47,  7.73s/it]
 50%|████▉     | 18817/37963 [42:37:09<40:38:42,  7.64s/it]
 50%|████▉     | 18818/37963 [42:37:17<40:07:12,  7.54s/it]
 50%|████▉     | 18819/37963 [42:37:24<40:28:59,  7.61s/it]
 50%|████▉     | 18820/37963 [42:37:32<40:26:25,  7.61s/it]
                                                           
{'loss': '0.1777', 'grad_norm': '2.714', 'learning_rate': '1.062e-05', 'epoch': '0.4957'}
+
 50%|████▉     | 18820/37963 [42:37:32<40:26:25,  7.61s/it]
 50%|████▉     | 18821/37963 [42:37:40<40:58:29,  7.71s/it]
 50%|████▉     | 18822/37963 [42:37:50<45:10:30,  8.50s/it]
 50%|████▉     | 18823/37963 [42:37:58<43:53:11,  8.25s/it]
 50%|████▉     | 18824/37963 [42:38:06<42:46:25,  8.05s/it]
 50%|████▉     | 18825/37963 [42:38:13<42:17:22,  7.95s/it]
 50%|████▉     | 18826/37963 [42:38:21<42:01:21,  7.91s/it]
 50%|████▉     | 18827/37963 [42:38:29<41:51:19,  7.87s/it]
 50%|████▉     | 18828/37963 [42:38:37<41:40:58,  7.84s/it]
 50%|████▉     | 18829/37963 [42:38:47<45:49:28,  8.62s/it]
 50%|████▉     | 18830/37963 [42:38:55<44:05:57,  8.30s/it]
                                                           
{'loss': '0.1594', 'grad_norm': '5.998', 'learning_rate': '1.062e-05', 'epoch': '0.496'}
+
 50%|████▉     | 18830/37963 [42:38:55<44:05:57,  8.30s/it]
 50%|████▉     | 18831/37963 [42:39:05<47:52:30,  9.01s/it]
 50%|████▉     | 18832/37963 [42:39:13<46:10:27,  8.69s/it]
 50%|████▉     | 18833/37963 [42:39:21<44:29:34,  8.37s/it]
 50%|████▉     | 18834/37963 [42:39:31<47:26:51,  8.93s/it]
 50%|████▉     | 18835/37963 [42:39:39<45:09:10,  8.50s/it]
 50%|████▉     | 18836/37963 [42:39:46<43:53:36,  8.26s/it]
 50%|████▉     | 18837/37963 [42:39:54<43:13:11,  8.14s/it]
 50%|████▉     | 18838/37963 [42:40:02<42:32:48,  8.01s/it]
 50%|████▉     | 18839/37963 [42:40:09<41:49:27,  7.87s/it]
 50%|████▉     | 18840/37963 [42:40:17<41:20:29,  7.78s/it]
                                                           
{'loss': '0.1538', 'grad_norm': '1.974', 'learning_rate': '1.061e-05', 'epoch': '0.4963'}
+
 50%|████▉     | 18840/37963 [42:40:17<41:20:29,  7.78s/it]
 50%|████▉     | 18841/37963 [42:40:25<41:22:55,  7.79s/it]
 50%|████▉     | 18842/37963 [42:40:33<41:41:20,  7.85s/it]
 50%|████▉     | 18843/37963 [42:40:40<40:59:53,  7.72s/it]
 50%|████▉     | 18844/37963 [42:40:48<40:53:36,  7.70s/it]
 50%|████▉     | 18845/37963 [42:40:58<44:53:19,  8.45s/it]
 50%|████▉     | 18846/37963 [42:41:09<48:04:31,  9.05s/it]
 50%|████▉     | 18847/37963 [42:41:19<50:30:43,  9.51s/it]
 50%|████▉     | 18848/37963 [42:41:27<47:38:02,  8.97s/it]
 50%|████▉     | 18849/37963 [42:41:37<49:35:32,  9.34s/it]
 50%|████▉     | 18850/37963 [42:41:45<46:33:28,  8.77s/it]
                                                           
{'loss': '0.1428', 'grad_norm': '2.302', 'learning_rate': '1.06e-05', 'epoch': '0.4965'}
+
 50%|████▉     | 18850/37963 [42:41:45<46:33:28,  8.77s/it]
 50%|████▉     | 18851/37963 [42:41:52<44:53:11,  8.45s/it]
 50%|████▉     | 18852/37963 [42:42:00<43:48:55,  8.25s/it]
 50%|████▉     | 18853/37963 [42:42:08<42:37:25,  8.03s/it]
 50%|████▉     | 18854/37963 [42:42:15<41:57:53,  7.91s/it]
 50%|████▉     | 18855/37963 [42:42:23<41:52:47,  7.89s/it]
 50%|████▉     | 18856/37963 [42:42:31<41:42:47,  7.86s/it]
 50%|████▉     | 18857/37963 [42:42:38<41:27:55,  7.81s/it]
 50%|████▉     | 18858/37963 [42:42:46<41:23:50,  7.80s/it]
 50%|████▉     | 18859/37963 [42:42:54<41:09:47,  7.76s/it]
 50%|████▉     | 18860/37963 [42:43:02<41:08:18,  7.75s/it]
                                                           
{'loss': '0.1525', 'grad_norm': '1.517', 'learning_rate': '1.059e-05', 'epoch': '0.4968'}
+
 50%|████▉     | 18860/37963 [42:43:02<41:08:18,  7.75s/it]
 50%|████▉     | 18861/37963 [42:43:09<41:11:21,  7.76s/it]
 50%|████▉     | 18862/37963 [42:43:17<40:55:24,  7.71s/it]
 50%|████▉     | 18863/37963 [42:43:25<40:41:03,  7.67s/it]
 50%|████▉     | 18864/37963 [42:43:32<40:37:17,  7.66s/it]
 50%|████▉     | 18865/37963 [42:43:40<40:37:20,  7.66s/it]
 50%|████▉     | 18866/37963 [42:43:50<44:14:21,  8.34s/it]
 50%|████▉     | 18867/37963 [42:43:57<43:07:11,  8.13s/it]
 50%|████▉     | 18868/37963 [42:44:05<42:21:57,  7.99s/it]
 50%|████▉     | 18869/37963 [42:44:13<41:46:24,  7.88s/it]
 50%|████▉     | 18870/37963 [42:44:21<41:52:06,  7.89s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '4.113', 'learning_rate': '1.058e-05', 'epoch': '0.4971'}
+
 50%|████▉     | 18870/37963 [42:44:21<41:52:06,  7.89s/it]
 50%|████▉     | 18871/37963 [42:44:28<41:29:09,  7.82s/it]
 50%|████▉     | 18872/37963 [42:44:36<40:44:20,  7.68s/it]
 50%|████▉     | 18873/37963 [42:44:44<41:00:08,  7.73s/it]
 50%|████▉     | 18874/37963 [42:44:51<40:50:01,  7.70s/it]
 50%|████▉     | 18875/37963 [42:45:01<44:56:52,  8.48s/it]
 50%|████▉     | 18876/37963 [42:45:09<43:51:22,  8.27s/it]
 50%|████▉     | 18877/37963 [42:45:17<42:47:43,  8.07s/it]
 50%|████▉     | 18878/37963 [42:45:25<42:51:11,  8.08s/it]
 50%|████▉     | 18879/37963 [42:45:33<42:19:16,  7.98s/it]
 50%|████▉     | 18880/37963 [42:45:43<46:17:13,  8.73s/it]
                                                           
{'loss': '0.1712', 'grad_norm': '1.677', 'learning_rate': '1.057e-05', 'epoch': '0.4973'}
+
 50%|████▉     | 18880/37963 [42:45:43<46:17:13,  8.73s/it]
 50%|████▉     | 18881/37963 [42:45:51<44:40:07,  8.43s/it]
 50%|████▉     | 18882/37963 [42:45:59<43:54:24,  8.28s/it]
 50%|████▉     | 18883/37963 [42:46:09<47:10:37,  8.90s/it]
 50%|████▉     | 18884/37963 [42:46:17<45:15:27,  8.54s/it]
 50%|████▉     | 18885/37963 [42:46:25<44:06:55,  8.32s/it]
 50%|████▉     | 18886/37963 [42:46:33<43:19:14,  8.18s/it]
 50%|████▉     | 18887/37963 [42:46:40<42:21:41,  7.99s/it]
 50%|████▉     | 18888/37963 [42:46:48<41:42:57,  7.87s/it]
 50%|████▉     | 18889/37963 [42:46:55<41:27:48,  7.83s/it]
 50%|████▉     | 18890/37963 [42:47:06<45:36:44,  8.61s/it]
                                                           
{'loss': '0.1588', 'grad_norm': '0.8', 'learning_rate': '1.056e-05', 'epoch': '0.4976'}
+
 50%|████▉     | 18890/37963 [42:47:06<45:36:44,  8.61s/it]
 50%|████▉     | 18891/37963 [42:47:14<44:08:14,  8.33s/it]
 50%|████▉     | 18892/37963 [42:47:21<43:16:58,  8.17s/it]
 50%|████▉     | 18893/37963 [42:47:32<46:44:47,  8.82s/it]
 50%|████▉     | 18894/37963 [42:47:39<45:05:18,  8.51s/it]
 50%|████▉     | 18895/37963 [42:47:47<43:44:03,  8.26s/it]
 50%|████▉     | 18896/37963 [42:47:58<47:12:22,  8.91s/it]
 50%|████▉     | 18897/37963 [42:48:05<45:26:26,  8.58s/it]
 50%|████▉     | 18898/37963 [42:48:13<44:05:13,  8.32s/it]
 50%|████▉     | 18899/37963 [42:48:21<43:39:58,  8.25s/it]
 50%|████▉     | 18900/37963 [42:48:29<42:43:01,  8.07s/it]
                                                           
{'loss': '0.1519', 'grad_norm': '1.148', 'learning_rate': '1.056e-05', 'epoch': '0.4979'}
+
 50%|████▉     | 18900/37963 [42:48:29<42:43:01,  8.07s/it]
 50%|████▉     | 18901/37963 [42:48:37<42:30:06,  8.03s/it]
 50%|████▉     | 18902/37963 [42:48:44<41:47:44,  7.89s/it]
 50%|████▉     | 18903/37963 [42:48:52<41:23:42,  7.82s/it]
 50%|████▉     | 18904/37963 [42:49:00<41:14:59,  7.79s/it]
 50%|████▉     | 18905/37963 [42:49:08<41:19:04,  7.80s/it]
 50%|████▉     | 18906/37963 [42:49:15<41:33:36,  7.85s/it]
 50%|████▉     | 18907/37963 [42:49:23<41:13:29,  7.79s/it]
 50%|████▉     | 18908/37963 [42:49:31<41:12:09,  7.78s/it]
 50%|████▉     | 18909/37963 [42:49:39<41:07:05,  7.77s/it]
 50%|████▉     | 18910/37963 [42:49:46<40:40:23,  7.69s/it]
                                                           
{'loss': '0.1382', 'grad_norm': '1.867', 'learning_rate': '1.055e-05', 'epoch': '0.4981'}
+
 50%|████▉     | 18910/37963 [42:49:46<40:40:23,  7.69s/it]
 50%|████▉     | 18911/37963 [42:49:54<40:39:40,  7.68s/it]
 50%|████▉     | 18912/37963 [42:50:01<40:11:57,  7.60s/it]
 50%|████▉     | 18913/37963 [42:50:09<39:44:45,  7.51s/it]
 50%|████▉     | 18914/37963 [42:50:19<43:43:58,  8.26s/it]
 50%|████▉     | 18915/37963 [42:50:26<42:09:56,  7.97s/it]
 50%|████▉     | 18916/37963 [42:50:34<42:01:43,  7.94s/it]
 50%|████▉     | 18917/37963 [42:50:41<41:41:45,  7.88s/it]
 50%|████▉     | 18918/37963 [42:50:49<41:36:48,  7.87s/it]
 50%|████▉     | 18919/37963 [42:50:57<40:54:41,  7.73s/it]
 50%|████▉     | 18920/37963 [42:51:04<40:59:09,  7.75s/it]
                                                           
{'loss': '0.1707', 'grad_norm': '2.693', 'learning_rate': '1.054e-05', 'epoch': '0.4984'}
+
 50%|████▉     | 18920/37963 [42:51:04<40:59:09,  7.75s/it]
 50%|████▉     | 18921/37963 [42:51:12<40:36:43,  7.68s/it]
 50%|████▉     | 18922/37963 [42:51:20<40:28:31,  7.65s/it]
 50%|████▉     | 18923/37963 [42:51:33<49:17:54,  9.32s/it]
 50%|████▉     | 18924/37963 [42:51:41<46:56:00,  8.87s/it]
 50%|████▉     | 18925/37963 [42:51:48<45:00:54,  8.51s/it]
 50%|████▉     | 18926/37963 [42:51:56<43:45:35,  8.28s/it]
 50%|████▉     | 18927/37963 [42:52:04<42:40:54,  8.07s/it]
 50%|████▉     | 18928/37963 [42:52:11<42:16:58,  8.00s/it]
 50%|████▉     | 18929/37963 [42:52:19<41:47:21,  7.90s/it]
 50%|████▉     | 18930/37963 [42:52:27<41:26:47,  7.84s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '3.375', 'learning_rate': '1.053e-05', 'epoch': '0.4986'}
+
 50%|████▉     | 18930/37963 [42:52:27<41:26:47,  7.84s/it]
 50%|████▉     | 18931/37963 [42:52:35<41:26:05,  7.84s/it]
 50%|████▉     | 18932/37963 [42:52:42<41:15:19,  7.80s/it]
 50%|████▉     | 18933/37963 [42:52:53<45:03:52,  8.53s/it]
 50%|████▉     | 18934/37963 [42:53:00<43:38:20,  8.26s/it]
 50%|████▉     | 18935/37963 [42:53:08<42:11:43,  7.98s/it]
 50%|████▉     | 18936/37963 [42:53:15<41:42:57,  7.89s/it]
 50%|████▉     | 18937/37963 [42:53:25<45:20:57,  8.58s/it]
 50%|████▉     | 18938/37963 [42:53:33<43:42:22,  8.27s/it]
 50%|████▉     | 18939/37963 [42:53:41<42:51:45,  8.11s/it]
 50%|████▉     | 18940/37963 [42:53:48<42:19:13,  8.01s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '2.851', 'learning_rate': '1.052e-05', 'epoch': '0.4989'}
+
 50%|████▉     | 18940/37963 [42:53:48<42:19:13,  8.01s/it]
 50%|████▉     | 18941/37963 [42:54:01<49:19:52,  9.34s/it]
 50%|████▉     | 18942/37963 [42:54:09<46:44:41,  8.85s/it]
 50%|████▉     | 18943/37963 [42:54:16<44:47:11,  8.48s/it]
 50%|████▉     | 18944/37963 [42:54:24<43:21:19,  8.21s/it]
 50%|████▉     | 18945/37963 [42:54:31<42:25:57,  8.03s/it]
 50%|████▉     | 18946/37963 [42:54:39<41:59:16,  7.95s/it]
 50%|████▉     | 18947/37963 [42:54:47<41:18:05,  7.82s/it]
 50%|████▉     | 18948/37963 [42:54:54<40:55:45,  7.75s/it]
 50%|████▉     | 18949/37963 [42:55:05<45:08:32,  8.55s/it]
 50%|████▉     | 18950/37963 [42:55:12<43:34:28,  8.25s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '1.555', 'learning_rate': '1.051e-05', 'epoch': '0.4992'}
+
 50%|████▉     | 18950/37963 [42:55:12<43:34:28,  8.25s/it]
 50%|████▉     | 18951/37963 [42:55:20<42:33:10,  8.06s/it]
 50%|████▉     | 18952/37963 [42:55:28<42:01:47,  7.96s/it]
 50%|████▉     | 18953/37963 [42:55:35<41:55:08,  7.94s/it]
 50%|████▉     | 18954/37963 [42:55:43<40:58:19,  7.76s/it]
 50%|████▉     | 18955/37963 [42:55:51<41:03:28,  7.78s/it]
 50%|████▉     | 18956/37963 [42:55:59<41:12:34,  7.81s/it]
 50%|████▉     | 18957/37963 [42:56:06<40:58:20,  7.76s/it]
 50%|████▉     | 18958/37963 [42:56:14<40:32:28,  7.68s/it]
 50%|████▉     | 18959/37963 [42:56:21<40:46:22,  7.72s/it]
 50%|████▉     | 18960/37963 [42:56:29<40:50:34,  7.74s/it]
                                                           
{'loss': '0.1652', 'grad_norm': '3.912', 'learning_rate': '1.05e-05', 'epoch': '0.4994'}
+
 50%|████▉     | 18960/37963 [42:56:29<40:50:34,  7.74s/it]
 50%|████▉     | 18961/37963 [42:56:37<40:35:44,  7.69s/it]
 50%|████▉     | 18962/37963 [42:56:47<44:46:39,  8.48s/it]
 50%|████▉     | 18963/37963 [42:56:55<43:31:25,  8.25s/it]
 50%|████▉     | 18964/37963 [42:57:03<42:49:12,  8.11s/it]
 50%|████▉     | 18965/37963 [42:57:10<42:01:03,  7.96s/it]
 50%|████▉     | 18966/37963 [42:57:18<41:41:34,  7.90s/it]
 50%|████▉     | 18967/37963 [42:57:29<46:11:37,  8.75s/it]
 50%|████▉     | 18968/37963 [42:57:37<45:00:36,  8.53s/it]
 50%|████▉     | 18969/37963 [42:57:45<43:50:27,  8.31s/it]
 50%|████▉     | 18970/37963 [42:57:52<42:53:20,  8.13s/it]
                                                           
{'loss': '0.1576', 'grad_norm': '1.696', 'learning_rate': '1.05e-05', 'epoch': '0.4997'}
+
 50%|████▉     | 18970/37963 [42:57:52<42:53:20,  8.13s/it]
 50%|████▉     | 18971/37963 [42:58:00<42:08:01,  7.99s/it]
 50%|████▉     | 18972/37963 [42:58:08<41:29:12,  7.86s/it]
 50%|████▉     | 18973/37963 [42:58:15<41:25:47,  7.85s/it]
 50%|████▉     | 18974/37963 [42:58:23<41:07:17,  7.80s/it]
 50%|████▉     | 18975/37963 [42:58:31<40:55:21,  7.76s/it]
 50%|████▉     | 18976/37963 [42:58:39<41:20:43,  7.84s/it]
 50%|████▉     | 18977/37963 [42:58:49<46:00:39,  8.72s/it]
 50%|████▉     | 18978/37963 [42:58:57<44:41:53,  8.48s/it]
 50%|████▉     | 18979/37963 [42:59:05<43:28:49,  8.25s/it]
 50%|████▉     | 18980/37963 [42:59:13<43:14:31,  8.20s/it]
                                                           
{'loss': '0.1656', 'grad_norm': '2.215', 'learning_rate': '1.049e-05', 'epoch': '0.5'}
+
 50%|████▉     | 18980/37963 [42:59:13<43:14:31,  8.20s/it]
 50%|████▉     | 18981/37963 [42:59:21<42:16:10,  8.02s/it]
 50%|█████     | 18982/37963 [42:59:28<41:39:49,  7.90s/it]
 50%|█████     | 18983/37963 [42:59:36<41:22:49,  7.85s/it]
 50%|█████     | 18984/37963 [42:59:44<40:49:56,  7.75s/it]
 50%|█████     | 18985/37963 [42:59:51<40:41:22,  7.72s/it]
 50%|█████     | 18986/37963 [42:59:59<40:34:36,  7.70s/it]
 50%|█████     | 18987/37963 [43:00:07<40:41:34,  7.72s/it]
 50%|█████     | 18988/37963 [43:00:14<40:33:50,  7.70s/it]
 50%|█████     | 18989/37963 [43:00:25<44:25:12,  8.43s/it]
 50%|█████     | 18990/37963 [43:00:32<43:44:21,  8.30s/it]
                                                           
{'loss': '0.1574', 'grad_norm': '3.293', 'learning_rate': '1.048e-05', 'epoch': '0.5002'}
+
 50%|█████     | 18990/37963 [43:00:33<43:44:21,  8.30s/it]
 50%|█████     | 18991/37963 [43:00:43<46:48:46,  8.88s/it]
 50%|█████     | 18992/37963 [43:00:51<45:15:30,  8.59s/it]
 50%|█████     | 18993/37963 [43:00:58<43:42:54,  8.30s/it]
 50%|█████     | 18994/37963 [43:01:06<43:26:41,  8.25s/it]
 50%|█████     | 18995/37963 [43:01:17<46:31:05,  8.83s/it]
 50%|█████     | 18996/37963 [43:01:24<44:42:36,  8.49s/it]
 50%|█████     | 18997/37963 [43:01:34<47:06:49,  8.94s/it]
 50%|█████     | 18998/37963 [43:01:42<44:45:29,  8.50s/it]
 50%|█████     | 18999/37963 [43:01:49<43:32:36,  8.27s/it]
 50%|█████     | 19000/37963 [43:01:57<42:36:29,  8.09s/it]
                                                           
{'loss': '0.1454', 'grad_norm': '2.614', 'learning_rate': '1.047e-05', 'epoch': '0.5005'}
+
 50%|█████     | 19000/37963 [43:01:57<42:36:29,  8.09s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.78s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.78s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 50%|█████     | 19001/37963 [43:03:02<132:40:01, 25.19s/it]
 50%|█████     | 19002/37963 [43:03:10<105:11:52, 19.97s/it]
 50%|█████     | 19003/37963 [43:03:18<85:54:31, 16.31s/it] 
 50%|█████     | 19004/37963 [43:03:26<72:26:18, 13.75s/it]
 50%|█████     | 19005/37963 [43:03:33<62:41:46, 11.91s/it]
 50%|█████     | 19006/37963 [43:03:41<56:10:20, 10.67s/it]
 50%|█████     | 19007/37963 [43:03:49<51:34:50,  9.80s/it]
 50%|█████     | 19008/37963 [43:03:56<48:12:18,  9.16s/it]
 50%|█████     | 19009/37963 [43:04:07<49:51:53,  9.47s/it]
 50%|█████     | 19010/37963 [43:04:15<47:26:45,  9.01s/it]
                                                           
{'loss': '0.151', 'grad_norm': '2.38', 'learning_rate': '1.046e-05', 'epoch': '0.5008'}
+
 50%|█████     | 19010/37963 [43:04:15<47:26:45,  9.01s/it]
 50%|█████     | 19011/37963 [43:04:22<45:28:38,  8.64s/it]
 50%|█████     | 19012/37963 [43:04:30<44:21:51,  8.43s/it]
 50%|█████     | 19013/37963 [43:04:40<46:59:57,  8.93s/it]
 50%|█████     | 19014/37963 [43:04:48<45:26:58,  8.63s/it]
 50%|█████     | 19015/37963 [43:04:56<44:03:52,  8.37s/it]
 50%|█████     | 19016/37963 [43:05:04<43:05:27,  8.19s/it]
 50%|█████     | 19017/37963 [43:05:14<46:09:22,  8.77s/it]
 50%|█████     | 19018/37963 [43:05:22<44:35:16,  8.47s/it]
 50%|█████     | 19019/37963 [43:05:29<43:23:13,  8.25s/it]
 50%|█████     | 19020/37963 [43:05:37<42:27:55,  8.07s/it]
                                                           
{'loss': '0.1602', 'grad_norm': '1.235', 'learning_rate': '1.045e-05', 'epoch': '0.501'}
+
 50%|█████     | 19020/37963 [43:05:37<42:27:55,  8.07s/it]
 50%|█████     | 19021/37963 [43:05:45<41:32:13,  7.89s/it]
 50%|█████     | 19022/37963 [43:05:52<41:10:16,  7.83s/it]
 50%|█████     | 19023/37963 [43:06:00<40:53:48,  7.77s/it]
 50%|█████     | 19024/37963 [43:06:07<40:14:36,  7.65s/it]
 50%|█████     | 19025/37963 [43:06:18<44:28:17,  8.45s/it]
 50%|█████     | 19026/37963 [43:06:26<43:49:51,  8.33s/it]
 50%|█████     | 19027/37963 [43:06:33<42:27:21,  8.07s/it]
 50%|█████     | 19028/37963 [43:06:41<41:54:05,  7.97s/it]
 50%|█████     | 19029/37963 [43:06:48<41:22:14,  7.87s/it]
 50%|█████     | 19030/37963 [43:06:56<40:54:25,  7.78s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '1.716', 'learning_rate': '1.045e-05', 'epoch': '0.5013'}
+
 50%|█████     | 19030/37963 [43:06:56<40:54:25,  7.78s/it]
 50%|█████     | 19031/37963 [43:07:04<41:06:09,  7.82s/it]
 50%|█████     | 19032/37963 [43:07:12<40:46:44,  7.75s/it]
 50%|█████     | 19033/37963 [43:07:19<40:50:44,  7.77s/it]
 50%|█████     | 19034/37963 [43:07:30<44:41:14,  8.50s/it]
 50%|█████     | 19035/37963 [43:07:37<43:31:59,  8.28s/it]
 50%|█████     | 19036/37963 [43:07:45<41:52:19,  7.96s/it]
 50%|█████     | 19037/37963 [43:07:52<41:14:47,  7.85s/it]
 50%|█████     | 19038/37963 [43:08:02<44:59:37,  8.56s/it]
 50%|█████     | 19039/37963 [43:08:10<43:49:58,  8.34s/it]
 50%|█████     | 19040/37963 [43:08:18<42:42:12,  8.12s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '2.937', 'learning_rate': '1.044e-05', 'epoch': '0.5015'}
+
 50%|█████     | 19040/37963 [43:08:18<42:42:12,  8.12s/it]
 50%|█████     | 19041/37963 [43:08:29<46:52:20,  8.92s/it]
 50%|█████     | 19042/37963 [43:08:37<45:33:35,  8.67s/it]
 50%|█████     | 19043/37963 [43:08:44<44:00:47,  8.37s/it]
 50%|█████     | 19044/37963 [43:08:52<42:43:21,  8.13s/it]
 50%|█████     | 19045/37963 [43:09:00<42:33:26,  8.10s/it]
 50%|█████     | 19046/37963 [43:09:08<41:51:58,  7.97s/it]
 50%|█████     | 19047/37963 [43:09:15<41:36:45,  7.92s/it]
 50%|█████     | 19048/37963 [43:09:26<45:24:57,  8.64s/it]
 50%|█████     | 19049/37963 [43:09:33<43:53:51,  8.36s/it]
 50%|█████     | 19050/37963 [43:09:41<42:45:08,  8.14s/it]
                                                           
{'loss': '0.162', 'grad_norm': '1.74', 'learning_rate': '1.043e-05', 'epoch': '0.5018'}
+
 50%|█████     | 19050/37963 [43:09:41<42:45:08,  8.14s/it]
 50%|█████     | 19051/37963 [43:09:49<41:58:29,  7.99s/it]
 50%|█████     | 19052/37963 [43:09:56<41:24:22,  7.88s/it]
 50%|█████     | 19053/37963 [43:10:08<47:01:12,  8.95s/it]
 50%|█████     | 19054/37963 [43:10:15<44:33:01,  8.48s/it]
 50%|█████     | 19055/37963 [43:10:23<43:07:07,  8.21s/it]
 50%|█████     | 19056/37963 [43:10:31<42:39:36,  8.12s/it]
 50%|█████     | 19057/37963 [43:10:41<46:34:52,  8.87s/it]
 50%|█████     | 19058/37963 [43:10:49<44:57:55,  8.56s/it]
 50%|█████     | 19059/37963 [43:10:57<43:28:41,  8.28s/it]
 50%|█████     | 19060/37963 [43:11:05<42:50:00,  8.16s/it]
                                                           
{'loss': '0.1599', 'grad_norm': '1.945', 'learning_rate': '1.042e-05', 'epoch': '0.5021'}
+
 50%|█████     | 19060/37963 [43:11:05<42:50:00,  8.16s/it]
 50%|█████     | 19061/37963 [43:11:12<42:29:38,  8.09s/it]
 50%|█████     | 19062/37963 [43:11:20<42:01:34,  8.00s/it]
 50%|█████     | 19063/37963 [43:11:28<41:37:01,  7.93s/it]
 50%|█████     | 19064/37963 [43:11:36<41:29:25,  7.90s/it]
 50%|█████     | 19065/37963 [43:11:44<41:10:51,  7.84s/it]
 50%|█████     | 19066/37963 [43:11:51<40:55:38,  7.80s/it]
 50%|█████     | 19067/37963 [43:11:59<41:22:14,  7.88s/it]
 50%|█████     | 19068/37963 [43:12:07<40:57:57,  7.81s/it]
 50%|█████     | 19069/37963 [43:12:15<40:44:10,  7.76s/it]
 50%|█████     | 19070/37963 [43:12:22<40:24:52,  7.70s/it]
                                                           
{'loss': '0.1748', 'grad_norm': '3.141', 'learning_rate': '1.041e-05', 'epoch': '0.5023'}
+
 50%|█████     | 19070/37963 [43:12:22<40:24:52,  7.70s/it]
 50%|█████     | 19071/37963 [43:12:33<44:51:28,  8.55s/it]
 50%|█████     | 19072/37963 [43:12:41<43:39:08,  8.32s/it]
 50%|█████     | 19073/37963 [43:12:48<42:31:28,  8.10s/it]
 50%|█████     | 19074/37963 [43:12:56<41:55:50,  7.99s/it]
 50%|█████     | 19075/37963 [43:13:04<41:43:02,  7.95s/it]
 50%|█████     | 19076/37963 [43:13:11<40:51:52,  7.79s/it]
 50%|█████     | 19077/37963 [43:13:19<40:24:18,  7.70s/it]
 50%|█████     | 19078/37963 [43:13:29<44:30:38,  8.48s/it]
 50%|█████     | 19079/37963 [43:13:40<48:19:16,  9.21s/it]
 50%|█████     | 19080/37963 [43:13:48<46:09:36,  8.80s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '1.566', 'learning_rate': '1.04e-05', 'epoch': '0.5026'}
+
 50%|█████     | 19080/37963 [43:13:48<46:09:36,  8.80s/it]
 50%|█████     | 19081/37963 [43:13:55<44:35:00,  8.50s/it]
 50%|█████     | 19082/37963 [43:14:03<43:34:06,  8.31s/it]
 50%|█████     | 19083/37963 [43:14:11<42:02:36,  8.02s/it]
 50%|█████     | 19084/37963 [43:14:18<41:20:27,  7.88s/it]
 50%|█████     | 19085/37963 [43:14:26<40:51:52,  7.79s/it]
 50%|█████     | 19086/37963 [43:14:34<41:15:03,  7.87s/it]
 50%|█████     | 19087/37963 [43:14:41<40:40:09,  7.76s/it]
 50%|█████     | 19088/37963 [43:14:49<40:31:26,  7.73s/it]
 50%|█���███     | 19089/37963 [43:14:59<44:32:08,  8.49s/it]
 50%|█████     | 19090/37963 [43:15:07<43:03:59,  8.21s/it]
                                                           
{'loss': '0.1525', 'grad_norm': '1.572', 'learning_rate': '1.039e-05', 'epoch': '0.5029'}
+
 50%|█████     | 19090/37963 [43:15:07<43:03:59,  8.21s/it]
 50%|█████     | 19091/37963 [43:15:15<42:24:54,  8.09s/it]
 50%|█████     | 19092/37963 [43:15:25<46:13:17,  8.82s/it]
 50%|█████     | 19093/37963 [43:15:33<44:06:06,  8.41s/it]
 50%|█████     | 19094/37963 [43:15:40<42:24:16,  8.09s/it]
 50%|█████     | 19095/37963 [43:15:47<41:08:07,  7.85s/it]
 50%|█████     | 19096/37963 [43:15:55<40:44:41,  7.77s/it]
 50%|█████     | 19097/37963 [43:16:06<46:07:06,  8.80s/it]
 50%|█████     | 19098/37963 [43:16:13<43:56:38,  8.39s/it]
 50%|█████     | 19099/37963 [43:16:21<42:44:04,  8.16s/it]
 50%|█████     | 19100/37963 [43:16:28<41:29:04,  7.92s/it]
                                                           
{'loss': '0.1448', 'grad_norm': '2.052', 'learning_rate': '1.039e-05', 'epoch': '0.5031'}
+
 50%|█████     | 19100/37963 [43:16:28<41:29:04,  7.92s/it]
 50%|█████     | 19101/37963 [43:16:36<41:16:47,  7.88s/it]
 50%|█████     | 19102/37963 [43:16:44<40:29:26,  7.73s/it]
 50%|█████     | 19103/37963 [43:16:52<40:52:20,  7.80s/it]
 50%|█████     | 19104/37963 [43:16:59<40:19:28,  7.70s/it]
 50%|█████     | 19105/37963 [43:17:07<40:24:00,  7.71s/it]
 50%|█████     | 19106/37963 [43:17:15<40:34:22,  7.75s/it]
 50%|█████     | 19107/37963 [43:17:22<39:53:04,  7.61s/it]
 50%|█████     | 19108/37963 [43:17:30<40:03:46,  7.65s/it]
 50%|█████     | 19109/37963 [43:17:37<39:42:58,  7.58s/it]
 50%|█████     | 19110/37963 [43:17:45<40:29:19,  7.73s/it]
                                                           
{'loss': '0.1684', 'grad_norm': '1.062', 'learning_rate': '1.038e-05', 'epoch': '0.5034'}
+
 50%|█████     | 19110/37963 [43:17:45<40:29:19,  7.73s/it]
 50%|█████     | 19111/37963 [43:17:56<44:38:28,  8.52s/it]
 50%|█████     | 19112/37963 [43:18:03<43:42:32,  8.35s/it]
 50%|█████     | 19113/37963 [43:18:11<42:46:57,  8.17s/it]
 50%|█████     | 19114/37963 [43:18:19<41:57:21,  8.01s/it]
 50%|█████     | 19115/37963 [43:18:26<41:00:15,  7.83s/it]
 50%|█████     | 19116/37963 [43:18:34<40:27:16,  7.73s/it]
 50%|█████     | 19117/37963 [43:18:41<40:03:44,  7.65s/it]
 50%|█████     | 19118/37963 [43:18:49<40:05:01,  7.66s/it]
 50%|█████     | 19119/37963 [43:18:57<40:23:09,  7.72s/it]
 50%|█████     | 19120/37963 [43:19:04<40:07:32,  7.67s/it]
                                                           
{'loss': '0.1514', 'grad_norm': '1.738', 'learning_rate': '1.037e-05', 'epoch': '0.5036'}
+
 50%|█████     | 19120/37963 [43:19:04<40:07:32,  7.67s/it]
 50%|█████     | 19121/37963 [43:19:15<44:20:59,  8.47s/it]
 50%|█████     | 19122/37963 [43:19:25<47:12:16,  9.02s/it]
 50%|█████     | 19123/37963 [43:19:33<45:18:02,  8.66s/it]
 50%|█████     | 19124/37963 [43:19:41<43:52:04,  8.38s/it]
 50%|█████     | 19125/37963 [43:19:51<47:07:01,  9.00s/it]
 50%|█████     | 19126/37963 [43:19:59<45:22:24,  8.67s/it]
 50%|█████     | 19127/37963 [43:20:07<43:54:19,  8.39s/it]
 50%|█████     | 19128/37963 [43:20:14<42:38:35,  8.15s/it]
 50%|█████     | 19129/37963 [43:20:22<42:06:51,  8.05s/it]
 50%|█████     | 19130/37963 [43:20:30<41:35:09,  7.95s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '5.387', 'learning_rate': '1.036e-05', 'epoch': '0.5039'}
+
 50%|█████     | 19130/37963 [43:20:30<41:35:09,  7.95s/it]
 50%|█████     | 19131/37963 [43:20:38<41:28:31,  7.93s/it]
 50%|█████     | 19132/37963 [43:20:45<41:00:27,  7.84s/it]
 50%|█████     | 19133/37963 [43:20:53<40:25:41,  7.73s/it]
 50%|█████     | 19134/37963 [43:21:01<40:49:41,  7.81s/it]
 50%|█████     | 19135/37963 [43:21:11<44:34:47,  8.52s/it]
 50%|█████     | 19136/37963 [43:21:19<43:12:49,  8.26s/it]
 50%|█████     | 19137/37963 [43:21:26<42:11:01,  8.07s/it]
 50%|█████     | 19138/37963 [43:21:34<41:36:01,  7.96s/it]
 50%|█████     | 19139/37963 [43:21:42<41:36:41,  7.96s/it]
 50%|█████     | 19140/37963 [43:21:50<41:11:46,  7.88s/it]
                                                           
{'loss': '0.1603', 'grad_norm': '1.894', 'learning_rate': '1.035e-05', 'epoch': '0.5042'}
+
 50%|█████     | 19140/37963 [43:21:50<41:11:46,  7.88s/it]
 50%|█████     | 19141/37963 [43:21:57<40:50:22,  7.81s/it]
 50%|█████     | 19142/37963 [43:22:05<40:38:46,  7.77s/it]
 50%|█████     | 19143/37963 [43:22:18<48:18:10,  9.24s/it]
 50%|█████     | 19144/37963 [43:22:26<46:23:13,  8.87s/it]
 50%|█████     | 19145/37963 [43:22:36<49:16:11,  9.43s/it]
 50%|█████     | 19146/37963 [43:22:44<46:54:03,  8.97s/it]
 50%|█████     | 19147/37963 [43:22:52<44:50:08,  8.58s/it]
 50%|█████     | 19148/37963 [43:23:00<43:28:19,  8.32s/it]
 50%|█████     | 19149/37963 [43:23:07<42:30:02,  8.13s/it]
 50%|█████     | 19150/37963 [43:23:15<42:04:42,  8.05s/it]
                                                           
{'loss': '0.1646', 'grad_norm': '1.727', 'learning_rate': '1.034e-05', 'epoch': '0.5044'}
+
 50%|█████     | 19150/37963 [43:23:15<42:04:42,  8.05s/it]
 50%|█████     | 19151/37963 [43:23:23<41:32:35,  7.95s/it]
 50%|█████     | 19152/37963 [43:23:31<41:34:06,  7.96s/it]
 50%|█████     | 19153/37963 [43:23:39<41:12:58,  7.89s/it]
 50%|█████     | 19154/37963 [43:23:46<41:11:15,  7.88s/it]
 50%|█████     | 19155/37963 [43:23:54<40:54:17,  7.83s/it]
 50%|█████     | 19156/37963 [43:24:02<40:51:48,  7.82s/it]
 50%|█████     | 19157/37963 [43:24:10<40:31:23,  7.76s/it]
 50%|█████     | 19158/37963 [43:24:17<40:39:40,  7.78s/it]
 50%|█████     | 19159/37963 [43:24:28<45:16:38,  8.67s/it]
 50%|█████     | 19160/37963 [43:24:36<43:53:41,  8.40s/it]
                                                           
{'loss': '0.1543', 'grad_norm': '1.742', 'learning_rate': '1.033e-05', 'epoch': '0.5047'}
+
 50%|█████     | 19160/37963 [43:24:36<43:53:41,  8.40s/it]
 50%|█████     | 19161/37963 [43:24:44<42:50:31,  8.20s/it]
 50%|█████     | 19162/37963 [43:24:51<42:00:04,  8.04s/it]
 50%|█████     | 19163/37963 [43:24:59<41:41:24,  7.98s/it]
 50%|█████     | 19164/37963 [43:25:07<41:20:10,  7.92s/it]
 50%|█████     | 19165/37963 [43:25:15<41:13:57,  7.90s/it]
 50%|█████     | 19166/37963 [43:25:23<41:02:02,  7.86s/it]
 50%|█████     | 19167/37963 [43:25:30<40:25:32,  7.74s/it]
 50%|█████     | 19168/37963 [43:25:38<40:28:42,  7.75s/it]
 50%|█████     | 19169/37963 [43:25:48<44:11:24,  8.46s/it]
 50%|█████     | 19170/37963 [43:25:58<47:08:11,  9.03s/it]
                                                           
{'loss': '0.1528', 'grad_norm': '1.449', 'learning_rate': '1.033e-05', 'epoch': '0.505'}
+
 50%|█████     | 19170/37963 [43:25:58<47:08:11,  9.03s/it]
 50%|█████     | 19171/37963 [43:26:06<45:18:10,  8.68s/it]
 51%|█████     | 19172/37963 [43:26:14<43:53:49,  8.41s/it]
 51%|█████     | 19173/37963 [43:26:22<43:00:18,  8.24s/it]
 51%|█████     | 19174/37963 [43:26:32<46:35:30,  8.93s/it]
 51%|█████     | 19175/37963 [43:26:40<45:03:34,  8.63s/it]
 51%|█████     | 19176/37963 [43:26:48<43:26:08,  8.32s/it]
 51%|█████     | 19177/37963 [43:26:55<42:26:35,  8.13s/it]
 51%|█████     | 19178/37963 [43:27:03<41:38:19,  7.98s/it]
 51%|█████     | 19179/37963 [43:27:11<41:15:06,  7.91s/it]
 51%|█████     | 19180/37963 [43:27:19<41:14:30,  7.90s/it]
                                                           
{'loss': '0.1595', 'grad_norm': '1.848', 'learning_rate': '1.032e-05', 'epoch': '0.5052'}
+
 51%|█████     | 19180/37963 [43:27:19<41:14:30,  7.90s/it]
 51%|█████     | 19181/37963 [43:27:29<45:03:28,  8.64s/it]
 51%|█████     | 19182/37963 [43:27:37<43:47:54,  8.40s/it]
 51%|█████     | 19183/37963 [43:27:45<42:39:25,  8.18s/it]
 51%|█████     | 19184/37963 [43:27:52<42:00:50,  8.05s/it]
 51%|█████     | 19185/37963 [43:28:00<41:24:26,  7.94s/it]
 51%|█████     | 19186/37963 [43:28:10<45:20:35,  8.69s/it]
 51%|█████     | 19187/37963 [43:28:18<43:40:38,  8.37s/it]
 51%|█████     | 19188/37963 [43:28:26<42:31:51,  8.16s/it]
 51%|█████     | 19189/37963 [43:28:33<41:46:36,  8.01s/it]
 51%|█████     | 19190/37963 [43:28:41<41:12:28,  7.90s/it]
                                                           
{'loss': '0.1689', 'grad_norm': '2.615', 'learning_rate': '1.031e-05', 'epoch': '0.5055'}
+
 51%|█████     | 19190/37963 [43:28:41<41:12:28,  7.90s/it]
 51%|█████     | 19191/37963 [43:28:51<44:56:32,  8.62s/it]
 51%|█████     | 19192/37963 [43:28:59<43:45:47,  8.39s/it]
 51%|█████     | 19193/37963 [43:29:10<47:23:34,  9.09s/it]
 51%|█████     | 19194/37963 [43:29:18<45:39:05,  8.76s/it]
 51%|█████     | 19195/37963 [43:29:26<44:00:55,  8.44s/it]
 51%|█████     | 19196/37963 [43:29:33<43:02:44,  8.26s/it]
 51%|█████     | 19197/37963 [43:29:41<41:47:37,  8.02s/it]
 51%|█████     | 19198/37963 [43:29:48<41:06:33,  7.89s/it]
 51%|█████     | 19199/37963 [43:29:56<41:00:10,  7.87s/it]
 51%|█████     | 19200/37963 [43:30:04<40:48:51,  7.83s/it]
                                                           
{'loss': '0.1586', 'grad_norm': '1.922', 'learning_rate': '1.03e-05', 'epoch': '0.5058'}
+
 51%|█████     | 19200/37963 [43:30:04<40:48:51,  7.83s/it]
 51%|█████     | 19201/37963 [43:30:12<40:43:17,  7.81s/it]
 51%|█████     | 19202/37963 [43:30:19<40:25:41,  7.76s/it]
 51%|█████     | 19203/37963 [43:30:30<44:43:44,  8.58s/it]
 51%|█████     | 19204/37963 [43:30:38<43:14:19,  8.30s/it]
 51%|█████     | 19205/37963 [43:30:45<42:28:10,  8.15s/it]
 51%|█████     | 19206/37963 [43:30:53<41:58:04,  8.05s/it]
 51%|█████     | 19207/37963 [43:31:01<41:23:42,  7.95s/it]
 51%|█████     | 19208/37963 [43:31:09<41:07:20,  7.89s/it]
 51%|█████     | 19209/37963 [43:31:16<40:57:45,  7.86s/it]
 51%|█████     | 19210/37963 [43:31:24<40:26:46,  7.76s/it]
                                                           
{'loss': '0.1436', 'grad_norm': '1.151', 'learning_rate': '1.029e-05', 'epoch': '0.506'}
+
 51%|█████     | 19210/37963 [43:31:24<40:26:46,  7.76s/it]
 51%|█████     | 19211/37963 [43:31:32<40:00:22,  7.68s/it]
 51%|█████     | 19212/37963 [43:31:39<39:50:40,  7.65s/it]
 51%|█████     | 19213/37963 [43:31:47<39:54:50,  7.66s/it]
 51%|█████     | 19214/37963 [43:31:55<40:06:57,  7.70s/it]
 51%|█████     | 19215/37963 [43:32:03<40:29:28,  7.78s/it]
 51%|█████     | 19216/37963 [43:32:10<40:15:11,  7.73s/it]
 51%|█████     | 19217/37963 [43:32:18<40:00:13,  7.68s/it]
 51%|█████     | 19218/37963 [43:32:26<40:20:16,  7.75s/it]
 51%|█████     | 19219/37963 [43:32:33<40:11:27,  7.72s/it]
 51%|█████     | 19220/37963 [43:32:41<40:08:23,  7.71s/it]
                                                           
{'loss': '0.1477', 'grad_norm': '1.45', 'learning_rate': '1.028e-05', 'epoch': '0.5063'}
+
 51%|█████     | 19220/37963 [43:32:41<40:08:23,  7.71s/it]
 51%|█████     | 19221/37963 [43:32:51<44:25:24,  8.53s/it]
 51%|█████     | 19222/37963 [43:32:59<43:21:08,  8.33s/it]
 51%|█████     | 19223/37963 [43:33:07<42:41:07,  8.20s/it]
 51%|█████     | 19224/37963 [43:33:17<45:38:32,  8.77s/it]
 51%|█████     | 19225/37963 [43:33:25<43:57:00,  8.44s/it]
 51%|█████     | 19226/37963 [43:33:33<42:45:30,  8.22s/it]
 51%|█████     | 19227/37963 [43:33:43<46:34:41,  8.95s/it]
 51%|█████     | 19228/37963 [43:33:51<44:42:04,  8.59s/it]
 51%|█████     | 19229/37963 [43:33:58<42:51:24,  8.24s/it]
 51%|█████     | 19230/37963 [43:34:06<41:58:16,  8.07s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '1.023', 'learning_rate': '1.027e-05', 'epoch': '0.5065'}
+
 51%|█████     | 19230/37963 [43:34:06<41:58:16,  8.07s/it]
 51%|█████     | 19231/37963 [43:34:14<41:17:54,  7.94s/it]
 51%|█████     | 19232/37963 [43:34:21<40:53:23,  7.86s/it]
 51%|█████     | 19233/37963 [43:34:29<40:42:50,  7.83s/it]
 51%|█████     | 19234/37963 [43:34:39<44:24:37,  8.54s/it]
 51%|█████     | 19235/37963 [43:34:50<47:21:58,  9.11s/it]
 51%|█████     | 19236/37963 [43:34:58<45:20:55,  8.72s/it]
 51%|█████     | 19237/37963 [43:35:08<48:13:13,  9.27s/it]
 51%|█████     | 19238/37963 [43:35:16<46:00:02,  8.84s/it]
 51%|█████     | 19239/37963 [43:35:26<48:07:40,  9.25s/it]
 51%|█████     | 19240/37963 [43:35:34<45:42:46,  8.79s/it]
                                                           
{'loss': '0.1556', 'grad_norm': '3.022', 'learning_rate': '1.027e-05', 'epoch': '0.5068'}
+
 51%|█████     | 19240/37963 [43:35:34<45:42:46,  8.79s/it]
 51%|█████     | 19241/37963 [43:35:42<44:08:25,  8.49s/it]
 51%|█████     | 19242/37963 [43:35:49<42:45:37,  8.22s/it]
 51%|█████     | 19243/37963 [43:35:57<41:45:18,  8.03s/it]
 51%|█████     | 19244/37963 [43:36:04<40:44:45,  7.84s/it]
 51%|█████     | 19245/37963 [43:36:12<40:31:37,  7.79s/it]
 51%|█████     | 19246/37963 [43:36:22<43:45:14,  8.42s/it]
 51%|█████     | 19247/37963 [43:36:30<43:02:27,  8.28s/it]
 51%|█████     | 19248/37963 [43:36:38<42:20:40,  8.15s/it]
 51%|█████     | 19249/37963 [43:36:45<41:41:31,  8.02s/it]
 51%|█████     | 19250/37963 [43:36:53<41:31:54,  7.99s/it]
                                                           
{'loss': '0.1671', 'grad_norm': '2.512', 'learning_rate': '1.026e-05', 'epoch': '0.5071'}
+
 51%|█████     | 19250/37963 [43:36:53<41:31:54,  7.99s/it]
 51%|█████     | 19251/37963 [43:37:01<40:30:57,  7.79s/it]
 51%|█████     | 19252/37963 [43:37:08<40:29:53,  7.79s/it]
 51%|█████     | 19253/37963 [43:37:16<40:16:51,  7.75s/it]
 51%|█████     | 19254/37963 [43:37:23<39:37:37,  7.63s/it]
 51%|█████     | 19255/37963 [43:37:31<39:43:25,  7.64s/it]
 51%|█████     | 19256/37963 [43:37:39<40:01:24,  7.70s/it]
 51%|█████     | 19257/37963 [43:37:47<40:17:31,  7.75s/it]
 51%|█████     | 19258/37963 [43:37:54<39:48:55,  7.66s/it]
 51%|█████     | 19259/37963 [43:38:02<40:03:02,  7.71s/it]
 51%|█████     | 19260/37963 [43:38:10<39:55:23,  7.68s/it]
                                                           
{'loss': '0.1686', 'grad_norm': '1.519', 'learning_rate': '1.025e-05', 'epoch': '0.5073'}
+
 51%|█████     | 19260/37963 [43:38:10<39:55:23,  7.68s/it]
 51%|█████     | 19261/37963 [43:38:17<39:56:40,  7.69s/it]
 51%|█████     | 19262/37963 [43:38:25<39:55:03,  7.68s/it]
 51%|█████     | 19263/37963 [43:38:33<39:53:23,  7.68s/it]
 51%|█████     | 19264/37963 [43:38:40<39:51:42,  7.67s/it]
 51%|█████     | 19265/37963 [43:38:48<39:43:41,  7.65s/it]
 51%|█████     | 19266/37963 [43:38:56<40:12:24,  7.74s/it]
 51%|█████     | 19267/37963 [43:39:04<40:26:00,  7.79s/it]
 51%|█████     | 19268/37963 [43:39:14<44:01:54,  8.48s/it]
 51%|█████     | 19269/37963 [43:39:24<46:27:17,  8.95s/it]
 51%|█████     | 19270/37963 [43:39:32<44:41:53,  8.61s/it]
                                                           
{'loss': '0.1463', 'grad_norm': '2.303', 'learning_rate': '1.024e-05', 'epoch': '0.5076'}
+
 51%|█████     | 19270/37963 [43:39:32<44:41:53,  8.61s/it]
 51%|█████     | 19271/37963 [43:39:39<43:15:59,  8.33s/it]
 51%|█████     | 19272/37963 [43:39:47<42:01:10,  8.09s/it]
 51%|█████     | 19273/37963 [43:39:55<41:52:20,  8.07s/it]
 51%|█████     | 19274/37963 [43:40:02<40:41:50,  7.84s/it]
 51%|█████     | 19275/37963 [43:40:10<40:21:04,  7.77s/it]
 51%|█████     | 19276/37963 [43:40:20<44:37:24,  8.60s/it]
 51%|█████     | 19277/37963 [43:40:28<43:28:00,  8.37s/it]
 51%|█████     | 19278/37963 [43:40:39<46:23:16,  8.94s/it]
 51%|█████     | 19279/37963 [43:40:47<45:09:25,  8.70s/it]
 51%|█████     | 19280/37963 [43:40:57<48:04:48,  9.26s/it]
                                                           
{'loss': '0.1559', 'grad_norm': '1.215', 'learning_rate': '1.023e-05', 'epoch': '0.5079'}
+
 51%|█████     | 19280/37963 [43:40:57<48:04:48,  9.26s/it]
 51%|█████     | 19281/37963 [43:41:05<46:07:07,  8.89s/it]
 51%|█████     | 19282/37963 [43:41:13<44:05:18,  8.50s/it]
 51%|█████     | 19283/37963 [43:41:26<50:45:40,  9.78s/it]
 51%|█████     | 19284/37963 [43:41:33<47:28:53,  9.15s/it]
 51%|█████     | 19285/37963 [43:41:41<45:30:15,  8.77s/it]
 51%|█████     | 19286/37963 [43:41:49<43:45:43,  8.44s/it]
 51%|█████     | 19287/37963 [43:41:56<42:27:54,  8.19s/it]
 51%|█████     | 19288/37963 [43:42:04<41:37:17,  8.02s/it]
 51%|█████     | 19289/37963 [43:42:12<40:48:10,  7.87s/it]
 51%|█████     | 19290/37963 [43:42:19<40:44:39,  7.86s/it]
                                                           
{'loss': '0.1528', 'grad_norm': '1.371', 'learning_rate': '1.022e-05', 'epoch': '0.5081'}
+
 51%|█████     | 19290/37963 [43:42:19<40:44:39,  7.86s/it]
 51%|█████     | 19291/37963 [43:42:27<40:24:34,  7.79s/it]
 51%|█████     | 19292/37963 [43:42:35<40:21:06,  7.78s/it]
 51%|█████     | 19293/37963 [43:42:45<44:40:30,  8.61s/it]
 51%|█████     | 19294/37963 [43:42:53<43:19:49,  8.36s/it]
 51%|█████     | 19295/37963 [43:43:01<42:15:54,  8.15s/it]
 51%|█████     | 19296/37963 [43:43:09<42:02:18,  8.11s/it]
 51%|█████     | 19297/37963 [43:43:17<41:31:25,  8.01s/it]
 51%|█████     | 19298/37963 [43:43:24<41:15:23,  7.96s/it]
 51%|█████     | 19299/37963 [43:43:32<40:58:01,  7.90s/it]
 51%|█████     | 19300/37963 [43:43:40<40:49:30,  7.87s/it]
                                                           
{'loss': '0.1636', 'grad_norm': '1.641', 'learning_rate': '1.021e-05', 'epoch': '0.5084'}
+
 51%|█████     | 19300/37963 [43:43:40<40:49:30,  7.87s/it]
 51%|█████     | 19301/37963 [43:43:48<40:34:13,  7.83s/it]
 51%|█████     | 19302/37963 [43:43:55<40:17:56,  7.77s/it]
 51%|█████     | 19303/37963 [43:44:03<40:00:45,  7.72s/it]
 51%|█████     | 19304/37963 [43:44:11<40:10:53,  7.75s/it]
 51%|█████     | 19305/37963 [43:44:19<40:23:51,  7.79s/it]
 51%|█████     | 19306/37963 [43:44:26<40:04:14,  7.73s/it]
 51%|█████     | 19307/37963 [43:44:34<39:57:51,  7.71s/it]
 51%|█████     | 19308/37963 [43:44:42<39:41:30,  7.66s/it]
 51%|█████     | 19309/37963 [43:44:49<39:56:54,  7.71s/it]
 51%|█████     | 19310/37963 [43:44:57<39:44:19,  7.67s/it]
                                                           
{'loss': '0.1691', 'grad_norm': '1.891', 'learning_rate': '1.021e-05', 'epoch': '0.5087'}
+
 51%|█████     | 19310/37963 [43:44:57<39:44:19,  7.67s/it]
 51%|█████     | 19311/37963 [43:45:07<43:41:19,  8.43s/it]
 51%|█████     | 19312/37963 [43:45:15<42:42:56,  8.24s/it]
 51%|█████     | 19313/37963 [43:45:23<41:38:12,  8.04s/it]
 51%|█████     | 19314/37963 [43:45:30<41:07:04,  7.94s/it]
 51%|█████     | 19315/37963 [43:45:38<41:02:20,  7.92s/it]
 51%|█████     | 19316/37963 [43:45:46<40:55:26,  7.90s/it]
 51%|█████     | 19317/37963 [43:45:54<40:31:04,  7.82s/it]
 51%|█████     | 19318/37963 [43:46:01<40:24:40,  7.80s/it]
 51%|█████     | 19319/37963 [43:46:11<44:02:52,  8.51s/it]
 51%|█████     | 19320/37963 [43:46:19<42:43:10,  8.25s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '1.798', 'learning_rate': '1.02e-05', 'epoch': '0.5089'}
+
 51%|█████     | 19320/37963 [43:46:19<42:43:10,  8.25s/it]
 51%|█████     | 19321/37963 [43:46:27<41:50:35,  8.08s/it]
 51%|█████     | 19322/37963 [43:46:37<45:34:21,  8.80s/it]
 51%|█████     | 19323/37963 [43:46:45<43:55:29,  8.48s/it]
 51%|█████     | 19324/37963 [43:46:59<51:39:36,  9.98s/it]
 51%|█████     | 19325/37963 [43:47:06<48:26:21,  9.36s/it]
 51%|█████     | 19326/37963 [43:47:17<49:40:32,  9.60s/it]
 51%|█████     | 19327/37963 [43:47:27<51:02:12,  9.86s/it]
 51%|█████     | 19328/37963 [43:47:35<47:18:46,  9.14s/it]
 51%|█████     | 19329/37963 [43:47:42<45:19:47,  8.76s/it]
 51%|█████     | 19330/37963 [43:47:50<43:48:51,  8.47s/it]
                                                           
{'loss': '0.1637', 'grad_norm': '1.775', 'learning_rate': '1.019e-05', 'epoch': '0.5092'}
+
 51%|█████     | 19330/37963 [43:47:50<43:48:51,  8.47s/it]
 51%|█████     | 19331/37963 [43:47:58<42:49:15,  8.27s/it]
 51%|█████     | 19332/37963 [43:48:05<41:15:07,  7.97s/it]
 51%|█████     | 19333/37963 [43:48:13<40:47:48,  7.88s/it]
 51%|█████     | 19334/37963 [43:48:20<40:17:22,  7.79s/it]
 51%|█████     | 19335/37963 [43:48:28<40:33:32,  7.84s/it]
 51%|█████     | 19336/37963 [43:48:36<40:24:48,  7.81s/it]
 51%|█████     | 19337/37963 [43:48:44<40:33:30,  7.84s/it]
 51%|█████     | 19338/37963 [43:48:52<40:12:49,  7.77s/it]
 51%|█████     | 19339/37963 [43:48:59<39:47:05,  7.69s/it]
 51%|█████     | 19340/37963 [43:49:09<43:39:45,  8.44s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '1.198', 'learning_rate': '1.018e-05', 'epoch': '0.5094'}
+
 51%|█████     | 19340/37963 [43:49:09<43:39:45,  8.44s/it]
 51%|█████     | 19341/37963 [43:49:17<42:57:16,  8.30s/it]
 51%|█████     | 19342/37963 [43:49:25<42:23:52,  8.20s/it]
 51%|█████     | 19343/37963 [43:49:33<41:47:18,  8.08s/it]
 51%|█████     | 19344/37963 [43:49:41<41:18:17,  7.99s/it]
 51%|█████     | 19345/37963 [43:49:48<40:35:06,  7.85s/it]
 51%|█████     | 19346/37963 [43:49:56<40:33:27,  7.84s/it]
 51%|█████     | 19347/37963 [43:50:04<40:27:22,  7.82s/it]
 51%|█████     | 19348/37963 [43:50:12<40:33:04,  7.84s/it]
 51%|█████     | 19349/37963 [43:50:20<40:12:40,  7.78s/it]
 51%|█████     | 19350/37963 [43:50:27<40:02:31,  7.74s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '3.513', 'learning_rate': '1.017e-05', 'epoch': '0.5097'}
+
 51%|█████     | 19350/37963 [43:50:27<40:02:31,  7.74s/it]
 51%|█████     | 19351/37963 [43:50:35<39:34:31,  7.65s/it]
 51%|█████     | 19352/37963 [43:50:43<39:52:47,  7.71s/it]
 51%|█████     | 19353/37963 [43:50:50<40:04:34,  7.75s/it]
 51%|█████     | 19354/37963 [43:50:58<39:50:21,  7.71s/it]
 51%|█████     | 19355/37963 [43:51:06<39:59:11,  7.74s/it]
 51%|█████     | 19356/37963 [43:51:14<40:00:34,  7.74s/it]
 51%|█████     | 19357/37963 [43:51:21<40:09:21,  7.77s/it]
 51%|█████     | 19358/37963 [43:51:29<40:05:32,  7.76s/it]
 51%|█████     | 19359/37963 [43:51:37<40:08:22,  7.77s/it]
 51%|█████     | 19360/37963 [43:51:47<43:55:30,  8.50s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '1.653', 'learning_rate': '1.016e-05', 'epoch': '0.51'}
+
 51%|█████     | 19360/37963 [43:51:47<43:55:30,  8.50s/it]
 51%|█████     | 19361/37963 [43:51:55<43:18:48,  8.38s/it]
 51%|█████     | 19362/37963 [43:52:03<42:20:02,  8.19s/it]
 51%|█████     | 19363/37963 [43:52:10<40:50:47,  7.91s/it]
 51%|█████     | 19364/37963 [43:52:18<40:36:43,  7.86s/it]
 51%|█████     | 19365/37963 [43:52:28<44:23:52,  8.59s/it]
 51%|█��███     | 19366/37963 [43:52:36<42:54:37,  8.31s/it]
 51%|█████     | 19367/37963 [43:52:44<41:57:44,  8.12s/it]
 51%|█████     | 19368/37963 [43:52:57<49:47:41,  9.64s/it]
 51%|█████     | 19369/37963 [43:53:04<46:40:11,  9.04s/it]
 51%|█████     | 19370/37963 [43:53:14<47:55:28,  9.28s/it]
                                                           
{'loss': '0.1554', 'grad_norm': '1.947', 'learning_rate': '1.016e-05', 'epoch': '0.5102'}
+
 51%|█████     | 19370/37963 [43:53:14<47:55:28,  9.28s/it]
 51%|█████     | 19371/37963 [43:53:22<45:10:43,  8.75s/it]
 51%|█████     | 19372/37963 [43:53:30<43:43:25,  8.47s/it]
 51%|█████     | 19373/37963 [43:53:37<42:28:45,  8.23s/it]
 51%|█████     | 19374/37963 [43:53:45<42:09:03,  8.16s/it]
 51%|█████     | 19375/37963 [43:53:53<41:43:37,  8.08s/it]
 51%|█████     | 19376/37963 [43:54:01<41:05:39,  7.96s/it]
 51%|█████     | 19377/37963 [43:54:11<45:06:41,  8.74s/it]
 51%|█████     | 19378/37963 [43:54:19<43:29:20,  8.42s/it]
 51%|█████     | 19379/37963 [43:54:27<42:42:22,  8.27s/it]
 51%|█████     | 19380/37963 [43:54:37<45:25:49,  8.80s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '3.058', 'learning_rate': '1.015e-05', 'epoch': '0.5105'}
+
 51%|█████     | 19380/37963 [43:54:37<45:25:49,  8.80s/it]
 51%|█████     | 19381/37963 [43:54:45<44:23:32,  8.60s/it]
 51%|█████     | 19382/37963 [43:54:53<43:12:32,  8.37s/it]
 51%|█████     | 19383/37963 [43:55:01<42:09:01,  8.17s/it]
 51%|█████     | 19384/37963 [43:55:08<41:23:04,  8.02s/it]
 51%|█████     | 19385/37963 [43:55:16<40:41:04,  7.88s/it]
 51%|█████     | 19386/37963 [43:55:23<40:04:35,  7.77s/it]
 51%|█████     | 19387/37963 [43:55:31<39:50:26,  7.72s/it]
 51%|█████     | 19388/37963 [43:55:39<39:38:23,  7.68s/it]
 51%|█████     | 19389/37963 [43:55:46<39:38:48,  7.68s/it]
 51%|█████     | 19390/37963 [43:55:54<39:26:03,  7.64s/it]
                                                           
{'loss': '0.168', 'grad_norm': '2.035', 'learning_rate': '1.014e-05', 'epoch': '0.5108'}
+
 51%|█████     | 19390/37963 [43:55:54<39:26:03,  7.64s/it]
 51%|█████     | 19391/37963 [43:56:01<38:47:38,  7.52s/it]
 51%|█████     | 19392/37963 [43:56:09<38:59:27,  7.56s/it]
 51%|█████     | 19393/37963 [43:56:16<38:55:57,  7.55s/it]
 51%|█████     | 19394/37963 [43:56:27<43:35:47,  8.45s/it]
 51%|█████     | 19395/37963 [43:56:35<42:41:37,  8.28s/it]
 51%|█████     | 19396/37963 [43:56:42<41:39:04,  8.08s/it]
 51%|█████     | 19397/37963 [43:56:50<41:04:56,  7.97s/it]
 51%|█████     | 19398/37963 [43:56:58<40:40:51,  7.89s/it]
 51%|█████     | 19399/37963 [43:57:05<40:25:42,  7.84s/it]
 51%|█████     | 19400/37963 [43:57:13<39:44:14,  7.71s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '2.077', 'learning_rate': '1.013e-05', 'epoch': '0.511'}
+
 51%|█████     | 19400/37963 [43:57:13<39:44:14,  7.71s/it]
 51%|█████     | 19401/37963 [43:57:21<39:48:32,  7.72s/it]
 51%|█████     | 19402/37963 [43:57:28<39:59:28,  7.76s/it]
 51%|█████     | 19403/37963 [43:57:36<39:39:59,  7.69s/it]
 51%|█████     | 19404/37963 [43:57:44<39:30:50,  7.66s/it]
 51%|█████     | 19405/37963 [43:57:51<39:28:21,  7.66s/it]
 51%|█████     | 19406/37963 [43:57:59<39:43:16,  7.71s/it]
 51%|█████     | 19407/37963 [43:58:07<39:26:15,  7.65s/it]
 51%|█████     | 19408/37963 [43:58:17<43:30:36,  8.44s/it]
 51%|█████     | 19409/37963 [43:58:25<42:19:52,  8.21s/it]
 51%|█████     | 19410/37963 [43:58:32<41:33:51,  8.07s/it]
                                                           
{'loss': '0.1496', 'grad_norm': '3.125', 'learning_rate': '1.012e-05', 'epoch': '0.5113'}
+
 51%|█████     | 19410/37963 [43:58:32<41:33:51,  8.07s/it]
 51%|█████     | 19411/37963 [43:58:43<45:08:59,  8.76s/it]
 51%|█████     | 19412/37963 [43:58:51<44:14:46,  8.59s/it]
 51%|█████     | 19413/37963 [43:59:01<47:09:15,  9.15s/it]
 51%|█████     | 19414/37963 [43:59:09<44:55:33,  8.72s/it]
 51%|█████     | 19415/37963 [43:59:17<43:31:12,  8.45s/it]
 51%|█████     | 19416/37963 [43:59:27<46:21:45,  9.00s/it]
 51%|█████     | 19417/37963 [43:59:34<43:54:03,  8.52s/it]
 51%|█████     | 19418/37963 [43:59:42<42:46:45,  8.30s/it]
 51%|█████     | 19419/37963 [43:59:52<45:43:20,  8.88s/it]
 51%|█████     | 19420/37963 [44:00:01<44:30:21,  8.64s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '2.553', 'learning_rate': '1.011e-05', 'epoch': '0.5116'}
+
 51%|█████     | 19420/37963 [44:00:01<44:30:21,  8.64s/it]
 51%|█████     | 19421/37963 [44:00:11<46:49:42,  9.09s/it]
 51%|█████     | 19422/37963 [44:00:18<44:37:54,  8.67s/it]
 51%|█████     | 19423/37963 [44:00:26<42:55:33,  8.34s/it]
 51%|█████     | 19424/37963 [44:00:34<42:16:25,  8.21s/it]
 51%|█████     | 19425/37963 [44:00:42<41:28:31,  8.05s/it]
 51%|█████     | 19426/37963 [44:00:49<40:43:05,  7.91s/it]
 51%|█████     | 19427/37963 [44:00:57<39:57:08,  7.76s/it]
 51%|█████     | 19428/37963 [44:01:07<43:59:02,  8.54s/it]
 51%|█████     | 19429/37963 [44:01:14<42:18:30,  8.22s/it]
 51%|█████     | 19430/37963 [44:01:22<41:24:38,  8.04s/it]
                                                           
{'loss': '0.1447', 'grad_norm': '2.352', 'learning_rate': '1.01e-05', 'epoch': '0.5118'}
+
 51%|█████     | 19430/37963 [44:01:22<41:24:38,  8.04s/it]
 51%|█████     | 19431/37963 [44:01:30<40:43:05,  7.91s/it]
 51%|█████     | 19432/37963 [44:01:37<39:57:37,  7.76s/it]
 51%|█████     | 19433/37963 [44:01:45<39:50:13,  7.74s/it]
 51%|█████     | 19434/37963 [44:01:52<39:53:47,  7.75s/it]
 51%|█████     | 19435/37963 [44:02:00<39:54:20,  7.75s/it]
 51%|█████     | 19436/37963 [44:02:08<39:49:50,  7.74s/it]
 51%|█████     | 19437/37963 [44:02:15<39:11:34,  7.62s/it]
 51%|█████     | 19438/37963 [44:02:23<39:30:07,  7.68s/it]
 51%|█████     | 19439/37963 [44:02:31<39:26:47,  7.67s/it]
 51%|█████     | 19440/37963 [44:02:39<39:45:48,  7.73s/it]
                                                           
{'loss': '0.149', 'grad_norm': '3.295', 'learning_rate': '1.01e-05', 'epoch': '0.5121'}
+
 51%|█████     | 19440/37963 [44:02:39<39:45:48,  7.73s/it]
 51%|█████     | 19441/37963 [44:02:46<39:40:57,  7.71s/it]
 51%|█████     | 19442/37963 [44:02:56<43:28:38,  8.45s/it]
 51%|█████     | 19443/37963 [44:03:04<42:34:11,  8.27s/it]
 51%|█████     | 19444/37963 [44:03:12<41:35:18,  8.08s/it]
 51%|█████     | 19445/37963 [44:03:20<40:49:39,  7.94s/it]
 51%|█████     | 19446/37963 [44:03:27<40:28:40,  7.87s/it]
 51%|█████     | 19447/37963 [44:03:35<40:20:47,  7.84s/it]
 51%|█████     | 19448/37963 [44:03:43<40:07:01,  7.80s/it]
 51%|█████     | 19449/37963 [44:03:51<40:05:19,  7.80s/it]
 51%|█████     | 19450/37963 [44:03:58<40:05:27,  7.80s/it]
                                                           
{'loss': '0.1662', 'grad_norm': '2.138', 'learning_rate': '1.009e-05', 'epoch': '0.5123'}
+
 51%|█████     | 19450/37963 [44:03:58<40:05:27,  7.80s/it]
 51%|█████     | 19451/37963 [44:04:06<40:02:54,  7.79s/it]
 51%|█████     | 19452/37963 [44:04:14<39:36:52,  7.70s/it]
 51%|█████     | 19453/37963 [44:04:21<39:41:14,  7.72s/it]
 51%|█████     | 19454/37963 [44:04:29<39:06:36,  7.61s/it]
 51%|█████     | 19455/37963 [44:04:36<39:17:17,  7.64s/it]
 51%|█████     | 19456/37963 [44:04:47<43:11:17,  8.40s/it]
 51%|█████▏    | 19457/37963 [44:04:55<42:32:06,  8.27s/it]
 51%|█████▏    | 19458/37963 [44:05:02<41:57:09,  8.16s/it]
 51%|█████▏    | 19459/37963 [44:05:13<45:33:54,  8.86s/it]
 51%|█████▏    | 19460/37963 [44:05:21<43:49:18,  8.53s/it]
                                                           
{'loss': '0.1683', 'grad_norm': '4.223', 'learning_rate': '1.008e-05', 'epoch': '0.5126'}
+
 51%|█████▏    | 19460/37963 [44:05:21<43:49:18,  8.53s/it]
 51%|█████▏    | 19461/37963 [44:05:29<42:47:39,  8.33s/it]
 51%|█████▏    | 19462/37963 [44:05:41<49:50:06,  9.70s/it]
 51%|█████▏    | 19463/37963 [44:05:49<46:47:40,  9.11s/it]
 51%|█████▏    | 19464/37963 [44:06:02<52:14:48, 10.17s/it]
 51%|█████▏    | 19465/37963 [44:06:10<49:01:46,  9.54s/it]
 51%|█████▏    | 19466/37963 [44:06:18<46:03:03,  8.96s/it]
 51%|█████▏    | 19467/37963 [44:06:25<44:08:14,  8.59s/it]
 51%|█████▏    | 19468/37963 [44:06:33<42:31:46,  8.28s/it]
 51%|█████▏    | 19469/37963 [44:06:40<41:35:22,  8.10s/it]
 51%|█████▏    | 19470/37963 [44:06:48<40:54:17,  7.96s/it]
                                                           
{'loss': '0.162', 'grad_norm': '1.55', 'learning_rate': '1.007e-05', 'epoch': '0.5129'}
+
 51%|█████▏    | 19470/37963 [44:06:48<40:54:17,  7.96s/it]
 51%|█████▏    | 19471/37963 [44:06:56<40:18:05,  7.85s/it]
 51%|█████▏    | 19472/37963 [44:07:06<44:06:02,  8.59s/it]
 51%|█████▏    | 19473/37963 [44:07:14<42:28:07,  8.27s/it]
 51%|█████▏    | 19474/37963 [44:07:21<41:42:30,  8.12s/it]
 51%|█████▏    | 19475/37963 [44:07:29<41:10:39,  8.02s/it]
 51%|█████▏    | 19476/37963 [44:07:37<40:57:09,  7.97s/it]
 51%|█████▏    | 19477/37963 [44:07:45<40:36:53,  7.91s/it]
 51%|█████▏    | 19478/37963 [44:07:53<40:25:14,  7.87s/it]
 51%|█████▏    | 19479/37963 [44:08:00<40:26:04,  7.88s/it]
 51%|█████▏    | 19480/37963 [44:08:08<40:34:39,  7.90s/it]
                                                           
{'loss': '0.1624', 'grad_norm': '2.019', 'learning_rate': '1.006e-05', 'epoch': '0.5131'}
+
 51%|█████▏    | 19480/37963 [44:08:08<40:34:39,  7.90s/it]
 51%|█████▏    | 19481/37963 [44:08:16<39:53:31,  7.77s/it]
 51%|█████▏    | 19482/37963 [44:08:24<39:51:01,  7.76s/it]
 51%|█████▏    | 19483/37963 [44:08:31<39:44:01,  7.74s/it]
 51%|█████▏    | 19484/37963 [44:08:39<39:38:44,  7.72s/it]
 51%|█████▏    | 19485/37963 [44:08:46<39:19:23,  7.66s/it]
 51%|█████▏    | 19486/37963 [44:08:57<43:22:28,  8.45s/it]
 51%|█████▏    | 19487/37963 [44:09:04<41:47:19,  8.14s/it]
 51%|█████▏    | 19488/37963 [44:09:12<40:55:34,  7.97s/it]
 51%|█████▏    | 19489/37963 [44:09:19<40:24:33,  7.87s/it]
 51%|█████▏    | 19490/37963 [44:09:27<39:50:26,  7.76s/it]
                                                           
{'loss': '0.1388', 'grad_norm': '3.058', 'learning_rate': '1.005e-05', 'epoch': '0.5134'}
+
 51%|█████▏    | 19490/37963 [44:09:27<39:50:26,  7.76s/it]
 51%|█████▏    | 19491/37963 [44:09:35<39:56:41,  7.78s/it]
 51%|█████▏    | 19492/37963 [44:09:43<39:53:24,  7.77s/it]
 51%|█████▏    | 19493/37963 [44:09:50<39:41:33,  7.74s/it]
 51%|█████▏    | 19494/37963 [44:09:58<39:39:47,  7.73s/it]
 51%|█████▏    | 19495/37963 [44:10:06<39:57:49,  7.79s/it]
 51%|█████▏    | 19496/37963 [44:10:13<39:42:00,  7.74s/it]
 51%|█████▏    | 19497/37963 [44:10:21<39:40:18,  7.73s/it]
 51%|█████▏    | 19498/37963 [44:10:28<39:04:11,  7.62s/it]
 51%|█████▏    | 19499/37963 [44:10:36<38:59:40,  7.60s/it]
 51%|█████▏    | 19500/37963 [44:10:46<43:07:09,  8.41s/it]
                                                           
{'loss': '0.154', 'grad_norm': '2.267', 'learning_rate': '1.004e-05', 'epoch': '0.5137'}
+
 51%|█████▏    | 19500/37963 [44:10:46<43:07:09,  8.41s/it]
 51%|█████▏    | 19501/37963 [44:10:54<42:37:41,  8.31s/it]
 51%|█████▏    | 19502/37963 [44:11:02<41:49:19,  8.16s/it]
 51%|█████▏    | 19503/37963 [44:11:13<45:34:30,  8.89s/it]
 51%|█████▏    | 19504/37963 [44:11:20<43:06:58,  8.41s/it]
 51%|█████▏    | 19505/37963 [44:11:28<41:40:07,  8.13s/it]
 51%|█████▏    | 19506/37963 [44:11:38<44:54:24,  8.76s/it]
 51%|█████▏    | 19507/37963 [44:11:46<43:21:28,  8.46s/it]
 51%|█████▏    | 19508/37963 [44:11:53<42:03:14,  8.20s/it]
 51%|█████▏    | 19509/37963 [44:12:01<41:11:51,  8.04s/it]
 51%|█████▏    | 19510/37963 [44:12:14<48:26:08,  9.45s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '1.65', 'learning_rate': '1.004e-05', 'epoch': '0.5139'}
+
 51%|█████▏    | 19510/37963 [44:12:14<48:26:08,  9.45s/it]
 51%|█████▏    | 19511/37963 [44:12:24<50:18:13,  9.81s/it]
 51%|█████▏    | 19512/37963 [44:12:32<47:09:45,  9.20s/it]
 51%|█████▏    | 19513/37963 [44:12:39<44:06:42,  8.61s/it]
 51%|█████▏    | 19514/37963 [44:12:47<42:18:11,  8.25s/it]
 51%|█████▏    | 19515/37963 [44:12:57<44:59:06,  8.78s/it]
 51%|█████▏    | 19516/37963 [44:13:05<43:45:52,  8.54s/it]
 51%|█████▏    | 19517/37963 [44:13:12<42:38:41,  8.32s/it]
 51%|█████▏    | 19518/37963 [44:13:21<42:25:20,  8.28s/it]
 51%|█████▏    | 19519/37963 [44:13:28<41:28:04,  8.09s/it]
 51%|█████▏    | 19520/37963 [44:13:36<40:49:32,  7.97s/it]
                                                           
{'loss': '0.1629', 'grad_norm': '1.547', 'learning_rate': '1.003e-05', 'epoch': '0.5142'}
+
 51%|█████▏    | 19520/37963 [44:13:36<40:49:32,  7.97s/it]
 51%|█████▏    | 19521/37963 [44:13:44<40:17:57,  7.87s/it]
 51%|█████▏    | 19522/37963 [44:13:51<40:10:12,  7.84s/it]
 51%|█████▏    | 19523/37963 [44:13:59<40:01:55,  7.82s/it]
 51%|█████▏    | 19524/37963 [44:14:07<39:48:23,  7.77s/it]
 51%|█████▏    | 19525/37963 [44:14:15<39:57:43,  7.80s/it]
 51%|█████▏    | 19526/37963 [44:14:22<39:27:27,  7.70s/it]
 51%|█████▏    | 19527/37963 [44:14:30<39:22:49,  7.69s/it]
 51%|█████▏    | 19528/37963 [44:14:38<39:36:09,  7.73s/it]
 51%|█████▏    | 19529/37963 [44:14:45<39:42:11,  7.75s/it]
 51%|█████▏    | 19530/37963 [44:14:56<43:55:52,  8.58s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '2.91', 'learning_rate': '1.002e-05', 'epoch': '0.5144'}
+
 51%|█████▏    | 19530/37963 [44:14:56<43:55:52,  8.58s/it]
 51%|█████▏    | 19531/37963 [44:15:04<42:47:26,  8.36s/it]
 51%|█████▏    | 19532/37963 [44:15:12<41:59:20,  8.20s/it]
 51%|█████▏    | 19533/37963 [44:15:19<41:26:21,  8.09s/it]
 51%|█████▏    | 19534/37963 [44:15:27<41:07:39,  8.03s/it]
 51%|█████▏    | 19535/37963 [44:15:35<40:47:28,  7.97s/it]
 51%|█████▏    | 19536/37963 [44:15:43<40:17:17,  7.87s/it]
 51%|█████▏    | 19537/37963 [44:15:51<40:14:40,  7.86s/it]
 51%|█████▏    | 19538/37963 [44:15:58<39:37:21,  7.74s/it]
 51%|█████▏    | 19539/37963 [44:16:06<39:27:31,  7.71s/it]
 51%|█████▏    | 19540/37963 [44:16:13<39:14:38,  7.67s/it]
                                                           
{'loss': '0.1581', 'grad_norm': '2.21', 'learning_rate': '1.001e-05', 'epoch': '0.5147'}
+
 51%|█████▏    | 19540/37963 [44:16:13<39:14:38,  7.67s/it]
 51%|█████▏    | 19541/37963 [44:16:21<39:08:50,  7.65s/it]
 51%|█████▏    | 19542/37963 [44:16:29<39:03:46,  7.63s/it]
 51%|█████▏    | 19543/37963 [44:16:36<39:13:23,  7.67s/it]
 51%|█████▏    | 19544/37963 [44:16:44<39:33:54,  7.73s/it]
 51%|█████▏    | 19545/37963 [44:16:52<39:23:47,  7.70s/it]
 51%|█████▏    | 19546/37963 [44:17:02<43:43:25,  8.55s/it]
 51%|█████▏    | 19547/37963 [44:17:10<42:24:32,  8.29s/it]
 51%|█████▏    | 19548/37963 [44:17:18<41:31:46,  8.12s/it]
 51%|█████▏    | 19549/37963 [44:17:26<41:04:00,  8.03s/it]
 51%|█████▏    | 19550/37963 [44:17:36<44:27:00,  8.69s/it]
                                                           
{'loss': '0.1591', 'grad_norm': '1.845', 'learning_rate': '1e-05', 'epoch': '0.515'}
+
 51%|█████▏    | 19550/37963 [44:17:36<44:27:00,  8.69s/it]
 52%|█████▏    | 19551/37963 [44:17:44<42:58:17,  8.40s/it]
 52%|█████▏    | 19552/37963 [44:17:51<41:48:04,  8.17s/it]
 52%|█████▏    | 19553/37963 [44:17:59<40:33:14,  7.93s/it]
 52%|█████▏    | 19554/37963 [44:18:09<44:05:01,  8.62s/it]
 52%|█████▏    | 19555/37963 [44:18:17<43:07:18,  8.43s/it]
 52%|█████▏    | 19556/37963 [44:18:24<41:36:18,  8.14s/it]
 52%|█████▏    | 19557/37963 [44:18:32<40:35:09,  7.94s/it]
 52%|█████▏    | 19558/37963 [44:18:39<39:47:19,  7.78s/it]
 52%|█████▏    | 19559/37963 [44:18:52<48:13:49,  9.43s/it]
 52%|█████▏    | 19560/37963 [44:19:00<45:56:35,  8.99s/it]
                                                           
{'loss': '0.1474', 'grad_norm': '3.953', 'learning_rate': '9.993e-06', 'epoch': '0.5152'}
+
 52%|█████▏    | 19560/37963 [44:19:00<45:56:35,  8.99s/it]
 52%|█████▏    | 19561/37963 [44:19:08<44:10:35,  8.64s/it]
 52%|█████▏    | 19562/37963 [44:19:16<42:56:32,  8.40s/it]
 52%|█████▏    | 19563/37963 [44:19:24<41:53:55,  8.20s/it]
 52%|█████▏    | 19564/37963 [44:19:34<45:16:13,  8.86s/it]
 52%|█████▏    | 19565/37963 [44:19:42<43:29:00,  8.51s/it]
 52%|█████▏    | 19566/37963 [44:19:50<42:34:17,  8.33s/it]
 52%|█████▏    | 19567/37963 [44:19:57<41:29:18,  8.12s/it]
 52%|█████▏    | 19568/37963 [44:20:05<40:46:14,  7.98s/it]
 52%|█████▏    | 19569/37963 [44:20:15<43:51:59,  8.59s/it]
 52%|█████▏    | 19570/37963 [44:20:23<42:46:56,  8.37s/it]
                                                           
{'loss': '0.1549', 'grad_norm': '1.278', 'learning_rate': '9.985e-06', 'epoch': '0.5155'}
+
 52%|█████▏    | 19570/37963 [44:20:23<42:46:56,  8.37s/it]
 52%|█████▏    | 19571/37963 [44:20:31<42:14:11,  8.27s/it]
 52%|█████▏    | 19572/37963 [44:20:39<41:39:56,  8.16s/it]
 52%|█████▏    | 19573/37963 [44:20:46<40:42:24,  7.97s/it]
 52%|█████▏    | 19574/37963 [44:20:54<40:13:46,  7.88s/it]
 52%|█████▏    | 19575/37963 [44:21:02<39:59:21,  7.83s/it]
 52%|█████▏    | 19576/37963 [44:21:09<39:55:27,  7.82s/it]
 52%|█████▏    | 19577/37963 [44:21:20<44:00:21,  8.62s/it]
 52%|█████▏    | 19578/37963 [44:21:28<42:23:42,  8.30s/it]
 52%|█████▏    | 19579/37963 [44:21:35<41:40:46,  8.16s/it]
 52%|█████▏    | 19580/37963 [44:21:43<40:53:16,  8.01s/it]
                                                           
{'loss': '0.1687', 'grad_norm': '3.827', 'learning_rate': '9.976e-06', 'epoch': '0.5158'}
+
 52%|█████▏    | 19580/37963 [44:21:43<40:53:16,  8.01s/it]
 52%|█████▏    | 19581/37963 [44:21:51<40:17:36,  7.89s/it]
 52%|█████▏    | 19582/37963 [44:21:58<40:03:19,  7.85s/it]
 52%|█████▏    | 19583/37963 [44:22:06<39:48:39,  7.80s/it]
 52%|█████▏    | 19584/37963 [44:22:14<39:36:09,  7.76s/it]
 52%|█��███▏    | 19585/37963 [44:22:22<39:38:21,  7.76s/it]
 52%|█████▏    | 19586/37963 [44:22:29<39:55:21,  7.82s/it]
 52%|█████▏    | 19587/37963 [44:22:38<40:16:23,  7.89s/it]
 52%|█████▏    | 19588/37963 [44:22:45<40:05:07,  7.85s/it]
 52%|█████▏    | 19589/37963 [44:22:53<39:44:42,  7.79s/it]
 52%|█████▏    | 19590/37963 [44:23:03<43:56:38,  8.61s/it]
                                                           
{'loss': '0.1731', 'grad_norm': '1.713', 'learning_rate': '9.968e-06', 'epoch': '0.516'}
+
 52%|█████▏    | 19590/37963 [44:23:03<43:56:38,  8.61s/it]
 52%|█████▏    | 19591/37963 [44:23:11<42:21:31,  8.30s/it]
 52%|█████▏    | 19592/37963 [44:23:19<41:30:44,  8.13s/it]
 52%|█████▏    | 19593/37963 [44:23:29<44:48:16,  8.78s/it]
 52%|█████▏    | 19594/37963 [44:23:37<43:12:50,  8.47s/it]
 52%|█████▏    | 19595/37963 [44:23:44<41:35:22,  8.15s/it]
 52%|█████▏    | 19596/37963 [44:23:52<40:58:38,  8.03s/it]
 52%|█████▏    | 19597/37963 [44:24:00<40:23:05,  7.92s/it]
 52%|█████▏    | 19598/37963 [44:24:07<40:06:54,  7.86s/it]
 52%|█████▏    | 19599/37963 [44:24:15<39:34:48,  7.76s/it]
 52%|█████▏    | 19600/37963 [44:24:23<39:29:58,  7.74s/it]
                                                           
{'loss': '0.1629', 'grad_norm': '2.166', 'learning_rate': '9.959e-06', 'epoch': '0.5163'}
+
 52%|█████▏    | 19600/37963 [44:24:23<39:29:58,  7.74s/it]
 52%|█████▏    | 19601/37963 [44:24:30<39:36:36,  7.77s/it]
 52%|█████▏    | 19602/37963 [44:24:41<43:47:26,  8.59s/it]
 52%|█████▏    | 19603/37963 [44:24:51<46:15:57,  9.07s/it]
 52%|█████▏    | 19604/37963 [44:24:59<44:05:51,  8.65s/it]
 52%|█████▏    | 19605/37963 [44:25:06<42:17:11,  8.29s/it]
 52%|█████▏    | 19606/37963 [44:25:14<41:17:17,  8.10s/it]
 52%|█████▏    | 19607/37963 [44:25:24<43:54:06,  8.61s/it]
 52%|█████▏    | 19608/37963 [44:25:31<42:40:57,  8.37s/it]
 52%|█████▏    | 19609/37963 [44:25:39<41:48:15,  8.20s/it]
 52%|█████▏    | 19610/37963 [44:25:47<41:06:01,  8.06s/it]
                                                           
{'loss': '0.1686', 'grad_norm': '2.961', 'learning_rate': '9.951e-06', 'epoch': '0.5166'}
+
 52%|█████▏    | 19610/37963 [44:25:47<41:06:01,  8.06s/it]
 52%|█████▏    | 19611/37963 [44:25:54<39:49:56,  7.81s/it]
 52%|█████▏    | 19612/37963 [44:26:02<39:48:02,  7.81s/it]
 52%|█████▏    | 19613/37963 [44:26:12<43:36:10,  8.55s/it]
 52%|█████▏    | 19614/37963 [44:26:20<42:24:28,  8.32s/it]
 52%|█████▏    | 19615/37963 [44:26:28<41:35:46,  8.16s/it]
 52%|█████▏    | 19616/37963 [44:26:36<41:04:11,  8.06s/it]
 52%|█████▏    | 19617/37963 [44:26:43<40:21:24,  7.92s/it]
 52%|█████▏    | 19618/37963 [44:26:53<43:46:08,  8.59s/it]
 52%|█████▏    | 19619/37963 [44:27:01<42:21:06,  8.31s/it]
 52%|█████▏    | 19620/37963 [44:27:09<42:01:30,  8.25s/it]
                                                           
{'loss': '0.15', 'grad_norm': '1.166', 'learning_rate': '9.942e-06', 'epoch': '0.5168'}
+
 52%|█████▏    | 19620/37963 [44:27:09<42:01:30,  8.25s/it]
 52%|█████▏    | 19621/37963 [44:27:17<41:00:44,  8.05s/it]
 52%|█████▏    | 19622/37963 [44:27:25<40:44:54,  8.00s/it]
 52%|█████▏    | 19623/37963 [44:27:32<40:15:07,  7.90s/it]
 52%|█████▏    | 19624/37963 [44:27:40<39:56:35,  7.84s/it]
 52%|█████▏    | 19625/37963 [44:27:48<39:44:19,  7.80s/it]
 52%|█████▏    | 19626/37963 [44:27:56<39:39:44,  7.79s/it]
 52%|█████▏    | 19627/37963 [44:28:03<39:23:50,  7.74s/it]
 52%|█████▏    | 19628/37963 [44:28:14<43:47:31,  8.60s/it]
 52%|█████▏    | 19629/37963 [44:28:22<42:43:45,  8.39s/it]
 52%|█████▏    | 19630/37963 [44:28:29<41:25:45,  8.14s/it]
                                                           
{'loss': '0.1602', 'grad_norm': '1.164', 'learning_rate': '9.933e-06', 'epoch': '0.5171'}
+
 52%|█████▏    | 19630/37963 [44:28:29<41:25:45,  8.14s/it]
 52%|█████▏    | 19631/37963 [44:28:37<40:33:54,  7.97s/it]
 52%|█████▏    | 19632/37963 [44:28:44<40:07:36,  7.88s/it]
 52%|█████▏    | 19633/37963 [44:28:52<39:37:08,  7.78s/it]
 52%|█████▏    | 19634/37963 [44:29:00<39:26:11,  7.75s/it]
 52%|█████▏    | 19635/37963 [44:29:07<39:28:41,  7.75s/it]
 52%|█████▏    | 19636/37963 [44:29:15<39:36:21,  7.78s/it]
 52%|█████▏    | 19637/37963 [44:29:25<43:16:03,  8.50s/it]
 52%|█████▏    | 19638/37963 [44:29:33<42:20:22,  8.32s/it]
 52%|█████▏    | 19639/37963 [44:29:41<41:36:15,  8.17s/it]
 52%|█████▏    | 19640/37963 [44:29:49<40:39:05,  7.99s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '1.625', 'learning_rate': '9.925e-06', 'epoch': '0.5173'}
+
 52%|█████▏    | 19640/37963 [44:29:49<40:39:05,  7.99s/it]
 52%|█████▏    | 19641/37963 [44:29:56<40:07:05,  7.88s/it]
 52%|█████▏    | 19642/37963 [44:30:04<40:20:29,  7.93s/it]
 52%|█████▏    | 19643/37963 [44:30:12<39:47:20,  7.82s/it]
 52%|█████▏    | 19644/37963 [44:30:23<44:16:29,  8.70s/it]
 52%|█████▏    | 19645/37963 [44:30:30<42:48:18,  8.41s/it]
 52%|█████▏    | 19646/37963 [44:30:41<45:46:58,  9.00s/it]
 52%|█████▏    | 19647/37963 [44:30:49<44:14:51,  8.70s/it]
 52%|█████▏    | 19648/37963 [44:30:56<42:35:49,  8.37s/it]
 52%|█████▏    | 19649/37963 [44:31:04<41:24:06,  8.14s/it]
 52%|█████▏    | 19650/37963 [44:31:12<40:27:51,  7.95s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '1.625', 'learning_rate': '9.916e-06', 'epoch': '0.5176'}
+
 52%|█████▏    | 19650/37963 [44:31:12<40:27:51,  7.95s/it]
 52%|█████▏    | 19651/37963 [44:31:22<44:01:53,  8.66s/it]
 52%|█████▏    | 19652/37963 [44:31:30<42:59:43,  8.45s/it]
 52%|█████▏    | 19653/37963 [44:31:38<41:53:42,  8.24s/it]
 52%|█████▏    | 19654/37963 [44:31:46<41:40:26,  8.19s/it]
 52%|█████▏    | 19655/37963 [44:31:53<41:00:22,  8.06s/it]
 52%|█████▏    | 19656/37963 [44:32:04<44:33:50,  8.76s/it]
 52%|█████▏    | 19657/37963 [44:32:12<42:54:04,  8.44s/it]
 52%|█████▏    | 19658/37963 [44:32:19<42:03:39,  8.27s/it]
 52%|█████▏    | 19659/37963 [44:32:27<41:07:20,  8.09s/it]
 52%|█████▏    | 19660/37963 [44:32:38<44:50:07,  8.82s/it]
                                                           
{'loss': '0.1561', 'grad_norm': '3.398', 'learning_rate': '9.908e-06', 'epoch': '0.5179'}
+
 52%|█████▏    | 19660/37963 [44:32:38<44:50:07,  8.82s/it]
 52%|█████▏    | 19661/37963 [44:32:45<43:08:42,  8.49s/it]
 52%|█████▏    | 19662/37963 [44:32:53<41:51:16,  8.23s/it]
 52%|█████▏    | 19663/37963 [44:33:00<40:44:33,  8.01s/it]
 52%|█████▏    | 19664/37963 [44:33:08<40:01:34,  7.87s/it]
 52%|█████▏    | 19665/37963 [44:33:16<39:44:29,  7.82s/it]
 52%|█████▏    | 19666/37963 [44:33:26<43:44:46,  8.61s/it]
 52%|█████▏    | 19667/37963 [44:33:34<42:21:20,  8.33s/it]
 52%|█████▏    | 19668/37963 [44:33:42<41:42:27,  8.21s/it]
 52%|█████▏    | 19669/37963 [44:33:49<40:45:11,  8.02s/it]
 52%|█████▏    | 19670/37963 [44:33:57<40:44:19,  8.02s/it]
                                                           
{'loss': '0.1598', 'grad_norm': '1.534', 'learning_rate': '9.899e-06', 'epoch': '0.5181'}
+
 52%|█████▏    | 19670/37963 [44:33:57<40:44:19,  8.02s/it]
 52%|█████▏    | 19671/37963 [44:34:05<39:56:11,  7.86s/it]
 52%|█████▏    | 19672/37963 [44:34:13<40:07:30,  7.90s/it]
 52%|█████▏    | 19673/37963 [44:34:21<39:51:11,  7.84s/it]
 52%|█████▏    | 19674/37963 [44:34:28<39:50:10,  7.84s/it]
 52%|█████▏    | 19675/37963 [44:34:36<39:25:44,  7.76s/it]
 52%|█████▏    | 19676/37963 [44:34:44<39:14:32,  7.73s/it]
 52%|█████▏    | 19677/37963 [44:34:51<39:05:33,  7.70s/it]
 52%|█████▏    | 19678/37963 [44:35:02<43:30:43,  8.57s/it]
 52%|█████▏    | 19679/37963 [44:35:10<42:13:53,  8.32s/it]
 52%|█████▏    | 19680/37963 [44:35:17<41:20:20,  8.14s/it]
                                                           
{'loss': '0.1472', 'grad_norm': '1.485', 'learning_rate': '9.891e-06', 'epoch': '0.5184'}
+
 52%|█████▏    | 19680/37963 [44:35:17<41:20:20,  8.14s/it]
 52%|█████▏    | 19681/37963 [44:35:25<40:37:03,  8.00s/it]
 52%|█████▏    | 19682/37963 [44:35:33<40:27:13,  7.97s/it]
 52%|█████▏    | 19683/37963 [44:35:41<40:04:04,  7.89s/it]
 52%|█████▏    | 19684/37963 [44:35:48<39:42:12,  7.82s/it]
 52%|█████▏    | 19685/37963 [44:35:56<39:43:44,  7.82s/it]
 52%|█████▏    | 19686/37963 [44:36:04<39:29:40,  7.78s/it]
 52%|█████▏    | 19687/37963 [44:36:11<39:17:38,  7.74s/it]
 52%|█████▏    | 19688/37963 [44:36:19<39:23:51,  7.76s/it]
 52%|█████▏    | 19689/37963 [44:36:29<43:04:58,  8.49s/it]
 52%|█████▏    | 19690/37963 [44:36:37<42:05:06,  8.29s/it]
                                                           
{'loss': '0.1422', 'grad_norm': '3.622', 'learning_rate': '9.882e-06', 'epoch': '0.5187'}
+
 52%|█████▏    | 19690/37963 [44:36:37<42:05:06,  8.29s/it]
 52%|█████▏    | 19691/37963 [44:36:47<44:52:29,  8.84s/it]
 52%|█████▏    | 19692/37963 [44:36:58<47:37:40,  9.38s/it]
 52%|██��██▏    | 19693/37963 [44:37:06<45:00:09,  8.87s/it]
 52%|█████▏    | 19694/37963 [44:37:13<43:17:41,  8.53s/it]
 52%|█████▏    | 19695/37963 [44:37:21<42:23:51,  8.36s/it]
 52%|█████▏    | 19696/37963 [44:37:29<41:25:33,  8.16s/it]
 52%|█████▏    | 19697/37963 [44:37:37<40:30:07,  7.98s/it]
 52%|█████▏    | 19698/37963 [44:37:44<39:53:17,  7.86s/it]
 52%|█████▏    | 19699/37963 [44:37:54<43:25:36,  8.56s/it]
 52%|█████▏    | 19700/37963 [44:38:02<42:13:37,  8.32s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '1.796', 'learning_rate': '9.874e-06', 'epoch': '0.5189'}
+
 52%|█████▏    | 19700/37963 [44:38:02<42:13:37,  8.32s/it]
 52%|█████▏    | 19701/37963 [44:38:10<41:31:11,  8.18s/it]
 52%|█████▏    | 19702/37963 [44:38:18<40:53:09,  8.06s/it]
 52%|█████▏    | 19703/37963 [44:38:28<44:24:25,  8.75s/it]
 52%|█████▏    | 19704/37963 [44:38:36<42:56:03,  8.47s/it]
 52%|█████▏    | 19705/37963 [44:38:44<41:39:41,  8.21s/it]
 52%|█████▏    | 19706/37963 [44:38:51<40:54:26,  8.07s/it]
 52%|█████▏    | 19707/37963 [44:38:59<40:15:11,  7.94s/it]
 52%|█████▏    | 19708/37963 [44:39:07<39:52:28,  7.86s/it]
 52%|█████▏    | 19709/37963 [44:39:17<43:42:56,  8.62s/it]
 52%|█████▏    | 19710/37963 [44:39:25<42:13:47,  8.33s/it]
                                                           
{'loss': '0.1719', 'grad_norm': '1.698', 'learning_rate': '9.865e-06', 'epoch': '0.5192'}
+
 52%|█████▏    | 19710/37963 [44:39:25<42:13:47,  8.33s/it]
 52%|█████▏    | 19711/37963 [44:39:32<41:19:53,  8.15s/it]
 52%|█████▏    | 19712/37963 [44:39:40<40:29:58,  7.99s/it]
 52%|█████▏    | 19713/37963 [44:39:48<39:51:46,  7.86s/it]
 52%|█████▏    | 19714/37963 [44:39:58<43:22:18,  8.56s/it]
 52%|█████▏    | 19715/37963 [44:40:05<42:02:11,  8.29s/it]
 52%|█████▏    | 19716/37963 [44:40:13<41:14:17,  8.14s/it]
 52%|█████▏    | 19717/37963 [44:40:21<40:52:00,  8.06s/it]
 52%|█████▏    | 19718/37963 [44:40:29<40:21:38,  7.96s/it]
 52%|█████▏    | 19719/37963 [44:40:36<39:56:40,  7.88s/it]
 52%|█████▏    | 19720/37963 [44:40:44<40:03:27,  7.90s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '3.261', 'learning_rate': '9.857e-06', 'epoch': '0.5195'}
+
 52%|█████▏    | 19720/37963 [44:40:44<40:03:27,  7.90s/it]
 52%|█████▏    | 19721/37963 [44:40:52<39:59:31,  7.89s/it]
 52%|█████▏    | 19722/37963 [44:41:00<39:53:41,  7.87s/it]
 52%|█████▏    | 19723/37963 [44:41:08<39:45:07,  7.85s/it]
 52%|█████▏    | 19724/37963 [44:41:16<39:29:37,  7.80s/it]
 52%|█████▏    | 19725/37963 [44:41:23<39:17:54,  7.76s/it]
 52%|█████▏    | 19726/37963 [44:41:34<43:47:40,  8.65s/it]
 52%|█████▏    | 19727/37963 [44:41:42<42:19:06,  8.35s/it]
 52%|█████▏    | 19728/37963 [44:41:49<41:27:26,  8.18s/it]
 52%|█████▏    | 19729/37963 [44:41:57<40:44:49,  8.04s/it]
 52%|█████▏    | 19730/37963 [44:42:05<40:21:45,  7.97s/it]
                                                           
{'loss': '0.1547', 'grad_norm': '1.161', 'learning_rate': '9.848e-06', 'epoch': '0.5197'}
+
 52%|█████▏    | 19730/37963 [44:42:05<40:21:45,  7.97s/it]
 52%|█████▏    | 19731/37963 [44:42:12<39:28:08,  7.79s/it]
 52%|█████▏    | 19732/37963 [44:42:20<39:15:03,  7.75s/it]
 52%|█████▏    | 19733/37963 [44:42:30<42:58:10,  8.49s/it]
 52%|█████▏    | 19734/37963 [44:42:38<41:34:13,  8.21s/it]
 52%|█████▏    | 19735/37963 [44:42:46<41:16:07,  8.15s/it]
 52%|█████▏    | 19736/37963 [44:42:56<44:36:57,  8.81s/it]
 52%|█████▏    | 19737/37963 [44:43:04<42:52:11,  8.47s/it]
 52%|█████▏    | 19738/37963 [44:43:14<45:35:16,  9.01s/it]
 52%|█████▏    | 19739/37963 [44:43:22<43:41:50,  8.63s/it]
 52%|█████▏    | 19740/37963 [44:43:29<42:10:55,  8.33s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '3.505', 'learning_rate': '9.84e-06', 'epoch': '0.52'}
+
 52%|█████▏    | 19740/37963 [44:43:29<42:10:55,  8.33s/it]
 52%|█████▏    | 19741/37963 [44:43:37<41:39:21,  8.23s/it]
 52%|█████▏    | 19742/37963 [44:43:45<40:49:45,  8.07s/it]
 52%|█████▏    | 19743/37963 [44:43:53<40:38:19,  8.03s/it]
 52%|█████▏    | 19744/37963 [44:44:01<40:18:37,  7.97s/it]
 52%|█████▏    | 19745/37963 [44:44:08<39:43:34,  7.85s/it]
 52%|█████▏    | 19746/37963 [44:44:16<39:37:51,  7.83s/it]
 52%|█████▏    | 19747/37963 [44:44:26<43:11:58,  8.54s/it]
 52%|█████▏    | 19748/37963 [44:44:34<42:02:13,  8.31s/it]
 52%|█████▏    | 19749/37963 [44:44:42<41:13:51,  8.15s/it]
 52%|█████▏    | 19750/37963 [44:44:50<40:36:27,  8.03s/it]
                                                           
{'loss': '0.1676', 'grad_norm': '2.145', 'learning_rate': '9.831e-06', 'epoch': '0.5202'}
+
 52%|█████▏    | 19750/37963 [44:44:50<40:36:27,  8.03s/it]
 52%|█████▏    | 19751/37963 [44:44:58<40:15:28,  7.96s/it]
 52%|█████▏    | 19752/37963 [44:45:05<39:14:02,  7.76s/it]
 52%|█████▏    | 19753/37963 [44:45:13<39:17:14,  7.77s/it]
 52%|█████▏    | 19754/37963 [44:45:20<39:11:32,  7.75s/it]
 52%|█████▏    | 19755/37963 [44:45:28<39:00:10,  7.71s/it]
 52%|█████▏    | 19756/37963 [44:45:36<39:19:33,  7.78s/it]
 52%|█████▏    | 19757/37963 [44:45:49<46:58:38,  9.29s/it]
 52%|█████▏    | 19758/37963 [44:45:56<44:43:45,  8.85s/it]
 52%|█████▏    | 19759/37963 [44:46:04<42:49:20,  8.47s/it]
 52%|█████▏    | 19760/37963 [44:46:12<41:40:45,  8.24s/it]
                                                           
{'loss': '0.1466', 'grad_norm': '1.58', 'learning_rate': '9.823e-06', 'epoch': '0.5205'}
+
 52%|█████▏    | 19760/37963 [44:46:12<41:40:45,  8.24s/it]
 52%|█████▏    | 19761/37963 [44:46:19<40:51:52,  8.08s/it]
 52%|█████▏    | 19762/37963 [44:46:30<44:04:14,  8.72s/it]
 52%|█████▏    | 19763/37963 [44:46:38<42:53:59,  8.49s/it]
 52%|█████▏    | 19764/37963 [44:46:45<41:40:18,  8.24s/it]
 52%|█████▏    | 19765/37963 [44:46:53<40:48:54,  8.07s/it]
 52%|█████▏    | 19766/37963 [44:47:01<40:09:57,  7.95s/it]
 52%|█████▏    | 19767/37963 [44:47:08<39:25:51,  7.80s/it]
 52%|█████▏    | 19768/37963 [44:47:16<39:38:55,  7.84s/it]
 52%|█████▏    | 19769/37963 [44:47:24<39:17:29,  7.77s/it]
 52%|█████▏    | 19770/37963 [44:47:34<43:31:35,  8.61s/it]
                                                           
{'loss': '0.1456', 'grad_norm': '3.671', 'learning_rate': '9.814e-06', 'epoch': '0.5208'}
+
 52%|█████▏    | 19770/37963 [44:47:34<43:31:35,  8.61s/it]
 52%|█████▏    | 19771/37963 [44:47:42<41:45:00,  8.26s/it]
 52%|█████▏    | 19772/37963 [44:47:49<40:52:45,  8.09s/it]
 52%|█████▏    | 19773/37963 [44:47:57<40:09:46,  7.95s/it]
 52%|█████▏    | 19774/37963 [44:48:05<39:51:34,  7.89s/it]
 52%|█████▏    | 19775/37963 [44:48:12<39:21:07,  7.79s/it]
 52%|█████▏    | 19776/37963 [44:48:20<39:05:26,  7.74s/it]
 52%|█████▏    | 19777/37963 [44:48:28<39:01:27,  7.73s/it]
 52%|█████▏    | 19778/37963 [44:48:35<38:42:26,  7.66s/it]
 52%|█████▏    | 19779/37963 [44:48:46<42:51:19,  8.48s/it]
 52%|█████▏    | 19780/37963 [44:48:53<41:36:04,  8.24s/it]
                                                           
{'loss': '0.1495', 'grad_norm': '1.148', 'learning_rate': '9.805e-06', 'epoch': '0.521'}
+
 52%|█████▏    | 19780/37963 [44:48:53<41:36:04,  8.24s/it]
 52%|█████▏    | 19781/37963 [44:49:04<45:04:05,  8.92s/it]
 52%|█████▏    | 19782/37963 [44:49:12<43:38:20,  8.64s/it]
 52%|█████▏    | 19783/37963 [44:49:20<42:32:35,  8.42s/it]
 52%|█████▏    | 19784/37963 [44:49:27<41:19:08,  8.18s/it]
 52%|█████▏    | 19785/37963 [44:49:35<40:10:48,  7.96s/it]
 52%|█████▏    | 19786/37963 [44:49:42<39:53:08,  7.90s/it]
 52%|█████▏    | 19787/37963 [44:49:50<39:27:25,  7.82s/it]
 52%|█████▏    | 19788/37963 [44:49:58<39:12:55,  7.77s/it]
 52%|█████▏    | 19789/37963 [44:50:05<38:23:40,  7.61s/it]
 52%|█████▏    | 19790/37963 [44:50:12<37:54:08,  7.51s/it]
                                                           
{'loss': '0.1455', 'grad_norm': '1.072', 'learning_rate': '9.797e-06', 'epoch': '0.5213'}
+
 52%|█████▏    | 19790/37963 [44:50:12<37:54:08,  7.51s/it]
 52%|█████▏    | 19791/37963 [44:50:22<42:04:45,  8.34s/it]
 52%|█████▏    | 19792/37963 [44:50:32<44:26:12,  8.80s/it]
 52%|█████▏    | 19793/37963 [44:50:40<42:54:56,  8.50s/it]
 52%|█████▏    | 19794/37963 [44:50:48<41:37:22,  8.25s/it]
 52%|█████▏    | 19795/37963 [44:50:55<40:34:25,  8.04s/it]
 52%|█████▏    | 19796/37963 [44:51:03<40:09:43,  7.96s/it]
 52%|█████▏    | 19797/37963 [44:51:11<40:15:45,  7.98s/it]
 52%|█████▏    | 19798/37963 [44:51:19<39:58:45,  7.92s/it]
 52%|█████▏    | 19799/37963 [44:51:27<39:34:07,  7.84s/it]
 52%|█████▏    | 19800/37963 [44:51:34<39:15:34,  7.78s/it]
                                                           
{'loss': '0.156', 'grad_norm': '2.069', 'learning_rate': '9.788e-06', 'epoch': '0.5216'}
+
 52%|█████▏    | 19800/37963 [44:51:34<39:15:34,  7.78s/it]
 52%|████��▏    | 19801/37963 [44:51:44<42:32:38,  8.43s/it]
 52%|█████▏    | 19802/37963 [44:51:52<41:47:55,  8.29s/it]
 52%|█████▏    | 19803/37963 [44:52:00<41:03:22,  8.14s/it]
 52%|█████▏    | 19804/37963 [44:52:08<40:26:00,  8.02s/it]
 52%|█████▏    | 19805/37963 [44:52:18<44:14:30,  8.77s/it]
 52%|█████▏    | 19806/37963 [44:52:28<46:27:51,  9.21s/it]
 52%|█████▏    | 19807/37963 [44:52:36<44:08:48,  8.75s/it]
 52%|█████▏    | 19808/37963 [44:52:44<42:52:07,  8.50s/it]
 52%|█████▏    | 19809/37963 [44:52:52<41:30:13,  8.23s/it]
 52%|█████▏    | 19810/37963 [44:52:59<40:52:23,  8.11s/it]
                                                           
{'loss': '0.1504', 'grad_norm': '3.037', 'learning_rate': '9.78e-06', 'epoch': '0.5218'}
+
 52%|█████▏    | 19810/37963 [44:52:59<40:52:23,  8.11s/it]
 52%|█████▏    | 19811/37963 [44:53:07<40:16:41,  7.99s/it]
 52%|█████▏    | 19812/37963 [44:53:15<39:55:54,  7.92s/it]
 52%|█████▏    | 19813/37963 [44:53:23<39:37:21,  7.86s/it]
 52%|█████▏    | 19814/37963 [44:53:33<43:36:37,  8.65s/it]
 52%|█████▏    | 19815/37963 [44:53:41<42:10:18,  8.37s/it]
 52%|█████▏    | 19816/37963 [44:53:49<41:26:20,  8.22s/it]
 52%|█████▏    | 19817/37963 [44:53:56<40:25:03,  8.02s/it]
 52%|█████▏    | 19818/37963 [44:54:04<39:37:47,  7.86s/it]
 52%|█████▏    | 19819/37963 [44:54:11<39:17:38,  7.80s/it]
 52%|█████▏    | 19820/37963 [44:54:19<39:12:08,  7.78s/it]
                                                           
{'loss': '0.1421', 'grad_norm': '1.476', 'learning_rate': '9.771e-06', 'epoch': '0.5221'}
+
 52%|█████▏    | 19820/37963 [44:54:19<39:12:08,  7.78s/it]
 52%|█████▏    | 19821/37963 [44:54:27<39:11:56,  7.78s/it]
 52%|█████▏    | 19822/37963 [44:54:35<39:33:40,  7.85s/it]
 52%|█████▏    | 19823/37963 [44:54:45<43:35:08,  8.65s/it]
 52%|█████▏    | 19824/37963 [44:54:53<42:10:43,  8.37s/it]
 52%|█████▏    | 19825/37963 [44:55:01<41:05:48,  8.16s/it]
 52%|█████▏    | 19826/37963 [44:55:09<40:39:23,  8.07s/it]
 52%|█████▏    | 19827/37963 [44:55:17<40:15:31,  7.99s/it]
 52%|█████▏    | 19828/37963 [44:55:24<39:57:28,  7.93s/it]
 52%|█████▏    | 19829/37963 [44:55:32<39:44:15,  7.89s/it]
 52%|█████▏    | 19830/37963 [44:55:40<39:20:57,  7.81s/it]
                                                           
{'loss': '0.1633', 'grad_norm': '1.456', 'learning_rate': '9.763e-06', 'epoch': '0.5224'}
+
 52%|█████▏    | 19830/37963 [44:55:40<39:20:57,  7.81s/it]
 52%|█████▏    | 19831/37963 [44:55:47<39:06:33,  7.76s/it]
 52%|█████▏    | 19832/37963 [44:55:55<38:50:12,  7.71s/it]
 52%|█████▏    | 19833/37963 [44:56:02<38:21:43,  7.62s/it]
 52%|█████▏    | 19834/37963 [44:56:10<38:29:33,  7.64s/it]
 52%|█████▏    | 19835/37963 [44:56:23<46:25:11,  9.22s/it]
 52%|█████▏    | 19836/37963 [44:56:31<44:13:28,  8.78s/it]
 52%|█████▏    | 19837/37963 [44:56:39<42:40:31,  8.48s/it]
 52%|█████▏    | 19838/37963 [44:56:46<41:41:40,  8.28s/it]
 52%|█████▏    | 19839/37963 [44:56:54<41:03:56,  8.16s/it]
 52%|█████▏    | 19840/37963 [44:57:02<40:04:10,  7.96s/it]
                                                           
{'loss': '0.1536', 'grad_norm': '3.12', 'learning_rate': '9.754e-06', 'epoch': '0.5226'}
+
 52%|█████▏    | 19840/37963 [44:57:02<40:04:10,  7.96s/it]
 52%|█████▏    | 19841/37963 [44:57:09<39:38:31,  7.88s/it]
 52%|█████▏    | 19842/37963 [44:57:17<39:20:39,  7.82s/it]
 52%|█████▏    | 19843/37963 [44:57:25<39:07:04,  7.77s/it]
 52%|█████▏    | 19844/37963 [44:57:35<43:08:58,  8.57s/it]
 52%|█████▏    | 19845/37963 [44:57:43<42:02:51,  8.35s/it]
 52%|█████▏    | 19846/37963 [44:57:53<44:47:57,  8.90s/it]
 52%|█████▏    | 19847/37963 [44:58:01<43:30:28,  8.65s/it]
 52%|█████▏    | 19848/37963 [44:58:09<42:24:27,  8.43s/it]
 52%|█████▏    | 19849/37963 [44:58:17<41:11:19,  8.19s/it]
 52%|█████▏    | 19850/37963 [44:58:27<43:59:35,  8.74s/it]
                                                           
{'loss': '0.1454', 'grad_norm': '0.9829', 'learning_rate': '9.746e-06', 'epoch': '0.5229'}
+
 52%|█████▏    | 19850/37963 [44:58:27<43:59:35,  8.74s/it]
 52%|█████▏    | 19851/37963 [44:58:34<42:13:54,  8.39s/it]
 52%|█████▏    | 19852/37963 [44:58:42<40:43:27,  8.09s/it]
 52%|█████▏    | 19853/37963 [44:58:49<40:05:50,  7.97s/it]
 52%|█████▏    | 19854/37963 [44:58:57<39:24:15,  7.83s/it]
 52%|█████▏    | 19855/37963 [44:59:05<39:05:44,  7.77s/it]
 52%|█████▏    | 19856/37963 [44:59:13<39:18:41,  7.82s/it]
 52%|█████▏    | 19857/37963 [44:59:20<39:14:16,  7.80s/it]
 52%|█████▏    | 19858/37963 [44:59:31<43:11:44,  8.59s/it]
 52%|█████▏    | 19859/37963 [44:59:39<42:19:27,  8.42s/it]
 52%|█████▏    | 19860/37963 [44:59:46<41:11:52,  8.19s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '1.153', 'learning_rate': '9.737e-06', 'epoch': '0.5231'}
+
 52%|█████▏    | 19860/37963 [44:59:46<41:11:52,  8.19s/it]
 52%|█████▏    | 19861/37963 [44:59:54<40:27:25,  8.05s/it]
 52%|█████▏    | 19862/37963 [45:00:02<39:49:26,  7.92s/it]
 52%|█████▏    | 19863/37963 [45:00:09<39:31:46,  7.86s/it]
 52%|█████▏    | 19864/37963 [45:00:20<43:14:54,  8.60s/it]
 52%|█████▏    | 19865/37963 [45:00:28<42:04:57,  8.37s/it]
 52%|█████▏    | 19866/37963 [45:00:35<41:04:57,  8.17s/it]
 52%|█████▏    | 19867/37963 [45:00:43<40:24:17,  8.04s/it]
 52%|█████▏    | 19868/37963 [45:00:51<40:05:25,  7.98s/it]
 52%|█████▏    | 19869/37963 [45:00:59<39:56:26,  7.95s/it]
 52%|█████▏    | 19870/37963 [45:01:07<39:40:42,  7.89s/it]
                                                           
{'loss': '0.1643', 'grad_norm': '1.307', 'learning_rate': '9.729e-06', 'epoch': '0.5234'}
+
 52%|█████▏    | 19870/37963 [45:01:07<39:40:42,  7.89s/it]
 52%|█████▏    | 19871/37963 [45:01:17<43:53:54,  8.74s/it]
 52%|█████▏    | 19872/37963 [45:01:25<42:09:55,  8.39s/it]
 52%|█████▏    | 19873/37963 [45:01:33<41:06:00,  8.18s/it]
 52%|█████▏    | 19874/37963 [45:01:40<40:26:48,  8.05s/it]
 52%|█████▏    | 19875/37963 [45:01:48<39:53:44,  7.94s/it]
 52%|█████▏    | 19876/37963 [45:01:56<39:26:18,  7.85s/it]
 52%|█████▏    | 19877/37963 [45:02:03<39:11:25,  7.80s/it]
 52%|█████▏    | 19878/37963 [45:02:14<42:50:41,  8.53s/it]
 52%|█████▏    | 19879/37963 [45:02:24<45:21:42,  9.03s/it]
 52%|█████▏    | 19880/37963 [45:02:32<43:41:50,  8.70s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '2.313', 'learning_rate': '9.72e-06', 'epoch': '0.5237'}
+
 52%|█████▏    | 19880/37963 [45:02:32<43:41:50,  8.70s/it]
 52%|█████▏    | 19881/37963 [45:02:39<42:09:05,  8.39s/it]
 52%|█████▏    | 19882/37963 [45:02:47<41:13:53,  8.21s/it]
 52%|█████▏    | 19883/37963 [45:02:55<40:14:24,  8.01s/it]
 52%|█████▏    | 19884/37963 [45:03:02<39:54:14,  7.95s/it]
 52%|█████▏    | 19885/37963 [45:03:10<39:29:14,  7.86s/it]
 52%|█████▏    | 19886/37963 [45:03:18<39:02:08,  7.77s/it]
 52%|█████▏    | 19887/37963 [45:03:25<38:54:35,  7.75s/it]
 52%|█████▏    | 19888/37963 [45:03:36<43:01:58,  8.57s/it]
 52%|█████▏    | 19889/37963 [45:03:44<41:52:15,  8.34s/it]
 52%|█████▏    | 19890/37963 [45:03:51<40:49:23,  8.13s/it]
                                                           
{'loss': '0.1574', 'grad_norm': '1.591', 'learning_rate': '9.712e-06', 'epoch': '0.5239'}
+
 52%|█████▏    | 19890/37963 [45:03:51<40:49:23,  8.13s/it]
 52%|█████▏    | 19891/37963 [45:03:59<40:20:51,  8.04s/it]
 52%|█████▏    | 19892/37963 [45:04:07<40:06:12,  7.99s/it]
 52%|█████▏    | 19893/37963 [45:04:15<39:57:25,  7.96s/it]
 52%|█████▏    | 19894/37963 [45:04:25<43:36:24,  8.69s/it]
 52%|█████▏    | 19895/37963 [45:04:33<42:22:13,  8.44s/it]
 52%|█████▏    | 19896/37963 [45:04:41<41:06:22,  8.19s/it]
 52%|█████▏    | 19897/37963 [45:04:49<40:27:56,  8.06s/it]
 52%|█████▏    | 19898/37963 [45:04:56<39:56:47,  7.96s/it]
 52%|█████▏    | 19899/37963 [45:05:04<39:14:24,  7.82s/it]
 52%|█████▏    | 19900/37963 [45:05:14<42:33:30,  8.48s/it]
                                                           
{'loss': '0.159', 'grad_norm': '2.21', 'learning_rate': '9.703e-06', 'epoch': '0.5242'}
+
 52%|█████▏    | 19900/37963 [45:05:14<42:33:30,  8.48s/it]
 52%|█████▏    | 19901/37963 [45:05:21<41:00:24,  8.17s/it]
 52%|█████▏    | 19902/37963 [45:05:29<40:32:26,  8.08s/it]
 52%|█████▏    | 19903/37963 [45:05:37<40:28:24,  8.07s/it]
 52%|█████▏    | 19904/37963 [45:05:45<39:52:03,  7.95s/it]
 52%|█████▏    | 19905/37963 [45:05:55<43:49:07,  8.74s/it]
 52%|█████▏    | 19906/37963 [45:06:03<42:12:29,  8.41s/it]
 52%|█████▏    | 19907/37963 [45:06:11<41:18:47,  8.24s/it]
 52%|█████▏    | 19908/37963 [45:06:18<40:24:07,  8.06s/it]
 52%|█████▏    | 19909/37963 [45:06:26<39:45:07,  7.93s/it]
 52%|█████▏    | 19910/37963 [45:06:34<39:18:16,  7.84s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '1.87', 'learning_rate': '9.695e-06', 'epoch': '0.5245'}
+
 52%|█████▏    | 19910/37963 [45:06:34<39:18:16,  7.84s/it]
 52%|█████▏    | 19911/37963 [45:06:42<39:34:31,  7.89s/it]
 52%|█████▏    | 19912/37963 [45:06:52<43:41:58,  8.72s/it]
 52%|█████▏    | 19913/37963 [45:07:00<42:04:46,  8.39s/it]
 52%|█████▏    | 19914/37963 [45:07:08<41:13:32,  8.22s/it]
 52%|█████▏    | 19915/37963 [45:07:18<44:36:49,  8.90s/it]
 52%|█████▏    | 19916/37963 [45:07:26<43:04:46,  8.59s/it]
 52%|█████▏    | 19917/37963 [45:07:34<41:48:56,  8.34s/it]
 52%|█████▏    | 19918/37963 [45:07:42<41:08:56,  8.21s/it]
 52%|█████▏    | 19919/37963 [45:07:50<40:37:59,  8.11s/it]
 52%|█████▏    | 19920/37963 [45:07:57<40:05:23,  8.00s/it]
                                                           
{'loss': '0.1731', 'grad_norm': '1.666', 'learning_rate': '9.686e-06', 'epoch': '0.5247'}
+
 52%|█████▏    | 19920/37963 [45:07:57<40:05:23,  8.00s/it]
 52%|█████▏    | 19921/37963 [45:08:05<39:20:28,  7.85s/it]
 52%|█████▏    | 19922/37963 [45:08:15<43:13:48,  8.63s/it]
 52%|█████▏    | 19923/37963 [45:08:23<41:52:19,  8.36s/it]
 52%|█████▏    | 19924/37963 [45:08:31<40:49:00,  8.15s/it]
 52%|█████▏    | 19925/37963 [45:08:39<40:18:40,  8.05s/it]
 52%|█████▏    | 19926/37963 [45:08:46<39:47:17,  7.94s/it]
 52%|█████▏    | 19927/37963 [45:08:56<42:59:41,  8.58s/it]
 52%|█████▏    | 19928/37963 [45:09:04<41:30:50,  8.29s/it]
 52%|█████▏    | 19929/37963 [45:09:12<40:32:40,  8.09s/it]
 52%|█████▏    | 19930/37963 [45:09:19<40:08:08,  8.01s/it]
                                                           
{'loss': '0.1528', 'grad_norm': '2.326', 'learning_rate': '9.678e-06', 'epoch': '0.525'}
+
 52%|█████▏    | 19930/37963 [45:09:19<40:08:08,  8.01s/it]
 53%|█████▎    | 19931/37963 [45:09:27<39:57:00,  7.98s/it]
 53%|█████▎    | 19932/37963 [45:09:35<39:40:04,  7.92s/it]
 53%|█████▎    | 19933/37963 [45:09:43<39:40:58,  7.92s/it]
 53%|█████▎    | 19934/37963 [45:09:51<39:28:17,  7.88s/it]
 53%|█████▎    | 19935/37963 [45:09:58<39:02:52,  7.80s/it]
 53%|█████▎    | 19936/37963 [45:10:06<38:51:10,  7.76s/it]
 53%|█████▎    | 19937/37963 [45:10:16<42:40:17,  8.52s/it]
 53%|█████▎    | 19938/37963 [45:10:24<41:24:35,  8.27s/it]
 53%|█████▎    | 19939/37963 [45:10:32<40:49:12,  8.15s/it]
 53%|█████▎    | 19940/37963 [45:10:40<40:11:50,  8.03s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '1.841', 'learning_rate': '9.669e-06', 'epoch': '0.5252'}
+
 53%|█████▎    | 19940/37963 [45:10:40<40:11:50,  8.03s/it]
 53%|█████▎    | 19941/37963 [45:10:48<39:53:07,  7.97s/it]
 53%|█████▎    | 19942/37963 [45:10:58<43:35:20,  8.71s/it]
 53%|█████▎    | 19943/37963 [45:11:06<41:59:38,  8.39s/it]
 53%|█████▎    | 19944/37963 [45:11:13<40:44:23,  8.14s/it]
 53%|█████▎    | 19945/37963 [45:11:20<39:26:18,  7.88s/it]
 53%|█████▎    | 19946/37963 [45:11:28<39:01:17,  7.80s/it]
 53%|█████▎    | 19947/37963 [45:11:35<38:26:57,  7.68s/it]
 53%|█████▎    | 19948/37963 [45:11:43<38:29:56,  7.69s/it]
 53%|█████▎    | 19949/37963 [45:11:51<38:24:00,  7.67s/it]
 53%|█████▎    | 19950/37963 [45:11:59<38:25:54,  7.68s/it]
                                                           
{'loss': '0.1703', 'grad_norm': '1.697', 'learning_rate': '9.661e-06', 'epoch': '0.5255'}
+
 53%|█████▎    | 19950/37963 [45:11:59<38:25:54,  7.68s/it]
 53%|█████▎    | 19951/37963 [45:12:06<38:42:15,  7.74s/it]
 53%|█████▎    | 19952/37963 [45:12:14<39:03:04,  7.81s/it]
 53%|█████▎    | 19953/37963 [45:12:22<38:41:03,  7.73s/it]
 53%|█████▎    | 19954/37963 [45:12:33<43:12:53,  8.64s/it]
 53%|█████▎    | 19955/37963 [45:12:41<42:03:35,  8.41s/it]
 53%|█████▎    | 19956/37963 [45:12:51<44:40:39,  8.93s/it]
 53%|█████▎    | 19957/37963 [45:12:59<43:06:05,  8.62s/it]
 53%|█████▎    | 19958/37963 [45:13:06<41:56:36,  8.39s/it]
 53%|█████▎    | 19959/37963 [45:13:14<41:01:15,  8.20s/it]
 53%|█████▎    | 19960/37963 [45:13:22<40:36:08,  8.12s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '1.595', 'learning_rate': '9.652e-06', 'epoch': '0.5258'}
+
 53%|█████▎    | 19960/37963 [45:13:22<40:36:08,  8.12s/it]
 53%|█████▎    | 19961/37963 [45:13:33<44:22:57,  8.88s/it]
 53%|█████▎    | 19962/37963 [45:13:43<46:49:14,  9.36s/it]
 53%|█████▎    | 19963/37963 [45:13:51<44:51:42,  8.97s/it]
 53%|█████▎    | 19964/37963 [45:13:59<42:58:56,  8.60s/it]
 53%|█████▎    | 19965/37963 [45:14:07<41:34:17,  8.32s/it]
 53%|█████▎    | 19966/37963 [45:14:14<40:25:36,  8.09s/it]
 53%|█████▎    | 19967/37963 [45:14:22<39:59:34,  8.00s/it]
 53%|█████▎    | 19968/37963 [45:14:30<39:54:12,  7.98s/it]
 53%|█████▎    | 19969/37963 [45:14:38<39:29:51,  7.90s/it]
 53%|█████▎    | 19970/37963 [45:14:48<42:43:33,  8.55s/it]
                                                           
{'loss': '0.1481', 'grad_norm': '4.51', 'learning_rate': '9.643e-06', 'epoch': '0.526'}
+
 53%|█████▎    | 19970/37963 [45:14:48<42:43:33,  8.55s/it]
 53%|█████▎    | 19971/37963 [45:14:58<45:52:23,  9.18s/it]
 53%|█████▎    | 19972/37963 [45:15:06<43:50:27,  8.77s/it]
 53%|█████▎    | 19973/37963 [45:15:14<42:37:10,  8.53s/it]
 53%|█████▎    | 19974/37963 [45:15:22<41:33:23,  8.32s/it]
 53%|█████▎    | 19975/37963 [45:15:30<41:02:55,  8.22s/it]
 53%|█████▎    | 19976/37963 [45:15:38<40:34:54,  8.12s/it]
 53%|█████▎    | 19977/37963 [45:15:46<39:50:35,  7.97s/it]
 53%|█████▎    | 19978/37963 [45:15:53<39:35:15,  7.92s/it]
 53%|█████▎    | 19979/37963 [45:16:01<39:34:47,  7.92s/it]
 53%|█████▎    | 19980/37963 [45:16:09<39:03:44,  7.82s/it]
                                                           
{'loss': '0.1731', 'grad_norm': '3.362', 'learning_rate': '9.635e-06', 'epoch': '0.5263'}
+
 53%|█████▎    | 19980/37963 [45:16:09<39:03:44,  7.82s/it]
 53%|█████▎    | 19981/37963 [45:16:16<38:48:06,  7.77s/it]
 53%|█████▎    | 19982/37963 [45:16:27<42:45:44,  8.56s/it]
 53%|█████▎    | 19983/37963 [45:16:35<41:37:24,  8.33s/it]
 53%|█████▎    | 19984/37963 [45:16:42<40:42:32,  8.15s/it]
 53%|█████▎    | 19985/37963 [45:16:52<43:30:19,  8.71s/it]
 53%|█████▎    | 19986/37963 [45:17:00<42:08:09,  8.44s/it]
 53%|█████▎    | 19987/37963 [45:17:08<40:56:54,  8.20s/it]
 53%|█████▎    | 19988/37963 [45:17:15<39:45:17,  7.96s/it]
 53%|█████▎    | 19989/37963 [45:17:23<39:20:43,  7.88s/it]
 53%|█████▎    | 19990/37963 [45:17:31<38:52:19,  7.79s/it]
                                                           
{'loss': '0.1714', 'grad_norm': '2.459', 'learning_rate': '9.626e-06', 'epoch': '0.5266'}
+
 53%|█████▎    | 19990/37963 [45:17:31<38:52:19,  7.79s/it]
 53%|█████▎    | 19991/37963 [45:17:38<38:59:17,  7.81s/it]
 53%|█████▎    | 19992/37963 [45:17:46<38:41:13,  7.75s/it]
 53%|█████▎    | 19993/37963 [45:17:54<38:39:07,  7.74s/it]
 53%|█████▎    | 19994/37963 [45:18:01<38:14:38,  7.66s/it]
 53%|█████▎    | 19995/37963 [45:18:09<37:54:32,  7.60s/it]
 53%|█████▎    | 19996/37963 [45:18:16<37:45:09,  7.56s/it]
 53%|█████▎    | 19997/37963 [45:18:24<37:56:49,  7.60s/it]
 53%|█████▎    | 19998/37963 [45:18:31<37:43:23,  7.56s/it]
 53%|█████▎    | 19999/37963 [45:18:39<37:51:13,  7.59s/it]
 53%|█████▎    | 20000/37963 [45:18:47<37:59:49,  7.62s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '3.434', 'learning_rate': '9.618e-06', 'epoch': '0.5268'}
+
 53%|█████▎    | 20000/37963 [45:18:47<37:59:49,  7.62s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.36s/it]
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.36s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 53%|█████▎    | 20001/37963 [45:19:51<123:17:23, 24.71s/it]
 53%|█████▎    | 20002/37963 [45:19:59<97:37:15, 19.57s/it] 
 53%|█████▎    | 20003/37963 [45:20:06<79:45:13, 15.99s/it]
 53%|█████▎    | 20004/37963 [45:20:14<66:54:56, 13.41s/it]
 53%|█████▎    | 20005/37963 [45:20:21<58:05:06, 11.64s/it]
 53%|█████▎    | 20006/37963 [45:20:29<52:29:08, 10.52s/it]
 53%|█████▎    | 20007/37963 [45:20:39<51:59:08, 10.42s/it]
 53%|█████▎    | 20008/37963 [45:20:47<47:46:49,  9.58s/it]
 53%|█████▎    | 20009/37963 [45:20:58<49:20:27,  9.89s/it]
 53%|█████▎    | 20010/37963 [45:21:05<45:42:29,  9.17s/it]
                                                           
{'loss': '0.1466', 'grad_norm': '2.364', 'learning_rate': '9.609e-06', 'epoch': '0.5271'}
+
 53%|█████▎    | 20010/37963 [45:21:05<45:42:29,  9.17s/it]
 53%|█████▎    | 20011/37963 [45:21:13<43:35:18,  8.74s/it]
 53%|█████▎    | 20012/37963 [45:21:23<45:56:24,  9.21s/it]
 53%|█████▎    | 20013/37963 [45:21:34<48:21:16,  9.70s/it]
 53%|█████▎    | 20014/37963 [45:21:45<49:50:43, 10.00s/it]
 53%|█████▎    | 20015/37963 [45:21:53<46:33:28,  9.34s/it]
 53%|█████▎    | 20016/37963 [45:22:00<44:18:32,  8.89s/it]
 53%|█████▎    | 20017/37963 [45:22:11<46:33:00,  9.34s/it]
 53%|█████▎    | 20018/37963 [45:22:19<44:24:04,  8.91s/it]
 53%|█████▎    | 20019/37963 [45:22:26<42:36:04,  8.55s/it]
 53%|█████▎    | 20020/37963 [45:22:34<41:04:20,  8.24s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '2.869', 'learning_rate': '9.601e-06', 'epoch': '0.5274'}
+
 53%|█████▎    | 20020/37963 [45:22:34<41:04:20,  8.24s/it]
 53%|█████▎    | 20021/37963 [45:22:42<40:25:11,  8.11s/it]
 53%|█████▎    | 20022/37963 [45:22:50<40:07:46,  8.05s/it]
 53%|█████▎    | 20023/37963 [45:22:57<39:49:06,  7.99s/it]
 53%|█████▎    | 20024/37963 [45:23:05<39:36:33,  7.95s/it]
 53%|█████▎    | 20025/37963 [45:23:13<39:27:30,  7.92s/it]
 53%|█████▎    | 20026/37963 [45:23:21<38:53:23,  7.81s/it]
 53%|█████▎    | 20027/37963 [45:23:28<38:27:25,  7.72s/it]
 53%|█████▎    | 20028/37963 [45:23:36<38:39:45,  7.76s/it]
 53%|█████▎    | 20029/37963 [45:23:44<38:53:15,  7.81s/it]
 53%|█████▎    | 20030/37963 [45:23:52<38:28:20,  7.72s/it]
                                                           
{'loss': '0.1378', 'grad_norm': '2.584', 'learning_rate': '9.592e-06', 'epoch': '0.5276'}
+
 53%|█████▎    | 20030/37963 [45:23:52<38:28:20,  7.72s/it]
 53%|█████▎    | 20031/37963 [45:23:59<38:37:12,  7.75s/it]
 53%|█████▎    | 20032/37963 [45:24:10<42:30:17,  8.53s/it]
 53%|█████▎    | 20033/37963 [45:24:17<41:22:13,  8.31s/it]
 53%|█████▎    | 20034/37963 [45:24:26<40:56:18,  8.22s/it]
 53%|█████▎    | 20035/37963 [45:24:36<44:19:18,  8.90s/it]
 53%|█████▎    | 20036/37963 [45:24:44<42:38:10,  8.56s/it]
 53%|█████▎    | 20037/37963 [45:24:52<41:28:20,  8.33s/it]
 53%|█████▎    | 20038/37963 [45:24:59<40:22:07,  8.11s/it]
 53%|█████▎    | 20039/37963 [45:25:07<39:58:50,  8.03s/it]
 53%|█████▎    | 20040/37963 [45:25:15<39:40:33,  7.97s/it]
                                                           
{'loss': '0.1704', 'grad_norm': '5.756', 'learning_rate': '9.584e-06', 'epoch': '0.5279'}
+
 53%|█████▎    | 20040/37963 [45:25:15<39:40:33,  7.97s/it]
 53%|█████▎    | 20041/37963 [45:25:22<38:56:49,  7.82s/it]
 53%|█████▎    | 20042/37963 [45:25:30<38:34:27,  7.75s/it]
 53%|█████▎    | 20043/37963 [45:25:38<38:32:53,  7.74s/it]
 53%|█████▎    | 20044/37963 [45:25:45<38:34:05,  7.75s/it]
 53%|█████▎    | 20045/37963 [45:25:53<38:12:17,  7.68s/it]
 53%|█████▎    | 20046/37963 [45:26:01<38:20:58,  7.71s/it]
 53%|█████▎    | 20047/37963 [45:26:08<38:30:07,  7.74s/it]
 53%|█████▎    | 20048/37963 [45:26:16<38:16:41,  7.69s/it]
 53%|█████▎    | 20049/37963 [45:26:24<38:22:54,  7.71s/it]
 53%|█████▎    | 20050/37963 [45:26:31<38:12:18,  7.68s/it]
                                                           
{'loss': '0.1621', 'grad_norm': '1.701', 'learning_rate': '9.575e-06', 'epoch': '0.5281'}
+
 53%|█████▎    | 20050/37963 [45:26:31<38:12:18,  7.68s/it]
 53%|█████▎    | 20051/37963 [45:26:42<42:26:39,  8.53s/it]
 53%|█████▎    | 20052/37963 [45:26:50<41:22:47,  8.32s/it]
 53%|█████▎    | 20053/37963 [45:26:57<40:05:48,  8.06s/it]
 53%|█████▎    | 20054/37963 [45:27:08<43:48:10,  8.81s/it]
 53%|█████▎    | 20055/37963 [45:27:16<42:22:40,  8.52s/it]
 53%|█████▎    | 20056/37963 [45:27:23<41:01:11,  8.25s/it]
 53%|█████▎    | 20057/37963 [45:27:31<40:27:08,  8.13s/it]
 53%|█████▎    | 20058/37963 [45:27:39<39:45:30,  7.99s/it]
 53%|█████▎    | 20059/37963 [45:27:46<39:10:30,  7.88s/it]
 53%|█████▎    | 20060/37963 [45:27:54<38:47:59,  7.80s/it]
                                                           
{'loss': '0.163', 'grad_norm': '1.28', 'learning_rate': '9.567e-06', 'epoch': '0.5284'}
+
 53%|█████▎    | 20060/37963 [45:27:54<38:47:59,  7.80s/it]
 53%|█████▎    | 20061/37963 [45:28:04<42:26:31,  8.53s/it]
 53%|█████▎    | 20062/37963 [45:28:13<42:03:01,  8.46s/it]
 53%|█████▎    | 20063/37963 [45:28:23<45:17:40,  9.11s/it]
 53%|█████▎    | 20064/37963 [45:28:31<43:37:23,  8.77s/it]
 53%|█████▎    | 20065/37963 [45:28:39<42:31:38,  8.55s/it]
 53%|█████▎    | 20066/37963 [45:28:47<41:13:12,  8.29s/it]
 53%|█████▎    | 20067/37963 [45:28:57<44:42:44,  8.99s/it]
 53%|█████▎    | 20068/37963 [45:29:05<42:49:32,  8.62s/it]
 53%|█████▎    | 20069/37963 [45:29:13<41:42:45,  8.39s/it]
 53%|█████▎    | 20070/37963 [45:29:21<40:40:05,  8.18s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '1.215', 'learning_rate': '9.558e-06', 'epoch': '0.5287'}
+
 53%|█████▎    | 20070/37963 [45:29:21<40:40:05,  8.18s/it]
 53%|█████▎    | 20071/37963 [45:29:31<44:08:11,  8.88s/it]
 53%|█████▎    | 20072/37963 [45:29:39<42:39:52,  8.58s/it]
 53%|█████▎    | 20073/37963 [45:29:47<41:18:45,  8.31s/it]
 53%|█████▎    | 20074/37963 [45:29:55<40:26:45,  8.14s/it]
 53%|█████▎    | 20075/37963 [45:30:02<40:03:11,  8.06s/it]
 53%|█████▎    | 20076/37963 [45:30:10<39:33:13,  7.96s/it]
 53%|█████▎    | 20077/37963 [45:30:18<39:37:17,  7.97s/it]
 53%|█████▎    | 20078/37963 [45:30:26<38:59:43,  7.85s/it]
 53%|█████▎    | 20079/37963 [45:30:36<42:46:29,  8.61s/it]
 53%|█████▎    | 20080/37963 [45:30:47<45:36:12,  9.18s/it]
                                                           
{'loss': '0.1613', 'grad_norm': '5.033', 'learning_rate': '9.55e-06', 'epoch': '0.5289'}
+
 53%|█████▎    | 20080/37963 [45:30:47<45:36:12,  9.18s/it]
 53%|█████▎    | 20081/37963 [45:30:54<43:04:21,  8.67s/it]
 53%|█████▎    | 20082/37963 [45:31:02<41:18:50,  8.32s/it]
 53%|█████▎    | 20083/37963 [45:31:09<40:28:26,  8.15s/it]
 53%|█████▎    | 20084/37963 [45:31:17<39:50:05,  8.02s/it]
 53%|█████▎    | 20085/37963 [45:31:25<39:29:35,  7.95s/it]
 53%|█████▎    | 20086/37963 [45:31:33<39:30:52,  7.96s/it]
 53%|█████▎    | 20087/37963 [45:31:41<39:21:00,  7.92s/it]
 53%|█████▎    | 20088/37963 [45:31:49<39:18:00,  7.91s/it]
 53%|█████▎    | 20089/37963 [45:31:56<39:07:21,  7.88s/it]
 53%|█████▎    | 20090/37963 [45:32:04<38:43:46,  7.80s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '2.233', 'learning_rate': '9.541e-06', 'epoch': '0.5292'}
+
 53%|█████▎    | 20090/37963 [45:32:04<38:43:46,  7.80s/it]
 53%|█████▎    | 20091/37963 [45:32:12<38:33:45,  7.77s/it]
 53%|█████▎    | 20092/37963 [45:32:20<38:43:41,  7.80s/it]
 53%|█████▎    | 20093/37963 [45:32:27<38:21:03,  7.73s/it]
 53%|█████▎    | 20094/37963 [45:32:35<38:16:37,  7.71s/it]
 53%|█████▎    | 20095/37963 [45:32:42<38:09:34,  7.69s/it]
 53%|█████▎    | 20096/37963 [45:32:50<38:24:39,  7.74s/it]
 53%|█████▎    | 20097/37963 [45:32:58<38:13:21,  7.70s/it]
 53%|█████▎    | 20098/37963 [45:33:09<42:37:59,  8.59s/it]
 53%|█████▎    | 20099/37963 [45:33:16<41:14:41,  8.31s/it]
 53%|█████▎    | 20100/37963 [45:33:24<40:30:55,  8.17s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '1.878', 'learning_rate': '9.533e-06', 'epoch': '0.5295'}
+
 53%|█████▎    | 20100/37963 [45:33:24<40:30:55,  8.17s/it]
 53%|█████▎    | 20101/37963 [45:33:32<39:47:07,  8.02s/it]
 53%|█████▎    | 20102/37963 [45:33:39<38:56:01,  7.85s/it]
 53%|█████▎    | 20103/37963 [45:33:47<38:58:07,  7.85s/it]
 53%|█████▎    | 20104/37963 [45:33:57<42:44:31,  8.62s/it]
 53%|█████▎    | 20105/37963 [45:34:07<44:41:57,  9.01s/it]
 53%|█████▎    | 20106/37963 [45:34:15<42:53:31,  8.65s/it]
 53%|█████▎    | 20107/37963 [45:34:23<41:30:08,  8.37s/it]
 53%|█████▎    | 20108/37963 [45:34:31<40:47:54,  8.23s/it]
 53%|█████▎    | 20109/37963 [45:34:39<40:05:02,  8.08s/it]
 53%|█████▎    | 20110/37963 [45:34:46<39:42:40,  8.01s/it]
                                                           
{'loss': '0.1439', 'grad_norm': '1.142', 'learning_rate': '9.524e-06', 'epoch': '0.5297'}
+
 53%|█████▎    | 20110/37963 [45:34:46<39:42:40,  8.01s/it]
 53%|█████▎    | 20111/37963 [45:34:54<39:37:39,  7.99s/it]
 53%|█████▎    | 20112/37963 [45:35:02<39:31:42,  7.97s/it]
 53%|█████▎    | 20113/37963 [45:35:10<39:14:23,  7.91s/it]
 53%|█████▎    | 20114/37963 [45:35:18<38:45:08,  7.82s/it]
 53%|█████▎    | 20115/37963 [45:35:28<42:46:53,  8.63s/it]
 53%|█████▎    | 20116/37963 [45:35:36<41:44:07,  8.42s/it]
 53%|█████▎    | 20117/37963 [45:35:47<45:03:31,  9.09s/it]
 53%|█████▎    | 20118/37963 [45:35:54<42:53:51,  8.65s/it]
 53%|█████▎    | 20119/37963 [45:36:02<41:34:32,  8.39s/it]
 53%|█████▎    | 20120/37963 [45:36:12<43:51:20,  8.85s/it]
                                                           
{'loss': '0.1677', 'grad_norm': '3.026', 'learning_rate': '9.516e-06', 'epoch': '0.53'}
+
 53%|█████▎    | 20120/37963 [45:36:12<43:51:20,  8.85s/it]
 53%|█████▎    | 20121/37963 [45:36:20<42:02:24,  8.48s/it]
 53%|█████▎    | 20122/37963 [45:36:30<44:26:28,  8.97s/it]
 53%|█████▎    | 20123/37963 [45:36:37<42:25:34,  8.56s/it]
 53%|█████▎    | 20124/37963 [45:36:45<40:53:25,  8.25s/it]
 53%|█████▎    | 20125/37963 [45:36:53<40:19:46,  8.14s/it]
 53%|█████▎    | 20126/37963 [45:37:01<39:45:49,  8.03s/it]
 53%|█████▎    | 20127/37963 [45:37:08<39:20:21,  7.94s/it]
 53%|█████▎    | 20128/37963 [45:37:16<38:53:21,  7.85s/it]
 53%|█████▎    | 20129/37963 [45:37:24<38:49:32,  7.84s/it]
 53%|█████▎    | 20130/37963 [45:37:32<38:42:48,  7.82s/it]
                                                           
{'loss': '0.1785', 'grad_norm': '3.003', 'learning_rate': '9.507e-06', 'epoch': '0.5303'}
+
 53%|█████▎    | 20130/37963 [45:37:32<38:42:48,  7.82s/it]
 53%|█████▎    | 20131/37963 [45:37:39<38:45:53,  7.83s/it]
 53%|█████▎    | 20132/37963 [45:37:50<42:30:33,  8.58s/it]
 53%|█████▎    | 20133/37963 [45:37:58<41:29:56,  8.38s/it]
 53%|█████▎    | 20134/37963 [45:38:05<40:33:47,  8.19s/it]
 53%|█████▎    | 20135/37963 [45:38:13<39:48:09,  8.04s/it]
 53%|█████▎    | 20136/37963 [45:38:21<39:18:30,  7.94s/it]
 53%|█████▎    | 20137/37963 [45:38:29<39:17:51,  7.94s/it]
 53%|█████▎    | 20138/37963 [45:38:36<38:54:37,  7.86s/it]
 53%|█████▎    | 20139/37963 [45:38:44<38:24:39,  7.76s/it]
 53%|█████▎    | 20140/37963 [45:38:51<38:05:33,  7.69s/it]
                                                           
{'loss': '0.1542', 'grad_norm': '1.451', 'learning_rate': '9.499e-06', 'epoch': '0.5305'}
+
 53%|█████▎    | 20140/37963 [45:38:51<38:05:33,  7.69s/it]
 53%|█████▎    | 20141/37963 [45:39:02<42:07:59,  8.51s/it]
 53%|█████▎    | 20142/37963 [45:39:09<40:46:22,  8.24s/it]
 53%|█████▎    | 20143/37963 [45:39:17<39:51:46,  8.05s/it]
 53%|█████▎    | 20144/37963 [45:39:25<39:14:39,  7.93s/it]
 53%|█████▎    | 20145/37963 [45:39:32<38:43:27,  7.82s/it]
 53%|█████▎    | 20146/37963 [45:39:40<38:54:39,  7.86s/it]
 53%|█████▎    | 20147/37963 [45:39:48<39:11:36,  7.92s/it]
 53%|█████▎    | 20148/37963 [45:39:56<38:14:18,  7.73s/it]
 53%|█████▎    | 20149/37963 [45:40:03<38:02:37,  7.69s/it]
 53%|█████▎    | 20150/37963 [45:40:11<38:00:12,  7.68s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '1.266', 'learning_rate': '9.49e-06', 'epoch': '0.5308'}
+
 53%|█████▎    | 20150/37963 [45:40:11<38:00:12,  7.68s/it]
 53%|█████▎    | 20151/37963 [45:40:18<37:28:46,  7.58s/it]
 53%|█████▎    | 20152/37963 [45:40:26<37:35:53,  7.60s/it]
 53%|█████▎    | 20153/37963 [45:40:34<38:05:46,  7.70s/it]
 53%|█████▎    | 20154/37963 [45:40:41<38:05:48,  7.70s/it]
 53%|█████▎    | 20155/37963 [45:40:49<38:19:42,  7.75s/it]
 53%|█████▎    | 20156/37963 [45:40:57<38:07:35,  7.71s/it]
 53%|█████▎    | 20157/37963 [45:41:05<38:05:50,  7.70s/it]
 53%|█████▎    | 20158/37963 [45:41:12<37:38:32,  7.61s/it]
 53%|█████▎    | 20159/37963 [45:41:25<45:34:14,  9.21s/it]
 53%|█████▎    | 20160/37963 [45:41:33<43:16:54,  8.75s/it]
                                                           
{'loss': '0.1611', 'grad_norm': '1.693', 'learning_rate': '9.482e-06', 'epoch': '0.531'}
+
 53%|█████▎    | 20160/37963 [45:41:33<43:16:54,  8.75s/it]
 53%|█████▎    | 20161/37963 [45:41:40<41:47:32,  8.45s/it]
 53%|█████▎    | 20162/37963 [45:41:48<40:36:51,  8.21s/it]
 53%|█████▎    | 20163/37963 [45:41:56<39:32:47,  8.00s/it]
 53%|█████▎    | 20164/37963 [45:42:03<39:00:39,  7.89s/it]
 53%|█████▎    | 20165/37963 [45:42:14<42:56:10,  8.68s/it]
 53%|█████▎    | 20166/37963 [45:42:21<41:30:44,  8.40s/it]
 53%|█████▎    | 20167/37963 [45:42:32<44:23:25,  8.98s/it]
 53%|█████▎    | 20168/37963 [45:42:42<46:23:07,  9.38s/it]
 53%|█████▎    | 20169/37963 [45:42:50<44:04:05,  8.92s/it]
 53%|█████▎    | 20170/37963 [45:42:58<42:28:08,  8.59s/it]
                                                           
{'loss': '0.1547', 'grad_norm': '3.073', 'learning_rate': '9.473e-06', 'epoch': '0.5313'}
+
 53%|█████▎    | 20170/37963 [45:42:58<42:28:08,  8.59s/it]
 53%|█████▎    | 20171/37963 [45:43:06<41:17:47,  8.36s/it]
 53%|█████▎    | 20172/37963 [45:43:13<40:34:04,  8.21s/it]
 53%|█████▎    | 20173/37963 [45:43:21<39:47:17,  8.05s/it]
 53%|█████▎    | 20174/37963 [45:43:29<38:58:19,  7.89s/it]
 53%|█████▎    | 20175/37963 [45:43:37<39:03:08,  7.90s/it]
 53%|█████▎    | 20176/37963 [45:43:47<42:49:07,  8.67s/it]
 53%|█████▎    | 20177/37963 [45:43:55<41:30:45,  8.40s/it]
 53%|█████▎    | 20178/37963 [45:44:03<40:37:13,  8.22s/it]
 53%|█████▎    | 20179/37963 [45:44:10<39:45:13,  8.05s/it]
 53%|█████▎    | 20180/37963 [45:44:18<39:05:17,  7.91s/it]
                                                           
{'loss': '0.1483', 'grad_norm': '1.872', 'learning_rate': '9.464e-06', 'epoch': '0.5316'}
+
 53%|█████▎    | 20180/37963 [45:44:18<39:05:17,  7.91s/it]
 53%|█████▎    | 20181/37963 [45:44:26<39:10:13,  7.93s/it]
 53%|█████▎    | 20182/37963 [45:44:34<38:59:28,  7.89s/it]
 53%|█████▎    | 20183/37963 [45:44:41<38:34:28,  7.81s/it]
 53%|█████▎    | 20184/37963 [45:44:49<38:25:35,  7.78s/it]
 53%|█████▎    | 20185/37963 [45:45:00<42:41:14,  8.64s/it]
 53%|█████▎    | 20186/37963 [45:45:07<41:29:09,  8.40s/it]
 53%|█████▎    | 20187/37963 [45:45:15<40:30:27,  8.20s/it]
 53%|█████▎    | 20188/37963 [45:45:23<39:49:39,  8.07s/it]
 53%|█████▎    | 20189/37963 [45:45:31<39:20:24,  7.97s/it]
 53%|█████▎    | 20190/37963 [45:45:38<39:02:11,  7.91s/it]
                                                           
{'loss': '0.1559', 'grad_norm': '2.292', 'learning_rate': '9.456e-06', 'epoch': '0.5318'}
+
 53%|█████▎    | 20190/37963 [45:45:38<39:02:11,  7.91s/it]
 53%|█████▎    | 20191/37963 [45:45:46<38:16:13,  7.75s/it]
 53%|█████▎    | 20192/37963 [45:45:54<38:14:15,  7.75s/it]
 53%|█████▎    | 20193/37963 [45:46:01<38:04:31,  7.71s/it]
 53%|█████▎    | 20194/37963 [45:46:08<37:21:08,  7.57s/it]
 53%|█████▎    | 20195/37963 [45:46:16<37:29:35,  7.60s/it]
 53%|█████▎    | 20196/37963 [45:46:24<37:33:13,  7.61s/it]
 53%|█████▎    | 20197/37963 [45:46:31<37:23:19,  7.58s/it]
 53%|█████▎    | 20198/37963 [45:46:39<37:39:32,  7.63s/it]
 53%|█████▎    | 20199/37963 [45:46:47<38:00:49,  7.70s/it]
 53%|█████▎    | 20200/37963 [45:46:54<37:45:46,  7.65s/it]
                                                           
{'loss': '0.1594', 'grad_norm': '3.85', 'learning_rate': '9.447e-06', 'epoch': '0.5321'}
+
 53%|█████▎    | 20200/37963 [45:46:54<37:45:46,  7.65s/it]
 53%|█████▎    | 20201/37963 [45:47:02<37:54:46,  7.68s/it]
 53%|█████▎    | 20202/37963 [45:47:10<37:49:49,  7.67s/it]
 53%|█████▎    | 20203/37963 [45:47:20<41:54:53,  8.50s/it]
 53%|█████▎    | 20204/37963 [45:47:28<40:45:27,  8.26s/it]
 53%|█████▎    | 20205/37963 [45:47:36<40:01:37,  8.11s/it]
 53%|█████▎    | 20206/37963 [45:47:43<39:27:59,  8.00s/it]
 53%|█████▎    | 20207/37963 [45:47:54<43:03:52,  8.73s/it]
 53%|█████▎    | 20208/37963 [45:48:02<41:50:14,  8.48s/it]
 53%|█████▎    | 20209/37963 [45:48:09<40:34:34,  8.23s/it]
 53%|█████▎    | 20210/37963 [45:48:17<39:38:00,  8.04s/it]
                                                           
{'loss': '0.1382', 'grad_norm': '0.8495', 'learning_rate': '9.439e-06', 'epoch': '0.5324'}
+
 53%|█████▎    | 20210/37963 [45:48:17<39:38:00,  8.04s/it]
 53%|█████▎    | 20211/37963 [45:48:27<42:27:25,  8.61s/it]
 53%|█████▎    | 20212/37963 [45:48:35<41:28:17,  8.41s/it]
 53%|█████▎    | 20213/37963 [45:48:48<48:30:55,  9.84s/it]
 53%|█████▎    | 20214/37963 [45:48:56<45:23:02,  9.21s/it]
 53%|█████▎    | 20215/37963 [45:49:03<43:05:39,  8.74s/it]
 53%|█████▎    | 20216/37963 [45:49:11<41:22:40,  8.39s/it]
 53%|█████▎    | 20217/37963 [45:49:19<40:16:49,  8.17s/it]
 53%|█████▎    | 20218/37963 [45:49:26<39:01:45,  7.92s/it]
 53%|█████▎    | 20219/37963 [45:49:34<38:22:25,  7.79s/it]
 53%|█████▎    | 20220/37963 [45:49:44<42:18:35,  8.58s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '1.395', 'learning_rate': '9.43e-06', 'epoch': '0.5326'}
+
 53%|█████▎    | 20220/37963 [45:49:44<42:18:35,  8.58s/it]
 53%|█████▎    | 20221/37963 [45:49:54<44:30:26,  9.03s/it]
 53%|█████▎    | 20222/37963 [45:50:01<42:09:52,  8.56s/it]
 53%|█████▎    | 20223/37963 [45:50:09<40:45:04,  8.27s/it]
 53%|█████▎    | 20224/37963 [45:50:17<39:57:53,  8.11s/it]
 53%|█████▎    | 20225/37963 [45:50:25<39:23:47,  8.00s/it]
 53%|█████▎    | 20226/37963 [45:50:32<38:59:55,  7.92s/it]
 53%|█████▎    | 20227/37963 [45:50:40<38:39:02,  7.85s/it]
 53%|█████▎    | 20228/37963 [45:50:48<38:20:39,  7.78s/it]
 53%|█████▎    | 20229/37963 [45:50:55<38:15:09,  7.77s/it]
 53%|█████▎    | 20230/37963 [45:51:06<42:33:25,  8.64s/it]
                                                           
{'loss': '0.1515', 'grad_norm': '3.057', 'learning_rate': '9.422e-06', 'epoch': '0.5329'}
+
 53%|█████▎    | 20230/37963 [45:51:06<42:33:25,  8.64s/it]
 53%|█████▎    | 20231/37963 [45:51:14<41:13:04,  8.37s/it]
 53%|█████▎    | 20232/37963 [45:51:21<40:14:06,  8.17s/it]
 53%|█████▎    | 20233/37963 [45:51:29<39:43:12,  8.06s/it]
 53%|█████▎    | 20234/37963 [45:51:37<38:56:35,  7.91s/it]
 53%|█████▎    | 20235/37963 [45:51:44<38:36:48,  7.84s/it]
 53%|█████▎    | 20236/37963 [45:51:52<38:22:30,  7.79s/it]
 53%|█████▎    | 20237/37963 [45:52:00<38:25:19,  7.80s/it]
 53%|█████▎    | 20238/37963 [45:52:08<38:21:04,  7.79s/it]
 53%|█████▎    | 20239/37963 [45:52:15<38:10:15,  7.75s/it]
 53%|█████▎    | 20240/37963 [45:52:23<38:01:30,  7.72s/it]
                                                           
{'loss': '0.1485', 'grad_norm': '2.534', 'learning_rate': '9.413e-06', 'epoch': '0.5332'}
+
 53%|█████▎    | 20240/37963 [45:52:23<38:01:30,  7.72s/it]
 53%|█████▎    | 20241/37963 [45:52:31<37:49:23,  7.68s/it]
 53%|█████▎    | 20242/37963 [45:52:38<37:51:35,  7.69s/it]
 53%|█████▎    | 20243/37963 [45:52:46<37:35:55,  7.64s/it]
 53%|█████▎    | 20244/37963 [45:52:54<37:35:18,  7.64s/it]
 53%|█████▎    | 20245/37963 [45:53:01<37:19:15,  7.58s/it]
 53%|█████▎    | 20246/37963 [45:53:09<37:28:09,  7.61s/it]
 53%|█████▎    | 20247/37963 [45:53:16<37:35:49,  7.64s/it]
 53%|█████▎    | 20248/37963 [45:53:24<37:01:18,  7.52s/it]
 53%|█████▎    | 20249/37963 [45:53:32<37:37:46,  7.65s/it]
 53%|█████▎    | 20250/37963 [45:53:39<37:34:39,  7.64s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '1.373', 'learning_rate': '9.405e-06', 'epoch': '0.5334'}
+
 53%|█████▎    | 20250/37963 [45:53:39<37:34:39,  7.64s/it]
 53%|█████▎    | 20251/37963 [45:53:49<41:06:52,  8.36s/it]
 53%|█████▎    | 20252/37963 [45:53:57<39:58:53,  8.13s/it]
 53%|█████▎    | 20253/37963 [45:54:04<39:13:57,  7.98s/it]
 53%|█████▎    | 20254/37963 [45:54:12<38:56:34,  7.92s/it]
 53%|█████▎    | 20255/37963 [45:54:22<42:23:17,  8.62s/it]
 53%|█████▎    | 20256/37963 [45:54:30<41:19:46,  8.40s/it]
 53%|█████▎    | 20257/37963 [45:54:41<44:26:45,  9.04s/it]
 53%|█████▎    | 20258/37963 [45:54:49<42:26:00,  8.63s/it]
 53%|█████▎    | 20259/37963 [45:54:56<41:01:06,  8.34s/it]
 53%|█████▎    | 20260/37963 [45:55:04<40:12:29,  8.18s/it]
                                                           
{'loss': '0.1735', 'grad_norm': '2.729', 'learning_rate': '9.396e-06', 'epoch': '0.5337'}
+
 53%|█████▎    | 20260/37963 [45:55:04<40:12:29,  8.18s/it]
 53%|█████▎    | 20261/37963 [45:55:15<43:44:10,  8.89s/it]
 53%|█████▎    | 20262/37963 [45:55:22<42:06:05,  8.56s/it]
 53%|█████▎    | 20263/37963 [45:55:30<41:04:13,  8.35s/it]
 53%|█████▎    | 20264/37963 [45:55:38<40:07:36,  8.16s/it]
 53%|█████▎    | 20265/37963 [45:55:45<39:03:17,  7.94s/it]
 53%|█████▎    | 20266/37963 [45:55:53<39:02:50,  7.94s/it]
 53%|█████▎    | 20267/37963 [45:56:04<42:21:24,  8.62s/it]
 53%|█████▎    | 20268/37963 [45:56:14<44:50:33,  9.12s/it]
 53%|█████▎    | 20269/37963 [45:56:22<42:44:52,  8.70s/it]
 53%|█████▎    | 20270/37963 [45:56:32<44:55:13,  9.14s/it]
                                                           
{'loss': '0.1477', 'grad_norm': '4.595', 'learning_rate': '9.388e-06', 'epoch': '0.5339'}
+
 53%|█████▎    | 20270/37963 [45:56:32<44:55:13,  9.14s/it]
 53%|█████▎    | 20271/37963 [45:56:39<42:46:57,  8.71s/it]
 53%|█████▎    | 20272/37963 [45:56:47<41:16:54,  8.40s/it]
 53%|█████▎    | 20273/37963 [45:56:55<40:20:28,  8.21s/it]
 53%|█████▎    | 20274/37963 [45:57:02<39:21:40,  8.01s/it]
 53%|█████▎    | 20275/37963 [45:57:10<38:54:27,  7.92s/it]
 53%|█████▎    | 20276/37963 [45:57:18<38:14:35,  7.78s/it]
 53%|█████▎    | 20277/37963 [45:57:25<37:48:48,  7.70s/it]
 53%|█████▎    | 20278/37963 [45:57:33<37:45:40,  7.69s/it]
 53%|█████▎    | 20279/37963 [45:57:40<37:30:41,  7.64s/it]
 53%|█████▎    | 20280/37963 [45:57:48<37:38:59,  7.66s/it]
                                                           
{'loss': '0.1455', 'grad_norm': '5.876', 'learning_rate': '9.379e-06', 'epoch': '0.5342'}
+
 53%|█████▎    | 20280/37963 [45:57:48<37:38:59,  7.66s/it]
 53%|█████▎    | 20281/37963 [45:57:56<37:41:22,  7.67s/it]
 53%|█████▎    | 20282/37963 [45:58:03<36:57:54,  7.53s/it]
 53%|█████▎    | 20283/37963 [45:58:13<41:29:55,  8.45s/it]
 53%|█████▎    | 20284/37963 [45:58:21<40:24:44,  8.23s/it]
 53%|█████▎    | 20285/37963 [45:58:29<39:27:00,  8.03s/it]
 53%|█████▎    | 20286/37963 [45:58:37<39:05:33,  7.96s/it]
 53%|█████▎    | 20287/37963 [45:58:44<38:59:22,  7.94s/it]
 53%|█████▎    | 20288/37963 [45:58:52<38:20:04,  7.81s/it]
 53%|█████▎    | 20289/37963 [45:59:00<38:09:39,  7.77s/it]
 53%|█████▎    | 20290/37963 [45:59:07<38:00:30,  7.74s/it]
                                                           
{'loss': '0.1635', 'grad_norm': '1.717', 'learning_rate': '9.371e-06', 'epoch': '0.5345'}
+
 53%|█████▎    | 20290/37963 [45:59:07<38:00:30,  7.74s/it]
 53%|█████▎    | 20291/37963 [45:59:15<37:50:43,  7.71s/it]
 53%|█████▎    | 20292/37963 [45:59:22<37:33:09,  7.65s/it]
 53%|█████▎    | 20293/37963 [45:59:30<37:54:14,  7.72s/it]
 53%|█████▎    | 20294/37963 [45:59:40<41:19:10,  8.42s/it]
 53%|█████▎    | 20295/37963 [45:59:48<40:17:00,  8.21s/it]
 53%|█████▎    | 20296/37963 [45:59:55<38:59:14,  7.94s/it]
 53%|█████▎    | 20297/37963 [46:00:03<39:06:16,  7.97s/it]
 53%|█████▎    | 20298/37963 [46:00:11<38:58:37,  7.94s/it]
 53%|█████▎    | 20299/37963 [46:00:19<38:34:30,  7.86s/it]
 53%|█████▎    | 20300/37963 [46:00:27<38:15:12,  7.80s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '0.8656', 'learning_rate': '9.362e-06', 'epoch': '0.5347'}
+
 53%|█████▎    | 20300/37963 [46:00:27<38:15:12,  7.80s/it]
 53%|█████▎    | 20301/37963 [46:00:37<42:14:43,  8.61s/it]
 53%|█████▎    | 20302/37963 [46:00:45<40:57:21,  8.35s/it]
 53%|█████▎    | 20303/37963 [46:00:55<44:14:40,  9.02s/it]
 53%|█████▎    | 20304/37963 [46:01:03<42:21:32,  8.64s/it]
 53%|█████▎    | 20305/37963 [46:01:11<41:16:51,  8.42s/it]
 53%|█████▎    | 20306/37963 [46:01:19<40:21:00,  8.23s/it]
 53%|█████▎    | 20307/37963 [46:01:27<39:30:11,  8.05s/it]
 53%|█████▎    | 20308/37963 [46:01:34<39:07:01,  7.98s/it]
 53%|█████▎    | 20309/37963 [46:01:45<43:05:51,  8.79s/it]
 53%|█████▎    | 20310/37963 [46:01:53<41:31:09,  8.47s/it]
                                                           
{'loss': '0.158', 'grad_norm': '2.676', 'learning_rate': '9.354e-06', 'epoch': '0.535'}
+
 53%|█████▎    | 20310/37963 [46:01:53<41:31:09,  8.47s/it]
 54%|█████▎    | 20311/37963 [46:02:00<40:02:47,  8.17s/it]
 54%|█████▎    | 20312/37963 [46:02:08<39:05:57,  7.97s/it]
 54%|█████▎    | 20313/37963 [46:02:15<38:26:14,  7.84s/it]
 54%|█████▎    | 20314/37963 [46:02:23<38:08:40,  7.78s/it]
 54%|█████▎    | 20315/37963 [46:02:31<38:08:17,  7.78s/it]
 54%|█████▎    | 20316/37963 [46:02:41<41:26:04,  8.45s/it]
 54%|█████▎    | 20317/37963 [46:02:48<39:57:43,  8.15s/it]
 54%|█████▎    | 20318/37963 [46:02:56<39:47:39,  8.12s/it]
 54%|█████▎    | 20319/37963 [46:03:04<39:02:52,  7.97s/it]
 54%|█████▎    | 20320/37963 [46:03:12<38:39:57,  7.89s/it]
                                                           
{'loss': '0.153', 'grad_norm': '1.584', 'learning_rate': '9.345e-06', 'epoch': '0.5353'}
+
 54%|█████▎    | 20320/37963 [46:03:12<38:39:57,  7.89s/it]
 54%|█████▎    | 20321/37963 [46:03:22<42:13:01,  8.61s/it]
 54%|█████▎    | 20322/37963 [46:03:30<40:52:42,  8.34s/it]
 54%|█████▎    | 20323/37963 [46:03:37<39:42:46,  8.10s/it]
 54%|█████▎    | 20324/37963 [46:03:45<39:05:57,  7.98s/it]
 54%|█████▎    | 20325/37963 [46:03:52<38:32:03,  7.87s/it]
 54%|█████▎    | 20326/37963 [46:04:00<37:54:33,  7.74s/it]
 54%|█████▎    | 20327/37963 [46:04:07<37:39:15,  7.69s/it]
 54%|█████▎    | 20328/37963 [46:04:15<37:41:20,  7.69s/it]
 54%|█████▎    | 20329/37963 [46:04:23<37:47:38,  7.72s/it]
 54%|█████▎    | 20330/37963 [46:04:31<37:47:10,  7.71s/it]
                                                           
{'loss': '0.15', 'grad_norm': '2.98', 'learning_rate': '9.337e-06', 'epoch': '0.5355'}
+
 54%|█████▎    | 20330/37963 [46:04:31<37:47:10,  7.71s/it]
 54%|█████▎    | 20331/37963 [46:04:38<37:37:57,  7.68s/it]
 54%|█████▎    | 20332/37963 [46:04:46<37:38:35,  7.69s/it]
 54%|█████▎    | 20333/37963 [46:04:54<37:34:55,  7.67s/it]
 54%|█████▎    | 20334/37963 [46:05:04<41:35:36,  8.49s/it]
 54%|█████▎    | 20335/37963 [46:05:11<40:01:55,  8.18s/it]
 54%|█████▎    | 20336/37963 [46:05:19<39:19:12,  8.03s/it]
 54%|█████▎    | 20337/37963 [46:05:27<38:58:36,  7.96s/it]
 54%|█████▎    | 20338/37963 [46:05:37<42:33:17,  8.69s/it]
 54%|█████▎    | 20339/37963 [46:05:45<40:49:14,  8.34s/it]
 54%|█████▎    | 20340/37963 [46:05:53<40:02:32,  8.18s/it]
                                                           
{'loss': '0.1486', 'grad_norm': '0.9016', 'learning_rate': '9.328e-06', 'epoch': '0.5358'}
+
 54%|█████▎    | 20340/37963 [46:05:53<40:02:32,  8.18s/it]
 54%|█████▎    | 20341/37963 [46:06:00<39:00:05,  7.97s/it]
 54%|█████▎    | 20342/37963 [46:06:08<38:34:20,  7.88s/it]
 54%|█████▎    | 20343/37963 [46:06:16<38:32:13,  7.87s/it]
 54%|█████▎    | 20344/37963 [46:06:23<38:05:12,  7.78s/it]
 54%|█████▎    | 20345/37963 [46:06:31<38:08:25,  7.79s/it]
 54%|█████▎    | 20346/37963 [46:06:39<38:11:07,  7.80s/it]
 54%|█████▎    | 20347/37963 [46:06:47<38:07:47,  7.79s/it]
 54%|█████▎    | 20348/37963 [46:06:57<41:30:11,  8.48s/it]
 54%|█████▎    | 20349/37963 [46:07:04<40:14:19,  8.22s/it]
 54%|█████▎    | 20350/37963 [46:07:12<39:44:04,  8.12s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '1.785', 'learning_rate': '9.32e-06', 'epoch': '0.5361'}
+
 54%|█████▎    | 20350/37963 [46:07:12<39:44:04,  8.12s/it]
 54%|█████▎    | 20351/37963 [46:07:20<38:52:37,  7.95s/it]
 54%|█████▎    | 20352/37963 [46:07:27<38:25:37,  7.86s/it]
 54%|█████▎    | 20353/37963 [46:07:35<38:02:55,  7.78s/it]
 54%|█████▎    | 20354/37963 [46:07:43<37:57:03,  7.76s/it]
 54%|█████▎    | 20355/37963 [46:07:50<37:42:26,  7.71s/it]
 54%|█████▎    | 20356/37963 [46:07:58<37:33:54,  7.68s/it]
 54%|█████▎    | 20357/37963 [46:08:08<41:39:21,  8.52s/it]
 54%|█████▎    | 20358/37963 [46:08:19<44:33:14,  9.11s/it]
 54%|█████▎    | 20359/37963 [46:08:26<42:24:51,  8.67s/it]
 54%|█████▎    | 20360/37963 [46:08:34<41:17:43,  8.45s/it]
                                                           
{'loss': '0.1521', 'grad_norm': '5.404', 'learning_rate': '9.311e-06', 'epoch': '0.5363'}
+
 54%|█████▎    | 20360/37963 [46:08:34<41:17:43,  8.45s/it]
 54%|█████▎    | 20361/37963 [46:08:45<44:03:20,  9.01s/it]
 54%|█████▎    | 20362/37963 [46:08:53<42:16:35,  8.65s/it]
 54%|█████▎    | 20363/37963 [46:09:00<40:52:04,  8.36s/it]
 54%|█████▎    | 20364/37963 [46:09:08<40:09:52,  8.22s/it]
 54%|█████▎    | 20365/37963 [46:09:16<39:28:57,  8.08s/it]
 54%|█████▎    | 20366/37963 [46:09:23<38:30:41,  7.88s/it]
 54%|█████▎    | 20367/37963 [46:09:31<38:05:30,  7.79s/it]
 54%|█████▎    | 20368/37963 [46:09:38<37:51:58,  7.75s/it]
 54%|█████▎    | 20369/37963 [46:09:49<41:25:14,  8.48s/it]
 54%|█████▎    | 20370/37963 [46:09:56<40:08:44,  8.21s/it]
                                                           
{'loss': '0.1498', 'grad_norm': '2.03', 'learning_rate': '9.303e-06', 'epoch': '0.5366'}
+
 54%|█████▎    | 20370/37963 [46:09:56<40:08:44,  8.21s/it]
 54%|█████▎    | 20371/37963 [46:10:04<39:22:56,  8.06s/it]
 54%|█████▎    | 20372/37963 [46:10:12<38:43:34,  7.93s/it]
 54%|█████▎    | 20373/37963 [46:10:20<38:48:28,  7.94s/it]
 54%|█████▎    | 20374/37963 [46:10:27<38:42:33,  7.92s/it]
 54%|█████▎    | 20375/37963 [46:10:35<38:24:19,  7.86s/it]
 54%|█████▎    | 20376/37963 [46:10:43<38:17:23,  7.84s/it]
 54%|█████▎    | 20377/37963 [46:10:51<37:58:16,  7.77s/it]
 54%|█████▎    | 20378/37963 [46:10:58<38:05:47,  7.80s/it]
 54%|█████▎    | 20379/37963 [46:11:06<37:55:22,  7.76s/it]
 54%|█████▎    | 20380/37963 [46:11:14<37:45:49,  7.73s/it]
                                                           
{'loss': '0.1627', 'grad_norm': '2.536', 'learning_rate': '9.294e-06', 'epoch': '0.5368'}
+
 54%|█████▎    | 20380/37963 [46:11:14<37:45:49,  7.73s/it]
 54%|█████▎    | 20381/37963 [46:11:21<37:05:11,  7.59s/it]
 54%|█████▎    | 20382/37963 [46:11:31<40:47:29,  8.35s/it]
 54%|█████▎    | 20383/37963 [46:11:39<39:55:22,  8.18s/it]
 54%|█████▎    | 20384/37963 [46:11:47<39:08:38,  8.02s/it]
 54%|█████▎    | 20385/37963 [46:11:54<38:41:41,  7.92s/it]
 54%|█████▎    | 20386/37963 [46:12:02<38:23:59,  7.86s/it]
 54%|█████▎    | 20387/37963 [46:12:10<38:13:35,  7.83s/it]
 54%|█████▎    | 20388/37963 [46:12:20<42:04:31,  8.62s/it]
 54%|█████▎    | 20389/37963 [46:12:28<40:49:15,  8.36s/it]
 54%|█████▎    | 20390/37963 [46:12:36<39:57:48,  8.19s/it]
                                                           
{'loss': '0.1383', 'grad_norm': '1.158', 'learning_rate': '9.286e-06', 'epoch': '0.5371'}
+
 54%|█████▎    | 20390/37963 [46:12:36<39:57:48,  8.19s/it]
 54%|█████▎    | 20391/37963 [46:12:44<39:25:32,  8.08s/it]
 54%|█████▎    | 20392/37963 [46:12:51<38:24:24,  7.87s/it]
 54%|█���███▎    | 20393/37963 [46:12:59<38:05:31,  7.80s/it]
 54%|█████▎    | 20394/37963 [46:13:06<37:52:03,  7.76s/it]
 54%|█████▎    | 20395/37963 [46:13:14<37:48:45,  7.75s/it]
 54%|█████▎    | 20396/37963 [46:13:22<37:53:27,  7.76s/it]
 54%|█████▎    | 20397/37963 [46:13:29<37:21:29,  7.66s/it]
 54%|█████▎    | 20398/37963 [46:13:37<37:33:59,  7.70s/it]
 54%|█████▎    | 20399/37963 [46:13:45<37:53:54,  7.77s/it]
 54%|█████▎    | 20400/37963 [46:13:52<37:29:11,  7.68s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '2.009', 'learning_rate': '9.277e-06', 'epoch': '0.5374'}
+
 54%|█████▎    | 20400/37963 [46:13:52<37:29:11,  7.68s/it]
 54%|█████▎    | 20401/37963 [46:14:00<37:36:03,  7.71s/it]
 54%|█████▎    | 20402/37963 [46:14:11<41:41:11,  8.55s/it]
 54%|█████▎    | 20403/37963 [46:14:19<40:56:43,  8.39s/it]
 54%|█████▎    | 20404/37963 [46:14:27<40:05:05,  8.22s/it]
 54%|█████▎    | 20405/37963 [46:14:34<39:12:15,  8.04s/it]
 54%|█████▍    | 20406/37963 [46:14:44<42:30:58,  8.72s/it]
 54%|█████▍    | 20407/37963 [46:14:52<40:57:28,  8.40s/it]
 54%|█████▍    | 20408/37963 [46:15:00<40:15:05,  8.25s/it]
 54%|█████▍    | 20409/37963 [46:15:08<39:41:36,  8.14s/it]
 54%|█████▍    | 20410/37963 [46:15:15<38:41:39,  7.94s/it]
                                                           
{'loss': '0.1507', 'grad_norm': '1.187', 'learning_rate': '9.269e-06', 'epoch': '0.5376'}
+
 54%|█████▍    | 20410/37963 [46:15:15<38:41:39,  7.94s/it]
 54%|█████▍    | 20411/37963 [46:15:26<42:27:04,  8.71s/it]
 54%|█████▍    | 20412/37963 [46:15:33<40:52:39,  8.38s/it]
 54%|█████▍    | 20413/37963 [46:15:44<43:36:17,  8.94s/it]
 54%|█████▍    | 20414/37963 [46:15:51<41:44:33,  8.56s/it]
 54%|█████▍    | 20415/37963 [46:15:59<40:26:28,  8.30s/it]
 54%|█████▍    | 20416/37963 [46:16:07<39:32:57,  8.11s/it]
 54%|█████▍    | 20417/37963 [46:16:14<38:32:29,  7.91s/it]
 54%|█████▍    | 20418/37963 [46:16:24<41:57:09,  8.61s/it]
 54%|█████▍    | 20419/37963 [46:16:32<40:12:09,  8.25s/it]
 54%|█████▍    | 20420/37963 [46:16:39<38:56:49,  7.99s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '2.216', 'learning_rate': '9.26e-06', 'epoch': '0.5379'}
+
 54%|█████▍    | 20420/37963 [46:16:39<38:56:49,  7.99s/it]
 54%|█████▍    | 20421/37963 [46:16:47<38:33:40,  7.91s/it]
 54%|█████▍    | 20422/37963 [46:16:55<38:16:12,  7.85s/it]
 54%|█████▍    | 20423/37963 [46:17:02<37:55:19,  7.78s/it]
 54%|█████▍    | 20424/37963 [46:17:10<38:01:43,  7.81s/it]
 54%|█████▍    | 20425/37963 [46:17:21<42:22:19,  8.70s/it]
 54%|█████▍    | 20426/37963 [46:17:29<41:22:13,  8.49s/it]
 54%|█████▍    | 20427/37963 [46:17:37<40:17:18,  8.27s/it]
 54%|█████▍    | 20428/37963 [46:17:44<39:21:57,  8.08s/it]
 54%|█████▍    | 20429/37963 [46:17:52<39:06:47,  8.03s/it]
 54%|█████▍    | 20430/37963 [46:18:00<38:32:03,  7.91s/it]
                                                           
{'loss': '0.1584', 'grad_norm': '2.846', 'learning_rate': '9.252e-06', 'epoch': '0.5382'}
+
 54%|█████▍    | 20430/37963 [46:18:00<38:32:03,  7.91s/it]
 54%|█████▍    | 20431/37963 [46:18:08<38:15:38,  7.86s/it]
 54%|█████▍    | 20432/37963 [46:18:16<38:23:53,  7.89s/it]
 54%|█████▍    | 20433/37963 [46:18:23<38:02:17,  7.81s/it]
 54%|█████▍    | 20434/37963 [46:18:31<37:37:42,  7.73s/it]
 54%|█████▍    | 20435/37963 [46:18:38<36:56:16,  7.59s/it]
 54%|█████▍    | 20436/37963 [46:18:46<36:55:29,  7.58s/it]
 54%|█████▍    | 20437/37963 [46:18:54<37:37:47,  7.73s/it]
 54%|█████▍    | 20438/37963 [46:19:01<37:34:50,  7.72s/it]
 54%|█████▍    | 20439/37963 [46:19:09<37:27:42,  7.70s/it]
 54%|█████▍    | 20440/37963 [46:19:17<37:22:11,  7.68s/it]
                                                           
{'loss': '0.1469', 'grad_norm': '1.661', 'learning_rate': '9.243e-06', 'epoch': '0.5384'}
+
 54%|█████▍    | 20440/37963 [46:19:17<37:22:11,  7.68s/it]
 54%|█████▍    | 20441/37963 [46:19:24<37:29:39,  7.70s/it]
 54%|█████▍    | 20442/37963 [46:19:35<41:27:43,  8.52s/it]
 54%|█████▍    | 20443/37963 [46:19:43<40:22:30,  8.30s/it]
 54%|█████▍    | 20444/37963 [46:19:50<39:27:38,  8.11s/it]
 54%|█████▍    | 20445/37963 [46:19:58<38:51:40,  7.99s/it]
 54%|█████▍    | 20446/37963 [46:20:06<38:25:19,  7.90s/it]
 54%|█████▍    | 20447/37963 [46:20:13<38:02:40,  7.82s/it]
 54%|█████▍    | 20448/37963 [46:20:24<41:46:07,  8.59s/it]
 54%|█████▍    | 20449/37963 [46:20:34<44:48:04,  9.21s/it]
 54%|█████▍    | 20450/37963 [46:20:42<42:44:38,  8.79s/it]
                                                           
{'loss': '0.1687', 'grad_norm': '4.91', 'learning_rate': '9.235e-06', 'epoch': '0.5387'}
+
 54%|█████▍    | 20450/37963 [46:20:42<42:44:38,  8.79s/it]
 54%|█████▍    | 20451/37963 [46:20:49<40:29:20,  8.32s/it]
 54%|█████▍    | 20452/37963 [46:20:57<39:44:59,  8.17s/it]
 54%|█████▍    | 20453/37963 [46:21:05<39:27:36,  8.11s/it]
 54%|█████▍    | 20454/37963 [46:21:13<39:00:16,  8.02s/it]
 54%|█████▍    | 20455/37963 [46:21:26<46:15:05,  9.51s/it]
 54%|█████▍    | 20456/37963 [46:21:34<43:45:44,  9.00s/it]
 54%|█████▍    | 20457/37963 [46:21:44<45:35:20,  9.38s/it]
 54%|█████▍    | 20458/37963 [46:21:52<43:00:43,  8.85s/it]
 54%|█████▍    | 20459/37963 [46:21:59<41:07:32,  8.46s/it]
 54%|█████▍    | 20460/37963 [46:22:07<39:48:57,  8.19s/it]
                                                           
{'loss': '0.1666', 'grad_norm': '2.995', 'learning_rate': '9.226e-06', 'epoch': '0.5389'}
+
 54%|█████▍    | 20460/37963 [46:22:07<39:48:57,  8.19s/it]
 54%|█████▍    | 20461/37963 [46:22:15<39:15:55,  8.08s/it]
 54%|█████▍    | 20462/37963 [46:22:22<38:42:54,  7.96s/it]
 54%|█████▍    | 20463/37963 [46:22:30<38:12:16,  7.86s/it]
 54%|█████▍    | 20464/37963 [46:22:37<37:12:36,  7.66s/it]
 54%|█████▍    | 20465/37963 [46:22:45<37:10:12,  7.65s/it]
 54%|█████▍    | 20466/37963 [46:22:55<40:55:50,  8.42s/it]
 54%|█████▍    | 20467/37963 [46:23:03<40:11:17,  8.27s/it]
 54%|█████▍    | 20468/37963 [46:23:11<39:37:16,  8.15s/it]
 54%|█████▍    | 20469/37963 [46:23:18<38:52:46,  8.00s/it]
 54%|█████▍    | 20470/37963 [46:23:26<38:37:05,  7.95s/it]
                                                           
{'loss': '0.1539', 'grad_norm': '1.209', 'learning_rate': '9.218e-06', 'epoch': '0.5392'}
+
 54%|█████▍    | 20470/37963 [46:23:26<38:37:05,  7.95s/it]
 54%|█████▍    | 20471/37963 [46:23:34<37:48:35,  7.78s/it]
 54%|█████▍    | 20472/37963 [46:23:41<37:45:22,  7.77s/it]
 54%|█████▍    | 20473/37963 [46:23:49<37:05:05,  7.63s/it]
 54%|█████▍    | 20474/37963 [46:23:56<37:23:26,  7.70s/it]
 54%|█████▍    | 20475/37963 [46:24:04<37:39:16,  7.75s/it]
 54%|█████▍    | 20476/37963 [46:24:12<37:49:00,  7.79s/it]
 54%|█████▍    | 20477/37963 [46:24:20<37:58:16,  7.82s/it]
 54%|█████▍    | 20478/37963 [46:24:28<37:36:28,  7.74s/it]
 54%|█████▍    | 20479/37963 [46:24:38<41:11:43,  8.48s/it]
 54%|█████▍    | 20480/37963 [46:24:45<39:55:53,  8.22s/it]
                                                           
{'loss': '0.149', 'grad_norm': '1.689', 'learning_rate': '9.209e-06', 'epoch': '0.5395'}
+
 54%|█████▍    | 20480/37963 [46:24:45<39:55:53,  8.22s/it]
 54%|█████▍    | 20481/37963 [46:24:53<39:16:26,  8.09s/it]
 54%|█████▍    | 20482/37963 [46:25:01<38:46:22,  7.98s/it]
 54%|█████▍    | 20483/37963 [46:25:09<38:17:27,  7.89s/it]
 54%|█████▍    | 20484/37963 [46:25:16<38:01:34,  7.83s/it]
 54%|█████▍    | 20485/37963 [46:25:24<37:42:41,  7.77s/it]
 54%|█████▍    | 20486/37963 [46:25:32<37:22:42,  7.70s/it]
 54%|█████▍    | 20487/37963 [46:25:39<37:36:19,  7.75s/it]
 54%|█████▍    | 20488/37963 [46:25:47<37:37:08,  7.75s/it]
 54%|█████▍    | 20489/37963 [46:25:55<37:30:54,  7.73s/it]
 54%|█████▍    | 20490/37963 [46:26:03<37:29:11,  7.72s/it]
                                                           
{'loss': '0.1528', 'grad_norm': '2.275', 'learning_rate': '9.201e-06', 'epoch': '0.5397'}
+
 54%|█████▍    | 20490/37963 [46:26:03<37:29:11,  7.72s/it]
 54%|█████▍    | 20491/37963 [46:26:10<37:37:29,  7.75s/it]
 54%|█████▍    | 20492/37963 [46:26:18<37:11:30,  7.66s/it]
 54%|█████▍    | 20493/37963 [46:26:26<37:16:32,  7.68s/it]
 54%|█████▍    | 20494/37963 [46:26:34<37:49:00,  7.79s/it]
 54%|█████▍    | 20495/37963 [46:26:41<37:34:57,  7.75s/it]
 54%|█████▍    | 20496/37963 [46:26:52<41:48:24,  8.62s/it]
 54%|█████▍    | 20497/37963 [46:27:00<40:51:12,  8.42s/it]
 54%|█████▍    | 20498/37963 [46:27:08<40:02:06,  8.25s/it]
 54%|█████▍    | 20499/37963 [46:27:18<42:58:25,  8.86s/it]
 54%|█████▍    | 20500/37963 [46:27:28<44:37:56,  9.20s/it]
                                                           
{'loss': '0.1507', 'grad_norm': '1.846', 'learning_rate': '9.192e-06', 'epoch': '0.54'}
+
 54%|█████▍    | 20500/37963 [46:27:28<44:37:56,  9.20s/it]
 54%|█████▍    | 20501/37963 [46:27:35<42:10:09,  8.69s/it]
 54%|█████▍    | 20502/37963 [46:27:43<40:09:05,  8.28s/it]
 54%|█████▍    | 20503/37963 [46:27:56<47:13:37,  9.74s/it]
 54%|█████▍    | 20504/37963 [46:28:04<44:29:14,  9.17s/it]
 54%|█████▍    | 20505/37963 [46:28:11<41:49:53,  8.63s/it]
 54%|█████▍    | 20506/37963 [46:28:19<40:23:38,  8.33s/it]
 54%|█████▍    | 20507/37963 [46:28:27<39:31:54,  8.15s/it]
 54%|█████▍    | 20508/37963 [46:28:34<38:50:42,  8.01s/it]
 54%|█████▍    | 20509/37963 [46:28:42<38:18:59,  7.90s/it]
 54%|█████▍    | 20510/37963 [46:28:49<37:22:01,  7.71s/it]
                                                           
{'loss': '0.1679', 'grad_norm': '4.119', 'learning_rate': '9.184e-06', 'epoch': '0.5403'}
+
 54%|█████▍    | 20510/37963 [46:28:49<37:22:01,  7.71s/it]
 54%|█████▍    | 20511/37963 [46:28:57<37:18:08,  7.69s/it]
 54%|█████▍    | 20512/37963 [46:29:04<36:45:12,  7.58s/it]
 54%|█████▍    | 20513/37963 [46:29:12<36:39:35,  7.56s/it]
 54%|█████▍    | 20514/37963 [46:29:22<40:44:31,  8.41s/it]
 54%|█████▍    | 20515/37963 [46:29:30<39:36:15,  8.17s/it]
 54%|█████▍    | 20516/37963 [46:29:37<38:59:20,  8.04s/it]
 54%|█████▍    | 20517/37963 [46:29:45<38:06:52,  7.86s/it]
 54%|█████▍    | 20518/37963 [46:29:52<37:52:18,  7.82s/it]
 54%|█████▍    | 20519/37963 [46:30:00<37:54:31,  7.82s/it]
 54%|█████▍    | 20520/37963 [46:30:08<37:30:36,  7.74s/it]
                                                           
{'loss': '0.1658', 'grad_norm': '1.56', 'learning_rate': '9.175e-06', 'epoch': '0.5405'}
+
 54%|█████▍    | 20520/37963 [46:30:08<37:30:36,  7.74s/it]
 54%|█████▍    | 20521/37963 [46:30:16<37:23:00,  7.72s/it]
 54%|█████▍    | 20522/37963 [46:30:23<37:34:47,  7.76s/it]
 54%|█████▍    | 20523/37963 [46:30:31<37:20:38,  7.71s/it]
 54%|█████▍    | 20524/37963 [46:30:39<37:17:43,  7.70s/it]
 54%|█████▍    | 20525/37963 [46:30:46<37:05:56,  7.66s/it]
 54%|█████▍    | 20526/37963 [46:30:54<37:16:44,  7.70s/it]
 54%|█████▍    | 20527/37963 [46:31:02<37:33:12,  7.75s/it]
 54%|█████▍    | 20528/37963 [46:31:10<37:33:58,  7.76s/it]
 54%|█████▍    | 20529/37963 [46:31:17<37:21:00,  7.71s/it]
 54%|█████▍    | 20530/37963 [46:31:25<37:12:36,  7.68s/it]
                                                           
{'loss': '0.1596', 'grad_norm': '1.934', 'learning_rate': '9.167e-06', 'epoch': '0.5408'}
+
 54%|█████▍    | 20530/37963 [46:31:25<37:12:36,  7.68s/it]
 54%|█████▍    | 20531/37963 [46:31:32<37:04:44,  7.66s/it]
 54%|█████▍    | 20532/37963 [46:31:40<37:17:01,  7.70s/it]
 54%|█████▍    | 20533/37963 [46:31:50<40:34:06,  8.38s/it]
 54%|█████▍    | 20534/37963 [46:31:58<39:32:50,  8.17s/it]
 54%|█████▍    | 20535/37963 [46:32:06<38:48:32,  8.02s/it]
 54%|█████▍    | 20536/37963 [46:32:13<38:15:30,  7.90s/it]
 54%|█████▍    | 20537/37963 [46:32:21<37:56:07,  7.84s/it]
 54%|█████▍    | 20538/37963 [46:32:29<37:50:28,  7.82s/it]
 54%|█████▍    | 20539/37963 [46:32:37<37:56:34,  7.84s/it]
 54%|█████▍    | 20540/37963 [46:32:47<41:46:29,  8.63s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '2.05', 'learning_rate': '9.158e-06', 'epoch': '0.5411'}
+
 54%|█████▍    | 20540/37963 [46:32:47<41:46:29,  8.63s/it]
 54%|█████▍    | 20541/37963 [46:32:55<40:33:53,  8.38s/it]
 54%|█████▍    | 20542/37963 [46:33:03<39:47:53,  8.22s/it]
 54%|█████▍    | 20543/37963 [46:33:10<39:04:11,  8.07s/it]
 54%|█████▍    | 20544/37963 [46:33:21<42:31:34,  8.79s/it]
 54%|█████▍    | 20545/37963 [46:33:29<41:35:45,  8.60s/it]
 54%|█████▍    | 20546/37963 [46:33:37<40:17:07,  8.33s/it]
 54%|█████▍    | 20547/37963 [46:33:47<43:36:34,  9.01s/it]
 54%|█████▍    | 20548/37963 [46:33:58<46:11:52,  9.55s/it]
 54%|█████▍    | 20549/37963 [46:34:06<44:02:25,  9.10s/it]
 54%|█████▍    | 20550/37963 [46:34:14<41:57:40,  8.68s/it]
                                                           
{'loss': '0.1546', 'grad_norm': '1.914', 'learning_rate': '9.15e-06', 'epoch': '0.5413'}
+
 54%|█████▍    | 20550/37963 [46:34:14<41:57:40,  8.68s/it]
 54%|█████▍    | 20551/37963 [46:34:24<44:13:04,  9.14s/it]
 54%|█████▍    | 20552/37963 [46:34:35<46:17:50,  9.57s/it]
 54%|█████▍    | 20553/37963 [46:34:42<43:34:14,  9.01s/it]
 54%|█████▍    | 20554/37963 [46:34:50<41:44:09,  8.63s/it]
 54%|█████▍    | 20555/37963 [46:34:58<40:33:01,  8.39s/it]
 54%|█████▍    | 20556/37963 [46:35:06<39:34:05,  8.18s/it]
 54%|█████▍    | 20557/37963 [46:35:13<38:51:46,  8.04s/it]
 54%|█████▍    | 20558/37963 [46:35:24<42:32:01,  8.80s/it]
 54%|█████▍    | 20559/37963 [46:35:32<41:11:35,  8.52s/it]
 54%|█████▍    | 20560/37963 [46:35:40<40:19:48,  8.34s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '1.371', 'learning_rate': '9.141e-06', 'epoch': '0.5416'}
+
 54%|█████▍    | 20560/37963 [46:35:40<40:19:48,  8.34s/it]
 54%|█████▍    | 20561/37963 [46:35:47<39:24:37,  8.15s/it]
 54%|█████▍    | 20562/37963 [46:35:55<39:03:24,  8.08s/it]
 54%|█████▍    | 20563/37963 [46:36:03<38:14:52,  7.91s/it]
 54%|█████▍    | 20564/37963 [46:36:11<37:52:22,  7.84s/it]
 54%|█████▍    | 20565/37963 [46:36:18<37:32:28,  7.77s/it]
 54%|█████▍    | 20566/37963 [46:36:26<37:48:23,  7.82s/it]
 54%|█████▍    | 20567/37963 [46:36:33<37:00:43,  7.66s/it]
 54%|█████▍    | 20568/37963 [46:36:41<37:02:37,  7.67s/it]
 54%|█████▍    | 20569/37963 [46:36:49<36:57:12,  7.65s/it]
 54%|█████▍    | 20570/37963 [46:36:56<36:58:56,  7.65s/it]
                                                           
{'loss': '0.1466', 'grad_norm': '1.855', 'learning_rate': '9.133e-06', 'epoch': '0.5418'}
+
 54%|█████▍    | 20570/37963 [46:36:56<36:58:56,  7.65s/it]
 54%|█████▍    | 20571/37963 [46:37:04<37:16:38,  7.72s/it]
 54%|█████▍    | 20572/37963 [46:37:12<37:20:06,  7.73s/it]
 54%|█████▍    | 20573/37963 [46:37:20<37:25:59,  7.75s/it]
 54%|█████▍    | 20574/37963 [46:37:28<37:34:20,  7.78s/it]
 54%|█████▍    | 20575/37963 [46:37:35<37:42:28,  7.81s/it]
 54%|█████▍    | 20576/37963 [46:37:43<37:47:52,  7.83s/it]
 54%|█████▍    | 20577/37963 [46:37:51<37:10:57,  7.70s/it]
 54%|█████▍    | 20578/37963 [46:37:59<37:36:36,  7.79s/it]
 54%|█████▍    | 20579/37963 [46:38:06<37:28:05,  7.76s/it]
 54%|█████▍    | 20580/37963 [46:38:14<37:24:51,  7.75s/it]
                                                           
{'loss': '0.1525', 'grad_norm': '2.809', 'learning_rate': '9.124e-06', 'epoch': '0.5421'}
+
 54%|█████▍    | 20580/37963 [46:38:14<37:24:51,  7.75s/it]
 54%|█████▍    | 20581/37963 [46:38:22<36:55:44,  7.65s/it]
 54%|█████▍    | 20582/37963 [46:38:29<36:22:22,  7.53s/it]
 54%|█████▍    | 20583/37963 [46:38:39<40:54:21,  8.47s/it]
 54%|█████▍    | 20584/37963 [46:38:47<40:01:13,  8.29s/it]
 54%|█████▍    | 20585/37963 [46:38:55<39:00:32,  8.08s/it]
 54%|█████▍    | 20586/37963 [46:39:03<38:41:59,  8.02s/it]
 54%|█████▍    | 20587/37963 [46:39:13<42:00:16,  8.70s/it]
 54%|█████▍    | 20588/37963 [46:39:21<40:38:57,  8.42s/it]
 54%|█████▍    | 20589/37963 [46:39:29<39:57:21,  8.28s/it]
 54%|█████▍    | 20590/37963 [46:39:36<38:57:18,  8.07s/it]
                                                           
{'loss': '0.1625', 'grad_norm': '1.02', 'learning_rate': '9.116e-06', 'epoch': '0.5424'}
+
 54%|█████▍    | 20590/37963 [46:39:36<38:57:18,  8.07s/it]
 54%|█████▍    | 20591/37963 [46:39:47<42:02:46,  8.71s/it]
 54%|█████▍    | 20592/37963 [46:39:57<44:27:15,  9.21s/it]
 54%|█████▍    | 20593/37963 [46:40:05<42:11:57,  8.75s/it]
 54%|█████▍    | 20594/37963 [46:40:12<40:36:38,  8.42s/it]
 54%|█████▍    | 20595/37963 [46:40:20<39:34:21,  8.20s/it]
 54%|█████▍    | 20596/37963 [46:40:28<38:33:10,  7.99s/it]
 54%|█████▍    | 20597/37963 [46:40:35<38:03:39,  7.89s/it]
 54%|█████▍    | 20598/37963 [46:40:46<41:35:26,  8.62s/it]
 54%|█████▍    | 20599/37963 [46:40:56<44:34:07,  9.24s/it]
 54%|█████▍    | 20600/37963 [46:41:07<46:30:51,  9.64s/it]
                                                           
{'loss': '0.1547', 'grad_norm': '1.439', 'learning_rate': '9.107e-06', 'epoch': '0.5426'}
+
 54%|█████▍    | 20600/37963 [46:41:07<46:30:51,  9.64s/it]
 54%|█████▍    | 20601/37963 [46:41:15<43:46:38,  9.08s/it]
 54%|█████▍    | 20602/37963 [46:41:22<41:46:28,  8.66s/it]
 54%|█████▍    | 20603/37963 [46:41:30<40:29:13,  8.40s/it]
 54%|█████▍    | 20604/37963 [46:41:38<39:50:02,  8.26s/it]
 54%|█████▍    | 20605/37963 [46:41:46<39:03:41,  8.10s/it]
 54%|█████▍    | 20606/37963 [46:41:56<42:06:20,  8.73s/it]
 54%|█████▍    | 20607/37963 [46:42:04<41:29:01,  8.60s/it]
 54%|█████▍    | 20608/37963 [46:42:12<40:06:40,  8.32s/it]
 54%|█████▍    | 20609/37963 [46:42:20<39:15:21,  8.14s/it]
 54%|█████▍    | 20610/37963 [46:42:27<38:28:58,  7.98s/it]
                                                           
{'loss': '0.1506', 'grad_norm': '1.796', 'learning_rate': '9.099e-06', 'epoch': '0.5429'}
+
 54%|█████▍    | 20610/37963 [46:42:27<38:28:58,  7.98s/it]
 54%|█████▍    | 20611/37963 [46:42:35<38:19:55,  7.95s/it]
 54%|█████▍    | 20612/37963 [46:42:43<37:49:58,  7.85s/it]
 54%|█████▍    | 20613/37963 [46:42:51<37:52:02,  7.86s/it]
 54%|█████▍    | 20614/37963 [46:42:58<37:36:26,  7.80s/it]
 54%|█████▍    | 20615/37963 [46:43:06<36:58:29,  7.67s/it]
 54%|█████▍    | 20616/37963 [46:43:13<37:17:49,  7.74s/it]
 54%|█████▍    | 20617/37963 [46:43:21<37:11:34,  7.72s/it]
 54%|█████▍    | 20618/37963 [46:43:29<37:14:54,  7.73s/it]
 54%|█████▍    | 20619/37963 [46:43:37<37:23:02,  7.76s/it]
 54%|█████▍    | 20620/37963 [46:43:44<37:20:53,  7.75s/it]
                                                           
{'loss': '0.1506', 'grad_norm': '2.977', 'learning_rate': '9.09e-06', 'epoch': '0.5432'}
+
 54%|█████▍    | 20620/37963 [46:43:44<37:20:53,  7.75s/it]
 54%|█████▍    | 20621/37963 [46:43:52<37:30:03,  7.78s/it]
 54%|█████▍    | 20622/37963 [46:44:00<37:03:31,  7.69s/it]
 54%|█████▍    | 20623/37963 [46:44:08<37:14:27,  7.73s/it]
 54%|█████▍    | 20624/37963 [46:44:15<36:53:34,  7.66s/it]
 54%|█████▍    | 20625/37963 [46:44:23<36:58:42,  7.68s/it]
 54%|█████▍    | 20626/37963 [46:44:30<36:52:08,  7.66s/it]
 54%|█████▍    | 20627/37963 [46:44:38<37:01:52,  7.69s/it]
 54%|█████▍    | 20628/37963 [46:44:46<37:03:58,  7.70s/it]
 54%|█████▍    | 20629/37963 [46:44:56<41:09:01,  8.55s/it]
 54%|█████▍    | 20630/37963 [46:45:04<40:05:00,  8.33s/it]
                                                           
{'loss': '0.1566', 'grad_norm': '2.954', 'learning_rate': '9.082e-06', 'epoch': '0.5434'}
+
 54%|█████▍    | 20630/37963 [46:45:04<40:05:00,  8.33s/it]
 54%|█████▍    | 20631/37963 [46:45:12<38:57:27,  8.09s/it]
 54%|█████▍    | 20632/37963 [46:45:20<38:41:59,  8.04s/it]
 54%|█████▍    | 20633/37963 [46:45:27<37:51:14,  7.86s/it]
 54%|█████▍    | 20634/37963 [46:45:35<37:54:40,  7.88s/it]
 54%|█████▍    | 20635/37963 [46:45:43<37:45:48,  7.85s/it]
 54%|█████▍    | 20636/37963 [46:45:54<41:47:11,  8.68s/it]
 54%|█████▍    | 20637/37963 [46:46:04<44:02:58,  9.15s/it]
 54%|█████▍    | 20638/37963 [46:46:11<41:33:19,  8.63s/it]
 54%|█████▍    | 20639/37963 [46:46:19<40:12:29,  8.36s/it]
 54%|█████▍    | 20640/37963 [46:46:26<39:06:47,  8.13s/it]
                                                           
{'loss': '0.1522', 'grad_norm': '1.814', 'learning_rate': '9.073e-06', 'epoch': '0.5437'}
+
 54%|█████▍    | 20640/37963 [46:46:26<39:06:47,  8.13s/it]
 54%|█████▍    | 20641/37963 [46:46:37<42:08:43,  8.76s/it]
 54%|█████▍    | 20642/37963 [46:46:45<40:59:31,  8.52s/it]
 54%|█████▍    | 20643/37963 [46:46:52<39:46:06,  8.27s/it]
 54%|█████▍    | 20644/37963 [46:47:03<42:59:38,  8.94s/it]
 54%|█████▍    | 20645/37963 [46:47:11<41:30:24,  8.63s/it]
 54%|█████▍    | 20646/37963 [46:47:19<40:31:44,  8.43s/it]
 54%|█████▍    | 20647/37963 [46:47:29<43:18:46,  9.00s/it]
 54%|█████▍    | 20648/37963 [46:47:37<41:14:03,  8.57s/it]
 54%|█████▍    | 20649/37963 [46:47:44<39:35:40,  8.23s/it]
 54%|█████▍    | 20650/37963 [46:47:52<38:57:26,  8.10s/it]
                                                           
{'loss': '0.1371', 'grad_norm': '1.415', 'learning_rate': '9.065e-06', 'epoch': '0.544'}
+
 54%|█████▍    | 20650/37963 [46:47:52<38:57:26,  8.10s/it]
 54%|█████▍    | 20651/37963 [46:47:59<38:11:19,  7.94s/it]
 54%|█████▍    | 20652/37963 [46:48:10<41:27:53,  8.62s/it]
 54%|█████▍    | 20653/37963 [46:48:18<40:28:11,  8.42s/it]
 54%|█████▍    | 20654/37963 [46:48:25<39:35:44,  8.24s/it]
 54%|█████▍    | 20655/37963 [46:48:36<42:34:55,  8.86s/it]
 54%|█████▍    | 20656/37963 [46:48:43<40:55:59,  8.51s/it]
 54%|█████▍    | 20657/37963 [46:48:51<39:04:04,  8.13s/it]
 54%|█████▍    | 20658/37963 [46:48:58<38:26:07,  8.00s/it]
 54%|█████▍    | 20659/37963 [46:49:06<38:02:35,  7.91s/it]
 54%|█████▍    | 20660/37963 [46:49:14<37:41:33,  7.84s/it]
                                                           
{'loss': '0.1584', 'grad_norm': '1.782', 'learning_rate': '9.056e-06', 'epoch': '0.5442'}
+
 54%|█████▍    | 20660/37963 [46:49:14<37:41:33,  7.84s/it]
 54%|█████▍    | 20661/37963 [46:49:21<37:28:58,  7.80s/it]
 54%|█████▍    | 20662/37963 [46:49:29<36:38:21,  7.62s/it]
 54%|█████▍    | 20663/37963 [46:49:37<37:09:24,  7.73s/it]
 54%|█████▍    | 20664/37963 [46:49:44<37:10:57,  7.74s/it]
 54%|█████▍    | 20665/37963 [46:49:52<37:05:39,  7.72s/it]
 54%|█████▍    | 20666/37963 [46:50:00<37:00:33,  7.70s/it]
 54%|█████▍    | 20667/37963 [46:50:07<36:57:08,  7.69s/it]
 54%|█████▍    | 20668/37963 [46:50:15<37:02:56,  7.71s/it]
 54%|█████▍    | 20669/37963 [46:50:23<36:36:25,  7.62s/it]
 54%|█████▍    | 20670/37963 [46:50:30<36:53:10,  7.68s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '3.418', 'learning_rate': '9.048e-06', 'epoch': '0.5445'}
+
 54%|█████▍    | 20670/37963 [46:50:30<36:53:10,  7.68s/it]
 54%|█████▍    | 20671/37963 [46:50:38<37:14:04,  7.75s/it]
 54%|█████▍    | 20672/37963 [46:50:46<36:55:48,  7.69s/it]
 54%|█████▍    | 20673/37963 [46:50:53<36:40:21,  7.64s/it]
 54%|█████▍    | 20674/37963 [46:51:01<36:50:00,  7.67s/it]
 54%|█████▍    | 20675/37963 [46:51:11<40:42:38,  8.48s/it]
 54%|█████▍    | 20676/37963 [46:51:19<39:14:25,  8.17s/it]
 54%|█████▍    | 20677/37963 [46:51:27<39:00:31,  8.12s/it]
 54%|█████▍    | 20678/37963 [46:51:35<38:25:47,  8.00s/it]
 54%|█████▍    | 20679/37963 [46:51:45<41:47:53,  8.71s/it]
 54%|█████▍    | 20680/37963 [46:51:53<40:14:34,  8.38s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '1.055', 'learning_rate': '9.039e-06', 'epoch': '0.5447'}
+
 54%|█████▍    | 20680/37963 [46:51:53<40:14:34,  8.38s/it]
 54%|█████▍    | 20681/37963 [46:52:00<39:20:07,  8.19s/it]
 54%|█████▍    | 20682/37963 [46:52:08<38:42:10,  8.06s/it]
 54%|█████▍    | 20683/37963 [46:52:16<38:33:07,  8.03s/it]
 54%|█████▍    | 20684/37963 [46:52:24<38:18:23,  7.98s/it]
 54%|█████▍    | 20685/37963 [46:52:34<41:29:29,  8.65s/it]
 54%|█████▍    | 20686/37963 [46:52:42<39:51:28,  8.31s/it]
 54%|█████▍    | 20687/37963 [46:52:52<43:08:53,  8.99s/it]
 54%|█████▍    | 20688/37963 [46:53:00<41:22:13,  8.62s/it]
 54%|█████▍    | 20689/37963 [46:53:08<40:11:18,  8.38s/it]
 55%|█████▍    | 20690/37963 [46:53:15<39:07:39,  8.15s/it]
                                                           
{'loss': '0.1452', 'grad_norm': '2.536', 'learning_rate': '9.031e-06', 'epoch': '0.545'}
+
 55%|█████▍    | 20690/37963 [46:53:15<39:07:39,  8.15s/it]
 55%|█████▍    | 20691/37963 [46:53:26<42:09:05,  8.79s/it]
 55%|█████▍    | 20692/37963 [46:53:33<40:03:43,  8.35s/it]
 55%|█████▍    | 20693/37963 [46:53:41<39:08:04,  8.16s/it]
 55%|█████▍    | 20694/37963 [46:53:49<38:39:21,  8.06s/it]
 55%|█████▍    | 20695/37963 [46:53:59<41:48:15,  8.72s/it]
 55%|█████▍    | 20696/37963 [46:54:07<40:32:31,  8.45s/it]
 55%|█████▍    | 20697/37963 [46:54:14<39:16:22,  8.19s/it]
 55%|█████▍    | 20698/37963 [46:54:22<38:20:28,  7.99s/it]
 55%|█████▍    | 20699/37963 [46:54:32<41:29:26,  8.65s/it]
 55%|█████▍    | 20700/37963 [46:54:39<39:49:27,  8.30s/it]
                                                           
{'loss': '0.1452', 'grad_norm': '1.598', 'learning_rate': '9.022e-06', 'epoch': '0.5453'}
+
 55%|█████▍    | 20700/37963 [46:54:39<39:49:27,  8.30s/it]
 55%|█████▍    | 20701/37963 [46:54:47<38:49:59,  8.10s/it]
 55%|█████▍    | 20702/37963 [46:54:54<37:48:49,  7.89s/it]
 55%|█████▍    | 20703/37963 [46:55:02<37:31:15,  7.83s/it]
 55%|█████▍    | 20704/37963 [46:55:10<37:25:33,  7.81s/it]
 55%|█████▍    | 20705/37963 [46:55:18<37:12:34,  7.76s/it]
 55%|█████▍    | 20706/37963 [46:55:28<40:50:16,  8.52s/it]
 55%|█████▍    | 20707/37963 [46:55:36<39:54:58,  8.33s/it]
 55%|█████▍    | 20708/37963 [46:55:43<38:56:06,  8.12s/it]
 55%|█████▍    | 20709/37963 [46:55:51<38:26:24,  8.02s/it]
 55%|█████▍    | 20710/37963 [46:55:59<38:10:48,  7.97s/it]
                                                           
{'loss': '0.151', 'grad_norm': '1.095', 'learning_rate': '9.014e-06', 'epoch': '0.5455'}
+
 55%|█████▍    | 20710/37963 [46:55:59<38:10:48,  7.97s/it]
 55%|█████▍    | 20711/37963 [46:56:07<37:36:39,  7.85s/it]
 55%|█████▍    | 20712/37963 [46:56:14<37:16:09,  7.78s/it]
 55%|█████▍    | 20713/37963 [46:56:22<37:02:24,  7.73s/it]
 55%|█████▍    | 20714/37963 [46:56:29<36:54:57,  7.70s/it]
 55%|█████▍    | 20715/37963 [46:56:37<36:25:46,  7.60s/it]
 55%|█████▍    | 20716/37963 [46:56:45<36:52:41,  7.70s/it]
 55%|█████▍    | 20717/37963 [46:56:53<37:05:16,  7.74s/it]
 55%|█████▍    | 20718/37963 [46:57:03<40:51:18,  8.53s/it]
 55%|█████▍    | 20719/37963 [46:57:11<39:30:28,  8.25s/it]
 55%|█████▍    | 20720/37963 [46:57:18<38:51:51,  8.11s/it]
                                                           
{'loss': '0.1514', 'grad_norm': '2.723', 'learning_rate': '9.005e-06', 'epoch': '0.5458'}
+
 55%|█████▍    | 20720/37963 [46:57:18<38:51:51,  8.11s/it]
 55%|█████▍    | 20721/37963 [46:57:26<37:45:44,  7.88s/it]
 55%|█████▍    | 20722/37963 [46:57:34<37:41:28,  7.87s/it]
 55%|█████▍    | 20723/37963 [46:57:41<37:25:51,  7.82s/it]
 55%|█████▍    | 20724/37963 [46:57:49<37:31:29,  7.84s/it]
 55%|█████▍    | 20725/37963 [46:57:57<37:09:14,  7.76s/it]
 55%|█████▍    | 20726/37963 [46:58:04<36:50:54,  7.70s/it]
 55%|█████▍    | 20727/37963 [46:58:12<36:57:20,  7.72s/it]
 55%|█████▍    | 20728/37963 [46:58:20<37:05:29,  7.75s/it]
 55%|█████▍    | 20729/37963 [46:58:27<36:50:20,  7.70s/it]
 55%|█████▍    | 20730/37963 [46:58:35<36:46:39,  7.68s/it]
                                                           
{'loss': '0.1521', 'grad_norm': '1.353', 'learning_rate': '8.997e-06', 'epoch': '0.5461'}
+
 55%|█████▍    | 20730/37963 [46:58:35<36:46:39,  7.68s/it]
 55%|█████▍    | 20731/37963 [46:58:46<40:45:11,  8.51s/it]
 55%|█████▍    | 20732/37963 [46:58:53<39:35:07,  8.27s/it]
 55%|█████▍    | 20733/37963 [46:59:04<43:18:47,  9.05s/it]
 55%|█████▍    | 20734/37963 [46:59:12<41:40:40,  8.71s/it]
 55%|█████▍    | 20735/37963 [46:59:20<40:08:08,  8.39s/it]
 55%|█████▍    | 20736/37963 [46:59:27<39:10:35,  8.19s/it]
 55%|█████▍    | 20737/37963 [46:59:35<38:19:22,  8.01s/it]
 55%|█████▍    | 20738/37963 [46:59:43<37:57:41,  7.93s/it]
 55%|█████▍    | 20739/37963 [46:59:56<45:16:59,  9.46s/it]
 55%|█████▍    | 20740/37963 [47:00:03<42:32:07,  8.89s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '2.692', 'learning_rate': '8.988e-06', 'epoch': '0.5463'}
+
 55%|█████▍    | 20740/37963 [47:00:03<42:32:07,  8.89s/it]
 55%|█████▍    | 20741/37963 [47:00:11<40:58:55,  8.57s/it]
 55%|█████▍    | 20742/37963 [47:00:22<43:41:07,  9.13s/it]
 55%|█████▍    | 20743/37963 [47:00:29<41:53:49,  8.76s/it]
 55%|█████▍    | 20744/37963 [47:00:37<40:37:27,  8.49s/it]
 55%|█████▍    | 20745/37963 [47:00:45<39:17:47,  8.22s/it]
 55%|█████▍    | 20746/37963 [47:00:53<38:40:02,  8.09s/it]
 55%|█████▍    | 20747/37963 [47:01:00<38:12:12,  7.99s/it]
 55%|█████▍    | 20748/37963 [47:01:08<37:30:10,  7.84s/it]
 55%|█████▍    | 20749/37963 [47:01:18<41:04:57,  8.59s/it]
 55%|█████▍    | 20750/37963 [47:01:26<40:04:22,  8.38s/it]
                                                           
{'loss': '0.1621', 'grad_norm': '1.572', 'learning_rate': '8.98e-06', 'epoch': '0.5466'}
+
 55%|█████▍    | 20750/37963 [47:01:26<40:04:22,  8.38s/it]
 55%|█████▍    | 20751/37963 [47:01:34<39:21:35,  8.23s/it]
 55%|█████▍    | 20752/37963 [47:01:42<38:58:14,  8.15s/it]
 55%|█████▍    | 20753/37963 [47:01:49<38:01:49,  7.96s/it]
 55%|█████▍    | 20754/37963 [47:02:00<41:13:41,  8.62s/it]
 55%|█████▍    | 20755/37963 [47:02:07<39:42:46,  8.31s/it]
 55%|█████▍    | 20756/37963 [47:02:15<38:49:59,  8.12s/it]
 55%|█████▍    | 20757/37963 [47:02:22<37:57:49,  7.94s/it]
 55%|█████▍    | 20758/37963 [47:02:30<37:39:16,  7.88s/it]
 55%|█████▍    | 20759/37963 [47:02:38<37:34:55,  7.86s/it]
 55%|█████▍    | 20760/37963 [47:02:46<37:34:46,  7.86s/it]
                                                           
{'loss': '0.1481', 'grad_norm': '2.221', 'learning_rate': '8.971e-06', 'epoch': '0.5469'}
+
 55%|█████▍    | 20760/37963 [47:02:46<37:34:46,  7.86s/it]
 55%|█████▍    | 20761/37963 [47:02:54<37:27:30,  7.84s/it]
 55%|█████▍    | 20762/37963 [47:03:04<41:23:48,  8.66s/it]
 55%|█████▍    | 20763/37963 [47:03:12<40:04:06,  8.39s/it]
 55%|█████▍    | 20764/37963 [47:03:20<39:05:55,  8.18s/it]
 55%|█████▍    | 20765/37963 [47:03:28<38:34:04,  8.07s/it]
 55%|█████▍    | 20766/37963 [47:03:35<38:09:40,  7.99s/it]
 55%|█████▍    | 20767/37963 [47:03:43<37:17:08,  7.81s/it]
 55%|█████▍    | 20768/37963 [47:03:50<37:04:55,  7.76s/it]
 55%|█████▍    | 20769/37963 [47:03:58<36:58:12,  7.74s/it]
 55%|█████▍    | 20770/37963 [47:04:06<37:08:51,  7.78s/it]
                                                           
{'loss': '0.1487', 'grad_norm': '1.707', 'learning_rate': '8.963e-06', 'epoch': '0.5471'}
+
 55%|█████▍    | 20770/37963 [47:04:06<37:08:51,  7.78s/it]
 55%|█████▍    | 20771/37963 [47:04:14<37:06:31,  7.77s/it]
 55%|█████▍    | 20772/37963 [47:04:21<36:40:44,  7.68s/it]
 55%|█████▍    | 20773/37963 [47:04:29<36:31:18,  7.65s/it]
 55%|█████▍    | 20774/37963 [47:04:36<36:37:21,  7.67s/it]
 55%|█████▍    | 20775/37963 [47:04:47<41:12:59,  8.63s/it]
 55%|█████▍    | 20776/37963 [47:04:55<39:51:46,  8.35s/it]
 55%|█████▍    | 20777/37963 [47:05:03<39:13:34,  8.22s/it]
 55%|█████▍    | 20778/37963 [47:05:11<38:28:38,  8.06s/it]
 55%|█████▍    | 20779/37963 [47:05:19<38:18:54,  8.03s/it]
 55%|█████▍    | 20780/37963 [47:05:27<38:17:42,  8.02s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '1.82', 'learning_rate': '8.954e-06', 'epoch': '0.5474'}
+
 55%|█████▍    | 20780/37963 [47:05:27<38:17:42,  8.02s/it]
 55%|█████▍    | 20781/37963 [47:05:34<37:54:51,  7.94s/it]
 55%|█████▍    | 20782/37963 [47:05:42<37:45:02,  7.91s/it]
 55%|█████▍    | 20783/37963 [47:05:50<37:26:30,  7.85s/it]
 55%|█████▍    | 20784/37963 [47:05:58<37:38:51,  7.89s/it]
 55%|█████▍    | 20785/37963 [47:06:08<41:21:52,  8.67s/it]
 55%|█████▍    | 20786/37963 [47:06:18<43:29:30,  9.12s/it]
 55%|█████▍    | 20787/37963 [47:06:31<49:00:59, 10.27s/it]
 55%|█████▍    | 20788/37963 [47:06:39<45:34:27,  9.55s/it]
 55%|█████▍    | 20789/37963 [47:06:47<42:55:52,  9.00s/it]
 55%|█████▍    | 20790/37963 [47:06:55<41:20:15,  8.67s/it]
                                                           
{'loss': '0.1591', 'grad_norm': '1.496', 'learning_rate': '8.946e-06', 'epoch': '0.5476'}
+
 55%|█████▍    | 20790/37963 [47:06:55<41:20:15,  8.67s/it]
 55%|█████▍    | 20791/37963 [47:07:03<40:24:50,  8.47s/it]
 55%|█████▍    | 20792/37963 [47:07:11<39:19:38,  8.25s/it]
 55%|█████▍    | 20793/37963 [47:07:18<38:32:30,  8.08s/it]
 55%|█████▍    | 20794/37963 [47:07:26<38:09:25,  8.00s/it]
 55%|█████▍    | 20795/37963 [47:07:34<37:37:54,  7.89s/it]
 55%|█████▍    | 20796/37963 [47:07:41<37:19:32,  7.83s/it]
 55%|█████▍    | 20797/37963 [47:07:49<37:27:50,  7.86s/it]
 55%|█████▍    | 20798/37963 [47:07:57<37:15:10,  7.81s/it]
 55%|█████▍    | 20799/37963 [47:08:05<36:45:39,  7.71s/it]
 55%|█████▍    | 20800/37963 [47:08:12<36:41:18,  7.70s/it]
                                                           
{'loss': '0.1548', 'grad_norm': '4.092', 'learning_rate': '8.937e-06', 'epoch': '0.5479'}
+
 55%|█████▍    | 20800/37963 [47:08:12<36:41:18,  7.70s/it]
 55%|█████▍    | 20801/37963 [47:08:20<36:13:58,  7.60s/it]
 55%|█████▍    | 20802/37963 [47:08:30<39:58:41,  8.39s/it]
 55%|█████▍    | 20803/37963 [47:08:40<42:47:22,  8.98s/it]
 55%|█████▍    | 20804/37963 [47:08:48<40:59:00,  8.60s/it]
 55%|█████▍    | 20805/37963 [47:08:56<40:00:20,  8.39s/it]
 55%|█████▍    | 20806/37963 [47:09:06<43:11:27,  9.06s/it]
 55%|█████▍    | 20807/37963 [47:09:14<41:17:04,  8.66s/it]
 55%|█████▍    | 20808/37963 [47:09:22<40:02:32,  8.40s/it]
 55%|█████▍    | 20809/37963 [47:09:30<39:30:40,  8.29s/it]
 55%|█████▍    | 20810/37963 [47:09:38<38:33:54,  8.09s/it]
                                                           
{'loss': '0.1305', 'grad_norm': '1.378', 'learning_rate': '8.929e-06', 'epoch': '0.5482'}
+
 55%|█████▍    | 20810/37963 [47:09:38<38:33:54,  8.09s/it]
 55%|█████▍    | 20811/37963 [47:09:46<38:14:44,  8.03s/it]
 55%|█████▍    | 20812/37963 [47:09:53<37:46:39,  7.93s/it]
 55%|█████▍    | 20813/37963 [47:10:01<37:36:15,  7.89s/it]
 55%|█████▍    | 20814/37963 [47:10:09<37:24:35,  7.85s/it]
 55%|█████▍    | 20815/37963 [47:10:17<37:10:55,  7.81s/it]
 55%|█████▍    | 20816/37963 [47:10:24<37:01:37,  7.77s/it]
 55%|█████▍    | 20817/37963 [47:10:32<37:02:27,  7.78s/it]
 55%|█████▍    | 20818/37963 [47:10:39<36:31:47,  7.67s/it]
 55%|█████▍    | 20819/37963 [47:10:47<36:25:58,  7.65s/it]
 55%|█████▍    | 20820/37963 [47:10:54<35:50:42,  7.53s/it]
                                                           
{'loss': '0.1396', 'grad_norm': '1.411', 'learning_rate': '8.92e-06', 'epoch': '0.5484'}
+
 55%|█████▍    | 20820/37963 [47:10:54<35:50:42,  7.53s/it]
 55%|█████▍    | 20821/37963 [47:11:02<36:12:05,  7.60s/it]
 55%|█████▍    | 20822/37963 [47:11:10<36:16:58,  7.62s/it]
 55%|█████▍    | 20823/37963 [47:11:20<40:24:38,  8.49s/it]
 55%|█████▍    | 20824/37963 [47:11:28<39:40:52,  8.33s/it]
 55%|█████▍    | 20825/37963 [47:11:36<38:49:10,  8.15s/it]
 55%|█████▍    | 20826/37963 [47:11:44<38:24:11,  8.07s/it]
 55%|█████▍    | 20827/37963 [47:11:51<37:45:47,  7.93s/it]
 55%|█████▍    | 20828/37963 [47:11:59<37:17:41,  7.84s/it]
 55%|█████▍    | 20829/37963 [47:12:07<37:18:01,  7.84s/it]
 55%|█████▍    | 20830/37963 [47:12:17<40:47:06,  8.57s/it]
                                                           
{'loss': '0.1546', 'grad_norm': '1.586', 'learning_rate': '8.912e-06', 'epoch': '0.5487'}
+
 55%|█████▍    | 20830/37963 [47:12:17<40:47:06,  8.57s/it]
 55%|█████▍    | 20831/37963 [47:12:25<39:33:58,  8.31s/it]
 55%|█████▍    | 20832/37963 [47:12:33<38:43:16,  8.14s/it]
 55%|█████▍    | 20833/37963 [47:12:40<37:59:20,  7.98s/it]
 55%|█████▍    | 20834/37963 [47:12:48<37:33:20,  7.89s/it]
 55%|█████▍    | 20835/37963 [47:13:04<48:53:20, 10.28s/it]
 55%|█████▍    | 20836/37963 [47:13:12<45:32:25,  9.57s/it]
 55%|█████▍    | 20837/37963 [47:13:19<42:26:57,  8.92s/it]
 55%|█████▍    | 20838/37963 [47:13:27<40:53:28,  8.60s/it]
 55%|█████▍    | 20839/37963 [47:13:35<40:04:48,  8.43s/it]
 55%|█████▍    | 20840/37963 [47:13:43<38:55:50,  8.18s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '1.154', 'learning_rate': '8.903e-06', 'epoch': '0.549'}
+
 55%|█████▍    | 20840/37963 [47:13:43<38:55:50,  8.18s/it]
 55%|█████▍    | 20841/37963 [47:13:50<37:47:57,  7.95s/it]
 55%|█████▍    | 20842/37963 [47:13:58<37:18:38,  7.85s/it]
 55%|█████▍    | 20843/37963 [47:14:05<37:26:12,  7.87s/it]
 55%|█████▍    | 20844/37963 [47:14:13<37:09:02,  7.81s/it]
 55%|█████▍    | 20845/37963 [47:14:21<37:05:46,  7.80s/it]
 55%|█████▍    | 20846/37963 [47:14:31<40:52:53,  8.60s/it]
 55%|█████▍    | 20847/37963 [47:14:39<39:54:25,  8.39s/it]
 55%|█████▍    | 20848/37963 [47:14:47<38:58:08,  8.20s/it]
 55%|█████▍    | 20849/37963 [47:14:55<38:23:56,  8.08s/it]
 55%|█████▍    | 20850/37963 [47:15:06<42:07:21,  8.86s/it]
                                                           
{'loss': '0.1552', 'grad_norm': '1.534', 'learning_rate': '8.895e-06', 'epoch': '0.5492'}
+
 55%|█████▍    | 20850/37963 [47:15:06<42:07:21,  8.86s/it]
 55%|█████▍    | 20851/37963 [47:15:13<40:38:03,  8.55s/it]
 55%|█████▍    | 20852/37963 [47:15:21<39:50:50,  8.38s/it]
 55%|█████▍    | 20853/37963 [47:15:29<39:00:18,  8.21s/it]
 55%|█████▍    | 20854/37963 [47:15:37<37:55:34,  7.98s/it]
 55%|█████▍    | 20855/37963 [47:15:44<37:49:30,  7.96s/it]
 55%|█████▍    | 20856/37963 [47:15:52<37:16:16,  7.84s/it]
 55%|█████▍    | 20857/37963 [47:16:02<40:17:51,  8.48s/it]
 55%|█████▍    | 20858/37963 [47:16:10<39:30:03,  8.31s/it]
 55%|█████▍    | 20859/37963 [47:16:18<38:24:51,  8.09s/it]
 55%|█████▍    | 20860/37963 [47:16:25<38:07:05,  8.02s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '2.941', 'learning_rate': '8.886e-06', 'epoch': '0.5495'}
+
 55%|█████▍    | 20860/37963 [47:16:25<38:07:05,  8.02s/it]
 55%|█████▍    | 20861/37963 [47:16:33<37:34:51,  7.91s/it]
 55%|█████▍    | 20862/37963 [47:16:41<37:01:57,  7.80s/it]
 55%|█████▍    | 20863/37963 [47:16:48<36:58:47,  7.79s/it]
 55%|█████▍    | 20864/37963 [47:16:56<36:47:30,  7.75s/it]
 55%|█████▍    | 20865/37963 [47:17:04<36:38:50,  7.72s/it]
 55%|█████▍    | 20866/37963 [47:17:11<36:45:31,  7.74s/it]
 55%|█████▍    | 20867/37963 [47:17:19<36:57:20,  7.78s/it]
 55%|█████▍    | 20868/37963 [47:17:27<36:54:52,  7.77s/it]
 55%|█████▍    | 20869/37963 [47:17:35<37:09:13,  7.82s/it]
 55%|█████▍    | 20870/37963 [47:17:42<36:25:26,  7.67s/it]
                                                           
{'loss': '0.1409', 'grad_norm': '2.565', 'learning_rate': '8.878e-06', 'epoch': '0.5497'}
+
 55%|█████▍    | 20870/37963 [47:17:42<36:25:26,  7.67s/it]
 55%|█████▍    | 20871/37963 [47:17:50<36:36:39,  7.71s/it]
 55%|█████▍    | 20872/37963 [47:17:58<36:30:45,  7.69s/it]
 55%|█████▍    | 20873/37963 [47:18:08<40:19:01,  8.49s/it]
 55%|█████▍    | 20874/37963 [47:18:16<39:14:51,  8.27s/it]
 55%|█████▍    | 20875/37963 [47:18:24<38:29:15,  8.11s/it]
 55%|█████▍    | 20876/37963 [47:18:31<38:02:38,  8.02s/it]
 55%|█████▍    | 20877/37963 [47:18:42<41:41:10,  8.78s/it]
 55%|█████▍    | 20878/37963 [47:18:50<40:24:18,  8.51s/it]
 55%|█████▍    | 20879/37963 [47:18:57<38:53:52,  8.20s/it]
 55%|█████▌    | 20880/37963 [47:19:05<38:20:59,  8.08s/it]
                                                           
{'loss': '0.1486', 'grad_norm': '1.853', 'learning_rate': '8.869e-06', 'epoch': '0.55'}
+
 55%|█████▌    | 20880/37963 [47:19:05<38:20:59,  8.08s/it]
 55%|█████▌    | 20881/37963 [47:19:15<41:33:56,  8.76s/it]
 55%|█████▌    | 20882/37963 [47:19:23<40:29:35,  8.53s/it]
 55%|█████▌    | 20883/37963 [47:19:36<46:44:06,  9.85s/it]
 55%|█████▌    | 20884/37963 [47:19:44<43:59:39,  9.27s/it]
 55%|█████▌    | 20885/37963 [47:19:52<41:36:03,  8.77s/it]
 55%|█████▌    | 20886/37963 [47:19:59<39:44:54,  8.38s/it]
 55%|█████▌    | 20887/37963 [47:20:07<38:59:05,  8.22s/it]
 55%|█████▌    | 20888/37963 [47:20:15<38:23:31,  8.09s/it]
 55%|█████▌    | 20889/37963 [47:20:25<41:15:51,  8.70s/it]
 55%|█████▌    | 20890/37963 [47:20:33<40:18:35,  8.50s/it]
                                                           
{'loss': '0.134', 'grad_norm': '2.842', 'learning_rate': '8.861e-06', 'epoch': '0.5503'}
+
 55%|█████▌    | 20890/37963 [47:20:33<40:18:35,  8.50s/it]
 55%|█████▌    | 20891/37963 [47:20:41<39:13:28,  8.27s/it]
 55%|█████▌    | 20892/37963 [47:20:49<38:22:26,  8.09s/it]
 55%|█████▌    | 20893/37963 [47:20:56<37:51:51,  7.99s/it]
 55%|█████▌    | 20894/37963 [47:21:04<37:25:19,  7.89s/it]
 55%|█████▌    | 20895/37963 [47:21:12<36:55:48,  7.79s/it]
 55%|█████▌    | 20896/37963 [47:21:19<36:48:58,  7.77s/it]
 55%|█████▌    | 20897/37963 [47:21:27<36:40:23,  7.74s/it]
 55%|█████▌    | 20898/37963 [47:21:35<36:30:46,  7.70s/it]
 55%|█████▌    | 20899/37963 [47:21:42<36:28:32,  7.70s/it]
 55%|█████▌    | 20900/37963 [47:21:50<36:34:44,  7.72s/it]
                                                           
{'loss': '0.1483', 'grad_norm': '2.282', 'learning_rate': '8.853e-06', 'epoch': '0.5505'}
+
 55%|█████▌    | 20900/37963 [47:21:50<36:34:44,  7.72s/it]
 55%|█████▌    | 20901/37963 [47:21:58<36:39:22,  7.73s/it]
 55%|█████▌    | 20902/37963 [47:22:06<36:55:13,  7.79s/it]
 55%|█████▌    | 20903/37963 [47:22:16<41:03:01,  8.66s/it]
 55%|█████▌    | 20904/37963 [47:22:24<39:53:22,  8.42s/it]
 55%|█████▌    | 20905/37963 [47:22:32<38:48:49,  8.19s/it]
 55%|█████▌    | 20906/37963 [47:22:40<38:12:08,  8.06s/it]
 55%|█████▌    | 20907/37963 [47:22:47<37:28:22,  7.91s/it]
 55%|█████▌    | 20908/37963 [47:22:55<37:08:53,  7.84s/it]
 55%|█████▌    | 20909/37963 [47:23:03<37:10:32,  7.85s/it]
 55%|█████▌    | 20910/37963 [47:23:10<36:29:09,  7.70s/it]
                                                           
{'loss': '0.1475', 'grad_norm': '3.057', 'learning_rate': '8.844e-06', 'epoch': '0.5508'}
+
 55%|█████▌    | 20910/37963 [47:23:10<36:29:09,  7.70s/it]
 55%|█████▌    | 20911/37963 [47:23:21<40:24:08,  8.53s/it]
 55%|█████▌    | 20912/37963 [47:23:28<39:24:04,  8.32s/it]
 55%|█████▌    | 20913/37963 [47:23:36<38:15:46,  8.08s/it]
 55%|█████▌    | 20914/37963 [47:23:44<37:39:35,  7.95s/it]
 55%|█████▌    | 20915/37963 [47:23:51<36:56:12,  7.80s/it]
 55%|█████▌    | 20916/37963 [47:23:59<37:20:37,  7.89s/it]
 55%|█████▌    | 20917/37963 [47:24:10<41:09:22,  8.69s/it]
 55%|█████▌    | 20918/37963 [47:24:17<39:45:21,  8.40s/it]
 55%|█████▌    | 20919/37963 [47:24:25<38:34:41,  8.15s/it]
 55%|█████▌    | 20920/37963 [47:24:33<37:52:39,  8.00s/it]
                                                           
{'loss': '0.1458', 'grad_norm': '2.038', 'learning_rate': '8.836e-06', 'epoch': '0.5511'}
+
 55%|█████▌    | 20920/37963 [47:24:33<37:52:39,  8.00s/it]
 55%|█████▌    | 20921/37963 [47:24:40<37:35:24,  7.94s/it]
 55%|█████▌    | 20922/37963 [47:24:48<37:24:47,  7.90s/it]
 55%|█████▌    | 20923/37963 [47:24:56<37:27:34,  7.91s/it]
 55%|█████▌    | 20924/37963 [47:25:04<37:09:23,  7.85s/it]
 55%|█████▌    | 20925/37963 [47:25:14<40:42:38,  8.60s/it]
 55%|█████▌    | 20926/37963 [47:25:22<39:22:56,  8.32s/it]
 55%|█████▌    | 20927/37963 [47:25:30<38:39:37,  8.17s/it]
 55%|█████▌    | 20928/37963 [47:25:37<37:30:27,  7.93s/it]
 55%|█████▌    | 20929/37963 [47:25:45<36:54:26,  7.80s/it]
 55%|█████▌    | 20930/37963 [47:25:55<40:09:23,  8.49s/it]
                                                           
{'loss': '0.141', 'grad_norm': '1.267', 'learning_rate': '8.827e-06', 'epoch': '0.5513'}
+
 55%|█████▌    | 20930/37963 [47:25:55<40:09:23,  8.49s/it]
 55%|█████▌    | 20931/37963 [47:26:08<47:03:54,  9.95s/it]
 55%|█████▌    | 20932/37963 [47:26:16<44:03:52,  9.31s/it]
 55%|█████▌    | 20933/37963 [47:26:24<42:00:31,  8.88s/it]
 55%|█████▌    | 20934/37963 [47:26:32<40:30:23,  8.56s/it]
 55%|█████▌    | 20935/37963 [47:26:39<39:32:22,  8.36s/it]
 55%|█████▌    | 20936/37963 [47:26:47<38:39:16,  8.17s/it]
 55%|█████▌    | 20937/37963 [47:26:57<41:24:58,  8.76s/it]
 55%|█████▌    | 20938/37963 [47:27:05<40:09:26,  8.49s/it]
 55%|█████▌    | 20939/37963 [47:27:13<39:03:36,  8.26s/it]
 55%|█████▌    | 20940/37963 [47:27:21<38:19:31,  8.10s/it]
                                                           
{'loss': '0.1382', 'grad_norm': '1.15', 'learning_rate': '8.819e-06', 'epoch': '0.5516'}
+
 55%|█████▌    | 20940/37963 [47:27:21<38:19:31,  8.10s/it]
 55%|█████▌    | 20941/37963 [47:27:28<37:40:14,  7.97s/it]
 55%|█████▌    | 20942/37963 [47:27:36<37:16:24,  7.88s/it]
 55%|█████▌    | 20943/37963 [47:27:44<36:57:04,  7.82s/it]
 55%|█████▌    | 20944/37963 [47:27:51<36:39:40,  7.75s/it]
 55%|█████▌    | 20945/37963 [47:27:59<36:39:01,  7.75s/it]
 55%|█████▌    | 20946/37963 [47:28:07<36:32:24,  7.73s/it]
 55%|█████▌    | 20947/37963 [47:28:17<40:31:02,  8.57s/it]
 55%|█████▌    | 20948/37963 [47:28:25<39:06:28,  8.27s/it]
 55%|█████▌    | 20949/37963 [47:28:32<38:14:24,  8.09s/it]
 55%|█████▌    | 20950/37963 [47:28:40<37:35:58,  7.96s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '2.352', 'learning_rate': '8.81e-06', 'epoch': '0.5519'}
+
 55%|█████▌    | 20950/37963 [47:28:40<37:35:58,  7.96s/it]
 55%|█████▌    | 20951/37963 [47:28:48<37:05:24,  7.85s/it]
 55%|█████▌    | 20952/37963 [47:28:55<36:43:10,  7.77s/it]
 55%|█████▌    | 20953/37963 [47:29:03<36:49:03,  7.79s/it]
 55%|█████▌    | 20954/37963 [47:29:11<36:40:52,  7.76s/it]
 55%|█████▌    | 20955/37963 [47:29:19<36:49:00,  7.79s/it]
 55%|█████▌    | 20956/37963 [47:29:26<36:48:05,  7.79s/it]
 55%|█████▌    | 20957/37963 [47:29:34<36:41:43,  7.77s/it]
 55%|█████▌    | 20958/37963 [47:29:42<36:54:09,  7.81s/it]
 55%|█████▌    | 20959/37963 [47:29:52<40:13:26,  8.52s/it]
 55%|█████▌    | 20960/37963 [47:30:00<39:01:38,  8.26s/it]
                                                           
{'loss': '0.1596', 'grad_norm': '2.676', 'learning_rate': '8.802e-06', 'epoch': '0.5521'}
+
 55%|█████▌    | 20960/37963 [47:30:00<39:01:38,  8.26s/it]
 55%|█████▌    | 20961/37963 [47:30:10<42:09:29,  8.93s/it]
 55%|█████▌    | 20962/37963 [47:30:18<40:10:21,  8.51s/it]
 55%|█████▌    | 20963/37963 [47:30:26<39:15:46,  8.31s/it]
 55%|█████▌    | 20964/37963 [47:30:33<38:23:11,  8.13s/it]
 55%|█████▌    | 20965/37963 [47:30:41<37:36:04,  7.96s/it]
 55%|█████▌    | 20966/37963 [47:30:49<37:17:09,  7.90s/it]
 55%|█████▌    | 20967/37963 [47:30:56<36:56:13,  7.82s/it]
 55%|█████▌    | 20968/37963 [47:31:04<36:27:24,  7.72s/it]
 55%|█████▌    | 20969/37963 [47:31:12<36:21:34,  7.70s/it]
 55%|█████▌    | 20970/37963 [47:31:19<35:55:32,  7.61s/it]
                                                           
{'loss': '0.1437', 'grad_norm': '1.006', 'learning_rate': '8.793e-06', 'epoch': '0.5524'}
+
 55%|█████▌    | 20970/37963 [47:31:19<35:55:32,  7.61s/it]
 55%|█████▌    | 20971/37963 [47:31:29<39:12:09,  8.31s/it]
 55%|█████▌    | 20972/37963 [47:31:37<38:51:09,  8.23s/it]
 55%|█████▌    | 20973/37963 [47:31:45<38:10:59,  8.09s/it]
 55%|█████▌    | 20974/37963 [47:31:53<37:49:16,  8.01s/it]
 55%|█████▌    | 20975/37963 [47:32:03<41:33:55,  8.81s/it]
 55%|█████▌    | 20976/37963 [47:32:11<40:06:43,  8.50s/it]
 55%|█████▌    | 20977/37963 [47:32:19<39:11:31,  8.31s/it]
 55%|█████▌    | 20978/37963 [47:32:30<42:44:06,  9.06s/it]
 55%|█████▌    | 20979/37963 [47:32:40<45:05:10,  9.56s/it]
 55%|█████▌    | 20980/37963 [47:32:48<42:06:05,  8.92s/it]
                                                           
{'loss': '0.1527', 'grad_norm': '3.71', 'learning_rate': '8.785e-06', 'epoch': '0.5526'}
+
 55%|█████▌    | 20980/37963 [47:32:48<42:06:05,  8.92s/it]
 55%|█████▌    | 20981/37963 [47:32:55<40:09:21,  8.51s/it]
 55%|█████▌    | 20982/37963 [47:33:03<39:02:56,  8.28s/it]
 55%|█████▌    | 20983/37963 [47:33:11<38:10:35,  8.09s/it]
 55%|█████▌    | 20984/37963 [47:33:18<37:24:29,  7.93s/it]
 55%|█████▌    | 20985/37963 [47:33:26<36:58:06,  7.84s/it]
 55%|█████▌    | 20986/37963 [47:33:36<40:00:15,  8.48s/it]
 55%|█████▌    | 20987/37963 [47:33:44<39:10:34,  8.31s/it]
 55%|█████▌    | 20988/37963 [47:33:51<38:10:46,  8.10s/it]
 55%|█████▌    | 20989/37963 [47:33:59<37:08:17,  7.88s/it]
 55%|█████▌    | 20990/37963 [47:34:06<36:31:48,  7.75s/it]
                                                           
{'loss': '0.1407', 'grad_norm': '1.56', 'learning_rate': '8.776e-06', 'epoch': '0.5529'}
+
 55%|█████▌    | 20990/37963 [47:34:06<36:31:48,  7.75s/it]
 55%|█████▌    | 20991/37963 [47:34:14<36:26:59,  7.73s/it]
 55%|█████▌    | 20992/37963 [47:34:22<36:20:49,  7.71s/it]
 55%|█████▌    | 20993/37963 [47:34:29<36:11:56,  7.68s/it]
 55%|█████▌    | 20994/37963 [47:34:37<36:10:56,  7.68s/it]
 55%|█████▌    | 20995/37963 [47:34:47<40:07:18,  8.51s/it]
 55%|█████▌    | 20996/37963 [47:34:55<38:59:43,  8.27s/it]
 55%|█████▌    | 20997/37963 [47:35:03<37:54:00,  8.04s/it]
 55%|█████▌    | 20998/37963 [47:35:10<36:45:11,  7.80s/it]
 55%|█████▌    | 20999/37963 [47:35:17<36:12:59,  7.69s/it]
 55%|█████▌    | 21000/37963 [47:35:25<36:13:51,  7.69s/it]
                                                           
{'loss': '0.1495', 'grad_norm': '2.103', 'learning_rate': '8.768e-06', 'epoch': '0.5532'}
+
 55%|█████▌    | 21000/37963 [47:35:25<36:13:51,  7.69s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.80s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.80s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 55%|█████▌    | 21001/37963 [47:36:28<114:24:32, 24.28s/it]
 55%|█████▌    | 21002/37963 [47:36:36<91:23:13, 19.40s/it] 
 55%|█████▌    | 21003/37963 [47:36:49<82:20:39, 17.48s/it]
 55%|█████▌    | 21004/37963 [47:36:57<68:47:12, 14.60s/it]
 55%|█████▌    | 21005/37963 [47:37:05<59:44:45, 12.68s/it]
 55%|█████▌    | 21006/37963 [47:37:13<53:06:30, 11.28s/it]
 55%|█████▌    | 21007/37963 [47:37:21<47:56:46, 10.18s/it]
 55%|█████▌    | 21008/37963 [47:37:29<44:45:07,  9.50s/it]
 55%|█████▌    | 21009/37963 [47:37:37<42:40:50,  9.06s/it]
 55%|█████▌    | 21010/37963 [47:37:44<40:17:13,  8.56s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '2.72', 'learning_rate': '8.759e-06', 'epoch': '0.5534'}
+
 55%|█████▌    | 21010/37963 [47:37:44<40:17:13,  8.56s/it]
 55%|█████▌    | 21011/37963 [47:37:52<38:58:09,  8.28s/it]
 55%|█████▌    | 21012/37963 [47:38:00<38:40:01,  8.21s/it]
 55%|█████▌    | 21013/37963 [47:38:07<37:59:48,  8.07s/it]
 55%|█████▌    | 21014/37963 [47:38:15<37:37:43,  7.99s/it]
 55%|█████▌    | 21015/37963 [47:38:23<37:19:03,  7.93s/it]
 55%|█████▌    | 21016/37963 [47:38:31<37:07:11,  7.89s/it]
 55%|█████▌    | 21017/37963 [47:38:38<36:26:35,  7.74s/it]
 55%|█████▌    | 21018/37963 [47:38:49<40:07:03,  8.52s/it]
 55%|█████▌    | 21019/37963 [47:38:56<39:04:51,  8.30s/it]
 55%|█████▌    | 21020/37963 [47:39:04<38:09:40,  8.11s/it]
                                                           
{'loss': '0.1533', 'grad_norm': '1.474', 'learning_rate': '8.751e-06', 'epoch': '0.5537'}
+
 55%|█████▌    | 21020/37963 [47:39:04<38:09:40,  8.11s/it]
 55%|█████▌    | 21021/37963 [47:39:15<41:39:12,  8.85s/it]
 55%|█████▌    | 21022/37963 [47:39:22<40:19:48,  8.57s/it]
 55%|█████▌    | 21023/37963 [47:39:30<38:45:59,  8.24s/it]
 55%|█████▌    | 21024/37963 [47:39:38<38:02:26,  8.08s/it]
 55%|█████▌    | 21025/37963 [47:39:48<40:57:18,  8.70s/it]
 55%|█████▌    | 21026/37963 [47:39:55<39:20:47,  8.36s/it]
 55%|█████▌    | 21027/37963 [47:40:03<38:17:36,  8.14s/it]
 55%|█████▌    | 21028/37963 [47:40:13<41:17:59,  8.78s/it]
 55%|█████▌    | 21029/37963 [47:40:21<39:40:56,  8.44s/it]
 55%|█████▌    | 21030/37963 [47:40:29<38:33:05,  8.20s/it]
                                                           
{'loss': '0.1535', 'grad_norm': '2.329', 'learning_rate': '8.742e-06', 'epoch': '0.554'}
+
 55%|█████▌    | 21030/37963 [47:40:29<38:33:05,  8.20s/it]
 55%|█████▌    | 21031/37963 [47:40:39<41:47:40,  8.89s/it]
 55%|█████▌    | 21032/37963 [47:40:47<40:25:41,  8.60s/it]
 55%|█████▌    | 21033/37963 [47:40:55<39:10:39,  8.33s/it]
 55%|█████▌    | 21034/37963 [47:41:03<38:37:38,  8.21s/it]
 55%|█████▌    | 21035/37963 [47:41:10<37:16:05,  7.93s/it]
 55%|█████▌    | 21036/37963 [47:41:18<37:19:36,  7.94s/it]
 55%|█████▌    | 21037/37963 [47:41:25<36:47:00,  7.82s/it]
 55%|█████▌    | 21038/37963 [47:41:33<36:39:40,  7.80s/it]
 55%|█████▌    | 21039/37963 [47:41:41<36:23:32,  7.74s/it]
 55%|█████▌    | 21040/37963 [47:41:48<36:15:29,  7.71s/it]
                                                           
{'loss': '0.1596', 'grad_norm': '1.542', 'learning_rate': '8.734e-06', 'epoch': '0.5542'}
+
 55%|█████▌    | 21040/37963 [47:41:48<36:15:29,  7.71s/it]
 55%|█████▌    | 21041/37963 [47:41:56<36:03:25,  7.67s/it]
 55%|█████▌    | 21042/37963 [47:42:04<36:30:39,  7.77s/it]
 55%|█████▌    | 21043/37963 [47:42:12<36:36:34,  7.79s/it]
 55%|█████▌    | 21044/37963 [47:42:20<36:34:48,  7.78s/it]
 55%|█████▌    | 21045/37963 [47:42:27<36:24:02,  7.75s/it]
 55%|█████▌    | 21046/37963 [47:42:35<36:14:25,  7.71s/it]
 55%|█████▌    | 21047/37963 [47:42:46<40:56:55,  8.71s/it]
 55%|█████▌    | 21048/37963 [47:42:53<38:58:43,  8.30s/it]
 55%|█████▌    | 21049/37963 [47:43:01<37:47:03,  8.04s/it]
 55%|█████▌    | 21050/37963 [47:43:08<37:10:15,  7.91s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '1.958', 'learning_rate': '8.725e-06', 'epoch': '0.5545'}
+
 55%|█████▌    | 21050/37963 [47:43:08<37:10:15,  7.91s/it]
 55%|█████▌    | 21051/37963 [47:43:19<40:46:47,  8.68s/it]
 55%|█████▌    | 21052/37963 [47:43:27<39:37:39,  8.44s/it]
 55%|█████▌    | 21053/37963 [47:43:34<38:36:03,  8.22s/it]
 55%|█████▌    | 21054/37963 [47:43:42<37:42:10,  8.03s/it]
 55%|█████▌    | 21055/37963 [47:43:50<37:12:11,  7.92s/it]
 55%|█████▌    | 21056/37963 [47:44:00<40:40:15,  8.66s/it]
 55%|█████▌    | 21057/37963 [47:44:07<38:55:12,  8.29s/it]
 55%|█████▌    | 21058/37963 [47:44:15<38:08:11,  8.12s/it]
 55%|█████▌    | 21059/37963 [47:44:23<37:21:25,  7.96s/it]
 55%|█████▌    | 21060/37963 [47:44:30<36:55:20,  7.86s/it]
                                                           
{'loss': '0.1549', 'grad_norm': '3.181', 'learning_rate': '8.717e-06', 'epoch': '0.5548'}
+
 55%|█████▌    | 21060/37963 [47:44:30<36:55:20,  7.86s/it]
 55%|█████▌    | 21061/37963 [47:44:38<36:46:54,  7.83s/it]
 55%|█████▌    | 21062/37963 [47:44:46<36:36:52,  7.80s/it]
 55%|█████▌    | 21063/37963 [47:44:53<36:23:44,  7.75s/it]
 55%|█████▌    | 21064/37963 [47:45:01<36:36:13,  7.80s/it]
 55%|█████▌    | 21065/37963 [47:45:12<40:21:30,  8.60s/it]
 55%|█████▌    | 21066/37963 [47:45:20<39:17:20,  8.37s/it]
 55%|█████▌    | 21067/37963 [47:45:27<38:06:31,  8.12s/it]
 55%|█████▌    | 21068/37963 [47:45:38<41:17:32,  8.80s/it]
 55%|█████▌    | 21069/37963 [47:45:45<39:43:06,  8.46s/it]
 56%|█████▌    | 21070/37963 [47:45:53<38:55:57,  8.30s/it]
                                                           
{'loss': '0.1431', 'grad_norm': '1.118', 'learning_rate': '8.709e-06', 'epoch': '0.555'}
+
 56%|█████▌    | 21070/37963 [47:45:53<38:55:57,  8.30s/it]
 56%|█████▌    | 21071/37963 [47:46:01<38:23:47,  8.18s/it]
 56%|█████▌    | 21072/37963 [47:46:09<37:37:09,  8.02s/it]
 56%|█████▌    | 21073/37963 [47:46:19<40:39:34,  8.67s/it]
 56%|█████▌    | 21074/37963 [47:46:27<39:08:55,  8.34s/it]
 56%|█████▌    | 21075/37963 [47:46:34<37:49:54,  8.06s/it]
 56%|█████▌    | 21076/37963 [47:46:42<37:20:08,  7.96s/it]
 56%|█████▌    | 21077/37963 [47:46:49<37:07:53,  7.92s/it]
 56%|█████▌    | 21078/37963 [47:46:57<36:46:34,  7.84s/it]
 56%|█████▌    | 21079/37963 [47:47:07<40:03:15,  8.54s/it]
 56%|█████▌    | 21080/37963 [47:47:15<38:51:50,  8.29s/it]
                                                           
{'loss': '0.1301', 'grad_norm': '1.388', 'learning_rate': '8.7e-06', 'epoch': '0.5553'}
+
 56%|█████▌    | 21080/37963 [47:47:15<38:51:50,  8.29s/it]
 56%|█████▌    | 21081/37963 [47:47:23<38:11:42,  8.14s/it]
 56%|█████▌    | 21082/37963 [47:47:33<41:26:32,  8.84s/it]
 56%|█████▌    | 21083/37963 [47:47:41<39:57:15,  8.52s/it]
 56%|█████▌    | 21084/37963 [47:47:49<38:41:50,  8.25s/it]
 56%|█████▌    | 21085/37963 [47:47:57<38:06:41,  8.13s/it]
 56%|█████▌    | 21086/37963 [47:48:04<37:07:26,  7.92s/it]
 56%|█████▌    | 21087/37963 [47:48:11<36:18:51,  7.75s/it]
 56%|█████▌    | 21088/37963 [47:48:19<36:22:57,  7.76s/it]
 56%|█████▌    | 21089/37963 [47:48:27<36:42:48,  7.83s/it]
 56%|█████▌    | 21090/37963 [47:48:35<36:34:13,  7.80s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '1.298', 'learning_rate': '8.692e-06', 'epoch': '0.5555'}
+
 56%|█████▌    | 21090/37963 [47:48:35<36:34:13,  7.80s/it]
 56%|█████▌    | 21091/37963 [47:48:42<36:15:20,  7.74s/it]
 56%|█████▌    | 21092/37963 [47:48:50<36:25:22,  7.77s/it]
 56%|��████▌    | 21093/37963 [47:48:58<36:39:11,  7.82s/it]
 56%|█████▌    | 21094/37963 [47:49:06<36:16:52,  7.74s/it]
 56%|█████▌    | 21095/37963 [47:49:13<36:11:12,  7.72s/it]
 56%|█████▌    | 21096/37963 [47:49:24<39:57:07,  8.53s/it]
 56%|█████▌    | 21097/37963 [47:49:32<38:57:10,  8.31s/it]
 56%|█████▌    | 21098/37963 [47:49:39<37:52:19,  8.08s/it]
 56%|█████▌    | 21099/37963 [47:49:47<37:15:25,  7.95s/it]
 56%|█████▌    | 21100/37963 [47:49:55<36:54:53,  7.88s/it]
                                                           
{'loss': '0.1596', 'grad_norm': '1.402', 'learning_rate': '8.683e-06', 'epoch': '0.5558'}
+
 56%|█████▌    | 21100/37963 [47:49:55<36:54:53,  7.88s/it]
 56%|█████▌    | 21101/37963 [47:50:02<36:56:38,  7.89s/it]
 56%|█████▌    | 21102/37963 [47:50:10<36:55:52,  7.89s/it]
 56%|█████▌    | 21103/37963 [47:50:18<36:57:16,  7.89s/it]
 56%|█████▌    | 21104/37963 [47:50:26<36:33:33,  7.81s/it]
 56%|█████▌    | 21105/37963 [47:50:36<40:12:40,  8.59s/it]
 56%|█████▌    | 21106/37963 [47:50:44<39:03:22,  8.34s/it]
 56%|█████▌    | 21107/37963 [47:50:52<38:30:41,  8.23s/it]
 56%|█████▌    | 21108/37963 [47:51:00<37:48:06,  8.07s/it]
 56%|█████▌    | 21109/37963 [47:51:07<37:15:55,  7.96s/it]
 56%|█████▌    | 21110/37963 [47:51:15<36:49:16,  7.87s/it]
                                                           
{'loss': '0.148', 'grad_norm': '1.674', 'learning_rate': '8.675e-06', 'epoch': '0.5561'}
+
 56%|█████▌    | 21110/37963 [47:51:15<36:49:16,  7.87s/it]
 56%|█████▌    | 21111/37963 [47:51:25<39:54:59,  8.53s/it]
 56%|█████▌    | 21112/37963 [47:51:36<42:38:07,  9.11s/it]
 56%|█████▌    | 21113/37963 [47:51:43<40:40:15,  8.69s/it]
 56%|█████▌    | 21114/37963 [47:51:51<39:26:40,  8.43s/it]
 56%|█████▌    | 21115/37963 [47:51:59<38:18:51,  8.19s/it]
 56%|█████▌    | 21116/37963 [47:52:06<37:25:51,  8.00s/it]
 56%|█████▌    | 21117/37963 [47:52:17<40:37:00,  8.68s/it]
 56%|█████▌    | 21118/37963 [47:52:24<39:20:11,  8.41s/it]
 56%|█████▌    | 21119/37963 [47:52:32<38:15:12,  8.18s/it]
 56%|█████▌    | 21120/37963 [47:52:40<37:30:52,  8.02s/it]
                                                           
{'loss': '0.1524', 'grad_norm': '3.488', 'learning_rate': '8.666e-06', 'epoch': '0.5563'}
+
 56%|█████▌    | 21120/37963 [47:52:40<37:30:52,  8.02s/it]
 56%|█████▌    | 21121/37963 [47:52:47<36:58:12,  7.90s/it]
 56%|█████▌    | 21122/37963 [47:52:57<40:15:46,  8.61s/it]
 56%|█████▌    | 21123/37963 [47:53:05<39:16:28,  8.40s/it]
 56%|█████▌    | 21124/37963 [47:53:13<38:19:36,  8.19s/it]
 56%|█████▌    | 21125/37963 [47:53:21<37:40:21,  8.05s/it]
 56%|█████▌    | 21126/37963 [47:53:31<40:54:24,  8.75s/it]
 56%|█████▌    | 21127/37963 [47:53:39<39:37:14,  8.47s/it]
 56%|█████▌    | 21128/37963 [47:53:47<38:18:12,  8.19s/it]
 56%|█████▌    | 21129/37963 [47:53:54<37:25:15,  8.00s/it]
 56%|█████▌    | 21130/37963 [47:54:02<36:41:56,  7.85s/it]
                                                           
{'loss': '0.1629', 'grad_norm': '2.847', 'learning_rate': '8.658e-06', 'epoch': '0.5566'}
+
 56%|█████▌    | 21130/37963 [47:54:02<36:41:56,  7.85s/it]
 56%|█████▌    | 21131/37963 [47:54:09<36:22:46,  7.78s/it]
 56%|█████▌    | 21132/37963 [47:54:17<35:44:47,  7.65s/it]
 56%|█████▌    | 21133/37963 [47:54:25<36:10:20,  7.74s/it]
 56%|█████▌    | 21134/37963 [47:54:32<35:53:52,  7.68s/it]
 56%|█████▌    | 21135/37963 [47:54:40<35:33:57,  7.61s/it]
 56%|█████▌    | 21136/37963 [47:54:47<35:47:34,  7.66s/it]
 56%|█████▌    | 21137/37963 [47:54:55<35:25:27,  7.58s/it]
 56%|█████▌    | 21138/37963 [47:55:02<35:23:42,  7.57s/it]
 56%|█████▌    | 21139/37963 [47:55:10<35:28:31,  7.59s/it]
 56%|█████▌    | 21140/37963 [47:55:17<35:25:13,  7.58s/it]
                                                           
{'loss': '0.1574', 'grad_norm': '2.722', 'learning_rate': '8.649e-06', 'epoch': '0.5569'}
+
 56%|█████▌    | 21140/37963 [47:55:17<35:25:13,  7.58s/it]
 56%|█████▌    | 21141/37963 [47:55:25<35:33:40,  7.61s/it]
 56%|█████▌    | 21142/37963 [47:55:36<39:49:45,  8.52s/it]
 56%|█████▌    | 21143/37963 [47:55:43<38:38:43,  8.27s/it]
 56%|█████▌    | 21144/37963 [47:55:51<38:03:03,  8.14s/it]
 56%|█████▌    | 21145/37963 [47:55:59<37:12:40,  7.97s/it]
 56%|█████▌    | 21146/37963 [47:56:07<36:56:55,  7.91s/it]
 56%|█████▌    | 21147/37963 [47:56:14<36:32:44,  7.82s/it]
 56%|█████▌    | 21148/37963 [47:56:22<36:36:56,  7.84s/it]
 56%|█████▌    | 21149/37963 [47:56:30<36:37:48,  7.84s/it]
 56%|█████▌    | 21150/37963 [47:56:38<36:33:09,  7.83s/it]
                                                           
{'loss': '0.1467', 'grad_norm': '1.27', 'learning_rate': '8.641e-06', 'epoch': '0.5571'}
+
 56%|█████▌    | 21150/37963 [47:56:38<36:33:09,  7.83s/it]
 56%|█████▌    | 21151/37963 [47:56:46<36:39:55,  7.85s/it]
 56%|█████▌    | 21152/37963 [47:56:53<36:23:46,  7.79s/it]
 56%|█████▌    | 21153/37963 [47:57:01<36:02:06,  7.72s/it]
 56%|█████▌    | 21154/37963 [47:57:11<39:31:59,  8.47s/it]
 56%|█████▌    | 21155/37963 [47:57:19<38:15:11,  8.19s/it]
 56%|█████▌    | 21156/37963 [47:57:27<37:48:43,  8.10s/it]
 56%|█████▌    | 21157/37963 [47:57:34<37:08:36,  7.96s/it]
 56%|█████▌    | 21158/37963 [47:57:42<36:36:55,  7.84s/it]
 56%|█████▌    | 21159/37963 [47:57:52<39:51:59,  8.54s/it]
 56%|█████▌    | 21160/37963 [47:58:00<38:43:44,  8.30s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '2.303', 'learning_rate': '8.632e-06', 'epoch': '0.5574'}
+
 56%|█████▌    | 21160/37963 [47:58:00<38:43:44,  8.30s/it]
 56%|█████▌    | 21161/37963 [47:58:07<37:28:10,  8.03s/it]
 56%|█████▌    | 21162/37963 [47:58:15<37:13:35,  7.98s/it]
 56%|█████▌    | 21163/37963 [47:58:25<40:32:39,  8.69s/it]
 56%|█████▌    | 21164/37963 [47:58:33<39:25:45,  8.45s/it]
 56%|█████▌    | 21165/37963 [47:58:41<38:59:30,  8.36s/it]
 56%|█████▌    | 21166/37963 [47:58:52<42:10:28,  9.04s/it]
 56%|█████▌    | 21167/37963 [47:59:00<40:36:23,  8.70s/it]
 56%|█████▌    | 21168/37963 [47:59:08<39:18:53,  8.43s/it]
 56%|█████▌    | 21169/37963 [47:59:15<38:17:35,  8.21s/it]
 56%|█████▌    | 21170/37963 [47:59:23<37:19:43,  8.00s/it]
                                                           
{'loss': '0.1341', 'grad_norm': '2.239', 'learning_rate': '8.624e-06', 'epoch': '0.5577'}
+
 56%|█████▌    | 21170/37963 [47:59:23<37:19:43,  8.00s/it]
 56%|█████▌    | 21171/37963 [47:59:33<41:02:54,  8.80s/it]
 56%|█████▌    | 21172/37963 [47:59:41<39:23:40,  8.45s/it]
 56%|█████▌    | 21173/37963 [47:59:49<38:13:04,  8.19s/it]
 56%|█████▌    | 21174/37963 [47:59:59<41:07:48,  8.82s/it]
 56%|█████▌    | 21175/37963 [48:00:07<39:23:26,  8.45s/it]
 56%|█████▌    | 21176/37963 [48:00:17<41:46:00,  8.96s/it]
 56%|█████▌    | 21177/37963 [48:00:24<39:54:41,  8.56s/it]
 56%|█████▌    | 21178/37963 [48:00:32<38:37:04,  8.28s/it]
 56%|█████▌    | 21179/37963 [48:00:40<37:59:29,  8.15s/it]
 56%|█████▌    | 21180/37963 [48:00:47<37:18:45,  8.00s/it]
                                                           
{'loss': '0.129', 'grad_norm': '4.425', 'learning_rate': '8.616e-06', 'epoch': '0.5579'}
+
 56%|█████▌    | 21180/37963 [48:00:47<37:18:45,  8.00s/it]
 56%|█████▌    | 21181/37963 [48:00:55<37:05:40,  7.96s/it]
 56%|█████▌    | 21182/37963 [48:01:03<36:36:15,  7.85s/it]
 56%|█████▌    | 21183/37963 [48:01:11<36:19:04,  7.79s/it]
 56%|█████▌    | 21184/37963 [48:01:19<36:31:34,  7.84s/it]
 56%|█████▌    | 21185/37963 [48:01:26<36:27:29,  7.82s/it]
 56%|█████▌    | 21186/37963 [48:01:37<40:31:36,  8.70s/it]
 56%|█████▌    | 21187/37963 [48:01:45<38:54:13,  8.35s/it]
 56%|█████▌    | 21188/37963 [48:01:52<37:34:05,  8.06s/it]
 56%|█████▌    | 21189/37963 [48:02:00<37:12:38,  7.99s/it]
 56%|█████▌    | 21190/37963 [48:02:08<36:56:24,  7.93s/it]
                                                           
{'loss': '0.1632', 'grad_norm': '2.041', 'learning_rate': '8.607e-06', 'epoch': '0.5582'}
+
 56%|█████▌    | 21190/37963 [48:02:08<36:56:24,  7.93s/it]
 56%|█████▌    | 21191/37963 [48:02:15<36:30:13,  7.84s/it]
 56%|█████▌    | 21192/37963 [48:02:23<36:16:37,  7.79s/it]
 56%|█████▌    | 21193/37963 [48:02:31<36:03:32,  7.74s/it]
 56%|█████▌    | 21194/37963 [48:02:38<35:54:58,  7.71s/it]
 56%|█████▌    | 21195/37963 [48:02:46<35:58:16,  7.72s/it]
 56%|█████▌    | 21196/37963 [48:02:54<36:24:30,  7.82s/it]
 56%|█████▌    | 21197/37963 [48:03:02<36:23:03,  7.81s/it]
 56%|█████▌    | 21198/37963 [48:03:10<36:32:08,  7.85s/it]
 56%|█████▌    | 21199/37963 [48:03:17<36:00:32,  7.73s/it]
 56%|█████▌    | 21200/37963 [48:03:25<35:44:06,  7.67s/it]
                                                           
{'loss': '0.1515', 'grad_norm': '1.508', 'learning_rate': '8.599e-06', 'epoch': '0.5584'}
+
 56%|█████▌    | 21200/37963 [48:03:25<35:44:06,  7.67s/it]
 56%|█��███▌    | 21201/37963 [48:03:32<35:50:41,  7.70s/it]
 56%|█████▌    | 21202/37963 [48:03:43<39:32:17,  8.49s/it]
 56%|█████▌    | 21203/37963 [48:03:50<38:24:30,  8.25s/it]
 56%|█████▌    | 21204/37963 [48:03:58<37:49:36,  8.13s/it]
 56%|█████▌    | 21205/37963 [48:04:06<37:12:20,  7.99s/it]
 56%|█████▌    | 21206/37963 [48:04:13<36:22:15,  7.81s/it]
 56%|█████▌    | 21207/37963 [48:04:21<36:05:35,  7.75s/it]
 56%|█████▌    | 21208/37963 [48:04:28<35:40:54,  7.67s/it]
 56%|█████▌    | 21209/37963 [48:04:36<36:05:17,  7.75s/it]
 56%|█████▌    | 21210/37963 [48:04:44<36:15:01,  7.79s/it]
                                                           
{'loss': '0.1408', 'grad_norm': '1.313', 'learning_rate': '8.59e-06', 'epoch': '0.5587'}
+
 56%|█████▌    | 21210/37963 [48:04:44<36:15:01,  7.79s/it]
 56%|█████▌    | 21211/37963 [48:04:54<39:13:36,  8.43s/it]
 56%|█████▌    | 21212/37963 [48:05:02<38:02:10,  8.17s/it]
 56%|█████▌    | 21213/37963 [48:05:12<41:02:28,  8.82s/it]
 56%|█████▌    | 21214/37963 [48:05:20<39:24:39,  8.47s/it]
 56%|█████▌    | 21215/37963 [48:05:27<38:19:05,  8.24s/it]
 56%|█████▌    | 21216/37963 [48:05:35<37:43:24,  8.11s/it]
 56%|█████▌    | 21217/37963 [48:05:43<37:11:38,  8.00s/it]
 56%|█████▌    | 21218/37963 [48:05:51<36:36:15,  7.87s/it]
 56%|█████▌    | 21219/37963 [48:05:59<36:44:45,  7.90s/it]
 56%|█████▌    | 21220/37963 [48:06:09<40:23:00,  8.68s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '3.513', 'learning_rate': '8.582e-06', 'epoch': '0.559'}
+
 56%|█████▌    | 21220/37963 [48:06:09<40:23:00,  8.68s/it]
 56%|█████▌    | 21221/37963 [48:06:17<38:50:44,  8.35s/it]
 56%|█████▌    | 21222/37963 [48:06:27<41:02:54,  8.83s/it]
 56%|█████▌    | 21223/37963 [48:06:35<39:58:05,  8.60s/it]
 56%|█████▌    | 21224/37963 [48:06:43<38:59:25,  8.39s/it]
 56%|█████▌    | 21225/37963 [48:06:56<45:34:40,  9.80s/it]
 56%|█████▌    | 21226/37963 [48:07:03<42:18:49,  9.10s/it]
 56%|█████▌    | 21227/37963 [48:07:11<40:26:32,  8.70s/it]
 56%|█████▌    | 21228/37963 [48:07:18<38:56:41,  8.38s/it]
 56%|█████▌    | 21229/37963 [48:07:26<38:02:02,  8.18s/it]
 56%|█████▌    | 21230/37963 [48:07:34<37:26:55,  8.06s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '1.764', 'learning_rate': '8.573e-06', 'epoch': '0.5592'}
+
 56%|█████▌    | 21230/37963 [48:07:34<37:26:55,  8.06s/it]
 56%|█████▌    | 21231/37963 [48:07:41<36:40:21,  7.89s/it]
 56%|█████▌    | 21232/37963 [48:07:49<36:38:44,  7.89s/it]
 56%|█████▌    | 21233/37963 [48:08:00<40:28:41,  8.71s/it]
 56%|█████▌    | 21234/37963 [48:08:08<39:33:56,  8.51s/it]
 56%|█████▌    | 21235/37963 [48:08:16<38:21:33,  8.26s/it]
 56%|█████▌    | 21236/37963 [48:08:24<37:51:34,  8.15s/it]
 56%|█████▌    | 21237/37963 [48:08:32<37:44:24,  8.12s/it]
 56%|█████▌    | 21238/37963 [48:08:39<36:58:03,  7.96s/it]
 56%|█████▌    | 21239/37963 [48:08:47<36:34:12,  7.87s/it]
 56%|█████▌    | 21240/37963 [48:08:55<36:22:08,  7.83s/it]
                                                           
{'loss': '0.1391', 'grad_norm': '1.465', 'learning_rate': '8.565e-06', 'epoch': '0.5595'}
+
 56%|█████▌    | 21240/37963 [48:08:55<36:22:08,  7.83s/it]
 56%|█████▌    | 21241/37963 [48:09:02<36:10:58,  7.79s/it]
 56%|█████▌    | 21242/37963 [48:09:10<35:56:57,  7.74s/it]
 56%|█████▌    | 21243/37963 [48:09:18<35:56:26,  7.74s/it]
 56%|█████▌    | 21244/37963 [48:09:26<36:12:50,  7.80s/it]
 56%|█████▌    | 21245/37963 [48:09:33<35:36:57,  7.67s/it]
 56%|█████▌    | 21246/37963 [48:09:43<39:14:28,  8.45s/it]
 56%|█████▌    | 21247/37963 [48:09:51<38:11:24,  8.22s/it]
 56%|█████▌    | 21248/37963 [48:09:59<37:52:03,  8.16s/it]
 56%|█████▌    | 21249/37963 [48:10:07<37:22:25,  8.05s/it]
 56%|█████▌    | 21250/37963 [48:10:14<36:48:24,  7.93s/it]
                                                           
{'loss': '0.1303', 'grad_norm': '2.933', 'learning_rate': '8.556e-06', 'epoch': '0.5598'}
+
 56%|█████▌    | 21250/37963 [48:10:14<36:48:24,  7.93s/it]
 56%|█████▌    | 21251/37963 [48:10:22<36:31:53,  7.87s/it]
 56%|█████▌    | 21252/37963 [48:10:30<36:12:44,  7.80s/it]
 56%|█████▌    | 21253/37963 [48:10:38<36:09:43,  7.79s/it]
 56%|█████▌    | 21254/37963 [48:10:45<35:55:07,  7.74s/it]
 56%|█████▌    | 21255/37963 [48:10:53<35:48:23,  7.72s/it]
 56%|█████▌    | 21256/37963 [48:11:01<35:50:46,  7.72s/it]
 56%|█████▌    | 21257/37963 [48:11:11<39:21:25,  8.48s/it]
 56%|█████▌    | 21258/37963 [48:11:19<38:25:43,  8.28s/it]
 56%|█████▌    | 21259/37963 [48:11:26<37:34:25,  8.10s/it]
 56%|█████▌    | 21260/37963 [48:11:34<36:19:20,  7.83s/it]
                                                           
{'loss': '0.1547', 'grad_norm': '3.409', 'learning_rate': '8.548e-06', 'epoch': '0.56'}
+
 56%|█████▌    | 21260/37963 [48:11:34<36:19:20,  7.83s/it]
 56%|█████▌    | 21261/37963 [48:11:41<35:45:07,  7.71s/it]
 56%|█████▌    | 21262/37963 [48:11:49<35:38:54,  7.68s/it]
 56%|█████▌    | 21263/37963 [48:11:56<35:07:03,  7.57s/it]
 56%|█████▌    | 21264/37963 [48:12:04<35:17:07,  7.61s/it]
 56%|█████▌    | 21265/37963 [48:12:14<38:58:16,  8.40s/it]
 56%|█████▌    | 21266/37963 [48:12:22<38:06:07,  8.22s/it]
 56%|█████▌    | 21267/37963 [48:12:29<37:30:54,  8.09s/it]
 56%|█████▌    | 21268/37963 [48:12:37<37:17:03,  8.04s/it]
 56%|█████▌    | 21269/37963 [48:12:45<36:45:52,  7.93s/it]
 56%|█████▌    | 21270/37963 [48:12:53<36:13:54,  7.81s/it]
                                                           
{'loss': '0.1539', 'grad_norm': '1.299', 'learning_rate': '8.54e-06', 'epoch': '0.5603'}
+
 56%|█████▌    | 21270/37963 [48:12:53<36:13:54,  7.81s/it]
 56%|█████▌    | 21271/37963 [48:13:00<36:10:18,  7.80s/it]
 56%|█████▌    | 21272/37963 [48:13:08<36:13:20,  7.81s/it]
 56%|█████▌    | 21273/37963 [48:13:21<43:16:14,  9.33s/it]
 56%|█████▌    | 21274/37963 [48:13:32<45:25:21,  9.80s/it]
 56%|█████▌    | 21275/37963 [48:13:40<42:28:54,  9.16s/it]
 56%|█████▌    | 21276/37963 [48:13:47<40:17:03,  8.69s/it]
 56%|█████▌    | 21277/37963 [48:13:55<39:15:33,  8.47s/it]
 56%|█████▌    | 21278/37963 [48:14:03<38:10:41,  8.24s/it]
 56%|█████▌    | 21279/37963 [48:14:13<41:14:22,  8.90s/it]
 56%|█████▌    | 21280/37963 [48:14:21<39:39:52,  8.56s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '2.266', 'learning_rate': '8.531e-06', 'epoch': '0.5605'}
+
 56%|█████▌    | 21280/37963 [48:14:21<39:39:52,  8.56s/it]
 56%|█████▌    | 21281/37963 [48:14:29<38:09:18,  8.23s/it]
 56%|█████▌    | 21282/37963 [48:14:36<37:07:26,  8.01s/it]
 56%|█████▌    | 21283/37963 [48:14:44<36:49:21,  7.95s/it]
 56%|█████▌    | 21284/37963 [48:14:51<36:04:11,  7.79s/it]
 56%|█████▌    | 21285/37963 [48:14:59<35:49:12,  7.73s/it]
 56%|█████▌    | 21286/37963 [48:15:07<35:59:33,  7.77s/it]
 56%|█████▌    | 21287/37963 [48:15:17<39:50:08,  8.60s/it]
 56%|█████▌    | 21288/37963 [48:15:25<38:31:13,  8.32s/it]
 56%|█████▌    | 21289/37963 [48:15:32<37:20:22,  8.06s/it]
 56%|█████▌    | 21290/37963 [48:15:40<36:44:48,  7.93s/it]
                                                           
{'loss': '0.145', 'grad_norm': '1.208', 'learning_rate': '8.523e-06', 'epoch': '0.5608'}
+
 56%|█████▌    | 21290/37963 [48:15:40<36:44:48,  7.93s/it]
 56%|█████▌    | 21291/37963 [48:15:48<36:24:16,  7.86s/it]
 56%|█████▌    | 21292/37963 [48:15:56<36:36:37,  7.91s/it]
 56%|█████▌    | 21293/37963 [48:16:04<36:40:26,  7.92s/it]
 56%|█████▌    | 21294/37963 [48:16:14<39:59:14,  8.64s/it]
 56%|█████▌    | 21295/37963 [48:16:22<38:35:43,  8.34s/it]
 56%|█████▌    | 21296/37963 [48:16:29<37:45:48,  8.16s/it]
 56%|█████▌    | 21297/37963 [48:16:37<37:15:21,  8.05s/it]
 56%|█████▌    | 21298/37963 [48:16:45<36:45:52,  7.94s/it]
 56%|█████▌    | 21299/37963 [48:16:52<36:02:54,  7.79s/it]
 56%|█████▌    | 21300/37963 [48:17:00<35:45:21,  7.72s/it]
                                                           
{'loss': '0.1451', 'grad_norm': '2.018', 'learning_rate': '8.514e-06', 'epoch': '0.5611'}
+
 56%|█████▌    | 21300/37963 [48:17:00<35:45:21,  7.72s/it]
 56%|█████▌    | 21301/37963 [48:17:07<35:37:54,  7.70s/it]
 56%|█████▌    | 21302/37963 [48:17:15<35:42:17,  7.71s/it]
 56%|█████▌    | 21303/37963 [48:17:23<35:42:48,  7.72s/it]
 56%|█████▌    | 21304/37963 [48:17:31<36:04:47,  7.80s/it]
 56%|█████▌    | 21305/37963 [48:17:41<39:37:04,  8.56s/it]
 56%|█████▌    | 21306/37963 [48:17:49<37:51:32,  8.18s/it]
 56%|█████▌    | 21307/37963 [48:17:56<37:12:33,  8.04s/it]
 56%|█████▌    | 21308/37963 [48:18:04<37:00:16,  8.00s/it]
 56%|█████▌    | 21309/37963 [48:18:14<39:52:53,  8.62s/it]
 56%|█████▌    | 21310/37963 [48:18:22<38:30:57,  8.33s/it]
                                                           
{'loss': '0.1431', 'grad_norm': '0.9885', 'learning_rate': '8.506e-06', 'epoch': '0.5613'}
+
 56%|█████▌    | 21310/37963 [48:18:22<38:30:57,  8.33s/it]
 56%|█████▌    | 21311/37963 [48:18:29<37:16:10,  8.06s/it]
 56%|█████▌    | 21312/37963 [48:18:37<36:56:07,  7.99s/it]
 56%|█████▌    | 21313/37963 [48:18:45<36:26:45,  7.88s/it]
 56%|█████▌    | 21314/37963 [48:18:52<36:06:42,  7.81s/it]
 56%|█████▌    | 21315/37963 [48:19:00<35:53:18,  7.76s/it]
 56%|█████▌    | 21316/37963 [48:19:10<39:09:06,  8.47s/it]
 56%|█████▌    | 21317/37963 [48:19:18<38:00:50,  8.22s/it]
 56%|█████▌    | 21318/37963 [48:19:25<37:15:56,  8.06s/it]
 56%|█████▌    | 21319/37963 [48:19:33<36:40:36,  7.93s/it]
 56%|█████▌    | 21320/37963 [48:19:41<36:23:19,  7.87s/it]
                                                           
{'loss': '0.1513', 'grad_norm': '2.864', 'learning_rate': '8.497e-06', 'epoch': '0.5616'}
+
 56%|█████▌    | 21320/37963 [48:19:41<36:23:19,  7.87s/it]
 56%|█████▌    | 21321/37963 [48:19:51<39:48:28,  8.61s/it]
 56%|█████▌    | 21322/37963 [48:19:59<38:49:32,  8.40s/it]
 56%|█████▌    | 21323/37963 [48:20:07<37:51:11,  8.19s/it]
 56%|█████▌    | 21324/37963 [48:20:15<37:16:34,  8.07s/it]
 56%|█████▌    | 21325/37963 [48:20:22<36:57:30,  8.00s/it]
 56%|█████▌    | 21326/37963 [48:20:30<36:15:17,  7.85s/it]
 56%|█████▌    | 21327/37963 [48:20:38<35:57:20,  7.78s/it]
 56%|█████▌    | 21328/37963 [48:20:48<39:16:58,  8.50s/it]
 56%|█████▌    | 21329/37963 [48:20:55<38:13:19,  8.27s/it]
 56%|█████▌    | 21330/37963 [48:21:03<37:27:54,  8.11s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '0.9963', 'learning_rate': '8.489e-06', 'epoch': '0.5619'}
+
 56%|█████▌    | 21330/37963 [48:21:03<37:27:54,  8.11s/it]
 56%|█████▌    | 21331/37963 [48:21:11<36:54:23,  7.99s/it]
 56%|█████▌    | 21332/37963 [48:21:19<36:50:24,  7.97s/it]
 56%|█████▌    | 21333/37963 [48:21:29<40:15:04,  8.71s/it]
 56%|█████▌    | 21334/37963 [48:21:37<39:00:21,  8.44s/it]
 56%|█████▌    | 21335/37963 [48:21:48<41:49:51,  9.06s/it]
 56%|█████▌    | 21336/37963 [48:21:55<40:05:05,  8.68s/it]
 56%|█████▌    | 21337/37963 [48:22:03<38:39:06,  8.37s/it]
 56%|█████▌    | 21338/37963 [48:22:13<41:04:25,  8.89s/it]
 56%|█████▌    | 21339/37963 [48:22:21<39:21:23,  8.52s/it]
 56%|█████▌    | 21340/37963 [48:22:29<38:19:58,  8.30s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '1.378', 'learning_rate': '8.48e-06', 'epoch': '0.5621'}
+
 56%|█████▌    | 21340/37963 [48:22:29<38:19:58,  8.30s/it]
 56%|█████▌    | 21341/37963 [48:22:37<37:55:21,  8.21s/it]
 56%|█████▌    | 21342/37963 [48:22:44<36:55:52,  8.00s/it]
 56%|█████▌    | 21343/37963 [48:22:52<36:22:08,  7.88s/it]
 56%|█████▌    | 21344/37963 [48:22:59<36:10:35,  7.84s/it]
 56%|█████▌    | 21345/37963 [48:23:07<35:50:41,  7.77s/it]
 56%|█████▌    | 21346/37963 [48:23:15<36:03:16,  7.81s/it]
 56%|█████▌    | 21347/37963 [48:23:23<35:57:00,  7.79s/it]
 56%|█████▌    | 21348/37963 [48:23:30<35:55:23,  7.78s/it]
 56%|█████▌    | 21349/37963 [48:23:38<35:57:28,  7.79s/it]
 56%|█████▌    | 21350/37963 [48:23:46<35:53:58,  7.78s/it]
                                                           
{'loss': '0.1526', 'grad_norm': '2.698', 'learning_rate': '8.472e-06', 'epoch': '0.5624'}
+
 56%|█████▌    | 21350/37963 [48:23:46<35:53:58,  7.78s/it]
 56%|█████▌    | 21351/37963 [48:23:54<35:42:54,  7.74s/it]
 56%|█████▌    | 21352/37963 [48:24:01<35:50:46,  7.77s/it]
 56%|█████▌    | 21353/37963 [48:24:12<39:40:57,  8.60s/it]
 56%|█████▌    | 21354/37963 [48:24:23<42:22:52,  9.19s/it]
 56%|█████▋    | 21355/37963 [48:24:30<40:22:02,  8.75s/it]
 56%|█████▋    | 21356/37963 [48:24:38<38:58:53,  8.45s/it]
 56%|█████▋    | 21357/37963 [48:24:46<37:51:37,  8.21s/it]
 56%|█████▋    | 21358/37963 [48:24:54<37:27:04,  8.12s/it]
 56%|█████▋    | 21359/37963 [48:25:01<36:54:11,  8.00s/it]
 56%|█████▋    | 21360/37963 [48:25:09<36:53:41,  8.00s/it]
                                                           
{'loss': '0.1538', 'grad_norm': '1.676', 'learning_rate': '8.464e-06', 'epoch': '0.5627'}
+
 56%|█████▋    | 21360/37963 [48:25:09<36:53:41,  8.00s/it]
 56%|█████▋    | 21361/37963 [48:25:17<36:27:50,  7.91s/it]
 56%|█████▋    | 21362/37963 [48:25:25<36:03:23,  7.82s/it]
 56%|█████▋    | 21363/37963 [48:25:32<36:04:31,  7.82s/it]
 56%|█████▋    | 21364/37963 [48:25:40<36:11:14,  7.85s/it]
 56%|█████▋    | 21365/37963 [48:25:48<35:54:32,  7.79s/it]
 56%|█████▋    | 21366/37963 [48:25:56<35:39:38,  7.74s/it]
 56%|█████▋    | 21367/37963 [48:26:03<35:36:10,  7.72s/it]
 56%|█████▋    | 21368/37963 [48:26:11<35:11:07,  7.63s/it]
 56%|█████▋    | 21369/37963 [48:26:21<38:56:11,  8.45s/it]
 56%|█████▋    | 21370/37963 [48:26:31<41:27:17,  8.99s/it]
                                                           
{'loss': '0.1492', 'grad_norm': '1.386', 'learning_rate': '8.455e-06', 'epoch': '0.5629'}
+
 56%|█████▋    | 21370/37963 [48:26:31<41:27:17,  8.99s/it]
 56%|█████▋    | 21371/37963 [48:26:39<39:51:51,  8.65s/it]
 56%|█████▋    | 21372/37963 [48:26:47<38:39:51,  8.39s/it]
 56%|█████▋    | 21373/37963 [48:26:54<37:19:41,  8.10s/it]
 56%|█████▋    | 21374/37963 [48:27:02<36:37:31,  7.95s/it]
 56%|█████▋    | 21375/37963 [48:27:09<35:56:17,  7.80s/it]
 56%|█████▋    | 21376/37963 [48:27:17<35:49:17,  7.77s/it]
 56%|█████▋    | 21377/37963 [48:27:28<39:54:51,  8.66s/it]
 56%|█████▋    | 21378/37963 [48:27:36<38:37:42,  8.38s/it]
 56%|█████▋    | 21379/37963 [48:27:43<37:17:20,  8.09s/it]
 56%|█████▋    | 21380/37963 [48:27:53<40:19:15,  8.75s/it]
                                                           
{'loss': '0.1516', 'grad_norm': '4.603', 'learning_rate': '8.447e-06', 'epoch': '0.5632'}
+
 56%|█████▋    | 21380/37963 [48:27:53<40:19:15,  8.75s/it]
 56%|█████▋    | 21381/37963 [48:28:01<39:04:51,  8.48s/it]
 56%|█████▋    | 21382/37963 [48:28:09<37:39:43,  8.18s/it]
 56%|█████▋    | 21383/37963 [48:28:16<36:54:51,  8.02s/it]
 56%|█████▋    | 21384/37963 [48:28:24<36:02:04,  7.82s/it]
 56%|█████▋    | 21385/37963 [48:28:31<35:48:56,  7.78s/it]
 56%|█████▋    | 21386/37963 [48:28:42<39:27:01,  8.57s/it]
 56%|█████▋    | 21387/37963 [48:28:52<42:10:55,  9.16s/it]
 56%|█████▋    | 21388/37963 [48:29:00<40:09:33,  8.72s/it]
 56%|█████▋    | 21389/37963 [48:29:08<38:42:47,  8.41s/it]
 56%|█████▋    | 21390/37963 [48:29:15<37:51:54,  8.23s/it]
                                                           
{'loss': '0.1409', 'grad_norm': '1.944', 'learning_rate': '8.438e-06', 'epoch': '0.5634'}
+
 56%|█████▋    | 21390/37963 [48:29:15<37:51:54,  8.23s/it]
 56%|█████▋    | 21391/37963 [48:29:23<37:02:21,  8.05s/it]
 56%|█████▋    | 21392/37963 [48:29:31<36:43:53,  7.98s/it]
 56%|█████▋    | 21393/37963 [48:29:39<36:25:55,  7.92s/it]
 56%|█████▋    | 21394/37963 [48:29:46<36:08:14,  7.85s/it]
 56%|█████▋    | 21395/37963 [48:29:54<36:01:05,  7.83s/it]
 56%|█████▋    | 21396/37963 [48:30:02<35:43:07,  7.76s/it]
 56%|█████▋    | 21397/37963 [48:30:12<39:19:20,  8.55s/it]
 56%|█████▋    | 21398/37963 [48:30:20<37:57:55,  8.25s/it]
 56%|█████▋    | 21399/37963 [48:30:27<37:09:57,  8.08s/it]
 56%|█████▋    | 21400/37963 [48:30:35<36:34:12,  7.95s/it]
                                                           
{'loss': '0.1621', 'grad_norm': '1.592', 'learning_rate': '8.43e-06', 'epoch': '0.5637'}
+
 56%|█████▋    | 21400/37963 [48:30:35<36:34:12,  7.95s/it]
 56%|█████▋    | 21401/37963 [48:30:43<35:58:16,  7.82s/it]
 56%|█████▋    | 21402/37963 [48:30:50<35:42:49,  7.76s/it]
 56%|█████▋    | 21403/37963 [48:30:58<35:45:45,  7.77s/it]
 56%|█████▋    | 21404/37963 [48:31:06<35:45:26,  7.77s/it]
 56%|█████▋    | 21405/37963 [48:31:13<35:39:27,  7.75s/it]
 56%|█████▋    | 21406/37963 [48:31:21<35:09:18,  7.64s/it]
 56%|█████▋    | 21407/37963 [48:31:31<38:32:02,  8.38s/it]
 56%|█████▋    | 21408/37963 [48:31:39<37:47:04,  8.22s/it]
 56%|█████▋    | 21409/37963 [48:31:47<37:13:11,  8.09s/it]
 56%|█████▋    | 21410/37963 [48:31:54<36:28:37,  7.93s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '2.895', 'learning_rate': '8.422e-06', 'epoch': '0.564'}
+
 56%|█████▋    | 21410/37963 [48:31:54<36:28:37,  7.93s/it]
 56%|█████▋    | 21411/37963 [48:32:02<36:00:52,  7.83s/it]
 56%|█████▋    | 21412/37963 [48:32:09<35:43:34,  7.77s/it]
 56%|█████▋    | 21413/37963 [48:32:20<39:23:02,  8.57s/it]
 56%|█████▋    | 21414/37963 [48:32:28<38:30:48,  8.38s/it]
 56%|█████▋    | 21415/37963 [48:32:36<37:45:36,  8.21s/it]
 56%|█████▋    | 21416/37963 [48:32:43<37:07:34,  8.08s/it]
 56%|█████▋    | 21417/37963 [48:32:51<36:31:23,  7.95s/it]
 56%|█████▋    | 21418/37963 [48:32:59<36:19:01,  7.90s/it]
 56%|█████▋    | 21419/37963 [48:33:07<36:16:37,  7.89s/it]
 56%|█████▋    | 21420/37963 [48:33:17<39:59:25,  8.70s/it]
                                                           
{'loss': '0.1527', 'grad_norm': '2.138', 'learning_rate': '8.413e-06', 'epoch': '0.5642'}
+
 56%|█████▋    | 21420/37963 [48:33:17<39:59:25,  8.70s/it]
 56%|█████▋    | 21421/37963 [48:33:25<38:53:59,  8.47s/it]
 56%|█████▋    | 21422/37963 [48:33:33<37:53:03,  8.25s/it]
 56%|█████▋    | 21423/37963 [48:33:41<37:05:57,  8.07s/it]
 56%|█████▋    | 21424/37963 [48:33:51<40:27:56,  8.81s/it]
 56%|█████▋    | 21425/37963 [48:33:59<38:46:39,  8.44s/it]
 56%|█████▋    | 21426/37963 [48:34:06<37:29:25,  8.16s/it]
 56%|█████▋    | 21427/37963 [48:34:17<40:52:23,  8.90s/it]
 56%|█████▋    | 21428/37963 [48:34:25<39:14:54,  8.55s/it]
 56%|█████▋    | 21429/37963 [48:34:32<38:06:28,  8.30s/it]
 56%|█████▋    | 21430/37963 [48:34:42<40:47:30,  8.88s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '1.17', 'learning_rate': '8.405e-06', 'epoch': '0.5645'}
+
 56%|█████▋    | 21430/37963 [48:34:42<40:47:30,  8.88s/it]
 56%|█████▋    | 21431/37963 [48:34:50<39:19:53,  8.56s/it]
 56%|█████▋    | 21432/37963 [48:34:58<38:06:20,  8.30s/it]
 56%|█████▋    | 21433/37963 [48:35:06<37:33:44,  8.18s/it]
 56%|█████▋    | 21434/37963 [48:35:14<36:52:52,  8.03s/it]
 56%|█████▋    | 21435/37963 [48:35:21<36:12:21,  7.89s/it]
 56%|█████▋    | 21436/37963 [48:35:29<36:01:39,  7.85s/it]
 56%|█████▋    | 21437/37963 [48:35:37<35:52:48,  7.82s/it]
 56%|█████▋    | 21438/37963 [48:35:44<35:55:46,  7.83s/it]
 56%|█████▋    | 21439/37963 [48:35:52<35:43:50,  7.78s/it]
 56%|█████▋    | 21440/37963 [48:36:00<35:42:02,  7.78s/it]
                                                           
{'loss': '0.1581', 'grad_norm': '1.288', 'learning_rate': '8.396e-06', 'epoch': '0.5648'}
+
 56%|█████▋    | 21440/37963 [48:36:00<35:42:02,  7.78s/it]
 56%|█████▋    | 21441/37963 [48:36:13<42:49:44,  9.33s/it]
 56%|█████▋    | 21442/37963 [48:36:21<40:34:06,  8.84s/it]
 56%|█████▋    | 21443/37963 [48:36:28<38:55:24,  8.48s/it]
 56%|█████▋    | 21444/37963 [48:36:36<38:21:55,  8.36s/it]
 56%|█████▋    | 21445/37963 [48:36:44<37:23:27,  8.15s/it]
 56%|█████▋    | 21446/37963 [48:36:52<36:40:39,  7.99s/it]
 56%|█████▋    | 21447/37963 [48:36:59<36:20:23,  7.92s/it]
 56%|█████▋    | 21448/37963 [48:37:07<36:12:28,  7.89s/it]
 56%|█████▋    | 21449/37963 [48:37:15<35:43:33,  7.79s/it]
 57%|█████▋    | 21450/37963 [48:37:22<35:26:15,  7.73s/it]
                                                           
{'loss': '0.1238', 'grad_norm': '0.9316', 'learning_rate': '8.388e-06', 'epoch': '0.565'}
+
 57%|█████▋    | 21450/37963 [48:37:22<35:26:15,  7.73s/it]
 57%|█████▋    | 21451/37963 [48:37:30<35:14:32,  7.68s/it]
 57%|█████▋    | 21452/37963 [48:37:37<35:09:44,  7.67s/it]
 57%|█████▋    | 21453/37963 [48:37:45<35:10:57,  7.67s/it]
 57%|█████▋    | 21454/37963 [48:37:53<35:23:41,  7.72s/it]
 57%|█████▋    | 21455/37963 [48:38:03<38:51:19,  8.47s/it]
 57%|█████▋    | 21456/37963 [48:38:11<37:43:25,  8.23s/it]
 57%|█████▋    | 21457/37963 [48:38:19<37:07:00,  8.10s/it]
 57%|█████▋    | 21458/37963 [48:38:26<36:35:09,  7.98s/it]
 57%|█████▋    | 21459/37963 [48:38:34<35:59:04,  7.85s/it]
 57%|█████▋    | 21460/37963 [48:38:41<35:32:03,  7.75s/it]
                                                           
{'loss': '0.1733', 'grad_norm': '1.481', 'learning_rate': '8.379e-06', 'epoch': '0.5653'}
+
 57%|█████▋    | 21460/37963 [48:38:41<35:32:03,  7.75s/it]
 57%|█████▋    | 21461/37963 [48:38:49<35:23:53,  7.72s/it]
 57%|█████▋    | 21462/37963 [48:38:57<35:19:36,  7.71s/it]
 57%|█████▋    | 21463/37963 [48:39:04<35:18:58,  7.71s/it]
 57%|█████▋    | 21464/37963 [48:39:12<35:18:45,  7.71s/it]
 57%|█████▋    | 21465/37963 [48:39:20<35:37:21,  7.77s/it]
 57%|█████▋    | 21466/37963 [48:39:28<35:38:15,  7.78s/it]
 57%|█████▋    | 21467/37963 [48:39:38<39:24:53,  8.60s/it]
 57%|█████▋    | 21468/37963 [48:39:46<38:25:57,  8.39s/it]
 57%|█████▋    | 21469/37963 [48:39:54<37:13:02,  8.12s/it]
 57%|█████▋    | 21470/37963 [48:40:02<36:38:17,  8.00s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '1.082', 'learning_rate': '8.371e-06', 'epoch': '0.5656'}
+
 57%|█████▋    | 21470/37963 [48:40:02<36:38:17,  8.00s/it]
 57%|█████▋    | 21471/37963 [48:40:09<36:17:55,  7.92s/it]
 57%|█████▋    | 21472/37963 [48:40:17<36:22:20,  7.94s/it]
 57%|█████▋    | 21473/37963 [48:40:25<36:04:34,  7.88s/it]
 57%|█████▋    | 21474/37963 [48:40:38<43:05:25,  9.41s/it]
 57%|█████▋    | 21475/37963 [48:40:48<44:30:42,  9.72s/it]
 57%|█████▋    | 21476/37963 [48:40:56<41:47:38,  9.13s/it]
 57%|█████▋    | 21477/37963 [48:41:04<39:31:40,  8.63s/it]
 57%|█████▋    | 21478/37963 [48:41:14<42:05:06,  9.19s/it]
 57%|█████▋    | 21479/37963 [48:41:22<40:15:07,  8.79s/it]
 57%|█████▋    | 21480/37963 [48:41:30<38:29:42,  8.41s/it]
                                                           
{'loss': '0.146', 'grad_norm': '4.145', 'learning_rate': '8.363e-06', 'epoch': '0.5658'}
+
 57%|█████▋    | 21480/37963 [48:41:30<38:29:42,  8.41s/it]
 57%|█████▋    | 21481/37963 [48:41:37<37:12:22,  8.13s/it]
 57%|█████▋    | 21482/37963 [48:41:45<36:33:02,  7.98s/it]
 57%|█████▋    | 21483/37963 [48:41:52<36:07:23,  7.89s/it]
 57%|█████▋    | 21484/37963 [48:42:00<35:42:46,  7.80s/it]
 57%|█████▋    | 21485/37963 [48:42:10<39:00:33,  8.52s/it]
 57%|█████▋    | 21486/37963 [48:42:18<37:37:05,  8.22s/it]
 57%|█████▋    | 21487/37963 [48:42:25<36:47:12,  8.04s/it]
 57%|█████▋    | 21488/37963 [48:42:33<36:23:36,  7.95s/it]
 57%|█████▋    | 21489/37963 [48:42:41<36:12:42,  7.91s/it]
 57%|█████▋    | 21490/37963 [48:42:48<35:52:44,  7.84s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '3.562', 'learning_rate': '8.354e-06', 'epoch': '0.5661'}
+
 57%|█████▋    | 21490/37963 [48:42:48<35:52:44,  7.84s/it]
 57%|█████▋    | 21491/37963 [48:42:56<35:34:53,  7.78s/it]
 57%|█████▋    | 21492/37963 [48:43:04<35:09:06,  7.68s/it]
 57%|█████▋    | 21493/37963 [48:43:11<35:07:02,  7.68s/it]
 57%|█████▋    | 21494/37963 [48:43:19<35:10:55,  7.69s/it]
 57%|█████▋    | 21495/37963 [48:43:29<39:04:53,  8.54s/it]
 57%|█████▋    | 21496/37963 [48:43:37<38:04:27,  8.32s/it]
 57%|█████▋    | 21497/37963 [48:43:45<37:19:46,  8.16s/it]
 57%|█████▋    | 21498/37963 [48:43:53<36:19:29,  7.94s/it]
 57%|█████▋    | 21499/37963 [48:44:01<36:27:41,  7.97s/it]
 57%|█████▋    | 21500/37963 [48:44:08<36:13:06,  7.92s/it]
                                                           
{'loss': '0.1413', 'grad_norm': '0.9966', 'learning_rate': '8.346e-06', 'epoch': '0.5663'}
+
 57%|█████▋    | 21500/37963 [48:44:08<36:13:06,  7.92s/it]
 57%|█████▋    | 21501/37963 [48:44:16<35:44:10,  7.82s/it]
 57%|█████▋    | 21502/37963 [48:44:24<35:31:24,  7.77s/it]
 57%|█████▋    | 21503/37963 [48:44:33<38:20:54,  8.39s/it]
 57%|█████▋    | 21504/37963 [48:44:41<36:55:46,  8.08s/it]
 57%|█████▋    | 21505/37963 [48:44:49<36:41:46,  8.03s/it]
 57%|█████▋    | 21506/37963 [48:44:57<36:36:03,  8.01s/it]
 57%|█████▋    | 21507/37963 [48:45:04<36:11:56,  7.92s/it]
 57%|█████▋    | 21508/37963 [48:45:12<36:10:20,  7.91s/it]
 57%|█████▋    | 21509/37963 [48:45:20<35:50:02,  7.84s/it]
 57%|█████▋    | 21510/37963 [48:45:28<35:29:41,  7.77s/it]
                                                           
{'loss': '0.1477', 'grad_norm': '2.519', 'learning_rate': '8.337e-06', 'epoch': '0.5666'}
+
 57%|█████▋    | 21510/37963 [48:45:28<35:29:41,  7.77s/it]
 57%|█████▋    | 21511/37963 [48:45:35<35:33:59,  7.78s/it]
 57%|█████▋    | 21512/37963 [48:45:43<35:35:14,  7.79s/it]
 57%|█████▋    | 21513/37963 [48:45:53<38:26:56,  8.41s/it]
 57%|█████▋    | 21514/37963 [48:46:01<37:35:18,  8.23s/it]
 57%|█████▋    | 21515/37963 [48:46:09<36:54:19,  8.08s/it]
 57%|█████▋    | 21516/37963 [48:46:16<36:27:48,  7.98s/it]
 57%|█████▋    | 21517/37963 [48:46:24<36:32:10,  8.00s/it]
 57%|█████▋    | 21518/37963 [48:46:34<39:19:28,  8.61s/it]
 57%|█████▋    | 21519/37963 [48:46:42<38:14:52,  8.37s/it]
 57%|█████▋    | 21520/37963 [48:46:50<37:16:57,  8.16s/it]
                                                           
{'loss': '0.17', 'grad_norm': '2.902', 'learning_rate': '8.329e-06', 'epoch': '0.5669'}
+
 57%|█████▋    | 21520/37963 [48:46:50<37:16:57,  8.16s/it]
 57%|█████▋    | 21521/37963 [48:46:57<36:26:14,  7.98s/it]
 57%|█████▋    | 21522/37963 [48:47:10<43:23:34,  9.50s/it]
 57%|█████▋    | 21523/37963 [48:47:18<41:19:13,  9.05s/it]
 57%|█████▋    | 21524/37963 [48:47:26<39:34:39,  8.67s/it]
 57%|█████▋    | 21525/37963 [48:47:34<38:29:08,  8.43s/it]
 57%|█████▋    | 21526/37963 [48:47:45<41:15:14,  9.04s/it]
 57%|█████▋    | 21527/37963 [48:47:52<39:31:52,  8.66s/it]
 57%|█████▋    | 21528/37963 [48:48:03<42:07:06,  9.23s/it]
 57%|█████▋    | 21529/37963 [48:48:10<39:48:53,  8.72s/it]
 57%|█████▋    | 21530/37963 [48:48:18<38:21:38,  8.40s/it]
                                                           
{'loss': '0.1533', 'grad_norm': '2.469', 'learning_rate': '8.32e-06', 'epoch': '0.5671'}
+
 57%|█████▋    | 21530/37963 [48:48:18<38:21:38,  8.40s/it]
 57%|█████▋    | 21531/37963 [48:48:26<37:17:37,  8.17s/it]
 57%|█████▋    | 21532/37963 [48:48:33<36:31:15,  8.00s/it]
 57%|█████▋    | 21533/37963 [48:48:41<36:26:14,  7.98s/it]
 57%|█████▋    | 21534/37963 [48:48:49<35:58:27,  7.88s/it]
 57%|█████▋    | 21535/37963 [48:48:56<35:28:47,  7.77s/it]
 57%|█████▋    | 21536/37963 [48:49:04<35:18:11,  7.74s/it]
 57%|█████▋    | 21537/37963 [48:49:12<35:25:24,  7.76s/it]
 57%|█████▋    | 21538/37963 [48:49:20<35:34:54,  7.80s/it]
 57%|█████▋    | 21539/37963 [48:49:27<35:25:55,  7.77s/it]
 57%|█████▋    | 21540/37963 [48:49:35<35:26:21,  7.77s/it]
                                                           
{'loss': '0.1565', 'grad_norm': '4.126', 'learning_rate': '8.312e-06', 'epoch': '0.5674'}
+
 57%|█████▋    | 21540/37963 [48:49:35<35:26:21,  7.77s/it]
 57%|█████▋    | 21541/37963 [48:49:43<35:02:41,  7.68s/it]
 57%|█████▋    | 21542/37963 [48:49:50<34:56:15,  7.66s/it]
 57%|█████▋    | 21543/37963 [48:49:58<35:10:19,  7.71s/it]
 57%|█████▋    | 21544/37963 [48:50:06<35:07:59,  7.70s/it]
 57%|█████▋    | 21545/37963 [48:50:13<34:43:18,  7.61s/it]
 57%|█████▋    | 21546/37963 [48:50:21<34:56:59,  7.66s/it]
 57%|█████▋    | 21547/37963 [48:50:29<34:52:09,  7.65s/it]
 57%|█████▋    | 21548/37963 [48:50:36<34:53:25,  7.65s/it]
 57%|█████▋    | 21549/37963 [48:50:47<38:55:24,  8.54s/it]
 57%|█████▋    | 21550/37963 [48:50:55<38:12:01,  8.38s/it]
                                                           
{'loss': '0.1499', 'grad_norm': '1.133', 'learning_rate': '8.304e-06', 'epoch': '0.5677'}
+
 57%|█████▋    | 21550/37963 [48:50:55<38:12:01,  8.38s/it]
 57%|█████▋    | 21551/37963 [48:51:03<37:11:48,  8.16s/it]
 57%|█████▋    | 21552/37963 [48:51:10<36:28:49,  8.00s/it]
 57%|█████▋    | 21553/37963 [48:51:18<36:06:39,  7.92s/it]
 57%|█████▋    | 21554/37963 [48:51:28<39:10:21,  8.59s/it]
 57%|█████▋    | 21555/37963 [48:51:36<37:57:36,  8.33s/it]
 57%|█████▋    | 21556/37963 [48:51:44<37:12:14,  8.16s/it]
 57%|█████▋    | 21557/37963 [48:51:51<36:40:12,  8.05s/it]
 57%|█████▋    | 21558/37963 [48:52:02<39:49:22,  8.74s/it]
 57%|█████▋    | 21559/37963 [48:52:09<38:00:14,  8.34s/it]
 57%|█████▋    | 21560/37963 [48:52:17<37:00:06,  8.12s/it]
                                                           
{'loss': '0.1527', 'grad_norm': '2.221', 'learning_rate': '8.295e-06', 'epoch': '0.5679'}
+
 57%|█████▋    | 21560/37963 [48:52:17<37:00:06,  8.12s/it]
 57%|█████▋    | 21561/37963 [48:52:24<36:01:47,  7.91s/it]
 57%|█████▋    | 21562/37963 [48:52:32<35:42:44,  7.84s/it]
 57%|█████▋    | 21563/37963 [48:52:39<35:17:39,  7.75s/it]
 57%|█████▋    | 21564/37963 [48:52:47<34:41:17,  7.61s/it]
 57%|█████▋    | 21565/37963 [48:52:54<34:41:12,  7.62s/it]
 57%|█████▋    | 21566/37963 [48:53:05<38:34:59,  8.47s/it]
 57%|█████▋    | 21567/37963 [48:53:13<37:42:13,  8.28s/it]
 57%|█████▋    | 21568/37963 [48:53:20<37:13:19,  8.17s/it]
 57%|█████▋    | 21569/37963 [48:53:28<36:09:48,  7.94s/it]
 57%|█████▋    | 21570/37963 [48:53:41<43:25:31,  9.54s/it]
                                                           
{'loss': '0.1403', 'grad_norm': '2.053', 'learning_rate': '8.287e-06', 'epoch': '0.5682'}
+
 57%|█████▋    | 21570/37963 [48:53:41<43:25:31,  9.54s/it]
 57%|█████▋    | 21571/37963 [48:53:49<40:45:12,  8.95s/it]
 57%|█████▋    | 21572/37963 [48:53:57<39:10:06,  8.60s/it]
 57%|█████▋    | 21573/37963 [48:54:04<37:49:13,  8.31s/it]
 57%|█████▋    | 21574/37963 [48:54:12<37:05:22,  8.15s/it]
 57%|█████▋    | 21575/37963 [48:54:22<40:01:36,  8.79s/it]
 57%|█████▋    | 21576/37963 [48:54:30<38:27:50,  8.45s/it]
 57%|█████▋    | 21577/37963 [48:54:40<41:02:02,  9.02s/it]
 57%|█████▋    | 21578/37963 [48:54:48<39:22:18,  8.65s/it]
 57%|█████▋    | 21579/37963 [48:54:55<37:40:04,  8.28s/it]
 57%|█████▋    | 21580/37963 [48:55:03<36:51:54,  8.10s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '1.445', 'learning_rate': '8.278e-06', 'epoch': '0.5685'}
+
 57%|█████▋    | 21580/37963 [48:55:03<36:51:54,  8.10s/it]
 57%|█████▋    | 21581/37963 [48:55:11<36:26:52,  8.01s/it]
 57%|█████▋    | 21582/37963 [48:55:19<36:12:39,  7.96s/it]
 57%|█████▋    | 21583/37963 [48:55:26<35:45:26,  7.86s/it]
 57%|█████▋    | 21584/37963 [48:55:34<35:31:28,  7.81s/it]
 57%|█████▋    | 21585/37963 [48:55:42<35:19:40,  7.77s/it]
 57%|█████▋    | 21586/37963 [48:55:49<34:45:09,  7.64s/it]
 57%|█████▋    | 21587/37963 [48:55:57<34:51:29,  7.66s/it]
 57%|█████▋    | 21588/37963 [48:56:05<35:17:22,  7.76s/it]
 57%|█████▋    | 21589/37963 [48:56:13<35:21:16,  7.77s/it]
 57%|█████▋    | 21590/37963 [48:56:20<35:10:11,  7.73s/it]
                                                           
{'loss': '0.1439', 'grad_norm': '1.989', 'learning_rate': '8.27e-06', 'epoch': '0.5687'}
+
 57%|█████▋    | 21590/37963 [48:56:20<35:10:11,  7.73s/it]
 57%|█████▋    | 21591/37963 [48:56:28<35:19:09,  7.77s/it]
 57%|█████▋    | 21592/37963 [48:56:36<35:13:57,  7.75s/it]
 57%|█████▋    | 21593/37963 [48:56:44<35:26:31,  7.79s/it]
 57%|█████▋    | 21594/37963 [48:56:52<35:30:44,  7.81s/it]
 57%|█████▋    | 21595/37963 [48:56:59<35:14:08,  7.75s/it]
 57%|█████▋    | 21596/37963 [48:57:10<38:56:29,  8.57s/it]
 57%|█████▋    | 21597/37963 [48:57:17<38:01:53,  8.37s/it]
 57%|█████▋    | 21598/37963 [48:57:25<37:07:33,  8.17s/it]
 57%|█████▋    | 21599/37963 [48:57:33<36:27:25,  8.02s/it]
 57%|█████▋    | 21600/37963 [48:57:41<36:01:48,  7.93s/it]
                                                           
{'loss': '0.1484', 'grad_norm': '2.01', 'learning_rate': '8.262e-06', 'epoch': '0.569'}
+
 57%|█████▋    | 21600/37963 [48:57:41<36:01:48,  7.93s/it]
 57%|█████▋    | 21601/37963 [48:57:48<35:44:11,  7.86s/it]
 57%|█████▋    | 21602/37963 [48:58:01<42:51:07,  9.43s/it]
 57%|█████▋    | 21603/37963 [48:58:09<40:31:46,  8.92s/it]
 57%|█████▋    | 21604/37963 [48:58:16<38:27:08,  8.46s/it]
 57%|█████▋    | 21605/37963 [48:58:24<37:38:47,  8.29s/it]
 57%|█████▋    | 21606/37963 [48:58:32<36:46:46,  8.09s/it]
 57%|█████▋    | 21607/37963 [48:58:40<36:25:00,  8.02s/it]
 57%|█████▋    | 21608/37963 [48:58:48<36:19:55,  8.00s/it]
 57%|█████▋    | 21609/37963 [48:58:56<36:08:31,  7.96s/it]
 57%|█████▋    | 21610/37963 [48:59:06<39:42:23,  8.74s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '2.499', 'learning_rate': '8.253e-06', 'epoch': '0.5692'}
+
 57%|█████▋    | 21610/37963 [48:59:06<39:42:23,  8.74s/it]
 57%|█████▋    | 21611/37963 [48:59:14<38:25:08,  8.46s/it]
 57%|█████▋    | 21612/37963 [48:59:22<37:26:12,  8.24s/it]
 57%|█████▋    | 21613/37963 [48:59:30<36:48:33,  8.10s/it]
 57%|█████▋    | 21614/37963 [48:59:40<40:06:30,  8.83s/it]
 57%|█████▋    | 21615/37963 [48:59:47<38:07:56,  8.40s/it]
 57%|█████▋    | 21616/37963 [48:59:55<36:38:02,  8.07s/it]
 57%|█████▋    | 21617/37963 [49:00:02<36:06:11,  7.95s/it]
 57%|█████▋    | 21618/37963 [49:00:10<35:57:28,  7.92s/it]
 57%|█████▋    | 21619/37963 [49:00:18<35:16:00,  7.77s/it]
 57%|█████▋    | 21620/37963 [49:00:25<34:52:06,  7.68s/it]
                                                           
{'loss': '0.1473', 'grad_norm': '1.4', 'learning_rate': '8.245e-06', 'epoch': '0.5695'}
+
 57%|█████▋    | 21620/37963 [49:00:25<34:52:06,  7.68s/it]
 57%|█████▋    | 21621/37963 [49:00:33<34:52:11,  7.68s/it]
 57%|█████▋    | 21622/37963 [49:00:41<34:58:03,  7.70s/it]
 57%|█████▋    | 21623/37963 [49:00:50<37:51:30,  8.34s/it]
 57%|█████▋    | 21624/37963 [49:00:58<36:50:19,  8.12s/it]
 57%|█████▋    | 21625/37963 [49:01:06<36:03:38,  7.95s/it]
 57%|█████▋    | 21626/37963 [49:01:13<35:41:52,  7.87s/it]
 57%|█████▋    | 21627/37963 [49:01:21<35:12:08,  7.76s/it]
 57%|█████▋    | 21628/37963 [49:01:28<34:38:15,  7.63s/it]
 57%|█████▋    | 21629/37963 [49:01:36<34:32:35,  7.61s/it]
 57%|█████▋    | 21630/37963 [49:01:43<34:39:04,  7.64s/it]
                                                           
{'loss': '0.1476', 'grad_norm': '1.721', 'learning_rate': '8.236e-06', 'epoch': '0.5698'}
+
 57%|█████▋    | 21630/37963 [49:01:43<34:39:04,  7.64s/it]
 57%|█████▋    | 21631/37963 [49:01:54<38:11:33,  8.42s/it]
 57%|█████▋    | 21632/37963 [49:02:02<37:29:26,  8.26s/it]
 57%|█████▋    | 21633/37963 [49:02:09<36:56:20,  8.14s/it]
 57%|█████▋    | 21634/37963 [49:02:17<36:27:36,  8.04s/it]
 57%|█████▋    | 21635/37963 [49:02:25<36:11:02,  7.98s/it]
 57%|█████▋    | 21636/37963 [49:02:33<35:35:22,  7.85s/it]
 57%|█████▋    | 21637/37963 [49:02:40<35:10:24,  7.76s/it]
 57%|█████▋    | 21638/37963 [49:02:48<35:34:09,  7.84s/it]
 57%|█████▋    | 21639/37963 [49:02:56<35:02:40,  7.73s/it]
 57%|█████▋    | 21640/37963 [49:03:06<38:53:22,  8.58s/it]
                                                           
{'loss': '0.1519', 'grad_norm': '1.777', 'learning_rate': '8.228e-06', 'epoch': '0.57'}
+
 57%|█████▋    | 21640/37963 [49:03:06<38:53:22,  8.58s/it]
 57%|█████▋    | 21641/37963 [49:03:14<37:36:15,  8.29s/it]
 57%|█████▋    | 21642/37963 [49:03:21<36:37:28,  8.08s/it]
 57%|█████▋    | 21643/37963 [49:03:29<35:58:22,  7.94s/it]
 57%|█████▋    | 21644/37963 [49:03:37<35:39:57,  7.87s/it]
 57%|█████▋    | 21645/37963 [49:03:44<35:27:55,  7.82s/it]
 57%|█████▋    | 21646/37963 [49:03:55<38:58:28,  8.60s/it]
 57%|█████▋    | 21647/37963 [49:04:03<37:52:14,  8.36s/it]
 57%|█████▋    | 21648/37963 [49:04:10<37:09:31,  8.20s/it]
 57%|█████▋    | 21649/37963 [49:04:18<36:28:37,  8.05s/it]
 57%|█████▋    | 21650/37963 [49:04:26<35:53:34,  7.92s/it]
                                                           
{'loss': '0.1346', 'grad_norm': '2.567', 'learning_rate': '8.22e-06', 'epoch': '0.5703'}
+
 57%|█████▋    | 21650/37963 [49:04:26<35:53:34,  7.92s/it]
 57%|█████▋    | 21651/37963 [49:04:33<35:35:11,  7.85s/it]
 57%|█████▋    | 21652/37963 [49:04:41<35:34:18,  7.85s/it]
 57%|█████▋    | 21653/37963 [49:04:52<39:18:14,  8.68s/it]
 57%|█████▋    | 21654/37963 [49:04:59<37:22:02,  8.25s/it]
 57%|█████▋    | 21655/37963 [49:05:07<36:30:22,  8.06s/it]
 57%|█████▋    | 21656/37963 [49:05:17<39:32:03,  8.73s/it]
 57%|█████▋    | 21657/37963 [49:05:27<41:49:34,  9.23s/it]
 57%|█████▋    | 21658/37963 [49:05:38<43:12:58,  9.54s/it]
 57%|█████▋    | 21659/37963 [49:05:46<40:56:35,  9.04s/it]
 57%|█████▋    | 21660/37963 [49:05:53<39:16:13,  8.67s/it]
                                                           
{'loss': '0.152', 'grad_norm': '2.272', 'learning_rate': '8.211e-06', 'epoch': '0.5706'}
+
 57%|█████▋    | 21660/37963 [49:05:53<39:16:13,  8.67s/it]
 57%|█████▋    | 21661/37963 [49:06:01<37:56:36,  8.38s/it]
 57%|█████▋    | 21662/37963 [49:06:09<37:00:25,  8.17s/it]
 57%|█████▋    | 21663/37963 [49:06:16<36:10:22,  7.99s/it]
 57%|█████▋    | 21664/37963 [49:06:25<36:26:00,  8.05s/it]
 57%|█████▋    | 21665/37963 [49:06:32<35:46:56,  7.90s/it]
 57%|█████▋    | 21666/37963 [49:06:40<35:25:32,  7.83s/it]
 57%|█████▋    | 21667/37963 [49:06:47<35:13:06,  7.78s/it]
 57%|█████▋    | 21668/37963 [49:06:55<35:11:43,  7.78s/it]
 57%|█████▋    | 21669/37963 [49:07:03<35:22:43,  7.82s/it]
 57%|█████▋    | 21670/37963 [49:07:11<35:06:31,  7.76s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '2.818', 'learning_rate': '8.203e-06', 'epoch': '0.5708'}
+
 57%|█████▋    | 21670/37963 [49:07:11<35:06:31,  7.76s/it]
 57%|█████▋    | 21671/37963 [49:07:18<34:54:20,  7.71s/it]
 57%|█████▋    | 21672/37963 [49:07:26<34:55:14,  7.72s/it]
 57%|█████▋    | 21673/37963 [49:07:34<34:48:50,  7.69s/it]
 57%|█████▋    | 21674/37963 [49:07:41<34:52:14,  7.71s/it]
 57%|█████▋    | 21675/37963 [49:07:52<38:07:12,  8.43s/it]
 57%|█████▋    | 21676/37963 [49:07:59<37:03:20,  8.19s/it]
 57%|█████▋    | 21677/37963 [49:08:09<39:45:34,  8.79s/it]
 57%|█████▋    | 21678/37963 [49:08:17<38:30:57,  8.51s/it]
 57%|█████▋    | 21679/37963 [49:08:25<37:33:53,  8.30s/it]
 57%|█████▋    | 21680/37963 [49:08:33<36:49:38,  8.14s/it]
                                                           
{'loss': '0.1387', 'grad_norm': '6.455', 'learning_rate': '8.194e-06', 'epoch': '0.5711'}
+
 57%|█████▋    | 21680/37963 [49:08:33<36:49:38,  8.14s/it]
 57%|█████▋    | 21681/37963 [49:08:40<36:06:10,  7.98s/it]
 57%|█████▋    | 21682/37963 [49:08:48<35:43:25,  7.90s/it]
 57%|█████▋    | 21683/37963 [49:08:56<35:19:07,  7.81s/it]
 57%|█████▋    | 21684/37963 [49:09:04<35:19:56,  7.81s/it]
 57%|█████▋    | 21685/37963 [49:09:11<35:01:16,  7.75s/it]
 57%|█████▋    | 21686/37963 [49:09:19<34:42:10,  7.68s/it]
 57%|█████▋    | 21687/37963 [49:09:27<34:59:16,  7.74s/it]
 57%|█████▋    | 21688/37963 [49:09:37<38:55:44,  8.61s/it]
 57%|█████▋    | 21689/37963 [49:09:48<41:19:12,  9.14s/it]
 57%|█████▋    | 21690/37963 [49:09:55<39:05:56,  8.65s/it]
                                                           
{'loss': '0.151', 'grad_norm': '1.776', 'learning_rate': '8.186e-06', 'epoch': '0.5713'}
+
 57%|█████▋    | 21690/37963 [49:09:55<39:05:56,  8.65s/it]
 57%|█████▋    | 21691/37963 [49:10:03<37:32:45,  8.31s/it]
 57%|█████▋    | 21692/37963 [49:10:10<36:48:24,  8.14s/it]
 57%|█████▋    | 21693/37963 [49:10:18<36:18:35,  8.03s/it]
 57%|█████▋    | 21694/37963 [49:10:26<35:51:10,  7.93s/it]
 57%|█████▋    | 21695/37963 [49:10:34<35:40:33,  7.89s/it]
 57%|█████▋    | 21696/37963 [49:10:41<35:15:35,  7.80s/it]
 57%|█████▋    | 21697/37963 [49:10:52<39:05:59,  8.65s/it]
 57%|█████▋    | 21698/37963 [49:11:00<37:49:32,  8.37s/it]
 57%|█████▋    | 21699/37963 [49:11:07<37:03:39,  8.20s/it]
 57%|█████▋    | 21700/37963 [49:11:15<36:11:50,  8.01s/it]
                                                           
{'loss': '0.1535', 'grad_norm': '4.631', 'learning_rate': '8.178e-06', 'epoch': '0.5716'}
+
 57%|█████▋    | 21700/37963 [49:11:15<36:11:50,  8.01s/it]
 57%|█████▋    | 21701/37963 [49:11:25<39:11:42,  8.68s/it]
 57%|█████▋    | 21702/37963 [49:11:33<37:58:26,  8.41s/it]
 57%|█████▋    | 21703/37963 [49:11:41<37:01:43,  8.20s/it]
 57%|█████▋    | 21704/37963 [49:11:51<39:47:59,  8.81s/it]
 57%|█████▋    | 21705/37963 [49:12:02<42:18:17,  9.37s/it]
 57%|█████▋    | 21706/37963 [49:12:09<39:54:10,  8.84s/it]
 57%|█████▋    | 21707/37963 [49:12:17<38:03:15,  8.43s/it]
 57%|█████▋    | 21708/37963 [49:12:24<37:17:01,  8.26s/it]
 57%|█████▋    | 21709/37963 [49:12:32<36:40:57,  8.12s/it]
 57%|█████▋    | 21710/37963 [49:12:40<36:12:11,  8.02s/it]
                                                           
{'loss': '0.1382', 'grad_norm': '1.208', 'learning_rate': '8.169e-06', 'epoch': '0.5719'}
+
 57%|█████▋    | 21710/37963 [49:12:40<36:12:11,  8.02s/it]
 57%|█████▋    | 21711/37963 [49:12:48<35:41:13,  7.91s/it]
 57%|█████▋    | 21712/37963 [49:12:55<35:20:42,  7.83s/it]
 57%|█████▋    | 21713/37963 [49:13:03<34:49:03,  7.71s/it]
 57%|█████▋    | 21714/37963 [49:13:11<34:53:53,  7.73s/it]
 57%|█████▋    | 21715/37963 [49:13:19<35:18:48,  7.82s/it]
 57%|█████▋    | 21716/37963 [49:13:26<35:03:08,  7.77s/it]
 57%|█████▋    | 21717/37963 [49:13:34<34:35:22,  7.66s/it]
 57%|█████▋    | 21718/37963 [49:13:41<34:26:25,  7.63s/it]
 57%|█████▋    | 21719/37963 [49:13:52<38:00:05,  8.42s/it]
 57%|█████▋    | 21720/37963 [49:14:01<39:49:16,  8.83s/it]
                                                           
{'loss': '0.1476', 'grad_norm': '1.92', 'learning_rate': '8.161e-06', 'epoch': '0.5721'}
+
 57%|█████▋    | 21720/37963 [49:14:01<39:49:16,  8.83s/it]
 57%|█████▋    | 21721/37963 [49:14:09<37:51:07,  8.39s/it]
 57%|█████▋    | 21722/37963 [49:14:16<36:50:52,  8.17s/it]
 57%|█████▋    | 21723/37963 [49:14:24<36:21:59,  8.06s/it]
 57%|█████▋    | 21724/37963 [49:14:32<36:04:32,  8.00s/it]
 57%|█████▋    | 21725/37963 [49:14:39<35:15:11,  7.82s/it]
 57%|█████▋    | 21726/37963 [49:14:47<34:38:02,  7.68s/it]
 57%|█████▋    | 21727/37963 [49:14:54<34:22:29,  7.62s/it]
 57%|█████▋    | 21728/37963 [49:15:02<34:27:16,  7.64s/it]
 57%|█████▋    | 21729/37963 [49:15:10<34:30:08,  7.65s/it]
 57%|█████▋    | 21730/37963 [49:15:17<34:31:46,  7.66s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '2.27', 'learning_rate': '8.153e-06', 'epoch': '0.5724'}
+
 57%|█████▋    | 21730/37963 [49:15:17<34:31:46,  7.66s/it]
 57%|█████▋    | 21731/37963 [49:15:25<34:30:13,  7.65s/it]
 57%|█████▋    | 21732/37963 [49:15:33<34:48:34,  7.72s/it]
 57%|█████▋    | 21733/37963 [49:15:41<34:57:19,  7.75s/it]
 57%|█████▋    | 21734/37963 [49:15:48<34:34:42,  7.67s/it]
 57%|█████▋    | 21735/37963 [49:15:56<34:34:41,  7.67s/it]
 57%|█████▋    | 21736/37963 [49:16:06<38:17:44,  8.50s/it]
 57%|█████▋    | 21737/37963 [49:16:16<40:45:15,  9.04s/it]
 57%|█████▋    | 21738/37963 [49:16:24<39:03:01,  8.66s/it]
 57%|█████▋    | 21739/37963 [49:16:32<37:37:54,  8.35s/it]
 57%|█████▋    | 21740/37963 [49:16:40<36:40:59,  8.14s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '1.512', 'learning_rate': '8.144e-06', 'epoch': '0.5727'}
+
 57%|█████▋    | 21740/37963 [49:16:40<36:40:59,  8.14s/it]
 57%|█████▋    | 21741/37963 [49:16:47<35:52:12,  7.96s/it]
 57%|█████▋    | 21742/37963 [49:16:55<35:37:15,  7.91s/it]
 57%|█████▋    | 21743/37963 [49:17:03<35:32:55,  7.89s/it]
 57%|█████▋    | 21744/37963 [49:17:10<35:13:06,  7.82s/it]
 57%|█████▋    | 21745/37963 [49:17:20<38:22:11,  8.52s/it]
 57%|█████▋    | 21746/37963 [49:17:28<37:26:22,  8.31s/it]
 57%|█████▋    | 21747/37963 [49:17:36<36:59:09,  8.21s/it]
 57%|█████▋    | 21748/37963 [49:17:44<36:30:59,  8.11s/it]
 57%|█████▋    | 21749/37963 [49:17:52<35:58:20,  7.99s/it]
 57%|█████▋    | 21750/37963 [49:18:00<35:38:58,  7.92s/it]
                                                           
{'loss': '0.1516', 'grad_norm': '1.917', 'learning_rate': '8.136e-06', 'epoch': '0.5729'}
+
 57%|█████▋    | 21750/37963 [49:18:00<35:38:58,  7.92s/it]
 57%|█████▋    | 21751/37963 [49:18:10<39:10:25,  8.70s/it]
 57%|█████▋    | 21752/37963 [49:18:18<38:12:17,  8.48s/it]
 57%|█████▋    | 21753/37963 [49:18:29<40:50:15,  9.07s/it]
 57%|█████▋    | 21754/37963 [49:18:36<39:05:42,  8.68s/it]
 57%|█████▋    | 21755/37963 [49:18:44<37:52:55,  8.41s/it]
 57%|█████▋    | 21756/37963 [49:18:52<36:52:00,  8.19s/it]
 57%|█████▋    | 21757/37963 [49:19:00<36:25:44,  8.09s/it]
 57%|█████▋    | 21758/37963 [49:19:10<39:27:46,  8.77s/it]
 57%|█████▋    | 21759/37963 [49:19:18<38:09:38,  8.48s/it]
 57%|█████▋    | 21760/37963 [49:19:25<36:59:12,  8.22s/it]
                                                           
{'loss': '0.1453', 'grad_norm': '1.376', 'learning_rate': '8.127e-06', 'epoch': '0.5732'}
+
 57%|█████▋    | 21760/37963 [49:19:25<36:59:12,  8.22s/it]
 57%|█████▋    | 21761/37963 [49:19:33<36:14:40,  8.05s/it]
 57%|█████▋    | 21762/37963 [49:19:43<39:14:14,  8.72s/it]
 57%|█████▋    | 21763/37963 [49:19:51<38:07:05,  8.47s/it]
 57%|█████▋    | 21764/37963 [49:19:59<37:01:54,  8.23s/it]
 57%|█████▋    | 21765/37963 [49:20:07<36:20:05,  8.08s/it]
 57%|█████▋    | 21766/37963 [49:20:14<35:45:57,  7.95s/it]
 57%|█████▋    | 21767/37963 [49:20:22<35:44:46,  7.95s/it]
 57%|█████▋    | 21768/37963 [49:20:30<35:21:45,  7.86s/it]
 57%|█████▋    | 21769/37963 [49:20:38<35:15:00,  7.84s/it]
 57%|█████▋    | 21770/37963 [49:20:45<35:00:53,  7.78s/it]
                                                           
{'loss': '0.1515', 'grad_norm': '2.184', 'learning_rate': '8.119e-06', 'epoch': '0.5735'}
+
 57%|█████▋    | 21770/37963 [49:20:45<35:00:53,  7.78s/it]
 57%|█████▋    | 21771/37963 [49:20:53<35:11:12,  7.82s/it]
 57%|█████▋    | 21772/37963 [49:21:01<34:51:17,  7.75s/it]
 57%|█████▋    | 21773/37963 [49:21:08<34:40:42,  7.71s/it]
 57%|█████▋    | 21774/37963 [49:21:18<37:46:26,  8.40s/it]
 57%|█████▋    | 21775/37963 [49:21:26<36:51:33,  8.20s/it]
 57%|█████▋    | 21776/37963 [49:21:34<36:15:08,  8.06s/it]
 57%|█████▋    | 21777/37963 [49:21:42<35:55:08,  7.99s/it]
 57%|█████▋    | 21778/37963 [49:21:50<35:45:04,  7.95s/it]
 57%|█████▋    | 21779/37963 [49:21:57<35:23:24,  7.87s/it]
 57%|█████▋    | 21780/37963 [49:22:08<39:00:13,  8.68s/it]
                                                           
{'loss': '0.1559', 'grad_norm': '1.049', 'learning_rate': '8.111e-06', 'epoch': '0.5737'}
+
 57%|█████▋    | 21780/37963 [49:22:08<39:00:13,  8.68s/it]
 57%|█████▋    | 21781/37963 [49:22:16<37:55:17,  8.44s/it]
 57%|█████▋    | 21782/37963 [49:22:24<37:12:41,  8.28s/it]
 57%|█████▋    | 21783/37963 [49:22:31<36:26:14,  8.11s/it]
 57%|█████▋    | 21784/37963 [49:22:39<36:06:55,  8.04s/it]
 57%|█████▋    | 21785/37963 [49:22:47<35:14:15,  7.84s/it]
 57%|█████▋    | 21786/37963 [49:22:54<35:18:06,  7.86s/it]
 57%|█████▋    | 21787/37963 [49:23:02<34:56:36,  7.78s/it]
 57%|█████▋    | 21788/37963 [49:23:10<34:37:37,  7.71s/it]
 57%|█████▋    | 21789/37963 [49:23:20<38:07:13,  8.48s/it]
 57%|█████▋    | 21790/37963 [49:23:28<37:19:05,  8.31s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '1.71', 'learning_rate': '8.102e-06', 'epoch': '0.574'}
+
 57%|█████▋    | 21790/37963 [49:23:28<37:19:05,  8.31s/it]
 57%|█████▋    | 21791/37963 [49:23:38<39:54:27,  8.88s/it]
 57%|█████▋    | 21792/37963 [49:23:46<38:14:01,  8.51s/it]
 57%|█████▋    | 21793/37963 [49:23:54<37:19:11,  8.31s/it]
 57%|█████▋    | 21794/37963 [49:24:01<36:22:31,  8.10s/it]
 57%|█████▋    | 21795/37963 [49:24:12<40:00:43,  8.91s/it]
 57%|█████▋    | 21796/37963 [49:24:20<38:44:46,  8.63s/it]
 57%|█████▋    | 21797/37963 [49:24:28<37:30:14,  8.35s/it]
 57%|█████▋    | 21798/37963 [49:24:35<36:45:49,  8.19s/it]
 57%|█████▋    | 21799/37963 [49:24:43<36:28:22,  8.12s/it]
 57%|█████▋    | 21800/37963 [49:24:51<36:03:19,  8.03s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '2.258', 'learning_rate': '8.094e-06', 'epoch': '0.5742'}
+
 57%|█████▋    | 21800/37963 [49:24:51<36:03:19,  8.03s/it]
 57%|█████▋    | 21801/37963 [49:25:02<39:10:16,  8.73s/it]
 57%|█████▋    | 21802/37963 [49:25:09<37:51:23,  8.43s/it]
 57%|█████▋    | 21803/37963 [49:25:17<36:36:07,  8.15s/it]
 57%|█████▋    | 21804/37963 [49:25:25<36:06:47,  8.05s/it]
 57%|█████▋    | 21805/37963 [49:25:33<35:59:38,  8.02s/it]
 57%|█████▋    | 21806/37963 [49:25:40<35:41:44,  7.95s/it]
 57%|█████▋    | 21807/37963 [49:25:48<35:17:33,  7.86s/it]
 57%|█████▋    | 21808/37963 [49:25:56<34:57:25,  7.79s/it]
 57%|█████▋    | 21809/37963 [49:26:03<35:02:27,  7.81s/it]
 57%|█████▋    | 21810/37963 [49:26:14<38:24:10,  8.56s/it]
                                                           
{'loss': '0.15', 'grad_norm': '3.068', 'learning_rate': '8.086e-06', 'epoch': '0.5745'}
+
 57%|█████▋    | 21810/37963 [49:26:14<38:24:10,  8.56s/it]
 57%|█████▋    | 21811/37963 [49:26:21<37:04:42,  8.26s/it]
 57%|█████▋    | 21812/37963 [49:26:32<39:44:33,  8.86s/it]
 57%|█████▋    | 21813/37963 [49:26:39<38:05:01,  8.49s/it]
 57%|█████▋    | 21814/37963 [49:26:47<36:57:30,  8.24s/it]
 57%|█████▋    | 21815/37963 [49:26:54<35:59:33,  8.02s/it]
 57%|█████▋    | 21816/37963 [49:27:02<35:07:05,  7.83s/it]
 57%|█████▋    | 21817/37963 [49:27:09<34:49:04,  7.76s/it]
 57%|█████▋    | 21818/37963 [49:27:17<34:32:52,  7.70s/it]
 57%|█████▋    | 21819/37963 [49:27:25<34:27:48,  7.69s/it]
 57%|█████▋    | 21820/37963 [49:27:33<34:44:37,  7.75s/it]
                                                           
{'loss': '0.1436', 'grad_norm': '2.157', 'learning_rate': '8.077e-06', 'epoch': '0.5748'}
+
 57%|█████▋    | 21820/37963 [49:27:33<34:44:37,  7.75s/it]
 57%|█████▋    | 21821/37963 [49:27:40<34:25:08,  7.68s/it]
 57%|█████▋    | 21822/37963 [49:27:48<34:20:13,  7.66s/it]
 57%|█████▋    | 21823/37963 [49:27:55<34:29:40,  7.69s/it]
 57%|█████▋    | 21824/37963 [49:28:03<34:28:36,  7.69s/it]
 57%|█████▋    | 21825/37963 [49:28:11<34:11:37,  7.63s/it]
 57%|█████▋    | 21826/37963 [49:28:18<34:29:47,  7.70s/it]
 57%|█████▋    | 21827/37963 [49:28:26<34:46:22,  7.76s/it]
 57%|█████▋    | 21828/37963 [49:28:39<41:35:12,  9.28s/it]
 58%|█████▊    | 21829/37963 [49:28:47<39:30:34,  8.82s/it]
 58%|█████▊    | 21830/37963 [49:28:55<38:00:44,  8.48s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '2.768', 'learning_rate': '8.069e-06', 'epoch': '0.575'}
+
 58%|█████▊    | 21830/37963 [49:28:55<38:00:44,  8.48s/it]
 58%|█████▊    | 21831/37963 [49:29:02<36:57:24,  8.25s/it]
 58%|█████▊    | 21832/37963 [49:29:10<36:19:40,  8.11s/it]
 58%|█████▊    | 21833/37963 [49:29:18<35:52:32,  8.01s/it]
 58%|█████▊    | 21834/37963 [49:29:26<35:32:58,  7.93s/it]
 58%|█████▊    | 21835/37963 [49:29:33<34:57:43,  7.80s/it]
 58%|█████▊    | 21836/37963 [49:29:41<34:47:25,  7.77s/it]
 58%|█████▊    | 21837/37963 [49:29:51<38:05:51,  8.50s/it]
 58%|█████▊    | 21838/37963 [49:29:59<37:22:49,  8.35s/it]
 58%|█████▊    | 21839/37963 [49:30:09<39:32:38,  8.83s/it]
 58%|█████▊    | 21840/37963 [49:30:17<37:59:40,  8.48s/it]
                                                           
{'loss': '0.1525', 'grad_norm': '2.546', 'learning_rate': '8.06e-06', 'epoch': '0.5753'}
+
 58%|█████▊    | 21840/37963 [49:30:17<37:59:40,  8.48s/it]
 58%|█████▊    | 21841/37963 [49:30:25<37:22:29,  8.35s/it]
 58%|█████▊    | 21842/37963 [49:30:32<36:29:23,  8.15s/it]
 58%|█████▊    | 21843/37963 [49:30:40<36:00:24,  8.04s/it]
 58%|█████▊    | 21844/37963 [49:30:48<35:39:18,  7.96s/it]
 58%|█████▊    | 21845/37963 [49:30:56<35:27:54,  7.92s/it]
 58%|█████▊    | 21846/37963 [49:31:03<35:10:19,  7.86s/it]
 58%|█████▊    | 21847/37963 [49:31:11<35:03:47,  7.83s/it]
 58%|█████▊    | 21848/37963 [49:31:19<35:14:04,  7.87s/it]
 58%|█████▊    | 21849/37963 [49:31:30<39:01:47,  8.72s/it]
 58%|█████▊    | 21850/37963 [49:31:38<38:07:55,  8.52s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '0.9738', 'learning_rate': '8.052e-06', 'epoch': '0.5756'}
+
 58%|█████▊    | 21850/37963 [49:31:38<38:07:55,  8.52s/it]
 58%|█████▊    | 21851/37963 [49:31:46<37:19:33,  8.34s/it]
 58%|█████▊    | 21852/37963 [49:31:54<36:40:23,  8.19s/it]
 58%|█████▊    | 21853/37963 [49:32:04<39:55:56,  8.92s/it]
 58%|█████▊    | 21854/37963 [49:32:15<41:42:49,  9.32s/it]
 58%|█████▊    | 21855/37963 [49:32:22<39:40:02,  8.87s/it]
 58%|█████▊    | 21856/37963 [49:32:30<38:05:16,  8.51s/it]
 58%|█████▊    | 21857/37963 [49:32:38<36:56:28,  8.26s/it]
 58%|█████▊    | 21858/37963 [49:32:45<36:10:55,  8.09s/it]
 58%|█████▊    | 21859/37963 [49:32:53<35:57:02,  8.04s/it]
 58%|█████▊    | 21860/37963 [49:33:04<39:03:22,  8.73s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '1.453', 'learning_rate': '8.044e-06', 'epoch': '0.5758'}
+
 58%|█████▊    | 21860/37963 [49:33:04<39:03:22,  8.73s/it]
 58%|█████▊    | 21861/37963 [49:33:12<37:48:41,  8.45s/it]
 58%|█████▊    | 21862/37963 [49:33:19<36:16:20,  8.11s/it]
 58%|█████▊    | 21863/37963 [49:33:27<35:42:57,  7.99s/it]
 58%|█████▊    | 21864/37963 [49:33:34<35:21:45,  7.91s/it]
 58%|█████▊    | 21865/37963 [49:33:42<35:01:35,  7.83s/it]
 58%|█████▊    | 21866/37963 [49:33:50<35:10:40,  7.87s/it]
 58%|█████▊    | 21867/37963 [49:33:58<35:11:48,  7.87s/it]
 58%|█████▊    | 21868/37963 [49:34:05<34:52:40,  7.80s/it]
 58%|█████▊    | 21869/37963 [49:34:13<34:38:15,  7.75s/it]
 58%|█████▊    | 21870/37963 [49:34:21<34:37:59,  7.75s/it]
                                                           
{'loss': '0.1405', 'grad_norm': '1.303', 'learning_rate': '8.035e-06', 'epoch': '0.5761'}
+
 58%|█████▊    | 21870/37963 [49:34:21<34:37:59,  7.75s/it]
 58%|█████▊    | 21871/37963 [49:34:29<34:39:46,  7.75s/it]
 58%|█████▊    | 21872/37963 [49:34:36<34:56:33,  7.82s/it]
 58%|█████▊    | 21873/37963 [49:34:44<35:02:01,  7.84s/it]
 58%|█████▊    | 21874/37963 [49:34:52<34:32:01,  7.73s/it]
 58%|█████▊    | 21875/37963 [49:35:00<34:36:14,  7.74s/it]
 58%|█████▊    | 21876/37963 [49:35:07<33:54:11,  7.59s/it]
 58%|█████▊    | 21877/37963 [49:35:15<34:09:29,  7.64s/it]
 58%|█████▊    | 21878/37963 [49:35:22<34:13:06,  7.66s/it]
 58%|█████▊    | 21879/37963 [49:35:30<34:23:47,  7.70s/it]
 58%|█████▊    | 21880/37963 [49:35:41<38:14:59,  8.56s/it]
                                                           
{'loss': '0.1415', 'grad_norm': '2.093', 'learning_rate': '8.027e-06', 'epoch': '0.5764'}
+
 58%|█████▊    | 21880/37963 [49:35:41<38:14:59,  8.56s/it]
 58%|█████▊    | 21881/37963 [49:35:49<37:17:59,  8.35s/it]
 58%|█████▊    | 21882/37963 [49:36:02<43:51:16,  9.82s/it]
 58%|█████▊    | 21883/37963 [49:36:10<41:11:38,  9.22s/it]
 58%|█████▊    | 21884/37963 [49:36:18<39:27:46,  8.84s/it]
 58%|█████▊    | 21885/37963 [49:36:25<38:17:11,  8.57s/it]
 58%|█████▊    | 21886/37963 [49:36:33<37:06:20,  8.31s/it]
 58%|█████▊    | 21887/37963 [49:36:41<35:48:54,  8.02s/it]
 58%|█████▊    | 21888/37963 [49:36:48<35:14:54,  7.89s/it]
 58%|█████▊    | 21889/37963 [49:36:56<35:00:45,  7.84s/it]
 58%|█████▊    | 21890/37963 [49:37:04<34:46:15,  7.79s/it]
                                                           
{'loss': '0.1685', 'grad_norm': '3.053', 'learning_rate': '8.019e-06', 'epoch': '0.5766'}
+
 58%|█████▊    | 21890/37963 [49:37:04<34:46:15,  7.79s/it]
 58%|█████▊    | 21891/37963 [49:37:11<34:37:53,  7.76s/it]
 58%|█████▊    | 21892/37963 [49:37:19<34:25:58,  7.71s/it]
 58%|█████▊    | 21893/37963 [49:37:29<37:48:03,  8.47s/it]
 58%|█████▊    | 21894/37963 [49:37:37<36:36:46,  8.20s/it]
 58%|█████▊    | 21895/37963 [49:37:44<36:01:39,  8.07s/it]
 58%|█████▊    | 21896/37963 [49:37:52<35:32:47,  7.96s/it]
 58%|█████▊    | 21897/37963 [49:38:05<42:17:16,  9.48s/it]
 58%|█████▊    | 21898/37963 [49:38:13<39:59:14,  8.96s/it]
 58%|█████▊    | 21899/37963 [49:38:21<38:38:03,  8.66s/it]
 58%|█████▊    | 21900/37963 [49:38:29<37:29:47,  8.40s/it]
                                                           
{'loss': '0.1452', 'grad_norm': '1.109', 'learning_rate': '8.01e-06', 'epoch': '0.5769'}
+
 58%|█████▊    | 21900/37963 [49:38:29<37:29:47,  8.40s/it]
 58%|█████▊    | 21901/37963 [49:38:36<36:35:58,  8.20s/it]
 58%|█████▊    | 21902/37963 [49:38:44<35:50:49,  8.03s/it]
 58%|█████▊    | 21903/37963 [49:38:52<35:33:53,  7.97s/it]
 58%|█████▊    | 21904/37963 [49:39:00<35:19:00,  7.92s/it]
 58%|█████▊    | 21905/37963 [49:39:07<34:59:53,  7.85s/it]
 58%|█████▊    | 21906/37963 [49:39:15<34:46:17,  7.80s/it]
 58%|█████▊    | 21907/37963 [49:39:25<38:23:35,  8.61s/it]
 58%|███���█▊    | 21908/37963 [49:39:33<37:02:14,  8.30s/it]
 58%|█████▊    | 21909/37963 [49:39:41<36:15:24,  8.13s/it]
 58%|█████▊    | 21910/37963 [49:39:48<35:29:39,  7.96s/it]
                                                           
{'loss': '0.151', 'grad_norm': '2.403', 'learning_rate': '8.002e-06', 'epoch': '0.5771'}
+
 58%|█████▊    | 21910/37963 [49:39:48<35:29:39,  7.96s/it]
 58%|█████▊    | 21911/37963 [49:39:56<35:11:07,  7.89s/it]
 58%|█████▊    | 21912/37963 [49:40:04<35:00:13,  7.85s/it]
 58%|█████▊    | 21913/37963 [49:40:11<34:44:23,  7.79s/it]
 58%|█████▊    | 21914/37963 [49:40:22<38:04:05,  8.54s/it]
 58%|█████▊    | 21915/37963 [49:40:29<36:54:11,  8.28s/it]
 58%|█████▊    | 21916/37963 [49:40:37<36:05:42,  8.10s/it]
 58%|█████▊    | 21917/37963 [49:40:45<35:32:36,  7.97s/it]
 58%|█████▊    | 21918/37963 [49:40:52<35:06:38,  7.88s/it]
 58%|█████▊    | 21919/37963 [49:41:00<34:56:49,  7.84s/it]
 58%|█████▊    | 21920/37963 [49:41:08<34:44:56,  7.80s/it]
                                                           
{'loss': '0.1431', 'grad_norm': '2.504', 'learning_rate': '7.993e-06', 'epoch': '0.5774'}
+
 58%|█████▊    | 21920/37963 [49:41:08<34:44:56,  7.80s/it]
 58%|█████▊    | 21921/37963 [49:41:16<35:01:50,  7.86s/it]
 58%|█████▊    | 21922/37963 [49:41:24<34:49:31,  7.82s/it]
 58%|█████▊    | 21923/37963 [49:41:31<34:49:39,  7.82s/it]
 58%|█████▊    | 21924/37963 [49:41:39<34:39:30,  7.78s/it]
 58%|█████▊    | 21925/37963 [49:41:47<34:28:59,  7.74s/it]
 58%|█████▊    | 21926/37963 [49:41:54<34:10:38,  7.67s/it]
 58%|█████▊    | 21927/37963 [49:42:02<34:07:25,  7.66s/it]
 58%|█████▊    | 21928/37963 [49:42:10<34:11:51,  7.68s/it]
 58%|█████▊    | 21929/37963 [49:42:17<33:57:20,  7.62s/it]
 58%|█████▊    | 21930/37963 [49:42:25<33:43:23,  7.57s/it]
                                                           
{'loss': '0.1404', 'grad_norm': '1.316', 'learning_rate': '7.985e-06', 'epoch': '0.5777'}
+
 58%|█████▊    | 21930/37963 [49:42:25<33:43:23,  7.57s/it]
 58%|█████▊    | 21931/37963 [49:42:35<36:49:21,  8.27s/it]
 58%|█████▊    | 21932/37963 [49:42:42<35:26:28,  7.96s/it]
 58%|█████▊    | 21933/37963 [49:42:49<35:08:48,  7.89s/it]
 58%|█████▊    | 21934/37963 [49:43:00<38:13:11,  8.58s/it]
 58%|█████▊    | 21935/37963 [49:43:07<37:10:06,  8.35s/it]
 58%|█████▊    | 21936/37963 [49:43:18<40:32:21,  9.11s/it]
 58%|█████▊    | 21937/37963 [49:43:26<39:04:09,  8.78s/it]
 58%|█████▊    | 21938/37963 [49:43:34<37:33:00,  8.44s/it]
 58%|█████▊    | 21939/37963 [49:43:42<36:40:47,  8.24s/it]
 58%|█████▊    | 21940/37963 [49:43:49<35:35:23,  8.00s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '0.9768', 'learning_rate': '7.977e-06', 'epoch': '0.5779'}
+
 58%|█████▊    | 21940/37963 [49:43:49<35:35:23,  8.00s/it]
 58%|█████▊    | 21941/37963 [49:43:57<35:16:06,  7.92s/it]
 58%|█████▊    | 21942/37963 [49:44:05<34:46:31,  7.81s/it]
 58%|█████▊    | 21943/37963 [49:44:12<34:40:47,  7.79s/it]
 58%|█████▊    | 21944/37963 [49:44:20<34:46:34,  7.82s/it]
 58%|█████▊    | 21945/37963 [49:44:30<38:05:32,  8.56s/it]
 58%|█████▊    | 21946/37963 [49:44:38<37:15:14,  8.37s/it]
 58%|█████▊    | 21947/37963 [49:44:49<39:36:04,  8.90s/it]
 58%|█████▊    | 21948/37963 [49:44:57<38:25:44,  8.64s/it]
 58%|█████▊    | 21949/37963 [49:45:04<37:20:36,  8.39s/it]
 58%|█████▊    | 21950/37963 [49:45:12<36:29:27,  8.20s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '1.9', 'learning_rate': '7.968e-06', 'epoch': '0.5782'}
+
 58%|█████▊    | 21950/37963 [49:45:12<36:29:27,  8.20s/it]
 58%|█████▊    | 21951/37963 [49:45:25<42:40:48,  9.60s/it]
 58%|█████▊    | 21952/37963 [49:45:33<40:19:43,  9.07s/it]
 58%|█████▊    | 21953/37963 [49:45:40<38:24:55,  8.64s/it]
 58%|█████▊    | 21954/37963 [49:45:48<37:16:06,  8.38s/it]
 58%|█████▊    | 21955/37963 [49:45:56<36:21:53,  8.18s/it]
 58%|█████▊    | 21956/37963 [49:46:04<35:52:04,  8.07s/it]
 58%|█████▊    | 21957/37963 [49:46:11<35:17:24,  7.94s/it]
 58%|█████▊    | 21958/37963 [49:46:19<34:51:12,  7.84s/it]
 58%|█████▊    | 21959/37963 [49:46:27<34:42:55,  7.81s/it]
 58%|█████▊    | 21960/37963 [49:46:37<38:14:53,  8.60s/it]
                                                           
{'loss': '0.1471', 'grad_norm': '3.391', 'learning_rate': '7.96e-06', 'epoch': '0.5785'}
+
 58%|█████▊    | 21960/37963 [49:46:37<38:14:53,  8.60s/it]
 58%|█████▊    | 21961/37963 [49:46:45<37:11:24,  8.37s/it]
 58%|█████▊    | 21962/37963 [49:46:53<36:33:17,  8.22s/it]
 58%|█████▊    | 21963/37963 [49:47:01<36:01:39,  8.11s/it]
 58%|█████▊    | 21964/37963 [49:47:09<35:39:07,  8.02s/it]
 58%|█████▊    | 21965/37963 [49:47:16<35:27:45,  7.98s/it]
 58%|█████▊    | 21966/37963 [49:47:24<35:20:18,  7.95s/it]
 58%|█████▊    | 21967/37963 [49:47:32<34:30:43,  7.77s/it]
 58%|█████▊    | 21968/37963 [49:47:39<34:16:22,  7.71s/it]
 58%|█████▊    | 21969/37963 [49:47:47<34:32:37,  7.78s/it]
 58%|█████▊    | 21970/37963 [49:47:55<34:19:14,  7.73s/it]
                                                           
{'loss': '0.1529', 'grad_norm': '1.091', 'learning_rate': '7.952e-06', 'epoch': '0.5787'}
+
 58%|█████▊    | 21970/37963 [49:47:55<34:19:14,  7.73s/it]
 58%|█████▊    | 21971/37963 [49:48:02<34:10:47,  7.69s/it]
 58%|█████▊    | 21972/37963 [49:48:10<34:06:55,  7.68s/it]
 58%|█████▊    | 21973/37963 [49:48:18<34:01:09,  7.66s/it]
 58%|█████▊    | 21974/37963 [49:48:25<34:17:10,  7.72s/it]
 58%|█████▊    | 21975/37963 [49:48:33<34:37:08,  7.80s/it]
 58%|█████▊    | 21976/37963 [49:48:41<34:27:16,  7.76s/it]
 58%|█████▊    | 21977/37963 [49:48:49<34:29:33,  7.77s/it]
 58%|█████▊    | 21978/37963 [49:48:56<34:08:20,  7.69s/it]
 58%|█████▊    | 21979/37963 [49:49:04<34:11:44,  7.70s/it]
 58%|█████▊    | 21980/37963 [49:49:12<33:57:27,  7.65s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '2.544', 'learning_rate': '7.943e-06', 'epoch': '0.579'}
+
 58%|█████▊    | 21980/37963 [49:49:12<33:57:27,  7.65s/it]
 58%|█████▊    | 21981/37963 [49:49:19<33:53:01,  7.63s/it]
 58%|█████▊    | 21982/37963 [49:49:27<34:05:36,  7.68s/it]
 58%|█████▊    | 21983/37963 [49:49:37<37:12:03,  8.38s/it]
 58%|█████▊    | 21984/37963 [49:49:44<35:53:27,  8.09s/it]
 58%|█████▊    | 21985/37963 [49:49:55<38:42:37,  8.72s/it]
 58%|█████▊    | 21986/37963 [49:50:02<37:21:59,  8.42s/it]
 58%|█████▊    | 21987/37963 [49:50:10<36:35:10,  8.24s/it]
 58%|█████▊    | 21988/37963 [49:50:18<35:49:12,  8.07s/it]
 58%|█████▊    | 21989/37963 [49:50:29<39:11:06,  8.83s/it]
 58%|█████▊    | 21990/37963 [49:50:39<41:22:35,  9.33s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '2.32', 'learning_rate': '7.935e-06', 'epoch': '0.5793'}
+
 58%|█████▊    | 21990/37963 [49:50:39<41:22:35,  9.33s/it]
 58%|█████▊    | 21991/37963 [49:50:50<42:59:17,  9.69s/it]
 58%|█████▊    | 21992/37963 [49:50:57<40:35:38,  9.15s/it]
 58%|█████▊    | 21993/37963 [49:51:05<38:58:16,  8.78s/it]
 58%|█████▊    | 21994/37963 [49:51:13<37:36:23,  8.48s/it]
 58%|█████▊    | 21995/37963 [49:51:21<36:43:46,  8.28s/it]
 58%|█████▊    | 21996/37963 [49:51:29<36:27:09,  8.22s/it]
 58%|█████▊    | 21997/37963 [49:51:39<39:28:29,  8.90s/it]
 58%|█████▊    | 21998/37963 [49:51:47<37:50:00,  8.53s/it]
 58%|█████▊    | 21999/37963 [49:51:55<37:09:29,  8.38s/it]
 58%|█████▊    | 22000/37963 [49:52:05<39:39:31,  8.94s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '1.741', 'learning_rate': '7.927e-06', 'epoch': '0.5795'}
+
 58%|█████▊    | 22000/37963 [49:52:05<39:39:31,  8.94s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.92s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.92s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 58%|█████▊    | 22001/37963 [49:53:10<114:06:21, 25.73s/it]
 58%|█████▊    | 22002/37963 [49:53:18<90:25:56, 20.40s/it] 
 58%|█████▊    | 22003/37963 [49:53:26<73:41:27, 16.62s/it]
 58%|█████▊    | 22004/37963 [49:53:34<61:42:22, 13.92s/it]
 58%|█████▊    | 22005/37963 [49:53:41<53:04:14, 11.97s/it]
 58%|█████▊    | 22006/37963 [49:53:49<47:29:08, 10.71s/it]
 58%|█████▊    | 22007/37963 [49:53:57<43:28:56,  9.81s/it]
 58%|█████▊    | 22008/37963 [49:54:05<40:53:29,  9.23s/it]
 58%|█████▊    | 22009/37963 [49:54:15<42:23:50,  9.57s/it]
 58%|█████▊    | 22010/37963 [49:54:23<40:05:21,  9.05s/it]
                                                           
{'loss': '0.1654', 'grad_norm': '2.684', 'learning_rate': '7.918e-06', 'epoch': '0.5798'}
+
 58%|█████▊    | 22010/37963 [49:54:23<40:05:21,  9.05s/it]
 58%|█████▊    | 22011/37963 [49:54:30<38:10:21,  8.61s/it]
 58%|█████▊    | 22012/37963 [49:54:38<36:49:18,  8.31s/it]
 58%|█████▊    | 22013/37963 [49:54:45<35:51:27,  8.09s/it]
 58%|█████▊    | 22014/37963 [49:54:54<35:46:28,  8.08s/it]
 58%|█████▊    | 22015/37963 [49:55:02<35:39:34,  8.05s/it]
 58%|█████▊    | 22016/37963 [49:55:09<35:25:15,  8.00s/it]
 58%|█████▊    | 22017/37963 [49:55:17<35:33:33,  8.03s/it]
 58%|█████▊    | 22018/37963 [49:55:25<35:25:38,  8.00s/it]
 58%|█████▊    | 22019/37963 [49:55:33<35:10:41,  7.94s/it]
 58%|█████▊    | 22020/37963 [49:55:41<34:25:37,  7.77s/it]
                                                           
{'loss': '0.1516', 'grad_norm': '3.095', 'learning_rate': '7.91e-06', 'epoch': '0.58'}
+
 58%|█████▊    | 22020/37963 [49:55:41<34:25:37,  7.77s/it]
 58%|█████▊    | 22021/37963 [49:55:49<34:35:19,  7.81s/it]
 58%|█████▊    | 22022/37963 [49:55:56<34:19:54,  7.75s/it]
 58%|█████▊    | 22023/37963 [49:56:04<34:18:25,  7.75s/it]
 58%|█████▊    | 22024/37963 [49:56:12<34:26:27,  7.78s/it]
 58%|█████▊    | 22025/37963 [49:56:19<34:08:16,  7.71s/it]
 58%|█████▊    | 22026/37963 [49:56:27<33:56:40,  7.67s/it]
 58%|█████▊    | 22027/37963 [49:56:34<33:48:00,  7.64s/it]
 58%|█████▊    | 22028/37963 [49:56:42<34:11:51,  7.73s/it]
 58%|█████▊    | 22029/37963 [49:56:53<37:47:10,  8.54s/it]
 58%|█████▊    | 22030/37963 [49:57:01<36:56:11,  8.35s/it]
                                                           
{'loss': '0.1455', 'grad_norm': '1.483', 'learning_rate': '7.902e-06', 'epoch': '0.5803'}
+
 58%|█████▊    | 22030/37963 [49:57:01<36:56:11,  8.35s/it]
 58%|█████▊    | 22031/37963 [49:57:08<36:14:42,  8.19s/it]
 58%|█████▊    | 22032/37963 [49:57:16<35:46:45,  8.09s/it]
 58%|█████▊    | 22033/37963 [49:57:24<35:36:50,  8.05s/it]
 58%|█████▊    | 22034/37963 [49:57:32<35:18:44,  7.98s/it]
 58%|█████▊    | 22035/37963 [49:57:42<38:03:55,  8.60s/it]
 58%|█████▊    | 22036/37963 [49:57:50<36:58:44,  8.36s/it]
 58%|█████▊    | 22037/37963 [49:57:57<35:52:05,  8.11s/it]
 58%|█████▊    | 22038/37963 [49:58:08<38:54:57,  8.80s/it]
 58%|█████▊    | 22039/37963 [49:58:18<41:00:31,  9.27s/it]
 58%|█████▊    | 22040/37963 [49:58:29<42:27:13,  9.60s/it]
                                                           
{'loss': '0.1514', 'grad_norm': '1.821', 'learning_rate': '7.893e-06', 'epoch': '0.5806'}
+
 58%|█████▊    | 22040/37963 [49:58:29<42:27:13,  9.60s/it]
 58%|█████▊    | 22041/37963 [49:58:36<40:01:16,  9.05s/it]
 58%|█████▊    | 22042/37963 [49:58:44<38:41:13,  8.75s/it]
 58%|█████▊    | 22043/37963 [49:58:52<37:32:21,  8.49s/it]
 58%|█████▊    | 22044/37963 [49:59:03<40:13:43,  9.10s/it]
 58%|█████▊    | 22045/37963 [49:59:11<38:21:30,  8.68s/it]
 58%|█████▊    | 22046/37963 [49:59:18<37:21:55,  8.45s/it]
 58%|█████▊    | 22047/37963 [49:59:26<36:22:54,  8.23s/it]
 58%|█████▊    | 22048/37963 [49:59:34<35:20:41,  8.00s/it]
 58%|█████▊    | 22049/37963 [49:59:41<34:47:39,  7.87s/it]
 58%|█████▊    | 22050/37963 [49:59:49<34:07:13,  7.72s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '2.858', 'learning_rate': '7.885e-06', 'epoch': '0.5808'}
+
 58%|█████▊    | 22050/37963 [49:59:49<34:07:13,  7.72s/it]
 58%|█████▊    | 22051/37963 [49:59:56<33:46:01,  7.64s/it]
 58%|█████▊    | 22052/37963 [50:00:04<33:42:17,  7.63s/it]
 58%|█████▊    | 22053/37963 [50:00:14<37:18:39,  8.44s/it]
 58%|█████▊    | 22054/37963 [50:00:24<39:45:14,  9.00s/it]
 58%|█████▊    | 22055/37963 [50:00:32<38:10:29,  8.64s/it]
 58%|█████▊    | 22056/37963 [50:00:39<36:34:59,  8.28s/it]
 58%|█████▊    | 22057/37963 [50:00:47<35:58:43,  8.14s/it]
 58%|█████▊    | 22058/37963 [50:00:55<35:31:59,  8.04s/it]
 58%|█████▊    | 22059/37963 [50:01:03<35:06:18,  7.95s/it]
 58%|█████▊    | 22060/37963 [50:01:11<35:10:16,  7.96s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '2.151', 'learning_rate': '7.877e-06', 'epoch': '0.5811'}
+
 58%|█████▊    | 22060/37963 [50:01:11<35:10:16,  7.96s/it]
 58%|█████▊    | 22061/37963 [50:01:18<34:37:44,  7.84s/it]
 58%|█████▊    | 22062/37963 [50:01:26<34:41:04,  7.85s/it]
 58%|█████▊    | 22063/37963 [50:01:34<34:31:11,  7.82s/it]
 58%|█████▊    | 22064/37963 [50:01:42<34:19:29,  7.77s/it]
 58%|█████▊    | 22065/37963 [50:01:49<34:14:02,  7.75s/it]
 58%|█████▊    | 22066/37963 [50:01:57<33:47:26,  7.65s/it]
 58%|█████▊    | 22067/37963 [50:02:05<33:57:05,  7.69s/it]
 58%|█████▊    | 22068/37963 [50:02:12<33:27:16,  7.58s/it]
 58%|█████▊    | 22069/37963 [50:02:19<33:28:13,  7.58s/it]
 58%|█████▊    | 22070/37963 [50:02:27<33:30:20,  7.59s/it]
                                                           
{'loss': '0.1562', 'grad_norm': '1.248', 'learning_rate': '7.868e-06', 'epoch': '0.5814'}
+
 58%|█████▊    | 22070/37963 [50:02:27<33:30:20,  7.59s/it]
 58%|█████▊    | 22071/37963 [50:02:34<33:14:56,  7.53s/it]
 58%|█████▊    | 22072/37963 [50:02:42<33:21:57,  7.56s/it]
 58%|█████▊    | 22073/37963 [50:02:50<33:29:50,  7.59s/it]
 58%|█████▊    | 22074/37963 [50:02:57<33:12:04,  7.52s/it]
 58%|█████▊    | 22075/37963 [50:03:05<33:30:39,  7.59s/it]
 58%|█████▊    | 22076/37963 [50:03:13<33:44:08,  7.64s/it]
 58%|█████▊    | 22077/37963 [50:03:20<33:54:30,  7.68s/it]
 58%|█████▊    | 22078/37963 [50:03:28<33:53:13,  7.68s/it]
 58%|█████▊    | 22079/37963 [50:03:38<37:26:23,  8.49s/it]
 58%|█████▊    | 22080/37963 [50:03:46<36:41:00,  8.31s/it]
                                                           
{'loss': '0.153', 'grad_norm': '1.16', 'learning_rate': '7.86e-06', 'epoch': '0.5816'}
+
 58%|█████▊    | 22080/37963 [50:03:46<36:41:00,  8.31s/it]
 58%|█████▊    | 22081/37963 [50:03:54<36:02:14,  8.17s/it]
 58%|█████▊    | 22082/37963 [50:04:05<39:07:15,  8.87s/it]
 58%|█████▊    | 22083/37963 [50:04:18<44:19:04, 10.05s/it]
 58%|█████▊    | 22084/37963 [50:04:25<41:26:02,  9.39s/it]
 58%|█████▊    | 22085/37963 [50:04:33<39:06:52,  8.87s/it]
 58%|█████▊    | 22086/37963 [50:04:41<37:44:31,  8.56s/it]
 58%|█████▊    | 22087/37963 [50:04:51<40:23:01,  9.16s/it]
 58%|█████▊    | 22088/37963 [50:04:59<38:20:59,  8.70s/it]
 58%|█████▊    | 22089/37963 [50:05:06<36:38:09,  8.31s/it]
 58%|█████▊    | 22090/37963 [50:05:14<36:05:57,  8.19s/it]
                                                           
{'loss': '0.1474', 'grad_norm': '2.127', 'learning_rate': '7.852e-06', 'epoch': '0.5819'}
+
 58%|█████▊    | 22090/37963 [50:05:14<36:05:57,  8.19s/it]
 58%|█████▊    | 22091/37963 [50:05:22<35:14:26,  7.99s/it]
 58%|█████▊    | 22092/37963 [50:05:32<38:40:42,  8.77s/it]
 58%|█████▊    | 22093/37963 [50:05:40<36:59:43,  8.39s/it]
 58%|█████▊    | 22094/37963 [50:05:48<36:01:49,  8.17s/it]
 58%|█████▊    | 22095/37963 [50:05:55<35:13:49,  7.99s/it]
 58%|█████▊    | 22096/37963 [50:06:03<34:46:10,  7.89s/it]
 58%|█████▊    | 22097/37963 [50:06:13<37:45:53,  8.57s/it]
 58%|█████▊    | 22098/37963 [50:06:21<37:03:04,  8.41s/it]
 58%|█████▊    | 22099/37963 [50:06:29<36:10:11,  8.21s/it]
 58%|█████▊    | 22100/37963 [50:06:37<35:36:49,  8.08s/it]
                                                           
{'loss': '0.1543', 'grad_norm': '3.04', 'learning_rate': '7.843e-06', 'epoch': '0.5821'}
+
 58%|█████▊    | 22100/37963 [50:06:37<35:36:49,  8.08s/it]
 58%|█████▊    | 22101/37963 [50:06:44<35:18:27,  8.01s/it]
 58%|█████▊    | 22102/37963 [50:06:52<35:05:47,  7.97s/it]
 58%|█████▊    | 22103/37963 [50:07:00<35:03:11,  7.96s/it]
 58%|█████▊    | 22104/37963 [50:07:08<34:48:29,  7.90s/it]
 58%|█████▊    | 22105/37963 [50:07:16<34:55:45,  7.93s/it]
 58%|█████▊    | 22106/37963 [50:07:24<34:49:35,  7.91s/it]
 58%|█████▊    | 22107/37963 [50:07:31<34:11:17,  7.76s/it]
 58%|█████▊    | 22108/37963 [50:07:41<37:19:03,  8.47s/it]
 58%|█████▊    | 22109/37963 [50:07:49<36:23:12,  8.26s/it]
 58%|█████▊    | 22110/37963 [50:07:57<35:26:11,  8.05s/it]
                                                           
{'loss': '0.1397', 'grad_norm': '1.22', 'learning_rate': '7.835e-06', 'epoch': '0.5824'}
+
 58%|█████▊    | 22110/37963 [50:07:57<35:26:11,  8.05s/it]
 58%|█████▊    | 22111/37963 [50:08:04<34:41:50,  7.88s/it]
 58%|█████▊    | 22112/37963 [50:08:12<34:33:51,  7.85s/it]
 58%|█████▊    | 22113/37963 [50:08:20<34:10:36,  7.76s/it]
 58%|█████▊    | 22114/37963 [50:08:27<34:03:11,  7.73s/it]
 58%|█████▊    | 22115/37963 [50:08:35<34:08:25,  7.76s/it]
 58%|█████▊    | 22116/37963 [50:08:43<34:02:51,  7.73s/it]
 58%|█████▊    | 22117/37963 [50:08:50<33:50:12,  7.69s/it]
 58%|█████▊    | 22118/37963 [50:08:58<34:09:42,  7.76s/it]
 58%|█████▊    | 22119/37963 [50:09:06<34:06:56,  7.75s/it]
 58%|█████▊    | 22120/37963 [50:09:14<33:54:35,  7.71s/it]
                                                           
{'loss': '0.1608', 'grad_norm': '3.46', 'learning_rate': '7.827e-06', 'epoch': '0.5827'}
+
 58%|█████▊    | 22120/37963 [50:09:14<33:54:35,  7.71s/it]
 58%|█████▊    | 22121/37963 [50:09:21<34:08:32,  7.76s/it]
 58%|█████▊    | 22122/37963 [50:09:31<37:10:23,  8.45s/it]
 58%|█████▊    | 22123/37963 [50:09:39<36:05:19,  8.20s/it]
 58%|█████▊    | 22124/37963 [50:09:47<35:22:24,  8.04s/it]
 58%|█████▊    | 22125/37963 [50:09:54<34:56:18,  7.94s/it]
 58%|█████▊    | 22126/37963 [50:10:02<34:30:40,  7.84s/it]
 58%|█████▊    | 22127/37963 [50:10:12<37:49:16,  8.60s/it]
 58%|█████▊    | 22128/37963 [50:10:20<36:12:41,  8.23s/it]
 58%|█████▊    | 22129/37963 [50:10:27<35:22:06,  8.04s/it]
 58%|█████▊    | 22130/37963 [50:10:38<38:33:00,  8.77s/it]
                                                           
{'loss': '0.145', 'grad_norm': '1.398', 'learning_rate': '7.818e-06', 'epoch': '0.5829'}
+
 58%|█████▊    | 22130/37963 [50:10:38<38:33:00,  8.77s/it]
 58%|█████▊    | 22131/37963 [50:10:48<40:45:26,  9.27s/it]
 58%|█████▊    | 22132/37963 [50:10:56<38:19:08,  8.71s/it]
 58%|█████▊    | 22133/37963 [50:11:03<36:22:32,  8.27s/it]
 58%|█████▊    | 22134/37963 [50:11:11<35:28:35,  8.07s/it]
 58%|█████▊    | 22135/37963 [50:11:18<34:27:18,  7.84s/it]
 58%|█████▊    | 22136/37963 [50:11:26<34:27:44,  7.84s/it]
 58%|█████▊    | 22137/37963 [50:11:36<37:54:06,  8.62s/it]
 58%|█████▊    | 22138/37963 [50:11:44<36:56:42,  8.40s/it]
 58%|█████▊    | 22139/37963 [50:11:52<35:57:06,  8.18s/it]
 58%|█████▊    | 22140/37963 [50:12:02<38:35:38,  8.78s/it]
                                                           
{'loss': '0.1454', 'grad_norm': '2.325', 'learning_rate': '7.81e-06', 'epoch': '0.5832'}
+
 58%|█████▊    | 22140/37963 [50:12:02<38:35:38,  8.78s/it]
 58%|█████▊    | 22141/37963 [50:12:10<37:31:06,  8.54s/it]
 58%|█████▊    | 22142/37963 [50:12:18<36:26:01,  8.29s/it]
 58%|█████▊    | 22143/37963 [50:12:25<35:42:14,  8.12s/it]
 58%|█████▊    | 22144/37963 [50:12:33<35:17:52,  8.03s/it]
 58%|█████▊    | 22145/37963 [50:12:41<35:23:03,  8.05s/it]
 58%|█████▊    | 22146/37963 [50:12:49<34:39:37,  7.89s/it]
 58%|█████▊    | 22147/37963 [50:12:56<34:07:48,  7.77s/it]
 58%|█████▊    | 22148/37963 [50:13:04<34:06:57,  7.77s/it]
 58%|█████▊    | 22149/37963 [50:13:12<34:36:16,  7.88s/it]
 58%|█████▊    | 22150/37963 [50:13:20<34:34:19,  7.87s/it]
                                                           
{'loss': '0.157', 'grad_norm': '2.813', 'learning_rate': '7.802e-06', 'epoch': '0.5835'}
+
 58%|█████▊    | 22150/37963 [50:13:20<34:34:19,  7.87s/it]
 58%|█████▊    | 22151/37963 [50:13:30<37:47:39,  8.60s/it]
 58%|█████▊    | 22152/37963 [50:13:38<36:52:19,  8.40s/it]
 58%|█████▊    | 22153/37963 [50:13:46<36:22:54,  8.28s/it]
 58%|█████▊    | 22154/37963 [50:13:54<35:29:49,  8.08s/it]
 58%|█████▊    | 22155/37963 [50:14:02<35:17:10,  8.04s/it]
 58%|█████▊    | 22156/37963 [50:14:12<38:17:25,  8.72s/it]
 58%|█████▊    | 22157/37963 [50:14:20<37:10:07,  8.47s/it]
 58%|█████▊    | 22158/37963 [50:14:28<36:27:23,  8.30s/it]
 58%|█████▊    | 22159/37963 [50:14:36<35:59:48,  8.20s/it]
 58%|█████▊    | 22160/37963 [50:14:44<35:17:32,  8.04s/it]
                                                           
{'loss': '0.1442', 'grad_norm': '2.504', 'learning_rate': '7.793e-06', 'epoch': '0.5837'}
+
 58%|█████▊    | 22160/37963 [50:14:44<35:17:32,  8.04s/it]
 58%|█████▊    | 22161/37963 [50:14:51<34:35:18,  7.88s/it]
 58%|█████▊    | 22162/37963 [50:14:59<34:03:53,  7.76s/it]
 58%|█████▊    | 22163/37963 [50:15:06<34:06:46,  7.77s/it]
 58%|█████▊    | 22164/37963 [50:15:14<33:48:37,  7.70s/it]
 58%|█████▊    | 22165/37963 [50:15:22<33:58:10,  7.74s/it]
 58%|█████▊    | 22166/37963 [50:15:29<33:55:35,  7.73s/it]
 58%|█████▊    | 22167/37963 [50:15:37<33:46:07,  7.70s/it]
 58%|█████▊    | 22168/37963 [50:15:45<33:56:39,  7.74s/it]
 58%|█████▊    | 22169/37963 [50:15:53<33:58:41,  7.74s/it]
 58%|█████▊    | 22170/37963 [50:16:00<34:00:00,  7.75s/it]
                                                           
{'loss': '0.1478', 'grad_norm': '1.528', 'learning_rate': '7.785e-06', 'epoch': '0.584'}
+
 58%|█████▊    | 22170/37963 [50:16:00<34:00:00,  7.75s/it]
 58%|█████▊    | 22171/37963 [50:16:08<34:14:56,  7.81s/it]
 58%|█████▊    | 22172/37963 [50:16:16<34:09:32,  7.79s/it]
 58%|█████▊    | 22173/37963 [50:16:24<33:57:46,  7.74s/it]
 58%|█████▊    | 22174/37963 [50:16:31<33:34:39,  7.66s/it]
 58%|█████▊    | 22175/37963 [50:16:41<37:06:29,  8.46s/it]
 58%|█████▊    | 22176/37963 [50:16:52<39:47:31,  9.07s/it]
 58%|█████▊    | 22177/37963 [50:17:00<37:56:03,  8.65s/it]
 58%|█████▊    | 22178/37963 [50:17:08<37:01:45,  8.45s/it]
 58%|█████▊    | 22179/37963 [50:17:15<36:05:23,  8.23s/it]
 58%|█████▊    | 22180/37963 [50:17:23<35:20:21,  8.06s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '3.237', 'learning_rate': '7.777e-06', 'epoch': '0.5843'}
+
 58%|█████▊    | 22180/37963 [50:17:23<35:20:21,  8.06s/it]
 58%|█████▊    | 22181/37963 [50:17:31<35:10:56,  8.03s/it]
 58%|█████▊    | 22182/37963 [50:17:39<35:03:53,  8.00s/it]
 58%|█████▊    | 22183/37963 [50:17:49<38:18:37,  8.74s/it]
 58%|█████▊    | 22184/37963 [50:17:57<37:06:59,  8.47s/it]
 58%|█████▊    | 22185/37963 [50:18:08<39:44:45,  9.07s/it]
 58%|█████▊    | 22186/37963 [50:18:15<37:23:44,  8.53s/it]
 58%|█████▊    | 22187/37963 [50:18:23<36:26:06,  8.31s/it]
 58%|█████▊    | 22188/37963 [50:18:31<35:49:10,  8.17s/it]
 58%|█████▊    | 22189/37963 [50:18:41<38:48:03,  8.86s/it]
 58%|█████▊    | 22190/37963 [50:18:49<37:18:33,  8.52s/it]
                                                           
{'loss': '0.1515', 'grad_norm': '1.691', 'learning_rate': '7.768e-06', 'epoch': '0.5845'}
+
 58%|█████▊    | 22190/37963 [50:18:49<37:18:33,  8.52s/it]
 58%|█████▊    | 22191/37963 [50:18:59<39:39:58,  9.05s/it]
 58%|█████▊    | 22192/37963 [50:19:07<37:46:16,  8.62s/it]
 58%|█████▊    | 22193/37963 [50:19:14<36:38:37,  8.37s/it]
 58%|█████▊    | 22194/37963 [50:19:22<35:48:12,  8.17s/it]
 58%|█████▊    | 22195/37963 [50:19:30<35:23:38,  8.08s/it]
 58%|█████▊    | 22196/37963 [50:19:38<34:51:11,  7.96s/it]
 58%|█████▊    | 22197/37963 [50:19:46<34:47:09,  7.94s/it]
 58%|█████▊    | 22198/37963 [50:19:53<34:33:14,  7.89s/it]
 58%|█████▊    | 22199/37963 [50:20:01<33:50:42,  7.73s/it]
 58%|█████▊    | 22200/37963 [50:20:08<33:50:57,  7.73s/it]
                                                           
{'loss': '0.1304', 'grad_norm': '3.371', 'learning_rate': '7.76e-06', 'epoch': '0.5848'}
+
 58%|█████▊    | 22200/37963 [50:20:08<33:50:57,  7.73s/it]
 58%|█████▊    | 22201/37963 [50:20:16<33:48:50,  7.72s/it]
 58%|█████▊    | 22202/37963 [50:20:24<33:42:40,  7.70s/it]
 58%|█████▊    | 22203/37963 [50:20:32<33:43:16,  7.70s/it]
 58%|█████▊    | 22204/37963 [50:20:44<40:35:51,  9.27s/it]
 58%|█████▊    | 22205/37963 [50:20:52<38:19:02,  8.75s/it]
 58%|█████▊    | 22206/37963 [50:21:00<36:52:37,  8.43s/it]
 58%|█████▊    | 22207/37963 [50:21:07<36:03:52,  8.24s/it]
 58%|█████▊    | 22208/37963 [50:21:15<35:07:57,  8.03s/it]
 59%|█████▊    | 22209/37963 [50:21:23<34:52:43,  7.97s/it]
 59%|█████▊    | 22210/37963 [50:21:31<34:40:15,  7.92s/it]
                                                           
{'loss': '0.1513', 'grad_norm': '2.356', 'learning_rate': '7.752e-06', 'epoch': '0.585'}
+
 59%|█████▊    | 22210/37963 [50:21:31<34:40:15,  7.92s/it]
 59%|█████▊    | 22211/37963 [50:21:38<34:31:28,  7.89s/it]
 59%|█████▊    | 22212/37963 [50:21:46<34:10:11,  7.81s/it]
 59%|█████▊    | 22213/37963 [50:21:54<33:50:01,  7.73s/it]
 59%|█████▊    | 22214/37963 [50:22:01<33:15:20,  7.60s/it]
 59%|█████▊    | 22215/37963 [50:22:09<33:15:39,  7.60s/it]
 59%|█████▊    | 22216/37963 [50:22:16<33:29:39,  7.66s/it]
 59%|█████▊    | 22217/37963 [50:22:24<33:51:05,  7.74s/it]
 59%|█████▊    | 22218/37963 [50:22:32<34:07:13,  7.80s/it]
 59%|█████▊    | 22219/37963 [50:22:40<34:15:51,  7.83s/it]
 59%|█████▊    | 22220/37963 [50:22:48<34:03:02,  7.79s/it]
                                                           
{'loss': '0.146', 'grad_norm': '1.774', 'learning_rate': '7.743e-06', 'epoch': '0.5853'}
+
 59%|█████▊    | 22220/37963 [50:22:48<34:03:02,  7.79s/it]
 59%|█████▊    | 22221/37963 [50:22:56<34:04:51,  7.79s/it]
 59%|█████▊    | 22222/37963 [50:23:03<34:02:30,  7.79s/it]
 59%|█████▊    | 22223/37963 [50:23:11<33:50:11,  7.74s/it]
 59%|█████▊    | 22224/37963 [50:23:21<36:49:40,  8.42s/it]
 59%|█████▊    | 22225/37963 [50:23:29<36:07:14,  8.26s/it]
 59%|█████▊    | 22226/37963 [50:23:37<35:27:09,  8.11s/it]
 59%|█████▊    | 22227/37963 [50:23:44<34:59:24,  8.00s/it]
 59%|█████▊    | 22228/37963 [50:23:52<34:18:43,  7.85s/it]
 59%|█████▊    | 22229/37963 [50:24:02<37:21:32,  8.55s/it]
 59%|█████▊    | 22230/37963 [50:24:10<36:25:42,  8.34s/it]
                                                           
{'loss': '0.1454', 'grad_norm': '3.806', 'learning_rate': '7.735e-06', 'epoch': '0.5856'}
+
 59%|█████▊    | 22230/37963 [50:24:10<36:25:42,  8.34s/it]
 59%|█████▊    | 22231/37963 [50:24:18<35:45:25,  8.18s/it]
 59%|█████▊    | 22232/37963 [50:24:25<35:06:10,  8.03s/it]
 59%|█████▊    | 22233/37963 [50:24:39<41:40:52,  9.54s/it]
 59%|█████▊    | 22234/37963 [50:24:46<39:10:09,  8.96s/it]
 59%|█████▊    | 22235/37963 [50:24:54<37:26:03,  8.57s/it]
 59%|█████▊    | 22236/37963 [50:25:01<36:08:08,  8.27s/it]
 59%|█████▊    | 22237/37963 [50:25:09<35:33:20,  8.14s/it]
 59%|█████▊    | 22238/37963 [50:25:17<34:56:32,  8.00s/it]
 59%|█████▊    | 22239/37963 [50:25:27<37:55:21,  8.68s/it]
 59%|█████▊    | 22240/37963 [50:25:35<36:57:01,  8.46s/it]
                                                           
{'loss': '0.1418', 'grad_norm': '1.821', 'learning_rate': '7.727e-06', 'epoch': '0.5858'}
+
 59%|█████▊    | 22240/37963 [50:25:35<36:57:01,  8.46s/it]
 59%|█████▊    | 22241/37963 [50:25:45<39:15:26,  8.99s/it]
 59%|█████▊    | 22242/37963 [50:25:53<37:32:07,  8.60s/it]
 59%|█████▊    | 22243/37963 [50:26:00<36:01:41,  8.25s/it]
 59%|█████▊    | 22244/37963 [50:26:08<35:43:02,  8.18s/it]
 59%|█████▊    | 22245/37963 [50:26:16<34:57:00,  8.00s/it]
 59%|█████▊    | 22246/37963 [50:26:24<34:43:32,  7.95s/it]
 59%|█████▊    | 22247/37963 [50:26:31<33:54:58,  7.77s/it]
 59%|█████▊    | 22248/37963 [50:26:41<37:09:12,  8.51s/it]
 59%|█████▊    | 22249/37963 [50:26:49<36:06:41,  8.27s/it]
 59%|█████▊    | 22250/37963 [50:26:57<35:27:57,  8.13s/it]
                                                           
{'loss': '0.1435', 'grad_norm': '4.589', 'learning_rate': '7.719e-06', 'epoch': '0.5861'}
+
 59%|█████▊    | 22250/37963 [50:26:57<35:27:57,  8.13s/it]
 59%|█████▊    | 22251/37963 [50:27:05<35:05:05,  8.04s/it]
 59%|█████▊    | 22252/37963 [50:27:15<38:12:16,  8.75s/it]
 59%|█████▊    | 22253/37963 [50:27:23<37:04:52,  8.50s/it]
 59%|█████▊    | 22254/37963 [50:27:31<35:50:38,  8.21s/it]
 59%|█████▊    | 22255/37963 [50:27:38<35:20:28,  8.10s/it]
 59%|█████▊    | 22256/37963 [50:27:46<34:29:53,  7.91s/it]
 59%|█████▊    | 22257/37963 [50:27:54<34:12:08,  7.84s/it]
 59%|█████▊    | 22258/37963 [50:28:01<33:32:48,  7.69s/it]
 59%|█████▊    | 22259/37963 [50:28:08<33:08:59,  7.60s/it]
 59%|█████▊    | 22260/37963 [50:28:16<33:06:31,  7.59s/it]
                                                           
{'loss': '0.1421', 'grad_norm': '1.934', 'learning_rate': '7.71e-06', 'epoch': '0.5864'}
+
 59%|█████▊    | 22260/37963 [50:28:16<33:06:31,  7.59s/it]
 59%|█████▊    | 22261/37963 [50:28:24<33:14:56,  7.62s/it]
 59%|█████▊    | 22262/37963 [50:28:31<33:09:39,  7.60s/it]
 59%|█████▊    | 22263/37963 [50:28:39<33:14:20,  7.62s/it]
 59%|█████▊    | 22264/37963 [50:28:46<32:49:55,  7.53s/it]
 59%|█████▊    | 22265/37963 [50:28:54<33:05:25,  7.59s/it]
 59%|█████▊    | 22266/37963 [50:29:01<32:45:27,  7.51s/it]
 59%|█████▊    | 22267/37963 [50:29:09<33:20:26,  7.65s/it]
 59%|█████▊    | 22268/37963 [50:29:19<36:27:09,  8.36s/it]
 59%|█████▊    | 22269/37963 [50:29:27<35:21:51,  8.11s/it]
 59%|█████▊    | 22270/37963 [50:29:34<34:40:59,  7.96s/it]
                                                           
{'loss': '0.1424', 'grad_norm': '1.425', 'learning_rate': '7.702e-06', 'epoch': '0.5866'}
+
 59%|█████▊    | 22270/37963 [50:29:34<34:40:59,  7.96s/it]
 59%|█████▊    | 22271/37963 [50:29:42<34:23:55,  7.89s/it]
 59%|█████▊    | 22272/37963 [50:29:50<33:54:53,  7.78s/it]
 59%|█████▊    | 22273/37963 [50:30:00<37:04:17,  8.51s/it]
 59%|█████▊    | 22274/37963 [50:30:08<36:20:44,  8.34s/it]
 59%|█████▊    | 22275/37963 [50:30:15<35:24:20,  8.12s/it]
 59%|█████▊    | 22276/37963 [50:30:23<35:06:54,  8.06s/it]
 59%|█████▊    | 22277/37963 [50:30:34<38:19:20,  8.80s/it]
 59%|█████▊    | 22278/37963 [50:30:42<37:14:59,  8.55s/it]
 59%|█████▊    | 22279/37963 [50:30:49<35:49:49,  8.22s/it]
 59%|█████▊    | 22280/37963 [50:30:57<35:05:39,  8.06s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '1.551', 'learning_rate': '7.694e-06', 'epoch': '0.5869'}
+
 59%|█████▊    | 22280/37963 [50:30:57<35:05:39,  8.06s/it]
 59%|█████▊    | 22281/37963 [50:31:07<38:15:56,  8.78s/it]
 59%|█████▊    | 22282/37963 [50:31:15<37:11:00,  8.54s/it]
 59%|█████▊    | 22283/37963 [50:31:23<35:58:30,  8.26s/it]
 59%|█████▊    | 22284/37963 [50:31:31<35:24:02,  8.13s/it]
 59%|█████▊    | 22285/37963 [50:31:38<34:42:19,  7.97s/it]
 59%|█████▊    | 22286/37963 [50:31:46<34:39:57,  7.96s/it]
 59%|█████▊    | 22287/37963 [50:31:54<34:02:00,  7.82s/it]
 59%|█████▊    | 22288/37963 [50:32:04<37:05:52,  8.52s/it]
 59%|█████▊    | 22289/37963 [50:32:12<36:08:10,  8.30s/it]
 59%|█████▊    | 22290/37963 [50:32:19<35:21:27,  8.12s/it]
                                                           
{'loss': '0.1432', 'grad_norm': '1.391', 'learning_rate': '7.685e-06', 'epoch': '0.5872'}
+
 59%|█████▊    | 22290/37963 [50:32:19<35:21:27,  8.12s/it]
 59%|█████▊    | 22291/37963 [50:32:30<38:10:00,  8.77s/it]
 59%|█████▊    | 22292/37963 [50:32:37<36:48:10,  8.45s/it]
 59%|█████▊    | 22293/37963 [50:32:45<35:39:09,  8.19s/it]
 59%|█████▊    | 22294/37963 [50:32:53<34:45:54,  7.99s/it]
 59%|█████▊    | 22295/37963 [50:33:03<37:50:40,  8.70s/it]
 59%|█████▊    | 22296/37963 [50:33:10<36:22:42,  8.36s/it]
 59%|█████▊    | 22297/37963 [50:33:18<35:29:42,  8.16s/it]
 59%|█████▊    | 22298/37963 [50:33:26<34:46:07,  7.99s/it]
 59%|█████▊    | 22299/37963 [50:33:33<34:16:44,  7.88s/it]
 59%|█████▊    | 22300/37963 [50:33:41<33:50:31,  7.78s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '2.107', 'learning_rate': '7.677e-06', 'epoch': '0.5874'}
+
 59%|█████▊    | 22300/37963 [50:33:41<33:50:31,  7.78s/it]
 59%|█████▊    | 22301/37963 [50:33:48<33:34:05,  7.72s/it]
 59%|█████▊    | 22302/37963 [50:33:56<33:04:02,  7.60s/it]
 59%|█████▊    | 22303/37963 [50:34:04<33:13:37,  7.64s/it]
 59%|█████▉    | 22304/37963 [50:34:14<36:50:01,  8.47s/it]
 59%|█████▉    | 22305/37963 [50:34:22<36:00:27,  8.28s/it]
 59%|█████▉    | 22306/37963 [50:34:30<35:16:53,  8.11s/it]
 59%|█████▉    | 22307/37963 [50:34:37<34:30:23,  7.93s/it]
 59%|█████▉    | 22308/37963 [50:34:45<34:15:50,  7.88s/it]
 59%|█████▉    | 22309/37963 [50:34:53<34:15:41,  7.88s/it]
 59%|█████▉    | 22310/37963 [50:35:00<33:31:36,  7.71s/it]
                                                           
{'loss': '0.134', 'grad_norm': '2.838', 'learning_rate': '7.669e-06', 'epoch': '0.5877'}
+
 59%|█████▉    | 22310/37963 [50:35:00<33:31:36,  7.71s/it]
 59%|█████▉    | 22311/37963 [50:35:07<33:13:34,  7.64s/it]
 59%|█████▉    | 22312/37963 [50:35:18<36:35:15,  8.42s/it]
 59%|█████▉    | 22313/37963 [50:35:26<35:51:22,  8.25s/it]
 59%|█████▉    | 22314/37963 [50:35:33<35:06:50,  8.08s/it]
 59%|█████▉    | 22315/37963 [50:35:41<34:45:49,  8.00s/it]
 59%|█████▉    | 22316/37963 [50:35:49<34:22:42,  7.91s/it]
 59%|█████▉    | 22317/37963 [50:35:57<34:30:40,  7.94s/it]
 59%|█████▉    | 22318/37963 [50:36:04<34:14:16,  7.88s/it]
 59%|█████▉    | 22319/37963 [50:36:12<33:34:49,  7.73s/it]
 59%|█████▉    | 22320/37963 [50:36:20<33:38:14,  7.74s/it]
                                                           
{'loss': '0.1556', 'grad_norm': '1.581', 'learning_rate': '7.66e-06', 'epoch': '0.5879'}
+
 59%|█████▉    | 22320/37963 [50:36:20<33:38:14,  7.74s/it]
 59%|█████▉    | 22321/37963 [50:36:30<37:02:26,  8.52s/it]
 59%|█████▉    | 22322/37963 [50:36:38<36:10:19,  8.33s/it]
 59%|█████▉    | 22323/37963 [50:36:45<34:51:23,  8.02s/it]
 59%|█████▉    | 22324/37963 [50:36:56<38:02:15,  8.76s/it]
 59%|█████▉    | 22325/37963 [50:37:03<36:50:13,  8.48s/it]
 59%|█████▉    | 22326/37963 [50:37:11<36:03:50,  8.30s/it]
 59%|█████▉    | 22327/37963 [50:37:19<35:30:46,  8.18s/it]
 59%|█████▉    | 22328/37963 [50:37:27<34:49:52,  8.02s/it]
 59%|█████▉    | 22329/37963 [50:37:35<34:28:09,  7.94s/it]
 59%|█████▉    | 22330/37963 [50:37:42<34:17:22,  7.90s/it]
                                                           
{'loss': '0.1477', 'grad_norm': '1.456', 'learning_rate': '7.652e-06', 'epoch': '0.5882'}
+
 59%|█████▉    | 22330/37963 [50:37:42<34:17:22,  7.90s/it]
 59%|█████▉    | 22331/37963 [50:37:53<37:33:30,  8.65s/it]
 59%|█████▉    | 22332/37963 [50:38:00<36:12:13,  8.34s/it]
 59%|█████▉    | 22333/37963 [50:38:08<35:22:39,  8.15s/it]
 59%|█████▉    | 22334/37963 [50:38:16<35:07:47,  8.09s/it]
 59%|█████▉    | 22335/37963 [50:38:27<38:16:29,  8.82s/it]
 59%|█████▉    | 22336/37963 [50:38:34<37:03:04,  8.54s/it]
 59%|█████▉    | 22337/37963 [50:38:42<36:06:07,  8.32s/it]
 59%|█████▉    | 22338/37963 [50:38:50<35:18:33,  8.14s/it]
 59%|█████▉    | 22339/37963 [50:38:58<34:53:29,  8.04s/it]
 59%|█████▉    | 22340/37963 [50:39:06<34:29:35,  7.95s/it]
                                                           
{'loss': '0.1345', 'grad_norm': '1.23', 'learning_rate': '7.644e-06', 'epoch': '0.5885'}
+
 59%|█████▉    | 22340/37963 [50:39:06<34:29:35,  7.95s/it]
 59%|█████▉    | 22341/37963 [50:39:13<34:08:49,  7.87s/it]
 59%|█████▉    | 22342/37963 [50:39:21<33:58:15,  7.83s/it]
 59%|█████▉    | 22343/37963 [50:39:29<33:53:46,  7.81s/it]
 59%|█████▉    | 22344/37963 [50:39:36<33:45:14,  7.78s/it]
 59%|█████▉    | 22345/37963 [50:39:46<36:40:49,  8.45s/it]
 59%|█████▉    | 22346/37963 [50:39:54<35:49:43,  8.26s/it]
 59%|█████▉    | 22347/37963 [50:40:02<35:12:20,  8.12s/it]
 59%|█████▉    | 22348/37963 [50:40:10<34:37:56,  7.98s/it]
 59%|█████▉    | 22349/37963 [50:40:20<37:45:08,  8.70s/it]
 59%|█████▉    | 22350/37963 [50:40:31<39:58:06,  9.22s/it]
                                                           
{'loss': '0.1349', 'grad_norm': '2.43', 'learning_rate': '7.636e-06', 'epoch': '0.5887'}
+
 59%|█████▉    | 22350/37963 [50:40:31<39:58:06,  9.22s/it]
 59%|█████▉    | 22351/37963 [50:40:38<38:11:25,  8.81s/it]
 59%|█████▉    | 22352/37963 [50:40:46<36:44:10,  8.47s/it]
 59%|█████▉    | 22353/37963 [50:40:54<35:55:20,  8.28s/it]
 59%|█████▉    | 22354/37963 [50:41:02<35:02:01,  8.08s/it]
 59%|█████▉    | 22355/37963 [50:41:12<37:56:37,  8.75s/it]
 59%|█████▉    | 22356/37963 [50:41:20<36:33:10,  8.43s/it]
 59%|█████▉    | 22357/37963 [50:41:27<35:31:20,  8.19s/it]
 59%|█████▉    | 22358/37963 [50:41:35<34:40:07,  8.00s/it]
 59%|█████▉    | 22359/37963 [50:41:43<34:25:02,  7.94s/it]
 59%|█████▉    | 22360/37963 [50:41:50<34:15:49,  7.91s/it]
                                                           
{'loss': '0.149', 'grad_norm': '2.185', 'learning_rate': '7.627e-06', 'epoch': '0.589'}
+
 59%|█████▉    | 22360/37963 [50:41:50<34:15:49,  7.91s/it]
 59%|█████▉    | 22361/37963 [50:41:58<34:07:40,  7.87s/it]
 59%|█████▉    | 22362/37963 [50:42:06<33:55:55,  7.83s/it]
 59%|█████▉    | 22363/37963 [50:42:14<33:46:57,  7.80s/it]
 59%|█████▉    | 22364/37963 [50:42:21<33:36:42,  7.76s/it]
 59%|█████▉    | 22365/37963 [50:42:32<36:54:39,  8.52s/it]
 59%|█████▉    | 22366/37963 [50:42:39<35:56:45,  8.30s/it]
 59%|█████▉    | 22367/37963 [50:42:50<38:32:20,  8.90s/it]
 59%|█████▉    | 22368/37963 [50:42:57<37:07:24,  8.57s/it]
 59%|█████▉    | 22369/37963 [50:43:05<35:57:21,  8.30s/it]
 59%|█████▉    | 22370/37963 [50:43:13<35:08:10,  8.11s/it]
                                                           
{'loss': '0.1397', 'grad_norm': '1.185', 'learning_rate': '7.619e-06', 'epoch': '0.5893'}
+
 59%|█████▉    | 22370/37963 [50:43:13<35:08:10,  8.11s/it]
 59%|█████▉    | 22371/37963 [50:43:21<34:47:39,  8.03s/it]
 59%|█████▉    | 22372/37963 [50:43:28<34:07:09,  7.88s/it]
 59%|█████▉    | 22373/37963 [50:43:36<33:36:09,  7.76s/it]
 59%|█████▉    | 22374/37963 [50:43:43<33:24:39,  7.72s/it]
 59%|█████▉    | 22375/37963 [50:43:51<33:33:35,  7.75s/it]
 59%|█████▉    | 22376/37963 [50:43:59<33:37:01,  7.76s/it]
 59%|█████▉    | 22377/37963 [50:44:06<33:24:47,  7.72s/it]
 59%|█████▉    | 22378/37963 [50:44:14<33:21:12,  7.70s/it]
 59%|█████▉    | 22379/37963 [50:44:25<36:57:59,  8.54s/it]
 59%|█████▉    | 22380/37963 [50:44:32<36:01:09,  8.32s/it]
                                                           
{'loss': '0.1239', 'grad_norm': '1.486', 'learning_rate': '7.611e-06', 'epoch': '0.5895'}
+
 59%|█████▉    | 22380/37963 [50:44:32<36:01:09,  8.32s/it]
 59%|█████▉    | 22381/37963 [50:44:40<35:20:16,  8.16s/it]
 59%|█████▉    | 22382/37963 [50:44:48<34:32:21,  7.98s/it]
 59%|█████▉    | 22383/37963 [50:44:55<33:53:16,  7.83s/it]
 59%|█████▉    | 22384/37963 [50:45:03<33:51:33,  7.82s/it]
 59%|█████▉    | 22385/37963 [50:45:13<37:08:42,  8.58s/it]
 59%|█████▉    | 22386/37963 [50:45:21<35:53:08,  8.29s/it]
 59%|█████▉    | 22387/37963 [50:45:28<34:30:37,  7.98s/it]
 59%|█████▉    | 22388/37963 [50:45:36<34:34:26,  7.99s/it]
 59%|█████▉    | 22389/37963 [50:45:44<33:37:46,  7.77s/it]
 59%|█████▉    | 22390/37963 [50:45:51<33:30:44,  7.75s/it]
                                                           
{'loss': '0.1339', 'grad_norm': '1.263', 'learning_rate': '7.602e-06', 'epoch': '0.5898'}
+
 59%|█████▉    | 22390/37963 [50:45:51<33:30:44,  7.75s/it]
 59%|█████▉    | 22391/37963 [50:45:59<33:16:25,  7.69s/it]
 59%|█████▉    | 22392/37963 [50:46:07<33:16:26,  7.69s/it]
 59%|█████▉    | 22393/37963 [50:46:17<36:50:09,  8.52s/it]
 59%|█████▉    | 22394/37963 [50:46:27<39:18:42,  9.09s/it]
 59%|█████▉    | 22395/37963 [50:46:35<37:36:06,  8.70s/it]
 59%|█████▉    | 22396/37963 [50:46:43<36:15:14,  8.38s/it]
 59%|█████▉    | 22397/37963 [50:46:50<35:12:20,  8.14s/it]
 59%|█████▉    | 22398/37963 [50:47:00<37:34:34,  8.69s/it]
 59%|█████▉    | 22399/37963 [50:47:11<39:51:59,  9.22s/it]
 59%|█████▉    | 22400/37963 [50:47:19<38:00:36,  8.79s/it]
                                                           
{'loss': '0.1347', 'grad_norm': '3.719', 'learning_rate': '7.594e-06', 'epoch': '0.5901'}
+
 59%|█████▉    | 22400/37963 [50:47:19<38:00:36,  8.79s/it]
 59%|█████▉    | 22401/37963 [50:47:27<36:55:17,  8.54s/it]
 59%|█████▉    | 22402/37963 [50:47:34<35:57:55,  8.32s/it]
 59%|█████▉    | 22403/37963 [50:47:42<35:18:56,  8.17s/it]
 59%|█████▉    | 22404/37963 [50:47:50<34:52:21,  8.07s/it]
 59%|█████▉    | 22405/37963 [50:47:58<35:01:06,  8.10s/it]
 59%|█████▉    | 22406/37963 [50:48:06<34:18:30,  7.94s/it]
 59%|█████▉    | 22407/37963 [50:48:14<34:05:00,  7.89s/it]
 59%|█████▉    | 22408/37963 [50:48:22<34:21:48,  7.95s/it]
 59%|█████▉    | 22409/37963 [50:48:29<34:01:08,  7.87s/it]
 59%|█████▉    | 22410/37963 [50:48:37<34:18:32,  7.94s/it]
                                                           
{'loss': '0.1477', 'grad_norm': '3.245', 'learning_rate': '7.586e-06', 'epoch': '0.5903'}
+
 59%|█████▉    | 22410/37963 [50:48:37<34:18:32,  7.94s/it]
 59%|█████▉    | 22411/37963 [50:48:45<34:00:54,  7.87s/it]
 59%|█████▉    | 22412/37963 [50:48:53<33:56:13,  7.86s/it]
 59%|█████▉    | 22413/37963 [50:49:03<37:11:22,  8.61s/it]
 59%|█████▉    | 22414/37963 [50:49:11<35:46:55,  8.28s/it]
 59%|█████▉    | 22415/37963 [50:49:19<35:06:01,  8.13s/it]
 59%|█████▉    | 22416/37963 [50:49:26<34:09:27,  7.91s/it]
 59%|█████▉    | 22417/37963 [50:49:34<33:46:38,  7.82s/it]
 59%|█████▉    | 22418/37963 [50:49:41<33:30:05,  7.76s/it]
 59%|█████▉    | 22419/37963 [50:49:49<33:28:40,  7.75s/it]
 59%|█████▉    | 22420/37963 [50:49:56<32:56:38,  7.63s/it]
                                                           
{'loss': '0.1435', 'grad_norm': '2.389', 'learning_rate': '7.578e-06', 'epoch': '0.5906'}
+
 59%|█████▉    | 22420/37963 [50:49:56<32:56:38,  7.63s/it]
 59%|█████▉    | 22421/37963 [50:50:07<36:54:54,  8.55s/it]
 59%|█████▉    | 22422/37963 [50:50:15<35:58:30,  8.33s/it]
 59%|█████▉    | 22423/37963 [50:50:26<39:04:06,  9.05s/it]
 59%|█████▉    | 22424/37963 [50:50:34<38:00:13,  8.80s/it]
 59%|█████▉    | 22425/37963 [50:50:42<36:43:07,  8.51s/it]
 59%|█████▉    | 22426/37963 [50:50:49<35:20:46,  8.19s/it]
 59%|█████▉    | 22427/37963 [50:50:57<34:31:40,  8.00s/it]
 59%|█████▉    | 22428/37963 [50:51:04<34:11:33,  7.92s/it]
 59%|█████▉    | 22429/37963 [50:51:12<33:52:01,  7.85s/it]
 59%|█████▉    | 22430/37963 [50:51:20<33:37:35,  7.79s/it]
                                                           
{'loss': '0.1447', 'grad_norm': '4.554', 'learning_rate': '7.569e-06', 'epoch': '0.5908'}
+
 59%|█████▉    | 22430/37963 [50:51:20<33:37:35,  7.79s/it]
 59%|█████▉    | 22431/37963 [50:51:27<33:27:41,  7.76s/it]
 59%|█████▉    | 22432/37963 [50:51:35<33:27:40,  7.76s/it]
 59%|█████▉    | 22433/37963 [50:51:43<33:21:43,  7.73s/it]
 59%|█████▉    | 22434/37963 [50:51:54<38:22:06,  8.89s/it]
 59%|█████▉    | 22435/37963 [50:52:02<37:09:47,  8.62s/it]
 59%|█████▉    | 22436/37963 [50:52:11<36:34:35,  8.48s/it]
 59%|█████▉    | 22437/37963 [50:52:18<35:42:05,  8.28s/it]
 59%|█████▉    | 22438/37963 [50:52:26<35:08:34,  8.15s/it]
 59%|█████▉    | 22439/37963 [50:52:34<34:44:21,  8.06s/it]
 59%|█████▉    | 22440/37963 [50:52:42<34:46:40,  8.07s/it]
                                                           
{'loss': '0.1604', 'grad_norm': '1.937', 'learning_rate': '7.561e-06', 'epoch': '0.5911'}
+
 59%|█████▉    | 22440/37963 [50:52:42<34:46:40,  8.07s/it]
 59%|█████▉    | 22441/37963 [50:52:50<34:38:30,  8.03s/it]
 59%|█████▉    | 22442/37963 [50:53:01<37:42:07,  8.74s/it]
 59%|█████▉    | 22443/37963 [50:53:08<36:34:57,  8.49s/it]
 59%|█████▉    | 22444/37963 [50:53:16<35:34:16,  8.25s/it]
 59%|█████▉    | 22445/37963 [50:53:24<34:39:01,  8.04s/it]
 59%|█████▉    | 22446/37963 [50:53:31<34:11:46,  7.93s/it]
 59%|█████▉    | 22447/37963 [50:53:42<37:19:40,  8.66s/it]
 59%|█████▉    | 22448/37963 [50:53:50<36:14:51,  8.41s/it]
 59%|█████▉    | 22449/37963 [50:53:57<35:34:23,  8.25s/it]
 59%|█████▉    | 22450/37963 [50:54:05<34:58:39,  8.12s/it]
                                                           
{'loss': '0.1413', 'grad_norm': '0.8241', 'learning_rate': '7.553e-06', 'epoch': '0.5914'}
+
 59%|█████▉    | 22450/37963 [50:54:05<34:58:39,  8.12s/it]
 59%|█████▉    | 22451/37963 [50:54:13<34:24:06,  7.98s/it]
 59%|█████▉    | 22452/37963 [50:54:21<34:15:10,  7.95s/it]
 59%|█████▉    | 22453/37963 [50:54:28<33:50:54,  7.86s/it]
 59%|█████▉    | 22454/37963 [50:54:36<33:35:06,  7.80s/it]
 59%|█████▉    | 22455/37963 [50:54:44<33:25:35,  7.76s/it]
 59%|█████▉    | 22456/37963 [50:54:51<32:52:51,  7.63s/it]
 59%|█████▉    | 22457/37963 [50:54:59<33:03:21,  7.67s/it]
 59%|█████▉    | 22458/37963 [50:55:07<33:05:42,  7.68s/it]
 59%|█████▉    | 22459/37963 [50:55:14<33:07:42,  7.69s/it]
 59%|█████▉    | 22460/37963 [50:55:22<32:59:08,  7.66s/it]
                                                           
{'loss': '0.151', 'grad_norm': '1.663', 'learning_rate': '7.544e-06', 'epoch': '0.5916'}
+
 59%|█████▉    | 22460/37963 [50:55:22<32:59:08,  7.66s/it]
 59%|█████▉    | 22461/37963 [50:55:32<36:26:45,  8.46s/it]
 59%|█████▉    | 22462/37963 [50:55:40<35:36:25,  8.27s/it]
 59%|█████▉    | 22463/37963 [50:55:48<35:04:17,  8.15s/it]
 59%|█████▉    | 22464/37963 [50:55:56<34:28:25,  8.01s/it]
 59%|█████▉    | 22465/37963 [50:56:03<34:01:02,  7.90s/it]
 59%|█████▉    | 22466/37963 [50:56:11<33:41:32,  7.83s/it]
 59%|█████▉    | 22467/37963 [50:56:18<33:05:06,  7.69s/it]
 59%|█████▉    | 22468/37963 [50:56:26<32:55:22,  7.65s/it]
 59%|█████▉    | 22469/37963 [50:56:33<32:38:30,  7.58s/it]
 59%|█████▉    | 22470/37963 [50:56:41<32:52:54,  7.64s/it]
                                                           
{'loss': '0.149', 'grad_norm': '1.689', 'learning_rate': '7.536e-06', 'epoch': '0.5919'}
+
 59%|█████▉    | 22470/37963 [50:56:41<32:52:54,  7.64s/it]
 59%|█████▉    | 22471/37963 [50:56:52<36:58:30,  8.59s/it]
 59%|█████▉    | 22472/37963 [50:57:00<36:04:11,  8.38s/it]
 59%|█████▉    | 22473/37963 [50:57:08<35:29:00,  8.25s/it]
 59%|█████▉    | 22474/37963 [50:57:15<34:58:46,  8.13s/it]
 59%|█████▉    | 22475/37963 [50:57:26<38:02:27,  8.84s/it]
 59%|█████▉    | 22476/37963 [50:57:34<36:33:34,  8.50s/it]
 59%|█████▉    | 22477/37963 [50:57:41<35:25:02,  8.23s/it]
 59%|█████▉    | 22478/37963 [50:57:49<34:58:44,  8.13s/it]
 59%|█████▉    | 22479/37963 [50:57:57<34:30:12,  8.02s/it]
 59%|█████▉    | 22480/37963 [50:58:05<33:58:59,  7.90s/it]
                                                           
{'loss': '0.139', 'grad_norm': '1.989', 'learning_rate': '7.528e-06', 'epoch': '0.5922'}
+
 59%|█████▉    | 22480/37963 [50:58:05<33:58:59,  7.90s/it]
 59%|█████▉    | 22481/37963 [50:58:12<33:36:52,  7.82s/it]
 59%|█████▉    | 22482/37963 [50:58:23<37:07:20,  8.63s/it]
 59%|█████▉    | 22483/37963 [50:58:31<36:21:06,  8.45s/it]
 59%|█████▉    | 22484/37963 [50:58:38<35:23:17,  8.23s/it]
 59%|█████▉    | 22485/37963 [50:58:46<34:51:52,  8.11s/it]
 59%|█████▉    | 22486/37963 [50:58:54<34:41:00,  8.07s/it]
 59%|█████▉    | 22487/37963 [50:59:02<34:30:21,  8.03s/it]
 59%|█████▉    | 22488/37963 [50:59:10<34:26:03,  8.01s/it]
 59%|█████▉    | 22489/37963 [50:59:18<33:53:15,  7.88s/it]
 59%|█████▉    | 22490/37963 [50:59:26<33:46:02,  7.86s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '1.857', 'learning_rate': '7.52e-06', 'epoch': '0.5924'}
+
 59%|█████▉    | 22490/37963 [50:59:26<33:46:02,  7.86s/it]
 59%|█████▉    | 22491/37963 [50:59:33<33:30:01,  7.79s/it]
 59%|█████▉    | 22492/37963 [50:59:41<33:36:45,  7.82s/it]
 59%|█████▉    | 22493/37963 [50:59:49<33:34:54,  7.81s/it]
 59%|█████▉    | 22494/37963 [50:59:59<36:46:08,  8.56s/it]
 59%|█████▉    | 22495/37963 [51:00:07<36:08:52,  8.41s/it]
 59%|█████▉    | 22496/37963 [51:00:20<42:04:12,  9.79s/it]
 59%|█████▉    | 22497/37963 [51:00:28<39:35:24,  9.22s/it]
 59%|█████▉    | 22498/37963 [51:00:36<37:33:09,  8.74s/it]
 59%|█████▉    | 22499/37963 [51:00:43<36:11:34,  8.43s/it]
 59%|█████▉    | 22500/37963 [51:00:51<35:07:14,  8.18s/it]
                                                           
{'loss': '0.1394', 'grad_norm': '2.005', 'learning_rate': '7.511e-06', 'epoch': '0.5927'}
+
 59%|█████▉    | 22500/37963 [51:00:51<35:07:14,  8.18s/it]
 59%|█████▉    | 22501/37963 [51:00:59<34:42:54,  8.08s/it]
 59%|█████▉    | 22502/37963 [51:01:07<34:15:52,  7.98s/it]
 59%|█████▉    | 22503/37963 [51:01:14<33:58:48,  7.91s/it]
 59%|█████▉    | 22504/37963 [51:01:22<33:45:05,  7.86s/it]
 59%|█████▉    | 22505/37963 [51:01:30<33:33:41,  7.82s/it]
 59%|█████▉    | 22506/37963 [51:01:38<33:43:12,  7.85s/it]
 59%|█████▉    | 22507/37963 [51:01:45<33:26:29,  7.79s/it]
 59%|█████▉    | 22508/37963 [51:01:53<33:14:58,  7.74s/it]
 59%|█████▉    | 22509/37963 [51:02:01<33:09:01,  7.72s/it]
 59%|█████▉    | 22510/37963 [51:02:09<33:17:00,  7.75s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '2.329', 'learning_rate': '7.503e-06', 'epoch': '0.5929'}
+
 59%|█████▉    | 22510/37963 [51:02:09<33:17:00,  7.75s/it]
 59%|█████▉    | 22511/37963 [51:02:16<33:20:00,  7.77s/it]
 59%|█████▉    | 22512/37963 [51:02:24<32:39:58,  7.61s/it]
 59%|█████▉    | 22513/37963 [51:02:31<32:28:56,  7.57s/it]
 59%|█████▉    | 22514/37963 [51:02:39<32:40:10,  7.61s/it]
 59%|█████▉    | 22515/37963 [51:02:49<36:15:20,  8.45s/it]
 59%|█████▉    | 22516/37963 [51:02:57<35:40:18,  8.31s/it]
 59%|█████▉    | 22517/37963 [51:03:05<34:59:38,  8.16s/it]
 59%|█████▉    | 22518/37963 [51:03:13<34:33:53,  8.06s/it]
 59%|█████▉    | 22519/37963 [51:03:23<37:32:48,  8.75s/it]
 59%|█████▉    | 22520/37963 [51:03:31<36:30:33,  8.51s/it]
                                                           
{'loss': '0.1447', 'grad_norm': '1.591', 'learning_rate': '7.495e-06', 'epoch': '0.5932'}
+
 59%|█████▉    | 22520/37963 [51:03:31<36:30:33,  8.51s/it]
 59%|█████▉    | 22521/37963 [51:03:39<35:32:08,  8.28s/it]
 59%|█████▉    | 22522/37963 [51:03:47<34:47:03,  8.11s/it]
 59%|█████▉    | 22523/37963 [51:03:57<37:31:40,  8.75s/it]
 59%|█████▉    | 22524/37963 [51:04:05<36:35:57,  8.53s/it]
 59%|█████▉    | 22525/37963 [51:04:13<35:43:14,  8.33s/it]
 59%|█████▉    | 22526/37963 [51:04:23<38:52:06,  9.06s/it]
 59%|█████▉    | 22527/37963 [51:04:31<37:22:14,  8.72s/it]
 59%|█████▉    | 22528/37963 [51:04:39<35:55:56,  8.38s/it]
 59%|█████▉    | 22529/37963 [51:04:47<35:04:36,  8.18s/it]
 59%|█████▉    | 22530/37963 [51:04:55<34:42:08,  8.09s/it]
                                                           
{'loss': '0.1421', 'grad_norm': '1.248', 'learning_rate': '7.487e-06', 'epoch': '0.5935'}
+
 59%|█████▉    | 22530/37963 [51:04:55<34:42:08,  8.09s/it]
 59%|█████▉    | 22531/37963 [51:05:02<34:12:29,  7.98s/it]
 59%|█████▉    | 22532/37963 [51:05:10<34:11:37,  7.98s/it]
 59%|█████▉    | 22533/37963 [51:05:18<34:12:41,  7.98s/it]
 59%|█████▉    | 22534/37963 [51:05:26<33:51:33,  7.90s/it]
 59%|█████▉    | 22535/37963 [51:05:34<33:48:38,  7.89s/it]
 59%|█████▉    | 22536/37963 [51:05:42<33:36:28,  7.84s/it]
 59%|█████▉    | 22537/37963 [51:05:49<33:18:21,  7.77s/it]
 59%|█████▉    | 22538/37963 [51:06:00<36:47:17,  8.59s/it]
 59%|█████▉    | 22539/37963 [51:06:08<35:49:08,  8.36s/it]
 59%|█████▉    | 22540/37963 [51:06:15<35:07:59,  8.20s/it]
                                                           
{'loss': '0.1385', 'grad_norm': '2.342', 'learning_rate': '7.478e-06', 'epoch': '0.5937'}
+
 59%|█████▉    | 22540/37963 [51:06:15<35:07:59,  8.20s/it]
 59%|█████▉    | 22541/37963 [51:06:23<34:30:46,  8.06s/it]
 59%|█████▉    | 22542/37963 [51:06:31<34:15:08,  8.00s/it]
 59%|█████▉    | 22543/37963 [51:06:39<34:05:21,  7.96s/it]
 59%|█████▉    | 22544/37963 [51:06:49<36:55:09,  8.62s/it]
 59%|█████▉    | 22545/37963 [51:06:59<38:55:05,  9.09s/it]
 59%|█████▉    | 22546/37963 [51:07:07<37:11:12,  8.68s/it]
 59%|█████▉    | 22547/37963 [51:07:15<35:54:47,  8.39s/it]
 59%|█████▉    | 22548/37963 [51:07:22<34:33:40,  8.07s/it]
 59%|█████▉    | 22549/37963 [51:07:32<37:26:15,  8.74s/it]
 59%|█████▉    | 22550/37963 [51:07:40<36:06:14,  8.43s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '2.116', 'learning_rate': '7.47e-06', 'epoch': '0.594'}
+
 59%|█████▉    | 22550/37963 [51:07:40<36:06:14,  8.43s/it]
 59%|█████▉    | 22551/37963 [51:07:48<35:12:52,  8.23s/it]
 59%|█████▉    | 22552/37963 [51:07:55<34:28:40,  8.05s/it]
 59%|█████▉    | 22553/37963 [51:08:03<34:23:05,  8.03s/it]
 59%|█████▉    | 22554/37963 [51:08:11<34:02:55,  7.95s/it]
 59%|█████▉    | 22555/37963 [51:08:19<33:40:20,  7.87s/it]
 59%|█████▉    | 22556/37963 [51:08:26<33:24:15,  7.81s/it]
 59%|█████▉    | 22557/37963 [51:08:34<33:44:50,  7.89s/it]
 59%|█████▉    | 22558/37963 [51:08:42<33:21:38,  7.80s/it]
 59%|█████▉    | 22559/37963 [51:08:52<36:34:45,  8.55s/it]
 59%|█████▉    | 22560/37963 [51:09:00<35:40:00,  8.34s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '3.206', 'learning_rate': '7.462e-06', 'epoch': '0.5943'}
+
 59%|█████▉    | 22560/37963 [51:09:00<35:40:00,  8.34s/it]
 59%|█████▉    | 22561/37963 [51:09:08<34:49:58,  8.14s/it]
 59%|█████▉    | 22562/37963 [51:09:16<34:25:48,  8.05s/it]
 59%|█████▉    | 22563/37963 [51:09:26<37:30:36,  8.77s/it]
 59%|█████▉    | 22564/37963 [51:09:34<36:20:23,  8.50s/it]
 59%|█████▉    | 22565/37963 [51:09:42<35:20:10,  8.26s/it]
 59%|█████▉    | 22566/37963 [51:09:50<34:45:20,  8.13s/it]
 59%|█████▉    | 22567/37963 [51:09:57<34:07:20,  7.98s/it]
 59%|█████▉    | 22568/37963 [51:10:05<34:17:31,  8.02s/it]
 59%|█████▉    | 22569/37963 [51:10:16<37:42:00,  8.82s/it]
 59%|█████▉    | 22570/37963 [51:10:24<36:33:29,  8.55s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '1.793', 'learning_rate': '7.454e-06', 'epoch': '0.5945'}
+
 59%|█████▉    | 22570/37963 [51:10:24<36:33:29,  8.55s/it]
 59%|█████▉    | 22571/37963 [51:10:32<35:35:14,  8.32s/it]
 59%|█████▉    | 22572/37963 [51:10:40<34:55:17,  8.17s/it]
 59%|█████▉    | 22573/37963 [51:10:50<38:00:06,  8.89s/it]
 59%|█████▉    | 22574/37963 [51:10:58<36:41:44,  8.58s/it]
 59%|█████▉    | 22575/37963 [51:11:06<35:48:34,  8.38s/it]
 59%|█████▉    | 22576/37963 [51:11:13<34:45:40,  8.13s/it]
 59%|█████▉    | 22577/37963 [51:11:21<34:12:29,  8.00s/it]
 59%|█████▉    | 22578/37963 [51:11:29<33:45:28,  7.90s/it]
 59%|█████▉    | 22579/37963 [51:11:36<33:27:10,  7.83s/it]
 59%|█████▉    | 22580/37963 [51:11:44<33:24:48,  7.82s/it]
                                                           
{'loss': '0.1437', 'grad_norm': '2.796', 'learning_rate': '7.445e-06', 'epoch': '0.5948'}
+
 59%|█████▉    | 22580/37963 [51:11:44<33:24:48,  7.82s/it]
 59%|█████▉    | 22581/37963 [51:11:52<33:21:14,  7.81s/it]
 59%|█████▉    | 22582/37963 [51:12:02<36:30:47,  8.55s/it]
 59%|█████▉    | 22583/37963 [51:12:10<35:33:06,  8.32s/it]
 59%|█████▉    | 22584/37963 [51:12:18<34:26:49,  8.06s/it]
 59%|█████▉    | 22585/37963 [51:12:25<34:05:10,  7.98s/it]
 59%|█████▉    | 22586/37963 [51:12:33<33:55:51,  7.94s/it]
 59%|█████▉    | 22587/37963 [51:12:41<33:48:00,  7.91s/it]
 60%|█████▉    | 22588/37963 [51:12:51<36:48:01,  8.62s/it]
 60%|█████▉    | 22589/37963 [51:12:59<35:34:38,  8.33s/it]
 60%|█████▉    | 22590/37963 [51:13:07<34:58:21,  8.19s/it]
                                                           
{'loss': '0.1594', 'grad_norm': '1.469', 'learning_rate': '7.437e-06', 'epoch': '0.5951'}
+
 60%|█████▉    | 22590/37963 [51:13:07<34:58:21,  8.19s/it]
 60%|█████▉    | 22591/37963 [51:13:15<34:27:36,  8.07s/it]
 60%|█████▉    | 22592/37963 [51:13:22<34:08:41,  8.00s/it]
 60%|█████▉    | 22593/37963 [51:13:30<33:36:07,  7.87s/it]
 60%|█████▉    | 22594/37963 [51:13:38<33:40:12,  7.89s/it]
 60%|█████▉    | 22595/37963 [51:13:46<33:38:01,  7.88s/it]
 60%|█████▉    | 22596/37963 [51:13:54<33:27:54,  7.84s/it]
 60%|█████▉    | 22597/37963 [51:14:04<36:53:19,  8.64s/it]
 60%|█████▉    | 22598/37963 [51:14:12<35:42:24,  8.37s/it]
 60%|█████▉    | 22599/37963 [51:14:22<38:10:01,  8.94s/it]
 60%|█████▉    | 22600/37963 [51:14:30<37:09:27,  8.71s/it]
                                                           
{'loss': '0.1452', 'grad_norm': '3.392', 'learning_rate': '7.429e-06', 'epoch': '0.5953'}
+
 60%|█████▉    | 22600/37963 [51:14:30<37:09:27,  8.71s/it]
 60%|█████▉    | 22601/37963 [51:14:38<36:10:56,  8.48s/it]
 60%|█████▉    | 22602/37963 [51:14:46<35:05:33,  8.22s/it]
 60%|█████▉    | 22603/37963 [51:14:56<37:36:04,  8.81s/it]
 60%|█████▉    | 22604/37963 [51:15:04<36:28:41,  8.55s/it]
 60%|█████▉    | 22605/37963 [51:15:11<35:05:20,  8.23s/it]
 60%|█████▉    | 22606/37963 [51:15:22<37:32:50,  8.80s/it]
 60%|█████▉    | 22607/37963 [51:15:29<36:00:19,  8.44s/it]
 60%|███��█▉    | 22608/37963 [51:15:37<35:18:48,  8.28s/it]
 60%|█████▉    | 22609/37963 [51:15:45<34:27:09,  8.08s/it]
 60%|█████▉    | 22610/37963 [51:15:52<33:55:45,  7.96s/it]
                                                           
{'loss': '0.1515', 'grad_norm': '1.972', 'learning_rate': '7.421e-06', 'epoch': '0.5956'}
+
 60%|█████▉    | 22610/37963 [51:15:52<33:55:45,  7.96s/it]
 60%|█████▉    | 22611/37963 [51:16:00<33:46:10,  7.92s/it]
 60%|█████▉    | 22612/37963 [51:16:08<33:14:46,  7.80s/it]
 60%|█████▉    | 22613/37963 [51:16:15<32:59:59,  7.74s/it]
 60%|█████▉    | 22614/37963 [51:16:23<33:01:18,  7.75s/it]
 60%|█████▉    | 22615/37963 [51:16:31<33:00:19,  7.74s/it]
 60%|█████▉    | 22616/37963 [51:16:38<32:29:10,  7.62s/it]
 60%|█████▉    | 22617/37963 [51:16:49<36:24:44,  8.54s/it]
 60%|█████▉    | 22618/37963 [51:16:57<35:30:43,  8.33s/it]
 60%|█████▉    | 22619/37963 [51:17:05<35:05:11,  8.23s/it]
 60%|█████▉    | 22620/37963 [51:17:12<34:20:52,  8.06s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '1.532', 'learning_rate': '7.412e-06', 'epoch': '0.5958'}
+
 60%|█████▉    | 22620/37963 [51:17:12<34:20:52,  8.06s/it]
 60%|█████▉    | 22621/37963 [51:17:23<37:31:22,  8.80s/it]
 60%|█████▉    | 22622/37963 [51:17:31<36:18:30,  8.52s/it]
 60%|█████▉    | 22623/37963 [51:17:39<35:32:55,  8.34s/it]
 60%|█████▉    | 22624/37963 [51:17:46<34:40:41,  8.14s/it]
 60%|█████▉    | 22625/37963 [51:17:57<37:38:01,  8.83s/it]
 60%|█████▉    | 22626/37963 [51:18:05<36:21:06,  8.53s/it]
 60%|█████▉    | 22627/37963 [51:18:12<35:18:32,  8.29s/it]
 60%|█████▉    | 22628/37963 [51:18:20<34:25:41,  8.08s/it]
 60%|█████▉    | 22629/37963 [51:18:27<33:34:12,  7.88s/it]
 60%|█████▉    | 22630/37963 [51:18:35<33:12:26,  7.80s/it]
                                                           
{'loss': '0.1352', 'grad_norm': '1.154', 'learning_rate': '7.404e-06', 'epoch': '0.5961'}
+
 60%|█████▉    | 22630/37963 [51:18:35<33:12:26,  7.80s/it]
 60%|█████▉    | 22631/37963 [51:18:45<36:27:19,  8.56s/it]
 60%|█████▉    | 22632/37963 [51:18:53<35:26:54,  8.32s/it]
 60%|█████▉    | 22633/37963 [51:19:01<34:52:55,  8.19s/it]
 60%|█████▉    | 22634/37963 [51:19:09<34:13:07,  8.04s/it]
 60%|█████▉    | 22635/37963 [51:19:16<33:56:53,  7.97s/it]
 60%|█████▉    | 22636/37963 [51:19:24<33:18:26,  7.82s/it]
 60%|█████▉    | 22637/37963 [51:19:32<33:18:48,  7.83s/it]
 60%|█████▉    | 22638/37963 [51:19:39<33:01:47,  7.76s/it]
 60%|█████▉    | 22639/37963 [51:19:47<33:05:13,  7.77s/it]
 60%|█████▉    | 22640/37963 [51:19:55<32:38:24,  7.67s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '1.341', 'learning_rate': '7.396e-06', 'epoch': '0.5964'}
+
 60%|█████▉    | 22640/37963 [51:19:55<32:38:24,  7.67s/it]
 60%|█████▉    | 22641/37963 [51:20:05<36:15:23,  8.52s/it]
 60%|█████▉    | 22642/37963 [51:20:13<35:23:29,  8.32s/it]
 60%|█████▉    | 22643/37963 [51:20:20<34:29:36,  8.11s/it]
 60%|█████▉    | 22644/37963 [51:20:28<33:48:42,  7.95s/it]
 60%|█████▉    | 22645/37963 [51:20:36<33:16:04,  7.82s/it]
 60%|█████▉    | 22646/37963 [51:20:43<33:10:32,  7.80s/it]
 60%|█████▉    | 22647/37963 [51:20:54<36:19:56,  8.54s/it]
 60%|█████▉    | 22648/37963 [51:21:02<35:38:40,  8.38s/it]
 60%|█████▉    | 22649/37963 [51:21:09<34:59:41,  8.23s/it]
 60%|█████▉    | 22650/37963 [51:21:20<37:59:42,  8.93s/it]
                                                           
{'loss': '0.1286', 'grad_norm': '2.053', 'learning_rate': '7.388e-06', 'epoch': '0.5966'}
+
 60%|█████▉    | 22650/37963 [51:21:20<37:59:42,  8.93s/it]
 60%|█████▉    | 22651/37963 [51:21:30<39:50:49,  9.37s/it]
 60%|█████▉    | 22652/37963 [51:21:38<38:00:22,  8.94s/it]
 60%|█████▉    | 22653/37963 [51:21:46<36:17:48,  8.53s/it]
 60%|█████▉    | 22654/37963 [51:21:54<35:16:23,  8.29s/it]
 60%|█████▉    | 22655/37963 [51:22:01<34:27:42,  8.10s/it]
 60%|█████▉    | 22656/37963 [51:22:09<33:48:49,  7.95s/it]
 60%|█████▉    | 22657/37963 [51:22:17<33:35:57,  7.90s/it]
 60%|█████▉    | 22658/37963 [51:22:24<32:53:28,  7.74s/it]
 60%|█████▉    | 22659/37963 [51:22:32<32:50:18,  7.72s/it]
 60%|█████▉    | 22660/37963 [51:22:40<32:55:14,  7.74s/it]
                                                           
{'loss': '0.146', 'grad_norm': '2.684', 'learning_rate': '7.379e-06', 'epoch': '0.5969'}
+
 60%|█████▉    | 22660/37963 [51:22:40<32:55:14,  7.74s/it]
 60%|█████▉    | 22661/37963 [51:22:47<33:00:15,  7.76s/it]
 60%|█████▉    | 22662/37963 [51:22:55<32:34:37,  7.66s/it]
 60%|█████▉    | 22663/37963 [51:23:03<32:45:25,  7.71s/it]
 60%|█████▉    | 22664/37963 [51:23:10<32:50:20,  7.73s/it]
 60%|█████▉    | 22665/37963 [51:23:18<32:38:58,  7.68s/it]
 60%|█████▉    | 22666/37963 [51:23:28<35:54:10,  8.45s/it]
 60%|█████▉    | 22667/37963 [51:23:36<35:14:43,  8.30s/it]
 60%|█████▉    | 22668/37963 [51:23:47<37:57:32,  8.93s/it]
 60%|█████▉    | 22669/37963 [51:23:54<36:20:02,  8.55s/it]
 60%|█████▉    | 22670/37963 [51:24:02<35:23:10,  8.33s/it]
                                                           
{'loss': '0.1476', 'grad_norm': '1.941', 'learning_rate': '7.371e-06', 'epoch': '0.5972'}
+
 60%|█████▉    | 22670/37963 [51:24:02<35:23:10,  8.33s/it]
 60%|█████▉    | 22671/37963 [51:24:10<34:52:36,  8.21s/it]
 60%|█████▉    | 22672/37963 [51:24:18<34:22:12,  8.09s/it]
 60%|█████▉    | 22673/37963 [51:24:25<33:27:57,  7.88s/it]
 60%|█████▉    | 22674/37963 [51:24:33<33:26:54,  7.88s/it]
 60%|█████▉    | 22675/37963 [51:24:41<33:10:24,  7.81s/it]
 60%|█████▉    | 22676/37963 [51:24:51<36:30:41,  8.60s/it]
 60%|█████▉    | 22677/37963 [51:24:59<35:33:36,  8.37s/it]
 60%|█████▉    | 22678/37963 [51:25:07<34:28:58,  8.12s/it]
 60%|█████▉    | 22679/37963 [51:25:17<37:01:30,  8.72s/it]
 60%|█████▉    | 22680/37963 [51:25:24<35:50:02,  8.44s/it]
                                                           
{'loss': '0.131', 'grad_norm': '2.035', 'learning_rate': '7.363e-06', 'epoch': '0.5974'}
+
 60%|█████▉    | 22680/37963 [51:25:24<35:50:02,  8.44s/it]
 60%|█████▉    | 22681/37963 [51:25:32<35:13:11,  8.30s/it]
 60%|█████▉    | 22682/37963 [51:25:40<34:17:39,  8.08s/it]
 60%|█████▉    | 22683/37963 [51:25:48<33:46:42,  7.96s/it]
 60%|█████▉    | 22684/37963 [51:25:55<33:31:02,  7.90s/it]
 60%|█████▉    | 22685/37963 [51:26:03<33:23:24,  7.87s/it]
 60%|█████▉    | 22686/37963 [51:26:11<33:15:54,  7.84s/it]
 60%|█████▉    | 22687/37963 [51:26:19<32:58:06,  7.77s/it]
 60%|█████▉    | 22688/37963 [51:26:26<32:41:32,  7.70s/it]
 60%|█████▉    | 22689/37963 [51:26:37<36:08:17,  8.52s/it]
 60%|█████▉    | 22690/37963 [51:26:44<35:02:39,  8.26s/it]
                                                           
{'loss': '0.1466', 'grad_norm': '2.282', 'learning_rate': '7.355e-06', 'epoch': '0.5977'}
+
 60%|█████▉    | 22690/37963 [51:26:44<35:02:39,  8.26s/it]
 60%|█████▉    | 22691/37963 [51:26:52<34:14:33,  8.07s/it]
 60%|█████▉    | 22692/37963 [51:26:59<33:36:02,  7.92s/it]
 60%|█████▉    | 22693/37963 [51:27:07<33:15:37,  7.84s/it]
 60%|█████▉    | 22694/37963 [51:27:15<33:07:02,  7.81s/it]
 60%|█████▉    | 22695/37963 [51:27:25<36:21:06,  8.57s/it]
 60%|█████▉    | 22696/37963 [51:27:33<35:22:12,  8.34s/it]
 60%|█████▉    | 22697/37963 [51:27:41<34:55:01,  8.23s/it]
 60%|█████▉    | 22698/37963 [51:27:49<34:26:55,  8.12s/it]
 60%|█████▉    | 22699/37963 [51:27:57<34:08:21,  8.05s/it]
 60%|█████▉    | 22700/37963 [51:28:04<33:48:09,  7.97s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '4.306', 'learning_rate': '7.346e-06', 'epoch': '0.598'}
+
 60%|█████▉    | 22700/37963 [51:28:04<33:48:09,  7.97s/it]
 60%|█████▉    | 22701/37963 [51:28:12<33:34:42,  7.92s/it]
 60%|█████▉    | 22702/37963 [51:28:20<33:23:15,  7.88s/it]
 60%|█████▉    | 22703/37963 [51:28:28<33:06:32,  7.81s/it]
 60%|█████▉    | 22704/37963 [51:28:38<36:43:33,  8.66s/it]
 60%|█████▉    | 22705/37963 [51:28:48<38:25:41,  9.07s/it]
 60%|█████▉    | 22706/37963 [51:28:56<36:42:17,  8.66s/it]
 60%|█████▉    | 22707/37963 [51:29:04<35:43:29,  8.43s/it]
 60%|█████▉    | 22708/37963 [51:29:12<34:45:16,  8.20s/it]
 60%|█████▉    | 22709/37963 [51:29:19<34:05:53,  8.05s/it]
 60%|█████▉    | 22710/37963 [51:29:27<33:01:45,  7.80s/it]
                                                           
{'loss': '0.1429', 'grad_norm': '2.304', 'learning_rate': '7.338e-06', 'epoch': '0.5982'}
+
 60%|█████▉    | 22710/37963 [51:29:27<33:01:45,  7.80s/it]
 60%|█████▉    | 22711/37963 [51:29:37<36:26:07,  8.60s/it]
 60%|█████▉    | 22712/37963 [51:29:45<35:16:17,  8.33s/it]
 60%|█████▉    | 22713/37963 [51:29:53<34:37:42,  8.17s/it]
 60%|█████▉    | 22714/37963 [51:30:00<34:02:46,  8.04s/it]
 60%|█████▉    | 22715/37963 [51:30:08<33:44:49,  7.97s/it]
 60%|████��▉    | 22716/37963 [51:30:16<33:17:12,  7.86s/it]
 60%|█████▉    | 22717/37963 [51:30:24<33:24:12,  7.89s/it]
 60%|█████▉    | 22718/37963 [51:30:31<33:00:08,  7.79s/it]
 60%|█████▉    | 22719/37963 [51:30:39<32:45:27,  7.74s/it]
 60%|█████▉    | 22720/37963 [51:30:49<36:19:40,  8.58s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '3.486', 'learning_rate': '7.33e-06', 'epoch': '0.5985'}
+
 60%|█████▉    | 22720/37963 [51:30:49<36:19:40,  8.58s/it]
 60%|█████▉    | 22721/37963 [51:30:57<35:21:30,  8.35s/it]
 60%|█████▉    | 22722/37963 [51:31:05<34:27:28,  8.14s/it]
 60%|█████▉    | 22723/37963 [51:31:15<37:36:41,  8.88s/it]
 60%|█████▉    | 22724/37963 [51:31:23<36:08:05,  8.54s/it]
 60%|█████▉    | 22725/37963 [51:31:31<34:59:19,  8.27s/it]
 60%|█████▉    | 22726/37963 [51:31:38<34:12:16,  8.08s/it]
 60%|█████▉    | 22727/37963 [51:31:46<33:55:02,  8.01s/it]
 60%|█████▉    | 22728/37963 [51:31:54<33:29:21,  7.91s/it]
 60%|█████▉    | 22729/37963 [51:32:02<33:32:03,  7.92s/it]
 60%|█████▉    | 22730/37963 [51:32:09<33:06:00,  7.82s/it]
                                                           
{'loss': '0.1323', 'grad_norm': '2.025', 'learning_rate': '7.322e-06', 'epoch': '0.5987'}
+
 60%|█████▉    | 22730/37963 [51:32:09<33:06:00,  7.82s/it]
 60%|█████▉    | 22731/37963 [51:32:17<32:45:44,  7.74s/it]
 60%|█████▉    | 22732/37963 [51:32:25<32:38:23,  7.71s/it]
 60%|█████▉    | 22733/37963 [51:32:33<32:47:52,  7.75s/it]
 60%|█████▉    | 22734/37963 [51:32:40<32:46:36,  7.75s/it]
 60%|█████▉    | 22735/37963 [51:32:48<32:43:12,  7.74s/it]
 60%|█████▉    | 22736/37963 [51:32:56<32:47:27,  7.75s/it]
 60%|█████▉    | 22737/37963 [51:33:07<36:34:13,  8.65s/it]
 60%|█████▉    | 22738/37963 [51:33:14<35:34:51,  8.41s/it]
 60%|█████▉    | 22739/37963 [51:33:22<34:56:20,  8.26s/it]
 60%|█████▉    | 22740/37963 [51:33:30<34:16:02,  8.10s/it]
                                                           
{'loss': '0.1326', 'grad_norm': '1.764', 'learning_rate': '7.314e-06', 'epoch': '0.599'}
+
 60%|█████▉    | 22740/37963 [51:33:30<34:16:02,  8.10s/it]
 60%|█████▉    | 22741/37963 [51:33:38<33:48:35,  8.00s/it]
 60%|█████▉    | 22742/37963 [51:33:46<33:39:48,  7.96s/it]
 60%|█████▉    | 22743/37963 [51:33:56<36:31:58,  8.64s/it]
 60%|█████▉    | 22744/37963 [51:34:04<35:31:39,  8.40s/it]
 60%|█████▉    | 22745/37963 [51:34:11<34:40:26,  8.20s/it]
 60%|█████▉    | 22746/37963 [51:34:19<34:00:56,  8.05s/it]
 60%|█████▉    | 22747/37963 [51:34:27<33:33:12,  7.94s/it]
 60%|█████▉    | 22748/37963 [51:34:35<33:30:40,  7.93s/it]
 60%|█████▉    | 22749/37963 [51:34:42<33:01:20,  7.81s/it]
 60%|█████▉    | 22750/37963 [51:34:50<32:45:09,  7.75s/it]
                                                           
{'loss': '0.1336', 'grad_norm': '1.671', 'learning_rate': '7.305e-06', 'epoch': '0.5993'}
+
 60%|█████▉    | 22750/37963 [51:34:50<32:45:09,  7.75s/it]
 60%|█████▉    | 22751/37963 [51:34:58<32:43:17,  7.74s/it]
 60%|█████▉    | 22752/37963 [51:35:05<32:34:07,  7.71s/it]
 60%|█████▉    | 22753/37963 [51:35:16<35:52:26,  8.49s/it]
 60%|█████▉    | 22754/37963 [51:35:23<34:48:10,  8.24s/it]
 60%|█████▉    | 22755/37963 [51:35:34<37:57:13,  8.98s/it]
 60%|█████▉    | 22756/37963 [51:35:42<36:18:38,  8.60s/it]
 60%|█████▉    | 22757/37963 [51:35:49<35:23:51,  8.38s/it]
 60%|█████▉    | 22758/37963 [51:36:00<38:14:30,  9.05s/it]
 60%|█████▉    | 22759/37963 [51:36:08<36:12:12,  8.57s/it]
 60%|█████▉    | 22760/37963 [51:36:16<35:26:24,  8.39s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '2.795', 'learning_rate': '7.297e-06', 'epoch': '0.5995'}
+
 60%|█████▉    | 22760/37963 [51:36:16<35:26:24,  8.39s/it]
 60%|█████▉    | 22761/37963 [51:36:23<34:52:43,  8.26s/it]
 60%|█████▉    | 22762/37963 [51:36:31<34:07:39,  8.08s/it]
 60%|█████▉    | 22763/37963 [51:36:41<36:23:13,  8.62s/it]
 60%|█████▉    | 22764/37963 [51:36:49<35:09:56,  8.33s/it]
 60%|█████▉    | 22765/37963 [51:36:56<34:15:18,  8.11s/it]
 60%|█████▉    | 22766/37963 [51:37:04<33:41:02,  7.98s/it]
 60%|█████▉    | 22767/37963 [51:37:12<33:20:57,  7.90s/it]
 60%|█████▉    | 22768/37963 [51:37:19<33:09:04,  7.85s/it]
 60%|█████▉    | 22769/37963 [51:37:30<36:22:59,  8.62s/it]
 60%|█████▉    | 22770/37963 [51:37:37<35:08:09,  8.33s/it]
                                                           
{'loss': '0.1398', 'grad_norm': '1.969', 'learning_rate': '7.289e-06', 'epoch': '0.5998'}
+
 60%|█████▉    | 22770/37963 [51:37:37<35:08:09,  8.33s/it]
 60%|█████▉    | 22771/37963 [51:37:45<34:20:44,  8.14s/it]
 60%|█████▉    | 22772/37963 [51:37:53<33:54:37,  8.04s/it]
 60%|█████▉    | 22773/37963 [51:38:01<33:55:11,  8.04s/it]
 60%|█████▉    | 22774/37963 [51:38:12<37:15:26,  8.83s/it]
 60%|█████▉    | 22775/37963 [51:38:20<36:11:24,  8.58s/it]
 60%|█████▉    | 22776/37963 [51:38:27<35:13:24,  8.35s/it]
 60%|█████▉    | 22777/37963 [51:38:35<34:40:51,  8.22s/it]
 60%|██████    | 22778/37963 [51:38:44<34:31:37,  8.19s/it]
 60%|██████    | 22779/37963 [51:38:51<34:01:06,  8.07s/it]
 60%|██████    | 22780/37963 [51:38:59<33:55:54,  8.05s/it]
                                                           
{'loss': '0.1423', 'grad_norm': '1.393', 'learning_rate': '7.281e-06', 'epoch': '0.6001'}
+
 60%|██████    | 22780/37963 [51:38:59<33:55:54,  8.05s/it]
 60%|██████    | 22781/37963 [51:39:07<33:03:55,  7.84s/it]
 60%|██████    | 22782/37963 [51:39:15<33:04:43,  7.84s/it]
 60%|██████    | 22783/37963 [51:39:22<32:51:52,  7.79s/it]
 60%|██████    | 22784/37963 [51:39:33<36:20:28,  8.62s/it]
 60%|██████    | 22785/37963 [51:39:41<35:19:05,  8.38s/it]
 60%|██████    | 22786/37963 [51:39:49<34:51:57,  8.27s/it]
 60%|██████    | 22787/37963 [51:39:57<34:35:38,  8.21s/it]
 60%|██████    | 22788/37963 [51:40:05<34:26:21,  8.17s/it]
 60%|██████    | 22789/37963 [51:40:12<33:49:18,  8.02s/it]
 60%|██████    | 22790/37963 [51:40:20<33:21:54,  7.92s/it]
                                                           
{'loss': '0.1435', 'grad_norm': '2.717', 'learning_rate': '7.273e-06', 'epoch': '0.6003'}
+
 60%|██████    | 22790/37963 [51:40:20<33:21:54,  7.92s/it]
 60%|██████    | 22791/37963 [51:40:28<33:05:53,  7.85s/it]
 60%|██████    | 22792/37963 [51:40:35<32:29:00,  7.71s/it]
 60%|██████    | 22793/37963 [51:40:43<32:06:12,  7.62s/it]
 60%|██████    | 22794/37963 [51:40:50<32:11:54,  7.64s/it]
 60%|██████    | 22795/37963 [51:41:00<35:27:52,  8.42s/it]
 60%|██████    | 22796/37963 [51:41:08<34:32:25,  8.20s/it]
 60%|██████    | 22797/37963 [51:41:19<37:29:19,  8.90s/it]
 60%|██████    | 22798/37963 [51:41:26<35:58:44,  8.54s/it]
 60%|██████    | 22799/37963 [51:41:37<38:41:31,  9.19s/it]
 60%|██████    | 22800/37963 [51:41:45<36:50:51,  8.75s/it]
                                                           
{'loss': '0.1536', 'grad_norm': '4.237', 'learning_rate': '7.264e-06', 'epoch': '0.6006'}
+
 60%|██████    | 22800/37963 [51:41:45<36:50:51,  8.75s/it]
 60%|██████    | 22801/37963 [51:41:53<35:32:42,  8.44s/it]
 60%|██████    | 22802/37963 [51:42:00<34:51:42,  8.28s/it]
 60%|██████    | 22803/37963 [51:42:08<34:15:25,  8.13s/it]
 60%|██████    | 22804/37963 [51:42:16<33:49:04,  8.03s/it]
 60%|██████    | 22805/37963 [51:42:24<33:51:10,  8.04s/it]
 60%|██████    | 22806/37963 [51:42:35<37:09:36,  8.83s/it]
 60%|██████    | 22807/37963 [51:42:42<35:10:50,  8.36s/it]
 60%|██████    | 22808/37963 [51:42:50<34:15:33,  8.14s/it]
 60%|██████    | 22809/37963 [51:42:57<33:54:23,  8.05s/it]
 60%|██████    | 22810/37963 [51:43:05<33:50:08,  8.04s/it]
                                                           
{'loss': '0.1461', 'grad_norm': '2.205', 'learning_rate': '7.256e-06', 'epoch': '0.6009'}
+
 60%|██████    | 22810/37963 [51:43:05<33:50:08,  8.04s/it]
 60%|██████    | 22811/37963 [51:43:16<36:51:58,  8.76s/it]
 60%|██████    | 22812/37963 [51:43:24<35:34:55,  8.45s/it]
 60%|██████    | 22813/37963 [51:43:31<34:19:08,  8.16s/it]
 60%|██████    | 22814/37963 [51:43:39<33:43:28,  8.01s/it]
 60%|██████    | 22815/37963 [51:43:49<36:45:38,  8.74s/it]
 60%|██████    | 22816/37963 [51:43:57<35:28:09,  8.43s/it]
 60%|██████    | 22817/37963 [51:44:05<34:33:08,  8.21s/it]
 60%|██████    | 22818/37963 [51:44:12<34:01:01,  8.09s/it]
 60%|██████    | 22819/37963 [51:44:20<33:37:51,  7.99s/it]
 60%|██████    | 22820/37963 [51:44:28<33:25:47,  7.95s/it]
                                                           
{'loss': '0.1463', 'grad_norm': '1.691', 'learning_rate': '7.248e-06', 'epoch': '0.6011'}
+
 60%|██████    | 22820/37963 [51:44:28<33:25:47,  7.95s/it]
 60%|██████    | 22821/37963 [51:44:36<33:22:23,  7.93s/it]
 60%|██████    | 22822/37963 [51:44:44<33:16:27,  7.91s/it]
 60%|██████    | 22823/37963 [51:44:52<33:05:06,  7.87s/it]
 60%|█████���    | 22824/37963 [51:44:59<32:34:56,  7.75s/it]
 60%|██████    | 22825/37963 [51:45:07<32:39:33,  7.77s/it]
 60%|██████    | 22826/37963 [51:45:14<32:20:23,  7.69s/it]
 60%|██████    | 22827/37963 [51:45:22<32:27:43,  7.72s/it]
 60%|██████    | 22828/37963 [51:45:33<36:05:19,  8.58s/it]
 60%|██████    | 22829/37963 [51:45:41<35:06:51,  8.35s/it]
 60%|██████    | 22830/37963 [51:45:48<34:22:22,  8.18s/it]
                                                           
{'loss': '0.151', 'grad_norm': '3.104', 'learning_rate': '7.24e-06', 'epoch': '0.6014'}
+
 60%|██████    | 22830/37963 [51:45:48<34:22:22,  8.18s/it]
 60%|██████    | 22831/37963 [51:45:56<33:59:19,  8.09s/it]
 60%|██████    | 22832/37963 [51:46:04<33:31:16,  7.98s/it]
 60%|██████    | 22833/37963 [51:46:11<32:47:54,  7.80s/it]
 60%|██████    | 22834/37963 [51:46:19<32:52:06,  7.82s/it]
 60%|██████    | 22835/37963 [51:46:27<32:38:46,  7.77s/it]
 60%|██████    | 22836/37963 [51:46:35<33:05:59,  7.88s/it]
 60%|██████    | 22837/37963 [51:46:46<36:26:26,  8.67s/it]
 60%|██████    | 22838/37963 [51:46:53<35:10:34,  8.37s/it]
 60%|██████    | 22839/37963 [51:47:01<34:12:48,  8.14s/it]
 60%|██████    | 22840/37963 [51:47:09<34:12:44,  8.14s/it]
                                                           
{'loss': '0.135', 'grad_norm': '1.862', 'learning_rate': '7.232e-06', 'epoch': '0.6016'}
+
 60%|██████    | 22840/37963 [51:47:09<34:12:44,  8.14s/it]
 60%|██████    | 22841/37963 [51:47:17<33:43:43,  8.03s/it]
 60%|██████    | 22842/37963 [51:47:24<33:11:54,  7.90s/it]
 60%|██████    | 22843/37963 [51:47:32<32:52:34,  7.83s/it]
 60%|██████    | 22844/37963 [51:47:40<32:40:13,  7.78s/it]
 60%|██████    | 22845/37963 [51:47:50<36:17:49,  8.64s/it]
 60%|██████    | 22846/37963 [51:47:58<34:58:42,  8.33s/it]
 60%|██████    | 22847/37963 [51:48:06<34:28:38,  8.21s/it]
 60%|██████    | 22848/37963 [51:48:14<34:07:45,  8.13s/it]
 60%|██████    | 22849/37963 [51:48:24<36:44:00,  8.75s/it]
 60%|██████    | 22850/37963 [51:48:34<38:44:18,  9.23s/it]
                                                           
{'loss': '0.1443', 'grad_norm': '1.522', 'learning_rate': '7.223e-06', 'epoch': '0.6019'}
+
 60%|██████    | 22850/37963 [51:48:34<38:44:18,  9.23s/it]
 60%|██████    | 22851/37963 [51:48:42<36:45:19,  8.76s/it]
 60%|██████    | 22852/37963 [51:48:50<35:26:46,  8.44s/it]
 60%|██████    | 22853/37963 [51:48:57<34:31:52,  8.23s/it]
 60%|██████    | 22854/37963 [51:49:05<34:04:50,  8.12s/it]
 60%|██████    | 22855/37963 [51:49:13<33:37:38,  8.01s/it]
 60%|██████    | 22856/37963 [51:49:21<33:26:01,  7.97s/it]
 60%|██████    | 22857/37963 [51:49:29<32:58:57,  7.86s/it]
 60%|██████    | 22858/37963 [51:49:36<33:03:37,  7.88s/it]
 60%|██████    | 22859/37963 [51:49:44<32:24:40,  7.73s/it]
 60%|██████    | 22860/37963 [51:49:51<32:15:51,  7.69s/it]
                                                           
{'loss': '0.1407', 'grad_norm': '1.972', 'learning_rate': '7.215e-06', 'epoch': '0.6022'}
+
 60%|██████    | 22860/37963 [51:49:51<32:15:51,  7.69s/it]
 60%|██████    | 22861/37963 [51:49:59<32:12:18,  7.68s/it]
 60%|██████    | 22862/37963 [51:50:07<32:16:35,  7.69s/it]
 60%|██████    | 22863/37963 [51:50:15<32:28:04,  7.74s/it]
 60%|██████    | 22864/37963 [51:50:22<32:07:07,  7.66s/it]
 60%|██████    | 22865/37963 [51:50:32<35:14:59,  8.41s/it]
 60%|██████    | 22866/37963 [51:50:40<34:21:16,  8.19s/it]
 60%|██████    | 22867/37963 [51:50:48<34:00:27,  8.11s/it]
 60%|██████    | 22868/37963 [51:50:58<36:45:06,  8.76s/it]
 60%|██████    | 22869/37963 [51:51:06<35:27:25,  8.46s/it]
 60%|██████    | 22870/37963 [51:51:14<34:33:23,  8.24s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '2.365', 'learning_rate': '7.207e-06', 'epoch': '0.6024'}
+
 60%|██████    | 22870/37963 [51:51:14<34:33:23,  8.24s/it]
 60%|██████    | 22871/37963 [51:51:21<33:56:47,  8.10s/it]
 60%|██████    | 22872/37963 [51:51:32<37:01:51,  8.83s/it]
 60%|██████    | 22873/37963 [51:51:40<35:55:20,  8.57s/it]
 60%|██████    | 22874/37963 [51:51:48<34:53:23,  8.32s/it]
 60%|██████    | 22875/37963 [51:51:55<34:09:32,  8.15s/it]
 60%|██████    | 22876/37963 [51:52:03<33:33:08,  8.01s/it]
 60%|██████    | 22877/37963 [51:52:11<33:33:46,  8.01s/it]
 60%|██████    | 22878/37963 [51:52:19<33:18:47,  7.95s/it]
 60%|██████    | 22879/37963 [51:52:27<33:06:41,  7.90s/it]
 60%|██████    | 22880/37963 [51:52:34<32:59:11,  7.87s/it]
                                                           
{'loss': '0.1483', 'grad_norm': '2.565', 'learning_rate': '7.199e-06', 'epoch': '0.6027'}
+
 60%|██████    | 22880/37963 [51:52:34<32:59:11,  7.87s/it]
 60%|██████    | 22881/37963 [51:52:42<33:06:55,  7.90s/it]
 60%|██████    | 22882/37963 [51:52:50<33:08:17,  7.91s/it]
 60%|██████    | 22883/37963 [51:52:58<32:29:37,  7.76s/it]
 60%|██████    | 22884/37963 [51:53:05<32:15:02,  7.70s/it]
 60%|██████    | 22885/37963 [51:53:16<35:52:42,  8.57s/it]
 60%|██████    | 22886/37963 [51:53:23<34:13:06,  8.17s/it]
 60%|██████    | 22887/37963 [51:53:30<33:07:36,  7.91s/it]
 60%|██████    | 22888/37963 [51:53:41<36:15:26,  8.66s/it]
 60%|██████    | 22889/37963 [51:53:48<34:54:02,  8.34s/it]
 60%|██████    | 22890/37963 [51:53:56<34:06:33,  8.15s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '1.221', 'learning_rate': '7.191e-06', 'epoch': '0.603'}
+
 60%|██████    | 22890/37963 [51:53:56<34:06:33,  8.15s/it]
 60%|██████    | 22891/37963 [51:54:04<33:47:21,  8.07s/it]
 60%|██████    | 22892/37963 [51:54:12<33:35:06,  8.02s/it]
 60%|██████    | 22893/37963 [51:54:25<39:43:10,  9.49s/it]
 60%|██████    | 22894/37963 [51:54:33<37:43:49,  9.01s/it]
 60%|██████    | 22895/37963 [51:54:40<35:56:41,  8.59s/it]
 60%|██████    | 22896/37963 [51:54:48<34:54:16,  8.34s/it]
 60%|██████    | 22897/37963 [51:54:56<34:02:51,  8.14s/it]
 60%|██████    | 22898/37963 [51:55:04<33:39:20,  8.04s/it]
 60%|██████    | 22899/37963 [51:55:11<33:22:10,  7.97s/it]
 60%|██████    | 22900/37963 [51:55:19<33:17:01,  7.95s/it]
                                                           
{'loss': '0.1383', 'grad_norm': '1.87', 'learning_rate': '7.182e-06', 'epoch': '0.6032'}
+
 60%|██████    | 22900/37963 [51:55:19<33:17:01,  7.95s/it]
 60%|██████    | 22901/37963 [51:55:27<32:53:00,  7.86s/it]
 60%|██████    | 22902/37963 [51:55:34<32:24:09,  7.75s/it]
 60%|██████    | 22903/37963 [51:55:45<35:27:24,  8.48s/it]
 60%|██████    | 22904/37963 [51:55:52<34:00:53,  8.13s/it]
 60%|██████    | 22905/37963 [51:56:00<33:33:04,  8.02s/it]
 60%|██████    | 22906/37963 [51:56:08<33:16:10,  7.95s/it]
 60%|██████    | 22907/37963 [51:56:15<33:07:00,  7.92s/it]
 60%|██████    | 22908/37963 [51:56:23<32:53:21,  7.86s/it]
 60%|██████    | 22909/37963 [51:56:33<35:59:15,  8.61s/it]
 60%|██████    | 22910/37963 [51:56:41<34:57:49,  8.36s/it]
                                                           
{'loss': '0.1468', 'grad_norm': '1.849', 'learning_rate': '7.174e-06', 'epoch': '0.6035'}
+
 60%|██████    | 22910/37963 [51:56:41<34:57:49,  8.36s/it]
 60%|██████    | 22911/37963 [51:56:49<34:15:57,  8.20s/it]
 60%|██████    | 22912/37963 [51:56:57<34:04:19,  8.15s/it]
 60%|██████    | 22913/37963 [51:57:05<33:42:03,  8.06s/it]
 60%|██████    | 22914/37963 [51:57:13<33:05:22,  7.92s/it]
 60%|██████    | 22915/37963 [51:57:20<32:47:41,  7.85s/it]
 60%|██████    | 22916/37963 [51:57:28<32:31:05,  7.78s/it]
 60%|██████    | 22917/37963 [51:57:38<35:52:03,  8.58s/it]
 60%|██████    | 22918/37963 [51:57:46<34:54:58,  8.35s/it]
 60%|██████    | 22919/37963 [51:57:54<34:04:31,  8.15s/it]
 60%|██████    | 22920/37963 [51:58:02<33:41:23,  8.06s/it]
                                                           
{'loss': '0.1328', 'grad_norm': '0.9321', 'learning_rate': '7.166e-06', 'epoch': '0.6037'}
+
 60%|██████    | 22920/37963 [51:58:02<33:41:23,  8.06s/it]
 60%|██████    | 22921/37963 [51:58:10<33:25:19,  8.00s/it]
 60%|██████    | 22922/37963 [51:58:17<32:49:23,  7.86s/it]
 60%|██████    | 22923/37963 [51:58:25<32:33:13,  7.79s/it]
 60%|██████    | 22924/37963 [51:58:32<32:22:10,  7.75s/it]
 60%|██████    | 22925/37963 [51:58:40<32:13:15,  7.71s/it]
 60%|██████    | 22926/37963 [51:58:51<36:09:10,  8.66s/it]
 60%|██████    | 22927/37963 [51:58:58<34:56:05,  8.36s/it]
 60%|██████    | 22928/37963 [51:59:06<34:03:05,  8.15s/it]
 60%|██████    | 22929/37963 [51:59:14<33:40:06,  8.06s/it]
 60%|██████    | 22930/37963 [51:59:22<33:23:35,  8.00s/it]
                                                           
{'loss': '0.1299', 'grad_norm': '1.937', 'learning_rate': '7.158e-06', 'epoch': '0.604'}
+
 60%|██████    | 22930/37963 [51:59:22<33:23:35,  8.00s/it]
 60%|██████    | 22931/37963 [51:59:29<32:56:22,  7.89s/it]
 60%|██████    | 22932/37963 [51:59:40<36:17:56,  8.69s/it]
 60%|██████    | 22933/37963 [51:59:48<35:01:12,  8.39s/it]
 60%|██████    | 22934/37963 [51:59:56<34:27:23,  8.25s/it]
 60%|██████    | 22935/37963 [52:00:04<33:58:32,  8.14s/it]
 60%|██████    | 22936/37963 [52:00:14<36:45:42,  8.81s/it]
 60%|██████    | 22937/37963 [52:00:24<38:21:54,  9.19s/it]
 60%|██████    | 22938/37963 [52:00:32<36:24:13,  8.72s/it]
 60%|██████    | 22939/37963 [52:00:39<34:58:36,  8.38s/it]
 60%|██████    | 22940/37963 [52:00:47<34:07:33,  8.18s/it]
                                                           
{'loss': '0.1346', 'grad_norm': '2.473', 'learning_rate': '7.15e-06', 'epoch': '0.6043'}
+
 60%|██████    | 22940/37963 [52:00:47<34:07:33,  8.18s/it]
 60%|██████    | 22941/37963 [52:00:58<37:10:22,  8.91s/it]
 60%|██████    | 22942/37963 [52:01:05<35:47:12,  8.58s/it]
 60%|██████    | 22943/37963 [52:01:13<34:40:11,  8.31s/it]
 60%|██████    | 22944/37963 [52:01:21<34:08:52,  8.19s/it]
 60%|██████    | 22945/37963 [52:01:29<33:26:33,  8.02s/it]
 60%|██████    | 22946/37963 [52:01:36<33:09:37,  7.95s/it]
 60%|██████    | 22947/37963 [52:01:44<32:50:16,  7.87s/it]
 60%|██████    | 22948/37963 [52:01:52<32:33:00,  7.80s/it]
 60%|██████    | 22949/37963 [52:02:02<35:11:19,  8.44s/it]
 60%|██████    | 22950/37963 [52:02:09<34:26:51,  8.26s/it]
                                                           
{'loss': '0.1422', 'grad_norm': '1.571', 'learning_rate': '7.141e-06', 'epoch': '0.6045'}
+
 60%|██████    | 22950/37963 [52:02:09<34:26:51,  8.26s/it]
 60%|██████    | 22951/37963 [52:02:17<34:00:52,  8.16s/it]
 60%|██████    | 22952/37963 [52:02:25<33:28:01,  8.03s/it]
 60%|██████    | 22953/37963 [52:02:33<32:55:00,  7.89s/it]
 60%|██████    | 22954/37963 [52:02:41<33:04:09,  7.93s/it]
 60%|██████    | 22955/37963 [52:02:51<36:04:15,  8.65s/it]
 60%|██████    | 22956/37963 [52:02:59<34:42:51,  8.33s/it]
 60%|██████    | 22957/37963 [52:03:06<34:05:42,  8.18s/it]
 60%|██████    | 22958/37963 [52:03:14<33:33:17,  8.05s/it]
 60%|██████    | 22959/37963 [52:03:22<33:03:32,  7.93s/it]
 60%|██████    | 22960/37963 [52:03:32<35:59:56,  8.64s/it]
                                                           
{'loss': '0.15', 'grad_norm': '1.599', 'learning_rate': '7.133e-06', 'epoch': '0.6048'}
+
 60%|██████    | 22960/37963 [52:03:32<35:59:56,  8.64s/it]
 60%|██████    | 22961/37963 [52:03:40<35:00:20,  8.40s/it]
 60%|██████    | 22962/37963 [52:03:48<34:04:49,  8.18s/it]
 60%|██████    | 22963/37963 [52:03:55<33:27:05,  8.03s/it]
 60%|██████    | 22964/37963 [52:04:03<32:58:58,  7.92s/it]
 60%|██████    | 22965/37963 [52:04:11<32:36:21,  7.83s/it]
 60%|██████    | 22966/37963 [52:04:19<32:53:47,  7.90s/it]
 60%|██████    | 22967/37963 [52:04:27<32:56:16,  7.91s/it]
 61%|██████    | 22968/37963 [52:04:35<33:04:00,  7.94s/it]
 61%|██████    | 22969/37963 [52:04:42<32:32:19,  7.81s/it]
 61%|██████    | 22970/37963 [52:04:50<32:33:32,  7.82s/it]
                                                           
{'loss': '0.1365', 'grad_norm': '4.234', 'learning_rate': '7.125e-06', 'epoch': '0.6051'}
+
 61%|██████    | 22970/37963 [52:04:50<32:33:32,  7.82s/it]
 61%|██████    | 22971/37963 [52:04:58<32:20:25,  7.77s/it]
 61%|██████    | 22972/37963 [52:05:05<32:24:39,  7.78s/it]
 61%|██████    | 22973/37963 [52:05:13<32:20:02,  7.77s/it]
 61%|██████    | 22974/37963 [52:05:21<32:16:16,  7.75s/it]
 61%|██████    | 22975/37963 [52:05:29<32:23:14,  7.78s/it]
 61%|██████    | 22976/37963 [52:05:39<36:09:08,  8.68s/it]
 61%|██████    | 22977/37963 [52:05:47<35:13:32,  8.46s/it]
 61%|██████    | 22978/37963 [52:05:55<34:19:49,  8.25s/it]
 61%|██████    | 22979/37963 [52:06:03<33:49:20,  8.13s/it]
 61%|██████    | 22980/37963 [52:06:13<36:24:19,  8.75s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '4.005', 'learning_rate': '7.117e-06', 'epoch': '0.6053'}
+
 61%|██████    | 22980/37963 [52:06:13<36:24:19,  8.75s/it]
 61%|██████    | 22981/37963 [52:06:21<35:22:50,  8.50s/it]
 61%|██████    | 22982/37963 [52:06:29<34:33:08,  8.30s/it]
 61%|██████    | 22983/37963 [52:06:37<33:57:25,  8.16s/it]
 61%|██████    | 22984/37963 [52:06:44<33:16:27,  8.00s/it]
 61%|██████    | 22985/37963 [52:06:58<39:39:42,  9.53s/it]
 61%|██████    | 22986/37963 [52:07:09<41:47:31, 10.05s/it]
 61%|██████    | 22987/37963 [52:07:17<39:02:40,  9.39s/it]
 61%|██████    | 22988/37963 [52:07:24<37:00:44,  8.90s/it]
 61%|██████    | 22989/37963 [52:07:32<35:20:58,  8.50s/it]
 61%|██████    | 22990/37963 [52:07:40<34:27:51,  8.29s/it]
                                                           
{'loss': '0.1283', 'grad_norm': '1.626', 'learning_rate': '7.109e-06', 'epoch': '0.6056'}
+
 61%|██████    | 22990/37963 [52:07:40<34:27:51,  8.29s/it]
 61%|██████    | 22991/37963 [52:07:48<33:50:40,  8.14s/it]
 61%|██████    | 22992/37963 [52:07:55<33:10:36,  7.98s/it]
 61%|██████    | 22993/37963 [52:08:03<32:34:10,  7.83s/it]
 61%|██████    | 22994/37963 [52:08:10<32:29:45,  7.82s/it]
 61%|██████    | 22995/37963 [52:08:18<32:25:28,  7.80s/it]
 61%|██████    | 22996/37963 [52:08:26<31:59:51,  7.70s/it]
 61%|██████    | 22997/37963 [52:08:33<31:42:33,  7.63s/it]
 61%|██████    | 22998/37963 [52:08:41<32:00:11,  7.70s/it]
 61%|██████    | 22999/37963 [52:08:49<32:09:52,  7.74s/it]
 61%|██████    | 23000/37963 [52:08:56<31:54:11,  7.68s/it]
                                                           
{'loss': '0.1365', 'grad_norm': '1.241', 'learning_rate': '7.101e-06', 'epoch': '0.6059'}
+
 61%|██████    | 23000/37963 [52:08:56<31:54:11,  7.68s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.51s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.51s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 61%|██████    | 23001/37963 [52:09:58<99:20:35, 23.90s/it]
 61%|██████    | 23002/37963 [52:10:06<78:56:26, 19.00s/it]
 61%|██████    | 23003/37963 [52:10:18<71:09:10, 17.12s/it]
 61%|██████    | 23004/37963 [52:10:26<59:26:46, 14.31s/it]
 61%|██████    | 23005/37963 [52:10:34<51:19:59, 12.35s/it]
 61%|██████    | 23006/37963 [52:10:42<45:27:05, 10.94s/it]
 61%|██████    | 23007/37963 [52:10:49<41:34:05, 10.01s/it]
 61%|██████    | 23008/37963 [52:10:57<39:03:34,  9.40s/it]
 61%|██████    | 23009/37963 [52:11:05<36:39:20,  8.82s/it]
 61%|██████    | 23010/37963 [52:11:13<35:22:03,  8.51s/it]
                                                           
{'loss': '0.1522', 'grad_norm': '1.889', 'learning_rate': '7.092e-06', 'epoch': '0.6061'}
+
 61%|██████    | 23010/37963 [52:11:13<35:22:03,  8.51s/it]
 61%|██████    | 23011/37963 [52:11:20<34:29:12,  8.30s/it]
 61%|██████    | 23012/37963 [52:11:28<33:54:01,  8.16s/it]
 61%|██████    | 23013/37963 [52:11:39<36:46:05,  8.85s/it]
 61%|██████    | 23014/37963 [52:11:47<35:26:13,  8.53s/it]
 61%|██████    | 23015/37963 [52:11:54<34:30:35,  8.31s/it]
 61%|██████    | 23016/37963 [52:12:02<33:37:05,  8.10s/it]
 61%|██████    | 23017/37963 [52:12:10<33:11:43,  8.00s/it]
 61%|██████    | 23018/37963 [52:12:18<33:02:40,  7.96s/it]
 61%|██████    | 23019/37963 [52:12:25<32:51:14,  7.91s/it]
 61%|██████    | 23020/37963 [52:12:33<32:43:19,  7.88s/it]
                                                           
{'loss': '0.1455', 'grad_norm': '1.962', 'learning_rate': '7.084e-06', 'epoch': '0.6064'}
+
 61%|██████    | 23020/37963 [52:12:33<32:43:19,  7.88s/it]
 61%|██████    | 23021/37963 [52:12:41<32:19:12,  7.79s/it]
 61%|██████    | 23022/37963 [52:12:48<32:08:24,  7.74s/it]
 61%|██████    | 23023/37963 [52:12:56<32:12:13,  7.76s/it]
 61%|██████    | 23024/37963 [52:13:07<35:44:06,  8.61s/it]
 61%|██████    | 23025/37963 [52:13:15<34:41:46,  8.36s/it]
 61%|██████    | 23026/37963 [52:13:22<33:57:04,  8.18s/it]
 61%|██████    | 23027/37963 [52:13:30<33:35:28,  8.10s/it]
 61%|██████    | 23028/37963 [52:13:38<33:02:10,  7.96s/it]
 61%|██████    | 23029/37963 [52:13:46<32:38:44,  7.87s/it]
 61%|██████    | 23030/37963 [52:13:56<35:58:35,  8.67s/it]
                                                           
{'loss': '0.1368', 'grad_norm': '2.085', 'learning_rate': '7.076e-06', 'epoch': '0.6066'}
+
 61%|██████    | 23030/37963 [52:13:56<35:58:35,  8.67s/it]
 61%|██████    | 23031/37963 [52:14:04<35:12:56,  8.49s/it]
 61%|██████    | 23032/37963 [52:14:12<34:09:09,  8.23s/it]
 61%|██████    | 23033/37963 [52:14:20<33:42:58,  8.13s/it]
 61%|██████    | 23034/37963 [52:14:27<33:16:14,  8.02s/it]
 61%|██████    | 23035/37963 [52:14:37<35:49:59,  8.64s/it]
 61%|██████    | 23036/37963 [52:14:52<42:58:23, 10.36s/it]
 61%|██████    | 23037/37963 [52:15:00<40:06:09,  9.67s/it]
 61%|██████    | 23038/37963 [52:15:08<37:36:45,  9.07s/it]
 61%|██████    | 23039/37963 [52:15:15<35:59:47,  8.68s/it]
 61%|██████    | 23040/37963 [52:15:23<34:52:35,  8.41s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '1.819', 'learning_rate': '7.068e-06', 'epoch': '0.6069'}
+
 61%|██████    | 23040/37963 [52:15:23<34:52:35,  8.41s/it]
 61%|██████    | 23041/37963 [52:15:31<34:14:45,  8.26s/it]
 61%|██████    | 23042/37963 [52:15:39<33:54:39,  8.18s/it]
 61%|██████    | 23043/37963 [52:15:47<33:32:56,  8.09s/it]
 61%|██████    | 23044/37963 [52:15:55<33:06:20,  7.99s/it]
 61%|██████    | 23045/37963 [52:16:02<32:33:25,  7.86s/it]
 61%|██████    | 23046/37963 [52:16:10<32:19:41,  7.80s/it]
 61%|██████    | 23047/37963 [52:16:18<32:17:37,  7.79s/it]
 61%|██████    | 23048/37963 [52:16:26<32:21:51,  7.81s/it]
 61%|██████    | 23049/37963 [52:16:34<32:32:34,  7.86s/it]
 61%|██████    | 23050/37963 [52:16:41<32:12:42,  7.78s/it]
                                                           
{'loss': '0.1453', 'grad_norm': '3.939', 'learning_rate': '7.06e-06', 'epoch': '0.6072'}
+
 61%|██████    | 23050/37963 [52:16:41<32:12:42,  7.78s/it]
 61%|██████    | 23051/37963 [52:16:51<34:54:16,  8.43s/it]
 61%|██████    | 23052/37963 [52:16:59<34:31:50,  8.34s/it]
 61%|██████    | 23053/37963 [52:17:07<33:55:37,  8.19s/it]
 61%|██████    | 23054/37963 [52:17:15<33:22:20,  8.06s/it]
 61%|██████    | 23055/37963 [52:17:24<35:20:58,  8.54s/it]
 61%|██████    | 23056/37963 [52:17:32<34:44:25,  8.39s/it]
 61%|██████    | 23057/37963 [52:17:40<34:00:31,  8.21s/it]
 61%|██████    | 23058/37963 [52:17:48<33:16:57,  8.04s/it]
 61%|██████    | 23059/37963 [52:17:56<32:45:52,  7.91s/it]
 61%|██████    | 23060/37963 [52:18:03<32:32:54,  7.86s/it]
                                                           
{'loss': '0.1436', 'grad_norm': '1.821', 'learning_rate': '7.052e-06', 'epoch': '0.6074'}
+
 61%|██████    | 23060/37963 [52:18:03<32:32:54,  7.86s/it]
 61%|██████    | 23061/37963 [52:18:14<35:29:01,  8.57s/it]
 61%|██████    | 23062/37963 [52:18:21<34:36:34,  8.36s/it]
 61%|██████    | 23063/37963 [52:18:29<33:45:48,  8.16s/it]
 61%|██████    | 23064/37963 [52:18:37<33:12:21,  8.02s/it]
 61%|██████    | 23065/37963 [52:18:44<32:34:37,  7.87s/it]
 61%|██████    | 23066/37963 [52:18:52<32:22:35,  7.82s/it]
 61%|██████    | 23067/37963 [52:19:00<32:09:21,  7.77s/it]
 61%|██████    | 23068/37963 [52:19:07<32:01:54,  7.74s/it]
 61%|██████    | 23069/37963 [52:19:15<31:24:02,  7.59s/it]
 61%|██████    | 23070/37963 [52:19:22<31:30:19,  7.62s/it]
                                                           
{'loss': '0.1362', 'grad_norm': '1.697', 'learning_rate': '7.044e-06', 'epoch': '0.6077'}
+
 61%|██████    | 23070/37963 [52:19:22<31:30:19,  7.62s/it]
 61%|██████    | 23071/37963 [52:19:30<31:35:13,  7.64s/it]
 61%|██████    | 23072/37963 [52:19:37<31:17:42,  7.57s/it]
 61%|██████    | 23073/37963 [52:19:45<31:23:21,  7.59s/it]
 61%|██████    | 23074/37963 [52:19:55<34:59:30,  8.46s/it]
 61%|██████    | 23075/37963 [52:20:03<34:00:03,  8.22s/it]
 61%|██████    | 23076/37963 [52:20:11<33:31:52,  8.11s/it]
 61%|██████    | 23077/37963 [52:20:19<32:57:56,  7.97s/it]
 61%|██████    | 23078/37963 [52:20:27<32:58:41,  7.98s/it]
 61%|██████    | 23079/37963 [52:20:37<35:50:17,  8.67s/it]
 61%|██████    | 23080/37963 [52:20:45<34:53:25,  8.44s/it]
                                                           
{'loss': '0.1585', 'grad_norm': '1.487', 'learning_rate': '7.035e-06', 'epoch': '0.608'}
+
 61%|██████    | 23080/37963 [52:20:45<34:53:25,  8.44s/it]
 61%|██████    | 23081/37963 [52:20:56<37:44:15,  9.13s/it]
 61%|██████    | 23082/37963 [52:21:03<35:59:10,  8.71s/it]
 61%|██████    | 23083/37963 [52:21:11<34:34:22,  8.36s/it]
 61%|██████    | 23084/37963 [52:21:21<37:07:56,  8.98s/it]
 61%|██████    | 23085/37963 [52:21:29<35:40:39,  8.63s/it]
 61%|██████    | 23086/37963 [52:21:37<34:29:55,  8.35s/it]
 61%|██████    | 23087/37963 [52:21:44<33:20:27,  8.07s/it]
 61%|██████    | 23088/37963 [52:21:52<32:48:51,  7.94s/it]
 61%|██████    | 23089/37963 [52:22:00<32:44:05,  7.92s/it]
 61%|██████    | 23090/37963 [52:22:11<36:40:32,  8.88s/it]
                                                           
{'loss': '0.1337', 'grad_norm': '2.996', 'learning_rate': '7.027e-06', 'epoch': '0.6082'}
+
 61%|██████    | 23090/37963 [52:22:11<36:40:32,  8.88s/it]
 61%|██████    | 23091/37963 [52:22:18<35:06:41,  8.50s/it]
 61%|██████    | 23092/37963 [52:22:26<34:02:28,  8.24s/it]
 61%|██████    | 23093/37963 [52:22:34<33:11:52,  8.04s/it]
 61%|██████    | 23094/37963 [52:22:41<32:38:50,  7.90s/it]
 61%|██████    | 23095/37963 [52:22:49<32:08:44,  7.78s/it]
 61%|██████    | 23096/37963 [52:22:56<32:09:45,  7.79s/it]
 61%|██████    | 23097/37963 [52:23:04<32:03:06,  7.76s/it]
 61%|██████    | 23098/37963 [52:23:12<31:55:44,  7.73s/it]
 61%|██████    | 23099/37963 [52:23:20<32:01:56,  7.76s/it]
 61%|██████    | 23100/37963 [52:23:27<31:43:11,  7.68s/it]
                                                           
{'loss': '0.1486', 'grad_norm': '1.702', 'learning_rate': '7.019e-06', 'epoch': '0.6085'}
+
 61%|██████    | 23100/37963 [52:23:27<31:43:11,  7.68s/it]
 61%|██████    | 23101/37963 [52:23:38<34:58:55,  8.47s/it]
 61%|██████    | 23102/37963 [52:23:45<34:00:36,  8.24s/it]
 61%|██████    | 23103/37963 [52:23:53<33:49:28,  8.19s/it]
 61%|██████    | 23104/37963 [52:24:04<36:42:34,  8.89s/it]
 61%|██████    | 23105/37963 [52:24:11<34:57:51,  8.47s/it]
 61%|██████    | 23106/37963 [52:24:19<34:05:25,  8.26s/it]
 61%|██████    | 23107/37963 [52:24:27<33:19:55,  8.08s/it]
 61%|██████    | 23108/37963 [52:24:35<33:13:46,  8.05s/it]
 61%|██████    | 23109/37963 [52:24:42<32:43:21,  7.93s/it]
 61%|██████    | 23110/37963 [52:24:50<32:29:45,  7.88s/it]
                                                           
{'loss': '0.1443', 'grad_norm': '1.498', 'learning_rate': '7.011e-06', 'epoch': '0.6088'}
+
 61%|██████    | 23110/37963 [52:24:50<32:29:45,  7.88s/it]
 61%|██████    | 23111/37963 [52:24:58<32:22:39,  7.85s/it]
 61%|██████    | 23112/37963 [52:25:05<32:01:29,  7.76s/it]
 61%|██████    | 23113/37963 [52:25:13<32:11:11,  7.80s/it]
 61%|██████    | 23114/37963 [52:25:21<32:08:59,  7.79s/it]
 61%|██████    | 23115/37963 [52:25:31<35:11:06,  8.53s/it]
 61%|██████    | 23116/37963 [52:25:39<33:55:09,  8.22s/it]
 61%|██████    | 23117/37963 [52:25:46<33:08:17,  8.04s/it]
 61%|██████    | 23118/37963 [52:25:54<32:46:53,  7.95s/it]
 61%|██████    | 23119/37963 [52:26:02<32:29:07,  7.88s/it]
 61%|██████    | 23120/37963 [52:26:10<32:07:32,  7.79s/it]
                                                           
{'loss': '0.1344', 'grad_norm': '1.283', 'learning_rate': '7.003e-06', 'epoch': '0.609'}
+
 61%|██████    | 23120/37963 [52:26:10<32:07:32,  7.79s/it]
 61%|██████    | 23121/37963 [52:26:17<32:06:14,  7.79s/it]
 61%|██████    | 23122/37963 [52:26:25<32:13:39,  7.82s/it]
 61%|██████    | 23123/37963 [52:26:33<32:02:12,  7.77s/it]
 61%|██████    | 23124/37963 [52:26:41<32:06:43,  7.79s/it]
 61%|██████    | 23125/37963 [52:26:49<32:09:14,  7.80s/it]
 61%|██████    | 23126/37963 [52:26:59<35:23:42,  8.59s/it]
 61%|██████    | 23127/37963 [52:27:07<34:36:50,  8.40s/it]
 61%|██████    | 23128/37963 [52:27:17<37:10:22,  9.02s/it]
 61%|██████    | 23129/37963 [52:27:28<39:07:46,  9.50s/it]
 61%|██████    | 23130/37963 [52:27:36<37:16:01,  9.04s/it]
                                                           
{'loss': '0.1406', 'grad_norm': '2.666', 'learning_rate': '6.995e-06', 'epoch': '0.6093'}
+
 61%|██████    | 23130/37963 [52:27:36<37:16:01,  9.04s/it]
 61%|██████    | 23131/37963 [52:27:44<35:49:51,  8.70s/it]
 61%|██████    | 23132/37963 [52:27:52<34:36:29,  8.40s/it]
 61%|██████    | 23133/37963 [52:27:59<33:59:43,  8.25s/it]
 61%|██████    | 23134/37963 [52:28:08<33:44:10,  8.19s/it]
 61%|██████    | 23135/37963 [52:28:18<36:31:13,  8.87s/it]
 61%|██████    | 23136/37963 [52:28:26<35:06:02,  8.52s/it]
 61%|██████    | 23137/37963 [52:28:33<33:55:11,  8.24s/it]
 61%|██████    | 23138/37963 [52:28:44<37:34:04,  9.12s/it]
 61%|██████    | 23139/37963 [52:28:52<35:42:11,  8.67s/it]
 61%|██████    | 23140/37963 [52:29:00<34:45:21,  8.44s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '2.261', 'learning_rate': '6.987e-06', 'epoch': '0.6095'}
+
 61%|██████    | 23140/37963 [52:29:00<34:45:21,  8.44s/it]
 61%|██████    | 23141/37963 [52:29:07<33:33:12,  8.15s/it]
 61%|██████    | 23142/37963 [52:29:15<32:59:07,  8.01s/it]
 61%|██████    | 23143/37963 [52:29:23<32:41:10,  7.94s/it]
 61%|██████    | 23144/37963 [52:29:34<35:58:38,  8.74s/it]
 61%|██████    | 23145/37963 [52:29:41<34:36:40,  8.41s/it]
 61%|██████    | 23146/37963 [52:29:49<33:53:45,  8.24s/it]
 61%|██████    | 23147/37963 [52:29:57<33:15:07,  8.08s/it]
 61%|██████    | 23148/37963 [52:30:05<33:00:09,  8.02s/it]
 61%|██████    | 23149/37963 [52:30:12<32:38:30,  7.93s/it]
 61%|██████    | 23150/37963 [52:30:20<32:13:04,  7.83s/it]
                                                           
{'loss': '0.1636', 'grad_norm': '2.042', 'learning_rate': '6.978e-06', 'epoch': '0.6098'}
+
 61%|██████    | 23150/37963 [52:30:20<32:13:04,  7.83s/it]
 61%|██████    | 23151/37963 [52:30:28<32:10:01,  7.82s/it]
 61%|██████    | 23152/37963 [52:30:36<32:33:24,  7.91s/it]
 61%|██████    | 23153/37963 [52:30:46<35:29:55,  8.63s/it]
 61%|██████    | 23154/37963 [52:30:54<34:41:07,  8.43s/it]
 61%|██████    | 23155/37963 [52:31:02<33:28:46,  8.14s/it]
 61%|██████    | 23156/37963 [52:31:09<33:11:00,  8.07s/it]
 61%|██████    | 23157/37963 [52:31:17<32:50:28,  7.99s/it]
 61%|██████    | 23158/37963 [52:31:25<32:16:13,  7.85s/it]
 61%|██████    | 23159/37963 [52:31:32<32:05:14,  7.80s/it]
 61%|██████    | 23160/37963 [52:31:40<31:38:31,  7.70s/it]
                                                           
{'loss': '0.15', 'grad_norm': '2.63', 'learning_rate': '6.97e-06', 'epoch': '0.6101'}
+
 61%|██████    | 23160/37963 [52:31:40<31:38:31,  7.70s/it]
 61%|██████    | 23161/37963 [52:31:48<31:47:29,  7.73s/it]
 61%|██████    | 23162/37963 [52:31:56<32:15:13,  7.84s/it]
 61%|██████    | 23163/37963 [52:32:03<32:00:55,  7.79s/it]
 61%|██████    | 23164/37963 [52:32:11<31:50:20,  7.75s/it]
 61%|██████    | 23165/37963 [52:32:19<31:55:28,  7.77s/it]
 61%|██████    | 23166/37963 [52:32:27<31:44:40,  7.72s/it]
 61%|██████    | 23167/37963 [52:32:34<31:51:38,  7.75s/it]
 61%|██████    | 23168/37963 [52:32:42<31:41:20,  7.71s/it]
 61%|██████    | 23169/37963 [52:32:52<34:58:09,  8.51s/it]
 61%|██████    | 23170/37963 [52:33:00<33:58:02,  8.27s/it]
                                                           
{'loss': '0.1418', 'grad_norm': '2.023', 'learning_rate': '6.962e-06', 'epoch': '0.6103'}
+
 61%|██████    | 23170/37963 [52:33:00<33:58:02,  8.27s/it]
 61%|██████    | 23171/37963 [52:33:08<33:19:28,  8.11s/it]
 61%|██████    | 23172/37963 [52:33:15<32:34:12,  7.93s/it]
 61%|██████    | 23173/37963 [52:33:23<32:30:15,  7.91s/it]
 61%|██████    | 23174/37963 [52:33:34<35:28:36,  8.64s/it]
 61%|██████    | 23175/37963 [52:33:41<34:28:14,  8.39s/it]
 61%|██████    | 23176/37963 [52:33:49<33:24:39,  8.13s/it]
 61%|██████    | 23177/37963 [52:33:59<36:24:49,  8.87s/it]
 61%|██████    | 23178/37963 [52:34:07<34:51:42,  8.49s/it]
 61%|██████    | 23179/37963 [52:34:18<37:29:05,  9.13s/it]
 61%|██████    | 23180/37963 [52:34:26<35:52:44,  8.74s/it]
                                                           
{'loss': '0.1387', 'grad_norm': '1.842', 'learning_rate': '6.954e-06', 'epoch': '0.6106'}
+
 61%|██████    | 23180/37963 [52:34:26<35:52:44,  8.74s/it]
 61%|██████    | 23181/37963 [52:34:33<34:34:59,  8.42s/it]
 61%|██████    | 23182/37963 [52:34:43<36:52:56,  8.98s/it]
 61%|██████    | 23183/37963 [52:34:51<35:17:12,  8.59s/it]
 61%|██████    | 23184/37963 [52:34:59<34:06:26,  8.31s/it]
 61%|██████    | 23185/37963 [52:35:07<33:28:46,  8.16s/it]
 61%|██████    | 23186/37963 [52:35:17<36:25:15,  8.87s/it]
 61%|██████    | 23187/37963 [52:35:25<35:10:21,  8.57s/it]
 61%|██████    | 23188/37963 [52:35:33<34:14:08,  8.34s/it]
 61%|██████    | 23189/37963 [52:35:41<33:31:56,  8.17s/it]
 61%|██████    | 23190/37963 [52:35:48<32:48:35,  8.00s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '2.175', 'learning_rate': '6.946e-06', 'epoch': '0.6109'}
+
 61%|██████    | 23190/37963 [52:35:48<32:48:35,  8.00s/it]
 61%|██████    | 23191/37963 [52:35:56<32:42:54,  7.97s/it]
 61%|██████    | 23192/37963 [52:36:04<32:20:01,  7.88s/it]
 61%|██████    | 23193/37963 [52:36:11<31:59:19,  7.80s/it]
 61%|██████    | 23194/37963 [52:36:19<32:14:51,  7.86s/it]
 61%|██████    | 23195/37963 [52:36:27<31:58:09,  7.79s/it]
 61%|██████    | 23196/37963 [52:36:35<32:08:58,  7.84s/it]
 61%|██████    | 23197/37963 [52:36:43<31:50:26,  7.76s/it]
 61%|██████    | 23198/37963 [52:36:53<34:38:43,  8.45s/it]
 61%|██████    | 23199/37963 [52:37:00<33:51:06,  8.25s/it]
 61%|���█████    | 23200/37963 [52:37:08<33:14:06,  8.10s/it]
                                                           
{'loss': '0.152', 'grad_norm': '1.37', 'learning_rate': '6.938e-06', 'epoch': '0.6111'}
+
 61%|██████    | 23200/37963 [52:37:08<33:14:06,  8.10s/it]
 61%|██████    | 23201/37963 [52:37:16<32:32:08,  7.93s/it]
 61%|██████    | 23202/37963 [52:37:24<32:31:18,  7.93s/it]
 61%|██████    | 23203/37963 [52:37:31<32:18:27,  7.88s/it]
 61%|██████    | 23204/37963 [52:37:39<32:24:02,  7.90s/it]
 61%|██████    | 23205/37963 [52:37:47<32:31:35,  7.93s/it]
 61%|██████    | 23206/37963 [52:37:55<32:17:51,  7.88s/it]
 61%|██████    | 23207/37963 [52:38:05<35:22:09,  8.63s/it]
 61%|██████    | 23208/37963 [52:38:13<33:38:19,  8.21s/it]
 61%|██████    | 23209/37963 [52:38:20<33:00:11,  8.05s/it]
 61%|██████    | 23210/37963 [52:38:28<32:28:55,  7.93s/it]
                                                           
{'loss': '0.1411', 'grad_norm': '2.601', 'learning_rate': '6.93e-06', 'epoch': '0.6114'}
+
 61%|██████    | 23210/37963 [52:38:28<32:28:55,  7.93s/it]
 61%|██████    | 23211/37963 [52:38:36<32:14:46,  7.87s/it]
 61%|██████    | 23212/37963 [52:38:44<32:08:25,  7.84s/it]
 61%|██████    | 23213/37963 [52:38:52<32:34:24,  7.95s/it]
 61%|██████    | 23214/37963 [52:38:59<32:03:12,  7.82s/it]
 61%|██████    | 23215/37963 [52:39:07<32:07:30,  7.84s/it]
 61%|██████    | 23216/37963 [52:39:15<31:33:01,  7.70s/it]
 61%|██████    | 23217/37963 [52:39:22<31:40:18,  7.73s/it]
 61%|██████    | 23218/37963 [52:39:30<31:39:28,  7.73s/it]
 61%|██████    | 23219/37963 [52:39:38<31:52:55,  7.78s/it]
 61%|██████    | 23220/37963 [52:39:46<31:48:11,  7.77s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '2.808', 'learning_rate': '6.922e-06', 'epoch': '0.6117'}
+
 61%|██████    | 23220/37963 [52:39:46<31:48:11,  7.77s/it]
 61%|██████    | 23221/37963 [52:39:54<32:05:08,  7.84s/it]
 61%|██████    | 23222/37963 [52:40:02<32:29:54,  7.94s/it]
 61%|██████    | 23223/37963 [52:40:12<35:18:06,  8.62s/it]
 61%|██████    | 23224/37963 [52:40:20<34:11:16,  8.35s/it]
 61%|██████    | 23225/37963 [52:40:30<36:52:19,  9.01s/it]
 61%|██████    | 23226/37963 [52:40:38<35:16:27,  8.62s/it]
 61%|██████    | 23227/37963 [52:40:45<33:50:13,  8.27s/it]
 61%|██████    | 23228/37963 [52:40:56<36:16:07,  8.86s/it]
 61%|██████    | 23229/37963 [52:41:04<35:03:21,  8.57s/it]
 61%|██████    | 23230/37963 [52:41:14<37:31:07,  9.17s/it]
                                                           
{'loss': '0.1504', 'grad_norm': '2.584', 'learning_rate': '6.913e-06', 'epoch': '0.6119'}
+
 61%|██████    | 23230/37963 [52:41:14<37:31:07,  9.17s/it]
 61%|██████    | 23231/37963 [52:41:22<35:57:25,  8.79s/it]
 61%|██████    | 23232/37963 [52:41:30<34:40:28,  8.47s/it]
 61%|██████    | 23233/37963 [52:41:40<37:18:33,  9.12s/it]
 61%|██████    | 23234/37963 [52:41:48<35:42:15,  8.73s/it]
 61%|██████    | 23235/37963 [52:41:56<33:57:04,  8.30s/it]
 61%|██████    | 23236/37963 [52:42:06<36:42:54,  8.97s/it]
 61%|██████    | 23237/37963 [52:42:14<35:08:47,  8.59s/it]
 61%|██████    | 23238/37963 [52:42:21<33:50:06,  8.27s/it]
 61%|██████    | 23239/37963 [52:42:29<33:08:45,  8.10s/it]
 61%|██████    | 23240/37963 [52:42:37<32:52:04,  8.04s/it]
                                                           
{'loss': '0.1495', 'grad_norm': '2.229', 'learning_rate': '6.905e-06', 'epoch': '0.6122'}
+
 61%|██████    | 23240/37963 [52:42:37<32:52:04,  8.04s/it]
 61%|██████    | 23241/37963 [52:42:45<32:24:56,  7.93s/it]
 61%|██████    | 23242/37963 [52:42:55<35:38:22,  8.72s/it]
 61%|██████    | 23243/37963 [52:43:03<34:17:19,  8.39s/it]
 61%|██████    | 23244/37963 [52:43:11<33:38:30,  8.23s/it]
 61%|██████    | 23245/37963 [52:43:19<33:18:28,  8.15s/it]
 61%|██████    | 23246/37963 [52:43:26<32:42:16,  8.00s/it]
 61%|██████    | 23247/37963 [52:43:34<32:22:26,  7.92s/it]
 61%|██████    | 23248/37963 [52:43:42<32:07:48,  7.86s/it]
 61%|██████    | 23249/37963 [52:43:49<31:59:27,  7.83s/it]
 61%|██████    | 23250/37963 [52:43:57<31:46:34,  7.78s/it]
                                                           
{'loss': '0.1415', 'grad_norm': '3.275', 'learning_rate': '6.897e-06', 'epoch': '0.6124'}
+
 61%|██████    | 23250/37963 [52:43:57<31:46:34,  7.78s/it]
 61%|██████    | 23251/37963 [52:44:08<35:13:50,  8.62s/it]
 61%|██████    | 23252/37963 [52:44:15<34:04:18,  8.34s/it]
 61%|██████▏   | 23253/37963 [52:44:23<33:01:57,  8.08s/it]
 61%|██████▏   | 23254/37963 [52:44:31<32:36:25,  7.98s/it]
 61%|██████▏   | 23255/37963 [52:44:38<32:09:30,  7.87s/it]
 61%|██████▏   | 23256/37963 [52:44:46<31:55:07,  7.81s/it]
 61%|██████▏   | 23257/37963 [52:44:54<31:48:07,  7.79s/it]
 61%|██████▏   | 23258/37963 [52:45:01<31:18:28,  7.66s/it]
 61%|██████▏   | 23259/37963 [52:45:09<31:24:32,  7.69s/it]
 61%|██████▏   | 23260/37963 [52:45:16<31:28:36,  7.71s/it]
                                                           
{'loss': '0.1443', 'grad_norm': '1.392', 'learning_rate': '6.889e-06', 'epoch': '0.6127'}
+
 61%|██████▏   | 23260/37963 [52:45:16<31:28:36,  7.71s/it]
 61%|██████▏   | 23261/37963 [52:45:24<31:31:00,  7.72s/it]
 61%|██████▏   | 23262/37963 [52:45:32<31:35:18,  7.74s/it]
 61%|██████▏   | 23263/37963 [52:45:40<31:36:03,  7.74s/it]
 61%|██████▏   | 23264/37963 [52:45:48<31:46:49,  7.78s/it]
 61%|██████▏   | 23265/37963 [52:45:55<31:35:49,  7.74s/it]
 61%|██████▏   | 23266/37963 [52:46:03<31:14:04,  7.65s/it]
 61%|██████▏   | 23267/37963 [52:46:10<31:06:33,  7.62s/it]
 61%|██████▏   | 23268/37963 [52:46:18<31:21:50,  7.68s/it]
 61%|██████▏   | 23269/37963 [52:46:26<31:34:24,  7.74s/it]
 61%|██████▏   | 23270/37963 [52:46:34<31:37:17,  7.75s/it]
                                                           
{'loss': '0.1473', 'grad_norm': '0.9943', 'learning_rate': '6.881e-06', 'epoch': '0.613'}
+
 61%|██████▏   | 23270/37963 [52:46:34<31:37:17,  7.75s/it]
 61%|██████▏   | 23271/37963 [52:46:42<31:38:42,  7.75s/it]
 61%|██████▏   | 23272/37963 [52:46:52<34:36:25,  8.48s/it]
 61%|██████▏   | 23273/37963 [52:46:59<33:44:28,  8.27s/it]
 61%|██████▏   | 23274/37963 [52:47:10<36:14:55,  8.88s/it]
 61%|██████▏   | 23275/37963 [52:47:18<34:52:23,  8.55s/it]
 61%|██████▏   | 23276/37963 [52:47:25<34:02:17,  8.34s/it]
 61%|██████▏   | 23277/37963 [52:47:38<39:42:54,  9.74s/it]
 61%|██████▏   | 23278/37963 [52:47:46<37:20:46,  9.16s/it]
 61%|██████▏   | 23279/37963 [52:47:57<38:57:53,  9.55s/it]
 61%|██████▏   | 23280/37963 [52:48:04<36:32:06,  8.96s/it]
                                                           
{'loss': '0.1408', 'grad_norm': '1.94', 'learning_rate': '6.873e-06', 'epoch': '0.6132'}
+
 61%|██████▏   | 23280/37963 [52:48:04<36:32:06,  8.96s/it]
 61%|██████▏   | 23281/37963 [52:48:12<35:06:33,  8.61s/it]
 61%|██████▏   | 23282/37963 [52:48:20<34:12:27,  8.39s/it]
 61%|██████▏   | 23283/37963 [52:48:28<33:19:30,  8.17s/it]
 61%|██████▏   | 23284/37963 [52:48:38<36:02:59,  8.84s/it]
 61%|██████▏   | 23285/37963 [52:48:46<34:58:39,  8.58s/it]
 61%|██████▏   | 23286/37963 [52:48:54<33:58:16,  8.33s/it]
 61%|██████▏   | 23287/37963 [52:49:01<33:06:07,  8.12s/it]
 61%|██████▏   | 23288/37963 [52:49:12<35:40:42,  8.75s/it]
 61%|██████▏   | 23289/37963 [52:49:19<34:18:19,  8.42s/it]
 61%|██████▏   | 23290/37963 [52:49:27<33:06:13,  8.12s/it]
                                                           
{'loss': '0.1407', 'grad_norm': '2.28', 'learning_rate': '6.865e-06', 'epoch': '0.6135'}
+
 61%|██████▏   | 23290/37963 [52:49:27<33:06:13,  8.12s/it]
 61%|██████▏   | 23291/37963 [52:49:34<32:31:26,  7.98s/it]
 61%|██████▏   | 23292/37963 [52:49:42<32:18:31,  7.93s/it]
 61%|██████▏   | 23293/37963 [52:49:50<32:14:45,  7.91s/it]
 61%|██████▏   | 23294/37963 [52:49:58<31:58:30,  7.85s/it]
 61%|██████▏   | 23295/37963 [52:50:05<31:40:58,  7.78s/it]
 61%|██████▏   | 23296/37963 [52:50:13<31:27:51,  7.72s/it]
 61%|██████▏   | 23297/37963 [52:50:21<31:36:44,  7.76s/it]
 61%|██████▏   | 23298/37963 [52:50:28<31:37:37,  7.76s/it]
 61%|██████▏   | 23299/37963 [52:50:37<31:56:08,  7.84s/it]
 61%|██████▏   | 23300/37963 [52:50:44<31:46:55,  7.80s/it]
                                                           
{'loss': '0.1469', 'grad_norm': '1.798', 'learning_rate': '6.857e-06', 'epoch': '0.6138'}
+
 61%|██████▏   | 23300/37963 [52:50:44<31:46:55,  7.80s/it]
 61%|██████▏   | 23301/37963 [52:50:55<35:14:02,  8.65s/it]
 61%|██████▏   | 23302/37963 [52:51:03<34:05:00,  8.37s/it]
 61%|██████▏   | 23303/37963 [52:51:10<33:17:37,  8.18s/it]
 61%|██████▏   | 23304/37963 [52:51:18<32:50:56,  8.07s/it]
 61%|██████▏   | 23305/37963 [52:51:26<32:08:10,  7.89s/it]
 61%|██████▏   | 23306/37963 [52:51:33<31:37:50,  7.77s/it]
 61%|██████▏   | 23307/37963 [52:51:41<31:33:07,  7.75s/it]
 61%|██████▏   | 23308/37963 [52:51:49<31:43:48,  7.79s/it]
 61%|██████▏   | 23309/37963 [52:51:56<31:24:50,  7.72s/it]
 61%|██████▏   | 23310/37963 [52:52:04<31:29:18,  7.74s/it]
                                                           
{'loss': '0.1388', 'grad_norm': '1.703', 'learning_rate': '6.849e-06', 'epoch': '0.614'}
+
 61%|██████▏   | 23310/37963 [52:52:04<31:29:18,  7.74s/it]
 61%|██████▏   | 23311/37963 [52:52:12<31:26:36,  7.73s/it]
 61%|██████▏   | 23312/37963 [52:52:20<31:45:59,  7.81s/it]
 61%|██████▏   | 23313/37963 [52:52:28<32:22:36,  7.96s/it]
 61%|██████▏   | 23314/37963 [52:52:36<32:14:26,  7.92s/it]
 61%|██████▏   | 23315/37963 [52:52:44<32:02:19,  7.87s/it]
 61%|██████▏   | 23316/37963 [52:52:51<31:47:43,  7.81s/it]
 61%|██████▏   | 23317/37963 [52:53:02<35:15:39,  8.67s/it]
 61%|██████▏   | 23318/37963 [52:53:10<34:07:41,  8.39s/it]
 61%|██████▏   | 23319/37963 [52:53:17<33:20:37,  8.20s/it]
 61%|██████▏   | 23320/37963 [52:53:28<35:52:18,  8.82s/it]
                                                           
{'loss': '0.1373', 'grad_norm': '1.131', 'learning_rate': '6.84e-06', 'epoch': '0.6143'}
+
 61%|██████▏   | 23320/37963 [52:53:28<35:52:18,  8.82s/it]
 61%|██████▏   | 23321/37963 [52:53:36<34:42:30,  8.53s/it]
 61%|██████▏   | 23322/37963 [52:53:43<33:54:19,  8.34s/it]
 61%|██████▏   | 23323/37963 [52:53:51<33:23:51,  8.21s/it]
 61%|██████▏   | 23324/37963 [52:53:59<32:50:56,  8.08s/it]
 61%|██████▏   | 23325/37963 [52:54:10<35:50:05,  8.81s/it]
 61%|██████▏   | 23326/37963 [52:54:17<34:34:21,  8.50s/it]
 61%|██████▏   | 23327/37963 [52:54:25<33:33:42,  8.26s/it]
 61%|██████▏   | 23328/37963 [52:54:33<32:50:15,  8.08s/it]
 61%|██████▏   | 23329/37963 [52:54:40<32:23:09,  7.97s/it]
 61%|██████▏   | 23330/37963 [52:54:48<32:07:08,  7.90s/it]
                                                           
{'loss': '0.155', 'grad_norm': '1.814', 'learning_rate': '6.832e-06', 'epoch': '0.6145'}
+
 61%|██████▏   | 23330/37963 [52:54:48<32:07:08,  7.90s/it]
 61%|██████▏   | 23331/37963 [52:54:59<35:07:44,  8.64s/it]
 61%|██████▏   | 23332/37963 [52:55:06<34:11:26,  8.41s/it]
 61%|██████▏   | 23333/37963 [52:55:17<36:47:25,  9.05s/it]
 61%|██████▏   | 23334/37963 [52:55:25<35:22:59,  8.71s/it]
 61%|██████▏   | 23335/37963 [52:55:33<34:21:10,  8.45s/it]
 61%|██████▏   | 23336/37963 [52:55:40<32:55:35,  8.10s/it]
 61%|██████▏   | 23337/37963 [52:55:48<32:36:04,  8.02s/it]
 61%|██████▏   | 23338/37963 [52:55:58<35:40:45,  8.78s/it]
 61%|██████▏   | 23339/37963 [52:56:06<34:30:55,  8.50s/it]
 61%|██████▏   | 23340/37963 [52:56:14<33:28:43,  8.24s/it]
                                                           
{'loss': '0.1536', 'grad_norm': '1.967', 'learning_rate': '6.824e-06', 'epoch': '0.6148'}
+
 61%|██████▏   | 23340/37963 [52:56:14<33:28:43,  8.24s/it]
 61%|██████▏   | 23341/37963 [52:56:22<32:52:18,  8.09s/it]
 61%|██████▏   | 23342/37963 [52:56:32<35:21:14,  8.70s/it]
 61%|██████▏   | 23343/37963 [52:56:40<34:30:08,  8.50s/it]
 61%|██████▏   | 23344/37963 [52:56:48<33:36:24,  8.28s/it]
 61%|██████▏   | 23345/37963 [52:56:55<33:02:03,  8.14s/it]
 61%|██████▏   | 23346/37963 [52:57:03<32:28:47,  8.00s/it]
 61%|██████▏   | 23347/37963 [52:57:13<35:24:06,  8.72s/it]
 62%|██████▏   | 23348/37963 [52:57:21<34:19:47,  8.46s/it]
 62%|██████▏   | 23349/37963 [52:57:29<33:11:10,  8.18s/it]
 62%|██████▏   | 23350/37963 [52:57:37<33:05:42,  8.15s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '2.641', 'learning_rate': '6.816e-06', 'epoch': '0.6151'}
+
 62%|██████▏   | 23350/37963 [52:57:37<33:05:42,  8.15s/it]
 62%|██████▏   | 23351/37963 [52:57:45<32:24:49,  7.99s/it]
 62%|██████▏   | 23352/37963 [52:57:52<32:03:51,  7.90s/it]
 62%|██████▏   | 23353/37963 [52:58:00<31:57:19,  7.87s/it]
 62%|██████▏   | 23354/37963 [52:58:08<31:54:42,  7.86s/it]
 62%|██████▏   | 23355/37963 [52:58:16<31:40:49,  7.81s/it]
 62%|██████▏   | 23356/37963 [52:58:23<31:27:07,  7.75s/it]
 62%|██████▏   | 23357/37963 [52:58:31<31:22:47,  7.73s/it]
 62%|██████▏   | 23358/37963 [52:58:39<31:22:16,  7.73s/it]
 62%|██████▏   | 23359/37963 [52:58:47<31:38:52,  7.80s/it]
 62%|██████▏   | 23360/37963 [52:58:54<31:45:47,  7.83s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '4.644', 'learning_rate': '6.808e-06', 'epoch': '0.6153'}
+
 62%|██████▏   | 23360/37963 [52:58:54<31:45:47,  7.83s/it]
 62%|██████▏   | 23361/37963 [52:59:02<31:43:07,  7.82s/it]
 62%|██████▏   | 23362/37963 [52:59:10<31:30:21,  7.77s/it]
 62%|██████▏   | 23363/37963 [52:59:18<31:48:51,  7.84s/it]
 62%|██████▏   | 23364/37963 [52:59:26<31:29:41,  7.77s/it]
 62%|██████▏   | 23365/37963 [52:59:36<34:47:08,  8.58s/it]
 62%|██████▏   | 23366/37963 [52:59:44<33:46:03,  8.33s/it]
 62%|██████▏   | 23367/37963 [52:59:51<32:50:25,  8.10s/it]
 62%|██████▏   | 23368/37963 [53:00:02<35:25:11,  8.74s/it]
 62%|██████▏   | 23369/37963 [53:00:09<34:13:47,  8.44s/it]
 62%|██████▏   | 23370/37963 [53:00:17<33:13:57,  8.20s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '1.719', 'learning_rate': '6.8e-06', 'epoch': '0.6156'}
+
 62%|██████▏   | 23370/37963 [53:00:17<33:13:57,  8.20s/it]
 62%|██████▏   | 23371/37963 [53:00:25<32:29:36,  8.02s/it]
 62%|██████▏   | 23372/37963 [53:00:32<32:04:12,  7.91s/it]
 62%|██████▏   | 23373/37963 [53:00:43<35:13:54,  8.69s/it]
 62%|██████▏   | 23374/37963 [53:00:50<34:09:15,  8.43s/it]
 62%|██████▏   | 23375/37963 [53:00:58<33:02:15,  8.15s/it]
 62%|██████▏   | 23376/37963 [53:01:06<32:48:06,  8.10s/it]
 62%|██████▏   | 23377/37963 [53:01:16<35:26:14,  8.75s/it]
 62%|██████▏   | 23378/37963 [53:01:24<34:08:01,  8.43s/it]
 62%|██████▏   | 23379/37963 [53:01:32<33:09:16,  8.18s/it]
 62%|██████▏   | 23380/37963 [53:01:39<32:26:43,  8.01s/it]
                                                           
{'loss': '0.1403', 'grad_norm': '1.231', 'learning_rate': '6.792e-06', 'epoch': '0.6159'}
+
 62%|██████▏   | 23380/37963 [53:01:39<32:26:43,  8.01s/it]
 62%|██████▏   | 23381/37963 [53:01:47<32:06:10,  7.93s/it]
 62%|██████▏   | 23382/37963 [53:01:55<31:55:55,  7.88s/it]
 62%|██████▏   | 23383/37963 [53:02:02<31:14:43,  7.71s/it]
 62%|██████▏   | 23384/37963 [53:02:10<31:08:33,  7.69s/it]
 62%|██████▏   | 23385/37963 [53:02:20<34:17:01,  8.47s/it]
 62%|██████▏   | 23386/37963 [53:02:28<33:49:46,  8.35s/it]
 62%|██████▏   | 23387/37963 [53:02:39<36:32:18,  9.02s/it]
 62%|██████▏   | 23388/37963 [53:02:46<34:58:06,  8.64s/it]
 62%|██████▏   | 23389/37963 [53:02:54<33:46:23,  8.34s/it]
 62%|██████▏   | 23390/37963 [53:03:02<33:16:26,  8.22s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '2.647', 'learning_rate': '6.784e-06', 'epoch': '0.6161'}
+
 62%|██████▏   | 23390/37963 [53:03:02<33:16:26,  8.22s/it]
 62%|██████▏   | 23391/37963 [53:03:12<36:04:13,  8.91s/it]
 62%|██████▏   | 23392/37963 [53:03:23<38:11:53,  9.44s/it]
 62%|██████▏   | 23393/37963 [53:03:30<35:42:17,  8.82s/it]
 62%|██████▏   | 23394/37963 [53:03:38<34:36:57,  8.55s/it]
 62%|██████▏   | 23395/37963 [53:03:46<33:43:17,  8.33s/it]
 62%|██████▏   | 23396/37963 [53:03:54<32:47:08,  8.10s/it]
 62%|██████▏   | 23397/37963 [53:04:01<32:11:41,  7.96s/it]
 62%|██████▏   | 23398/37963 [53:04:09<31:40:16,  7.83s/it]
 62%|██████▏   | 23399/37963 [53:04:17<31:33:16,  7.80s/it]
 62%|██████▏   | 23400/37963 [53:04:25<32:01:38,  7.92s/it]
                                                           
{'loss': '0.1483', 'grad_norm': '2.041', 'learning_rate': '6.776e-06', 'epoch': '0.6164'}
+
 62%|██████▏   | 23400/37963 [53:04:25<32:01:38,  7.92s/it]
 62%|██████▏   | 23401/37963 [53:04:33<31:45:03,  7.85s/it]
 62%|██████▏   | 23402/37963 [53:04:40<31:26:35,  7.77s/it]
 62%|██████▏   | 23403/37963 [53:04:48<31:22:06,  7.76s/it]
 62%|██████▏   | 23404/37963 [53:04:56<31:30:20,  7.79s/it]
 62%|██████▏   | 23405/37963 [53:05:03<31:21:30,  7.75s/it]
 62%|██████▏   | 23406/37963 [53:05:11<31:29:48,  7.79s/it]
 62%|██████▏   | 23407/37963 [53:05:19<31:24:20,  7.77s/it]
 62%|██████▏   | 23408/37963 [53:05:27<31:17:52,  7.74s/it]
 62%|██████▏   | 23409/37963 [53:05:37<34:50:12,  8.62s/it]
 62%|██████▏   | 23410/37963 [53:05:45<33:55:40,  8.39s/it]
                                                           
{'loss': '0.1379', 'grad_norm': '2.385', 'learning_rate': '6.768e-06', 'epoch': '0.6167'}
+
 62%|██████▏   | 23410/37963 [53:05:45<33:55:40,  8.39s/it]
 62%|██████▏   | 23411/37963 [53:05:53<33:08:58,  8.20s/it]
 62%|██████▏   | 23412/37963 [53:06:03<35:37:17,  8.81s/it]
 62%|██████▏   | 23413/37963 [53:06:11<34:14:18,  8.47s/it]
 62%|██████▏   | 23414/37963 [53:06:18<33:14:04,  8.22s/it]
 62%|██████▏   | 23415/37963 [53:06:26<32:52:10,  8.13s/it]
 62%|██████▏   | 23416/37963 [53:06:34<32:22:10,  8.01s/it]
 62%|██████▏   | 23417/37963 [53:06:42<32:11:49,  7.97s/it]
 62%|██████▏   | 23418/37963 [53:06:50<32:01:15,  7.93s/it]
 62%|██████▏   | 23419/37963 [53:06:58<31:44:26,  7.86s/it]
 62%|██████▏   | 23420/37963 [53:07:05<31:36:24,  7.82s/it]
                                                           
{'loss': '0.1452', 'grad_norm': '4.182', 'learning_rate': '6.76e-06', 'epoch': '0.6169'}
+
 62%|██████▏   | 23420/37963 [53:07:05<31:36:24,  7.82s/it]
 62%|██████▏   | 23421/37963 [53:07:16<35:11:22,  8.71s/it]
 62%|██████▏   | 23422/37963 [53:07:24<34:07:46,  8.45s/it]
 62%|██████▏   | 23423/37963 [53:07:32<33:10:19,  8.21s/it]
 62%|██████▏   | 23424/37963 [53:07:39<32:30:44,  8.05s/it]
 62%|██████▏   | 23425/37963 [53:07:47<32:03:03,  7.94s/it]
 62%|██████▏   | 23426/37963 [53:07:54<31:24:06,  7.78s/it]
 62%|██████▏   | 23427/37963 [53:08:02<31:30:19,  7.80s/it]
 62%|██████▏   | 23428/37963 [53:08:10<31:06:41,  7.71s/it]
 62%|██████▏   | 23429/37963 [53:08:20<33:46:58,  8.37s/it]
 62%|██████▏   | 23430/37963 [53:08:27<32:45:30,  8.11s/it]
                                                           
{'loss': '0.1448', 'grad_norm': '2.595', 'learning_rate': '6.752e-06', 'epoch': '0.6172'}
+
 62%|██████▏   | 23430/37963 [53:08:27<32:45:30,  8.11s/it]
 62%|██████▏   | 23431/37963 [53:08:38<35:37:27,  8.83s/it]
 62%|██████▏   | 23432/37963 [53:08:45<34:13:35,  8.48s/it]
 62%|██████▏   | 23433/37963 [53:08:53<33:32:17,  8.31s/it]
 62%|██████▏   | 23434/37963 [53:09:01<32:50:50,  8.14s/it]
 62%|██████▏   | 23435/37963 [53:09:09<32:16:03,  8.00s/it]
 62%|██████▏   | 23436/37963 [53:09:16<32:02:26,  7.94s/it]
 62%|██████▏   | 23437/37963 [53:09:24<31:47:20,  7.88s/it]
 62%|██████▏   | 23438/37963 [53:09:32<31:39:59,  7.85s/it]
 62%|██████▏   | 23439/37963 [53:09:42<34:43:49,  8.61s/it]
 62%|██████▏   | 23440/37963 [53:09:53<37:01:35,  9.18s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '2.44', 'learning_rate': '6.743e-06', 'epoch': '0.6174'}
+
 62%|██████▏   | 23440/37963 [53:09:53<37:01:35,  9.18s/it]
 62%|██████▏   | 23441/37963 [53:10:01<35:25:25,  8.78s/it]
 62%|██████▏   | 23442/37963 [53:10:08<34:16:58,  8.50s/it]
 62%|██████▏   | 23443/37963 [53:10:16<33:28:15,  8.30s/it]
 62%|██████▏   | 23444/37963 [53:10:24<33:12:14,  8.23s/it]
 62%|██████▏   | 23445/37963 [53:10:32<32:30:54,  8.06s/it]
 62%|██████▏   | 23446/37963 [53:10:43<35:47:31,  8.88s/it]
 62%|██████▏   | 23447/37963 [53:10:51<34:29:35,  8.55s/it]
 62%|██████▏   | 23448/37963 [53:10:58<33:31:05,  8.31s/it]
 62%|██████▏   | 23449/37963 [53:11:06<32:43:30,  8.12s/it]
 62%|██████▏   | 23450/37963 [53:11:14<32:13:20,  7.99s/it]
                                                           
{'loss': '0.1354', 'grad_norm': '2.65', 'learning_rate': '6.735e-06', 'epoch': '0.6177'}
+
 62%|██████▏   | 23450/37963 [53:11:14<32:13:20,  7.99s/it]
 62%|██████▏   | 23451/37963 [53:11:22<32:00:33,  7.94s/it]
 62%|██████▏   | 23452/37963 [53:11:29<31:33:10,  7.83s/it]
 62%|██████▏   | 23453/37963 [53:11:37<31:04:33,  7.71s/it]
 62%|██████▏   | 23454/37963 [53:11:44<30:49:55,  7.65s/it]
 62%|██████▏   | 23455/37963 [53:11:52<30:47:42,  7.64s/it]
 62%|██████▏   | 23456/37963 [53:12:02<33:59:28,  8.44s/it]
 62%|██████▏   | 23457/37963 [53:12:13<36:39:08,  9.10s/it]
 62%|██████▏   | 23458/37963 [53:12:20<34:52:30,  8.66s/it]
 62%|██████▏   | 23459/37963 [53:12:28<33:36:41,  8.34s/it]
 62%|██████▏   | 23460/37963 [53:12:35<32:44:47,  8.13s/it]
                                                           
{'loss': '0.1472', 'grad_norm': '2.019', 'learning_rate': '6.727e-06', 'epoch': '0.618'}
+
 62%|██████▏   | 23460/37963 [53:12:35<32:44:47,  8.13s/it]
 62%|██████▏   | 23461/37963 [53:12:43<32:36:27,  8.09s/it]
 62%|██████▏   | 23462/37963 [53:12:51<32:03:23,  7.96s/it]
 62%|██████▏   | 23463/37963 [53:12:59<32:03:28,  7.96s/it]
 62%|██████▏   | 23464/37963 [53:13:07<32:02:33,  7.96s/it]
 62%|██████▏   | 23465/37963 [53:13:15<31:46:30,  7.89s/it]
 62%|██████▏   | 23466/37963 [53:13:23<31:35:22,  7.84s/it]
 62%|██████▏   | 23467/37963 [53:13:30<31:14:06,  7.76s/it]
 62%|██████▏   | 23468/37963 [53:13:38<31:12:53,  7.75s/it]
 62%|██████▏   | 23469/37963 [53:13:48<34:05:32,  8.47s/it]
 62%|██████▏   | 23470/37963 [53:13:56<33:21:47,  8.29s/it]
                                                           
{'loss': '0.1406', 'grad_norm': '1.594', 'learning_rate': '6.719e-06', 'epoch': '0.6182'}
+
 62%|██████▏   | 23470/37963 [53:13:56<33:21:47,  8.29s/it]
 62%|██████▏   | 23471/37963 [53:14:03<32:18:35,  8.03s/it]
 62%|██████▏   | 23472/37963 [53:14:11<31:36:09,  7.85s/it]
 62%|██████▏   | 23473/37963 [53:14:18<31:09:45,  7.74s/it]
 62%|██████▏   | 23474/37963 [53:14:26<31:03:11,  7.72s/it]
 62%|██████▏   | 23475/37963 [53:14:34<31:07:28,  7.73s/it]
 62%|██████▏   | 23476/37963 [53:14:42<31:27:14,  7.82s/it]
 62%|██████▏   | 23477/37963 [53:14:49<31:11:04,  7.75s/it]
 62%|██████▏   | 23478/37963 [53:14:57<31:10:01,  7.75s/it]
 62%|██████▏   | 23479/37963 [53:15:05<31:13:57,  7.76s/it]
 62%|██████▏   | 23480/37963 [53:15:15<34:14:17,  8.51s/it]
                                                           
{'loss': '0.139', 'grad_norm': '1.823', 'learning_rate': '6.711e-06', 'epoch': '0.6185'}
+
 62%|██████▏   | 23480/37963 [53:15:15<34:14:17,  8.51s/it]
 62%|██████▏   | 23481/37963 [53:15:23<33:16:42,  8.27s/it]
 62%|██████▏   | 23482/37963 [53:15:30<32:31:12,  8.08s/it]
 62%|██████▏   | 23483/37963 [53:15:38<32:11:42,  8.00s/it]
 62%|██████▏   | 23484/37963 [53:15:48<34:46:36,  8.65s/it]
 62%|██████▏   | 23485/37963 [53:16:01<40:10:35,  9.99s/it]
 62%|██████▏   | 23486/37963 [53:16:09<37:27:18,  9.31s/it]
 62%|██████▏   | 23487/37963 [53:16:17<35:04:09,  8.72s/it]
 62%|██████▏   | 23488/37963 [53:16:24<34:02:02,  8.46s/it]
 62%|██████▏   | 23489/37963 [53:16:32<32:58:15,  8.20s/it]
 62%|██████▏   | 23490/37963 [53:16:40<32:34:10,  8.10s/it]
                                                           
{'loss': '0.1378', 'grad_norm': '1.985', 'learning_rate': '6.703e-06', 'epoch': '0.6188'}
+
 62%|██████▏   | 23490/37963 [53:16:40<32:34:10,  8.10s/it]
 62%|██████▏   | 23491/37963 [53:16:48<32:19:46,  8.04s/it]
 62%|██████▏   | 23492/37963 [53:16:56<32:05:23,  7.98s/it]
 62%|██████▏   | 23493/37963 [53:17:03<31:35:35,  7.86s/it]
 62%|██████▏   | 23494/37963 [53:17:11<31:18:56,  7.79s/it]
 62%|██████▏   | 23495/37963 [53:17:18<31:08:29,  7.75s/it]
 62%|██████▏   | 23496/37963 [53:17:26<31:13:50,  7.77s/it]
 62%|██████▏   | 23497/37963 [53:17:34<31:01:58,  7.72s/it]
 62%|██████▏   | 23498/37963 [53:17:42<30:56:36,  7.70s/it]
 62%|██████▏   | 23499/37963 [53:17:50<31:20:47,  7.80s/it]
 62%|██████▏   | 23500/37963 [53:18:00<34:53:45,  8.69s/it]
                                                           
{'loss': '0.1317', 'grad_norm': '1.858', 'learning_rate': '6.695e-06', 'epoch': '0.619'}
+
 62%|██████▏   | 23500/37963 [53:18:00<34:53:45,  8.69s/it]
 62%|██████▏   | 23501/37963 [53:18:11<37:31:16,  9.34s/it]
 62%|██████▏   | 23502/37963 [53:18:19<35:46:50,  8.91s/it]
 62%|██████▏   | 23503/37963 [53:18:27<34:35:27,  8.61s/it]
 62%|██████▏   | 23504/37963 [53:18:35<33:24:31,  8.32s/it]
 62%|██████▏   | 23505/37963 [53:18:43<32:55:38,  8.20s/it]
 62%|██████▏   | 23506/37963 [53:18:50<32:30:04,  8.09s/it]
 62%|██████▏   | 23507/37963 [53:18:58<31:58:45,  7.96s/it]
 62%|██████▏   | 23508/37963 [53:19:06<31:46:05,  7.91s/it]
 62%|██████▏   | 23509/37963 [53:19:14<31:37:26,  7.88s/it]
 62%|██████▏   | 23510/37963 [53:19:24<34:35:19,  8.62s/it]
                                                           
{'loss': '0.1412', 'grad_norm': '1.615', 'learning_rate': '6.687e-06', 'epoch': '0.6193'}
+
 62%|██████▏   | 23510/37963 [53:19:24<34:35:19,  8.62s/it]
 62%|██████▏   | 23511/37963 [53:19:32<33:46:24,  8.41s/it]
 62%|██████▏   | 23512/37963 [53:19:40<33:16:02,  8.29s/it]
 62%|██████▏   | 23513/37963 [53:19:48<32:31:02,  8.10s/it]
 62%|██████▏   | 23514/37963 [53:19:55<31:50:11,  7.93s/it]
 62%|██████▏   | 23515/37963 [53:20:03<31:37:44,  7.88s/it]
 62%|██████▏   | 23516/37963 [53:20:11<31:31:00,  7.85s/it]
 62%|██████▏   | 23517/37963 [53:20:19<31:31:23,  7.86s/it]
 62%|██████▏   | 23518/37963 [53:20:26<31:21:01,  7.81s/it]
 62%|█████��▏   | 23519/37963 [53:20:34<31:08:58,  7.76s/it]
 62%|██████▏   | 23520/37963 [53:20:42<31:17:04,  7.80s/it]
                                                           
{'loss': '0.1498', 'grad_norm': '2.318', 'learning_rate': '6.679e-06', 'epoch': '0.6196'}
+
 62%|██████▏   | 23520/37963 [53:20:42<31:17:04,  7.80s/it]
 62%|██████▏   | 23521/37963 [53:20:49<31:00:26,  7.73s/it]
 62%|██████▏   | 23522/37963 [53:20:57<31:02:00,  7.74s/it]
 62%|██████▏   | 23523/37963 [53:21:08<34:26:43,  8.59s/it]
 62%|██████▏   | 23524/37963 [53:21:15<33:07:11,  8.26s/it]
 62%|██████▏   | 23525/37963 [53:21:23<32:09:37,  8.02s/it]
 62%|██████▏   | 23526/37963 [53:21:30<31:44:16,  7.91s/it]
 62%|██████▏   | 23527/37963 [53:21:38<31:12:00,  7.78s/it]
 62%|██████▏   | 23528/37963 [53:21:48<34:33:19,  8.62s/it]
 62%|██████▏   | 23529/37963 [53:21:59<36:45:01,  9.17s/it]
 62%|██████▏   | 23530/37963 [53:22:07<35:07:50,  8.76s/it]
                                                           
{'loss': '0.1377', 'grad_norm': '1.293', 'learning_rate': '6.671e-06', 'epoch': '0.6198'}
+
 62%|██████▏   | 23530/37963 [53:22:07<35:07:50,  8.76s/it]
 62%|██████▏   | 23531/37963 [53:22:15<34:06:07,  8.51s/it]
 62%|██████▏   | 23532/37963 [53:22:22<33:09:58,  8.27s/it]
 62%|██████▏   | 23533/37963 [53:22:30<32:39:21,  8.15s/it]
 62%|██████▏   | 23534/37963 [53:22:40<35:05:37,  8.76s/it]
 62%|██████▏   | 23535/37963 [53:22:48<34:03:32,  8.50s/it]
 62%|██████▏   | 23536/37963 [53:22:56<33:24:27,  8.34s/it]
 62%|██████▏   | 23537/37963 [53:23:04<32:39:58,  8.15s/it]
 62%|██████▏   | 23538/37963 [53:23:12<32:23:31,  8.08s/it]
 62%|██████▏   | 23539/37963 [53:23:20<32:06:19,  8.01s/it]
 62%|██████▏   | 23540/37963 [53:23:27<31:44:17,  7.92s/it]
                                                           
{'loss': '0.1296', 'grad_norm': '2.962', 'learning_rate': '6.663e-06', 'epoch': '0.6201'}
+
 62%|██████▏   | 23540/37963 [53:23:27<31:44:17,  7.92s/it]
 62%|██████▏   | 23541/37963 [53:23:35<31:21:13,  7.83s/it]
 62%|██████▏   | 23542/37963 [53:23:43<31:03:05,  7.75s/it]
 62%|██████▏   | 23543/37963 [53:23:50<31:14:27,  7.80s/it]
 62%|██████▏   | 23544/37963 [53:23:58<31:23:37,  7.84s/it]
 62%|██████▏   | 23545/37963 [53:24:06<31:32:04,  7.87s/it]
 62%|██████▏   | 23546/37963 [53:24:14<31:25:19,  7.85s/it]
 62%|██████▏   | 23547/37963 [53:24:22<31:12:10,  7.79s/it]
 62%|██████▏   | 23548/37963 [53:24:29<31:08:48,  7.78s/it]
 62%|██████▏   | 23549/37963 [53:24:40<34:25:35,  8.60s/it]
 62%|██████▏   | 23550/37963 [53:24:48<33:35:15,  8.39s/it]
                                                           
{'loss': '0.1476', 'grad_norm': '1.547', 'learning_rate': '6.655e-06', 'epoch': '0.6203'}
+
 62%|██████▏   | 23550/37963 [53:24:48<33:35:15,  8.39s/it]
 62%|██████▏   | 23551/37963 [53:24:55<32:19:27,  8.07s/it]
 62%|██████▏   | 23552/37963 [53:25:03<32:01:36,  8.00s/it]
 62%|██████▏   | 23553/37963 [53:25:11<31:39:53,  7.91s/it]
 62%|██████▏   | 23554/37963 [53:25:21<34:48:10,  8.70s/it]
 62%|██████▏   | 23555/37963 [53:25:29<33:10:04,  8.29s/it]
 62%|██████▏   | 23556/37963 [53:25:37<32:40:03,  8.16s/it]
 62%|██████▏   | 23557/37963 [53:25:44<31:48:43,  7.95s/it]
 62%|██████▏   | 23558/37963 [53:25:52<31:26:29,  7.86s/it]
 62%|██████▏   | 23559/37963 [53:25:59<31:14:21,  7.81s/it]
 62%|██████▏   | 23560/37963 [53:26:07<31:13:05,  7.80s/it]
                                                           
{'loss': '0.1345', 'grad_norm': '2.528', 'learning_rate': '6.647e-06', 'epoch': '0.6206'}
+
 62%|██████▏   | 23560/37963 [53:26:07<31:13:05,  7.80s/it]
 62%|██████▏   | 23561/37963 [53:26:15<31:10:18,  7.79s/it]
 62%|██████▏   | 23562/37963 [53:26:23<31:34:13,  7.89s/it]
 62%|██████▏   | 23563/37963 [53:26:31<31:28:33,  7.87s/it]
 62%|██████▏   | 23564/37963 [53:26:41<34:37:23,  8.66s/it]
 62%|██████▏   | 23565/37963 [53:26:49<33:44:52,  8.44s/it]
 62%|██████▏   | 23566/37963 [53:26:57<32:59:02,  8.25s/it]
 62%|██████▏   | 23567/37963 [53:27:05<32:09:27,  8.04s/it]
 62%|██████▏   | 23568/37963 [53:27:12<31:50:15,  7.96s/it]
 62%|██████▏   | 23569/37963 [53:27:20<31:43:29,  7.93s/it]
 62%|██████▏   | 23570/37963 [53:27:31<34:52:58,  8.72s/it]
                                                           
{'loss': '0.1474', 'grad_norm': '1.449', 'learning_rate': '6.639e-06', 'epoch': '0.6209'}
+
 62%|██���███▏   | 23570/37963 [53:27:31<34:52:58,  8.72s/it]
 62%|██████▏   | 23571/37963 [53:27:38<33:25:31,  8.36s/it]
 62%|██████▏   | 23572/37963 [53:27:52<39:20:01,  9.84s/it]
 62%|██████▏   | 23573/37963 [53:27:59<36:53:40,  9.23s/it]
 62%|██████▏   | 23574/37963 [53:28:07<35:04:32,  8.78s/it]
 62%|██████▏   | 23575/37963 [53:28:15<33:40:02,  8.42s/it]
 62%|██████▏   | 23576/37963 [53:28:23<33:04:53,  8.28s/it]
 62%|██████▏   | 23577/37963 [53:28:31<32:35:23,  8.16s/it]
 62%|██████▏   | 23578/37963 [53:28:38<31:37:43,  7.92s/it]
 62%|██████▏   | 23579/37963 [53:28:46<31:25:00,  7.86s/it]
 62%|██████▏   | 23580/37963 [53:28:54<31:30:07,  7.88s/it]
                                                           
{'loss': '0.1367', 'grad_norm': '2.034', 'learning_rate': '6.631e-06', 'epoch': '0.6211'}
+
 62%|██████▏   | 23580/37963 [53:28:54<31:30:07,  7.88s/it]
 62%|██████▏   | 23581/37963 [53:29:04<34:43:43,  8.69s/it]
 62%|██████▏   | 23582/37963 [53:29:12<33:16:39,  8.33s/it]
 62%|██████▏   | 23583/37963 [53:29:19<32:36:25,  8.16s/it]
 62%|██████▏   | 23584/37963 [53:29:27<32:16:34,  8.08s/it]
 62%|██████▏   | 23585/37963 [53:29:35<31:58:06,  8.00s/it]
 62%|██████▏   | 23586/37963 [53:29:43<31:42:11,  7.94s/it]
 62%|██████▏   | 23587/37963 [53:29:51<31:31:04,  7.89s/it]
 62%|██████▏   | 23588/37963 [53:29:58<31:14:17,  7.82s/it]
 62%|██████▏   | 23589/37963 [53:30:06<31:00:49,  7.77s/it]
 62%|██████▏   | 23590/37963 [53:30:14<31:18:44,  7.84s/it]
                                                           
{'loss': '0.1248', 'grad_norm': '1.321', 'learning_rate': '6.623e-06', 'epoch': '0.6214'}
+
 62%|██████▏   | 23590/37963 [53:30:14<31:18:44,  7.84s/it]
 62%|██████▏   | 23591/37963 [53:30:22<31:08:58,  7.80s/it]
 62%|██████▏   | 23592/37963 [53:30:30<31:21:12,  7.85s/it]
 62%|██████▏   | 23593/37963 [53:30:38<31:21:09,  7.85s/it]
 62%|██████▏   | 23594/37963 [53:30:45<31:07:52,  7.80s/it]
 62%|██████▏   | 23595/37963 [53:30:53<31:02:46,  7.78s/it]
 62%|██████▏   | 23596/37963 [53:31:01<31:01:28,  7.77s/it]
 62%|██████▏   | 23597/37963 [53:31:11<34:28:08,  8.64s/it]
 62%|██████▏   | 23598/37963 [53:31:19<33:14:59,  8.33s/it]
 62%|██████▏   | 23599/37963 [53:31:27<32:34:02,  8.16s/it]
 62%|██████▏   | 23600/37963 [53:31:34<31:56:36,  8.01s/it]
                                                           
{'loss': '0.1478', 'grad_norm': '2.931', 'learning_rate': '6.615e-06', 'epoch': '0.6217'}
+
 62%|██████▏   | 23600/37963 [53:31:34<31:56:36,  8.01s/it]
 62%|██████▏   | 23601/37963 [53:31:42<31:45:49,  7.96s/it]
 62%|██████▏   | 23602/37963 [53:31:50<31:31:03,  7.90s/it]
 62%|██████▏   | 23603/37963 [53:31:58<31:06:27,  7.80s/it]
 62%|██████▏   | 23604/37963 [53:32:05<30:41:24,  7.69s/it]
 62%|██████▏   | 23605/37963 [53:32:13<31:00:46,  7.78s/it]
 62%|██████▏   | 23606/37963 [53:32:20<30:33:40,  7.66s/it]
 62%|██████▏   | 23607/37963 [53:32:28<30:46:22,  7.72s/it]
 62%|██████▏   | 23608/37963 [53:32:39<34:09:31,  8.57s/it]
 62%|██████▏   | 23609/37963 [53:32:47<33:12:31,  8.33s/it]
 62%|██████▏   | 23610/37963 [53:32:54<32:20:44,  8.11s/it]
                                                           
{'loss': '0.1401', 'grad_norm': '4.475', 'learning_rate': '6.607e-06', 'epoch': '0.6219'}
+
 62%|██████▏   | 23610/37963 [53:32:54<32:20:44,  8.11s/it]
 62%|██████▏   | 23611/37963 [53:33:02<32:04:14,  8.04s/it]
 62%|██████▏   | 23612/37963 [53:33:12<34:36:25,  8.68s/it]
 62%|██████▏   | 23613/37963 [53:33:20<33:16:49,  8.35s/it]
 62%|██████▏   | 23614/37963 [53:33:27<32:27:40,  8.14s/it]
 62%|██████▏   | 23615/37963 [53:33:38<35:05:42,  8.81s/it]
 62%|██████▏   | 23616/37963 [53:33:46<33:59:01,  8.53s/it]
 62%|██████▏   | 23617/37963 [53:33:54<33:12:51,  8.33s/it]
 62%|██████▏   | 23618/37963 [53:34:04<35:58:29,  9.03s/it]
 62%|██████▏   | 23619/37963 [53:34:12<34:40:00,  8.70s/it]
 62%|██████▏   | 23620/37963 [53:34:20<33:38:41,  8.44s/it]
                                                           
{'loss': '0.1409', 'grad_norm': '2.364', 'learning_rate': '6.599e-06', 'epoch': '0.6222'}
+
 62%|██████▏   | 23620/37963 [53:34:20<33:38:41,  8.44s/it]
 62%|██████▏   | 23621/37963 [53:34:28<32:42:50,  8.21s/it]
 62%|██████▏   | 23622/37963 [53:34:35<31:54:17,  8.01s/it]
 62%|██████▏   | 23623/37963 [53:34:43<31:34:39,  7.93s/it]
 62%|���█████▏   | 23624/37963 [53:34:51<31:27:56,  7.90s/it]
 62%|██████▏   | 23625/37963 [53:35:01<34:12:58,  8.59s/it]
 62%|██████▏   | 23626/37963 [53:35:12<36:32:28,  9.18s/it]
 62%|██████▏   | 23627/37963 [53:35:19<35:01:44,  8.80s/it]
 62%|██████▏   | 23628/37963 [53:35:27<33:49:28,  8.49s/it]
 62%|██████▏   | 23629/37963 [53:35:35<32:44:54,  8.22s/it]
 62%|██████▏   | 23630/37963 [53:35:43<32:12:06,  8.09s/it]
                                                           
{'loss': '0.1429', 'grad_norm': '2.231', 'learning_rate': '6.591e-06', 'epoch': '0.6225'}
+
 62%|██████▏   | 23630/37963 [53:35:43<32:12:06,  8.09s/it]
 62%|██████▏   | 23631/37963 [53:35:50<32:00:06,  8.04s/it]
 62%|██████▏   | 23632/37963 [53:35:58<31:36:24,  7.94s/it]
 62%|██████▏   | 23633/37963 [53:36:06<31:41:11,  7.96s/it]
 62%|██████▏   | 23634/37963 [53:36:14<31:16:55,  7.86s/it]
 62%|██████▏   | 23635/37963 [53:36:22<31:16:48,  7.86s/it]
 62%|██████▏   | 23636/37963 [53:36:29<30:53:09,  7.76s/it]
 62%|██████▏   | 23637/37963 [53:36:37<30:44:21,  7.72s/it]
 62%|██████▏   | 23638/37963 [53:36:45<30:48:02,  7.74s/it]
 62%|██████▏   | 23639/37963 [53:36:52<30:42:31,  7.72s/it]
 62%|██████▏   | 23640/37963 [53:37:00<30:29:09,  7.66s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '2.053', 'learning_rate': '6.583e-06', 'epoch': '0.6227'}
+
 62%|██████▏   | 23640/37963 [53:37:00<30:29:09,  7.66s/it]
 62%|██████▏   | 23641/37963 [53:37:10<33:35:43,  8.44s/it]
 62%|██████▏   | 23642/37963 [53:37:18<32:42:46,  8.22s/it]
 62%|██████▏   | 23643/37963 [53:37:26<32:06:25,  8.07s/it]
 62%|██████▏   | 23644/37963 [53:37:33<31:52:38,  8.01s/it]
 62%|██████▏   | 23645/37963 [53:37:41<31:32:05,  7.93s/it]
 62%|██████▏   | 23646/37963 [53:37:49<31:30:19,  7.92s/it]
 62%|██████▏   | 23647/37963 [53:37:57<31:13:25,  7.85s/it]
 62%|██████▏   | 23648/37963 [53:38:05<31:16:06,  7.86s/it]
 62%|██████▏   | 23649/37963 [53:38:12<31:03:58,  7.81s/it]
 62%|██████▏   | 23650/37963 [53:38:20<30:41:13,  7.72s/it]
                                                           
{'loss': '0.1338', 'grad_norm': '1.046', 'learning_rate': '6.575e-06', 'epoch': '0.623'}
+
 62%|██████▏   | 23650/37963 [53:38:20<30:41:13,  7.72s/it]
 62%|██████▏   | 23651/37963 [53:38:27<30:36:43,  7.70s/it]
 62%|██████▏   | 23652/37963 [53:38:35<30:46:22,  7.74s/it]
 62%|██████▏   | 23653/37963 [53:38:43<30:38:59,  7.71s/it]
 62%|██████▏   | 23654/37963 [53:38:51<30:28:45,  7.67s/it]
 62%|██████▏   | 23655/37963 [53:38:58<30:35:10,  7.70s/it]
 62%|██████▏   | 23656/37963 [53:39:06<30:45:25,  7.74s/it]
 62%|██████▏   | 23657/37963 [53:39:14<30:50:47,  7.76s/it]
 62%|██████▏   | 23658/37963 [53:39:22<30:39:45,  7.72s/it]
 62%|██████▏   | 23659/37963 [53:39:29<30:28:06,  7.67s/it]
 62%|██████▏   | 23660/37963 [53:39:37<30:08:54,  7.59s/it]
                                                           
{'loss': '0.1424', 'grad_norm': '1.527', 'learning_rate': '6.567e-06', 'epoch': '0.6232'}
+
 62%|██████▏   | 23660/37963 [53:39:37<30:08:54,  7.59s/it]
 62%|██████▏   | 23661/37963 [53:39:44<29:44:51,  7.49s/it]
 62%|██████▏   | 23662/37963 [53:39:54<33:03:27,  8.32s/it]
 62%|██████▏   | 23663/37963 [53:40:02<32:30:20,  8.18s/it]
 62%|██████▏   | 23664/37963 [53:40:10<32:03:01,  8.07s/it]
 62%|██████▏   | 23665/37963 [53:40:17<31:30:01,  7.93s/it]
 62%|██████▏   | 23666/37963 [53:40:27<34:08:48,  8.60s/it]
 62%|██████▏   | 23667/37963 [53:40:36<33:32:01,  8.44s/it]
 62%|██████▏   | 23668/37963 [53:40:43<32:44:02,  8.24s/it]
 62%|██████▏   | 23669/37963 [53:40:56<38:27:35,  9.69s/it]
 62%|██████▏   | 23670/37963 [53:41:07<39:27:22,  9.94s/it]
                                                           
{'loss': '0.1339', 'grad_norm': '2.542', 'learning_rate': '6.559e-06', 'epoch': '0.6235'}
+
 62%|██████▏   | 23670/37963 [53:41:07<39:27:22,  9.94s/it]
 62%|██████▏   | 23671/37963 [53:41:15<36:57:51,  9.31s/it]
 62%|██████▏   | 23672/37963 [53:41:22<34:58:55,  8.81s/it]
 62%|██████▏   | 23673/37963 [53:41:30<33:30:01,  8.44s/it]
 62%|██████▏   | 23674/37963 [53:41:38<32:39:58,  8.23s/it]
 62%|██████▏   | 23675/37963 [53:41:48<35:19:27,  8.90s/it]
 62%|██████▏   | 23676/37963 [53:41:56<33:45:15,  8.51s/it]
 62%|██████▏   | 23677/37963 [53:42:03<32:45:36,  8.26s/it]
 62%|██████▏   | 23678/37963 [53:42:11<32:02:00,  8.07s/it]
 62%|██████▏   | 23679/37963 [53:42:22<35:10:17,  8.86s/it]
 62%|██████▏   | 23680/37963 [53:42:30<34:00:51,  8.57s/it]
                                                           
{'loss': '0.1348', 'grad_norm': '1.942', 'learning_rate': '6.551e-06', 'epoch': '0.6238'}
+
 62%|██████▏   | 23680/37963 [53:42:30<34:00:51,  8.57s/it]
 62%|██████▏   | 23681/37963 [53:42:37<33:04:11,  8.34s/it]
 62%|██████▏   | 23682/37963 [53:42:45<32:37:50,  8.23s/it]
 62%|██████▏   | 23683/37963 [53:42:53<32:10:00,  8.11s/it]
 62%|██████▏   | 23684/37963 [53:43:01<31:40:57,  7.99s/it]
 62%|██████▏   | 23685/37963 [53:43:09<31:22:25,  7.91s/it]
 62%|██████▏   | 23686/37963 [53:43:16<31:13:37,  7.87s/it]
 62%|██████▏   | 23687/37963 [53:43:24<30:36:33,  7.72s/it]
 62%|██████▏   | 23688/37963 [53:43:32<30:44:20,  7.75s/it]
 62%|██████▏   | 23689/37963 [53:43:42<34:01:22,  8.58s/it]
 62%|██████▏   | 23690/37963 [53:43:50<32:56:43,  8.31s/it]
                                                           
{'loss': '0.1551', 'grad_norm': '5.615', 'learning_rate': '6.543e-06', 'epoch': '0.624'}
+
 62%|██████▏   | 23690/37963 [53:43:50<32:56:43,  8.31s/it]
 62%|██████▏   | 23691/37963 [53:43:57<31:56:31,  8.06s/it]
 62%|██████▏   | 23692/37963 [53:44:05<31:26:22,  7.93s/it]
 62%|██████▏   | 23693/37963 [53:44:13<31:06:58,  7.85s/it]
 62%|██████▏   | 23694/37963 [53:44:20<30:42:37,  7.75s/it]
 62%|██████▏   | 23695/37963 [53:44:28<31:02:47,  7.83s/it]
 62%|██████▏   | 23696/37963 [53:44:36<30:53:21,  7.79s/it]
 62%|██████▏   | 23697/37963 [53:44:44<31:10:30,  7.87s/it]
 62%|██████▏   | 23698/37963 [53:44:52<31:09:57,  7.87s/it]
 62%|██████▏   | 23699/37963 [53:45:00<31:03:40,  7.84s/it]
 62%|██████▏   | 23700/37963 [53:45:07<30:55:23,  7.81s/it]
                                                           
{'loss': '0.1369', 'grad_norm': '2.183', 'learning_rate': '6.535e-06', 'epoch': '0.6243'}
+
 62%|██████▏   | 23700/37963 [53:45:07<30:55:23,  7.81s/it]
 62%|██████▏   | 23701/37963 [53:45:15<30:48:42,  7.78s/it]
 62%|██████▏   | 23702/37963 [53:45:23<30:45:37,  7.77s/it]
 62%|██████▏   | 23703/37963 [53:45:31<30:50:27,  7.79s/it]
 62%|██████▏   | 23704/37963 [53:45:38<30:40:38,  7.75s/it]
 62%|██████▏   | 23705/37963 [53:45:46<30:49:42,  7.78s/it]
 62%|██████▏   | 23706/37963 [53:45:54<31:04:58,  7.85s/it]
 62%|██████▏   | 23707/37963 [53:46:02<31:09:22,  7.87s/it]
 62%|██████▏   | 23708/37963 [53:46:10<31:12:39,  7.88s/it]
 62%|██████▏   | 23709/37963 [53:46:18<31:00:06,  7.83s/it]
 62%|██████▏   | 23710/37963 [53:46:25<30:54:03,  7.80s/it]
                                                           
{'loss': '0.1494', 'grad_norm': '1.372', 'learning_rate': '6.527e-06', 'epoch': '0.6246'}
+
 62%|██████▏   | 23710/37963 [53:46:25<30:54:03,  7.80s/it]
 62%|██████▏   | 23711/37963 [53:46:33<31:02:45,  7.84s/it]
 62%|██████▏   | 23712/37963 [53:46:41<31:05:34,  7.85s/it]
 62%|██████▏   | 23713/37963 [53:46:49<31:09:11,  7.87s/it]
 62%|██████▏   | 23714/37963 [53:46:57<30:52:26,  7.80s/it]
 62%|██████▏   | 23715/37963 [53:47:04<30:37:27,  7.74s/it]
 62%|██████▏   | 23716/37963 [53:47:15<33:53:12,  8.56s/it]
 62%|██████▏   | 23717/37963 [53:47:25<35:47:03,  9.04s/it]
 62%|██████▏   | 23718/37963 [53:47:33<34:19:51,  8.68s/it]
 62%|██████▏   | 23719/37963 [53:47:43<36:25:41,  9.21s/it]
 62%|██████▏   | 23720/37963 [53:47:53<37:34:33,  9.50s/it]
                                                           
{'loss': '0.1417', 'grad_norm': '3.571', 'learning_rate': '6.519e-06', 'epoch': '0.6248'}
+
 62%|██████▏   | 23720/37963 [53:47:53<37:34:33,  9.50s/it]
 62%|██████▏   | 23721/37963 [53:48:01<35:47:09,  9.05s/it]
 62%|██████▏   | 23722/37963 [53:48:09<34:34:28,  8.74s/it]
 62%|██████▏   | 23723/37963 [53:48:20<36:23:43,  9.20s/it]
 62%|██████▏   | 23724/37963 [53:48:27<34:41:09,  8.77s/it]
 62%|██████▏   | 23725/37963 [53:48:36<33:51:37,  8.56s/it]
 62%|██████▏   | 23726/37963 [53:48:46<36:01:06,  9.11s/it]
 63%|██████▎   | 23727/37963 [53:48:54<34:40:07,  8.77s/it]
 63%|██████▎   | 23728/37963 [53:49:04<36:49:30,  9.31s/it]
 63%|██████▎   | 23729/37963 [53:49:12<34:45:34,  8.79s/it]
 63%|██████▎   | 23730/37963 [53:49:20<33:29:59,  8.47s/it]
                                                           
{'loss': '0.1354', 'grad_norm': '2.499', 'learning_rate': '6.511e-06', 'epoch': '0.6251'}
+
 63%|██████▎   | 23730/37963 [53:49:20<33:29:59,  8.47s/it]
 63%|██████▎   | 23731/37963 [53:49:28<32:39:06,  8.26s/it]
 63%|██████▎   | 23732/37963 [53:49:36<32:16:49,  8.17s/it]
 63%|██████▎   | 23733/37963 [53:49:46<35:04:04,  8.87s/it]
 63%|██████▎   | 23734/37963 [53:49:54<33:38:26,  8.51s/it]
 63%|██████▎   | 23735/37963 [53:50:02<32:49:10,  8.30s/it]
 63%|██████▎   | 23736/37963 [53:50:09<32:01:14,  8.10s/it]
 63%|██████▎   | 23737/37963 [53:50:17<31:39:27,  8.01s/it]
 63%|██████▎   | 23738/37963 [53:50:25<31:30:25,  7.97s/it]
 63%|██████▎   | 23739/37963 [53:50:33<31:21:13,  7.94s/it]
 63%|██████▎   | 23740/37963 [53:50:40<31:11:01,  7.89s/it]
                                                           
{'loss': '0.1397', 'grad_norm': '2.024', 'learning_rate': '6.503e-06', 'epoch': '0.6253'}
+
 63%|██████▎   | 23740/37963 [53:50:40<31:11:01,  7.89s/it]
 63%|██████▎   | 23741/37963 [53:50:48<31:00:18,  7.85s/it]
 63%|██████▎   | 23742/37963 [53:50:56<30:34:32,  7.74s/it]
 63%|██████▎   | 23743/37963 [53:51:03<30:34:23,  7.74s/it]
 63%|██████▎   | 23744/37963 [53:51:11<30:21:07,  7.68s/it]
 63%|██████▎   | 23745/37963 [53:51:18<30:02:04,  7.60s/it]
 63%|██████▎   | 23746/37963 [53:51:26<30:16:19,  7.67s/it]
 63%|██████▎   | 23747/37963 [53:51:34<30:12:56,  7.65s/it]
 63%|██████▎   | 23748/37963 [53:51:42<30:25:17,  7.70s/it]
 63%|██████▎   | 23749/37963 [53:51:49<30:15:37,  7.66s/it]
 63%|██████▎   | 23750/37963 [53:51:57<30:12:51,  7.65s/it]
                                                           
{'loss': '0.1428', 'grad_norm': '4.271', 'learning_rate': '6.495e-06', 'epoch': '0.6256'}
+
 63%|██████▎   | 23750/37963 [53:51:57<30:12:51,  7.65s/it]
 63%|██████▎   | 23751/37963 [53:52:04<29:57:32,  7.59s/it]
 63%|██████▎   | 23752/37963 [53:52:12<30:24:14,  7.70s/it]
 63%|██████▎   | 23753/37963 [53:52:20<30:31:53,  7.73s/it]
 63%|██████▎   | 23754/37963 [53:52:28<30:11:06,  7.65s/it]
 63%|██████▎   | 23755/37963 [53:52:36<30:36:27,  7.76s/it]
 63%|██████▎   | 23756/37963 [53:52:43<30:43:01,  7.78s/it]
 63%|██████▎   | 23757/37963 [53:52:51<30:37:29,  7.76s/it]
 63%|██████▎   | 23758/37963 [53:52:59<30:51:14,  7.82s/it]
 63%|██████▎   | 23759/37963 [53:53:07<30:48:44,  7.81s/it]
 63%|██████▎   | 23760/37963 [53:53:15<30:54:22,  7.83s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '2.06', 'learning_rate': '6.487e-06', 'epoch': '0.6259'}
+
 63%|██████▎   | 23760/37963 [53:53:15<30:54:22,  7.83s/it]
 63%|██████▎   | 23761/37963 [53:53:22<30:46:03,  7.80s/it]
 63%|██████▎   | 23762/37963 [53:53:30<30:01:39,  7.61s/it]
 63%|██████▎   | 23763/37963 [53:53:40<33:20:59,  8.45s/it]
 63%|██████▎   | 23764/37963 [53:53:48<32:20:34,  8.20s/it]
 63%|██████▎   | 23765/37963 [53:53:56<32:03:57,  8.13s/it]
 63%|██████▎   | 23766/37963 [53:54:06<35:11:21,  8.92s/it]
 63%|██████▎   | 23767/37963 [53:54:14<34:02:59,  8.63s/it]
 63%|██████▎   | 23768/37963 [53:54:22<32:43:13,  8.30s/it]
 63%|██████▎   | 23769/37963 [53:54:30<31:59:42,  8.11s/it]
 63%|██████▎   | 23770/37963 [53:54:37<31:31:44,  8.00s/it]
                                                           
{'loss': '0.1352', 'grad_norm': '1.226', 'learning_rate': '6.479e-06', 'epoch': '0.6261'}
+
 63%|██████▎   | 23770/37963 [53:54:37<31:31:44,  8.00s/it]
 63%|██████▎   | 23771/37963 [53:54:47<34:01:38,  8.63s/it]
 63%|██████▎   | 23772/37963 [53:54:58<36:33:27,  9.27s/it]
 63%|██████▎   | 23773/37963 [53:55:08<37:22:36,  9.48s/it]
 63%|██████▎   | 23774/37963 [53:55:18<37:52:31,  9.61s/it]
 63%|██████▎   | 23775/37963 [53:55:26<35:57:58,  9.13s/it]
 63%|██████▎   | 23776/37963 [53:55:34<34:44:28,  8.82s/it]
 63%|██████▎   | 23777/37963 [53:55:47<39:54:22, 10.13s/it]
 63%|██████▎   | 23778/37963 [53:55:55<37:11:23,  9.44s/it]
 63%|██████▎   | 23779/37963 [53:56:03<35:12:23,  8.94s/it]
 63%|██████▎   | 23780/37963 [53:56:11<33:48:12,  8.58s/it]
                                                           
{'loss': '0.1412', 'grad_norm': '1.379', 'learning_rate': '6.471e-06', 'epoch': '0.6264'}
+
 63%|██████▎   | 23780/37963 [53:56:11<33:48:12,  8.58s/it]
 63%|██████▎   | 23781/37963 [53:56:18<32:38:15,  8.28s/it]
 63%|██████▎   | 23782/37963 [53:56:26<31:50:22,  8.08s/it]
 63%|██████▎   | 23783/37963 [53:56:33<31:15:28,  7.94s/it]
 63%|██████▎   | 23784/37963 [53:56:41<30:54:10,  7.85s/it]
 63%|██████▎   | 23785/37963 [53:56:49<30:34:02,  7.76s/it]
 63%|██████▎   | 23786/37963 [53:56:56<30:23:15,  7.72s/it]
 63%|██████▎   | 23787/37963 [53:57:04<30:22:13,  7.71s/it]
 63%|██████▎   | 23788/37963 [53:57:12<30:15:41,  7.69s/it]
 63%|██████▎   | 23789/37963 [53:57:19<30:18:42,  7.70s/it]
 63%|██████▎   | 23790/37963 [53:57:27<30:14:43,  7.68s/it]
                                                           
{'loss': '0.136', 'grad_norm': '1.916', 'learning_rate': '6.463e-06', 'epoch': '0.6267'}
+
 63%|██████▎   | 23790/37963 [53:57:27<30:14:43,  7.68s/it]
 63%|██████▎   | 23791/37963 [53:57:35<30:19:16,  7.70s/it]
 63%|██████▎   | 23792/37963 [53:57:43<30:26:49,  7.73s/it]
 63%|██████▎   | 23793/37963 [53:57:50<30:37:02,  7.78s/it]
 63%|██████▎   | 23794/37963 [53:57:58<30:35:37,  7.77s/it]
 63%|██████▎   | 23795/37963 [53:58:06<30:33:12,  7.76s/it]
 63%|██████▎   | 23796/37963 [53:58:14<30:38:17,  7.79s/it]
 63%|██████▎   | 23797/37963 [53:58:21<30:26:25,  7.74s/it]
 63%|██████▎   | 23798/37963 [53:58:29<30:29:14,  7.75s/it]
 63%|██████▎   | 23799/37963 [53:58:37<30:31:20,  7.76s/it]
 63%|██████▎   | 23800/37963 [53:58:45<30:34:52,  7.77s/it]
                                                           
{'loss': '0.1389', 'grad_norm': '3.24', 'learning_rate': '6.455e-06', 'epoch': '0.6269'}
+
 63%|██████▎   | 23800/37963 [53:58:45<30:34:52,  7.77s/it]
 63%|██████▎   | 23801/37963 [53:58:53<30:35:29,  7.78s/it]
 63%|██████▎   | 23802/37963 [53:59:00<30:29:27,  7.75s/it]
 63%|██████▎   | 23803/37963 [53:59:08<30:27:45,  7.74s/it]
 63%|██████▎   | 23804/37963 [53:59:16<30:35:23,  7.78s/it]
 63%|██████▎   | 23805/37963 [53:59:23<30:30:33,  7.76s/it]
 63%|██████▎   | 23806/37963 [53:59:31<30:36:02,  7.78s/it]
 63%|██████▎   | 23807/37963 [53:59:39<30:30:16,  7.76s/it]
 63%|██████▎   | 23808/37963 [53:59:47<30:35:05,  7.78s/it]
 63%|██████▎   | 23809/37963 [53:59:54<30:15:15,  7.70s/it]
 63%|██████▎   | 23810/37963 [54:00:02<30:27:14,  7.75s/it]
                                                           
{'loss': '0.1274', 'grad_norm': '1.71', 'learning_rate': '6.447e-06', 'epoch': '0.6272'}
+
 63%|██████▎   | 23810/37963 [54:00:02<30:27:14,  7.75s/it]
 63%|██████▎   | 23811/37963 [54:00:10<30:20:37,  7.72s/it]
 63%|██████▎   | 23812/37963 [54:00:20<33:33:40,  8.54s/it]
 63%|██████▎   | 23813/37963 [54:00:28<33:06:11,  8.42s/it]
 63%|██████▎   | 23814/37963 [54:00:36<32:10:14,  8.19s/it]
 63%|██████▎   | 23815/37963 [54:00:46<34:25:16,  8.76s/it]
 63%|██████▎   | 23816/37963 [54:00:57<36:31:40,  9.30s/it]
 63%|██████▎   | 23817/37963 [54:01:05<34:57:06,  8.89s/it]
 63%|██████▎   | 23818/37963 [54:01:12<33:35:43,  8.55s/it]
 63%|██████▎   | 23819/37963 [54:01:20<32:42:29,  8.33s/it]
 63%|██████▎   | 23820/37963 [54:01:31<35:24:04,  9.01s/it]
                                                           
{'loss': '0.1457', 'grad_norm': '1.74', 'learning_rate': '6.439e-06', 'epoch': '0.6275'}
+
 63%|██████▎   | 23820/37963 [54:01:31<35:24:04,  9.01s/it]
 63%|██████▎   | 23821/37963 [54:01:39<34:02:20,  8.67s/it]
 63%|██████▎   | 23822/37963 [54:01:49<36:12:29,  9.22s/it]
 63%|██████▎   | 23823/37963 [54:01:57<34:21:50,  8.75s/it]
 63%|██████▎   | 23824/37963 [54:02:05<33:14:33,  8.46s/it]
 63%|██████▎   | 23825/37963 [54:02:15<35:26:49,  9.03s/it]
 63%|██████▎   | 23826/37963 [54:02:23<33:59:25,  8.66s/it]
 63%|██████▎   | 23827/37963 [54:02:33<36:10:34,  9.21s/it]
 63%|██████▎   | 23828/37963 [54:02:41<34:39:15,  8.83s/it]
 63%|██████▎   | 23829/37963 [54:02:49<32:49:51,  8.36s/it]
 63%|██████▎   | 23830/37963 [54:02:56<31:39:54,  8.07s/it]
                                                           
{'loss': '0.142', 'grad_norm': '2.185', 'learning_rate': '6.431e-06', 'epoch': '0.6277'}
+
 63%|██████▎   | 23830/37963 [54:02:56<31:39:54,  8.07s/it]
 63%|██████▎   | 23831/37963 [54:03:06<34:13:17,  8.72s/it]
 63%|██████▎   | 23832/37963 [54:03:14<33:03:03,  8.42s/it]
 63%|██████▎   | 23833/37963 [54:03:21<32:06:00,  8.18s/it]
 63%|██████▎   | 23834/37963 [54:03:29<31:40:49,  8.07s/it]
 63%|██████▎   | 23835/37963 [54:03:37<31:22:29,  7.99s/it]
 63%|██████▎   | 23836/37963 [54:03:45<31:20:34,  7.99s/it]
 63%|██████▎   | 23837/37963 [54:03:53<30:56:25,  7.89s/it]
 63%|██████▎   | 23838/37963 [54:04:01<30:55:12,  7.88s/it]
 63%|██████▎   | 23839/37963 [54:04:08<30:37:21,  7.81s/it]
 63%|██████▎   | 23840/37963 [54:04:16<30:26:14,  7.76s/it]
                                                           
{'loss': '0.1328', 'grad_norm': '2.421', 'learning_rate': '6.423e-06', 'epoch': '0.628'}
+
 63%|██████▎   | 23840/37963 [54:04:16<30:26:14,  7.76s/it]
 63%|██████▎   | 23841/37963 [54:04:24<30:33:01,  7.79s/it]
 63%|██████▎   | 23842/37963 [54:04:32<30:40:32,  7.82s/it]
 63%|██████▎   | 23843/37963 [54:04:39<30:31:45,  7.78s/it]
 63%|██████▎   | 23844/37963 [54:04:47<30:28:24,  7.77s/it]
 63%|██████▎   | 23845/37963 [54:04:55<30:22:14,  7.74s/it]
 63%|██████▎   | 23846/37963 [54:05:03<30:26:06,  7.76s/it]
 63%|██████▎   | 23847/37963 [54:05:10<30:09:59,  7.69s/it]
 63%|██████▎   | 23848/37963 [54:05:18<29:53:53,  7.63s/it]
 63%|██████▎   | 23849/37963 [54:05:25<30:07:46,  7.69s/it]
 63%|██████▎   | 23850/37963 [54:05:33<30:31:26,  7.79s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '1.864', 'learning_rate': '6.415e-06', 'epoch': '0.6282'}
+
 63%|██████▎   | 23850/37963 [54:05:33<30:31:26,  7.79s/it]
 63%|██████▎   | 23851/37963 [54:05:41<30:21:25,  7.74s/it]
 63%|██████▎   | 23852/37963 [54:05:49<30:14:20,  7.71s/it]
 63%|██████▎   | 23853/37963 [54:05:56<30:11:40,  7.70s/it]
 63%|██████▎   | 23854/37963 [54:06:04<30:17:44,  7.73s/it]
 63%|██████▎   | 23855/37963 [54:06:12<30:17:06,  7.73s/it]
 63%|██████▎   | 23856/37963 [54:06:20<30:33:34,  7.80s/it]
 63%|██████▎   | 23857/37963 [54:06:27<30:18:10,  7.73s/it]
 63%|██████▎   | 23858/37963 [54:06:35<30:18:45,  7.74s/it]
 63%|██████▎   | 23859/37963 [54:06:43<30:14:38,  7.72s/it]
 63%|██████▎   | 23860/37963 [54:06:53<33:17:17,  8.50s/it]
                                                           
{'loss': '0.1303', 'grad_norm': '1.245', 'learning_rate': '6.407e-06', 'epoch': '0.6285'}
+
 63%|██████▎   | 23860/37963 [54:06:53<33:17:17,  8.50s/it]
 63%|██████▎   | 23861/37963 [54:07:01<32:29:36,  8.30s/it]
 63%|██████▎   | 23862/37963 [54:07:09<31:48:52,  8.12s/it]
 63%|██████▎   | 23863/37963 [54:07:16<31:09:14,  7.95s/it]
 63%|██████▎   | 23864/37963 [54:07:27<34:02:02,  8.69s/it]
 63%|██████▎   | 23865/37963 [54:07:35<33:11:15,  8.47s/it]
 63%|██████▎   | 23866/37963 [54:07:43<32:31:34,  8.31s/it]
 63%|██████▎   | 23867/37963 [54:07:51<32:04:13,  8.19s/it]
 63%|██████▎   | 23868/37963 [54:07:58<31:21:56,  8.01s/it]
 63%|██████▎   | 23869/37963 [54:08:11<36:41:40,  9.37s/it]
 63%|██████▎   | 23870/37963 [54:08:21<38:17:23,  9.78s/it]
                                                           
{'loss': '0.1444', 'grad_norm': '2.023', 'learning_rate': '6.399e-06', 'epoch': '0.6288'}
+
 63%|██████▎   | 23870/37963 [54:08:21<38:17:23,  9.78s/it]
 63%|██████▎   | 23871/37963 [54:08:29<36:13:50,  9.26s/it]
 63%|██████▎   | 23872/37963 [54:08:37<34:40:40,  8.86s/it]
 63%|██████▎   | 23873/37963 [54:08:45<33:24:10,  8.53s/it]
 63%|██████▎   | 23874/37963 [54:08:53<32:49:22,  8.39s/it]
 63%|██████▎   | 23875/37963 [54:09:04<35:14:51,  9.01s/it]
 63%|██████▎   | 23876/37963 [54:09:11<33:51:31,  8.65s/it]
 63%|██████▎   | 23877/37963 [54:09:22<35:51:28,  9.16s/it]
 63%|██████▎   | 23878/37963 [54:09:32<37:36:47,  9.61s/it]
 63%|██████▎   | 23879/37963 [54:09:40<35:38:22,  9.11s/it]
 63%|██████▎   | 23880/37963 [54:09:48<33:54:12,  8.67s/it]
                                                           
{'loss': '0.1311', 'grad_norm': '2.504', 'learning_rate': '6.391e-06', 'epoch': '0.629'}
+
 63%|██████▎   | 23880/37963 [54:09:48<33:54:12,  8.67s/it]
 63%|██████▎   | 23881/37963 [54:09:56<32:41:52,  8.36s/it]
 63%|██████▎   | 23882/37963 [54:10:03<31:46:13,  8.12s/it]
 63%|██████▎   | 23883/37963 [54:10:11<31:15:28,  7.99s/it]
 63%|██████▎   | 23884/37963 [54:10:19<31:08:05,  7.96s/it]
 63%|██████▎   | 23885/37963 [54:10:27<31:03:18,  7.94s/it]
 63%|██████▎   | 23886/37963 [54:10:34<30:39:28,  7.84s/it]
 63%|██████▎   | 23887/37963 [54:10:42<30:23:41,  7.77s/it]
 63%|██████▎   | 23888/37963 [54:10:50<30:25:04,  7.78s/it]
 63%|██████▎   | 23889/37963 [54:10:57<29:59:47,  7.67s/it]
 63%|██████▎   | 23890/37963 [54:11:05<30:09:46,  7.72s/it]
                                                           
{'loss': '0.1455', 'grad_norm': '2.995', 'learning_rate': '6.383e-06', 'epoch': '0.6293'}
+
 63%|██████▎   | 23890/37963 [54:11:05<30:09:46,  7.72s/it]
 63%|██████▎   | 23891/37963 [54:11:12<29:49:42,  7.63s/it]
 63%|██████▎   | 23892/37963 [54:11:20<29:54:58,  7.65s/it]
 63%|██████▎   | 23893/37963 [54:11:28<29:59:30,  7.67s/it]
 63%|██████▎   | 23894/37963 [54:11:36<30:17:30,  7.75s/it]
 63%|██████▎   | 23895/37963 [54:11:43<30:13:12,  7.73s/it]
 63%|██████▎   | 23896/37963 [54:11:51<30:08:48,  7.72s/it]
 63%|██████▎   | 23897/37963 [54:11:59<30:10:21,  7.72s/it]
 63%|██████▎   | 23898/37963 [54:12:06<30:03:18,  7.69s/it]
 63%|██████▎   | 23899/37963 [54:12:14<30:14:05,  7.74s/it]
 63%|██████▎   | 23900/37963 [54:12:22<30:18:12,  7.76s/it]
                                                           
{'loss': '0.1322', 'grad_norm': '1.596', 'learning_rate': '6.375e-06', 'epoch': '0.6296'}
+
 63%|██████▎   | 23900/37963 [54:12:22<30:18:12,  7.76s/it]
 63%|██████▎   | 23901/37963 [54:12:30<30:16:45,  7.75s/it]
 63%|██████▎   | 23902/37963 [54:12:38<30:23:56,  7.78s/it]
 63%|██████▎   | 23903/37963 [54:12:46<30:25:30,  7.79s/it]
 63%|██████▎   | 23904/37963 [54:12:53<30:32:33,  7.82s/it]
 63%|██████▎   | 23905/37963 [54:13:01<30:21:47,  7.78s/it]
 63%|██████▎   | 23906/37963 [54:13:09<30:18:42,  7.76s/it]
 63%|██████▎   | 23907/37963 [54:13:17<30:14:39,  7.75s/it]
 63%|██████▎   | 23908/37963 [54:13:24<30:24:31,  7.79s/it]
 63%|██████▎   | 23909/37963 [54:13:35<33:54:45,  8.69s/it]
 63%|██████▎   | 23910/37963 [54:13:43<32:59:33,  8.45s/it]
                                                           
{'loss': '0.1593', 'grad_norm': '3.419', 'learning_rate': '6.367e-06', 'epoch': '0.6298'}
+
 63%|██████▎   | 23910/37963 [54:13:43<32:59:33,  8.45s/it]
 63%|██████▎   | 23911/37963 [54:13:51<32:04:34,  8.22s/it]
 63%|██████▎   | 23912/37963 [54:14:01<34:42:34,  8.89s/it]
 63%|██████▎   | 23913/37963 [54:14:09<33:42:56,  8.64s/it]
 63%|██████▎   | 23914/37963 [54:14:20<35:55:56,  9.21s/it]
 63%|██████▎   | 23915/37963 [54:14:28<34:24:51,  8.82s/it]
 63%|██████▎   | 23916/37963 [54:14:36<33:16:44,  8.53s/it]
 63%|██████▎   | 23917/37963 [54:14:43<31:55:20,  8.18s/it]
 63%|██████▎   | 23918/37963 [54:14:53<34:30:23,  8.84s/it]
 63%|██████▎   | 23919/37963 [54:15:01<33:22:26,  8.55s/it]
 63%|██████▎   | 23920/37963 [54:15:09<32:17:19,  8.28s/it]
                                                           
{'loss': '0.1204', 'grad_norm': '1.583', 'learning_rate': '6.359e-06', 'epoch': '0.6301'}
+
 63%|██████▎   | 23920/37963 [54:15:09<32:17:19,  8.28s/it]
 63%|██████▎   | 23921/37963 [54:15:17<31:34:36,  8.10s/it]
 63%|██████▎   | 23922/37963 [54:15:25<31:26:14,  8.06s/it]
 63%|██████▎   | 23923/37963 [54:15:35<34:03:09,  8.73s/it]
 63%|██████▎   | 23924/37963 [54:15:45<36:06:00,  9.26s/it]
 63%|██████▎   | 23925/37963 [54:15:56<37:24:37,  9.59s/it]
 63%|██████▎   | 23926/37963 [54:16:03<35:12:01,  9.03s/it]
 63%|██████▎   | 23927/37963 [54:16:11<33:37:41,  8.63s/it]
 63%|██████▎   | 23928/37963 [54:16:19<32:27:54,  8.33s/it]
 63%|██████▎   | 23929/37963 [54:16:26<31:39:51,  8.12s/it]
 63%|██████▎   | 23930/37963 [54:16:34<31:12:56,  8.01s/it]
                                                           
{'loss': '0.1458', 'grad_norm': '2.919', 'learning_rate': '6.351e-06', 'epoch': '0.6304'}
+
 63%|██████▎   | 23930/37963 [54:16:34<31:12:56,  8.01s/it]
 63%|██████▎   | 23931/37963 [54:16:42<30:48:03,  7.90s/it]
 63%|██████▎   | 23932/37963 [54:16:50<30:37:30,  7.86s/it]
 63%|██████▎   | 23933/37963 [54:17:00<33:48:52,  8.68s/it]
 63%|██████▎   | 23934/37963 [54:17:08<32:54:51,  8.45s/it]
 63%|██████▎   | 23935/37963 [54:17:16<32:09:28,  8.25s/it]
 63%|██████▎   | 23936/37963 [54:17:24<31:33:30,  8.10s/it]
 63%|██████▎   | 23937/37963 [54:17:31<31:22:47,  8.05s/it]
 63%|██████▎   | 23938/37963 [54:17:39<31:01:27,  7.96s/it]
 63%|██████▎   | 23939/37963 [54:17:47<30:49:57,  7.91s/it]
 63%|██████▎   | 23940/37963 [54:17:55<30:47:03,  7.90s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '1.427', 'learning_rate': '6.343e-06', 'epoch': '0.6306'}
+
 63%|██████▎   | 23940/37963 [54:17:55<30:47:03,  7.90s/it]
 63%|██████▎   | 23941/37963 [54:18:03<30:37:31,  7.86s/it]
 63%|██████▎   | 23942/37963 [54:18:10<30:31:58,  7.84s/it]
 63%|██████▎   | 23943/37963 [54:18:18<30:20:17,  7.79s/it]
 63%|██████▎   | 23944/37963 [54:18:26<30:26:15,  7.82s/it]
 63%|██████▎   | 23945/37963 [54:18:34<30:16:27,  7.77s/it]
 63%|██████▎   | 23946/37963 [54:18:42<30:20:01,  7.79s/it]
 63%|██████▎   | 23947/37963 [54:18:49<30:19:01,  7.79s/it]
 63%|██████▎   | 23948/37963 [54:18:57<30:06:32,  7.73s/it]
 63%|██████▎   | 23949/37963 [54:19:05<30:14:50,  7.77s/it]
 63%|██████▎   | 23950/37963 [54:19:12<29:50:12,  7.67s/it]
                                                           
{'loss': '0.1538', 'grad_norm': '2.582', 'learning_rate': '6.335e-06', 'epoch': '0.6309'}
+
 63%|██████▎   | 23950/37963 [54:19:12<29:50:12,  7.67s/it]
 63%|██████▎   | 23951/37963 [54:19:20<30:04:42,  7.73s/it]
 63%|██████▎   | 23952/37963 [54:19:28<29:47:49,  7.66s/it]
 63%|██████▎   | 23953/37963 [54:19:35<29:52:49,  7.68s/it]
 63%|██████▎   | 23954/37963 [54:19:43<30:07:35,  7.74s/it]
 63%|██████▎   | 23955/37963 [54:19:53<32:53:10,  8.45s/it]
 63%|██████▎   | 23956/37963 [54:20:01<31:58:31,  8.22s/it]
 63%|██████▎   | 23957/37963 [54:20:11<34:34:08,  8.89s/it]
 63%|██████▎   | 23958/37963 [54:20:19<33:27:51,  8.60s/it]
 63%|██████▎   | 23959/37963 [54:20:27<32:04:53,  8.25s/it]
 63%|██████▎   | 23960/37963 [54:20:34<31:26:07,  8.08s/it]
                                                           
{'loss': '0.1473', 'grad_norm': '3.16', 'learning_rate': '6.327e-06', 'epoch': '0.6311'}
+
 63%|██████▎   | 23960/37963 [54:20:34<31:26:07,  8.08s/it]
 63%|██████▎   | 23961/37963 [54:20:42<31:07:21,  8.00s/it]
 63%|██████▎   | 23962/37963 [54:20:50<30:37:39,  7.88s/it]
 63%|██████▎   | 23963/37963 [54:21:00<33:45:06,  8.68s/it]
 63%|██████▎   | 23964/37963 [54:21:08<32:13:35,  8.29s/it]
 63%|██████▎   | 23965/37963 [54:21:16<31:52:36,  8.20s/it]
 63%|██████▎   | 23966/37963 [54:21:23<31:10:02,  8.02s/it]
 63%|██████▎   | 23967/37963 [54:21:34<33:49:31,  8.70s/it]
 63%|██████▎   | 23968/37963 [54:21:41<32:48:00,  8.44s/it]
 63%|██████▎   | 23969/37963 [54:21:49<32:13:14,  8.29s/it]
 63%|██████▎   | 23970/37963 [54:21:57<31:24:07,  8.08s/it]
                                                           
{'loss': '0.1365', 'grad_norm': '3.803', 'learning_rate': '6.319e-06', 'epoch': '0.6314'}
+
 63%|██████▎   | 23970/37963 [54:21:57<31:24:07,  8.08s/it]
 63%|██████▎   | 23971/37963 [54:22:05<30:52:33,  7.94s/it]
 63%|██████▎   | 23972/37963 [54:22:12<30:28:47,  7.84s/it]
 63%|██████▎   | 23973/37963 [54:22:23<33:32:36,  8.63s/it]
 63%|██████▎   | 23974/37963 [54:22:30<32:30:47,  8.37s/it]
 63%|██████▎   | 23975/37963 [54:22:38<31:40:33,  8.15s/it]
 63%|██████▎   | 23976/37963 [54:22:46<31:24:19,  8.08s/it]
 63%|██████▎   | 23977/37963 [54:22:57<34:21:26,  8.84s/it]
 63%|██████▎   | 23978/37963 [54:23:07<36:19:44,  9.35s/it]
 63%|██████▎   | 23979/37963 [54:23:15<34:21:25,  8.84s/it]
 63%|██████▎   | 23980/37963 [54:23:23<33:05:52,  8.52s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '1.744', 'learning_rate': '6.312e-06', 'epoch': '0.6317'}
+
 63%|██████▎   | 23980/37963 [54:23:23<33:05:52,  8.52s/it]
 63%|██████▎   | 23981/37963 [54:23:30<32:06:56,  8.27s/it]
 63%|██████▎   | 23982/37963 [54:23:38<31:30:25,  8.11s/it]
 63%|██████▎   | 23983/37963 [54:23:46<31:07:48,  8.02s/it]
 63%|██████▎   | 23984/37963 [54:23:53<30:30:04,  7.85s/it]
 63%|██████▎   | 23985/37963 [54:24:01<30:32:20,  7.87s/it]
 63%|██████▎   | 23986/37963 [54:24:09<30:43:38,  7.91s/it]
 63%|██████▎   | 23987/37963 [54:24:20<33:39:50,  8.67s/it]
 63%|██████▎   | 23988/37963 [54:24:28<32:55:06,  8.48s/it]
 63%|██████▎   | 23989/37963 [54:24:36<32:10:33,  8.29s/it]
 63%|██████▎   | 23990/37963 [54:24:43<31:04:35,  8.01s/it]
                                                           
{'loss': '0.1387', 'grad_norm': '1.624', 'learning_rate': '6.304e-06', 'epoch': '0.6319'}
+
 63%|██████▎   | 23990/37963 [54:24:43<31:04:35,  8.01s/it]
 63%|██████▎   | 23991/37963 [54:24:51<30:46:27,  7.93s/it]
 63%|██████▎   | 23992/37963 [54:24:58<30:28:13,  7.85s/it]
 63%|██████▎   | 23993/37963 [54:25:06<29:59:42,  7.73s/it]
 63%|██████▎   | 23994/37963 [54:25:13<29:49:50,  7.69s/it]
 63%|██████▎   | 23995/37963 [54:25:21<30:05:54,  7.76s/it]
 63%|██████▎   | 23996/37963 [54:25:29<29:56:54,  7.72s/it]
 63%|██████▎   | 23997/37963 [54:25:37<29:51:27,  7.70s/it]
 63%|██████▎   | 23998/37963 [54:25:44<29:43:35,  7.66s/it]
 63%|██████▎   | 23999/37963 [54:25:55<33:02:51,  8.52s/it]
 63%|██████▎   | 24000/37963 [54:26:02<32:08:29,  8.29s/it]
                                                           
{'loss': '0.1364', 'grad_norm': '1.707', 'learning_rate': '6.296e-06', 'epoch': '0.6322'}
+
 63%|██████▎   | 24000/37963 [54:26:02<32:08:29,  8.29s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.10s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.10s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 63%|██████▎   | 24001/37963 [54:27:04<93:41:40, 24.16s/it]
 63%|██████▎   | 24002/37963 [54:27:11<74:37:34, 19.24s/it]
 63%|██████▎   | 24003/37963 [54:27:19<61:20:21, 15.82s/it]
 63%|██████▎   | 24004/37963 [54:27:27<51:50:31, 13.37s/it]
 63%|██████▎   | 24005/37963 [54:27:35<45:33:25, 11.75s/it]
 63%|██████▎   | 24006/37963 [54:27:43<40:55:56, 10.56s/it]
 63%|██████▎   | 24007/37963 [54:27:53<41:10:35, 10.62s/it]
 63%|██████▎   | 24008/37963 [54:28:01<37:51:20,  9.77s/it]
 63%|██████▎   | 24009/37963 [54:28:09<35:22:14,  9.13s/it]
 63%|██████▎   | 24010/37963 [54:28:16<33:39:18,  8.68s/it]
                                                           
{'loss': '0.1329', 'grad_norm': '3.21', 'learning_rate': '6.288e-06', 'epoch': '0.6325'}
+
 63%|██████▎   | 24010/37963 [54:28:16<33:39:18,  8.68s/it]
 63%|██████▎   | 24011/37963 [54:28:24<32:38:03,  8.42s/it]
 63%|██████▎   | 24012/37963 [54:28:32<31:44:14,  8.19s/it]
 63%|██████▎   | 24013/37963 [54:28:39<30:51:57,  7.97s/it]
 63%|██████▎   | 24014/37963 [54:28:47<30:32:25,  7.88s/it]
 63%|██████▎   | 24015/37963 [54:28:55<30:32:39,  7.88s/it]
 63%|██████▎   | 24016/37963 [54:29:03<30:43:38,  7.93s/it]
 63%|██████▎   | 24017/37963 [54:29:11<30:39:48,  7.92s/it]
 63%|██████▎   | 24018/37963 [54:29:19<30:29:09,  7.87s/it]
 63%|██████▎   | 24019/37963 [54:29:31<36:19:07,  9.38s/it]
 63%|██████▎   | 24020/37963 [54:29:39<34:20:57,  8.87s/it]
                                                           
{'loss': '0.1383', 'grad_norm': '5.304', 'learning_rate': '6.28e-06', 'epoch': '0.6327'}
+
 63%|██████▎   | 24020/37963 [54:29:39<34:20:57,  8.87s/it]
 63%|██████▎   | 24021/37963 [54:29:47<32:44:30,  8.45s/it]
 63%|██████▎   | 24022/37963 [54:29:55<32:03:58,  8.28s/it]
 63%|██████▎   | 24023/37963 [54:30:02<31:32:27,  8.15s/it]
 63%|██████▎   | 24024/37963 [54:30:10<30:56:01,  7.99s/it]
 63%|██████▎   | 24025/37963 [54:30:18<30:32:56,  7.89s/it]
 63%|██████▎   | 24026/37963 [54:30:28<33:18:14,  8.60s/it]
 63%|██████▎   | 24027/37963 [54:30:36<32:19:57,  8.35s/it]
 63%|██████▎   | 24028/37963 [54:30:46<34:35:52,  8.94s/it]
 63%|██████▎   | 24029/37963 [54:30:54<33:09:48,  8.57s/it]
 63%|██████▎   | 24030/37963 [54:31:01<32:05:46,  8.29s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '3.883', 'learning_rate': '6.272e-06', 'epoch': '0.633'}
+
 63%|██████▎   | 24030/37963 [54:31:01<32:05:46,  8.29s/it]
 63%|██████▎   | 24031/37963 [54:31:09<31:28:19,  8.13s/it]
 63%|██████▎   | 24032/37963 [54:31:17<31:04:21,  8.03s/it]
 63%|██████▎   | 24033/37963 [54:31:28<34:24:00,  8.89s/it]
 63%|██████▎   | 24034/37963 [54:31:36<33:04:12,  8.55s/it]
 63%|██████▎   | 24035/37963 [54:31:43<32:17:37,  8.35s/it]
 63%|██████▎   | 24036/37963 [54:31:51<31:39:02,  8.18s/it]
 63%|██████▎   | 24037/37963 [54:31:59<31:08:12,  8.05s/it]
 63%|██████▎   | 24038/37963 [54:32:07<30:45:26,  7.95s/it]
 63%|██████▎   | 24039/37963 [54:32:14<30:28:34,  7.88s/it]
 63%|██████▎   | 24040/37963 [54:32:22<29:51:02,  7.72s/it]
                                                           
{'loss': '0.1444', 'grad_norm': '2.14', 'learning_rate': '6.264e-06', 'epoch': '0.6333'}
+
 63%|██████▎   | 24040/37963 [54:32:22<29:51:02,  7.72s/it]
 63%|██████▎   | 24041/37963 [54:32:29<29:45:23,  7.69s/it]
 63%|██████▎   | 24042/37963 [54:32:37<29:59:32,  7.76s/it]
 63%|██████▎   | 24043/37963 [54:32:48<32:53:57,  8.51s/it]
 63%|██████▎   | 24044/37963 [54:32:55<32:01:53,  8.28s/it]
 63%|██████▎   | 24045/37963 [54:33:03<31:15:53,  8.09s/it]
 63%|██████▎   | 24046/37963 [54:33:11<31:01:08,  8.02s/it]
 63%|██████▎   | 24047/37963 [54:33:19<30:40:17,  7.93s/it]
 63%|██████▎   | 24048/37963 [54:33:26<30:23:23,  7.86s/it]
 63%|██████▎   | 24049/37963 [54:33:34<30:12:40,  7.82s/it]
 63%|██████▎   | 24050/37963 [54:33:42<29:58:21,  7.76s/it]
                                                           
{'loss': '0.1426', 'grad_norm': '1.505', 'learning_rate': '6.256e-06', 'epoch': '0.6335'}
+
 63%|██████▎   | 24050/37963 [54:33:42<29:58:21,  7.76s/it]
 63%|██████▎   | 24051/37963 [54:33:52<33:18:36,  8.62s/it]
 63%|██████▎   | 24052/37963 [54:34:00<32:28:17,  8.40s/it]
 63%|██████▎   | 24053/37963 [54:34:08<31:45:51,  8.22s/it]
 63%|██████▎   | 24054/37963 [54:34:16<31:16:30,  8.09s/it]
 63%|██████▎   | 24055/37963 [54:34:26<33:52:25,  8.77s/it]
 63%|██████▎   | 24056/37963 [54:34:34<33:04:23,  8.56s/it]
 63%|██████▎   | 24057/37963 [54:34:42<32:11:34,  8.33s/it]
 63%|██████▎   | 24058/37963 [54:34:50<31:34:45,  8.18s/it]
 63%|██████▎   | 24059/37963 [54:34:57<30:58:32,  8.02s/it]
 63%|██████▎   | 24060/37963 [54:35:05<30:52:44,  8.00s/it]
                                                           
{'loss': '0.1496', 'grad_norm': '1.298', 'learning_rate': '6.248e-06', 'epoch': '0.6338'}
+
 63%|██████▎   | 24060/37963 [54:35:05<30:52:44,  8.00s/it]
 63%|██████▎   | 24061/37963 [54:35:13<30:27:10,  7.89s/it]
 63%|██████▎   | 24062/37963 [54:35:21<30:14:13,  7.83s/it]
 63%|██████▎   | 24063/37963 [54:35:28<30:15:58,  7.84s/it]
 63%|██████▎   | 24064/37963 [54:35:36<30:26:02,  7.88s/it]
 63%|██████▎   | 24065/37963 [54:35:44<29:53:01,  7.74s/it]
 63%|██████▎   | 24066/37963 [54:35:52<29:47:26,  7.72s/it]
 63%|██████▎   | 24067/37963 [54:36:01<32:21:21,  8.38s/it]
 63%|██████▎   | 24068/37963 [54:36:09<31:51:07,  8.25s/it]
 63%|██████▎   | 24069/37963 [54:36:17<31:24:16,  8.14s/it]
 63%|██████▎   | 24070/37963 [54:36:25<30:52:11,  8.00s/it]
                                                           
{'loss': '0.1377', 'grad_norm': '1.58', 'learning_rate': '6.24e-06', 'epoch': '0.634'}
+
 63%|██████▎   | 24070/37963 [54:36:25<30:52:11,  8.00s/it]
 63%|██████▎   | 24071/37963 [54:36:33<30:25:28,  7.88s/it]
 63%|██████▎   | 24072/37963 [54:36:40<30:08:14,  7.81s/it]
 63%|██████▎   | 24073/37963 [54:36:50<32:57:23,  8.54s/it]
 63%|██████▎   | 24074/37963 [54:36:58<32:15:21,  8.36s/it]
 63%|██████▎   | 24075/37963 [54:37:06<31:39:26,  8.21s/it]
 63%|██████▎   | 24076/37963 [54:37:17<34:10:09,  8.86s/it]
 63%|██████▎   | 24077/37963 [54:37:24<32:59:00,  8.55s/it]
 63%|██████▎   | 24078/37963 [54:37:32<31:47:56,  8.24s/it]
 63%|██████▎   | 24079/37963 [54:37:39<30:43:27,  7.97s/it]
 63%|██████▎   | 24080/37963 [54:37:50<33:25:36,  8.67s/it]
                                                           
{'loss': '0.1278', 'grad_norm': '1.2', 'learning_rate': '6.232e-06', 'epoch': '0.6343'}
+
 63%|██████▎   | 24080/37963 [54:37:50<33:25:36,  8.67s/it]
 63%|██████▎   | 24081/37963 [54:38:00<35:39:52,  9.25s/it]
 63%|██████▎   | 24082/37963 [54:38:08<33:55:01,  8.80s/it]
 63%|██████▎   | 24083/37963 [54:38:15<32:22:15,  8.40s/it]
 63%|██████▎   | 24084/37963 [54:38:23<31:41:45,  8.22s/it]
 63%|██████▎   | 24085/37963 [54:38:31<31:01:44,  8.05s/it]
 63%|██████▎   | 24086/37963 [54:38:41<33:31:04,  8.70s/it]
 63%|██████▎   | 24087/37963 [54:38:49<32:24:24,  8.41s/it]
 63%|██████▎   | 24088/37963 [54:38:57<31:45:34,  8.24s/it]
 63%|██████▎   | 24089/37963 [54:39:04<30:58:50,  8.04s/it]
 63%|██████▎   | 24090/37963 [54:39:12<30:32:11,  7.92s/it]
                                                           
{'loss': '0.1335', 'grad_norm': '2.044', 'learning_rate': '6.224e-06', 'epoch': '0.6346'}
+
 63%|██████▎   | 24090/37963 [54:39:12<30:32:11,  7.92s/it]
 63%|██████▎   | 24091/37963 [54:39:20<30:14:22,  7.85s/it]
 63%|██████▎   | 24092/37963 [54:39:27<30:02:04,  7.80s/it]
 63%|██████▎   | 24093/37963 [54:39:35<29:53:18,  7.76s/it]
 63%|██████▎   | 24094/37963 [54:39:43<30:14:29,  7.85s/it]
 63%|██████▎   | 24095/37963 [54:39:50<29:34:53,  7.68s/it]
 63%|██████▎   | 24096/37963 [54:39:58<29:36:43,  7.69s/it]
 63%|██████▎   | 24097/37963 [54:40:06<29:31:06,  7.66s/it]
 63%|██████▎   | 24098/37963 [54:40:13<29:32:12,  7.67s/it]
 63%|██████▎   | 24099/37963 [54:40:24<32:43:23,  8.50s/it]
 63%|██████▎   | 24100/37963 [54:40:32<32:01:22,  8.32s/it]
                                                           
{'loss': '0.1382', 'grad_norm': '1.943', 'learning_rate': '6.217e-06', 'epoch': '0.6348'}
+
 63%|██████▎   | 24100/37963 [54:40:32<32:01:22,  8.32s/it]
 63%|██████▎   | 24101/37963 [54:40:39<30:59:31,  8.05s/it]
 63%|██████▎   | 24102/37963 [54:40:47<30:44:20,  7.98s/it]
 63%|██████▎   | 24103/37963 [54:40:54<30:14:08,  7.85s/it]
 63%|██████▎   | 24104/37963 [54:41:02<30:04:18,  7.81s/it]
 63%|██████▎   | 24105/37963 [54:41:10<30:13:51,  7.85s/it]
 63%|██████▎   | 24106/37963 [54:41:18<30:03:42,  7.81s/it]
 64%|██████▎   | 24107/37963 [54:41:25<29:55:33,  7.78s/it]
 64%|██████▎   | 24108/37963 [54:41:33<29:33:55,  7.68s/it]
 64%|██████▎   | 24109/37963 [54:41:43<32:54:02,  8.55s/it]
 64%|██████▎   | 24110/37963 [54:41:51<32:04:04,  8.33s/it]
                                                           
{'loss': '0.1401', 'grad_norm': '3.776', 'learning_rate': '6.209e-06', 'epoch': '0.6351'}
+
 64%|██████▎   | 24110/37963 [54:41:51<32:04:04,  8.33s/it]
 64%|██████▎   | 24111/37963 [54:42:02<34:18:44,  8.92s/it]
 64%|██████▎   | 24112/37963 [54:42:09<32:59:14,  8.57s/it]
 64%|██████▎   | 24113/37963 [54:42:17<32:01:16,  8.32s/it]
 64%|██████▎   | 24114/37963 [54:42:25<31:28:33,  8.18s/it]
 64%|██████▎   | 24115/37963 [54:42:33<30:47:24,  8.00s/it]
 64%|██████▎   | 24116/37963 [54:42:40<30:21:16,  7.89s/it]
 64%|██████▎   | 24117/37963 [54:42:48<30:11:41,  7.85s/it]
 64%|██████▎   | 24118/37963 [54:42:56<29:55:07,  7.78s/it]
 64%|██████▎   | 24119/37963 [54:43:03<29:59:09,  7.80s/it]
 64%|██████▎   | 24120/37963 [54:43:11<29:58:58,  7.80s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '3.656', 'learning_rate': '6.201e-06', 'epoch': '0.6354'}
+
 64%|██████▎   | 24120/37963 [54:43:11<29:58:58,  7.80s/it]
 64%|██████▎   | 24121/37963 [54:43:21<32:47:24,  8.53s/it]
 64%|██████▎   | 24122/37963 [54:43:29<31:51:18,  8.29s/it]
 64%|██████▎   | 24123/37963 [54:43:37<31:25:47,  8.18s/it]
 64%|██████▎   | 24124/37963 [54:43:50<36:56:37,  9.61s/it]
 64%|██████▎   | 24125/37963 [54:44:01<38:07:51,  9.92s/it]
 64%|██████▎   | 24126/37963 [54:44:08<35:20:42,  9.20s/it]
 64%|██████▎   | 24127/37963 [54:44:16<33:44:16,  8.78s/it]
 64%|██████▎   | 24128/37963 [54:44:24<32:20:53,  8.42s/it]
 64%|██████▎   | 24129/37963 [54:44:31<31:22:59,  8.17s/it]
 64%|██████▎   | 24130/37963 [54:44:39<31:02:51,  8.08s/it]
                                                           
{'loss': '0.1329', 'grad_norm': '1.216', 'learning_rate': '6.193e-06', 'epoch': '0.6356'}
+
 64%|██████▎   | 24130/37963 [54:44:39<31:02:51,  8.08s/it]
 64%|██████▎   | 24131/37963 [54:44:47<30:58:20,  8.06s/it]
 64%|██████▎   | 24132/37963 [54:44:55<30:48:25,  8.02s/it]
 64%|██████▎   | 24133/37963 [54:45:03<30:34:45,  7.96s/it]
 64%|██████▎   | 24134/37963 [54:45:10<30:18:14,  7.89s/it]
 64%|██████▎   | 24135/37963 [54:45:21<32:57:15,  8.58s/it]
 64%|██████▎   | 24136/37963 [54:45:29<32:13:23,  8.39s/it]
 64%|██████▎   | 24137/37963 [54:45:36<31:13:23,  8.13s/it]
 64%|██████▎   | 24138/37963 [54:45:44<30:47:48,  8.02s/it]
 64%|██████▎   | 24139/37963 [54:45:52<30:34:31,  7.96s/it]
 64%|██████▎   | 24140/37963 [54:45:59<30:18:27,  7.89s/it]
                                                           
{'loss': '0.1389', 'grad_norm': '1.982', 'learning_rate': '6.185e-06', 'epoch': '0.6359'}
+
 64%|██████▎   | 24140/37963 [54:45:59<30:18:27,  7.89s/it]
 64%|██████▎   | 24141/37963 [54:46:07<30:08:34,  7.85s/it]
 64%|██████▎   | 24142/37963 [54:46:15<30:04:43,  7.83s/it]
 64%|██████▎   | 24143/37963 [54:46:23<29:59:18,  7.81s/it]
 64%|██████▎   | 24144/37963 [54:46:31<29:56:38,  7.80s/it]
 64%|██████▎   | 24145/37963 [54:46:38<29:43:56,  7.75s/it]
 64%|██████▎   | 24146/37963 [54:46:46<29:59:34,  7.81s/it]
 64%|██████▎   | 24147/37963 [54:46:54<30:00:19,  7.82s/it]
 64%|██████▎   | 24148/37963 [54:47:02<29:50:44,  7.78s/it]
 64%|██████▎   | 24149/37963 [54:47:09<29:51:25,  7.78s/it]
 64%|██████▎   | 24150/37963 [54:47:17<30:11:06,  7.87s/it]
                                                           
{'loss': '0.1294', 'grad_norm': '2.659', 'learning_rate': '6.177e-06', 'epoch': '0.6361'}
+
 64%|██████▎   | 24150/37963 [54:47:18<30:11:06,  7.87s/it]
 64%|██████▎   | 24151/37963 [54:47:25<29:49:39,  7.77s/it]
 64%|██████▎   | 24152/37963 [54:47:36<32:56:58,  8.59s/it]
 64%|██████▎   | 24153/37963 [54:47:46<35:12:28,  9.18s/it]
 64%|██████▎   | 24154/37963 [54:47:54<33:13:11,  8.66s/it]
 64%|██████▎   | 24155/37963 [54:48:01<32:11:53,  8.39s/it]
 64%|██████▎   | 24156/37963 [54:48:09<31:21:54,  8.18s/it]
 64%|██████▎   | 24157/37963 [54:48:17<30:41:59,  8.01s/it]
 64%|██████▎   | 24158/37963 [54:48:24<30:06:09,  7.85s/it]
 64%|██████▎   | 24159/37963 [54:48:35<33:19:03,  8.69s/it]
 64%|██████▎   | 24160/37963 [54:48:43<32:28:40,  8.47s/it]
                                                           
{'loss': '0.1428', 'grad_norm': '1.519', 'learning_rate': '6.169e-06', 'epoch': '0.6364'}
+
 64%|██████▎   | 24160/37963 [54:48:43<32:28:40,  8.47s/it]
 64%|██████▎   | 24161/37963 [54:48:51<31:45:59,  8.29s/it]
 64%|██████▎   | 24162/37963 [54:48:59<31:23:13,  8.19s/it]
 64%|██████▎   | 24163/37963 [54:49:06<30:52:41,  8.06s/it]
 64%|██████▎   | 24164/37963 [54:49:14<30:47:58,  8.04s/it]
 64%|██████▎   | 24165/37963 [54:49:22<30:18:49,  7.91s/it]
 64%|██████▎   | 24166/37963 [54:49:30<30:04:02,  7.85s/it]
 64%|██████▎   | 24167/37963 [54:49:40<32:49:43,  8.57s/it]
 64%|██████▎   | 24168/37963 [54:49:48<31:55:34,  8.33s/it]
 64%|██████▎   | 24169/37963 [54:49:55<31:23:34,  8.19s/it]
 64%|██████▎   | 24170/37963 [54:50:03<30:56:28,  8.08s/it]
                                                           
{'loss': '0.1484', 'grad_norm': '4.165', 'learning_rate': '6.161e-06', 'epoch': '0.6367'}
+
 64%|██████▎   | 24170/37963 [54:50:03<30:56:28,  8.08s/it]
 64%|██████▎   | 24171/37963 [54:50:11<30:40:39,  8.01s/it]
 64%|██████▎   | 24172/37963 [54:50:19<30:14:23,  7.89s/it]
 64%|██████▎   | 24173/37963 [54:50:29<33:23:10,  8.72s/it]
 64%|██████▎   | 24174/37963 [54:50:37<32:21:18,  8.45s/it]
 64%|██████▎   | 24175/37963 [54:50:48<34:38:50,  9.05s/it]
 64%|██████▎   | 24176/37963 [54:50:56<33:22:25,  8.71s/it]
 64%|██████▎   | 24177/37963 [54:51:04<32:33:32,  8.50s/it]
 64%|██████▎   | 24178/37963 [54:51:14<34:48:48,  9.09s/it]
 64%|██████▎   | 24179/37963 [54:51:22<33:22:39,  8.72s/it]
 64%|██████▎   | 24180/37963 [54:51:30<32:10:30,  8.40s/it]
                                                           
{'loss': '0.1347', 'grad_norm': '2.22', 'learning_rate': '6.153e-06', 'epoch': '0.6369'}
+
 64%|██████▎   | 24180/37963 [54:51:30<32:10:30,  8.40s/it]
 64%|██████▎   | 24181/37963 [54:51:37<31:21:31,  8.19s/it]
 64%|██████▎   | 24182/37963 [54:51:48<34:20:45,  8.97s/it]
 64%|██████▎   | 24183/37963 [54:51:56<33:22:04,  8.72s/it]
 64%|██████▎   | 24184/37963 [54:52:04<31:58:38,  8.35s/it]
 64%|██████▎   | 24185/37963 [54:52:12<31:29:50,  8.23s/it]
 64%|██████▎   | 24186/37963 [54:52:19<30:46:42,  8.04s/it]
 64%|██████▎   | 24187/37963 [54:52:27<30:32:04,  7.98s/it]
 64%|██████▎   | 24188/37963 [54:52:35<30:06:38,  7.87s/it]
 64%|██████▎   | 24189/37963 [54:52:43<30:04:54,  7.86s/it]
 64%|██████▎   | 24190/37963 [54:52:50<29:53:36,  7.81s/it]
                                                           
{'loss': '0.138', 'grad_norm': '2.891', 'learning_rate': '6.146e-06', 'epoch': '0.6372'}
+
 64%|██████▎   | 24190/37963 [54:52:50<29:53:36,  7.81s/it]
 64%|██████▎   | 24191/37963 [54:52:58<29:31:54,  7.72s/it]
 64%|██████▎   | 24192/37963 [54:53:06<29:57:53,  7.83s/it]
 64%|██████▎   | 24193/37963 [54:53:14<29:54:44,  7.82s/it]
 64%|██████▎   | 24194/37963 [54:53:22<29:59:35,  7.84s/it]
 64%|██████▎   | 24195/37963 [54:53:29<29:25:15,  7.69s/it]
 64%|██████▎   | 24196/37963 [54:53:37<29:32:55,  7.73s/it]
 64%|██████▎   | 24197/37963 [54:53:44<29:28:49,  7.71s/it]
 64%|██████▎   | 24198/37963 [54:53:52<29:12:29,  7.64s/it]
 64%|██████▎   | 24199/37963 [54:54:00<29:21:17,  7.68s/it]
 64%|██████▎   | 24200/37963 [54:54:07<29:37:26,  7.75s/it]
                                                           
{'loss': '0.1318', 'grad_norm': '2.726', 'learning_rate': '6.138e-06', 'epoch': '0.6375'}
+
 64%|██████▎   | 24200/37963 [54:54:07<29:37:26,  7.75s/it]
 64%|██████▎   | 24201/37963 [54:54:15<29:42:48,  7.77s/it]
 64%|██████▍   | 24202/37963 [54:54:23<29:36:45,  7.75s/it]
 64%|██████▍   | 24203/37963 [54:54:31<29:29:05,  7.71s/it]
 64%|██████▍   | 24204/37963 [54:54:38<29:17:29,  7.66s/it]
 64%|██████▍   | 24205/37963 [54:54:48<32:11:31,  8.42s/it]
 64%|██████▍   | 24206/37963 [54:54:59<35:00:38,  9.16s/it]
 64%|██████▍   | 24207/37963 [54:55:10<36:21:47,  9.52s/it]
 64%|██████▍   | 24208/37963 [54:55:17<33:56:24,  8.88s/it]
 64%|██████▍   | 24209/37963 [54:55:25<32:34:05,  8.52s/it]
 64%|██████▍   | 24210/37963 [54:55:32<31:37:01,  8.28s/it]
                                                           
{'loss': '0.1401', 'grad_norm': '2.903', 'learning_rate': '6.13e-06', 'epoch': '0.6377'}
+
 64%|██████▍   | 24210/37963 [54:55:32<31:37:01,  8.28s/it]
 64%|██████▍   | 24211/37963 [54:55:43<33:59:56,  8.90s/it]
 64%|██████▍   | 24212/37963 [54:55:51<32:48:30,  8.59s/it]
 64%|██████▍   | 24213/37963 [54:55:58<31:52:10,  8.34s/it]
 64%|██████▍   | 24214/37963 [54:56:06<31:12:13,  8.17s/it]
 64%|██████▍   | 24215/37963 [54:56:14<30:37:42,  8.02s/it]
 64%|██████▍   | 24216/37963 [54:56:21<30:11:24,  7.91s/it]
 64%|██████▍   | 24217/37963 [54:56:32<33:05:39,  8.67s/it]
 64%|██████▍   | 24218/37963 [54:56:40<32:13:01,  8.44s/it]
 64%|██████▍   | 24219/37963 [54:56:47<31:20:15,  8.21s/it]
 64%|██████▍   | 24220/37963 [54:56:55<30:58:47,  8.12s/it]
                                                           
{'loss': '0.1323', 'grad_norm': '3.239', 'learning_rate': '6.122e-06', 'epoch': '0.638'}
+
 64%|██████▍   | 24220/37963 [54:56:55<30:58:47,  8.12s/it]
 64%|██████▍   | 24221/37963 [54:57:03<30:38:21,  8.03s/it]
 64%|██████▍   | 24222/37963 [54:57:13<33:12:55,  8.70s/it]
 64%|██████▍   | 24223/37963 [54:57:21<32:02:40,  8.40s/it]
 64%|██████▍   | 24224/37963 [54:57:31<34:14:03,  8.97s/it]
 64%|██████▍   | 24225/37963 [54:57:39<32:56:46,  8.63s/it]
 64%|██████▍   | 24226/37963 [54:57:49<34:33:20,  9.06s/it]
 64%|██████▍   | 24227/37963 [54:57:57<32:57:55,  8.64s/it]
 64%|██████▍   | 24228/37963 [54:58:05<32:15:03,  8.45s/it]
 64%|██████▍   | 24229/37963 [54:58:13<31:11:55,  8.18s/it]
 64%|██████▍   | 24230/37963 [54:58:20<30:45:34,  8.06s/it]
                                                           
{'loss': '0.1474', 'grad_norm': '2.507', 'learning_rate': '6.114e-06', 'epoch': '0.6383'}
+
 64%|██████▍   | 24230/37963 [54:58:20<30:45:34,  8.06s/it]
 64%|██████▍   | 24231/37963 [54:58:28<30:29:47,  8.00s/it]
 64%|██████▍   | 24232/37963 [54:58:36<30:22:03,  7.96s/it]
 64%|██████▍   | 24233/37963 [54:58:44<30:12:22,  7.92s/it]
 64%|██████▍   | 24234/37963 [54:58:52<30:02:32,  7.88s/it]
 64%|██████▍   | 24235/37963 [54:59:00<29:57:38,  7.86s/it]
 64%|██████▍   | 24236/37963 [54:59:07<29:44:52,  7.80s/it]
 64%|██████▍   | 24237/37963 [54:59:15<29:26:24,  7.72s/it]
 64%|██████▍   | 24238/37963 [54:59:22<29:24:09,  7.71s/it]
 64%|██████▍   | 24239/37963 [54:59:30<29:31:33,  7.75s/it]
 64%|██████▍   | 24240/37963 [54:59:38<29:35:14,  7.76s/it]
                                                           
{'loss': '0.1326', 'grad_norm': '1.388', 'learning_rate': '6.106e-06', 'epoch': '0.6385'}
+
 64%|██████▍   | 24240/37963 [54:59:38<29:35:14,  7.76s/it]
 64%|██████▍   | 24241/37963 [54:59:45<29:14:51,  7.67s/it]
 64%|██████▍   | 24242/37963 [54:59:53<29:05:51,  7.63s/it]
 64%|██████▍   | 24243/37963 [55:00:00<28:50:08,  7.57s/it]
 64%|██████▍   | 24244/37963 [55:00:08<28:54:46,  7.59s/it]
 64%|██████▍   | 24245/37963 [55:00:16<29:06:34,  7.64s/it]
 64%|██████▍   | 24246/37963 [55:00:23<28:46:45,  7.55s/it]
 64%|██████▍   | 24247/37963 [55:00:31<28:32:20,  7.49s/it]
 64%|██████▍   | 24248/37963 [55:00:38<28:38:43,  7.52s/it]
 64%|██████▍   | 24249/37963 [55:00:46<28:45:13,  7.55s/it]
 64%|██████▍   | 24250/37963 [55:00:53<28:56:11,  7.60s/it]
                                                           
{'loss': '0.1459', 'grad_norm': '1.859', 'learning_rate': '6.098e-06', 'epoch': '0.6388'}
+
 64%|██████▍   | 24250/37963 [55:00:53<28:56:11,  7.60s/it]
 64%|██████▍   | 24251/37963 [55:01:04<32:22:49,  8.50s/it]
 64%|██████▍   | 24252/37963 [55:01:15<34:38:26,  9.10s/it]
 64%|██████▍   | 24253/37963 [55:01:22<32:55:17,  8.64s/it]
 64%|██████▍   | 24254/37963 [55:01:32<34:37:37,  9.09s/it]
 64%|██████▍   | 24255/37963 [55:01:40<33:15:11,  8.73s/it]
 64%|██████▍   | 24256/37963 [55:01:48<31:51:23,  8.37s/it]
 64%|██████▍   | 24257/37963 [55:01:55<31:10:42,  8.19s/it]
 64%|██████▍   | 24258/37963 [55:02:03<30:35:13,  8.03s/it]
 64%|██████▍   | 24259/37963 [55:02:11<30:18:59,  7.96s/it]
 64%|██████▍   | 24260/37963 [55:02:21<33:14:39,  8.73s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '1.456', 'learning_rate': '6.091e-06', 'epoch': '0.639'}
+
 64%|██████▍   | 24260/37963 [55:02:21<33:14:39,  8.73s/it]
 64%|██████▍   | 24261/37963 [55:02:30<32:29:23,  8.54s/it]
 64%|██████▍   | 24262/37963 [55:02:37<31:22:49,  8.25s/it]
 64%|██████▍   | 24263/37963 [55:02:45<30:35:01,  8.04s/it]
 64%|██████▍   | 24264/37963 [55:02:52<30:12:08,  7.94s/it]
 64%|██████▍   | 24265/37963 [55:03:03<32:56:18,  8.66s/it]
 64%|██████▍   | 24266/37963 [55:03:13<34:34:20,  9.09s/it]
 64%|██████▍   | 24267/37963 [55:03:21<33:11:45,  8.73s/it]
 64%|██████▍   | 24268/37963 [55:03:28<32:08:26,  8.45s/it]
 64%|██████▍   | 24269/37963 [55:03:36<31:18:50,  8.23s/it]
 64%|██████▍   | 24270/37963 [55:03:47<34:01:31,  8.95s/it]
                                                           
{'loss': '0.1469', 'grad_norm': '2.548', 'learning_rate': '6.083e-06', 'epoch': '0.6393'}
+
 64%|██████▍   | 24270/37963 [55:03:47<34:01:31,  8.95s/it]
 64%|██████▍   | 24271/37963 [55:03:55<32:45:02,  8.61s/it]
 64%|██████▍   | 24272/37963 [55:04:05<34:35:21,  9.10s/it]
 64%|██████▍   | 24273/37963 [55:04:13<33:12:09,  8.73s/it]
 64%|██████▍   | 24274/37963 [55:04:20<32:02:53,  8.43s/it]
 64%|██████▍   | 24275/37963 [55:04:28<31:00:45,  8.16s/it]
 64%|██████▍   | 24276/37963 [55:04:36<30:29:29,  8.02s/it]
 64%|██████▍   | 24277/37963 [55:04:43<30:15:16,  7.96s/it]
 64%|██████▍   | 24278/37963 [55:04:51<29:57:14,  7.88s/it]
 64%|██████▍   | 24279/37963 [55:04:59<29:33:11,  7.77s/it]
 64%|██████▍   | 24280/37963 [55:05:07<29:40:25,  7.81s/it]
                                                           
{'loss': '0.138', 'grad_norm': '1.392', 'learning_rate': '6.075e-06', 'epoch': '0.6396'}
+
 64%|██████▍   | 24280/37963 [55:05:07<29:40:25,  7.81s/it]
 64%|██████▍   | 24281/37963 [55:05:15<29:50:23,  7.85s/it]
 64%|██████▍   | 24282/37963 [55:05:22<29:39:16,  7.80s/it]
 64%|██████▍   | 24283/37963 [55:05:30<29:30:59,  7.77s/it]
 64%|██████▍   | 24284/37963 [55:05:38<29:34:00,  7.78s/it]
 64%|██████▍   | 24285/37963 [55:05:46<29:36:54,  7.79s/it]
 64%|██████▍   | 24286/37963 [55:05:53<29:26:18,  7.75s/it]
 64%|██████▍   | 24287/37963 [55:06:01<29:09:57,  7.68s/it]
 64%|██████▍   | 24288/37963 [55:06:08<29:05:23,  7.66s/it]
 64%|██████▍   | 24289/37963 [55:06:16<29:03:48,  7.65s/it]
 64%|██████▍   | 24290/37963 [55:06:24<29:05:25,  7.66s/it]
                                                           
{'loss': '0.1392', 'grad_norm': '1.197', 'learning_rate': '6.067e-06', 'epoch': '0.6398'}
+
 64%|██████▍   | 24290/37963 [55:06:24<29:05:25,  7.66s/it]
 64%|██████▍   | 24291/37963 [55:06:31<29:10:32,  7.68s/it]
 64%|██████▍   | 24292/37963 [55:06:39<29:18:01,  7.72s/it]
 64%|██████▍   | 24293/37963 [55:06:47<29:25:42,  7.75s/it]
 64%|██████▍   | 24294/37963 [55:06:55<29:36:56,  7.80s/it]
 64%|██████▍   | 24295/37963 [55:07:03<29:27:23,  7.76s/it]
 64%|██████▍   | 24296/37963 [55:07:11<29:38:26,  7.81s/it]
 64%|██████▍   | 24297/37963 [55:07:18<29:07:43,  7.67s/it]
 64%|██████▍   | 24298/37963 [55:07:26<29:05:55,  7.67s/it]
 64%|██████▍   | 24299/37963 [55:07:36<32:02:14,  8.44s/it]
 64%|██████▍   | 24300/37963 [55:07:44<31:26:43,  8.29s/it]
                                                           
{'loss': '0.1336', 'grad_norm': '1.781', 'learning_rate': '6.059e-06', 'epoch': '0.6401'}
+
 64%|██████▍   | 24300/37963 [55:07:44<31:26:43,  8.29s/it]
 64%|██████▍   | 24301/37963 [55:07:52<30:53:54,  8.14s/it]
 64%|██████▍   | 24302/37963 [55:07:59<30:30:56,  8.04s/it]
 64%|██████▍   | 24303/37963 [55:08:07<30:19:00,  7.99s/it]
 64%|██████▍   | 24304/37963 [55:08:18<33:17:59,  8.78s/it]
 64%|██████▍   | 24305/37963 [55:08:26<32:19:43,  8.52s/it]
 64%|██████▍   | 24306/37963 [55:08:34<31:30:01,  8.30s/it]
 64%|██████▍   | 24307/37963 [55:08:41<31:02:43,  8.18s/it]
 64%|██████▍   | 24308/37963 [55:08:52<33:28:09,  8.82s/it]
 64%|██████���   | 24309/37963 [55:08:59<32:15:24,  8.50s/it]
 64%|██████▍   | 24310/37963 [55:09:07<31:13:02,  8.23s/it]
                                                           
{'loss': '0.1275', 'grad_norm': '1.33', 'learning_rate': '6.051e-06', 'epoch': '0.6404'}
+
 64%|██████▍   | 24310/37963 [55:09:07<31:13:02,  8.23s/it]
 64%|██████▍   | 24311/37963 [55:09:15<30:50:37,  8.13s/it]
 64%|██████▍   | 24312/37963 [55:09:23<30:41:30,  8.09s/it]
 64%|██████▍   | 24313/37963 [55:09:34<33:32:15,  8.85s/it]
 64%|██████▍   | 24314/37963 [55:09:47<38:14:29, 10.09s/it]
 64%|██████▍   | 24315/37963 [55:09:55<35:55:06,  9.47s/it]
 64%|██████▍   | 24316/37963 [55:10:02<34:01:31,  8.98s/it]
 64%|██████▍   | 24317/37963 [55:10:13<35:19:35,  9.32s/it]
 64%|██████▍   | 24318/37963 [55:10:20<33:39:11,  8.88s/it]
 64%|██████▍   | 24319/37963 [55:10:28<32:16:07,  8.51s/it]
 64%|██████▍   | 24320/37963 [55:10:38<34:04:43,  8.99s/it]
                                                           
{'loss': '0.1451', 'grad_norm': '1.55', 'learning_rate': '6.043e-06', 'epoch': '0.6406'}
+
 64%|██████▍   | 24320/37963 [55:10:38<34:04:43,  8.99s/it]
 64%|██████▍   | 24321/37963 [55:10:46<32:49:55,  8.66s/it]
 64%|██████▍   | 24322/37963 [55:10:54<31:51:18,  8.41s/it]
 64%|██████▍   | 24323/37963 [55:11:01<30:49:46,  8.14s/it]
 64%|██████▍   | 24324/37963 [55:11:09<30:16:57,  7.99s/it]
 64%|██████▍   | 24325/37963 [55:11:17<30:10:58,  7.97s/it]
 64%|██████▍   | 24326/37963 [55:11:24<29:37:28,  7.82s/it]
 64%|██████▍   | 24327/37963 [55:11:32<29:32:37,  7.80s/it]
 64%|██████▍   | 24328/37963 [55:11:40<29:27:46,  7.78s/it]
 64%|██████▍   | 24329/37963 [55:11:48<29:20:38,  7.75s/it]
 64%|██████▍   | 24330/37963 [55:11:55<29:15:52,  7.73s/it]
                                                           
{'loss': '0.1341', 'grad_norm': '1.813', 'learning_rate': '6.036e-06', 'epoch': '0.6409'}
+
 64%|██████▍   | 24330/37963 [55:11:55<29:15:52,  7.73s/it]
 64%|██████▍   | 24331/37963 [55:12:03<29:16:42,  7.73s/it]
 64%|██████▍   | 24332/37963 [55:12:11<29:11:25,  7.71s/it]
 64%|██████▍   | 24333/37963 [55:12:18<29:06:26,  7.69s/it]
 64%|██████▍   | 24334/37963 [55:12:26<29:15:21,  7.73s/it]
 64%|██████▍   | 24335/37963 [55:12:34<29:07:18,  7.69s/it]
 64%|██████▍   | 24336/37963 [55:12:41<28:45:09,  7.60s/it]
 64%|██████▍   | 24337/37963 [55:12:49<28:54:31,  7.64s/it]
 64%|██████▍   | 24338/37963 [55:12:57<29:09:09,  7.70s/it]
 64%|██████▍   | 24339/37963 [55:13:04<28:35:54,  7.56s/it]
 64%|██████▍   | 24340/37963 [55:13:12<28:46:03,  7.60s/it]
                                                           
{'loss': '0.1428', 'grad_norm': '1.628', 'learning_rate': '6.028e-06', 'epoch': '0.6412'}
+
 64%|██████▍   | 24340/37963 [55:13:12<28:46:03,  7.60s/it]
 64%|██████▍   | 24341/37963 [55:13:19<28:48:48,  7.61s/it]
 64%|██████▍   | 24342/37963 [55:13:27<28:39:13,  7.57s/it]
 64%|██████▍   | 24343/37963 [55:13:34<28:43:53,  7.59s/it]
 64%|██████▍   | 24344/37963 [55:13:42<28:54:03,  7.64s/it]
 64%|██████▍   | 24345/37963 [55:13:49<28:28:46,  7.53s/it]
 64%|██████▍   | 24346/37963 [55:13:57<28:12:54,  7.46s/it]
 64%|██████▍   | 24347/37963 [55:14:04<28:16:09,  7.47s/it]
 64%|██████▍   | 24348/37963 [55:14:12<28:34:46,  7.56s/it]
 64%|██████▍   | 24349/37963 [55:14:20<28:39:51,  7.58s/it]
 64%|██████▍   | 24350/37963 [55:14:27<28:52:33,  7.64s/it]
                                                           
{'loss': '0.1378', 'grad_norm': '1.952', 'learning_rate': '6.02e-06', 'epoch': '0.6414'}
+
 64%|██████▍   | 24350/37963 [55:14:27<28:52:33,  7.64s/it]
 64%|██████▍   | 24351/37963 [55:14:35<28:47:23,  7.61s/it]
 64%|██████▍   | 24352/37963 [55:14:43<28:47:08,  7.61s/it]
 64%|██████▍   | 24353/37963 [55:14:58<38:12:28, 10.11s/it]
 64%|██████▍   | 24354/37963 [55:15:07<35:52:59,  9.49s/it]
 64%|██████▍   | 24355/37963 [55:15:14<33:48:20,  8.94s/it]
 64%|██████▍   | 24356/37963 [55:15:22<32:21:19,  8.56s/it]
 64%|██████▍   | 24357/37963 [55:15:30<31:26:18,  8.32s/it]
 64%|██████▍   | 24358/37963 [55:15:40<34:01:24,  9.00s/it]
 64%|██████▍   | 24359/37963 [55:15:48<32:44:59,  8.67s/it]
 64%|██████▍   | 24360/37963 [55:15:56<31:26:00,  8.32s/it]
                                                           
{'loss': '0.1405', 'grad_norm': '1.728', 'learning_rate': '6.012e-06', 'epoch': '0.6417'}
+
 64%|██████▍   | 24360/37963 [55:15:56<31:26:00,  8.32s/it]
 64%|██████▍   | 24361/37963 [55:16:03<30:10:02,  7.98s/it]
 64%|██████▍   | 24362/37963 [55:16:15<35:23:12,  9.37s/it]
 64%|██████▍   | 24363/37963 [55:16:23<33:46:08,  8.94s/it]
 64%|██████▍   | 24364/37963 [55:16:34<35:25:08,  9.38s/it]
 64%|██████▍   | 24365/37963 [55:16:41<33:06:36,  8.77s/it]
 64%|██████▍   | 24366/37963 [55:16:49<31:52:30,  8.44s/it]
 64%|██████▍   | 24367/37963 [55:16:59<34:13:33,  9.06s/it]
 64%|██████▍   | 24368/37963 [55:17:07<32:45:47,  8.68s/it]
 64%|██████▍   | 24369/37963 [55:17:15<31:28:26,  8.34s/it]
 64%|██████▍   | 24370/37963 [55:17:22<30:42:13,  8.13s/it]
                                                           
{'loss': '0.1227', 'grad_norm': '2.416', 'learning_rate': '6.004e-06', 'epoch': '0.6419'}
+
 64%|██████▍   | 24370/37963 [55:17:22<30:42:13,  8.13s/it]
 64%|██████▍   | 24371/37963 [55:17:30<30:16:21,  8.02s/it]
 64%|██████▍   | 24372/37963 [55:17:38<30:14:54,  8.01s/it]
 64%|██████▍   | 24373/37963 [55:17:46<30:03:02,  7.96s/it]
 64%|██████▍   | 24374/37963 [55:17:53<29:25:51,  7.80s/it]
 64%|██████▍   | 24375/37963 [55:18:01<29:21:20,  7.78s/it]
 64%|██████▍   | 24376/37963 [55:18:09<29:41:30,  7.87s/it]
 64%|██████▍   | 24377/37963 [55:18:17<29:28:44,  7.81s/it]
 64%|██████▍   | 24378/37963 [55:18:25<29:30:42,  7.82s/it]
 64%|██████▍   | 24379/37963 [55:18:32<29:30:23,  7.82s/it]
 64%|██████▍   | 24380/37963 [55:18:40<29:30:04,  7.82s/it]
                                                           
{'loss': '0.1366', 'grad_norm': '2.926', 'learning_rate': '5.997e-06', 'epoch': '0.6422'}
+
 64%|██████▍   | 24380/37963 [55:18:40<29:30:04,  7.82s/it]
 64%|██████▍   | 24381/37963 [55:18:48<29:18:47,  7.77s/it]
 64%|██████▍   | 24382/37963 [55:18:56<29:19:59,  7.78s/it]
 64%|██████▍   | 24383/37963 [55:19:04<29:37:47,  7.85s/it]
 64%|██████▍   | 24384/37963 [55:19:11<29:21:43,  7.78s/it]
 64%|██████▍   | 24385/37963 [55:19:19<28:43:46,  7.62s/it]
 64%|██████▍   | 24386/37963 [55:19:26<28:48:30,  7.64s/it]
 64%|██████▍   | 24387/37963 [55:19:34<28:51:29,  7.65s/it]
 64%|██████▍   | 24388/37963 [55:19:42<28:48:17,  7.64s/it]
 64%|██████▍   | 24389/37963 [55:19:49<28:24:41,  7.54s/it]
 64%|██████▍   | 24390/37963 [55:19:56<28:34:27,  7.58s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '1.368', 'learning_rate': '5.989e-06', 'epoch': '0.6425'}
+
 64%|██████▍   | 24390/37963 [55:19:56<28:34:27,  7.58s/it]
 64%|██████▍   | 24391/37963 [55:20:04<28:48:09,  7.64s/it]
 64%|██████▍   | 24392/37963 [55:20:12<29:03:30,  7.71s/it]
 64%|██████▍   | 24393/37963 [55:20:20<28:43:09,  7.62s/it]
 64%|██████▍   | 24394/37963 [55:20:27<28:43:09,  7.62s/it]
 64%|██████▍   | 24395/37963 [55:20:35<28:44:20,  7.63s/it]
 64%|██████▍   | 24396/37963 [55:20:42<28:44:10,  7.63s/it]
 64%|██████▍   | 24397/37963 [55:20:50<28:52:08,  7.66s/it]
 64%|██████▍   | 24398/37963 [55:20:58<28:48:13,  7.64s/it]
 64%|██████▍   | 24399/37963 [55:21:06<29:04:52,  7.72s/it]
 64%|██████▍   | 24400/37963 [55:21:13<28:59:23,  7.69s/it]
                                                           
{'loss': '0.1393', 'grad_norm': '1.581', 'learning_rate': '5.981e-06', 'epoch': '0.6427'}
+
 64%|██████▍   | 24400/37963 [55:21:13<28:59:23,  7.69s/it]
 64%|██████▍   | 24401/37963 [55:21:24<31:50:35,  8.45s/it]
 64%|██████▍   | 24402/37963 [55:21:34<34:01:40,  9.03s/it]
 64%|██████▍   | 24403/37963 [55:21:42<32:31:35,  8.64s/it]
 64%|██████▍   | 24404/37963 [55:21:49<31:33:36,  8.38s/it]
 64%|██████▍   | 24405/37963 [55:21:57<30:57:18,  8.22s/it]
 64%|██████▍   | 24406/37963 [55:22:08<33:33:47,  8.91s/it]
 64%|██████▍   | 24407/37963 [55:22:18<35:11:16,  9.34s/it]
 64%|██████▍   | 24408/37963 [55:22:26<33:38:32,  8.93s/it]
 64%|██████▍   | 24409/37963 [55:22:34<32:08:53,  8.54s/it]
 64%|██████▍   | 24410/37963 [55:22:42<31:24:41,  8.34s/it]
                                                           
{'loss': '0.1484', 'grad_norm': '2.181', 'learning_rate': '5.973e-06', 'epoch': '0.643'}
+
 64%|██████▍   | 24410/37963 [55:22:42<31:24:41,  8.34s/it]
 64%|██████▍   | 24411/37963 [55:22:49<30:41:49,  8.15s/it]
 64%|██████▍   | 24412/37963 [55:23:00<33:02:45,  8.78s/it]
 64%|██████▍   | 24413/37963 [55:23:10<34:25:36,  9.15s/it]
 64%|██���███▍   | 24414/37963 [55:23:17<32:41:45,  8.69s/it]
 64%|██████▍   | 24415/37963 [55:23:25<31:36:11,  8.40s/it]
 64%|██████▍   | 24416/37963 [55:23:36<34:06:18,  9.06s/it]
 64%|██████▍   | 24417/37963 [55:23:43<32:30:04,  8.64s/it]
 64%|██████▍   | 24418/37963 [55:23:54<34:25:01,  9.15s/it]
 64%|██████▍   | 24419/37963 [55:24:01<32:46:48,  8.71s/it]
 64%|██████▍   | 24420/37963 [55:24:09<31:34:07,  8.39s/it]
                                                           
{'loss': '0.1252', 'grad_norm': '3.973', 'learning_rate': '5.965e-06', 'epoch': '0.6433'}
+
 64%|██████▍   | 24420/37963 [55:24:09<31:34:07,  8.39s/it]
 64%|██████▍   | 24421/37963 [55:24:17<30:49:59,  8.20s/it]
 64%|██████▍   | 24422/37963 [55:24:25<30:32:24,  8.12s/it]
 64%|██████▍   | 24423/37963 [55:24:32<30:19:43,  8.06s/it]
 64%|██████▍   | 24424/37963 [55:24:40<30:04:02,  7.99s/it]
 64%|██████▍   | 24425/37963 [55:24:48<29:53:08,  7.95s/it]
 64%|██████▍   | 24426/37963 [55:24:56<29:44:34,  7.91s/it]
 64%|██████▍   | 24427/37963 [55:25:04<29:34:59,  7.87s/it]
 64%|██████▍   | 24428/37963 [55:25:11<28:57:41,  7.70s/it]
 64%|██████▍   | 24429/37963 [55:25:19<29:03:02,  7.73s/it]
 64%|██████▍   | 24430/37963 [55:25:26<28:39:26,  7.62s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '1.985', 'learning_rate': '5.957e-06', 'epoch': '0.6435'}
+
 64%|██████▍   | 24430/37963 [55:25:26<28:39:26,  7.62s/it]
 64%|██████▍   | 24431/37963 [55:25:34<28:59:54,  7.71s/it]
 64%|██████▍   | 24432/37963 [55:25:42<29:07:13,  7.75s/it]
 64%|██████▍   | 24433/37963 [55:25:50<29:25:08,  7.83s/it]
 64%|██████▍   | 24434/37963 [55:25:58<29:13:37,  7.78s/it]
 64%|██████▍   | 24435/37963 [55:26:05<29:16:30,  7.79s/it]
 64%|██████▍   | 24436/37963 [55:26:13<29:13:25,  7.78s/it]
 64%|██████▍   | 24437/37963 [55:26:21<29:09:47,  7.76s/it]
 64%|██████▍   | 24438/37963 [55:26:28<28:39:44,  7.63s/it]
 64%|██████▍   | 24439/37963 [55:26:36<28:35:43,  7.61s/it]
 64%|██████▍   | 24440/37963 [55:26:43<28:14:17,  7.52s/it]
                                                           
{'loss': '0.1406', 'grad_norm': '2.926', 'learning_rate': '5.95e-06', 'epoch': '0.6438'}
+
 64%|██████▍   | 24440/37963 [55:26:43<28:14:17,  7.52s/it]
 64%|██████▍   | 24441/37963 [55:26:51<28:22:20,  7.55s/it]
 64%|██████▍   | 24442/37963 [55:26:59<28:36:29,  7.62s/it]
 64%|██████▍   | 24443/37963 [55:27:06<28:51:10,  7.68s/it]
 64%|██████▍   | 24444/37963 [55:27:14<28:44:49,  7.66s/it]
 64%|██████▍   | 24445/37963 [55:27:22<28:54:47,  7.70s/it]
 64%|██████▍   | 24446/37963 [55:27:29<28:55:26,  7.70s/it]
 64%|██████▍   | 24447/37963 [55:27:37<29:07:21,  7.76s/it]
 64%|██████▍   | 24448/37963 [55:27:48<32:17:15,  8.60s/it]
 64%|██████▍   | 24449/37963 [55:27:58<34:00:59,  9.06s/it]
 64%|██████▍   | 24450/37963 [55:28:06<32:30:07,  8.66s/it]
                                                           
{'loss': '0.1373', 'grad_norm': '2.166', 'learning_rate': '5.942e-06', 'epoch': '0.6441'}
+
 64%|██████▍   | 24450/37963 [55:28:06<32:30:07,  8.66s/it]
 64%|██████▍   | 24451/37963 [55:28:14<31:34:01,  8.41s/it]
 64%|██████▍   | 24452/37963 [55:28:21<30:27:59,  8.12s/it]
 64%|██████▍   | 24453/37963 [55:28:29<29:55:52,  7.98s/it]
 64%|██████▍   | 24454/37963 [55:28:39<32:40:50,  8.71s/it]
 64%|██████▍   | 24455/37963 [55:28:47<31:36:44,  8.42s/it]
 64%|██████▍   | 24456/37963 [55:28:54<30:34:51,  8.15s/it]
 64%|██████▍   | 24457/37963 [55:29:02<30:19:16,  8.08s/it]
 64%|██████▍   | 24458/37963 [55:29:10<29:53:09,  7.97s/it]
 64%|██████▍   | 24459/37963 [55:29:18<29:40:12,  7.91s/it]
 64%|██████▍   | 24460/37963 [55:29:25<29:13:28,  7.79s/it]
                                                           
{'loss': '0.145', 'grad_norm': '1.494', 'learning_rate': '5.934e-06', 'epoch': '0.6443'}
+
 64%|██████▍   | 24460/37963 [55:29:25<29:13:28,  7.79s/it]
 64%|██████▍   | 24461/37963 [55:29:41<37:53:07, 10.10s/it]
 64%|██████▍   | 24462/37963 [55:29:49<35:20:55,  9.43s/it]
 64%|██████▍   | 24463/37963 [55:29:57<33:36:51,  8.96s/it]
 64%|██████▍   | 24464/37963 [55:30:07<35:38:30,  9.51s/it]
 64%|██████▍   | 24465/37963 [55:30:15<33:45:30,  9.00s/it]
 64%|██████▍   | 24466/37963 [55:30:23<32:14:50,  8.60s/it]
 64%|██████▍   | 24467/37963 [55:30:31<31:29:15,  8.40s/it]
 64%|██████▍   | 24468/37963 [55:30:39<30:53:04,  8.24s/it]
 64%|██████▍   | 24469/37963 [55:30:46<30:13:41,  8.06s/it]
 64%|██████▍   | 24470/37963 [55:30:54<29:57:49,  7.99s/it]
                                                           
{'loss': '0.1472', 'grad_norm': '2.263', 'learning_rate': '5.926e-06', 'epoch': '0.6446'}
+
 64%|██████▍   | 24470/37963 [55:30:54<29:57:49,  7.99s/it]
 64%|██████▍   | 24471/37963 [55:31:02<29:31:48,  7.88s/it]
 64%|██████▍   | 24472/37963 [55:31:12<32:10:45,  8.59s/it]
 64%|██████▍   | 24473/37963 [55:31:20<31:30:00,  8.41s/it]
 64%|██████▍   | 24474/37963 [55:31:28<30:41:46,  8.19s/it]
 64%|██████▍   | 24475/37963 [55:31:35<30:15:04,  8.07s/it]
 64%|██████▍   | 24476/37963 [55:31:43<29:44:56,  7.94s/it]
 64%|██████▍   | 24477/37963 [55:31:51<29:37:13,  7.91s/it]
 64%|██████▍   | 24478/37963 [55:31:58<29:19:15,  7.83s/it]
 64%|██████▍   | 24479/37963 [55:32:06<29:14:19,  7.81s/it]
 64%|██████▍   | 24480/37963 [55:32:14<29:10:43,  7.79s/it]
                                                           
{'loss': '0.1354', 'grad_norm': '2.753', 'learning_rate': '5.919e-06', 'epoch': '0.6448'}
+
 64%|██████▍   | 24480/37963 [55:32:14<29:10:43,  7.79s/it]
 64%|██████▍   | 24481/37963 [55:32:22<29:01:27,  7.75s/it]
 64%|██████▍   | 24482/37963 [55:32:30<29:28:19,  7.87s/it]
 64%|██████▍   | 24483/37963 [55:32:37<29:08:13,  7.78s/it]
 64%|██████▍   | 24484/37963 [55:32:45<29:23:34,  7.85s/it]
 64%|██████▍   | 24485/37963 [55:32:53<29:25:14,  7.86s/it]
 64%|██████▍   | 24486/37963 [55:33:01<29:10:54,  7.80s/it]
 65%|██████▍   | 24487/37963 [55:33:09<29:16:56,  7.82s/it]
 65%|██████▍   | 24488/37963 [55:33:17<29:10:22,  7.79s/it]
 65%|██████▍   | 24489/37963 [55:33:24<29:15:10,  7.82s/it]
 65%|██████▍   | 24490/37963 [55:33:32<28:57:45,  7.74s/it]
                                                           
{'loss': '0.146', 'grad_norm': '2.926', 'learning_rate': '5.911e-06', 'epoch': '0.6451'}
+
 65%|██████▍   | 24490/37963 [55:33:32<28:57:45,  7.74s/it]
 65%|██████▍   | 24491/37963 [55:33:39<28:40:11,  7.66s/it]
 65%|██████▍   | 24492/37963 [55:33:47<28:38:12,  7.65s/it]
 65%|██████▍   | 24493/37963 [55:33:55<28:39:43,  7.66s/it]
 65%|██████▍   | 24494/37963 [55:34:02<28:45:09,  7.68s/it]
 65%|██████▍   | 24495/37963 [55:34:10<28:46:26,  7.69s/it]
 65%|██████▍   | 24496/37963 [55:34:18<28:38:33,  7.66s/it]
 65%|██████▍   | 24497/37963 [55:34:25<28:38:42,  7.66s/it]
 65%|██████▍   | 24498/37963 [55:34:36<31:54:59,  8.53s/it]
 65%|██████▍   | 24499/37963 [55:34:44<31:07:14,  8.32s/it]
 65%|██████▍   | 24500/37963 [55:34:54<33:17:05,  8.90s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '3.119', 'learning_rate': '5.903e-06', 'epoch': '0.6454'}
+
 65%|██████▍   | 24500/37963 [55:34:54<33:17:05,  8.90s/it]
 65%|██████▍   | 24501/37963 [55:35:02<31:52:08,  8.52s/it]
 65%|██████▍   | 24502/37963 [55:35:12<34:07:33,  9.13s/it]
 65%|██████▍   | 24503/37963 [55:35:20<32:38:10,  8.73s/it]
 65%|██████▍   | 24504/37963 [55:35:28<31:41:16,  8.48s/it]
 65%|██████▍   | 24505/37963 [55:35:38<33:56:40,  9.08s/it]
 65%|██████▍   | 24506/37963 [55:35:46<32:42:29,  8.75s/it]
 65%|██████▍   | 24507/37963 [55:35:54<31:37:40,  8.46s/it]
 65%|██████▍   | 24508/37963 [55:36:02<31:12:39,  8.35s/it]
 65%|██████▍   | 24509/37963 [55:36:13<33:43:25,  9.02s/it]
 65%|██████▍   | 24510/37963 [55:36:20<31:49:41,  8.52s/it]
                                                           
{'loss': '0.1269', 'grad_norm': '1.068', 'learning_rate': '5.895e-06', 'epoch': '0.6456'}
+
 65%|██████▍   | 24510/37963 [55:36:20<31:49:41,  8.52s/it]
 65%|██████▍   | 24511/37963 [55:36:28<30:55:41,  8.28s/it]
 65%|██████▍   | 24512/37963 [55:36:38<33:27:05,  8.95s/it]
 65%|██████▍   | 24513/37963 [55:36:46<32:07:57,  8.60s/it]
 65%|██████▍   | 24514/37963 [55:36:54<31:27:28,  8.42s/it]
 65%|██████▍   | 24515/37963 [55:37:04<33:29:28,  8.97s/it]
 65%|██████▍   | 24516/37963 [55:37:12<32:07:20,  8.60s/it]
 65%|██████▍   | 24517/37963 [55:37:20<31:18:53,  8.38s/it]
 65%|██████▍   | 24518/37963 [55:37:28<30:40:08,  8.21s/it]
 65%|██████▍   | 24519/37963 [55:37:36<30:20:46,  8.13s/it]
 65%|██████▍   | 24520/37963 [55:37:46<32:45:55,  8.77s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '1.976', 'learning_rate': '5.887e-06', 'epoch': '0.6459'}
+
 65%|██████▍   | 24520/37963 [55:37:46<32:45:55,  8.77s/it]
 65%|██████▍   | 24521/37963 [55:37:54<31:44:25,  8.50s/it]
 65%|██████▍   | 24522/37963 [55:38:02<31:03:43,  8.32s/it]
 65%|██████▍   | 24523/37963 [55:38:10<30:35:02,  8.19s/it]
 65%|██████▍   | 24524/37963 [55:38:17<29:55:13,  8.01s/it]
 65%|██████▍   | 24525/37963 [55:38:25<29:52:09,  8.00s/it]
 65%|██████▍   | 24526/37963 [55:38:33<29:40:24,  7.95s/it]
 65%|██████▍   | 24527/37963 [55:38:41<29:25:05,  7.88s/it]
 65%|██████▍   | 24528/37963 [55:38:49<29:26:43,  7.89s/it]
 65%|██████▍   | 24529/37963 [55:38:57<29:24:24,  7.88s/it]
 65%|██████▍   | 24530/37963 [55:39:04<28:57:06,  7.76s/it]
                                                           
{'loss': '0.1345', 'grad_norm': '2.501', 'learning_rate': '5.88e-06', 'epoch': '0.6462'}
+
 65%|██████▍   | 24530/37963 [55:39:04<28:57:06,  7.76s/it]
 65%|██████▍   | 24531/37963 [55:39:12<28:49:12,  7.72s/it]
 65%|██████▍   | 24532/37963 [55:39:19<28:46:11,  7.71s/it]
 65%|██████▍   | 24533/37963 [55:39:27<28:59:05,  7.77s/it]
 65%|██████▍   | 24534/37963 [55:39:35<29:05:04,  7.80s/it]
 65%|██████▍   | 24535/37963 [55:39:43<28:43:39,  7.70s/it]
 65%|██████▍   | 24536/37963 [55:39:50<28:41:29,  7.69s/it]
 65%|██████▍   | 24537/37963 [55:39:58<28:53:37,  7.75s/it]
 65%|██████▍   | 24538/37963 [55:40:06<28:43:32,  7.70s/it]
 65%|██████▍   | 24539/37963 [55:40:14<28:54:13,  7.75s/it]
 65%|██████▍   | 24540/37963 [55:40:22<29:02:43,  7.79s/it]
                                                           
{'loss': '0.1454', 'grad_norm': '2.763', 'learning_rate': '5.872e-06', 'epoch': '0.6464'}
+
 65%|██████▍   | 24540/37963 [55:40:22<29:02:43,  7.79s/it]
 65%|██████▍   | 24541/37963 [55:40:30<29:17:24,  7.86s/it]
 65%|██████▍   | 24542/37963 [55:40:37<29:16:19,  7.85s/it]
 65%|██████▍   | 24543/37963 [55:40:45<29:17:44,  7.86s/it]
 65%|██████▍   | 24544/37963 [55:40:53<28:47:45,  7.73s/it]
 65%|██████▍   | 24545/37963 [55:41:03<31:35:56,  8.48s/it]
 65%|██████▍   | 24546/37963 [55:41:13<33:41:30,  9.04s/it]
 65%|██████▍   | 24547/37963 [55:41:21<32:04:52,  8.61s/it]
 65%|██████▍   | 24548/37963 [55:41:29<31:08:06,  8.36s/it]
 65%|██████▍   | 24549/37963 [55:41:36<30:24:55,  8.16s/it]
 65%|██████▍   | 24550/37963 [55:41:44<30:00:48,  8.06s/it]
                                                           
{'loss': '0.1337', 'grad_norm': '2.32', 'learning_rate': '5.864e-06', 'epoch': '0.6467'}
+
 65%|██████▍   | 24550/37963 [55:41:44<30:00:48,  8.06s/it]
 65%|██████▍   | 24551/37963 [55:41:52<29:34:38,  7.94s/it]
 65%|██████▍   | 24552/37963 [55:42:00<29:18:09,  7.87s/it]
 65%|██████▍   | 24553/37963 [55:42:10<31:53:58,  8.56s/it]
 65%|██████▍   | 24554/37963 [55:42:18<30:59:40,  8.32s/it]
 65%|██████▍   | 24555/37963 [55:42:25<30:16:34,  8.13s/it]
 65%|██████▍   | 24556/37963 [55:42:39<36:18:24,  9.75s/it]
 65%|██████▍   | 24557/37963 [55:42:47<34:15:08,  9.20s/it]
 65%|██████▍   | 24558/37963 [55:42:57<35:34:37,  9.55s/it]
 65%|██████▍   | 24559/37963 [55:43:07<36:26:54,  9.79s/it]
 65%|██████▍   | 24560/37963 [55:43:15<34:32:11,  9.28s/it]
                                                           
{'loss': '0.129', 'grad_norm': '1.148', 'learning_rate': '5.856e-06', 'epoch': '0.6469'}
+
 65%|██████▍   | 24560/37963 [55:43:15<34:32:11,  9.28s/it]
 65%|██████▍   | 24561/37963 [55:43:23<32:39:41,  8.77s/it]
 65%|██████▍   | 24562/37963 [55:43:31<31:42:29,  8.52s/it]
 65%|██████▍   | 24563/37963 [55:43:39<30:40:20,  8.24s/it]
 65%|██████▍   | 24564/37963 [55:43:46<29:45:33,  8.00s/it]
 65%|██████▍   | 24565/37963 [55:43:54<29:27:01,  7.91s/it]
 65%|██████▍   | 24566/37963 [55:44:01<29:03:50,  7.81s/it]
 65%|██████▍   | 24567/37963 [55:44:09<28:59:26,  7.79s/it]
 65%|██████▍   | 24568/37963 [55:44:19<31:39:07,  8.51s/it]
 65%|██████▍   | 24569/37963 [55:44:27<31:06:36,  8.36s/it]
 65%|██████▍   | 24570/37963 [55:44:35<30:43:22,  8.26s/it]
                                                           
{'loss': '0.1413', 'grad_norm': '2.897', 'learning_rate': '5.849e-06', 'epoch': '0.6472'}
+
 65%|██████▍   | 24570/37963 [55:44:35<30:43:22,  8.26s/it]
 65%|██████▍   | 24571/37963 [55:44:43<29:54:35,  8.04s/it]
 65%|██████▍   | 24572/37963 [55:44:51<29:44:47,  8.00s/it]
 65%|██████▍   | 24573/37963 [55:44:59<29:47:32,  8.01s/it]
 65%|██████▍   | 24574/37963 [55:45:06<29:28:09,  7.92s/it]
 65%|██████▍   | 24575/37963 [55:45:14<29:17:20,  7.88s/it]
 65%|██████▍   | 24576/37963 [55:45:22<29:19:29,  7.89s/it]
 65%|██████▍   | 24577/37963 [55:45:30<29:03:05,  7.81s/it]
 65%|██████▍   | 24578/37963 [55:45:38<29:11:43,  7.85s/it]
 65%|██████▍   | 24579/37963 [55:45:45<28:52:42,  7.77s/it]
 65%|██████▍   | 24580/37963 [55:45:53<28:50:00,  7.76s/it]
                                                           
{'loss': '0.1364', 'grad_norm': '2.361', 'learning_rate': '5.841e-06', 'epoch': '0.6475'}
+
 65%|██████▍   | 24580/37963 [55:45:53<28:50:00,  7.76s/it]
 65%|██████▍   | 24581/37963 [55:46:01<29:01:22,  7.81s/it]
 65%|██████▍   | 24582/37963 [55:46:09<29:10:30,  7.85s/it]
 65%|██████▍   | 24583/37963 [55:46:17<29:08:26,  7.84s/it]
 65%|██████▍   | 24584/37963 [55:46:25<29:21:36,  7.90s/it]
 65%|██████▍   | 24585/37963 [55:46:32<28:52:13,  7.77s/it]
 65%|██████▍   | 24586/37963 [55:46:40<28:37:23,  7.70s/it]
 65%|██████▍   | 24587/37963 [55:46:48<28:48:35,  7.75s/it]
 65%|██████▍   | 24588/37963 [55:46:55<28:40:29,  7.72s/it]
 65%|██████▍   | 24589/37963 [55:47:06<31:46:57,  8.56s/it]
 65%|██████▍   | 24590/37963 [55:47:14<30:54:25,  8.32s/it]
                                                           
{'loss': '0.1308', 'grad_norm': '2.541', 'learning_rate': '5.833e-06', 'epoch': '0.6477'}
+
 65%|██████▍   | 24590/37963 [55:47:14<30:54:25,  8.32s/it]
 65%|██████▍   | 24591/37963 [55:47:21<30:18:16,  8.16s/it]
 65%|██████▍   | 24592/37963 [55:47:29<29:59:03,  8.07s/it]
 65%|██████▍   | 24593/37963 [55:47:37<29:16:28,  7.88s/it]
 65%|██████▍   | 24594/37963 [55:47:44<29:14:32,  7.87s/it]
 65%|██████▍   | 24595/37963 [55:47:52<29:09:25,  7.85s/it]
 65%|██████▍   | 24596/37963 [55:48:03<32:13:44,  8.68s/it]
 65%|██████▍   | 24597/37963 [55:48:11<31:10:33,  8.40s/it]
 65%|██████▍   | 24598/37963 [55:48:18<30:25:24,  8.19s/it]
 65%|██████▍   | 24599/37963 [55:48:26<30:02:42,  8.09s/it]
 65%|██████▍   | 24600/37963 [55:48:40<36:11:12,  9.75s/it]
                                                           
{'loss': '0.1313', 'grad_norm': '1.92', 'learning_rate': '5.825e-06', 'epoch': '0.648'}
+
 65%|██████▍   | 24600/37963 [55:48:40<36:11:12,  9.75s/it]
 65%|██████▍   | 24601/37963 [55:48:50<36:39:32,  9.88s/it]
 65%|██████▍   | 24602/37963 [55:48:58<34:33:37,  9.31s/it]
 65%|██████▍   | 24603/37963 [55:49:06<32:47:53,  8.84s/it]
 65%|██████▍   | 24604/37963 [55:49:13<31:29:18,  8.49s/it]
 65%|██████▍   | 24605/37963 [55:49:21<30:31:29,  8.23s/it]
 65%|██████▍   | 24606/37963 [55:49:29<30:09:13,  8.13s/it]
 65%|██████▍   | 24607/37963 [55:49:39<32:11:50,  8.68s/it]
 65%|██████▍   | 24608/37963 [55:49:47<31:21:51,  8.45s/it]
 65%|██████▍   | 24609/37963 [55:49:55<30:31:13,  8.23s/it]
 65%|██████▍   | 24610/37963 [55:50:02<29:38:03,  7.99s/it]
                                                           
{'loss': '0.1408', 'grad_norm': '3.186', 'learning_rate': '5.818e-06', 'epoch': '0.6483'}
+
 65%|██████▍   | 24610/37963 [55:50:02<29:38:03,  7.99s/it]
 65%|██████▍   | 24611/37963 [55:50:13<32:42:11,  8.82s/it]
 65%|██████▍   | 24612/37963 [55:50:20<31:29:02,  8.49s/it]
 65%|██████▍   | 24613/37963 [55:50:28<30:48:07,  8.31s/it]
 65%|██████▍   | 24614/37963 [55:50:36<30:24:51,  8.20s/it]
 65%|██████▍   | 24615/37963 [55:50:44<29:51:39,  8.05s/it]
 65%|██████▍   | 24616/37963 [55:50:54<32:20:39,  8.72s/it]
 65%|██████▍   | 24617/37963 [55:51:02<31:20:29,  8.45s/it]
 65%|██████▍   | 24618/37963 [55:51:10<30:32:10,  8.24s/it]
 65%|██████▍   | 24619/37963 [55:51:17<29:54:25,  8.07s/it]
 65%|██████▍   | 24620/37963 [55:51:25<29:38:01,  8.00s/it]
                                                           
{'loss': '0.1364', 'grad_norm': '2.053', 'learning_rate': '5.81e-06', 'epoch': '0.6485'}
+
 65%|██████▍   | 24620/37963 [55:51:25<29:38:01,  8.00s/it]
 65%|██████▍   | 24621/37963 [55:51:33<29:18:49,  7.91s/it]
 65%|██████▍   | 24622/37963 [55:51:41<29:06:28,  7.85s/it]
 65%|██████▍   | 24623/37963 [55:51:49<29:08:39,  7.87s/it]
 65%|██████▍   | 24624/37963 [55:51:56<28:45:43,  7.76s/it]
 65%|██████▍   | 24625/37963 [55:52:04<28:44:58,  7.76s/it]
 65%|██████▍   | 24626/37963 [55:52:11<28:24:26,  7.67s/it]
 65%|██████▍   | 24627/37963 [55:52:19<28:27:46,  7.68s/it]
 65%|██████▍   | 24628/37963 [55:52:27<28:27:50,  7.68s/it]
 65%|██████▍   | 24629/37963 [55:52:34<28:08:37,  7.60s/it]
 65%|██████▍   | 24630/37963 [55:52:42<28:44:12,  7.76s/it]
                                                           
{'loss': '0.1339', 'grad_norm': '2.918', 'learning_rate': '5.802e-06', 'epoch': '0.6488'}
+
 65%|██████▍   | 24630/37963 [55:52:42<28:44:12,  7.76s/it]
 65%|██████▍   | 24631/37963 [55:52:50<28:36:07,  7.72s/it]
 65%|██████▍   | 24632/37963 [55:53:00<31:37:01,  8.54s/it]
 65%|██████▍   | 24633/37963 [55:53:08<30:58:59,  8.37s/it]
 65%|██████▍   | 24634/37963 [55:53:16<30:00:58,  8.11s/it]
 65%|██████▍   | 24635/37963 [55:53:24<29:39:09,  8.01s/it]
 65%|██████▍   | 24636/37963 [55:53:31<29:21:10,  7.93s/it]
 65%|██████▍   | 24637/37963 [55:53:39<29:02:16,  7.84s/it]
 65%|██████▍   | 24638/37963 [55:53:47<29:06:08,  7.86s/it]
 65%|██████▍   | 24639/37963 [55:53:55<28:55:12,  7.81s/it]
 65%|██████▍   | 24640/37963 [55:54:02<28:59:34,  7.83s/it]
                                                           
{'loss': '0.1427', 'grad_norm': '2.311', 'learning_rate': '5.794e-06', 'epoch': '0.6491'}
+
 65%|██████▍   | 24640/37963 [55:54:03<28:59:34,  7.83s/it]
 65%|██████▍   | 24641/37963 [55:54:10<28:55:59,  7.82s/it]
 65%|██████▍   | 24642/37963 [55:54:18<29:11:52,  7.89s/it]
 65%|██████▍   | 24643/37963 [55:54:31<34:52:49,  9.43s/it]
 65%|██████▍   | 24644/37963 [55:54:39<33:16:15,  8.99s/it]
 65%|██████▍   | 24645/37963 [55:54:47<32:08:16,  8.69s/it]
 65%|██████▍   | 24646/37963 [55:54:55<31:02:11,  8.39s/it]
 65%|██████▍   | 24647/37963 [55:55:03<30:04:12,  8.13s/it]
 65%|██████▍   | 24648/37963 [55:55:10<29:22:14,  7.94s/it]
 65%|██████▍   | 24649/37963 [55:55:20<32:08:47,  8.69s/it]
 65%|██████▍   | 24650/37963 [55:55:31<33:58:42,  9.19s/it]
                                                           
{'loss': '0.1443', 'grad_norm': '3.107', 'learning_rate': '5.787e-06', 'epoch': '0.6493'}
+
 65%|██████▍   | 24650/37963 [55:55:31<33:58:42,  9.19s/it]
 65%|██████▍   | 24651/37963 [55:55:39<32:19:53,  8.74s/it]
 65%|██████▍   | 24652/37963 [55:55:46<31:02:01,  8.39s/it]
 65%|██████▍   | 24653/37963 [55:55:54<30:09:59,  8.16s/it]
 65%|██████▍   | 24654/37963 [55:56:01<29:38:40,  8.02s/it]
 65%|██████▍   | 24655/37963 [55:56:14<35:13:50,  9.53s/it]
 65%|██████▍   | 24656/37963 [55:56:22<32:53:07,  8.90s/it]
 65%|██████▍   | 24657/37963 [55:56:30<31:31:57,  8.53s/it]
 65%|██████▍   | 24658/37963 [55:56:37<30:36:35,  8.28s/it]
 65%|██████▍   | 24659/37963 [55:56:45<30:15:43,  8.19s/it]
 65%|██████▍   | 24660/37963 [55:56:53<29:47:28,  8.06s/it]
                                                           
{'loss': '0.1311', 'grad_norm': '1.842', 'learning_rate': '5.779e-06', 'epoch': '0.6496'}
+
 65%|██████▍   | 24660/37963 [55:56:53<29:47:28,  8.06s/it]
 65%|██████▍   | 24661/37963 [55:57:01<29:24:03,  7.96s/it]
 65%|██████▍   | 24662/37963 [55:57:09<29:19:14,  7.94s/it]
 65%|██████▍   | 24663/37963 [55:57:16<29:16:03,  7.92s/it]
 65%|██████▍   | 24664/37963 [55:57:24<29:04:46,  7.87s/it]
 65%|██████▍   | 24665/37963 [55:57:35<31:52:33,  8.63s/it]
 65%|██████▍   | 24666/37963 [55:57:42<30:56:43,  8.38s/it]
 65%|██████▍   | 24667/37963 [55:57:50<30:21:56,  8.22s/it]
 65%|██████▍   | 24668/37963 [55:57:58<29:57:41,  8.11s/it]
 65%|██████▍   | 24669/37963 [55:58:06<29:45:38,  8.06s/it]
 65%|██████▍   | 24670/37963 [55:58:14<29:11:33,  7.91s/it]
                                                           
{'loss': '0.141', 'grad_norm': '1.085', 'learning_rate': '5.771e-06', 'epoch': '0.6498'}
+
 65%|██████▍   | 24670/37963 [55:58:14<29:11:33,  7.91s/it]
 65%|██████▍   | 24671/37963 [55:58:21<29:00:17,  7.86s/it]
 65%|██████▍   | 24672/37963 [55:58:29<28:46:37,  7.79s/it]
 65%|██████▍   | 24673/37963 [55:58:37<29:02:50,  7.87s/it]
 65%|██████▍   | 24674/37963 [55:58:45<28:56:41,  7.84s/it]
 65%|██████▍   | 24675/37963 [55:58:53<28:57:37,  7.85s/it]
 65%|██████▌   | 24676/37963 [55:59:00<28:43:37,  7.78s/it]
 65%|██████▌   | 24677/37963 [55:59:08<28:42:02,  7.78s/it]
 65%|██████▌   | 24678/37963 [55:59:16<28:46:06,  7.80s/it]
 65%|██████▌   | 24679/37963 [55:59:26<31:38:35,  8.58s/it]
 65%|██████▌   | 24680/37963 [55:59:34<30:32:06,  8.28s/it]
                                                           
{'loss': '0.1291', 'grad_norm': '2.901', 'learning_rate': '5.763e-06', 'epoch': '0.6501'}
+
 65%|██████▌   | 24680/37963 [55:59:34<30:32:06,  8.28s/it]
 65%|██████▌   | 24681/37963 [55:59:42<29:50:21,  8.09s/it]
 65%|██████▌   | 24682/37963 [55:59:49<29:26:25,  7.98s/it]
 65%|██████▌   | 24683/37963 [55:59:57<29:16:33,  7.94s/it]
 65%|██████▌   | 24684/37963 [56:00:05<28:56:52,  7.85s/it]
 65%|██████▌   | 24685/37963 [56:00:12<28:46:21,  7.80s/it]
 65%|██████▌   | 24686/37963 [56:00:20<28:39:46,  7.77s/it]
 65%|██████▌   | 24687/37963 [56:00:30<31:30:48,  8.55s/it]
 65%|██████▌   | 24688/37963 [56:00:38<30:33:31,  8.29s/it]
 65%|██████▌   | 24689/37963 [56:00:46<29:49:58,  8.09s/it]
 65%|██████▌   | 24690/37963 [56:00:54<29:40:38,  8.05s/it]
                                                           
{'loss': '0.1308', 'grad_norm': '1.808', 'learning_rate': '5.756e-06', 'epoch': '0.6504'}
+
 65%|██████▌   | 24690/37963 [56:00:54<29:40:38,  8.05s/it]
 65%|██████▌   | 24691/37963 [56:01:01<28:48:21,  7.81s/it]
 65%|██████▌   | 24692/37963 [56:01:08<28:23:58,  7.70s/it]
 65%|██████▌   | 24693/37963 [56:01:16<27:59:40,  7.59s/it]
 65%|██████▌   | 24694/37963 [56:01:24<28:05:56,  7.62s/it]
 65%|██████▌   | 24695/37963 [56:01:31<28:16:41,  7.67s/it]
 65%|██████▌   | 24696/37963 [56:01:39<28:29:03,  7.73s/it]
 65%|██████▌   | 24697/37963 [56:01:50<31:29:28,  8.55s/it]
 65%|██████▌   | 24698/37963 [56:02:02<36:17:02,  9.85s/it]
 65%|██████▌   | 24699/37963 [56:02:10<34:09:48,  9.27s/it]
 65%|██████▌   | 24700/37963 [56:02:18<32:31:36,  8.83s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '3.296', 'learning_rate': '5.748e-06', 'epoch': '0.6506'}
+
 65%|██████▌   | 24700/37963 [56:02:18<32:31:36,  8.83s/it]
 65%|██████▌   | 24701/37963 [56:02:26<31:23:42,  8.52s/it]
 65%|██████▌   | 24702/37963 [56:02:34<30:39:22,  8.32s/it]
 65%|██████▌   | 24703/37963 [56:02:42<29:57:29,  8.13s/it]
 65%|██████▌   | 24704/37963 [56:02:52<32:25:56,  8.81s/it]
 65%|██████▌   | 24705/37963 [56:03:00<31:20:31,  8.51s/it]
 65%|██████▌   | 24706/37963 [56:03:08<30:31:07,  8.29s/it]
 65%|██████▌   | 24707/37963 [56:03:18<33:01:37,  8.97s/it]
 65%|██████▌   | 24708/37963 [56:03:26<31:48:36,  8.64s/it]
 65%|██████▌   | 24709/37963 [56:03:34<30:56:47,  8.41s/it]
 65%|██████▌   | 24710/37963 [56:03:42<30:21:06,  8.24s/it]
                                                           
{'loss': '0.1347', 'grad_norm': '2.539', 'learning_rate': '5.74e-06', 'epoch': '0.6509'}
+
 65%|██████▌   | 24710/37963 [56:03:42<30:21:06,  8.24s/it]
 65%|██████▌   | 24711/37963 [56:03:49<29:48:39,  8.10s/it]
 65%|██████▌   | 24712/37963 [56:03:57<29:20:07,  7.97s/it]
 65%|██████▌   | 24713/37963 [56:04:05<29:11:05,  7.93s/it]
 65%|██████▌   | 24714/37963 [56:04:13<28:54:26,  7.85s/it]
 65%|██████▌   | 24715/37963 [56:04:20<28:47:03,  7.82s/it]
 65%|██████▌   | 24716/37963 [56:04:28<28:41:17,  7.80s/it]
 65%|██████▌   | 24717/37963 [56:04:36<28:50:54,  7.84s/it]
 65%|██████▌   | 24718/37963 [56:04:43<28:13:04,  7.67s/it]
 65%|██████▌   | 24719/37963 [56:04:54<31:08:56,  8.47s/it]
 65%|██████▌   | 24720/37963 [56:05:01<30:25:59,  8.27s/it]
                                                           
{'loss': '0.1436', 'grad_norm': '1.323', 'learning_rate': '5.732e-06', 'epoch': '0.6512'}
+
 65%|██████▌   | 24720/37963 [56:05:01<30:25:59,  8.27s/it]
 65%|██████▌   | 24721/37963 [56:05:09<29:48:51,  8.11s/it]
 65%|██████▌   | 24722/37963 [56:05:17<29:22:43,  7.99s/it]
 65%|██████▌   | 24723/37963 [56:05:25<29:09:35,  7.93s/it]
 65%|██████▌   | 24724/37963 [56:05:32<28:37:06,  7.78s/it]
 65%|██████▌   | 24725/37963 [56:05:40<28:40:35,  7.80s/it]
 65%|██████▌   | 24726/37963 [56:05:50<31:27:13,  8.55s/it]
 65%|██████▌   | 24727/37963 [56:05:58<30:36:24,  8.32s/it]
 65%|██████▌   | 24728/37963 [56:06:06<29:56:27,  8.14s/it]
 65%|██████▌   | 24729/37963 [56:06:13<28:55:13,  7.87s/it]
 65%|██████▌   | 24730/37963 [56:06:21<28:43:41,  7.82s/it]
                                                           
{'loss': '0.1401', 'grad_norm': '3.022', 'learning_rate': '5.725e-06', 'epoch': '0.6514'}
+
 65%|██████▌   | 24730/37963 [56:06:21<28:43:41,  7.82s/it]
 65%|██████▌   | 24731/37963 [56:06:28<28:23:47,  7.73s/it]
 65%|██████▌   | 24732/37963 [56:06:36<28:52:17,  7.86s/it]
 65%|██████▌   | 24733/37963 [56:06:44<28:47:31,  7.83s/it]
 65%|██████▌   | 24734/37963 [56:06:52<28:19:59,  7.71s/it]
 65%|██████▌   | 24735/37963 [56:07:02<31:12:36,  8.49s/it]
 65%|██████▌   | 24736/37963 [56:07:10<30:38:39,  8.34s/it]
 65%|██████▌   | 24737/37963 [56:07:18<30:01:30,  8.17s/it]
 65%|██████▌   | 24738/37963 [56:07:26<29:43:50,  8.09s/it]
 65%|██████▌   | 24739/37963 [56:07:33<28:53:58,  7.87s/it]
 65%|██████▌   | 24740/37963 [56:07:41<28:56:56,  7.88s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '2.106', 'learning_rate': '5.717e-06', 'epoch': '0.6517'}
+
 65%|██████▌   | 24740/37963 [56:07:41<28:56:56,  7.88s/it]
 65%|██████▌   | 24741/37963 [56:07:49<29:01:42,  7.90s/it]
 65%|██████▌   | 24742/37963 [56:07:57<29:04:28,  7.92s/it]
 65%|██████▌   | 24743/37963 [56:08:04<28:30:26,  7.76s/it]
 65%|██████▌   | 24744/37963 [56:08:12<28:25:46,  7.74s/it]
 65%|██████▌   | 24745/37963 [56:08:20<28:27:15,  7.75s/it]
 65%|██████▌   | 24746/37963 [56:08:33<34:24:04,  9.37s/it]
 65%|██████▌   | 24747/37963 [56:08:43<35:39:49,  9.71s/it]
 65%|██████▌   | 24748/37963 [56:08:51<33:31:03,  9.13s/it]
 65%|██████▌   | 24749/37963 [56:08:59<31:40:06,  8.63s/it]
 65%|██████▌   | 24750/37963 [56:09:06<30:31:53,  8.32s/it]
                                                           
{'loss': '0.1268', 'grad_norm': '1.177', 'learning_rate': '5.709e-06', 'epoch': '0.652'}
+
 65%|██████▌   | 24750/37963 [56:09:06<30:31:53,  8.32s/it]
 65%|██████▌   | 24751/37963 [56:09:17<32:56:07,  8.97s/it]
 65%|██████▌   | 24752/37963 [56:09:27<34:24:44,  9.38s/it]
 65%|██████▌   | 24753/37963 [56:09:35<32:32:30,  8.87s/it]
 65%|██████▌   | 24754/37963 [56:09:43<31:32:26,  8.60s/it]
 65%|██████▌   | 24755/37963 [56:09:50<30:35:08,  8.34s/it]
 65%|██████▌   | 24756/37963 [56:09:58<30:14:07,  8.24s/it]
 65%|██████▌   | 24757/37963 [56:10:06<29:27:33,  8.03s/it]
 65%|██████▌   | 24758/37963 [56:10:14<29:03:06,  7.92s/it]
 65%|██████▌   | 24759/37963 [56:10:21<28:41:11,  7.82s/it]
 65%|██████▌   | 24760/37963 [56:10:29<28:21:03,  7.73s/it]
                                                           
{'loss': '0.1447', 'grad_norm': '1.752', 'learning_rate': '5.702e-06', 'epoch': '0.6522'}
+
 65%|██████▌   | 24760/37963 [56:10:29<28:21:03,  7.73s/it]
 65%|██████▌   | 24761/37963 [56:10:37<28:49:41,  7.86s/it]
 65%|██████▌   | 24762/37963 [56:10:47<31:16:03,  8.53s/it]
 65%|██████▌   | 24763/37963 [56:10:54<30:01:08,  8.19s/it]
 65%|██████▌   | 24764/37963 [56:11:02<29:21:07,  8.01s/it]
 65%|██████▌   | 24765/37963 [56:11:10<29:07:25,  7.94s/it]
 65%|██████▌   | 24766/37963 [56:11:17<28:46:20,  7.85s/it]
 65%|██████▌   | 24767/37963 [56:11:25<28:30:07,  7.78s/it]
 65%|██████▌   | 24768/37963 [56:11:33<28:26:28,  7.76s/it]
 65%|██████▌   | 24769/37963 [56:11:40<28:29:36,  7.77s/it]
 65%|██████▌   | 24770/37963 [56:11:48<28:30:32,  7.78s/it]
                                                           
{'loss': '0.1369', 'grad_norm': '1.534', 'learning_rate': '5.694e-06', 'epoch': '0.6525'}
+
 65%|██████▌   | 24770/37963 [56:11:48<28:30:32,  7.78s/it]
 65%|██████▌   | 24771/37963 [56:11:56<28:37:54,  7.81s/it]
 65%|██████▌   | 24772/37963 [56:12:04<28:57:16,  7.90s/it]
 65%|██████▌   | 24773/37963 [56:12:12<28:21:12,  7.74s/it]
 65%|██████▌   | 24774/37963 [56:12:22<31:19:13,  8.55s/it]
 65%|██████▌   | 24775/37963 [56:12:30<30:40:31,  8.37s/it]
 65%|██████▌   | 24776/37963 [56:12:38<29:57:29,  8.18s/it]
 65%|██████▌   | 24777/37963 [56:12:45<29:25:20,  8.03s/it]
 65%|██████▌   | 24778/37963 [56:12:53<28:59:08,  7.91s/it]
 65%|██████▌   | 24779/37963 [56:13:01<29:00:43,  7.92s/it]
 65%|██████▌   | 24780/37963 [56:13:09<28:39:07,  7.82s/it]
                                                           
{'loss': '0.1281', 'grad_norm': '1.681', 'learning_rate': '5.686e-06', 'epoch': '0.6527'}
+
 65%|██████▌   | 24780/37963 [56:13:09<28:39:07,  7.82s/it]
 65%|██████▌   | 24781/37963 [56:13:16<28:17:32,  7.73s/it]
 65%|██████▌   | 24782/37963 [56:13:24<28:14:16,  7.71s/it]
 65%|██████▌   | 24783/37963 [56:13:32<28:26:14,  7.77s/it]
 65%|██████▌   | 24784/37963 [56:13:42<31:31:52,  8.61s/it]
 65%|██████▌   | 24785/37963 [56:13:50<30:58:31,  8.46s/it]
 65%|██████▌   | 24786/37963 [56:13:58<30:20:07,  8.29s/it]
 65%|██████▌   | 24787/37963 [56:14:06<29:51:23,  8.16s/it]
 65%|██████▌   | 24788/37963 [56:14:14<29:19:16,  8.01s/it]
 65%|██████▌   | 24789/37963 [56:14:27<34:33:44,  9.44s/it]
 65%|██████▌   | 24790/37963 [56:14:34<32:45:06,  8.95s/it]
                                                           
{'loss': '0.1344', 'grad_norm': '6.733', 'learning_rate': '5.679e-06', 'epoch': '0.653'}
+
 65%|██████▌   | 24790/37963 [56:14:34<32:45:06,  8.95s/it]
 65%|██████▌   | 24791/37963 [56:14:42<31:14:44,  8.54s/it]
 65%|██████▌   | 24792/37963 [56:14:50<30:21:28,  8.30s/it]
 65%|██████▌   | 24793/37963 [56:14:57<29:50:15,  8.16s/it]
 65%|██████▌   | 24794/37963 [56:15:08<32:24:56,  8.86s/it]
 65%|██████▌   | 24795/37963 [56:15:21<37:22:12, 10.22s/it]
 65%|██████▌   | 24796/37963 [56:15:29<34:56:08,  9.55s/it]
 65%|██████▌   | 24797/37963 [56:15:37<32:48:39,  8.97s/it]
 65%|██████▌   | 24798/37963 [56:15:44<30:55:30,  8.46s/it]
 65%|██████▌   | 24799/37963 [56:15:52<30:11:45,  8.26s/it]
 65%|██████▌   | 24800/37963 [56:15:59<29:06:41,  7.96s/it]
                                                           
{'loss': '0.1415', 'grad_norm': '2.947', 'learning_rate': '5.671e-06', 'epoch': '0.6533'}
+
 65%|██████▌   | 24800/37963 [56:15:59<29:06:41,  7.96s/it]
 65%|██████▌   | 24801/37963 [56:16:07<28:45:38,  7.87s/it]
 65%|██████▌   | 24802/37963 [56:16:15<28:29:59,  7.80s/it]
 65%|██████▌   | 24803/37963 [56:16:22<28:36:09,  7.82s/it]
 65%|██████▌   | 24804/37963 [56:16:30<28:17:34,  7.74s/it]
 65%|██████▌   | 24805/37963 [56:16:38<28:18:52,  7.75s/it]
 65%|██████▌   | 24806/37963 [56:16:45<27:59:00,  7.66s/it]
 65%|██████▌   | 24807/37963 [56:16:53<27:46:25,  7.60s/it]
 65%|██████▌   | 24808/37963 [56:17:01<28:06:44,  7.69s/it]
 65%|██████▌   | 24809/37963 [56:17:08<28:16:01,  7.74s/it]
 65%|██████▌   | 24810/37963 [56:17:19<31:25:49,  8.60s/it]
                                                           
{'loss': '0.1433', 'grad_norm': '1.103', 'learning_rate': '5.663e-06', 'epoch': '0.6535'}
+
 65%|██████▌   | 24810/37963 [56:17:19<31:25:49,  8.60s/it]
 65%|██████▌   | 24811/37963 [56:17:27<30:33:42,  8.37s/it]
 65%|██████▌   | 24812/37963 [56:17:34<29:32:01,  8.08s/it]
 65%|██████▌   | 24813/37963 [56:17:42<29:17:46,  8.02s/it]
 65%|██████▌   | 24814/37963 [56:17:50<28:51:35,  7.90s/it]
 65%|██████▌   | 24815/37963 [56:17:58<28:40:23,  7.85s/it]
 65%|██████▌   | 24816/37963 [56:18:05<28:38:59,  7.85s/it]
 65%|██████▌   | 24817/37963 [56:18:13<28:40:24,  7.85s/it]
 65%|██████▌   | 24818/37963 [56:18:21<28:28:31,  7.80s/it]
 65%|██████▌   | 24819/37963 [56:18:28<28:14:07,  7.73s/it]
 65%|██████▌   | 24820/37963 [56:18:36<28:10:38,  7.72s/it]
                                                           
{'loss': '0.1561', 'grad_norm': '1.231', 'learning_rate': '5.655e-06', 'epoch': '0.6538'}
+
 65%|██████▌   | 24820/37963 [56:18:36<28:10:38,  7.72s/it]
 65%|██████▌   | 24821/37963 [56:18:44<28:22:28,  7.77s/it]
 65%|██████▌   | 24822/37963 [56:18:52<28:30:09,  7.81s/it]
 65%|██████▌   | 24823/37963 [56:19:02<31:17:26,  8.57s/it]
 65%|██████▌   | 24824/37963 [56:19:10<30:38:44,  8.40s/it]
 65%|██████▌   | 24825/37963 [56:19:18<29:59:05,  8.22s/it]
 65%|██████▌   | 24826/37963 [56:19:26<29:24:01,  8.06s/it]
 65%|██████▌   | 24827/37963 [56:19:34<29:15:58,  8.02s/it]
 65%|██████▌   | 24828/37963 [56:19:42<29:01:24,  7.95s/it]
 65%|██████▌   | 24829/37963 [56:19:50<29:04:54,  7.97s/it]
 65%|██████▌   | 24830/37963 [56:19:57<28:46:33,  7.89s/it]
                                                           
{'loss': '0.1279', 'grad_norm': '2.318', 'learning_rate': '5.648e-06', 'epoch': '0.6541'}
+
 65%|██████▌   | 24830/37963 [56:19:57<28:46:33,  7.89s/it]
 65%|██████▌   | 24831/37963 [56:20:08<31:50:05,  8.73s/it]
 65%|██████▌   | 24832/37963 [56:20:16<30:47:05,  8.44s/it]
 65%|██████▌   | 24833/37963 [56:20:23<29:45:19,  8.16s/it]
 65%|██████▌   | 24834/37963 [56:20:31<29:11:16,  8.00s/it]
 65%|██████▌   | 24835/37963 [56:20:39<29:07:29,  7.99s/it]
 65%|██████▌   | 24836/37963 [56:20:46<28:44:01,  7.88s/it]
 65%|██████▌   | 24837/37963 [56:20:54<28:30:05,  7.82s/it]
 65%|██████▌   | 24838/37963 [56:21:04<31:08:15,  8.54s/it]
 65%|██████▌   | 24839/37963 [56:21:14<32:53:40,  9.02s/it]
 65%|██████▌   | 24840/37963 [56:21:22<31:35:41,  8.67s/it]
                                                           
{'loss': '0.1339', 'grad_norm': '2.175', 'learning_rate': '5.64e-06', 'epoch': '0.6543'}
+
 65%|██████▌   | 24840/37963 [56:21:22<31:35:41,  8.67s/it]
 65%|██████▌   | 24841/37963 [56:21:30<30:45:09,  8.44s/it]
 65%|██████▌   | 24842/37963 [56:21:40<32:27:27,  8.91s/it]
 65%|██████▌   | 24843/37963 [56:21:51<34:14:45,  9.40s/it]
 65%|██████▌   | 24844/37963 [56:21:59<32:35:27,  8.94s/it]
 65%|██████▌   | 24845/37963 [56:22:06<31:19:47,  8.60s/it]
 65%|██████▌   | 24846/37963 [56:22:14<30:18:47,  8.32s/it]
 65%|██████▌   | 24847/37963 [56:22:22<29:45:37,  8.17s/it]
 65%|██████▌   | 24848/37963 [56:22:30<29:12:24,  8.02s/it]
 65%|██████▌   | 24849/37963 [56:22:37<28:33:37,  7.84s/it]
 65%|██████▌   | 24850/37963 [56:22:45<28:27:01,  7.81s/it]
                                                           
{'loss': '0.1374', 'grad_norm': '1.631', 'learning_rate': '5.632e-06', 'epoch': '0.6546'}
+
 65%|██████▌   | 24850/37963 [56:22:45<28:27:01,  7.81s/it]
 65%|██████▌   | 24851/37963 [56:22:53<28:35:41,  7.85s/it]
 65%|██████▌   | 24852/37963 [56:23:00<28:29:09,  7.82s/it]
 65%|██████▌   | 24853/37963 [56:23:08<28:45:11,  7.90s/it]
 65%|██████▌   | 24854/37963 [56:23:16<28:16:33,  7.77s/it]
 65%|██████▌   | 24855/37963 [56:23:23<27:41:30,  7.61s/it]
 65%|██████▌   | 24856/37963 [56:23:31<27:31:01,  7.56s/it]
 65%|██████▌   | 24857/37963 [56:23:38<27:34:53,  7.58s/it]
 65%|██████▌   | 24858/37963 [56:23:46<27:40:34,  7.60s/it]
 65%|██████▌   | 24859/37963 [56:23:56<30:14:29,  8.31s/it]
 65%|██████▌   | 24860/37963 [56:24:04<29:58:24,  8.24s/it]
                                                           
{'loss': '0.1227', 'grad_norm': '2.496', 'learning_rate': '5.625e-06', 'epoch': '0.6549'}
+
 65%|██████▌   | 24860/37963 [56:24:04<29:58:24,  8.24s/it]
 65%|██████▌   | 24861/37963 [56:24:12<29:40:54,  8.16s/it]
 65%|██████▌   | 24862/37963 [56:24:20<29:20:04,  8.06s/it]
 65%|██████▌   | 24863/37963 [56:24:27<28:52:56,  7.94s/it]
 65%|██████▌   | 24864/37963 [56:24:35<28:37:49,  7.87s/it]
 65%|██████▌   | 24865/37963 [56:24:43<28:27:39,  7.82s/it]
 66%|██████▌   | 24866/37963 [56:24:50<28:15:31,  7.77s/it]
 66%|██████▌   | 24867/37963 [56:24:58<27:52:25,  7.66s/it]
 66%|██████▌   | 24868/37963 [56:25:05<27:40:52,  7.61s/it]
 66%|██████▌   | 24869/37963 [56:25:16<30:47:28,  8.47s/it]
 66%|██████▌   | 24870/37963 [56:25:23<29:41:03,  8.16s/it]
                                                           
{'loss': '0.146', 'grad_norm': '2.101', 'learning_rate': '5.617e-06', 'epoch': '0.6551'}
+
 66%|██████▌   | 24870/37963 [56:25:23<29:41:03,  8.16s/it]
 66%|██████▌   | 24871/37963 [56:25:31<29:27:10,  8.10s/it]
 66%|██████▌   | 24872/37963 [56:25:39<29:01:41,  7.98s/it]
 66%|██████▌   | 24873/37963 [56:25:47<28:53:14,  7.94s/it]
 66%|██████▌   | 24874/37963 [56:25:55<28:41:32,  7.89s/it]
 66%|██████▌   | 24875/37963 [56:26:02<28:19:06,  7.79s/it]
 66%|██████▌   | 24876/37963 [56:26:10<28:19:34,  7.79s/it]
 66%|██████▌   | 24877/37963 [56:26:18<28:20:26,  7.80s/it]
 66%|██████▌   | 24878/37963 [56:26:25<28:14:30,  7.77s/it]
 66%|██████▌   | 24879/37963 [56:26:33<28:30:39,  7.84s/it]
 66%|██████▌   | 24880/37963 [56:26:41<28:11:14,  7.76s/it]
                                                           
{'loss': '0.1313', 'grad_norm': '1.636', 'learning_rate': '5.609e-06', 'epoch': '0.6554'}
+
 66%|██████▌   | 24880/37963 [56:26:41<28:11:14,  7.76s/it]
 66%|██████▌   | 24881/37963 [56:26:49<28:01:38,  7.71s/it]
 66%|██████▌   | 24882/37963 [56:26:56<27:59:14,  7.70s/it]
 66%|██████▌   | 24883/37963 [56:27:04<28:12:40,  7.76s/it]
 66%|██████▌   | 24884/37963 [56:27:14<30:49:50,  8.49s/it]
 66%|██████▌   | 24885/37963 [56:27:22<30:02:35,  8.27s/it]
 66%|██████▌   | 24886/37963 [56:27:30<29:22:31,  8.09s/it]
 66%|██████▌   | 24887/37963 [56:27:41<32:18:59,  8.90s/it]
 66%|██████▌   | 24888/37963 [56:27:48<30:43:26,  8.46s/it]
 66%|██████▌   | 24889/37963 [56:27:58<32:40:07,  9.00s/it]
 66%|██████▌   | 24890/37963 [56:28:06<31:16:25,  8.61s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '1.957', 'learning_rate': '5.602e-06', 'epoch': '0.6556'}
+
 66%|██████▌   | 24890/37963 [56:28:06<31:16:25,  8.61s/it]
 66%|██████▌   | 24891/37963 [56:28:14<30:32:39,  8.41s/it]
 66%|██████▌   | 24892/37963 [56:28:27<36:00:47,  9.92s/it]
 66%|██████▌   | 24893/37963 [56:28:35<33:17:51,  9.17s/it]
 66%|██████▌   | 24894/37963 [56:28:42<31:29:32,  8.67s/it]
 66%|██████▌   | 24895/37963 [56:28:50<30:17:38,  8.35s/it]
 66%|██████▌   | 24896/37963 [56:28:58<29:36:48,  8.16s/it]
 66%|██████▌   | 24897/37963 [56:29:05<29:18:51,  8.08s/it]
 66%|██████▌   | 24898/37963 [56:29:13<29:07:51,  8.03s/it]
 66%|██████▌   | 24899/37963 [56:29:21<28:56:19,  7.97s/it]
 66%|██████▌   | 24900/37963 [56:29:29<28:33:16,  7.87s/it]
                                                           
{'loss': '0.1422', 'grad_norm': '3.501', 'learning_rate': '5.594e-06', 'epoch': '0.6559'}
+
 66%|██████▌   | 24900/37963 [56:29:29<28:33:16,  7.87s/it]
 66%|██████▌   | 24901/37963 [56:29:36<28:04:34,  7.74s/it]
 66%|██████▌   | 24902/37963 [56:29:44<27:54:52,  7.69s/it]
 66%|██████▌   | 24903/37963 [56:29:52<27:51:51,  7.68s/it]
 66%|██████▌   | 24904/37963 [56:29:59<27:48:20,  7.67s/it]
 66%|██████▌   | 24905/37963 [56:30:06<27:23:45,  7.55s/it]
 66%|██████▌   | 24906/37963 [56:30:14<27:30:09,  7.58s/it]
 66%|██████▌   | 24907/37963 [56:30:25<30:35:33,  8.44s/it]
 66%|██████▌   | 24908/37963 [56:30:32<29:39:04,  8.18s/it]
 66%|██████▌   | 24909/37963 [56:30:40<29:19:33,  8.09s/it]
 66%|██████▌   | 24910/37963 [56:30:48<29:04:00,  8.02s/it]
                                                           
{'loss': '0.1317', 'grad_norm': '1.974', 'learning_rate': '5.586e-06', 'epoch': '0.6562'}
+
 66%|██████▌   | 24910/37963 [56:30:48<29:04:00,  8.02s/it]
 66%|██████▌   | 24911/37963 [56:30:55<28:30:05,  7.86s/it]
 66%|██████▌   | 24912/37963 [56:31:03<28:14:15,  7.79s/it]
 66%|██████▌   | 24913/37963 [56:31:13<31:00:24,  8.55s/it]
 66%|██████▌   | 24914/37963 [56:31:21<30:02:52,  8.29s/it]
 66%|██████▌   | 24915/37963 [56:31:29<29:22:29,  8.10s/it]
 66%|██████▌   | 24916/37963 [56:31:36<28:44:34,  7.93s/it]
 66%|██████▌   | 24917/37963 [56:31:44<28:18:52,  7.81s/it]
 66%|██████▌   | 24918/37963 [56:31:51<28:12:19,  7.78s/it]
 66%|██████▌   | 24919/37963 [56:31:59<28:27:29,  7.85s/it]
 66%|██████▌   | 24920/37963 [56:32:07<27:52:21,  7.69s/it]
                                                           
{'loss': '0.1361', 'grad_norm': '1.791', 'learning_rate': '5.579e-06', 'epoch': '0.6564'}
+
 66%|██████▌   | 24920/37963 [56:32:07<27:52:21,  7.69s/it]
 66%|██████▌   | 24921/37963 [56:32:15<27:56:08,  7.71s/it]
 66%|██████▌   | 24922/37963 [56:32:22<27:59:34,  7.73s/it]
 66%|██████▌   | 24923/37963 [56:32:30<27:58:50,  7.72s/it]
 66%|██████▌   | 24924/37963 [56:32:38<27:51:03,  7.69s/it]
 66%|██████▌   | 24925/37963 [56:32:45<27:45:34,  7.66s/it]
 66%|██████▌   | 24926/37963 [56:32:53<27:59:02,  7.73s/it]
 66%|██████▌   | 24927/37963 [56:33:01<27:52:39,  7.70s/it]
 66%|██████▌   | 24928/37963 [56:33:11<30:20:33,  8.38s/it]
 66%|██████▌   | 24929/37963 [56:33:19<29:46:26,  8.22s/it]
 66%|██████▌   | 24930/37963 [56:33:26<29:16:16,  8.09s/it]
                                                           
{'loss': '0.1403', 'grad_norm': '1.701', 'learning_rate': '5.571e-06', 'epoch': '0.6567'}
+
 66%|██████▌   | 24930/37963 [56:33:26<29:16:16,  8.09s/it]
 66%|██████▌   | 24931/37963 [56:33:37<31:56:56,  8.83s/it]
 66%|██████▌   | 24932/37963 [56:33:45<30:49:00,  8.51s/it]
 66%|██████▌   | 24933/37963 [56:33:53<30:09:57,  8.33s/it]
 66%|██████▌   | 24934/37963 [56:34:00<29:33:44,  8.17s/it]
 66%|██████▌   | 24935/37963 [56:34:08<29:23:47,  8.12s/it]
 66%|██████▌   | 24936/37963 [56:34:16<29:04:45,  8.04s/it]
 66%|██████▌   | 24937/37963 [56:34:24<28:35:01,  7.90s/it]
 66%|██████▌   | 24938/37963 [56:34:31<28:14:16,  7.80s/it]
 66%|██████▌   | 24939/37963 [56:34:39<28:02:10,  7.75s/it]
 66%|██████▌   | 24940/37963 [56:34:50<31:08:08,  8.61s/it]
                                                           
{'loss': '0.1342', 'grad_norm': '3.904', 'learning_rate': '5.563e-06', 'epoch': '0.657'}
+
 66%|██████▌   | 24940/37963 [56:34:50<31:08:08,  8.61s/it]
 66%|██████▌   | 24941/37963 [56:35:00<33:23:10,  9.23s/it]
 66%|██████▌   | 24942/37963 [56:35:08<31:41:22,  8.76s/it]
 66%|██████▌   | 24943/37963 [56:35:18<33:08:39,  9.16s/it]
 66%|██████▌   | 24944/37963 [56:35:26<31:40:20,  8.76s/it]
 66%|██████▌   | 24945/37963 [56:35:34<30:48:30,  8.52s/it]
 66%|██████▌   | 24946/37963 [56:35:42<30:16:37,  8.37s/it]
 66%|██████▌   | 24947/37963 [56:35:49<29:29:57,  8.16s/it]
 66%|██████▌   | 24948/37963 [56:35:57<28:58:49,  8.02s/it]
 66%|██████▌   | 24949/37963 [56:36:05<28:44:18,  7.95s/it]
 66%|██████▌   | 24950/37963 [56:36:13<28:40:55,  7.93s/it]
                                                           
{'loss': '0.1388', 'grad_norm': '2.176', 'learning_rate': '5.556e-06', 'epoch': '0.6572'}
+
 66%|██████▌   | 24950/37963 [56:36:13<28:40:55,  7.93s/it]
 66%|██████▌   | 24951/37963 [56:36:21<28:21:14,  7.84s/it]
 66%|██████▌   | 24952/37963 [56:36:28<28:05:03,  7.77s/it]
 66%|██████▌   | 24953/37963 [56:36:36<27:59:08,  7.74s/it]
 66%|██████▌   | 24954/37963 [56:36:43<27:52:23,  7.71s/it]
 66%|██████▌   | 24955/37963 [56:36:54<30:34:00,  8.46s/it]
 66%|██████▌   | 24956/37963 [56:37:01<29:49:42,  8.26s/it]
 66%|██████▌   | 24957/37963 [56:37:09<29:18:08,  8.11s/it]
 66%|██████▌   | 24958/37963 [56:37:17<28:46:30,  7.97s/it]
 66%|██████▌   | 24959/37963 [56:37:24<28:27:42,  7.88s/it]
 66%|██████▌   | 24960/37963 [56:37:32<28:09:53,  7.80s/it]
                                                           
{'loss': '0.1367', 'grad_norm': '1.451', 'learning_rate': '5.548e-06', 'epoch': '0.6575'}
+
 66%|██████▌   | 24960/37963 [56:37:32<28:09:53,  7.80s/it]
 66%|██████▌   | 24961/37963 [56:37:42<30:52:29,  8.55s/it]
 66%|██████▌   | 24962/37963 [56:37:50<29:59:20,  8.30s/it]
 66%|██████▌   | 24963/37963 [56:37:58<29:15:50,  8.10s/it]
 66%|██████▌   | 24964/37963 [56:38:06<28:51:38,  7.99s/it]
 66%|██████▌   | 24965/37963 [56:38:13<28:25:04,  7.87s/it]
 66%|██████▌   | 24966/37963 [56:38:21<28:10:46,  7.81s/it]
 66%|██████▌   | 24967/37963 [56:38:29<28:20:13,  7.85s/it]
 66%|██████▌   | 24968/37963 [56:38:37<28:17:48,  7.84s/it]
 66%|██████▌   | 24969/37963 [56:38:44<28:13:56,  7.82s/it]
 66%|██████▌   | 24970/37963 [56:38:52<28:01:24,  7.76s/it]
                                                           
{'loss': '0.1429', 'grad_norm': '1.372', 'learning_rate': '5.541e-06', 'epoch': '0.6577'}
+
 66%|██████▌   | 24970/37963 [56:38:52<28:01:24,  7.76s/it]
 66%|██████▌   | 24971/37963 [56:38:59<27:35:41,  7.65s/it]
 66%|██████▌   | 24972/37963 [56:39:10<30:51:53,  8.55s/it]
 66%|██████▌   | 24973/37963 [56:39:18<30:02:33,  8.33s/it]
 66%|██████▌   | 24974/37963 [56:39:28<32:24:59,  8.98s/it]
 66%|██████▌   | 24975/37963 [56:39:36<31:19:09,  8.68s/it]
 66%|██████▌   | 24976/37963 [56:39:44<29:53:28,  8.29s/it]
 66%|██████▌   | 24977/37963 [56:39:51<29:15:53,  8.11s/it]
 66%|██████▌   | 24978/37963 [56:39:59<28:55:12,  8.02s/it]
 66%|██████▌   | 24979/37963 [56:40:07<28:42:50,  7.96s/it]
 66%|██████▌   | 24980/37963 [56:40:15<28:30:38,  7.91s/it]
                                                           
{'loss': '0.1333', 'grad_norm': '2.012', 'learning_rate': '5.533e-06', 'epoch': '0.658'}
+
 66%|██████▌   | 24980/37963 [56:40:15<28:30:38,  7.91s/it]
 66%|██████▌   | 24981/37963 [56:40:23<28:26:01,  7.88s/it]
 66%|██████▌   | 24982/37963 [56:40:30<28:21:44,  7.87s/it]
 66%|██████▌   | 24983/37963 [56:40:38<28:25:10,  7.88s/it]
 66%|██████▌   | 24984/37963 [56:40:52<34:19:47,  9.52s/it]
 66%|██████▌   | 24985/37963 [56:40:59<32:09:28,  8.92s/it]
 66%|██████▌   | 24986/37963 [56:41:07<30:56:17,  8.58s/it]
 66%|██████▌   | 24987/37963 [56:41:15<29:59:21,  8.32s/it]
 66%|██████▌   | 24988/37963 [56:41:22<28:59:15,  8.04s/it]
 66%|██████▌   | 24989/37963 [56:41:30<28:32:34,  7.92s/it]
 66%|██████▌   | 24990/37963 [56:41:37<28:15:29,  7.84s/it]
                                                           
{'loss': '0.123', 'grad_norm': '1.676', 'learning_rate': '5.525e-06', 'epoch': '0.6583'}
+
 66%|██████▌   | 24990/37963 [56:41:37<28:15:29,  7.84s/it]
 66%|██████▌   | 24991/37963 [56:41:45<27:58:17,  7.76s/it]
 66%|██████▌   | 24992/37963 [56:41:53<27:58:45,  7.77s/it]
 66%|██████▌   | 24993/37963 [56:42:00<27:49:13,  7.72s/it]
 66%|██████▌   | 24994/37963 [56:42:11<30:44:01,  8.53s/it]
 66%|██████▌   | 24995/37963 [56:42:18<29:38:54,  8.23s/it]
 66%|██████▌   | 24996/37963 [56:42:26<28:58:11,  8.04s/it]
 66%|██████▌   | 24997/37963 [56:42:34<28:43:58,  7.98s/it]
 66%|██████▌   | 24998/37963 [56:42:42<28:37:14,  7.95s/it]
 66%|██████▌   | 24999/37963 [56:42:49<28:18:39,  7.86s/it]
 66%|██████▌   | 25000/37963 [56:42:57<28:04:46,  7.80s/it]
                                                           
{'loss': '0.1314', 'grad_norm': '1.705', 'learning_rate': '5.518e-06', 'epoch': '0.6585'}
+
 66%|██████▌   | 25000/37963 [56:42:57<28:04:46,  7.80s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.59s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.59s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 66%|██████▌   | 25001/37963 [56:43:58<85:37:16, 23.78s/it]
 66%|██████▌   | 25002/37963 [56:44:06<68:19:37, 18.98s/it]
 66%|██████▌   | 25003/37963 [56:44:16<58:58:21, 16.38s/it]
 66%|██████▌   | 25004/37963 [56:44:24<49:50:03, 13.84s/it]
 66%|██████▌   | 25005/37963 [56:44:31<42:46:06, 11.88s/it]
 66%|██████▌   | 25006/37963 [56:44:42<41:02:03, 11.40s/it]
 66%|██████▌   | 25007/37963 [56:44:49<37:06:48, 10.31s/it]
 66%|██████▌   | 25008/37963 [56:44:57<34:26:07,  9.57s/it]
 66%|██████▌   | 25009/37963 [56:45:05<32:36:10,  9.06s/it]
 66%|██████▌   | 25010/37963 [56:45:13<31:08:08,  8.65s/it]
                                                           
{'loss': '0.1374', 'grad_norm': '3.154', 'learning_rate': '5.51e-06', 'epoch': '0.6588'}
+
 66%|██████▌   | 25010/37963 [56:45:13<31:08:08,  8.65s/it]
 66%|██████▌   | 25011/37963 [56:45:21<30:19:44,  8.43s/it]
 66%|██████▌   | 25012/37963 [56:45:28<29:31:36,  8.21s/it]
 66%|██████▌   | 25013/37963 [56:45:36<28:57:09,  8.05s/it]
 66%|██████▌   | 25014/37963 [56:45:44<28:41:46,  7.98s/it]
 66%|██████▌   | 25015/37963 [56:45:51<28:07:45,  7.82s/it]
 66%|██████▌   | 25016/37963 [56:45:59<28:05:32,  7.81s/it]
 66%|██████▌   | 25017/37963 [56:46:07<28:07:11,  7.82s/it]
 66%|██████▌   | 25018/37963 [56:46:15<27:55:13,  7.76s/it]
 66%|██████▌   | 25019/37963 [56:46:25<30:33:33,  8.50s/it]
 66%|██████▌   | 25020/37963 [56:46:33<29:50:35,  8.30s/it]
                                                           
{'loss': '0.1409', 'grad_norm': '1.792', 'learning_rate': '5.502e-06', 'epoch': '0.6591'}
+
 66%|██████▌   | 25020/37963 [56:46:33<29:50:35,  8.30s/it]
 66%|██████▌   | 25021/37963 [56:46:40<29:15:11,  8.14s/it]
 66%|██████▌   | 25022/37963 [56:46:48<28:57:19,  8.05s/it]
 66%|██████▌   | 25023/37963 [56:46:59<31:34:08,  8.78s/it]
 66%|██████▌   | 25024/37963 [56:47:07<30:49:26,  8.58s/it]
 66%|██████▌   | 25025/37963 [56:47:15<29:52:49,  8.31s/it]
 66%|██████▌   | 25026/37963 [56:47:25<32:33:36,  9.06s/it]
 66%|██████▌   | 25027/37963 [56:47:33<31:13:04,  8.69s/it]
 66%|██████▌   | 25028/37963 [56:47:41<30:06:42,  8.38s/it]
 66%|██████▌   | 25029/37963 [56:47:54<35:28:04,  9.87s/it]
 66%|██████▌   | 25030/37963 [56:48:02<33:09:40,  9.23s/it]
                                                           
{'loss': '0.141', 'grad_norm': '2.014', 'learning_rate': '5.495e-06', 'epoch': '0.6593'}
+
 66%|██████▌   | 25030/37963 [56:48:02<33:09:40,  9.23s/it]
 66%|██████▌   | 25031/37963 [56:48:09<31:14:34,  8.70s/it]
 66%|██████▌   | 25032/37963 [56:48:17<29:53:24,  8.32s/it]
 66%|██████▌   | 25033/37963 [56:48:25<29:20:55,  8.17s/it]
 66%|██████▌   | 25034/37963 [56:48:32<28:51:20,  8.03s/it]
 66%|██████▌   | 25035/37963 [56:48:40<28:12:12,  7.85s/it]
 66%|██████▌   | 25036/37963 [56:48:47<27:57:23,  7.79s/it]
 66%|██████▌   | 25037/37963 [56:48:55<27:46:52,  7.74s/it]
 66%|██████▌   | 25038/37963 [56:49:03<27:49:53,  7.75s/it]
 66%|██████▌   | 25039/37963 [56:49:11<27:59:29,  7.80s/it]
 66%|██████▌   | 25040/37963 [56:49:18<27:51:20,  7.76s/it]
                                                           
{'loss': '0.1338', 'grad_norm': '1.458', 'learning_rate': '5.487e-06', 'epoch': '0.6596'}
+
 66%|██████▌   | 25040/37963 [56:49:18<27:51:20,  7.76s/it]
 66%|██████▌   | 25041/37963 [56:49:26<27:30:05,  7.66s/it]
 66%|██████▌   | 25042/37963 [56:49:33<27:31:34,  7.67s/it]
 66%|██████▌   | 25043/37963 [56:49:41<27:40:50,  7.71s/it]
 66%|██████▌   | 25044/37963 [56:49:49<27:39:41,  7.71s/it]
 66%|██████▌   | 25045/37963 [56:49:57<27:40:34,  7.71s/it]
 66%|██████▌   | 25046/37963 [56:50:05<27:52:30,  7.77s/it]
 66%|██████▌   | 25047/37963 [56:50:15<30:20:05,  8.46s/it]
 66%|██████▌   | 25048/37963 [56:50:22<29:28:19,  8.22s/it]
 66%|██████▌   | 25049/37963 [56:50:30<29:03:36,  8.10s/it]
 66%|██████▌   | 25050/37963 [56:50:38<28:57:39,  8.07s/it]
                                                           
{'loss': '0.1339', 'grad_norm': '2.409', 'learning_rate': '5.48e-06', 'epoch': '0.6599'}
+
 66%|██████▌   | 25050/37963 [56:50:38<28:57:39,  8.07s/it]
 66%|██████▌   | 25051/37963 [56:50:46<28:32:47,  7.96s/it]
 66%|██████▌   | 25052/37963 [56:50:54<28:18:13,  7.89s/it]
 66%|██████▌   | 25053/37963 [56:51:01<28:04:36,  7.83s/it]
 66%|██████▌   | 25054/37963 [56:51:12<30:53:06,  8.61s/it]
 66%|██████▌   | 25055/37963 [56:51:20<30:03:18,  8.38s/it]
 66%|██████▌   | 25056/37963 [56:51:30<31:53:47,  8.90s/it]
 66%|██████▌   | 25057/37963 [56:51:38<30:45:28,  8.58s/it]
 66%|██████▌   | 25058/37963 [56:51:45<29:58:34,  8.36s/it]
 66%|██████▌   | 25059/37963 [56:51:53<29:28:12,  8.22s/it]
 66%|██████▌   | 25060/37963 [56:52:01<28:54:25,  8.07s/it]
                                                           
{'loss': '0.1346', 'grad_norm': '1.185', 'learning_rate': '5.472e-06', 'epoch': '0.6601'}
+
 66%|██████▌   | 25060/37963 [56:52:01<28:54:25,  8.07s/it]
 66%|██████▌   | 25061/37963 [56:52:09<28:46:31,  8.03s/it]
 66%|██████▌   | 25062/37963 [56:52:16<28:17:10,  7.89s/it]
 66%|██████▌   | 25063/37963 [56:52:24<28:17:10,  7.89s/it]
 66%|██████▌   | 25064/37963 [56:52:32<28:05:08,  7.84s/it]
 66%|██████▌   | 25065/37963 [56:52:40<27:53:21,  7.78s/it]
 66%|██████▌   | 25066/37963 [56:52:47<27:45:45,  7.75s/it]
 66%|██████▌   | 25067/37963 [56:52:55<27:20:58,  7.63s/it]
 66%|██████▌   | 25068/37963 [56:53:03<27:44:22,  7.74s/it]
 66%|██████▌   | 25069/37963 [56:53:10<27:40:07,  7.73s/it]
 66%|██████▌   | 25070/37963 [56:53:18<27:47:59,  7.76s/it]
                                                           
{'loss': '0.1324', 'grad_norm': '0.8957', 'learning_rate': '5.464e-06', 'epoch': '0.6604'}
+
 66%|██████▌   | 25070/37963 [56:53:18<27:47:59,  7.76s/it]
 66%|██████▌   | 25071/37963 [56:53:26<27:43:29,  7.74s/it]
 66%|██████▌   | 25072/37963 [56:53:34<27:49:53,  7.77s/it]
 66%|██████▌   | 25073/37963 [56:53:47<34:00:21,  9.50s/it]
 66%|██████▌   | 25074/37963 [56:53:55<32:05:28,  8.96s/it]
 66%|██████▌   | 25075/37963 [56:54:03<30:33:21,  8.54s/it]
 66%|██████▌   | 25076/37963 [56:54:13<32:40:14,  9.13s/it]
 66%|██████▌   | 25077/37963 [56:54:23<33:59:09,  9.49s/it]
 66%|██████▌   | 25078/37963 [56:54:31<31:47:48,  8.88s/it]
 66%|██████▌   | 25079/37963 [56:54:38<30:20:53,  8.48s/it]
 66%|██████▌   | 25080/37963 [56:54:46<29:26:09,  8.23s/it]
                                                           
{'loss': '0.1447', 'grad_norm': '1.618', 'learning_rate': '5.457e-06', 'epoch': '0.6606'}
+
 66%|██████▌   | 25080/37963 [56:54:46<29:26:09,  8.23s/it]
 66%|██████▌   | 25081/37963 [56:54:54<28:40:58,  8.02s/it]
 66%|██████▌   | 25082/37963 [56:55:01<28:16:36,  7.90s/it]
 66%|██████▌   | 25083/37963 [56:55:09<28:05:47,  7.85s/it]
 66%|██████▌   | 25084/37963 [56:55:17<27:54:07,  7.80s/it]
 66%|██████▌   | 25085/37963 [56:55:24<27:45:38,  7.76s/it]
 66%|██████▌   | 25086/37963 [56:55:32<27:39:37,  7.73s/it]
 66%|██████▌   | 25087/37963 [56:55:40<28:02:25,  7.84s/it]
 66%|██████▌   | 25088/37963 [56:55:48<27:45:28,  7.76s/it]
 66%|██████▌   | 25089/37963 [56:55:55<27:30:07,  7.69s/it]
 66%|██████▌   | 25090/37963 [56:56:03<27:37:46,  7.73s/it]
                                                           
{'loss': '0.1335', 'grad_norm': '1.453', 'learning_rate': '5.449e-06', 'epoch': '0.6609'}
+
 66%|██████▌   | 25090/37963 [56:56:03<27:37:46,  7.73s/it]
 66%|██████▌   | 25091/37963 [56:56:11<27:39:26,  7.74s/it]
 66%|██████▌   | 25092/37963 [56:56:18<27:37:56,  7.73s/it]
 66%|██████▌   | 25093/37963 [56:56:26<27:53:53,  7.80s/it]
 66%|██████▌   | 25094/37963 [56:56:34<27:21:48,  7.65s/it]
 66%|██████▌   | 25095/37963 [56:56:41<27:15:04,  7.62s/it]
 66%|██████▌   | 25096/37963 [56:56:49<27:25:16,  7.67s/it]
 66%|██████▌   | 25097/37963 [56:56:57<27:37:40,  7.73s/it]
 66%|██████▌   | 25098/37963 [56:57:05<27:44:42,  7.76s/it]
 66%|██████���   | 25099/37963 [56:57:13<27:53:28,  7.81s/it]
 66%|██████▌   | 25100/37963 [56:57:23<30:17:51,  8.48s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '3.082', 'learning_rate': '5.442e-06', 'epoch': '0.6612'}
+
 66%|██████▌   | 25100/37963 [56:57:23<30:17:51,  8.48s/it]
 66%|██████▌   | 25101/37963 [56:57:33<32:38:35,  9.14s/it]
 66%|██████▌   | 25102/37963 [56:57:44<33:56:19,  9.50s/it]
 66%|██████▌   | 25103/37963 [56:57:52<32:08:51,  9.00s/it]
 66%|██████▌   | 25104/37963 [56:57:59<30:26:40,  8.52s/it]
 66%|██████▌   | 25105/37963 [56:58:07<29:53:59,  8.37s/it]
 66%|██████▌   | 25106/37963 [56:58:15<29:25:50,  8.24s/it]
 66%|██████▌   | 25107/37963 [56:58:23<29:08:50,  8.16s/it]
 66%|██████▌   | 25108/37963 [56:58:30<28:13:00,  7.90s/it]
 66%|██████▌   | 25109/37963 [56:58:38<28:14:50,  7.91s/it]
 66%|██████▌   | 25110/37963 [56:58:46<28:13:54,  7.91s/it]
                                                           
{'loss': '0.1252', 'grad_norm': '1.953', 'learning_rate': '5.434e-06', 'epoch': '0.6614'}
+
 66%|██████▌   | 25110/37963 [56:58:46<28:13:54,  7.91s/it]
 66%|██████▌   | 25111/37963 [56:58:54<28:06:18,  7.87s/it]
 66%|██████▌   | 25112/37963 [56:59:02<27:56:25,  7.83s/it]
 66%|██████▌   | 25113/37963 [56:59:09<27:46:53,  7.78s/it]
 66%|██████▌   | 25114/37963 [56:59:17<27:56:32,  7.83s/it]
 66%|██████▌   | 25115/37963 [56:59:25<27:39:40,  7.75s/it]
 66%|██████▌   | 25116/37963 [56:59:35<30:39:59,  8.59s/it]
 66%|██████▌   | 25117/37963 [56:59:46<32:31:35,  9.12s/it]
 66%|██████▌   | 25118/37963 [56:59:53<31:04:54,  8.71s/it]
 66%|██████▌   | 25119/37963 [57:00:01<30:19:29,  8.50s/it]
 66%|██████▌   | 25120/37963 [57:00:09<29:11:31,  8.18s/it]
                                                           
{'loss': '0.1333', 'grad_norm': '1.531', 'learning_rate': '5.426e-06', 'epoch': '0.6617'}
+
 66%|██████▌   | 25120/37963 [57:00:09<29:11:31,  8.18s/it]
 66%|██████▌   | 25121/37963 [57:00:17<28:37:53,  8.03s/it]
 66%|██████▌   | 25122/37963 [57:00:24<28:24:50,  7.97s/it]
 66%|██████▌   | 25123/37963 [57:00:32<28:05:37,  7.88s/it]
 66%|██████▌   | 25124/37963 [57:00:39<27:28:15,  7.70s/it]
 66%|██████▌   | 25125/37963 [57:00:50<30:15:32,  8.49s/it]
 66%|██████▌   | 25126/37963 [57:00:57<29:29:52,  8.27s/it]
 66%|██████▌   | 25127/37963 [57:01:08<31:47:31,  8.92s/it]
 66%|██████▌   | 25128/37963 [57:01:15<30:15:55,  8.49s/it]
 66%|██████▌   | 25129/37963 [57:01:23<29:28:27,  8.27s/it]
 66%|██████▌   | 25130/37963 [57:01:34<31:52:29,  8.94s/it]
                                                           
{'loss': '0.145', 'grad_norm': '2.747', 'learning_rate': '5.419e-06', 'epoch': '0.662'}
+
 66%|██████▌   | 25130/37963 [57:01:34<31:52:29,  8.94s/it]
 66%|██████▌   | 25131/37963 [57:01:41<30:37:39,  8.59s/it]
 66%|██████▌   | 25132/37963 [57:01:49<29:39:57,  8.32s/it]
 66%|██████▌   | 25133/37963 [57:01:57<29:03:56,  8.16s/it]
 66%|██████▌   | 25134/37963 [57:02:04<28:28:16,  7.99s/it]
 66%|██████▌   | 25135/37963 [57:02:12<27:56:49,  7.84s/it]
 66%|██████▌   | 25136/37963 [57:02:20<27:49:01,  7.81s/it]
 66%|██████▌   | 25137/37963 [57:02:28<27:55:14,  7.84s/it]
 66%|██████▌   | 25138/37963 [57:02:35<27:45:14,  7.79s/it]
 66%|██████▌   | 25139/37963 [57:02:43<27:32:17,  7.73s/it]
 66%|██████▌   | 25140/37963 [57:02:50<27:25:45,  7.70s/it]
                                                           
{'loss': '0.1288', 'grad_norm': '1.09', 'learning_rate': '5.411e-06', 'epoch': '0.6622'}
+
 66%|██████▌   | 25140/37963 [57:02:50<27:25:45,  7.70s/it]
 66%|██████▌   | 25141/37963 [57:02:58<27:14:03,  7.65s/it]
 66%|██████▌   | 25142/37963 [57:03:06<27:30:41,  7.72s/it]
 66%|██████▌   | 25143/37963 [57:03:14<27:43:12,  7.78s/it]
 66%|██████▌   | 25144/37963 [57:03:22<27:39:24,  7.77s/it]
 66%|██████▌   | 25145/37963 [57:03:29<27:22:47,  7.69s/it]
 66%|██████▌   | 25146/37963 [57:03:42<32:52:41,  9.23s/it]
 66%|██████▌   | 25147/37963 [57:03:50<31:36:53,  8.88s/it]
 66%|██████▌   | 25148/37963 [57:03:58<30:21:27,  8.53s/it]
 66%|██████▌   | 25149/37963 [57:04:06<29:39:35,  8.33s/it]
 66%|██████▌   | 25150/37963 [57:04:13<29:02:08,  8.16s/it]
                                                           
{'loss': '0.1387', 'grad_norm': '2.503', 'learning_rate': '5.404e-06', 'epoch': '0.6625'}
+
 66%|██████▌   | 25150/37963 [57:04:13<29:02:08,  8.16s/it]
 66%|██████▋   | 25151/37963 [57:04:21<28:30:18,  8.01s/it]
 66%|██████▋   | 25152/37963 [57:04:28<27:53:48,  7.84s/it]
 66%|██████▋   | 25153/37963 [57:04:36<27:52:07,  7.83s/it]
 66%|██████▋   | 25154/37963 [57:04:44<27:46:40,  7.81s/it]
 66%|██████▋   | 25155/37963 [57:04:54<30:34:11,  8.59s/it]
 66%|██████▋   | 25156/37963 [57:05:02<29:22:38,  8.26s/it]
 66%|██████▋   | 25157/37963 [57:05:10<28:50:49,  8.11s/it]
 66%|██████▋   | 25158/37963 [57:05:17<27:55:03,  7.85s/it]
 66%|██████▋   | 25159/37963 [57:05:25<27:50:22,  7.83s/it]
 66%|██████▋   | 25160/37963 [57:05:32<27:37:22,  7.77s/it]
                                                           
{'loss': '0.133', 'grad_norm': '2.442', 'learning_rate': '5.396e-06', 'epoch': '0.6628'}
+
 66%|██████▋   | 25160/37963 [57:05:32<27:37:22,  7.77s/it]
 66%|██████▋   | 25161/37963 [57:05:43<30:49:26,  8.67s/it]
 66%|██████▋   | 25162/37963 [57:05:51<29:53:24,  8.41s/it]
 66%|██████▋   | 25163/37963 [57:05:58<29:01:42,  8.16s/it]
 66%|██████▋   | 25164/37963 [57:06:06<28:52:25,  8.12s/it]
 66%|██████▋   | 25165/37963 [57:06:17<31:25:41,  8.84s/it]
 66%|██████▋   | 25166/37963 [57:06:25<30:25:30,  8.56s/it]
 66%|██████▋   | 25167/37963 [57:06:33<29:33:13,  8.31s/it]
 66%|██████▋   | 25168/37963 [57:06:40<28:48:39,  8.11s/it]
 66%|██████▋   | 25169/37963 [57:06:48<28:26:43,  8.00s/it]
 66%|██████▋   | 25170/37963 [57:06:56<27:55:27,  7.86s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '2.161', 'learning_rate': '5.388e-06', 'epoch': '0.663'}
+
 66%|██████▋   | 25170/37963 [57:06:56<27:55:27,  7.86s/it]
 66%|██████▋   | 25171/37963 [57:07:03<27:49:01,  7.83s/it]
 66%|██████▋   | 25172/37963 [57:07:11<27:41:18,  7.79s/it]
 66%|██████▋   | 25173/37963 [57:07:21<30:30:38,  8.59s/it]
 66%|██████▋   | 25174/37963 [57:07:29<29:43:41,  8.37s/it]
 66%|██████▋   | 25175/37963 [57:07:37<28:53:57,  8.14s/it]
 66%|██████▋   | 25176/37963 [57:07:47<31:01:20,  8.73s/it]
 66%|██████▋   | 25177/37963 [57:07:55<30:04:15,  8.47s/it]
 66%|██████▋   | 25178/37963 [57:08:03<29:30:51,  8.31s/it]
 66%|██████▋   | 25179/37963 [57:08:11<28:57:45,  8.16s/it]
 66%|██████▋   | 25180/37963 [57:08:18<28:26:05,  8.01s/it]
                                                           
{'loss': '0.1418', 'grad_norm': '2.454', 'learning_rate': '5.381e-06', 'epoch': '0.6633'}
+
 66%|██████▋   | 25180/37963 [57:08:18<28:26:05,  8.01s/it]
 66%|██████▋   | 25181/37963 [57:08:29<31:08:54,  8.77s/it]
 66%|██████▋   | 25182/37963 [57:08:37<30:11:28,  8.50s/it]
 66%|██████▋   | 25183/37963 [57:08:45<29:32:41,  8.32s/it]
 66%|██████▋   | 25184/37963 [57:08:53<29:11:34,  8.22s/it]
 66%|██████▋   | 25185/37963 [57:09:00<28:31:49,  8.04s/it]
 66%|██████▋   | 25186/37963 [57:09:08<28:18:52,  7.98s/it]
 66%|██████▋   | 25187/37963 [57:09:16<28:02:16,  7.90s/it]
 66%|██████▋   | 25188/37963 [57:09:23<27:26:55,  7.74s/it]
 66%|██████▋   | 25189/37963 [57:09:31<27:14:23,  7.68s/it]
 66%|██████▋   | 25190/37963 [57:09:38<27:15:52,  7.68s/it]
                                                           
{'loss': '0.116', 'grad_norm': '1.116', 'learning_rate': '5.373e-06', 'epoch': '0.6635'}
+
 66%|██████▋   | 25190/37963 [57:09:38<27:15:52,  7.68s/it]
 66%|██████▋   | 25191/37963 [57:09:46<27:23:07,  7.72s/it]
 66%|██████▋   | 25192/37963 [57:09:54<27:23:42,  7.72s/it]
 66%|██████▋   | 25193/37963 [57:10:02<27:20:27,  7.71s/it]
 66%|██████▋   | 25194/37963 [57:10:12<30:07:03,  8.49s/it]
 66%|██████▋   | 25195/37963 [57:10:19<29:10:14,  8.22s/it]
 66%|██████▋   | 25196/37963 [57:10:27<28:40:45,  8.09s/it]
 66%|██████▋   | 25197/37963 [57:10:38<31:01:33,  8.75s/it]
 66%|██████▋   | 25198/37963 [57:10:45<29:46:17,  8.40s/it]
 66%|██████▋   | 25199/37963 [57:10:56<32:01:19,  9.03s/it]
 66%|██████▋   | 25200/37963 [57:11:04<30:58:30,  8.74s/it]
                                                           
{'loss': '0.141', 'grad_norm': '2.439', 'learning_rate': '5.366e-06', 'epoch': '0.6638'}
+
 66%|██████▋   | 25200/37963 [57:11:04<30:58:30,  8.74s/it]
 66%|██████▋   | 25201/37963 [57:11:11<29:48:56,  8.41s/it]
 66%|██████▋   | 25202/37963 [57:11:19<29:14:13,  8.25s/it]
 66%|██████▋   | 25203/37963 [57:11:27<28:32:08,  8.05s/it]
 66%|███���██▋   | 25204/37963 [57:11:34<28:08:19,  7.94s/it]
 66%|██████▋   | 25205/37963 [57:11:42<27:49:11,  7.85s/it]
 66%|██████▋   | 25206/37963 [57:11:50<27:23:23,  7.73s/it]
 66%|██████▋   | 25207/37963 [57:11:57<27:20:57,  7.72s/it]
 66%|██████▋   | 25208/37963 [57:12:05<27:09:01,  7.66s/it]
 66%|██████▋   | 25209/37963 [57:12:12<27:10:42,  7.67s/it]
 66%|██████▋   | 25210/37963 [57:12:20<27:06:13,  7.65s/it]
                                                           
{'loss': '0.1262', 'grad_norm': '2.191', 'learning_rate': '5.358e-06', 'epoch': '0.6641'}
+
 66%|██████▋   | 25210/37963 [57:12:20<27:06:13,  7.65s/it]
 66%|██████▋   | 25211/37963 [57:12:28<27:09:16,  7.67s/it]
 66%|██████▋   | 25212/37963 [57:12:36<27:22:39,  7.73s/it]
 66%|██████▋   | 25213/37963 [57:12:46<30:21:17,  8.57s/it]
 66%|██████▋   | 25214/37963 [57:12:54<29:41:46,  8.39s/it]
 66%|██████▋   | 25215/37963 [57:13:05<32:06:48,  9.07s/it]
 66%|██████▋   | 25216/37963 [57:13:13<30:48:57,  8.70s/it]
 66%|██████▋   | 25217/37963 [57:13:20<29:47:48,  8.42s/it]
 66%|██████▋   | 25218/37963 [57:13:28<28:51:05,  8.15s/it]
 66%|██████▋   | 25219/37963 [57:13:36<28:38:36,  8.09s/it]
 66%|██████▋   | 25220/37963 [57:13:44<28:14:50,  7.98s/it]
                                                           
{'loss': '0.1362', 'grad_norm': '2.584', 'learning_rate': '5.351e-06', 'epoch': '0.6643'}
+
 66%|██████▋   | 25220/37963 [57:13:44<28:14:50,  7.98s/it]
 66%|██████▋   | 25221/37963 [57:13:51<28:06:18,  7.94s/it]
 66%|██████▋   | 25222/37963 [57:14:02<30:50:20,  8.71s/it]
 66%|██████▋   | 25223/37963 [57:14:13<32:50:54,  9.28s/it]
 66%|██████▋   | 25224/37963 [57:14:21<31:29:17,  8.90s/it]
 66%|██████▋   | 25225/37963 [57:14:29<30:28:11,  8.61s/it]
 66%|██████▋   | 25226/37963 [57:14:36<29:41:39,  8.39s/it]
 66%|██████▋   | 25227/37963 [57:14:44<29:11:38,  8.25s/it]
 66%|██████▋   | 25228/37963 [57:14:52<28:49:39,  8.15s/it]
 66%|██████▋   | 25229/37963 [57:15:00<28:14:51,  7.99s/it]
 66%|██████▋   | 25230/37963 [57:15:08<28:10:13,  7.96s/it]
                                                           
{'loss': '0.1556', 'grad_norm': '1.75', 'learning_rate': '5.343e-06', 'epoch': '0.6646'}
+
 66%|██████▋   | 25230/37963 [57:15:08<28:10:13,  7.96s/it]
 66%|██████▋   | 25231/37963 [57:15:15<27:42:09,  7.83s/it]
 66%|██████▋   | 25232/37963 [57:15:23<27:35:08,  7.80s/it]
 66%|██████▋   | 25233/37963 [57:15:31<27:39:05,  7.82s/it]
 66%|██████▋   | 25234/37963 [57:15:39<27:27:33,  7.77s/it]
 66%|██████▋   | 25235/37963 [57:15:49<30:09:36,  8.53s/it]
 66%|██████▋   | 25236/37963 [57:15:57<29:25:40,  8.32s/it]
 66%|██████▋   | 25237/37963 [57:16:05<29:03:57,  8.22s/it]
 66%|██████▋   | 25238/37963 [57:16:12<28:30:58,  8.07s/it]
 66%|██████▋   | 25239/37963 [57:16:20<28:14:51,  7.99s/it]
 66%|██████▋   | 25240/37963 [57:16:28<27:56:51,  7.91s/it]
                                                           
{'loss': '0.1363', 'grad_norm': '1.745', 'learning_rate': '5.336e-06', 'epoch': '0.6649'}
+
 66%|██████▋   | 25240/37963 [57:16:28<27:56:51,  7.91s/it]
 66%|██████▋   | 25241/37963 [57:16:36<27:48:38,  7.87s/it]
 66%|██████▋   | 25242/37963 [57:16:46<30:37:25,  8.67s/it]
 66%|██████▋   | 25243/37963 [57:16:54<29:44:05,  8.42s/it]
 66%|██████▋   | 25244/37963 [57:17:02<29:06:01,  8.24s/it]
 66%|██████▋   | 25245/37963 [57:17:12<31:17:28,  8.86s/it]
 67%|██████▋   | 25246/37963 [57:17:20<30:20:23,  8.59s/it]
 67%|██████▋   | 25247/37963 [57:17:28<29:29:30,  8.35s/it]
 67%|██████▋   | 25248/37963 [57:17:35<28:41:28,  8.12s/it]
 67%|██████▋   | 25249/37963 [57:17:43<28:11:54,  7.98s/it]
 67%|██████▋   | 25250/37963 [57:17:51<28:09:00,  7.97s/it]
                                                           
{'loss': '0.1274', 'grad_norm': '3.073', 'learning_rate': '5.328e-06', 'epoch': '0.6651'}
+
 67%|██████▋   | 25250/37963 [57:17:51<28:09:00,  7.97s/it]
 67%|██████▋   | 25251/37963 [57:17:59<28:14:06,  8.00s/it]
 67%|██████▋   | 25252/37963 [57:18:07<27:57:42,  7.92s/it]
 67%|██████▋   | 25253/37963 [57:18:17<30:29:35,  8.64s/it]
 67%|██████▋   | 25254/37963 [57:18:25<29:40:06,  8.40s/it]
 67%|██████▋   | 25255/37963 [57:18:33<28:53:10,  8.18s/it]
 67%|██████▋   | 25256/37963 [57:18:40<28:21:31,  8.03s/it]
 67%|██████▋   | 25257/37963 [57:18:48<28:17:24,  8.02s/it]
 67%|█��████▋   | 25258/37963 [57:18:56<27:51:15,  7.89s/it]
 67%|██████▋   | 25259/37963 [57:19:04<27:35:23,  7.82s/it]
 67%|██████▋   | 25260/37963 [57:19:12<27:39:47,  7.84s/it]
                                                           
{'loss': '0.1267', 'grad_norm': '2.833', 'learning_rate': '5.32e-06', 'epoch': '0.6654'}
+
 67%|██████▋   | 25260/37963 [57:19:12<27:39:47,  7.84s/it]
 67%|██████▋   | 25261/37963 [57:19:19<27:24:51,  7.77s/it]
 67%|██████▋   | 25262/37963 [57:19:27<27:34:15,  7.81s/it]
 67%|██████▋   | 25263/37963 [57:19:38<30:31:34,  8.65s/it]
 67%|██████▋   | 25264/37963 [57:19:46<29:42:45,  8.42s/it]
 67%|██████▋   | 25265/37963 [57:19:56<31:53:13,  9.04s/it]
 67%|██████▋   | 25266/37963 [57:20:04<30:36:13,  8.68s/it]
 67%|██████▋   | 25267/37963 [57:20:17<35:37:14, 10.10s/it]
 67%|██████▋   | 25268/37963 [57:20:25<32:58:59,  9.35s/it]
 67%|██████▋   | 25269/37963 [57:20:33<31:09:30,  8.84s/it]
 67%|██████▋   | 25270/37963 [57:20:40<29:56:35,  8.49s/it]
                                                           
{'loss': '0.1376', 'grad_norm': '2.667', 'learning_rate': '5.313e-06', 'epoch': '0.6657'}
+
 67%|██████▋   | 25270/37963 [57:20:40<29:56:35,  8.49s/it]
 67%|██████▋   | 25271/37963 [57:20:48<29:17:16,  8.31s/it]
 67%|██████▋   | 25272/37963 [57:20:56<28:52:18,  8.19s/it]
 67%|██████▋   | 25273/37963 [57:21:04<28:18:04,  8.03s/it]
 67%|██████▋   | 25274/37963 [57:21:11<27:55:11,  7.92s/it]
 67%|██████▋   | 25275/37963 [57:21:19<27:29:32,  7.80s/it]
 67%|██████▋   | 25276/37963 [57:21:27<27:34:01,  7.82s/it]
 67%|██████▋   | 25277/37963 [57:21:35<27:33:51,  7.82s/it]
 67%|██████▋   | 25278/37963 [57:21:42<27:37:39,  7.84s/it]
 67%|██████▋   | 25279/37963 [57:21:50<27:32:14,  7.82s/it]
 67%|██████▋   | 25280/37963 [57:21:58<27:42:16,  7.86s/it]
                                                           
{'loss': '0.1334', 'grad_norm': '2.004', 'learning_rate': '5.305e-06', 'epoch': '0.6659'}
+
 67%|██████▋   | 25280/37963 [57:21:58<27:42:16,  7.86s/it]
 67%|██████▋   | 25281/37963 [57:22:06<27:44:24,  7.87s/it]
 67%|██████▋   | 25282/37963 [57:22:14<27:41:23,  7.86s/it]
 67%|██████▋   | 25283/37963 [57:22:22<27:39:44,  7.85s/it]
 67%|██████▋   | 25284/37963 [57:22:30<27:39:09,  7.85s/it]
 67%|██████▋   | 25285/37963 [57:22:37<27:21:49,  7.77s/it]
 67%|██████▋   | 25286/37963 [57:22:48<30:11:47,  8.58s/it]
 67%|██████▋   | 25287/37963 [57:22:55<29:27:07,  8.36s/it]
 67%|██████▋   | 25288/37963 [57:23:03<28:48:30,  8.18s/it]
 67%|██████▋   | 25289/37963 [57:23:14<31:07:23,  8.84s/it]
 67%|██████▋   | 25290/37963 [57:23:21<29:55:27,  8.50s/it]
                                                           
{'loss': '0.1347', 'grad_norm': '2.228', 'learning_rate': '5.298e-06', 'epoch': '0.6662'}
+
 67%|██████▋   | 25290/37963 [57:23:21<29:55:27,  8.50s/it]
 67%|██████▋   | 25291/37963 [57:23:29<28:41:32,  8.15s/it]
 67%|██████▋   | 25292/37963 [57:23:36<28:10:51,  8.01s/it]
 67%|██████▋   | 25293/37963 [57:23:44<27:47:07,  7.89s/it]
 67%|██████▋   | 25294/37963 [57:23:52<27:30:54,  7.82s/it]
 67%|██████▋   | 25295/37963 [57:24:02<29:58:19,  8.52s/it]
 67%|██████▋   | 25296/37963 [57:24:10<29:10:21,  8.29s/it]
 67%|██████▋   | 25297/37963 [57:24:17<28:47:23,  8.18s/it]
 67%|██████▋   | 25298/37963 [57:24:25<28:20:33,  8.06s/it]
 67%|██████▋   | 25299/37963 [57:24:33<27:56:07,  7.94s/it]
 67%|██████▋   | 25300/37963 [57:24:40<27:35:41,  7.85s/it]
                                                           
{'loss': '0.1306', 'grad_norm': '2.738', 'learning_rate': '5.29e-06', 'epoch': '0.6664'}
+
 67%|██████▋   | 25300/37963 [57:24:40<27:35:41,  7.85s/it]
 67%|██████▋   | 25301/37963 [57:24:48<27:41:38,  7.87s/it]
 67%|██████▋   | 25302/37963 [57:24:56<27:22:37,  7.78s/it]
 67%|██████▋   | 25303/37963 [57:25:04<27:35:03,  7.84s/it]
 67%|██████▋   | 25304/37963 [57:25:12<27:23:46,  7.79s/it]
 67%|██████▋   | 25305/37963 [57:25:19<26:50:49,  7.64s/it]
 67%|██████▋   | 25306/37963 [57:25:27<27:03:17,  7.70s/it]
 67%|██████▋   | 25307/37963 [57:25:37<29:57:35,  8.52s/it]
 67%|██████▋   | 25308/37963 [57:25:45<29:15:38,  8.32s/it]
 67%|██████▋   | 25309/37963 [57:25:53<28:40:15,  8.16s/it]
 67%|██████▋   | 25310/37963 [57:26:01<28:15:10,  8.04s/it]
                                                           
{'loss': '0.1399', 'grad_norm': '2.299', 'learning_rate': '5.283e-06', 'epoch': '0.6667'}
+
 67%|██████▋   | 25310/37963 [57:26:01<28:15:10,  8.04s/it]
 67%|██████▋   | 25311/37963 [57:26:08<27:59:48,  7.97s/it]
 67%|██████▋   | 25312/37963 [57:26:16<27:53:43,  7.94s/it]
 67%|██████▋   | 25313/37963 [57:26:27<30:24:21,  8.65s/it]
 67%|██████▋   | 25314/37963 [57:26:34<29:11:47,  8.31s/it]
 67%|██████▋   | 25315/37963 [57:26:44<31:17:57,  8.91s/it]
 67%|██████▋   | 25316/37963 [57:26:52<30:01:32,  8.55s/it]
 67%|██████▋   | 25317/37963 [57:27:00<28:59:44,  8.25s/it]
 67%|██████▋   | 25318/37963 [57:27:10<31:37:14,  9.00s/it]
 67%|██████▋   | 25319/37963 [57:27:18<30:20:11,  8.64s/it]
 67%|██████▋   | 25320/37963 [57:27:26<29:33:41,  8.42s/it]
                                                           
{'loss': '0.123', 'grad_norm': '2.146', 'learning_rate': '5.275e-06', 'epoch': '0.667'}
+
 67%|██████▋   | 25320/37963 [57:27:26<29:33:41,  8.42s/it]
 67%|██████▋   | 25321/37963 [57:27:37<31:43:37,  9.03s/it]
 67%|██████▋   | 25322/37963 [57:27:44<29:59:46,  8.54s/it]
 67%|██████▋   | 25323/37963 [57:27:52<29:11:25,  8.31s/it]
 67%|██████▋   | 25324/37963 [57:28:00<28:39:37,  8.16s/it]
 67%|██████▋   | 25325/37963 [57:28:07<28:18:23,  8.06s/it]
 67%|██████▋   | 25326/37963 [57:28:15<28:09:48,  8.02s/it]
 67%|██████▋   | 25327/37963 [57:28:23<27:48:59,  7.92s/it]
 67%|██████▋   | 25328/37963 [57:28:31<27:34:32,  7.86s/it]
 67%|██████▋   | 25329/37963 [57:28:38<27:26:20,  7.82s/it]
 67%|██████▋   | 25330/37963 [57:28:46<27:22:58,  7.80s/it]
                                                           
{'loss': '0.1266', 'grad_norm': '3.146', 'learning_rate': '5.268e-06', 'epoch': '0.6672'}
+
 67%|██████▋   | 25330/37963 [57:28:46<27:22:58,  7.80s/it]
 67%|██████▋   | 25331/37963 [57:28:54<27:13:04,  7.76s/it]
 67%|██████▋   | 25332/37963 [57:29:02<27:11:02,  7.75s/it]
 67%|██████▋   | 25333/37963 [57:29:09<26:56:50,  7.68s/it]
 67%|██████▋   | 25334/37963 [57:29:20<30:05:48,  8.58s/it]
 67%|██████▋   | 25335/37963 [57:29:27<29:03:16,  8.28s/it]
 67%|██████▋   | 25336/37963 [57:29:35<28:48:11,  8.21s/it]
 67%|██████▋   | 25337/37963 [57:29:43<28:20:23,  8.08s/it]
 67%|██████▋   | 25338/37963 [57:29:51<27:54:16,  7.96s/it]
 67%|██████▋   | 25339/37963 [57:29:59<27:45:25,  7.92s/it]
 67%|██████▋   | 25340/37963 [57:30:06<27:27:48,  7.83s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '1.558', 'learning_rate': '5.26e-06', 'epoch': '0.6675'}
+
 67%|██████▋   | 25340/37963 [57:30:06<27:27:48,  7.83s/it]
 67%|██████▋   | 25341/37963 [57:30:14<27:24:09,  7.82s/it]
 67%|██████▋   | 25342/37963 [57:30:22<27:39:27,  7.89s/it]
 67%|██████▋   | 25343/37963 [57:30:33<30:40:31,  8.75s/it]
 67%|██████▋   | 25344/37963 [57:30:41<29:45:52,  8.49s/it]
 67%|██████▋   | 25345/37963 [57:30:49<28:53:30,  8.24s/it]
 67%|██████▋   | 25346/37963 [57:30:56<28:22:57,  8.10s/it]
 67%|██████▋   | 25347/37963 [57:31:04<27:59:55,  7.99s/it]
 67%|██████▋   | 25348/37963 [57:31:11<27:25:04,  7.82s/it]
 67%|██████▋   | 25349/37963 [57:31:19<27:15:40,  7.78s/it]
 67%|██████▋   | 25350/37963 [57:31:27<27:11:17,  7.76s/it]
                                                           
{'loss': '0.1342', 'grad_norm': '2.513', 'learning_rate': '5.253e-06', 'epoch': '0.6678'}
+
 67%|██████▋   | 25350/37963 [57:31:27<27:11:17,  7.76s/it]
 67%|██████▋   | 25351/37963 [57:31:35<27:08:36,  7.75s/it]
 67%|██████▋   | 25352/37963 [57:31:42<26:59:18,  7.70s/it]
 67%|██████▋   | 25353/37963 [57:31:53<29:50:08,  8.52s/it]
 67%|██████▋   | 25354/37963 [57:32:00<28:57:57,  8.27s/it]
 67%|██████▋   | 25355/37963 [57:32:08<28:35:21,  8.16s/it]
 67%|██████▋   | 25356/37963 [57:32:16<28:19:03,  8.09s/it]
 67%|██████▋   | 25357/37963 [57:32:24<27:57:39,  7.99s/it]
 67%|██████▋   | 25358/37963 [57:32:32<27:46:06,  7.93s/it]
 67%|██████▋   | 25359/37963 [57:32:39<27:26:14,  7.84s/it]
 67%|██████▋   | 25360/37963 [57:32:47<27:25:43,  7.83s/it]
                                                           
{'loss': '0.1186', 'grad_norm': '1.585', 'learning_rate': '5.245e-06', 'epoch': '0.668'}
+
 67%|██████▋   | 25360/37963 [57:32:47<27:25:43,  7.83s/it]
 67%|██████▋   | 25361/37963 [57:32:55<27:27:40,  7.84s/it]
 67%|██████▋   | 25362/37963 [57:33:05<30:15:17,  8.64s/it]
 67%|██████▋   | 25363/37963 [57:33:13<29:03:51,  8.30s/it]
 67%|██████▋   | 25364/37963 [57:33:21<28:29:32,  8.14s/it]
 67%|██████▋   | 25365/37963 [57:33:28<28:01:47,  8.01s/it]
 67%|██████▋   | 25366/37963 [57:33:36<27:38:31,  7.90s/it]
 67%|██████▋   | 25367/37963 [57:33:44<27:36:14,  7.89s/it]
 67%|██████▋   | 25368/37963 [57:33:52<27:23:30,  7.83s/it]
 67%|██████▋   | 25369/37963 [57:34:05<33:11:01,  9.49s/it]
 67%|██████▋   | 25370/37963 [57:34:13<31:09:42,  8.91s/it]
                                                           
{'loss': '0.1338', 'grad_norm': '2.427', 'learning_rate': '5.238e-06', 'epoch': '0.6683'}
+
 67%|██████▋   | 25370/37963 [57:34:13<31:09:42,  8.91s/it]
 67%|██████▋   | 25371/37963 [57:34:20<29:57:19,  8.56s/it]
 67%|██████▋   | 25372/37963 [57:34:31<32:02:14,  9.16s/it]
 67%|██████▋   | 25373/37963 [57:34:39<30:33:59,  8.74s/it]
 67%|██████▋   | 25374/37963 [57:34:46<29:26:42,  8.42s/it]
 67%|██████▋   | 25375/37963 [57:34:54<28:44:06,  8.22s/it]
 67%|██████▋   | 25376/37963 [57:35:02<28:13:55,  8.07s/it]
 67%|██████▋   | 25377/37963 [57:35:10<28:00:41,  8.01s/it]
 67%|██████▋   | 25378/37963 [57:35:18<27:55:35,  7.99s/it]
 67%|██████▋   | 25379/37963 [57:35:25<27:43:36,  7.93s/it]
 67%|██████▋   | 25380/37963 [57:35:33<27:10:29,  7.77s/it]
                                                           
{'loss': '0.1433', 'grad_norm': '1.912', 'learning_rate': '5.23e-06', 'epoch': '0.6685'}
+
 67%|██████▋   | 25380/37963 [57:35:33<27:10:29,  7.77s/it]
 67%|██████▋   | 25381/37963 [57:35:41<27:13:27,  7.79s/it]
 67%|██████▋   | 25382/37963 [57:35:48<26:52:54,  7.69s/it]
 67%|██████▋   | 25383/37963 [57:35:56<26:51:43,  7.69s/it]
 67%|██████▋   | 25384/37963 [57:36:04<26:58:51,  7.72s/it]
 67%|██████▋   | 25385/37963 [57:36:11<27:12:45,  7.79s/it]
 67%|██████▋   | 25386/37963 [57:36:19<26:59:24,  7.73s/it]
 67%|██████▋   | 25387/37963 [57:36:32<32:14:31,  9.23s/it]
 67%|██████▋   | 25388/37963 [57:36:39<30:34:03,  8.75s/it]
 67%|██████▋   | 25389/37963 [57:36:47<29:24:50,  8.42s/it]
 67%|██████▋   | 25390/37963 [57:36:55<28:49:34,  8.25s/it]
                                                           
{'loss': '0.1339', 'grad_norm': '1.431', 'learning_rate': '5.223e-06', 'epoch': '0.6688'}
+
 67%|██████▋   | 25390/37963 [57:36:55<28:49:34,  8.25s/it]
 67%|██████▋   | 25391/37963 [57:37:03<28:20:15,  8.11s/it]
 67%|██████▋   | 25392/37963 [57:37:11<27:59:05,  8.01s/it]
 67%|██████▋   | 25393/37963 [57:37:18<27:42:22,  7.94s/it]
 67%|██████▋   | 25394/37963 [57:37:26<27:27:11,  7.86s/it]
 67%|██████▋   | 25395/37963 [57:37:34<27:07:58,  7.77s/it]
 67%|██████▋   | 25396/37963 [57:37:41<26:55:17,  7.71s/it]
 67%|██████▋   | 25397/37963 [57:37:52<30:00:55,  8.60s/it]
 67%|██████▋   | 25398/37963 [57:38:00<29:13:24,  8.37s/it]
 67%|██████▋   | 25399/37963 [57:38:07<28:37:29,  8.20s/it]
 67%|██████▋   | 25400/37963 [57:38:15<27:57:19,  8.01s/it]
                                                           
{'loss': '0.1355', 'grad_norm': '2.015', 'learning_rate': '5.215e-06', 'epoch': '0.6691'}
+
 67%|██████▋   | 25400/37963 [57:38:15<27:57:19,  8.01s/it]
 67%|██████▋   | 25401/37963 [57:38:23<27:37:06,  7.91s/it]
 67%|██████▋   | 25402/37963 [57:38:30<27:30:46,  7.89s/it]
 67%|██████▋   | 25403/37963 [57:38:38<27:17:36,  7.82s/it]
 67%|██████▋   | 25404/37963 [57:38:46<27:14:05,  7.81s/it]
 67%|██████▋   | 25405/37963 [57:38:54<27:10:41,  7.79s/it]
 67%|██████▋   | 25406/37963 [57:39:01<27:10:11,  7.79s/it]
 67%|██████▋   | 25407/37963 [57:39:12<30:00:01,  8.60s/it]
 67%|██████▋   | 25408/37963 [57:39:20<29:12:39,  8.38s/it]
 67%|██████▋   | 25409/37963 [57:39:28<28:54:47,  8.29s/it]
 67%|██████▋   | 25410/37963 [57:39:38<30:58:48,  8.88s/it]
                                                           
{'loss': '0.1347', 'grad_norm': '1.785', 'learning_rate': '5.208e-06', 'epoch': '0.6693'}
+
 67%|██████▋   | 25410/37963 [57:39:38<30:58:48,  8.88s/it]
 67%|██████▋   | 25411/37963 [57:39:46<29:52:27,  8.57s/it]
 67%|██████▋   | 25412/37963 [57:39:54<29:08:54,  8.36s/it]
 67%|██████▋   | 25413/37963 [57:40:02<28:37:44,  8.21s/it]
 67%|██████▋   | 25414/37963 [57:40:12<30:57:06,  8.88s/it]
 67%|██████▋   | 25415/37963 [57:40:20<29:51:59,  8.57s/it]
 67%|██████▋   | 25416/37963 [57:40:28<28:59:55,  8.32s/it]
 67%|██████▋   | 25417/37963 [57:40:35<28:20:29,  8.13s/it]
 67%|██████▋   | 25418/37963 [57:40:43<28:05:50,  8.06s/it]
 67%|██████▋   | 25419/37963 [57:40:54<30:46:31,  8.83s/it]
 67%|██████▋   | 25420/37963 [57:41:02<29:48:39,  8.56s/it]
                                                           
{'loss': '0.1293', 'grad_norm': '1.73', 'learning_rate': '5.2e-06', 'epoch': '0.6696'}
+
 67%|██████▋   | 25420/37963 [57:41:02<29:48:39,  8.56s/it]
 67%|██████▋   | 25421/37963 [57:41:09<28:43:12,  8.24s/it]
 67%|██████▋   | 25422/37963 [57:41:17<27:57:22,  8.03s/it]
 67%|██████▋   | 25423/37963 [57:41:25<27:37:12,  7.93s/it]
 67%|██████▋   | 25424/37963 [57:41:32<27:27:36,  7.88s/it]
 67%|██████▋   | 25425/37963 [57:41:40<27:18:54,  7.84s/it]
 67%|██████▋   | 25426/37963 [57:41:51<30:06:54,  8.65s/it]
 67%|██████▋   | 25427/37963 [57:41:58<29:09:56,  8.38s/it]
 67%|██████▋   | 25428/37963 [57:42:06<28:17:54,  8.13s/it]
 67%|██████▋   | 25429/37963 [57:42:14<28:05:08,  8.07s/it]
 67%|██████▋   | 25430/37963 [57:42:22<27:47:15,  7.98s/it]
                                                           
{'loss': '0.1432', 'grad_norm': '1.689', 'learning_rate': '5.193e-06', 'epoch': '0.6699'}
+
 67%|██████▋   | 25430/37963 [57:42:22<27:47:15,  7.98s/it]
 67%|██████▋   | 25431/37963 [57:42:35<33:07:30,  9.52s/it]
 67%|██████▋   | 25432/37963 [57:42:43<31:19:16,  9.00s/it]
 67%|██████▋   | 25433/37963 [57:42:50<30:03:05,  8.63s/it]
 67%|██████▋   | 25434/37963 [57:42:58<28:28:49,  8.18s/it]
 67%|██████▋   | 25435/37963 [57:43:06<28:20:45,  8.15s/it]
 67%|██████▋   | 25436/37963 [57:43:14<28:15:24,  8.12s/it]
 67%|██████▋   | 25437/37963 [57:43:21<27:51:09,  8.00s/it]
 67%|██████▋   | 25438/37963 [57:43:29<27:15:27,  7.83s/it]
 67%|██████▋   | 25439/37963 [57:43:36<27:04:12,  7.78s/it]
 67%|██████▋   | 25440/37963 [57:43:44<27:05:22,  7.79s/it]
                                                           
{'loss': '0.1291', 'grad_norm': '1.34', 'learning_rate': '5.185e-06', 'epoch': '0.6701'}
+
 67%|██████▋   | 25440/37963 [57:43:44<27:05:22,  7.79s/it]
 67%|██████▋   | 25441/37963 [57:43:52<26:57:27,  7.75s/it]
 67%|██████▋   | 25442/37963 [57:44:00<27:08:25,  7.80s/it]
 67%|██████▋   | 25443/37963 [57:44:08<27:05:02,  7.79s/it]
 67%|██████▋   | 25444/37963 [57:44:15<26:51:35,  7.72s/it]
 67%|██████▋   | 25445/37963 [57:44:23<26:38:24,  7.66s/it]
 67%|██████▋   | 25446/37963 [57:44:31<26:52:39,  7.73s/it]
 67%|██████▋   | 25447/37963 [57:44:38<26:54:52,  7.74s/it]
 67%|██████▋   | 25448/37963 [57:44:46<26:57:59,  7.76s/it]
 67%|██████▋   | 25449/37963 [57:44:54<26:57:16,  7.75s/it]
 67%|██████▋   | 25450/37963 [57:45:02<26:54:39,  7.74s/it]
                                                           
{'loss': '0.139', 'grad_norm': '1.743', 'learning_rate': '5.178e-06', 'epoch': '0.6704'}
+
 67%|██████▋   | 25450/37963 [57:45:02<26:54:39,  7.74s/it]
 67%|██████▋   | 25451/37963 [57:45:15<32:35:59,  9.38s/it]
 67%|██████▋   | 25452/37963 [57:45:23<31:08:21,  8.96s/it]
 67%|██████▋   | 25453/37963 [57:45:30<29:42:47,  8.55s/it]
 67%|██████▋   | 25454/37963 [57:45:38<28:29:55,  8.20s/it]
 67%|██████▋   | 25455/37963 [57:45:45<27:42:48,  7.98s/it]
 67%|██████▋   | 25456/37963 [57:45:53<27:33:18,  7.93s/it]
 67%|██████▋   | 25457/37963 [57:46:01<27:22:42,  7.88s/it]
 67%|██████▋   | 25458/37963 [57:46:11<29:45:42,  8.57s/it]
 67%|██████▋   | 25459/37963 [57:46:19<29:02:33,  8.36s/it]
 67%|██████▋   | 25460/37963 [57:46:27<28:20:31,  8.16s/it]
                                                           
{'loss': '0.1268', 'grad_norm': '2.02', 'learning_rate': '5.17e-06', 'epoch': '0.6707'}
+
 67%|██████▋   | 25460/37963 [57:46:27<28:20:31,  8.16s/it]
 67%|██████▋   | 25461/37963 [57:46:34<27:58:00,  8.05s/it]
 67%|██████▋   | 25462/37963 [57:46:45<30:51:56,  8.89s/it]
 67%|██████▋   | 25463/37963 [57:46:53<29:46:51,  8.58s/it]
 67%|██████▋   | 25464/37963 [57:47:01<28:48:09,  8.30s/it]
 67%|██████▋   | 25465/37963 [57:47:08<28:05:58,  8.09s/it]
 67%|██████▋   | 25466/37963 [57:47:16<27:34:33,  7.94s/it]
 67%|██████▋   | 25467/37963 [57:47:24<27:16:38,  7.86s/it]
 67%|██████▋   | 25468/37963 [57:47:34<30:04:11,  8.66s/it]
 67%|██████▋   | 25469/37963 [57:47:42<29:00:17,  8.36s/it]
 67%|██████▋   | 25470/37963 [57:47:49<28:09:17,  8.11s/it]
                                                           
{'loss': '0.1407', 'grad_norm': '1.854', 'learning_rate': '5.163e-06', 'epoch': '0.6709'}
+
 67%|██████▋   | 25470/37963 [57:47:49<28:09:17,  8.11s/it]
 67%|██████▋   | 25471/37963 [57:47:57<27:42:12,  7.98s/it]
 67%|██████▋   | 25472/37963 [57:48:05<27:20:06,  7.88s/it]
 67%|██████▋   | 25473/37963 [57:48:12<27:08:34,  7.82s/it]
 67%|██████▋   | 25474/37963 [57:48:23<29:43:29,  8.57s/it]
 67%|██████▋   | 25475/37963 [57:48:30<29:00:44,  8.36s/it]
 67%|██████▋   | 25476/37963 [57:48:41<31:17:08,  9.02s/it]
 67%|██████▋   | 25477/37963 [57:48:49<30:14:14,  8.72s/it]
 67%|██████▋   | 25478/37963 [57:48:57<29:20:41,  8.46s/it]
 67%|██████▋   | 25479/37963 [57:49:05<28:35:01,  8.24s/it]
 67%|██████▋   | 25480/37963 [57:49:15<30:55:10,  8.92s/it]
                                                           
{'loss': '0.1396', 'grad_norm': '1.927', 'learning_rate': '5.155e-06', 'epoch': '0.6712'}
+
 67%|██████▋   | 25480/37963 [57:49:15<30:55:10,  8.92s/it]
 67%|██████▋   | 25481/37963 [57:49:23<29:42:57,  8.57s/it]
 67%|██████▋   | 25482/37963 [57:49:31<29:14:18,  8.43s/it]
 67%|██████▋   | 25483/37963 [57:49:39<28:23:46,  8.19s/it]
 67%|██████▋   | 25484/37963 [57:49:46<27:49:05,  8.03s/it]
 67%|██████▋   | 25485/37963 [57:49:54<27:34:48,  7.96s/it]
 67%|██████▋   | 25486/37963 [57:50:02<27:15:51,  7.87s/it]
 67%|██████▋   | 25487/37963 [57:50:09<27:03:36,  7.81s/it]
 67%|██████▋   | 25488/37963 [57:50:17<27:04:12,  7.81s/it]
 67%|██████▋   | 25489/37963 [57:50:25<26:51:07,  7.75s/it]
 67%|██████▋   | 25490/37963 [57:50:33<26:56:55,  7.78s/it]
                                                           
{'loss': '0.1276', 'grad_norm': '2.232', 'learning_rate': '5.148e-06', 'epoch': '0.6714'}
+
 67%|██████▋   | 25490/37963 [57:50:33<26:56:55,  7.78s/it]
 67%|██████▋   | 25491/37963 [57:50:41<27:02:17,  7.80s/it]
 67%|██████▋   | 25492/37963 [57:50:48<27:02:21,  7.81s/it]
 67%|██████▋   | 25493/37963 [57:50:56<26:43:25,  7.71s/it]
 67%|██████▋   | 25494/37963 [57:51:04<26:50:08,  7.75s/it]
 67%|██████▋   | 25495/37963 [57:51:12<27:12:38,  7.86s/it]
 67%|██████▋   | 25496/37963 [57:51:19<27:03:19,  7.81s/it]
 67%|██████▋   | 25497/37963 [57:51:27<27:00:34,  7.80s/it]
 67%|██████▋   | 25498/37963 [57:51:35<26:59:32,  7.80s/it]
 67%|██████▋   | 25499/37963 [57:51:43<26:48:26,  7.74s/it]
 67%|██████▋   | 25500/37963 [57:51:50<26:48:33,  7.74s/it]
                                                           
{'loss': '0.1373', 'grad_norm': '1.754', 'learning_rate': '5.141e-06', 'epoch': '0.6717'}
+
 67%|██████▋   | 25500/37963 [57:51:50<26:48:33,  7.74s/it]
 67%|██████▋   | 25501/37963 [57:51:58<26:44:54,  7.73s/it]
 67%|██████▋   | 25502/37963 [57:52:06<26:28:10,  7.65s/it]
 67%|██████▋   | 25503/37963 [57:52:13<26:31:04,  7.66s/it]
 67%|██████▋   | 25504/37963 [57:52:21<26:27:34,  7.65s/it]
 67%|██████▋   | 25505/37963 [57:52:34<32:14:02,  9.31s/it]
 67%|██████▋   | 25506/37963 [57:52:44<33:15:29,  9.61s/it]
 67%|██████▋   | 25507/37963 [57:52:52<31:26:03,  9.09s/it]
 67%|██████▋   | 25508/37963 [57:53:00<30:08:48,  8.71s/it]
 67%|██████▋   | 25509/37963 [57:53:08<29:16:54,  8.46s/it]
 67%|██████▋   | 25510/37963 [57:53:16<28:43:13,  8.30s/it]
                                                           
{'loss': '0.1337', 'grad_norm': '2.008', 'learning_rate': '5.133e-06', 'epoch': '0.672'}
+
 67%|██████▋   | 25510/37963 [57:53:16<28:43:13,  8.30s/it]
 67%|██████▋   | 25511/37963 [57:53:23<27:49:56,  8.05s/it]
 67%|██████▋   | 25512/37963 [57:53:31<27:06:01,  7.84s/it]
 67%|██████▋   | 25513/37963 [57:53:39<27:06:52,  7.84s/it]
 67%|██████▋   | 25514/37963 [57:53:46<27:07:21,  7.84s/it]
 67%|██████▋   | 25515/37963 [57:53:54<26:33:23,  7.68s/it]
 67%|██████▋   | 25516/37963 [57:54:04<29:37:14,  8.57s/it]
 67%|██████▋   | 25517/37963 [57:54:12<28:26:57,  8.23s/it]
 67%|██████▋   | 25518/37963 [57:54:19<27:49:59,  8.05s/it]
 67%|██████▋   | 25519/37963 [57:54:27<27:27:51,  7.95s/it]
 67%|██████▋   | 25520/37963 [57:54:35<27:28:40,  7.95s/it]
                                                           
{'loss': '0.1342', 'grad_norm': '1.379', 'learning_rate': '5.126e-06', 'epoch': '0.6722'}
+
 67%|██████▋   | 25520/37963 [57:54:35<27:28:40,  7.95s/it]
 67%|██████▋   | 25521/37963 [57:54:43<27:10:22,  7.86s/it]
 67%|██████▋   | 25522/37963 [57:54:53<30:06:37,  8.71s/it]
 67%|██████▋   | 25523/37963 [57:55:01<29:09:36,  8.44s/it]
 67%|██████▋   | 25524/37963 [57:55:09<28:23:06,  8.22s/it]
 67%|██████▋   | 25525/37963 [57:55:19<30:50:09,  8.93s/it]
 67%|██████▋   | 25526/37963 [57:55:27<29:35:52,  8.57s/it]
 67%|██████▋   | 25527/37963 [57:55:35<28:52:00,  8.36s/it]
 67%|██████▋   | 25528/37963 [57:55:46<31:12:35,  9.04s/it]
 67%|██████▋   | 25529/37963 [57:55:53<29:48:56,  8.63s/it]
 67%|██████▋   | 25530/37963 [57:56:01<28:49:45,  8.35s/it]
                                                           
{'loss': '0.1399', 'grad_norm': '3.819', 'learning_rate': '5.118e-06', 'epoch': '0.6725'}
+
 67%|██████▋   | 25530/37963 [57:56:01<28:49:45,  8.35s/it]
 67%|██████▋   | 25531/37963 [57:56:09<28:16:07,  8.19s/it]
 67%|██████▋   | 25532/37963 [57:56:16<27:39:57,  8.01s/it]
 67%|██████▋   | 25533/37963 [57:56:24<27:25:39,  7.94s/it]
 67%|██████▋   | 25534/37963 [57:56:35<30:04:22,  8.71s/it]
 67%|██████▋   | 25535/37963 [57:56:43<29:09:12,  8.44s/it]
 67%|██████▋   | 25536/37963 [57:56:51<28:39:31,  8.30s/it]
 67%|██████▋   | 25537/37963 [57:56:58<28:08:00,  8.15s/it]
 67%|██████▋   | 25538/37963 [57:57:06<27:40:43,  8.02s/it]
 67%|██████▋   | 25539/37963 [57:57:14<27:28:03,  7.96s/it]
 67%|██████▋   | 25540/37963 [57:57:22<27:23:50,  7.94s/it]
                                                           
{'loss': '0.1375', 'grad_norm': '1.868', 'learning_rate': '5.111e-06', 'epoch': '0.6728'}
+
 67%|██████▋   | 25540/37963 [57:57:22<27:23:50,  7.94s/it]
 67%|██████▋   | 25541/37963 [57:57:29<26:46:25,  7.76s/it]
 67%|██████▋   | 25542/37963 [57:57:37<27:07:41,  7.86s/it]
 67%|██████▋   | 25543/37963 [57:57:45<27:21:27,  7.93s/it]
 67%|██████▋   | 25544/37963 [57:57:53<27:05:24,  7.85s/it]
 67%|██████▋   | 25545/37963 [57:58:01<26:59:37,  7.83s/it]
 67%|██████▋   | 25546/37963 [57:58:08<26:42:58,  7.75s/it]
 67%|██████▋   | 25547/37963 [57:58:16<26:34:42,  7.71s/it]
 67%|██████▋   | 25548/37963 [57:58:26<29:02:21,  8.42s/it]
 67%|██████▋   | 25549/37963 [57:58:37<31:13:03,  9.05s/it]
 67%|██████▋   | 25550/37963 [57:58:44<29:38:41,  8.60s/it]
                                                           
{'loss': '0.1335', 'grad_norm': '2.176', 'learning_rate': '5.103e-06', 'epoch': '0.673'}
+
 67%|██████▋   | 25550/37963 [57:58:44<29:38:41,  8.60s/it]
 67%|██████▋   | 25551/37963 [57:58:51<28:21:03,  8.22s/it]
 67%|██████▋   | 25552/37963 [57:58:59<28:00:38,  8.12s/it]
 67%|██████▋   | 25553/37963 [57:59:07<27:42:31,  8.04s/it]
 67%|██████▋   | 25554/37963 [57:59:15<27:19:02,  7.93s/it]
 67%|██████▋   | 25555/37963 [57:59:25<29:51:04,  8.66s/it]
 67%|██████▋   | 25556/37963 [57:59:33<28:48:50,  8.36s/it]
 67%|██████▋   | 25557/37963 [57:59:41<28:07:09,  8.16s/it]
 67%|██████▋   | 25558/37963 [57:59:48<27:48:03,  8.07s/it]
 67%|██████▋   | 25559/37963 [57:59:56<27:26:56,  7.97s/it]
 67%|██████▋   | 25560/37963 [58:00:04<27:28:33,  7.97s/it]
                                                           
{'loss': '0.125', 'grad_norm': '3.858', 'learning_rate': '5.096e-06', 'epoch': '0.6733'}
+
 67%|██████▋   | 25560/37963 [58:00:04<27:28:33,  7.97s/it]
 67%|██████▋   | 25561/37963 [58:00:12<27:20:38,  7.94s/it]
 67%|██████▋   | 25562/37963 [58:00:20<27:10:16,  7.89s/it]
 67%|██████▋   | 25563/37963 [58:00:28<27:24:47,  7.96s/it]
 67%|██████▋   | 25564/37963 [58:00:36<27:12:58,  7.90s/it]
 67%|██████▋   | 25565/37963 [58:00:46<30:02:08,  8.72s/it]
 67%|██████▋   | 25566/37963 [58:00:57<32:03:22,  9.31s/it]
 67%|██████▋   | 25567/37963 [58:01:05<30:26:09,  8.84s/it]
 67%|██████▋   | 25568/37963 [58:01:12<29:11:43,  8.48s/it]
 67%|██████▋   | 25569/37963 [58:01:20<28:22:28,  8.24s/it]
 67%|██████▋   | 25570/37963 [58:01:28<27:45:51,  8.07s/it]
                                                           
{'loss': '0.1336', 'grad_norm': '1.528', 'learning_rate': '5.088e-06', 'epoch': '0.6736'}
+
 67%|██████▋   | 25570/37963 [58:01:28<27:45:51,  8.07s/it]
 67%|██████▋   | 25571/37963 [58:01:35<27:26:29,  7.97s/it]
 67%|██████▋   | 25572/37963 [58:01:43<27:07:13,  7.88s/it]
 67%|██████▋   | 25573/37963 [58:01:51<26:59:35,  7.84s/it]
 67%|██████▋   | 25574/37963 [58:01:59<27:01:22,  7.85s/it]
 67%|██████▋   | 25575/37963 [58:02:07<27:00:04,  7.85s/it]
 67%|██████▋   | 25576/37963 [58:02:17<29:35:29,  8.60s/it]
 67%|██████▋   | 25577/37963 [58:02:27<30:48:56,  8.96s/it]
 67%|██████▋   | 25578/37963 [58:02:35<29:42:09,  8.63s/it]
 67%|██████▋   | 25579/37963 [58:02:42<28:44:30,  8.36s/it]
 67%|██████▋   | 25580/37963 [58:02:50<28:01:06,  8.15s/it]
                                                           
{'loss': '0.1203', 'grad_norm': '1.481', 'learning_rate': '5.081e-06', 'epoch': '0.6738'}
+
 67%|██████▋   | 25580/37963 [58:02:50<28:01:06,  8.15s/it]
 67%|██████▋   | 25581/37963 [58:02:58<27:42:14,  8.05s/it]
 67%|██████▋   | 25582/37963 [58:03:06<27:35:51,  8.02s/it]
 67%|██████▋   | 25583/37963 [58:03:16<30:14:01,  8.79s/it]
 67%|██████▋   | 25584/37963 [58:03:24<29:02:02,  8.44s/it]
 67%|██████▋   | 25585/37963 [58:03:32<28:09:20,  8.19s/it]
 67%|██████▋   | 25586/37963 [58:03:39<27:37:54,  8.04s/it]
 67%|██████▋   | 25587/37963 [58:03:47<27:36:55,  8.03s/it]
 67%|██████▋   | 25588/37963 [58:03:55<27:21:41,  7.96s/it]
 67%|██████▋   | 25589/37963 [58:04:03<27:06:54,  7.89s/it]
 67%|██████▋   | 25590/37963 [58:04:11<27:12:51,  7.92s/it]
                                                           
{'loss': '0.136', 'grad_norm': '3.427', 'learning_rate': '5.074e-06', 'epoch': '0.6741'}
+
 67%|██████▋   | 25590/37963 [58:04:11<27:12:51,  7.92s/it]
 67%|██████▋   | 25591/37963 [58:04:18<27:01:29,  7.86s/it]
 67%|██████▋   | 25592/37963 [58:04:29<29:36:37,  8.62s/it]
 67%|██████▋   | 25593/37963 [58:04:37<28:41:16,  8.35s/it]
 67%|██████▋   | 25594/37963 [58:04:44<28:08:12,  8.19s/it]
 67%|██████▋   | 25595/37963 [58:04:52<27:52:40,  8.11s/it]
 67%|██████▋   | 25596/37963 [58:05:00<27:07:45,  7.90s/it]
 67%|██████▋   | 25597/37963 [58:05:10<29:49:54,  8.68s/it]
 67%|██████▋   | 25598/37963 [58:05:21<31:40:09,  9.22s/it]
 67%|██████▋   | 25599/37963 [58:05:29<30:12:30,  8.80s/it]
 67%|██████▋   | 25600/37963 [58:05:36<28:58:22,  8.44s/it]
                                                           
{'loss': '0.1234', 'grad_norm': '2.224', 'learning_rate': '5.066e-06', 'epoch': '0.6743'}
+
 67%|██████▋   | 25600/37963 [58:05:36<28:58:22,  8.44s/it]
 67%|██████▋   | 25601/37963 [58:05:44<28:13:11,  8.22s/it]
 67%|██████▋   | 25602/37963 [58:05:51<27:34:43,  8.03s/it]
 67%|██████▋   | 25603/37963 [58:05:59<27:13:34,  7.93s/it]
 67%|██████▋   | 25604/37963 [58:06:07<27:05:18,  7.89s/it]
 67%|██████▋   | 25605/37963 [58:06:14<26:18:00,  7.66s/it]
 67%|██████▋   | 25606/37963 [58:06:22<26:24:09,  7.69s/it]
 67%|██████▋   | 25607/37963 [58:06:30<26:36:43,  7.75s/it]
 67%|██████▋   | 25608/37963 [58:06:37<26:17:32,  7.66s/it]
 67%|██████▋   | 25609/37963 [58:06:45<26:19:47,  7.67s/it]
 67%|██████▋   | 25610/37963 [58:06:55<29:14:38,  8.52s/it]
                                                           
{'loss': '0.1431', 'grad_norm': '2.068', 'learning_rate': '5.059e-06', 'epoch': '0.6746'}
+
 67%|██████▋   | 25610/37963 [58:06:55<29:14:38,  8.52s/it]
 67%|██████▋   | 25611/37963 [58:07:03<28:11:56,  8.22s/it]
 67%|██████▋   | 25612/37963 [58:07:11<27:46:12,  8.09s/it]
 67%|██████▋   | 25613/37963 [58:07:21<30:14:00,  8.81s/it]
 67%|██████▋   | 25614/37963 [58:07:29<29:05:01,  8.48s/it]
 67%|██████▋   | 25615/37963 [58:07:37<28:28:13,  8.30s/it]
 67%|██████▋   | 25616/37963 [58:07:45<27:57:47,  8.15s/it]
 67%|██████▋   | 25617/37963 [58:07:52<27:35:50,  8.05s/it]
 67%|██████▋   | 25618/37963 [58:08:00<27:02:27,  7.89s/it]
 67%|██████▋   | 25619/37963 [58:08:08<26:51:40,  7.83s/it]
 67%|██████▋   | 25620/37963 [58:08:18<29:38:28,  8.65s/it]
                                                           
{'loss': '0.1236', 'grad_norm': '1.883', 'learning_rate': '5.051e-06', 'epoch': '0.6749'}
+
 67%|██████▋   | 25620/37963 [58:08:18<29:38:28,  8.65s/it]
 67%|██████▋   | 25621/37963 [58:08:26<28:30:10,  8.31s/it]
 67%|██████▋   | 25622/37963 [58:08:33<27:54:31,  8.14s/it]
 67%|██████▋   | 25623/37963 [58:08:41<27:28:15,  8.01s/it]
 67%|██████▋   | 25624/37963 [58:08:49<27:14:46,  7.95s/it]
 67%|██████▋   | 25625/37963 [58:08:57<27:11:05,  7.93s/it]
 68%|██████▊   | 25626/37963 [58:09:07<29:36:45,  8.64s/it]
 68%|██████▊   | 25627/37963 [58:09:15<28:55:49,  8.44s/it]
 68%|██████▊   | 25628/37963 [58:09:23<28:08:44,  8.21s/it]
 68%|██████▊   | 25629/37963 [58:09:31<27:45:00,  8.10s/it]
 68%|██████▊   | 25630/37963 [58:09:38<27:17:00,  7.96s/it]
                                                           
{'loss': '0.1458', 'grad_norm': '1.64', 'learning_rate': '5.044e-06', 'epoch': '0.6751'}
+
 68%|██████▊   | 25630/37963 [58:09:38<27:17:00,  7.96s/it]
 68%|██████▊   | 25631/37963 [58:09:49<29:49:23,  8.71s/it]
 68%|██████▊   | 25632/37963 [58:09:56<28:52:05,  8.43s/it]
 68%|██████▊   | 25633/37963 [58:10:04<28:05:34,  8.20s/it]
 68%|██████▊   | 25634/37963 [58:10:12<27:35:55,  8.06s/it]
 68%|██████▊   | 25635/37963 [58:10:19<26:48:25,  7.83s/it]
 68%|██████▊   | 25636/37963 [58:10:27<26:52:04,  7.85s/it]
 68%|██████▊   | 25637/37963 [58:10:35<26:54:27,  7.86s/it]
 68%|██████▊   | 25638/37963 [58:10:43<26:46:02,  7.82s/it]
 68%|██████▊   | 25639/37963 [58:10:50<26:39:46,  7.79s/it]
 68%|██████▊   | 25640/37963 [58:11:00<28:48:24,  8.42s/it]
                                                           
{'loss': '0.1243', 'grad_norm': '3.435', 'learning_rate': '5.036e-06', 'epoch': '0.6754'}
+
 68%|██████▊   | 25640/37963 [58:11:00<28:48:24,  8.42s/it]
 68%|██████▊   | 25641/37963 [58:11:08<28:04:23,  8.20s/it]
 68%|██████▊   | 25642/37963 [58:11:18<30:11:15,  8.82s/it]
 68%|██████▊   | 25643/37963 [58:11:26<28:59:11,  8.47s/it]
 68%|██████▊   | 25644/37963 [58:11:37<31:15:46,  9.14s/it]
 68%|██████▊   | 25645/37963 [58:11:44<29:48:32,  8.71s/it]
 68%|██████▊   | 25646/37963 [58:11:52<28:48:50,  8.42s/it]
 68%|██████▊   | 25647/37963 [58:12:00<27:58:39,  8.18s/it]
 68%|██████▊   | 25648/37963 [58:12:07<27:18:59,  7.99s/it]
 68%|██████▊   | 25649/37963 [58:12:15<26:44:29,  7.82s/it]
 68%|██████▊   | 25650/37963 [58:12:23<27:00:46,  7.90s/it]
                                                           
{'loss': '0.1285', 'grad_norm': '1.427', 'learning_rate': '5.029e-06', 'epoch': '0.6757'}
+
 68%|██████▊   | 25650/37963 [58:12:23<27:00:46,  7.90s/it]
 68%|██████▊   | 25651/37963 [58:12:30<26:41:18,  7.80s/it]
 68%|██████▊   | 25652/37963 [58:12:38<26:33:00,  7.76s/it]
 68%|██████▊   | 25653/37963 [58:12:46<26:22:41,  7.71s/it]
 68%|██████▊   | 25654/37963 [58:12:53<26:37:25,  7.79s/it]
 68%|██████▊   | 25655/37963 [58:13:01<26:37:29,  7.79s/it]
 68%|██████▊   | 25656/37963 [58:13:09<26:20:30,  7.71s/it]
 68%|██████▊   | 25657/37963 [58:13:16<26:06:13,  7.64s/it]
 68%|██████▊   | 25658/37963 [58:13:30<31:58:31,  9.35s/it]
 68%|██████▊   | 25659/37963 [58:13:37<30:09:41,  8.82s/it]
 68%|██████▊   | 25660/37963 [58:13:45<28:45:47,  8.42s/it]
                                                           
{'loss': '0.1192', 'grad_norm': '2.333', 'learning_rate': '5.022e-06', 'epoch': '0.6759'}
+
 68%|██████▊   | 25660/37963 [58:13:45<28:45:47,  8.42s/it]
 68%|██████▊   | 25661/37963 [58:13:53<28:11:36,  8.25s/it]
 68%|██████▊   | 25662/37963 [58:14:00<27:42:28,  8.11s/it]
 68%|██████▊   | 25663/37963 [58:14:08<27:35:18,  8.07s/it]
 68%|██████▊   | 25664/37963 [58:14:16<27:09:01,  7.95s/it]
 68%|██████▊   | 25665/37963 [58:14:24<26:44:28,  7.83s/it]
 68%|██████▊   | 25666/37963 [58:14:31<26:41:28,  7.81s/it]
 68%|██████▊   | 25667/37963 [58:14:39<26:36:08,  7.79s/it]
 68%|██████▊   | 25668/37963 [58:14:49<29:07:38,  8.53s/it]
 68%|██████▊   | 25669/37963 [58:14:57<28:00:16,  8.20s/it]
 68%|██████▊   | 25670/37963 [58:15:04<27:21:29,  8.01s/it]
                                                           
{'loss': '0.1359', 'grad_norm': '1.462', 'learning_rate': '5.014e-06', 'epoch': '0.6762'}
+
 68%|██████▊   | 25670/37963 [58:15:04<27:21:29,  8.01s/it]
 68%|██████▊   | 25671/37963 [58:15:12<26:47:29,  7.85s/it]
 68%|██████▊   | 25672/37963 [58:15:20<26:44:01,  7.83s/it]
 68%|██████▊   | 25673/37963 [58:15:30<29:08:45,  8.54s/it]
 68%|██████▊   | 25674/37963 [58:15:40<30:46:17,  9.01s/it]
 68%|██████▊   | 25675/37963 [58:15:48<29:27:41,  8.63s/it]
 68%|██████▊   | 25676/37963 [58:15:55<28:35:58,  8.38s/it]
 68%|██████▊   | 25677/37963 [58:16:03<27:29:51,  8.06s/it]
 68%|██████▊   | 25678/37963 [58:16:10<27:02:41,  7.93s/it]
 68%|██████▊   | 25679/37963 [58:16:18<26:39:01,  7.81s/it]
 68%|██████▊   | 25680/37963 [58:16:26<26:38:11,  7.81s/it]
                                                           
{'loss': '0.1294', 'grad_norm': '1.292', 'learning_rate': '5.007e-06', 'epoch': '0.6765'}
+
 68%|██████▊   | 25680/37963 [58:16:26<26:38:11,  7.81s/it]
 68%|██████▊   | 25681/37963 [58:16:33<26:28:37,  7.76s/it]
 68%|██████▊   | 25682/37963 [58:16:41<26:18:24,  7.71s/it]
 68%|██████▊   | 25683/37963 [58:16:49<26:25:45,  7.75s/it]
 68%|██████▊   | 25684/37963 [58:16:56<26:21:54,  7.73s/it]
 68%|██████▊   | 25685/37963 [58:17:04<26:34:00,  7.79s/it]
 68%|██████▊   | 25686/37963 [58:17:15<29:18:38,  8.59s/it]
 68%|██████▊   | 25687/37963 [58:17:25<31:07:29,  9.13s/it]
 68%|██████▊   | 25688/37963 [58:17:33<29:54:28,  8.77s/it]
 68%|██████▊   | 25689/37963 [58:17:41<28:43:00,  8.42s/it]
 68%|██████▊   | 25690/37963 [58:17:49<28:07:24,  8.25s/it]
                                                           
{'loss': '0.1266', 'grad_norm': '1.645', 'learning_rate': '5e-06', 'epoch': '0.6767'}
+
 68%|██████▊   | 25690/37963 [58:17:49<28:07:24,  8.25s/it]
 68%|██████▊   | 25691/37963 [58:17:56<27:40:18,  8.12s/it]
 68%|██████▊   | 25692/37963 [58:18:07<30:15:51,  8.88s/it]
 68%|██████▊   | 25693/37963 [58:18:15<29:05:45,  8.54s/it]
 68%|██████▊   | 25694/37963 [58:18:23<28:26:17,  8.34s/it]
 68%|██████▊   | 25695/37963 [58:18:30<27:44:02,  8.14s/it]
 68%|██████▊   | 25696/37963 [58:18:38<27:39:27,  8.12s/it]
 68%|██████▊   | 25697/37963 [58:18:46<27:22:40,  8.04s/it]
 68%|██████▊   | 25698/37963 [58:18:54<27:02:50,  7.94s/it]
 68%|██████▊   | 25699/37963 [58:19:02<26:51:41,  7.88s/it]
 68%|██████▊   | 25700/37963 [58:19:10<27:02:57,  7.94s/it]
                                                           
{'loss': '0.1428', 'grad_norm': '1.534', 'learning_rate': '4.992e-06', 'epoch': '0.677'}
+
 68%|██████▊   | 25700/37963 [58:19:10<27:02:57,  7.94s/it]
 68%|██████▊   | 25701/37963 [58:19:17<26:33:08,  7.80s/it]
 68%|██████▊   | 25702/37963 [58:19:25<26:13:09,  7.70s/it]
 68%|██████▊   | 25703/37963 [58:19:32<26:09:17,  7.68s/it]
 68%|██████▊   | 25704/37963 [58:19:40<26:04:42,  7.66s/it]
 68%|██████▊   | 25705/37963 [58:19:48<26:14:17,  7.71s/it]
 68%|██████▊   | 25706/37963 [58:19:59<29:18:46,  8.61s/it]
 68%|██████▊   | 25707/37963 [58:20:09<31:01:34,  9.11s/it]
 68%|██████▊   | 25708/37963 [58:20:17<29:55:08,  8.79s/it]
 68%|██████▊   | 25709/37963 [58:20:25<28:59:07,  8.52s/it]
 68%|██████▊   | 25710/37963 [58:20:32<28:13:47,  8.29s/it]
                                                           
{'loss': '0.1348', 'grad_norm': '1.902', 'learning_rate': '4.985e-06', 'epoch': '0.6772'}
+
 68%|██████▊   | 25710/37963 [58:20:32<28:13:47,  8.29s/it]
 68%|██████▊   | 25711/37963 [58:20:43<30:15:30,  8.89s/it]
 68%|██████▊   | 25712/37963 [58:20:51<29:12:10,  8.58s/it]
 68%|██████▊   | 25713/37963 [58:20:59<28:32:58,  8.39s/it]
 68%|██████▊   | 25714/37963 [58:21:06<28:00:43,  8.23s/it]
 68%|██████▊   | 25715/37963 [58:21:14<27:36:21,  8.11s/it]
 68%|██████▊   | 25716/37963 [58:21:22<27:15:04,  8.01s/it]
 68%|██████▊   | 25717/37963 [58:21:30<27:07:07,  7.97s/it]
 68%|██████▊   | 25718/37963 [58:21:41<29:53:41,  8.79s/it]
 68%|██████▊   | 25719/37963 [58:21:48<28:53:07,  8.49s/it]
 68%|██████▊   | 25720/37963 [58:21:56<27:48:01,  8.17s/it]
                                                           
{'loss': '0.1363', 'grad_norm': '2.08', 'learning_rate': '4.977e-06', 'epoch': '0.6775'}
+
 68%|██████▊   | 25720/37963 [58:21:56<27:48:01,  8.17s/it]
 68%|██████▊   | 25721/37963 [58:22:04<27:28:15,  8.08s/it]
 68%|██████▊   | 25722/37963 [58:22:12<27:15:46,  8.02s/it]
 68%|██████▊   | 25723/37963 [58:22:19<26:51:24,  7.90s/it]
 68%|██████▊   | 25724/37963 [58:22:29<29:02:19,  8.54s/it]
 68%|██████▊   | 25725/37963 [58:22:37<28:20:59,  8.34s/it]
 68%|██████▊   | 25726/37963 [58:22:45<27:22:41,  8.05s/it]
 68%|██████▊   | 25727/37963 [58:22:53<27:19:10,  8.04s/it]
 68%|██████▊   | 25728/37963 [58:23:00<27:10:38,  8.00s/it]
 68%|██████▊   | 25729/37963 [58:23:10<29:06:34,  8.57s/it]
 68%|██████▊   | 25730/37963 [58:23:18<28:03:38,  8.26s/it]
                                                           
{'loss': '0.145', 'grad_norm': '1.54', 'learning_rate': '4.97e-06', 'epoch': '0.6778'}
+
 68%|██████▊   | 25730/37963 [58:23:18<28:03:38,  8.26s/it]
 68%|██████▊   | 25731/37963 [58:23:26<27:37:06,  8.13s/it]
 68%|██████▊   | 25732/37963 [58:23:33<26:57:54,  7.94s/it]
 68%|██████▊   | 25733/37963 [58:23:41<26:50:18,  7.90s/it]
 68%|██████▊   | 25734/37963 [58:23:49<26:44:37,  7.87s/it]
 68%|██████▊   | 25735/37963 [58:23:57<26:37:07,  7.84s/it]
 68%|██████▊   | 25736/37963 [58:24:07<29:10:03,  8.59s/it]
 68%|██████▊   | 25737/37963 [58:24:14<28:10:35,  8.30s/it]
 68%|██████▊   | 25738/37963 [58:24:22<27:26:51,  8.08s/it]
 68%|██████▊   | 25739/37963 [58:24:30<27:05:10,  7.98s/it]
 68%|██████▊   | 25740/37963 [58:24:37<26:40:46,  7.86s/it]
                                                           
{'loss': '0.1231', 'grad_norm': '1.41', 'learning_rate': '4.963e-06', 'epoch': '0.678'}
+
 68%|██████▊   | 25740/37963 [58:24:37<26:40:46,  7.86s/it]
 68%|██████▊   | 25741/37963 [58:24:45<26:03:19,  7.67s/it]
 68%|██████▊   | 25742/37963 [58:24:52<26:05:50,  7.69s/it]
 68%|██████▊   | 25743/37963 [58:25:00<26:05:56,  7.69s/it]
 68%|██████▊   | 25744/37963 [58:25:08<26:12:34,  7.72s/it]
 68%|██████▊   | 25745/37963 [58:25:18<28:57:37,  8.53s/it]
 68%|██████▊   | 25746/37963 [58:25:26<28:24:32,  8.37s/it]
 68%|██████▊   | 25747/37963 [58:25:34<27:51:52,  8.21s/it]
 68%|██████▊   | 25748/37963 [58:25:42<27:18:39,  8.05s/it]
 68%|██████▊   | 25749/37963 [58:25:50<27:02:18,  7.97s/it]
 68%|██████▊   | 25750/37963 [58:25:57<26:19:22,  7.76s/it]
                                                           
{'loss': '0.132', 'grad_norm': '1.648', 'learning_rate': '4.955e-06', 'epoch': '0.6783'}
+
 68%|██████▊   | 25750/37963 [58:25:57<26:19:22,  7.76s/it]
 68%|██████▊   | 25751/37963 [58:26:05<26:22:17,  7.77s/it]
 68%|██████▊   | 25752/37963 [58:26:12<26:26:17,  7.79s/it]
 68%|██████▊   | 25753/37963 [58:26:20<26:25:39,  7.79s/it]
 68%|██████▊   | 25754/37963 [58:26:31<29:35:34,  8.73s/it]
 68%|██████▊   | 25755/37963 [58:26:44<34:03:29, 10.04s/it]
 68%|██████▊   | 25756/37963 [58:26:52<31:51:31,  9.40s/it]
 68%|██████▊   | 25757/37963 [58:27:00<30:11:09,  8.90s/it]
 68%|██████▊   | 25758/37963 [58:27:08<28:52:53,  8.52s/it]
 68%|██████▊   | 25759/37963 [58:27:15<28:01:43,  8.27s/it]
 68%|██████▊   | 25760/37963 [58:27:23<27:33:59,  8.13s/it]
                                                           
{'loss': '0.1395', 'grad_norm': '1.467', 'learning_rate': '4.948e-06', 'epoch': '0.6786'}
+
 68%|██████▊   | 25760/37963 [58:27:23<27:33:59,  8.13s/it]
 68%|██████▊   | 25761/37963 [58:27:30<26:44:58,  7.89s/it]
 68%|██████▊   | 25762/37963 [58:27:41<29:33:12,  8.72s/it]
 68%|██████▊   | 25763/37963 [58:27:49<28:28:34,  8.40s/it]
 68%|██████▊   | 25764/37963 [58:27:57<28:04:38,  8.29s/it]
 68%|██████▊   | 25765/37963 [58:28:05<27:36:40,  8.15s/it]
 68%|██████▊   | 25766/37963 [58:28:12<27:21:35,  8.08s/it]
 68%|██████▊   | 25767/37963 [58:28:20<26:55:03,  7.95s/it]
 68%|██████▊   | 25768/37963 [58:28:28<26:48:30,  7.91s/it]
 68%|██████▊   | 25769/37963 [58:28:36<26:49:37,  7.92s/it]
 68%|██████▊   | 25770/37963 [58:28:46<29:27:47,  8.70s/it]
                                                           
{'loss': '0.1305', 'grad_norm': '2.697', 'learning_rate': '4.941e-06', 'epoch': '0.6788'}
+
 68%|██████▊   | 25770/37963 [58:28:46<29:27:47,  8.70s/it]
 68%|██████▊   | 25771/37963 [58:28:54<28:43:57,  8.48s/it]
 68%|██████▊   | 25772/37963 [58:29:02<27:54:45,  8.24s/it]
 68%|██████▊   | 25773/37963 [58:29:12<30:00:55,  8.86s/it]
 68%|██████▊   | 25774/37963 [58:29:20<28:56:46,  8.55s/it]
 68%|██████▊   | 25775/37963 [58:29:28<27:52:34,  8.23s/it]
 68%|██████▊   | 25776/37963 [58:29:35<27:17:31,  8.06s/it]
 68%|██████▊   | 25777/37963 [58:29:43<26:54:13,  7.95s/it]
 68%|██████▊   | 25778/37963 [58:29:51<26:36:21,  7.86s/it]
 68%|██████▊   | 25779/37963 [58:29:59<26:49:05,  7.92s/it]
 68%|██████▊   | 25780/37963 [58:30:09<29:01:01,  8.57s/it]
                                                           
{'loss': '0.1198', 'grad_norm': '1.532', 'learning_rate': '4.933e-06', 'epoch': '0.6791'}
+
 68%|██████▊   | 25780/37963 [58:30:09<29:01:01,  8.57s/it]
 68%|██████▊   | 25781/37963 [58:30:17<28:07:45,  8.31s/it]
 68%|██████▊   | 25782/37963 [58:30:24<27:24:36,  8.10s/it]
 68%|██████▊   | 25783/37963 [58:30:32<27:13:13,  8.05s/it]
 68%|██████▊   | 25784/37963 [58:30:40<26:49:29,  7.93s/it]
 68%|██████▊   | 25785/37963 [58:30:47<26:22:21,  7.80s/it]
 68%|██████▊   | 25786/37963 [58:30:55<26:17:07,  7.77s/it]
 68%|██████▊   | 25787/37963 [58:31:03<26:24:58,  7.81s/it]
 68%|██████▊   | 25788/37963 [58:31:11<26:22:09,  7.80s/it]
 68%|██████▊   | 25789/37963 [58:31:19<26:34:14,  7.86s/it]
 68%|██████▊   | 25790/37963 [58:31:26<26:16:09,  7.77s/it]
                                                           
{'loss': '0.1259', 'grad_norm': '1.831', 'learning_rate': '4.926e-06', 'epoch': '0.6793'}
+
 68%|██████▊   | 25790/37963 [58:31:26<26:16:09,  7.77s/it]
 68%|██████▊   | 25791/37963 [58:31:34<26:14:05,  7.76s/it]
 68%|██████▊   | 25792/37963 [58:31:42<26:32:37,  7.85s/it]
 68%|██████▊   | 25793/37963 [58:31:49<26:01:38,  7.70s/it]
 68%|██████▊   | 25794/37963 [58:31:57<26:07:45,  7.73s/it]
 68%|██████▊   | 25795/37963 [58:32:05<26:06:54,  7.73s/it]
 68%|██████▊   | 25796/37963 [58:32:13<26:08:37,  7.74s/it]
 68%|██████▊   | 25797/37963 [58:32:20<26:12:13,  7.75s/it]
 68%|██████▊   | 25798/37963 [58:32:28<26:02:24,  7.71s/it]
 68%|██████▊   | 25799/37963 [58:32:39<29:01:52,  8.59s/it]
 68%|██████▊   | 25800/37963 [58:32:47<28:27:56,  8.43s/it]
                                                           
{'loss': '0.1305', 'grad_norm': '1.776', 'learning_rate': '4.918e-06', 'epoch': '0.6796'}
+
 68%|██████▊   | 25800/37963 [58:32:47<28:27:56,  8.43s/it]
 68%|██████▊   | 25801/37963 [58:32:54<27:50:10,  8.24s/it]
 68%|██████▊   | 25802/37963 [58:33:04<29:39:41,  8.78s/it]
 68%|██████▊   | 25803/37963 [58:33:12<28:46:32,  8.52s/it]
 68%|██████▊   | 25804/37963 [58:33:20<27:54:01,  8.26s/it]
 68%|██████▊   | 25805/37963 [58:33:28<27:15:07,  8.07s/it]
 68%|██████▊   | 25806/37963 [58:33:35<26:56:24,  7.98s/it]
 68%|██████▊   | 25807/37963 [58:33:43<26:27:11,  7.83s/it]
 68%|██████▊   | 25808/37963 [58:33:50<25:59:57,  7.70s/it]
 68%|██████▊   | 25809/37963 [58:33:58<26:10:46,  7.75s/it]
 68%|██████▊   | 25810/37963 [58:34:09<29:04:30,  8.61s/it]
                                                           
{'loss': '0.1187', 'grad_norm': '2.268', 'learning_rate': '4.911e-06', 'epoch': '0.6799'}
+
 68%|██████▊   | 25810/37963 [58:34:09<29:04:30,  8.61s/it]
 68%|██████▊   | 25811/37963 [58:34:17<28:07:55,  8.33s/it]
 68%|██████▊   | 25812/37963 [58:34:24<27:26:36,  8.13s/it]
 68%|██████▊   | 25813/37963 [58:34:32<27:02:34,  8.01s/it]
 68%|██████▊   | 25814/37963 [58:34:40<27:00:58,  8.01s/it]
 68%|██████▊   | 25815/37963 [58:34:50<29:17:11,  8.68s/it]
 68%|██████▊   | 25816/37963 [58:35:00<30:53:11,  9.15s/it]
 68%|██████▊   | 25817/37963 [58:35:08<29:36:00,  8.77s/it]
 68%|██████▊   | 25818/37963 [58:35:16<28:24:19,  8.42s/it]
 68%|██████▊   | 25819/37963 [58:35:23<27:23:06,  8.12s/it]
 68%|██████▊   | 25820/37963 [58:35:31<27:17:23,  8.09s/it]
                                                           
{'loss': '0.1281', 'grad_norm': '3.208', 'learning_rate': '4.904e-06', 'epoch': '0.6801'}
+
 68%|██████▊   | 25820/37963 [58:35:31<27:17:23,  8.09s/it]
 68%|██████▊   | 25821/37963 [58:35:39<26:47:24,  7.94s/it]
 68%|██████▊   | 25822/37963 [58:35:47<26:46:33,  7.94s/it]
 68%|██████▊   | 25823/37963 [58:35:55<26:34:08,  7.88s/it]
 68%|██████▊   | 25824/37963 [58:36:05<28:58:03,  8.59s/it]
 68%|██████▊   | 25825/37963 [58:36:13<28:03:26,  8.32s/it]
 68%|██████▊   | 25826/37963 [58:36:20<27:36:01,  8.19s/it]
 68%|██████▊   | 25827/37963 [58:36:28<27:09:28,  8.06s/it]
 68%|██████▊   | 25828/37963 [58:36:36<26:54:31,  7.98s/it]
 68%|██████▊   | 25829/37963 [58:36:44<26:54:03,  7.98s/it]
 68%|██████▊   | 25830/37963 [58:36:52<26:39:53,  7.91s/it]
                                                           
{'loss': '0.1266', 'grad_norm': '1.551', 'learning_rate': '4.896e-06', 'epoch': '0.6804'}
+
 68%|██████▊   | 25830/37963 [58:36:52<26:39:53,  7.91s/it]
 68%|██████▊   | 25831/37963 [58:36:59<26:23:45,  7.83s/it]
 68%|██████▊   | 25832/37963 [58:37:07<26:03:48,  7.73s/it]
 68%|██████▊   | 25833/37963 [58:37:15<25:59:22,  7.71s/it]
 68%|██████▊   | 25834/37963 [58:37:22<25:30:51,  7.57s/it]
 68%|██████▊   | 25835/37963 [58:37:30<25:50:26,  7.67s/it]
 68%|██████▊   | 25836/37963 [58:37:37<25:46:37,  7.65s/it]
 68%|██████▊   | 25837/37963 [58:37:45<25:57:33,  7.71s/it]
 68%|██████▊   | 25838/37963 [58:37:53<26:05:56,  7.75s/it]
 68%|██████▊   | 25839/37963 [58:38:01<26:13:55,  7.79s/it]
 68%|██████▊   | 25840/37963 [58:38:09<26:08:15,  7.76s/it]
                                                           
{'loss': '0.1316', 'grad_norm': '1.972', 'learning_rate': '4.889e-06', 'epoch': '0.6807'}
+
 68%|██████▊   | 25840/37963 [58:38:09<26:08:15,  7.76s/it]
 68%|██████▊   | 25841/37963 [58:38:16<26:13:35,  7.79s/it]
 68%|██████▊   | 25842/37963 [58:38:24<26:23:25,  7.84s/it]
 68%|██████▊   | 25843/37963 [58:38:35<29:11:28,  8.67s/it]
 68%|██████▊   | 25844/37963 [58:38:42<27:59:19,  8.31s/it]
 68%|██████▊   | 25845/37963 [58:38:50<27:34:29,  8.19s/it]
 68%|██████▊   | 25846/37963 [58:38:58<26:54:16,  7.99s/it]
 68%|██████▊   | 25847/37963 [58:39:08<28:54:03,  8.59s/it]
 68%|██████▊   | 25848/37963 [58:39:16<28:07:42,  8.36s/it]
 68%|██████▊   | 25849/37963 [58:39:24<27:42:31,  8.23s/it]
 68%|██████▊   | 25850/37963 [58:39:37<32:48:33,  9.75s/it]
                                                           
{'loss': '0.1408', 'grad_norm': '2.547', 'learning_rate': '4.882e-06', 'epoch': '0.6809'}
+
 68%|██████▊   | 25850/37963 [58:39:37<32:48:33,  9.75s/it]
 68%|██████▊   | 25851/37963 [58:39:45<30:46:05,  9.15s/it]
 68%|██████▊   | 25852/37963 [58:39:52<29:24:52,  8.74s/it]
 68%|██████▊   | 25853/37963 [58:40:00<28:15:26,  8.40s/it]
 68%|██████▊   | 25854/37963 [58:40:11<30:32:21,  9.08s/it]
 68%|██████▊   | 25855/37963 [58:40:19<29:22:57,  8.74s/it]
 68%|██████▊   | 25856/37963 [58:40:27<28:31:15,  8.48s/it]
 68%|██████▊   | 25857/37963 [58:40:34<27:44:48,  8.25s/it]
 68%|██████▊   | 25858/37963 [58:40:42<27:25:57,  8.16s/it]
 68%|██████▊   | 25859/37963 [58:40:50<26:52:08,  7.99s/it]
 68%|██████▊   | 25860/37963 [58:40:58<26:38:21,  7.92s/it]
                                                           
{'loss': '0.1233', 'grad_norm': '2.794', 'learning_rate': '4.874e-06', 'epoch': '0.6812'}
+
 68%|██████▊   | 25860/37963 [58:40:58<26:38:21,  7.92s/it]
 68%|██████▊   | 25861/37963 [58:41:05<26:32:17,  7.89s/it]
 68%|██████▊   | 25862/37963 [58:41:13<26:35:35,  7.91s/it]
 68%|██████▊   | 25863/37963 [58:41:24<28:57:03,  8.61s/it]
 68%|██████▊   | 25864/37963 [58:41:32<28:28:05,  8.47s/it]
 68%|██████▊   | 25865/37963 [58:41:40<27:52:45,  8.30s/it]
 68%|██████▊   | 25866/37963 [58:41:50<30:09:19,  8.97s/it]
 68%|██████▊   | 25867/37963 [58:41:58<29:05:13,  8.66s/it]
 68%|██████▊   | 25868/37963 [58:42:09<30:54:30,  9.20s/it]
 68%|██████▊   | 25869/37963 [58:42:16<29:25:31,  8.76s/it]
 68%|██████▊   | 25870/37963 [58:42:24<28:21:58,  8.44s/it]
                                                           
{'loss': '0.1324', 'grad_norm': '1.548', 'learning_rate': '4.867e-06', 'epoch': '0.6815'}
+
 68%|██████▊   | 25870/37963 [58:42:24<28:21:58,  8.44s/it]
 68%|██████▊   | 25871/37963 [58:42:32<27:39:38,  8.24s/it]
 68%|██████▊   | 25872/37963 [58:42:40<27:14:55,  8.11s/it]
 68%|██████▊   | 25873/37963 [58:42:47<26:51:35,  8.00s/it]
 68%|██████▊   | 25874/37963 [58:42:55<26:28:36,  7.88s/it]
 68%|██████▊   | 25875/37963 [58:43:03<26:18:06,  7.83s/it]
 68%|██████▊   | 25876/37963 [58:43:10<26:00:42,  7.75s/it]
 68%|██████▊   | 25877/37963 [58:43:18<25:57:47,  7.73s/it]
 68%|██████▊   | 25878/37963 [58:43:25<25:44:15,  7.67s/it]
 68%|██████▊   | 25879/37963 [58:43:33<25:51:24,  7.70s/it]
 68%|██████▊   | 25880/37963 [58:43:41<25:46:31,  7.68s/it]
                                                           
{'loss': '0.1448', 'grad_norm': '2.609', 'learning_rate': '4.86e-06', 'epoch': '0.6817'}
+
 68%|██████▊   | 25880/37963 [58:43:41<25:46:31,  7.68s/it]
 68%|██████▊   | 25881/37963 [58:43:48<25:42:53,  7.66s/it]
 68%|██████▊   | 25882/37963 [58:43:56<25:36:05,  7.63s/it]
 68%|██████▊   | 25883/37963 [58:44:04<25:32:30,  7.61s/it]
 68%|██████▊   | 25884/37963 [58:44:11<25:36:00,  7.63s/it]
 68%|██████▊   | 25885/37963 [58:44:19<26:00:54,  7.75s/it]
 68%|██████▊   | 25886/37963 [58:44:27<26:02:53,  7.76s/it]
 68%|██████▊   | 25887/37963 [58:44:35<26:00:17,  7.75s/it]
 68%|██████▊   | 25888/37963 [58:44:43<26:18:25,  7.84s/it]
 68%|██████▊   | 25889/37963 [58:44:51<26:13:57,  7.82s/it]
 68%|██████▊   | 25890/37963 [58:44:58<26:08:11,  7.79s/it]
                                                           
{'loss': '0.1299', 'grad_norm': '2.531', 'learning_rate': '4.852e-06', 'epoch': '0.682'}
+
 68%|██████▊   | 25890/37963 [58:44:58<26:08:11,  7.79s/it]
 68%|██████▊   | 25891/37963 [58:45:06<25:58:00,  7.74s/it]
 68%|██████▊   | 25892/37963 [58:45:14<25:47:57,  7.69s/it]
 68%|██████▊   | 25893/37963 [58:45:21<26:01:12,  7.76s/it]
 68%|██████▊   | 25894/37963 [58:45:32<28:52:45,  8.61s/it]
 68%|██████▊   | 25895/37963 [58:45:40<28:12:29,  8.41s/it]
 68%|██████▊   | 25896/37963 [58:45:50<29:53:08,  8.92s/it]
 68%|██████▊   | 25897/37963 [58:46:00<31:04:14,  9.27s/it]
 68%|██████▊   | 25898/37963 [58:46:08<29:20:02,  8.75s/it]
 68%|██████▊   | 25899/37963 [58:46:15<27:54:45,  8.33s/it]
 68%|██████▊   | 25900/37963 [58:46:23<27:20:47,  8.16s/it]
                                                           
{'loss': '0.1182', 'grad_norm': '2.875', 'learning_rate': '4.845e-06', 'epoch': '0.6822'}
+
 68%|██████▊   | 25900/37963 [58:46:23<27:20:47,  8.16s/it]
 68%|██████▊   | 25901/37963 [58:46:31<27:03:22,  8.08s/it]
 68%|██████▊   | 25902/37963 [58:46:41<29:19:39,  8.75s/it]
 68%|██████▊   | 25903/37963 [58:46:49<28:27:38,  8.50s/it]
 68%|██████▊   | 25904/37963 [58:47:00<30:43:11,  9.17s/it]
 68%|██████▊   | 25905/37963 [58:47:08<29:42:34,  8.87s/it]
 68%|██████▊   | 25906/37963 [58:47:16<28:45:49,  8.59s/it]
 68%|██████▊   | 25907/37963 [58:47:23<27:47:08,  8.30s/it]
 68%|██████▊   | 25908/37963 [58:47:31<27:25:07,  8.19s/it]
 68%|██████▊   | 25909/37963 [58:47:39<26:55:36,  8.04s/it]
 68%|██████▊   | 25910/37963 [58:47:47<26:43:51,  7.98s/it]
                                                           
{'loss': '0.1301', 'grad_norm': '2.56', 'learning_rate': '4.838e-06', 'epoch': '0.6825'}
+
 68%|██████▊   | 25910/37963 [58:47:47<26:43:51,  7.98s/it]
 68%|██████▊   | 25911/37963 [58:47:55<26:30:47,  7.92s/it]
 68%|██████▊   | 25912/37963 [58:48:02<26:21:40,  7.87s/it]
 68%|██████▊   | 25913/37963 [58:48:13<28:46:02,  8.59s/it]
 68%|██████▊   | 25914/37963 [58:48:20<27:56:49,  8.35s/it]
 68%|██████▊   | 25915/37963 [58:48:28<27:11:55,  8.13s/it]
 68%|██████▊   | 25916/37963 [58:48:36<26:50:50,  8.02s/it]
 68%|██████▊   | 25917/37963 [58:48:43<26:26:19,  7.90s/it]
 68%|██████▊   | 25918/37963 [58:48:51<26:12:32,  7.83s/it]
 68%|██████▊   | 25919/37963 [58:48:59<26:13:49,  7.84s/it]
 68%|██████▊   | 25920/37963 [58:49:09<28:31:52,  8.53s/it]
                                                           
{'loss': '0.1331', 'grad_norm': '2.409', 'learning_rate': '4.831e-06', 'epoch': '0.6828'}
+
 68%|██████▊   | 25920/37963 [58:49:09<28:31:52,  8.53s/it]
 68%|██████▊   | 25921/37963 [58:49:20<30:22:52,  9.08s/it]
 68%|██████▊   | 25922/37963 [58:49:27<28:53:55,  8.64s/it]
 68%|██████▊   | 25923/37963 [58:49:35<28:13:20,  8.44s/it]
 68%|██████▊   | 25924/37963 [58:49:43<27:19:12,  8.17s/it]
 68%|██████▊   | 25925/37963 [58:49:50<26:56:19,  8.06s/it]
 68%|██████▊   | 25926/37963 [58:49:58<26:27:47,  7.91s/it]
 68%|██████▊   | 25927/37963 [58:50:05<25:57:55,  7.77s/it]
 68%|██████▊   | 25928/37963 [58:50:14<26:17:49,  7.87s/it]
 68%|██████▊   | 25929/37963 [58:50:21<26:06:53,  7.81s/it]
 68%|██████▊   | 25930/37963 [58:50:29<26:01:08,  7.78s/it]
                                                           
{'loss': '0.1308', 'grad_norm': '2.041', 'learning_rate': '4.823e-06', 'epoch': '0.683'}
+
 68%|██████▊   | 25930/37963 [58:50:29<26:01:08,  7.78s/it]
 68%|██████▊   | 25931/37963 [58:50:37<25:49:25,  7.73s/it]
 68%|██████▊   | 25932/37963 [58:50:44<25:28:44,  7.62s/it]
 68%|██████▊   | 25933/37963 [58:50:52<25:26:04,  7.61s/it]
 68%|██████▊   | 25934/37963 [58:50:59<25:24:05,  7.60s/it]
 68%|██████▊   | 25935/37963 [58:51:07<25:29:42,  7.63s/it]
 68%|██████▊   | 25936/37963 [58:51:14<25:27:31,  7.62s/it]
 68%|██████▊   | 25937/37963 [58:51:25<28:27:06,  8.52s/it]
 68%|██████▊   | 25938/37963 [58:51:33<27:45:33,  8.31s/it]
 68%|██████▊   | 25939/37963 [58:51:41<27:15:37,  8.16s/it]
 68%|██████▊   | 25940/37963 [58:51:49<26:59:02,  8.08s/it]
                                                           
{'loss': '0.1284', 'grad_norm': '1.155', 'learning_rate': '4.816e-06', 'epoch': '0.6833'}
+
 68%|██████▊   | 25940/37963 [58:51:49<26:59:02,  8.08s/it]
 68%|██████▊   | 25941/37963 [58:51:56<26:24:37,  7.91s/it]
 68%|██████▊   | 25942/37963 [58:52:04<26:07:37,  7.82s/it]
 68%|██████▊   | 25943/37963 [58:52:11<26:06:29,  7.82s/it]
 68%|██████▊   | 25944/37963 [58:52:19<25:51:40,  7.75s/it]
 68%|██████▊   | 25945/37963 [58:52:30<28:36:45,  8.57s/it]
 68%|██████▊   | 25946/37963 [58:52:37<27:49:57,  8.34s/it]
 68%|██████��   | 25947/37963 [58:52:45<27:12:44,  8.15s/it]
 68%|██████▊   | 25948/37963 [58:52:56<29:36:38,  8.87s/it]
 68%|██████▊   | 25949/37963 [58:53:04<28:39:06,  8.59s/it]
 68%|██████▊   | 25950/37963 [58:53:14<30:42:50,  9.20s/it]
                                                           
{'loss': '0.1314', 'grad_norm': '3.526', 'learning_rate': '4.809e-06', 'epoch': '0.6836'}
+
 68%|██████▊   | 25950/37963 [58:53:14<30:42:50,  9.20s/it]
 68%|██████▊   | 25951/37963 [58:53:22<29:27:21,  8.83s/it]
 68%|██████▊   | 25952/37963 [58:53:33<31:10:33,  9.34s/it]
 68%|██████▊   | 25953/37963 [58:53:41<29:43:18,  8.91s/it]
 68%|██████▊   | 25954/37963 [58:53:48<28:35:24,  8.57s/it]
 68%|██████▊   | 25955/37963 [58:53:56<27:54:24,  8.37s/it]
 68%|██████▊   | 25956/37963 [58:54:04<27:10:59,  8.15s/it]
 68%|██████▊   | 25957/37963 [58:54:12<26:57:50,  8.09s/it]
 68%|██████▊   | 25958/37963 [58:54:19<26:27:58,  7.94s/it]
 68%|██████▊   | 25959/37963 [58:54:29<28:25:36,  8.53s/it]
 68%|██████▊   | 25960/37963 [58:54:37<27:51:00,  8.35s/it]
                                                           
{'loss': '0.1299', 'grad_norm': '1.406', 'learning_rate': '4.801e-06', 'epoch': '0.6838'}
+
 68%|██████▊   | 25960/37963 [58:54:37<27:51:00,  8.35s/it]
 68%|██████▊   | 25961/37963 [58:54:45<27:07:00,  8.13s/it]
 68%|██████▊   | 25962/37963 [58:54:53<26:54:14,  8.07s/it]
 68%|██████▊   | 25963/37963 [58:55:03<29:18:54,  8.79s/it]
 68%|██████▊   | 25964/37963 [58:55:11<27:50:20,  8.35s/it]
 68%|██████▊   | 25965/37963 [58:55:18<27:18:30,  8.19s/it]
 68%|██████▊   | 25966/37963 [58:55:26<26:46:34,  8.03s/it]
 68%|██████▊   | 25967/37963 [58:55:34<26:23:53,  7.92s/it]
 68%|██████▊   | 25968/37963 [58:55:42<26:16:24,  7.89s/it]
 68%|██████▊   | 25969/37963 [58:55:49<26:07:50,  7.84s/it]
 68%|██████▊   | 25970/37963 [58:55:59<28:24:12,  8.53s/it]
                                                           
{'loss': '0.1171', 'grad_norm': '1.81', 'learning_rate': '4.794e-06', 'epoch': '0.6841'}
+
 68%|██████▊   | 25970/37963 [58:55:59<28:24:12,  8.53s/it]
 68%|██████▊   | 25971/37963 [58:56:07<27:37:40,  8.29s/it]
 68%|██████▊   | 25972/37963 [58:56:15<27:03:36,  8.12s/it]
 68%|██████▊   | 25973/37963 [58:56:23<26:58:13,  8.10s/it]
 68%|██████▊   | 25974/37963 [58:56:30<26:15:49,  7.89s/it]
 68%|██████▊   | 25975/37963 [58:56:38<25:56:51,  7.79s/it]
 68%|██████▊   | 25976/37963 [58:56:45<25:38:28,  7.70s/it]
 68%|██████▊   | 25977/37963 [58:56:53<25:35:46,  7.69s/it]
 68%|██████▊   | 25978/37963 [58:57:01<25:40:35,  7.71s/it]
 68%|██████▊   | 25979/37963 [58:57:08<25:30:41,  7.66s/it]
 68%|██████▊   | 25980/37963 [58:57:16<25:45:05,  7.74s/it]
                                                           
{'loss': '0.1418', 'grad_norm': '1.741', 'learning_rate': '4.787e-06', 'epoch': '0.6844'}
+
 68%|██████▊   | 25980/37963 [58:57:16<25:45:05,  7.74s/it]
 68%|██████▊   | 25981/37963 [58:57:24<25:56:02,  7.79s/it]
 68%|██████▊   | 25982/37963 [58:57:32<26:02:31,  7.82s/it]
 68%|██████▊   | 25983/37963 [58:57:40<25:46:42,  7.75s/it]
 68%|██████▊   | 25984/37963 [58:57:47<25:22:03,  7.62s/it]
 68%|██████▊   | 25985/37963 [58:57:58<28:19:21,  8.51s/it]
 68%|██████▊   | 25986/37963 [58:58:05<27:37:29,  8.30s/it]
 68%|██████▊   | 25987/37963 [58:58:13<27:06:47,  8.15s/it]
 68%|██████▊   | 25988/37963 [58:58:21<26:39:31,  8.01s/it]
 68%|██████▊   | 25989/37963 [58:58:29<26:29:13,  7.96s/it]
 68%|██████▊   | 25990/37963 [58:58:37<26:26:05,  7.95s/it]
                                                           
{'loss': '0.1426', 'grad_norm': '4.278', 'learning_rate': '4.78e-06', 'epoch': '0.6846'}
+
 68%|██████▊   | 25990/37963 [58:58:37<26:26:05,  7.95s/it]
 68%|██████▊   | 25991/37963 [58:58:45<26:22:19,  7.93s/it]
 68%|██████▊   | 25992/37963 [58:58:55<29:03:31,  8.74s/it]
 68%|██████▊   | 25993/37963 [58:59:06<30:45:00,  9.25s/it]
 68%|██████▊   | 25994/37963 [58:59:16<32:19:30,  9.72s/it]
 68%|██████▊   | 25995/37963 [58:59:25<30:51:01,  9.28s/it]
 68%|██████▊   | 25996/37963 [58:59:32<29:12:26,  8.79s/it]
 68%|██████▊   | 25997/37963 [58:59:40<27:55:39,  8.40s/it]
 68%|██████▊   | 25998/37963 [58:59:47<27:08:51,  8.17s/it]
 68%|██████▊   | 25999/37963 [58:59:55<26:47:22,  8.06s/it]
 68%|██████▊   | 26000/37963 [59:00:06<29:20:59,  8.83s/it]
                                                           
{'loss': '0.1244', 'grad_norm': '1.98', 'learning_rate': '4.772e-06', 'epoch': '0.6849'}
+
 68%|██████▊   | 26000/37963 [59:00:06<29:20:59,  8.83s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.48s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.48s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 68%|██████▊   | 26001/37963 [59:01:05<79:33:45, 23.94s/it]
 68%|██████▊   | 26002/37963 [59:01:13<63:27:49, 19.10s/it]
 68%|██████▊   | 26003/37963 [59:01:21<52:06:28, 15.68s/it]
 68%|██████▊   | 26004/37963 [59:01:28<44:18:36, 13.34s/it]
 69%|██████▊   | 26005/37963 [59:01:39<41:15:47, 12.42s/it]
 69%|██████▊   | 26006/37963 [59:01:46<36:31:06, 10.99s/it]
 69%|██████▊   | 26007/37963 [59:01:54<32:50:07,  9.89s/it]
 69%|██████▊   | 26008/37963 [59:02:01<30:36:56,  9.22s/it]
 69%|██████▊   | 26009/37963 [59:02:09<28:57:42,  8.72s/it]
 69%|██████▊   | 26010/37963 [59:02:19<30:20:57,  9.14s/it]
                                                           
{'loss': '0.1147', 'grad_norm': '1.874', 'learning_rate': '4.765e-06', 'epoch': '0.6851'}
+
 69%|██████▊   | 26010/37963 [59:02:19<30:20:57,  9.14s/it]
 69%|██████▊   | 26011/37963 [59:02:27<28:53:51,  8.70s/it]
 69%|██████▊   | 26012/37963 [59:02:35<28:05:46,  8.46s/it]
 69%|██████▊   | 26013/37963 [59:02:42<27:22:23,  8.25s/it]
 69%|██████▊   | 26014/37963 [59:02:50<26:52:44,  8.10s/it]
 69%|██████▊   | 26015/37963 [59:02:57<26:09:18,  7.88s/it]
 69%|██████▊   | 26016/37963 [59:03:05<26:09:10,  7.88s/it]
 69%|██████▊   | 26017/37963 [59:03:13<25:55:48,  7.81s/it]
 69%|██████▊   | 26018/37963 [59:03:21<25:55:32,  7.81s/it]
 69%|██████▊   | 26019/37963 [59:03:28<25:36:57,  7.72s/it]
 69%|██████▊   | 26020/37963 [59:03:36<25:52:44,  7.80s/it]
                                                           
{'loss': '0.1314', 'grad_norm': '1.673', 'learning_rate': '4.758e-06', 'epoch': '0.6854'}
+
 69%|██████▊   | 26020/37963 [59:03:36<25:52:44,  7.80s/it]
 69%|██████▊   | 26021/37963 [59:03:47<28:24:32,  8.56s/it]
 69%|██████▊   | 26022/37963 [59:03:55<27:47:39,  8.38s/it]
 69%|██████▊   | 26023/37963 [59:04:02<27:10:20,  8.19s/it]
 69%|██████▊   | 26024/37963 [59:04:10<26:50:17,  8.09s/it]
 69%|██████▊   | 26025/37963 [59:04:18<26:24:30,  7.96s/it]
 69%|██████▊   | 26026/37963 [59:04:26<26:10:23,  7.89s/it]
 69%|██████▊   | 26027/37963 [59:04:34<26:14:14,  7.91s/it]
 69%|██████▊   | 26028/37963 [59:04:41<26:08:13,  7.88s/it]
 69%|██████▊   | 26029/37963 [59:04:49<25:44:09,  7.76s/it]
 69%|██████▊   | 26030/37963 [59:04:57<26:00:58,  7.85s/it]
                                                           
{'loss': '0.1221', 'grad_norm': '2.918', 'learning_rate': '4.75e-06', 'epoch': '0.6857'}
+
 69%|██████▊   | 26030/37963 [59:04:57<26:00:58,  7.85s/it]
 69%|██████▊   | 26031/37963 [59:05:04<25:38:29,  7.74s/it]
 69%|██████▊   | 26032/37963 [59:05:12<25:45:46,  7.77s/it]
 69%|██████▊   | 26033/37963 [59:05:20<25:43:30,  7.76s/it]
 69%|██████▊   | 26034/37963 [59:05:28<25:43:54,  7.77s/it]
 69%|██████▊   | 26035/37963 [59:05:39<28:49:50,  8.70s/it]
 69%|██████▊   | 26036/37963 [59:05:52<33:33:14, 10.13s/it]
 69%|██████▊   | 26037/37963 [59:06:03<33:59:01, 10.26s/it]
 69%|██████▊   | 26038/37963 [59:06:10<31:29:00,  9.50s/it]
 69%|██████▊   | 26039/37963 [59:06:18<29:45:19,  8.98s/it]
 69%|██████▊   | 26040/37963 [59:06:26<28:36:27,  8.64s/it]
                                                           
{'loss': '0.1471', 'grad_norm': '4.731', 'learning_rate': '4.743e-06', 'epoch': '0.6859'}
+
 69%|██████▊   | 26040/37963 [59:06:26<28:36:27,  8.64s/it]
 69%|██████▊   | 26041/37963 [59:06:34<27:44:31,  8.38s/it]
 69%|██████▊   | 26042/37963 [59:06:42<27:18:28,  8.25s/it]
 69%|██████▊   | 26043/37963 [59:06:50<26:49:08,  8.10s/it]
 69%|██████▊   | 26044/37963 [59:06:57<26:37:41,  8.04s/it]
 69%|██████▊   | 26045/37963 [59:07:05<26:24:22,  7.98s/it]
 69%|██████▊   | 26046/37963 [59:07:13<26:02:04,  7.86s/it]
 69%|██████▊   | 26047/37963 [59:07:21<25:55:58,  7.83s/it]
 69%|██████��   | 26048/37963 [59:07:31<28:29:46,  8.61s/it]
 69%|██████▊   | 26049/37963 [59:07:39<27:32:35,  8.32s/it]
 69%|██████▊   | 26050/37963 [59:07:46<26:37:03,  8.04s/it]
                                                           
{'loss': '0.122', 'grad_norm': '1.963', 'learning_rate': '4.736e-06', 'epoch': '0.6862'}
+
 69%|██████▊   | 26050/37963 [59:07:46<26:37:03,  8.04s/it]
 69%|██████▊   | 26051/37963 [59:07:57<29:17:38,  8.85s/it]
 69%|██████▊   | 26052/37963 [59:08:05<28:23:05,  8.58s/it]
 69%|██████▊   | 26053/37963 [59:08:13<27:34:38,  8.34s/it]
 69%|██████▊   | 26054/37963 [59:08:20<27:11:14,  8.22s/it]
 69%|██████▊   | 26055/37963 [59:08:28<26:55:27,  8.14s/it]
 69%|██████▊   | 26056/37963 [59:08:36<26:21:15,  7.97s/it]
 69%|██████▊   | 26057/37963 [59:08:44<26:10:08,  7.91s/it]
 69%|██████▊   | 26058/37963 [59:08:54<28:40:00,  8.67s/it]
 69%|██████▊   | 26059/37963 [59:09:02<27:48:07,  8.41s/it]
 69%|██████▊   | 26060/37963 [59:09:10<27:06:42,  8.20s/it]
                                                           
{'loss': '0.1312', 'grad_norm': '3.525', 'learning_rate': '4.729e-06', 'epoch': '0.6865'}
+
 69%|██████▊   | 26060/37963 [59:09:10<27:06:42,  8.20s/it]
 69%|██████▊   | 26061/37963 [59:09:17<26:22:10,  7.98s/it]
 69%|██████▊   | 26062/37963 [59:09:25<25:55:42,  7.84s/it]
 69%|██████▊   | 26063/37963 [59:09:32<25:47:41,  7.80s/it]
 69%|██████▊   | 26064/37963 [59:09:40<25:57:54,  7.86s/it]
 69%|██████▊   | 26065/37963 [59:09:51<28:13:10,  8.54s/it]
 69%|██████▊   | 26066/37963 [59:09:58<27:38:07,  8.36s/it]
 69%|██████▊   | 26067/37963 [59:10:06<26:55:25,  8.15s/it]
 69%|██████▊   | 26068/37963 [59:10:14<26:32:45,  8.03s/it]
 69%|██████▊   | 26069/37963 [59:10:22<26:10:16,  7.92s/it]
 69%|██████▊   | 26070/37963 [59:10:29<25:48:58,  7.81s/it]
                                                           
{'loss': '0.1374', 'grad_norm': '1.752', 'learning_rate': '4.721e-06', 'epoch': '0.6867'}
+
 69%|██████▊   | 26070/37963 [59:10:29<25:48:58,  7.81s/it]
 69%|██████▊   | 26071/37963 [59:10:37<25:38:00,  7.76s/it]
 69%|██████▊   | 26072/37963 [59:10:44<25:30:16,  7.72s/it]
 69%|██████▊   | 26073/37963 [59:10:52<25:33:37,  7.74s/it]
 69%|██████▊   | 26074/37963 [59:11:00<25:31:34,  7.73s/it]
 69%|██████▊   | 26075/37963 [59:11:08<25:34:25,  7.74s/it]
 69%|██████▊   | 26076/37963 [59:11:15<25:37:15,  7.76s/it]
 69%|██████▊   | 26077/37963 [59:11:23<25:44:05,  7.79s/it]
 69%|██████▊   | 26078/37963 [59:11:31<25:35:28,  7.75s/it]
 69%|██████▊   | 26079/37963 [59:11:42<28:23:00,  8.60s/it]
 69%|██████▊   | 26080/37963 [59:11:49<27:36:46,  8.37s/it]
                                                           
{'loss': '0.1323', 'grad_norm': '1.445', 'learning_rate': '4.714e-06', 'epoch': '0.687'}
+
 69%|██████▊   | 26080/37963 [59:11:49<27:36:46,  8.37s/it]
 69%|██████▊   | 26081/37963 [59:11:57<26:31:41,  8.04s/it]
 69%|██████▊   | 26082/37963 [59:12:05<26:22:08,  7.99s/it]
 69%|██████▊   | 26083/37963 [59:12:14<28:13:06,  8.55s/it]
 69%|██████▊   | 26084/37963 [59:12:22<27:37:08,  8.37s/it]
 69%|██████▊   | 26085/37963 [59:12:30<27:04:41,  8.21s/it]
 69%|██████▊   | 26086/37963 [59:12:38<26:38:29,  8.08s/it]
 69%|██████▊   | 26087/37963 [59:12:46<26:18:22,  7.97s/it]
 69%|██████▊   | 26088/37963 [59:12:56<28:55:11,  8.77s/it]
 69%|██████▊   | 26089/37963 [59:13:04<27:54:36,  8.46s/it]
 69%|██████▊   | 26090/37963 [59:13:14<29:49:35,  9.04s/it]
                                                           
{'loss': '0.1299', 'grad_norm': '1.656', 'learning_rate': '4.707e-06', 'epoch': '0.6873'}
+
 69%|██████▊   | 26090/37963 [59:13:14<29:49:35,  9.04s/it]
 69%|██████▊   | 26091/37963 [59:13:22<28:41:59,  8.70s/it]
 69%|██████▊   | 26092/37963 [59:13:30<27:36:11,  8.37s/it]
 69%|██████▊   | 26093/37963 [59:13:38<27:06:41,  8.22s/it]
 69%|██████▊   | 26094/37963 [59:13:46<26:37:06,  8.07s/it]
 69%|██████▊   | 26095/37963 [59:13:53<26:09:36,  7.94s/it]
 69%|██████▊   | 26096/37963 [59:14:03<28:22:38,  8.61s/it]
 69%|██████▊   | 26097/37963 [59:14:11<27:40:49,  8.40s/it]
 69%|██████▊   | 26098/37963 [59:14:19<27:14:58,  8.27s/it]
 69%|██████▊   | 26099/37963 [59:14:27<26:58:27,  8.19s/it]
 69%|██████▉   | 26100/37963 [59:14:35<26:31:37,  8.05s/it]
                                                           
{'loss': '0.1206', 'grad_norm': '2.4', 'learning_rate': '4.7e-06', 'epoch': '0.6875'}
+
 69%|██████▉   | 26100/37963 [59:14:35<26:31:37,  8.05s/it]
 69%|██████▉   | 26101/37963 [59:14:43<26:16:59,  7.98s/it]
 69%|██████▉   | 26102/37963 [59:14:53<28:09:12,  8.54s/it]
 69%|██████▉   | 26103/37963 [59:15:01<27:47:27,  8.44s/it]
 69%|██████▉   | 26104/37963 [59:15:08<26:44:12,  8.12s/it]
 69%|██████▉   | 26105/37963 [59:15:19<29:03:04,  8.82s/it]
 69%|██████▉   | 26106/37963 [59:15:27<28:10:26,  8.55s/it]
 69%|██████▉   | 26107/37963 [59:15:34<27:22:00,  8.31s/it]
 69%|██████▉   | 26108/37963 [59:15:42<26:35:47,  8.08s/it]
 69%|██████▉   | 26109/37963 [59:15:50<26:17:31,  7.98s/it]
 69%|██████▉   | 26110/37963 [59:15:57<26:12:23,  7.96s/it]
                                                           
{'loss': '0.1322', 'grad_norm': '1.61', 'learning_rate': '4.692e-06', 'epoch': '0.6878'}
+
 69%|██████▉   | 26110/37963 [59:15:57<26:12:23,  7.96s/it]
 69%|██████▉   | 26111/37963 [59:16:05<25:47:03,  7.83s/it]
 69%|██████▉   | 26112/37963 [59:16:13<25:38:27,  7.79s/it]
 69%|██████▉   | 26113/37963 [59:16:21<25:38:45,  7.79s/it]
 69%|██████▉   | 26114/37963 [59:16:28<25:41:56,  7.81s/it]
 69%|██████▉   | 26115/37963 [59:16:36<25:41:30,  7.81s/it]
 69%|██████▉   | 26116/37963 [59:16:44<25:36:44,  7.78s/it]
 69%|██████▉   | 26117/37963 [59:16:52<25:33:28,  7.77s/it]
 69%|██████▉   | 26118/37963 [59:17:02<28:09:29,  8.56s/it]
 69%|██████▉   | 26119/37963 [59:17:10<27:37:48,  8.40s/it]
 69%|██████▉   | 26120/37963 [59:17:18<26:56:43,  8.19s/it]
                                                           
{'loss': '0.137', 'grad_norm': '2.508', 'learning_rate': '4.685e-06', 'epoch': '0.688'}
+
 69%|██████▉   | 26120/37963 [59:17:18<26:56:43,  8.19s/it]
 69%|██████▉   | 26121/37963 [59:17:25<26:25:54,  8.04s/it]
 69%|██████▉   | 26122/37963 [59:17:33<26:11:50,  7.96s/it]
 69%|██████▉   | 26123/37963 [59:17:41<25:51:40,  7.86s/it]
 69%|██████▉   | 26124/37963 [59:17:49<25:55:43,  7.88s/it]
 69%|██████▉   | 26125/37963 [59:17:57<25:54:03,  7.88s/it]
 69%|██████▉   | 26126/37963 [59:18:04<25:40:32,  7.81s/it]
 69%|██████▉   | 26127/37963 [59:18:15<28:33:04,  8.68s/it]
 69%|██████▉   | 26128/37963 [59:18:23<27:52:04,  8.48s/it]
 69%|██████▉   | 26129/37963 [59:18:31<27:11:22,  8.27s/it]
 69%|██████▉   | 26130/37963 [59:18:39<26:53:14,  8.18s/it]
                                                           
{'loss': '0.1398', 'grad_norm': '1.662', 'learning_rate': '4.678e-06', 'epoch': '0.6883'}
+
 69%|██████▉   | 26130/37963 [59:18:39<26:53:14,  8.18s/it]
 69%|██████▉   | 26131/37963 [59:18:49<29:13:04,  8.89s/it]
 69%|██████▉   | 26132/37963 [59:18:57<28:11:06,  8.58s/it]
 69%|██████▉   | 26133/37963 [59:19:05<27:21:17,  8.32s/it]
 69%|██████▉   | 26134/37963 [59:19:13<26:56:19,  8.20s/it]
 69%|██████▉   | 26135/37963 [59:19:20<26:24:59,  8.04s/it]
 69%|██████▉   | 26136/37963 [59:19:28<26:03:52,  7.93s/it]
 69%|██████▉   | 26137/37963 [59:19:36<25:46:27,  7.85s/it]
 69%|██████▉   | 26138/37963 [59:19:46<28:34:13,  8.70s/it]
 69%|██████▉   | 26139/37963 [59:19:54<27:35:25,  8.40s/it]
 69%|██████▉   | 26140/37963 [59:20:02<27:05:41,  8.25s/it]
                                                           
{'loss': '0.1258', 'grad_norm': '1.293', 'learning_rate': '4.671e-06', 'epoch': '0.6886'}
+
 69%|██████▉   | 26140/37963 [59:20:02<27:05:41,  8.25s/it]
 69%|██████▉   | 26141/37963 [59:20:10<26:24:45,  8.04s/it]
 69%|██████▉   | 26142/37963 [59:20:17<26:09:12,  7.96s/it]
 69%|██████▉   | 26143/37963 [59:20:25<25:36:49,  7.80s/it]
 69%|██████▉   | 26144/37963 [59:20:35<28:04:18,  8.55s/it]
 69%|██████▉   | 26145/37963 [59:20:43<27:16:03,  8.31s/it]
 69%|██████▉   | 26146/37963 [59:20:51<26:46:28,  8.16s/it]
 69%|██████▉   | 26147/37963 [59:20:58<26:15:36,  8.00s/it]
 69%|██████▉   | 26148/37963 [59:21:09<28:33:09,  8.70s/it]
 69%|██████▉   | 26149/37963 [59:21:16<27:21:33,  8.34s/it]
 69%|██████▉   | 26150/37963 [59:21:27<29:22:57,  8.95s/it]
                                                           
{'loss': '0.1288', 'grad_norm': '3.682', 'learning_rate': '4.664e-06', 'epoch': '0.6888'}
+
 69%|██████▉   | 26150/37963 [59:21:27<29:22:57,  8.95s/it]
 69%|██████▉   | 26151/37963 [59:21:34<28:10:21,  8.59s/it]
 69%|██████▉   | 26152/37963 [59:21:42<26:59:47,  8.23s/it]
 69%|████���█▉   | 26153/37963 [59:21:49<26:24:50,  8.05s/it]
 69%|██████▉   | 26154/37963 [59:21:57<26:17:54,  8.02s/it]
 69%|██████▉   | 26155/37963 [59:22:05<26:07:24,  7.96s/it]
 69%|██████▉   | 26156/37963 [59:22:13<25:54:10,  7.90s/it]
 69%|██████▉   | 26157/37963 [59:22:21<25:43:30,  7.84s/it]
 69%|██████▉   | 26158/37963 [59:22:28<25:41:45,  7.84s/it]
 69%|██████▉   | 26159/37963 [59:22:36<25:43:18,  7.84s/it]
 69%|██████▉   | 26160/37963 [59:22:44<25:31:11,  7.78s/it]
                                                           
{'loss': '0.1192', 'grad_norm': '5.062', 'learning_rate': '4.656e-06', 'epoch': '0.6891'}
+
 69%|██████▉   | 26160/37963 [59:22:44<25:31:11,  7.78s/it]
 69%|██████▉   | 26161/37963 [59:22:51<25:18:28,  7.72s/it]
 69%|██████▉   | 26162/37963 [59:23:02<27:49:12,  8.49s/it]
 69%|██████▉   | 26163/37963 [59:23:10<27:24:02,  8.36s/it]
 69%|██████▉   | 26164/37963 [59:23:18<26:47:33,  8.17s/it]
 69%|██████▉   | 26165/37963 [59:23:25<26:20:28,  8.04s/it]
 69%|██████▉   | 26166/37963 [59:23:33<26:17:46,  8.02s/it]
 69%|██████▉   | 26167/37963 [59:23:41<26:06:14,  7.97s/it]
 69%|██████▉   | 26168/37963 [59:23:49<25:57:17,  7.92s/it]
 69%|██████▉   | 26169/37963 [59:23:57<25:50:58,  7.89s/it]
 69%|██████▉   | 26170/37963 [59:24:04<25:38:50,  7.83s/it]
                                                           
{'loss': '0.1452', 'grad_norm': '1.724', 'learning_rate': '4.649e-06', 'epoch': '0.6894'}
+
 69%|██████▉   | 26170/37963 [59:24:04<25:38:50,  7.83s/it]
 69%|██████▉   | 26171/37963 [59:24:15<28:19:45,  8.65s/it]
 69%|██████▉   | 26172/37963 [59:24:23<27:40:50,  8.45s/it]
 69%|██████▉   | 26173/37963 [59:24:31<26:53:46,  8.21s/it]
 69%|██████▉   | 26174/37963 [59:24:38<26:24:25,  8.06s/it]
 69%|██████▉   | 26175/37963 [59:24:46<25:44:16,  7.86s/it]
 69%|██████▉   | 26176/37963 [59:24:53<25:28:32,  7.78s/it]
 69%|██████▉   | 26177/37963 [59:25:01<25:15:22,  7.71s/it]
 69%|██████▉   | 26178/37963 [59:25:09<25:17:38,  7.73s/it]
 69%|██████▉   | 26179/37963 [59:25:16<25:12:58,  7.70s/it]
 69%|██████▉   | 26180/37963 [59:25:27<27:56:53,  8.54s/it]
                                                           
{'loss': '0.1206', 'grad_norm': '3.059', 'learning_rate': '4.642e-06', 'epoch': '0.6896'}
+
 69%|██████▉   | 26180/37963 [59:25:27<27:56:53,  8.54s/it]
 69%|██████▉   | 26181/37963 [59:25:37<29:28:21,  9.01s/it]
 69%|██████▉   | 26182/37963 [59:25:47<31:00:49,  9.48s/it]
 69%|██████▉   | 26183/37963 [59:25:55<29:13:08,  8.93s/it]
 69%|██████▉   | 26184/37963 [59:26:03<28:19:44,  8.66s/it]
 69%|██████▉   | 26185/37963 [59:26:11<27:26:27,  8.39s/it]
 69%|██████▉   | 26186/37963 [59:26:19<26:43:02,  8.17s/it]
 69%|██████▉   | 26187/37963 [59:26:26<26:20:48,  8.05s/it]
 69%|██████▉   | 26188/37963 [59:26:34<26:01:36,  7.96s/it]
 69%|██████▉   | 26189/37963 [59:26:42<25:57:10,  7.94s/it]
 69%|██████▉   | 26190/37963 [59:26:50<25:40:31,  7.85s/it]
                                                           
{'loss': '0.1269', 'grad_norm': '2.527', 'learning_rate': '4.635e-06', 'epoch': '0.6899'}
+
 69%|██████▉   | 26190/37963 [59:26:50<25:40:31,  7.85s/it]
 69%|██████▉   | 26191/37963 [59:26:57<25:37:26,  7.84s/it]
 69%|██████▉   | 26192/37963 [59:27:05<25:18:21,  7.74s/it]
 69%|██████▉   | 26193/37963 [59:27:13<25:24:11,  7.77s/it]
 69%|██████▉   | 26194/37963 [59:27:23<28:07:19,  8.60s/it]
 69%|██████▉   | 26195/37963 [59:27:31<27:30:59,  8.42s/it]
 69%|██████▉   | 26196/37963 [59:27:39<26:39:14,  8.15s/it]
 69%|██████▉   | 26197/37963 [59:27:47<26:18:22,  8.05s/it]
 69%|██████▉   | 26198/37963 [59:27:59<30:59:32,  9.48s/it]
 69%|██████▉   | 26199/37963 [59:28:07<29:25:19,  9.00s/it]
 69%|██████▉   | 26200/37963 [59:28:15<28:10:59,  8.63s/it]
                                                           
{'loss': '0.1322', 'grad_norm': '1.917', 'learning_rate': '4.628e-06', 'epoch': '0.6901'}
+
 69%|██████▉   | 26200/37963 [59:28:15<28:10:59,  8.63s/it]
 69%|██████▉   | 26201/37963 [59:28:23<27:35:41,  8.45s/it]
 69%|██████▉   | 26202/37963 [59:28:31<26:52:57,  8.23s/it]
 69%|██████▉   | 26203/37963 [59:28:38<26:19:06,  8.06s/it]
 69%|██████▉   | 26204/37963 [59:28:46<25:47:20,  7.90s/it]
 69%|██████▉   | 26205/37963 [59:28:54<25:31:33,  7.82s/it]
 69%|██████▉   | 26206/37963 [59:29:01<25:24:41,  7.78s/it]
 69%|██���███▉   | 26207/37963 [59:29:09<25:16:01,  7.74s/it]
 69%|██████▉   | 26208/37963 [59:29:16<25:04:52,  7.68s/it]
 69%|██████▉   | 26209/37963 [59:29:24<25:11:17,  7.71s/it]
 69%|██████▉   | 26210/37963 [59:29:32<25:11:23,  7.72s/it]
                                                           
{'loss': '0.1358', 'grad_norm': '1.711', 'learning_rate': '4.62e-06', 'epoch': '0.6904'}
+
 69%|██████▉   | 26210/37963 [59:29:32<25:11:23,  7.72s/it]
 69%|██████▉   | 26211/37963 [59:29:40<25:20:17,  7.76s/it]
 69%|██████▉   | 26212/37963 [59:29:47<24:56:31,  7.64s/it]
 69%|██████▉   | 26213/37963 [59:29:55<24:45:45,  7.59s/it]
 69%|██████▉   | 26214/37963 [59:30:05<27:38:40,  8.47s/it]
 69%|██████▉   | 26215/37963 [59:30:13<26:59:41,  8.27s/it]
 69%|██████▉   | 26216/37963 [59:30:24<29:12:46,  8.95s/it]
 69%|██████▉   | 26217/37963 [59:30:31<28:05:59,  8.61s/it]
 69%|██████▉   | 26218/37963 [59:30:39<27:08:40,  8.32s/it]
 69%|██████▉   | 26219/37963 [59:30:47<26:22:08,  8.08s/it]
 69%|██████▉   | 26220/37963 [59:30:54<25:50:55,  7.92s/it]
                                                           
{'loss': '0.1152', 'grad_norm': '1.664', 'learning_rate': '4.613e-06', 'epoch': '0.6907'}
+
 69%|██████▉   | 26220/37963 [59:30:54<25:50:55,  7.92s/it]
 69%|██████▉   | 26221/37963 [59:31:02<25:53:11,  7.94s/it]
 69%|██████▉   | 26222/37963 [59:31:10<25:42:02,  7.88s/it]
 69%|██████▉   | 26223/37963 [59:31:18<25:32:29,  7.83s/it]
 69%|██████▉   | 26224/37963 [59:31:25<25:30:27,  7.82s/it]
 69%|██████▉   | 26225/37963 [59:31:33<25:16:49,  7.75s/it]
 69%|██████▉   | 26226/37963 [59:31:43<27:53:34,  8.56s/it]
 69%|██████▉   | 26227/37963 [59:31:51<26:50:52,  8.24s/it]
 69%|██████▉   | 26228/37963 [59:31:59<26:15:58,  8.06s/it]
 69%|██████▉   | 26229/37963 [59:32:06<26:10:16,  8.03s/it]
 69%|██████▉   | 26230/37963 [59:32:17<28:23:44,  8.71s/it]
                                                           
{'loss': '0.1302', 'grad_norm': '1.512', 'learning_rate': '4.606e-06', 'epoch': '0.6909'}
+
 69%|██████▉   | 26230/37963 [59:32:17<28:23:44,  8.71s/it]
 69%|██████▉   | 26231/37963 [59:32:25<27:28:40,  8.43s/it]
 69%|██████▉   | 26232/37963 [59:32:32<26:46:17,  8.22s/it]
 69%|██████▉   | 26233/37963 [59:32:40<26:02:38,  7.99s/it]
 69%|██████▉   | 26234/37963 [59:32:47<25:46:32,  7.91s/it]
 69%|██████▉   | 26235/37963 [59:32:55<25:30:42,  7.83s/it]
 69%|██████▉   | 26236/37963 [59:33:06<28:02:01,  8.61s/it]
 69%|██████▉   | 26237/37963 [59:33:13<27:04:40,  8.31s/it]
 69%|██████▉   | 26238/37963 [59:33:21<26:28:27,  8.13s/it]
 69%|██████▉   | 26239/37963 [59:33:28<25:58:40,  7.98s/it]
 69%|██████▉   | 26240/37963 [59:33:36<25:51:52,  7.94s/it]
                                                           
{'loss': '0.1288', 'grad_norm': '3.061', 'learning_rate': '4.599e-06', 'epoch': '0.6912'}
+
 69%|██████▉   | 26240/37963 [59:33:36<25:51:52,  7.94s/it]
 69%|██████▉   | 26241/37963 [59:33:44<25:37:24,  7.87s/it]
 69%|██████▉   | 26242/37963 [59:33:54<28:06:49,  8.63s/it]
 69%|██████▉   | 26243/37963 [59:34:02<27:27:40,  8.44s/it]
 69%|██████▉   | 26244/37963 [59:34:10<26:50:30,  8.25s/it]
 69%|██████▉   | 26245/37963 [59:34:18<26:12:33,  8.05s/it]
 69%|██████▉   | 26246/37963 [59:34:28<28:29:18,  8.75s/it]
 69%|██████▉   | 26247/37963 [59:34:36<27:35:37,  8.48s/it]
 69%|██████▉   | 26248/37963 [59:34:44<26:46:46,  8.23s/it]
 69%|██████▉   | 26249/37963 [59:34:51<26:18:19,  8.08s/it]
 69%|██████▉   | 26250/37963 [59:34:59<25:54:59,  7.97s/it]
                                                           
{'loss': '0.1315', 'grad_norm': '1.675', 'learning_rate': '4.592e-06', 'epoch': '0.6915'}
+
 69%|██████▉   | 26250/37963 [59:34:59<25:54:59,  7.97s/it]
 69%|██████▉   | 26251/37963 [59:35:07<25:44:43,  7.91s/it]
 69%|██████▉   | 26252/37963 [59:35:18<28:23:45,  8.73s/it]
 69%|██████▉   | 26253/37963 [59:35:25<27:34:25,  8.48s/it]
 69%|██████▉   | 26254/37963 [59:35:33<26:51:41,  8.26s/it]
 69%|██████▉   | 26255/37963 [59:35:41<26:22:19,  8.11s/it]
 69%|██████▉   | 26256/37963 [59:35:49<26:09:04,  8.04s/it]
 69%|██████▉   | 26257/37963 [59:35:57<26:07:20,  8.03s/it]
 69%|██████▉   | 26258/37963 [59:36:08<28:53:58,  8.89s/it]
 69%|██████▉   | 26259/37963 [59:36:16<27:57:46,  8.60s/it]
 69%|██████▉   | 26260/37963 [59:36:23<27:00:54,  8.31s/it]
                                                           
{'loss': '0.1333', 'grad_norm': '1.819', 'learning_rate': '4.584e-06', 'epoch': '0.6917'}
+
 69%|██████▉   | 26260/37963 [59:36:23<27:00:54,  8.31s/it]
 69%|██████▉   | 26261/37963 [59:36:31<26:36:16,  8.18s/it]
 69%|██████▉   | 26262/37963 [59:36:39<26:12:15,  8.06s/it]
 69%|██████▉   | 26263/37963 [59:36:47<25:44:07,  7.92s/it]
 69%|██████▉   | 26264/37963 [59:36:57<28:02:40,  8.63s/it]
 69%|██████▉   | 26265/37963 [59:37:05<27:14:00,  8.38s/it]
 69%|██████▉   | 26266/37963 [59:37:12<26:33:14,  8.17s/it]
 69%|██████▉   | 26267/37963 [59:37:20<26:18:10,  8.10s/it]
 69%|██████▉   | 26268/37963 [59:37:28<26:01:14,  8.01s/it]
 69%|██████▉   | 26269/37963 [59:37:36<26:03:12,  8.02s/it]
 69%|██████▉   | 26270/37963 [59:37:44<25:43:42,  7.92s/it]
                                                           
{'loss': '0.1239', 'grad_norm': '2.145', 'learning_rate': '4.577e-06', 'epoch': '0.692'}
+
 69%|██████▉   | 26270/37963 [59:37:44<25:43:42,  7.92s/it]
 69%|██████▉   | 26271/37963 [59:37:51<25:21:06,  7.81s/it]
 69%|██████▉   | 26272/37963 [59:37:59<25:08:02,  7.74s/it]
 69%|██████▉   | 26273/37963 [59:38:09<27:33:16,  8.49s/it]
 69%|██████▉   | 26274/37963 [59:38:20<29:26:07,  9.07s/it]
 69%|██████▉   | 26275/37963 [59:38:27<27:54:47,  8.60s/it]
 69%|██████▉   | 26276/37963 [59:38:35<26:51:41,  8.27s/it]
 69%|██████▉   | 26277/37963 [59:38:42<26:21:25,  8.12s/it]
 69%|██████▉   | 26278/37963 [59:38:50<25:54:16,  7.98s/it]
 69%|██████▉   | 26279/37963 [59:38:58<25:31:26,  7.86s/it]
 69%|██████▉   | 26280/37963 [59:39:06<25:40:09,  7.91s/it]
                                                           
{'loss': '0.1346', 'grad_norm': '2.302', 'learning_rate': '4.57e-06', 'epoch': '0.6923'}
+
 69%|██████▉   | 26280/37963 [59:39:06<25:40:09,  7.91s/it]
 69%|██████▉   | 26281/37963 [59:39:13<25:29:18,  7.85s/it]
 69%|██████▉   | 26282/37963 [59:39:21<25:16:33,  7.79s/it]
 69%|██████▉   | 26283/37963 [59:39:29<25:08:03,  7.75s/it]
 69%|██████▉   | 26284/37963 [59:39:36<25:10:38,  7.76s/it]
 69%|██████▉   | 26285/37963 [59:39:47<27:51:25,  8.59s/it]
 69%|██████▉   | 26286/37963 [59:39:55<26:56:10,  8.30s/it]
 69%|██████▉   | 26287/37963 [59:40:02<26:02:58,  8.03s/it]
 69%|██████▉   | 26288/37963 [59:40:10<25:42:01,  7.92s/it]
 69%|██████▉   | 26289/37963 [59:40:17<25:34:18,  7.89s/it]
 69%|██████▉   | 26290/37963 [59:40:25<25:29:03,  7.86s/it]
                                                           
{'loss': '0.1362', 'grad_norm': '1.756', 'learning_rate': '4.563e-06', 'epoch': '0.6925'}
+
 69%|██████▉   | 26290/37963 [59:40:25<25:29:03,  7.86s/it]
 69%|██████▉   | 26291/37963 [59:40:36<28:04:58,  8.66s/it]
 69%|██████▉   | 26292/37963 [59:40:43<27:07:05,  8.36s/it]
 69%|██████▉   | 26293/37963 [59:40:51<26:28:36,  8.17s/it]
 69%|██████▉   | 26294/37963 [59:40:59<26:06:13,  8.05s/it]
 69%|██████▉   | 26295/37963 [59:41:09<28:19:09,  8.74s/it]
 69%|██████▉   | 26296/37963 [59:41:17<27:17:07,  8.42s/it]
 69%|██████▉   | 26297/37963 [59:41:25<26:33:21,  8.19s/it]
 69%|██████▉   | 26298/37963 [59:41:32<25:59:05,  8.02s/it]
 69%|██████▉   | 26299/37963 [59:41:40<25:35:58,  7.90s/it]
 69%|██████▉   | 26300/37963 [59:41:50<27:54:55,  8.62s/it]
                                                           
{'loss': '0.1308', 'grad_norm': '4.185', 'learning_rate': '4.556e-06', 'epoch': '0.6928'}
+
 69%|██████▉   | 26300/37963 [59:41:50<27:54:55,  8.62s/it]
 69%|██████▉   | 26301/37963 [59:41:58<27:02:12,  8.35s/it]
 69%|██████▉   | 26302/37963 [59:42:08<28:56:51,  8.94s/it]
 69%|██████▉   | 26303/37963 [59:42:16<27:55:12,  8.62s/it]
 69%|██████▉   | 26304/37963 [59:42:24<27:05:43,  8.37s/it]
 69%|██████▉   | 26305/37963 [59:42:31<26:23:40,  8.15s/it]
 69%|██████▉   | 26306/37963 [59:42:39<26:02:35,  8.04s/it]
 69%|██████▉   | 26307/37963 [59:42:47<25:36:46,  7.91s/it]
 69%|██████▉   | 26308/37963 [59:42:55<25:32:28,  7.89s/it]
 69%|██████▉   | 26309/37963 [59:43:02<25:20:35,  7.83s/it]
 69%|██████▉   | 26310/37963 [59:43:10<25:14:16,  7.80s/it]
                                                           
{'loss': '0.1254', 'grad_norm': '5.882', 'learning_rate': '4.549e-06', 'epoch': '0.693'}
+
 69%|██████▉   | 26310/37963 [59:43:10<25:14:16,  7.80s/it]
 69%|██████▉   | 26311/37963 [59:43:18<25:09:01,  7.77s/it]
 69%|██████▉   | 26312/37963 [59:43:28<27:44:59,  8.57s/it]
 69%|██████▉   | 26313/37963 [59:43:36<27:04:32,  8.37s/it]
 69%|██████▉   | 26314/37963 [59:43:44<26:28:01,  8.18s/it]
 69%|██████▉   | 26315/37963 [59:43:52<26:08:17,  8.08s/it]
 69%|██████▉   | 26316/37963 [59:43:59<25:43:33,  7.95s/it]
 69%|██████▉   | 26317/37963 [59:44:07<25:14:32,  7.80s/it]
 69%|██████▉   | 26318/37963 [59:44:15<25:13:31,  7.80s/it]
 69%|██████▉   | 26319/37963 [59:44:22<24:45:53,  7.66s/it]
 69%|██████▉   | 26320/37963 [59:44:30<24:48:25,  7.67s/it]
                                                           
{'loss': '0.128', 'grad_norm': '1.622', 'learning_rate': '4.541e-06', 'epoch': '0.6933'}
+
 69%|██████▉   | 26320/37963 [59:44:30<24:48:25,  7.67s/it]
 69%|██████▉   | 26321/37963 [59:44:38<25:04:10,  7.75s/it]
 69%|██████▉   | 26322/37963 [59:44:45<24:57:34,  7.72s/it]
 69%|██████▉   | 26323/37963 [59:44:53<25:04:04,  7.75s/it]
 69%|██████▉   | 26324/37963 [59:45:01<24:52:16,  7.69s/it]
 69%|██████▉   | 26325/37963 [59:45:14<29:56:03,  9.26s/it]
 69%|██████▉   | 26326/37963 [59:45:22<28:52:52,  8.93s/it]
 69%|██████▉   | 26327/37963 [59:45:30<27:48:09,  8.60s/it]
 69%|██████▉   | 26328/37963 [59:45:37<26:52:08,  8.31s/it]
 69%|██████▉   | 26329/37963 [59:45:45<26:31:01,  8.21s/it]
 69%|██████▉   | 26330/37963 [59:45:53<26:03:26,  8.06s/it]
                                                           
{'loss': '0.1295', 'grad_norm': '3.419', 'learning_rate': '4.534e-06', 'epoch': '0.6936'}
+
 69%|██████▉   | 26330/37963 [59:45:53<26:03:26,  8.06s/it]
 69%|██████▉   | 26331/37963 [59:46:01<25:45:04,  7.97s/it]
 69%|██████▉   | 26332/37963 [59:46:08<25:17:46,  7.83s/it]
 69%|██████▉   | 26333/37963 [59:46:19<28:05:32,  8.70s/it]
 69%|██████▉   | 26334/37963 [59:46:29<29:33:56,  9.15s/it]
 69%|██████▉   | 26335/37963 [59:46:37<28:15:27,  8.75s/it]
 69%|██████▉   | 26336/37963 [59:46:45<27:16:38,  8.45s/it]
 69%|██████▉   | 26337/37963 [59:46:52<26:34:35,  8.23s/it]
 69%|██████▉   | 26338/37963 [59:47:03<28:33:43,  8.85s/it]
 69%|██████▉   | 26339/37963 [59:47:10<27:37:06,  8.55s/it]
 69%|██████▉   | 26340/37963 [59:47:18<27:04:24,  8.39s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '2.204', 'learning_rate': '4.527e-06', 'epoch': '0.6938'}
+
 69%|██████▉   | 26340/37963 [59:47:18<27:04:24,  8.39s/it]
 69%|██████▉   | 26341/37963 [59:47:26<26:03:32,  8.07s/it]
 69%|██████▉   | 26342/37963 [59:47:34<25:40:37,  7.95s/it]
 69%|██████▉   | 26343/37963 [59:47:41<25:18:59,  7.84s/it]
 69%|██████▉   | 26344/37963 [59:47:49<25:10:56,  7.80s/it]
 69%|██████▉   | 26345/37963 [59:47:57<25:07:11,  7.78s/it]
 69%|██████▉   | 26346/37963 [59:48:04<24:59:44,  7.75s/it]
 69%|██████▉   | 26347/37963 [59:48:15<27:34:53,  8.55s/it]
 69%|██████▉   | 26348/37963 [59:48:22<26:49:26,  8.31s/it]
 69%|██████▉   | 26349/37963 [59:48:30<26:16:52,  8.15s/it]
 69%|██████▉   | 26350/37963 [59:48:38<25:47:38,  8.00s/it]
                                                           
{'loss': '0.1355', 'grad_norm': '4.208', 'learning_rate': '4.52e-06', 'epoch': '0.6941'}
+
 69%|██████▉   | 26350/37963 [59:48:38<25:47:38,  8.00s/it]
 69%|██████▉   | 26351/37963 [59:48:46<25:31:51,  7.92s/it]
 69%|██████▉   | 26352/37963 [59:48:53<25:27:18,  7.89s/it]
 69%|██████▉   | 26353/37963 [59:49:01<25:17:41,  7.84s/it]
 69%|██████▉   | 26354/37963 [59:49:09<25:08:03,  7.79s/it]
 69%|██████▉   | 26355/37963 [59:49:16<24:57:53,  7.74s/it]
 69%|██████▉   | 26356/37963 [59:49:27<27:44:42,  8.61s/it]
 69%|██████▉   | 26357/37963 [59:49:35<27:02:52,  8.39s/it]
 69%|██████▉   | 26358/37963 [59:49:43<26:26:01,  8.20s/it]
 69%|██████▉   | 26359/37963 [59:49:50<25:53:32,  8.03s/it]
 69%|██████▉   | 26360/37963 [59:49:58<25:16:52,  7.84s/it]
                                                           
{'loss': '0.1271', 'grad_norm': '2.187', 'learning_rate': '4.513e-06', 'epoch': '0.6944'}
+
 69%|██████▉   | 26360/37963 [59:49:58<25:16:52,  7.84s/it]
 69%|██████▉   | 26361/37963 [59:50:05<24:51:47,  7.71s/it]
 69%|██████▉   | 26362/37963 [59:50:13<25:13:46,  7.83s/it]
 69%|██████▉   | 26363/37963 [59:50:21<24:50:08,  7.71s/it]
 69%|██████▉   | 26364/37963 [59:50:28<24:51:23,  7.71s/it]
 69%|██████▉   | 26365/37963 [59:50:36<24:58:07,  7.75s/it]
 69%|██████▉   | 26366/37963 [59:50:46<27:20:26,  8.49s/it]
 69%|██████▉   | 26367/37963 [59:50:54<26:45:06,  8.31s/it]
 69%|██████▉   | 26368/37963 [59:51:02<26:08:14,  8.12s/it]
 69%|██████▉   | 26369/37963 [59:51:12<28:21:59,  8.81s/it]
 69%|██████▉   | 26370/37963 [59:51:20<27:22:04,  8.50s/it]
                                                           
{'loss': '0.1222', 'grad_norm': '1.187', 'learning_rate': '4.506e-06', 'epoch': '0.6946'}
+
 69%|██████▉   | 26370/37963 [59:51:20<27:22:04,  8.50s/it]
 69%|██████▉   | 26371/37963 [59:51:28<26:46:12,  8.31s/it]
 69%|██████▉   | 26372/37963 [59:51:36<26:25:25,  8.21s/it]
 69%|██████▉   | 26373/37963 [59:51:44<25:52:09,  8.04s/it]
 69%|██████▉   | 26374/37963 [59:51:51<25:21:00,  7.87s/it]
 69%|██████▉   | 26375/37963 [59:51:58<24:52:04,  7.73s/it]
 69%|██████▉   | 26376/37963 [59:52:06<24:58:58,  7.76s/it]
 69%|██████▉   | 26377/37963 [59:52:14<24:52:46,  7.73s/it]
 69%|██████▉   | 26378/37963 [59:52:24<27:30:03,  8.55s/it]
 69%|██████▉   | 26379/37963 [59:52:32<26:32:14,  8.25s/it]
 69%|██████▉   | 26380/37963 [59:52:40<26:20:23,  8.19s/it]
                                                           
{'loss': '0.1252', 'grad_norm': '2.376', 'learning_rate': '4.499e-06', 'epoch': '0.6949'}
+
 69%|██████▉   | 26380/37963 [59:52:40<26:20:23,  8.19s/it]
 69%|██████▉   | 26381/37963 [59:52:51<28:41:53,  8.92s/it]
 69%|██████▉   | 26382/37963 [59:52:58<27:29:10,  8.54s/it]
 69%|██████▉   | 26383/37963 [59:53:06<26:32:21,  8.25s/it]
 69%|██████▉   | 26384/37963 [59:53:13<25:43:11,  8.00s/it]
 70%|██████▉   | 26385/37963 [59:53:21<25:22:34,  7.89s/it]
 70%|██████▉   | 26386/37963 [59:53:28<24:48:47,  7.72s/it]
 70%|██████▉   | 26387/37963 [59:53:38<26:59:00,  8.39s/it]
 70%|██████▉   | 26388/37963 [59:53:46<26:20:37,  8.19s/it]
 70%|██████▉   | 26389/37963 [59:53:54<25:52:48,  8.05s/it]
 70%|██████▉   | 26390/37963 [59:54:01<25:20:38,  7.88s/it]
                                                           
{'loss': '0.1257', 'grad_norm': '2.409', 'learning_rate': '4.492e-06', 'epoch': '0.6952'}
+
 70%|██████▉   | 26390/37963 [59:54:01<25:20:38,  7.88s/it]
 70%|██████▉   | 26391/37963 [59:54:09<25:20:20,  7.88s/it]
 70%|██████▉   | 26392/37963 [59:54:17<25:07:45,  7.82s/it]
 70%|██████▉   | 26393/37963 [59:54:24<25:00:19,  7.78s/it]
 70%|██████▉   | 26394/37963 [59:54:32<25:09:09,  7.83s/it]
 70%|██████▉   | 26395/37963 [59:54:40<24:58:50,  7.77s/it]
 70%|██████▉   | 26396/37963 [59:54:47<24:42:47,  7.69s/it]
 70%|██████▉   | 26397/37963 [59:54:58<27:23:23,  8.53s/it]
 70%|██████▉   | 26398/37963 [59:55:06<26:52:24,  8.37s/it]
 70%|██████▉   | 26399/37963 [59:55:14<26:13:33,  8.16s/it]
 70%|██████▉   | 26400/37963 [59:55:21<25:43:41,  8.01s/it]
                                                           
{'loss': '0.1448', 'grad_norm': '2.331', 'learning_rate': '4.484e-06', 'epoch': '0.6954'}
+
 70%|██████▉   | 26400/37963 [59:55:21<25:43:41,  8.01s/it]
 70%|██████▉   | 26401/37963 [59:55:29<25:26:18,  7.92s/it]
 70%|██████▉   | 26402/37963 [59:55:37<25:13:54,  7.86s/it]
 70%|██████▉   | 26403/37963 [59:55:45<25:17:26,  7.88s/it]
 70%|██████▉   | 26404/37963 [59:55:52<25:10:43,  7.84s/it]
 70%|██████▉   | 26405/37963 [59:56:00<25:08:46,  7.83s/it]
 70%|██████▉   | 26406/37963 [59:56:08<25:09:19,  7.84s/it]
 70%|██████▉   | 26407/37963 [59:56:16<24:59:12,  7.78s/it]
 70%|██████▉   | 26408/37963 [59:56:23<24:54:17,  7.76s/it]
 70%|██████▉   | 26409/37963 [59:56:31<24:47:49,  7.73s/it]
 70%|██████▉   | 26410/37963 [59:56:44<30:03:14,  9.37s/it]
                                                           
{'loss': '0.1292', 'grad_norm': '2.072', 'learning_rate': '4.477e-06', 'epoch': '0.6957'}
+
 70%|██████▉   | 26410/37963 [59:56:44<30:03:14,  9.37s/it]
 70%|██████▉   | 26411/37963 [59:56:52<28:42:42,  8.95s/it]
 70%|██████▉   | 26412/37963 [59:57:00<27:36:42,  8.61s/it]
 70%|██████▉   | 26413/37963 [59:57:08<26:46:34,  8.35s/it]
 70%|██████▉   | 26414/37963 [59:57:15<26:09:01,  8.15s/it]
 70%|██████▉   | 26415/37963 [59:57:23<25:45:01,  8.03s/it]
 70%|██████▉   | 26416/37963 [59:57:31<25:14:34,  7.87s/it]
 70%|██████▉   | 26417/37963 [59:57:38<25:03:55,  7.82s/it]
 70%|██████▉   | 26418/37963 [59:57:46<24:53:48,  7.76s/it]
 70%|██████▉   | 26419/37963 [59:57:54<24:55:45,  7.77s/it]
 70%|██████▉   | 26420/37963 [59:58:01<24:47:36,  7.73s/it]
                                                           
{'loss': '0.1289', 'grad_norm': '1.187', 'learning_rate': '4.47e-06', 'epoch': '0.6959'}
+
 70%|██████▉   | 26420/37963 [59:58:01<24:47:36,  7.73s/it]
 70%|██████▉   | 26421/37963 [59:58:12<27:07:49,  8.46s/it]
 70%|██████▉   | 26422/37963 [59:58:23<29:30:31,  9.20s/it]
 70%|██████▉   | 26423/37963 [59:58:30<28:07:39,  8.77s/it]
 70%|██████▉   | 26424/37963 [59:58:38<26:55:18,  8.40s/it]
 70%|██████▉   | 26425/37963 [59:58:48<28:52:46,  9.01s/it]
 70%|██████▉   | 26426/37963 [59:58:56<27:43:25,  8.65s/it]
 70%|██████▉   | 26427/37963 [59:59:06<29:13:14,  9.12s/it]
 70%|██████▉   | 26428/37963 [59:59:14<27:42:50,  8.65s/it]
 70%|██████▉   | 26429/37963 [59:59:22<26:47:17,  8.36s/it]
 70%|██████▉   | 26430/37963 [59:59:29<26:00:03,  8.12s/it]
                                                           
{'loss': '0.126', 'grad_norm': '2.053', 'learning_rate': '4.463e-06', 'epoch': '0.6962'}
+
 70%|██████▉   | 26430/37963 [59:59:29<26:00:03,  8.12s/it]
 70%|██████▉   | 26431/37963 [59:59:37<25:36:03,  7.99s/it]
 70%|██████▉   | 26432/37963 [59:59:44<25:15:00,  7.88s/it]
 70%|██████▉   | 26433/37963 [59:59:53<25:25:23,  7.94s/it]
 70%|██████▉   | 26434/37963 [60:00:00<25:22:51,  7.93s/it]
 70%|██████▉   | 26435/37963 [60:00:11<27:40:31,  8.64s/it]
 70%|██████▉   | 26436/37963 [60:00:19<27:04:22,  8.46s/it]
 70%|██████▉   | 26437/37963 [60:00:27<26:30:17,  8.28s/it]
 70%|██████▉   | 26438/37963 [60:00:34<25:54:00,  8.09s/it]
 70%|██████▉   | 26439/37963 [60:00:42<25:32:58,  7.98s/it]
 70%|██████▉   | 26440/37963 [60:00:50<25:13:07,  7.88s/it]
                                                           
{'loss': '0.1282', 'grad_norm': '1.897', 'learning_rate': '4.456e-06', 'epoch': '0.6965'}
+
 70%|██████▉   | 26440/37963 [60:00:50<25:13:07,  7.88s/it]
 70%|██████▉   | 26441/37963 [60:00:57<25:02:16,  7.82s/it]
 70%|██████▉   | 26442/37963 [60:01:05<24:54:06,  7.78s/it]
 70%|██████▉   | 26443/37963 [60:01:13<25:09:07,  7.86s/it]
 70%|██████▉   | 26444/37963 [60:01:21<24:57:21,  7.80s/it]
 70%|██████▉   | 26445/37963 [60:01:31<27:21:20,  8.55s/it]
 70%|██████▉   | 26446/37963 [60:01:39<26:25:48,  8.26s/it]
 70%|██████▉   | 26447/37963 [60:01:46<25:52:44,  8.09s/it]
 70%|██████▉   | 26448/37963 [60:01:54<25:32:59,  7.99s/it]
 70%|██████▉   | 26449/37963 [60:02:02<25:13:10,  7.89s/it]
 70%|██████▉   | 26450/37963 [60:02:10<25:20:37,  7.92s/it]
                                                           
{'loss': '0.1285', 'grad_norm': '2.534', 'learning_rate': '4.449e-06', 'epoch': '0.6967'}
+
 70%|██████▉   | 26450/37963 [60:02:10<25:20:37,  7.92s/it]
 70%|██████▉   | 26451/37963 [60:02:17<25:02:48,  7.83s/it]
 70%|██████▉   | 26452/37963 [60:02:25<24:40:07,  7.72s/it]
 70%|██████▉   | 26453/37963 [60:02:32<24:37:39,  7.70s/it]
 70%|██████▉   | 26454/37963 [60:02:43<27:12:36,  8.51s/it]
 70%|██████▉   | 26455/37963 [60:02:51<26:25:22,  8.27s/it]
 70%|██████▉   | 26456/37963 [60:02:58<25:30:48,  7.98s/it]
 70%|██████▉   | 26457/37963 [60:03:06<25:20:53,  7.93s/it]
 70%|██████▉   | 26458/37963 [60:03:13<25:04:14,  7.84s/it]
 70%|██████▉   | 26459/37963 [60:03:21<24:29:07,  7.66s/it]
 70%|██████▉   | 26460/37963 [60:03:28<24:18:55,  7.61s/it]
                                                           
{'loss': '0.1432', 'grad_norm': '2.015', 'learning_rate': '4.442e-06', 'epoch': '0.697'}
+
 70%|██████▉   | 26460/37963 [60:03:28<24:18:55,  7.61s/it]
 70%|██████▉   | 26461/37963 [60:03:36<24:23:06,  7.63s/it]
 70%|██████▉   | 26462/37963 [60:03:43<24:27:06,  7.65s/it]
 70%|██████▉   | 26463/37963 [60:03:51<24:16:31,  7.60s/it]
 70%|██████▉   | 26464/37963 [60:04:01<26:49:22,  8.40s/it]
 70%|██████▉   | 26465/37963 [60:04:09<26:05:06,  8.17s/it]
 70%|██████▉   | 26466/37963 [60:04:20<28:31:31,  8.93s/it]
 70%|██████▉   | 26467/37963 [60:04:27<27:30:49,  8.62s/it]
 70%|██████▉   | 26468/37963 [60:04:35<26:42:24,  8.36s/it]
 70%|██████▉   | 26469/37963 [60:04:46<28:37:04,  8.96s/it]
 70%|██████▉   | 26470/37963 [60:04:53<27:26:20,  8.59s/it]
                                                           
{'loss': '0.1269', 'grad_norm': '1.479', 'learning_rate': '4.435e-06', 'epoch': '0.6973'}
+
 70%|██████▉   | 26470/37963 [60:04:53<27:26:20,  8.59s/it]
 70%|██████▉   | 26471/37963 [60:05:01<26:36:15,  8.33s/it]
 70%|██████▉   | 26472/37963 [60:05:09<26:04:34,  8.17s/it]
 70%|██████▉   | 26473/37963 [60:05:16<25:39:14,  8.04s/it]
 70%|██████▉   | 26474/37963 [60:05:24<25:24:21,  7.96s/it]
 70%|██████▉   | 26475/37963 [60:05:34<27:26:47,  8.60s/it]
 70%|██████▉   | 26476/37963 [60:05:42<26:51:04,  8.42s/it]
 70%|██████▉   | 26477/37963 [60:05:50<26:01:41,  8.16s/it]
 70%|██████▉   | 26478/37963 [60:06:00<28:09:09,  8.82s/it]
 70%|██████▉   | 26479/37963 [60:06:08<27:18:24,  8.56s/it]
 70%|██████▉   | 26480/37963 [60:06:16<26:31:43,  8.32s/it]
                                                           
{'loss': '0.1278', 'grad_norm': '1.871', 'learning_rate': '4.428e-06', 'epoch': '0.6975'}
+
 70%|██████▉   | 26480/37963 [60:06:16<26:31:43,  8.32s/it]
 70%|██████▉   | 26481/37963 [60:06:26<28:32:40,  8.95s/it]
 70%|██████▉   | 26482/37963 [60:06:34<27:22:22,  8.58s/it]
 70%|██████▉   | 26483/37963 [60:06:42<26:28:51,  8.30s/it]
 70%|██████▉   | 26484/37963 [60:06:50<25:55:18,  8.13s/it]
 70%|██████▉   | 26485/37963 [60:06:57<25:37:12,  8.04s/it]
 70%|██████▉   | 26486/37963 [60:07:05<24:59:53,  7.84s/it]
 70%|██████▉   | 26487/37963 [60:07:12<24:48:03,  7.78s/it]
 70%|██████▉   | 26488/37963 [60:07:20<24:29:40,  7.68s/it]
 70%|██████▉   | 26489/37963 [60:07:28<24:31:29,  7.69s/it]
 70%|██████▉   | 26490/37963 [60:07:35<24:34:33,  7.71s/it]
                                                           
{'loss': '0.1311', 'grad_norm': '2.572', 'learning_rate': '4.421e-06', 'epoch': '0.6978'}
+
 70%|██████▉   | 26490/37963 [60:07:35<24:34:33,  7.71s/it]
 70%|██████▉   | 26491/37963 [60:07:43<24:46:45,  7.78s/it]
 70%|██████▉   | 26492/37963 [60:07:51<24:42:21,  7.75s/it]
 70%|██████▉   | 26493/37963 [60:08:02<27:25:17,  8.61s/it]
 70%|██████▉   | 26494/37963 [60:08:09<26:30:35,  8.32s/it]
 70%|██████▉   | 26495/37963 [60:08:17<26:11:06,  8.22s/it]
 70%|██████▉   | 26496/37963 [60:08:25<25:36:58,  8.04s/it]
 70%|██████▉   | 26497/37963 [60:08:33<25:20:46,  7.96s/it]
 70%|██████▉   | 26498/37963 [60:08:40<24:39:29,  7.74s/it]
 70%|██████▉   | 26499/37963 [60:08:47<24:34:50,  7.72s/it]
 70%|██████▉   | 26500/37963 [60:08:55<24:41:14,  7.75s/it]
                                                           
{'loss': '0.1365', 'grad_norm': '3.107', 'learning_rate': '4.413e-06', 'epoch': '0.6981'}
+
 70%|██████▉   | 26500/37963 [60:08:55<24:41:14,  7.75s/it]
 70%|██████▉   | 26501/37963 [60:09:03<24:33:41,  7.71s/it]
 70%|██████▉   | 26502/37963 [60:09:13<26:56:46,  8.46s/it]
 70%|██████▉   | 26503/37963 [60:09:21<26:06:41,  8.20s/it]
 70%|██████▉   | 26504/37963 [60:09:28<25:38:55,  8.06s/it]
 70%|██████▉   | 26505/37963 [60:09:36<25:16:39,  7.94s/it]
 70%|██████▉   | 26506/37963 [60:09:44<25:01:47,  7.86s/it]
 70%|██████▉   | 26507/37963 [60:09:52<24:57:21,  7.84s/it]
 70%|██████▉   | 26508/37963 [60:09:59<24:52:07,  7.82s/it]
 70%|██████▉   | 26509/37963 [60:10:07<24:25:29,  7.68s/it]
 70%|██████▉   | 26510/37963 [60:10:14<24:31:52,  7.71s/it]
                                                           
{'loss': '0.1236', 'grad_norm': '3.716', 'learning_rate': '4.406e-06', 'epoch': '0.6983'}
+
 70%|██████▉   | 26510/37963 [60:10:14<24:31:52,  7.71s/it]
 70%|██████▉   | 26511/37963 [60:10:22<24:28:59,  7.70s/it]
 70%|██████▉   | 26512/37963 [60:10:33<27:14:38,  8.57s/it]
 70%|██████▉   | 26513/37963 [60:10:43<28:52:34,  9.08s/it]
 70%|██████▉   | 26514/37963 [60:10:51<27:29:16,  8.64s/it]
 70%|██████▉   | 26515/37963 [60:10:58<26:44:51,  8.41s/it]
 70%|██████▉   | 26516/37963 [60:11:06<26:09:23,  8.23s/it]
 70%|██████▉   | 26517/37963 [60:11:14<25:41:00,  8.08s/it]
 70%|██████▉   | 26518/37963 [60:11:25<27:58:39,  8.80s/it]
 70%|██████▉   | 26519/37963 [60:11:32<26:56:23,  8.47s/it]
 70%|██████▉   | 26520/37963 [60:11:40<26:12:42,  8.25s/it]
                                                           
{'loss': '0.121', 'grad_norm': '1.729', 'learning_rate': '4.399e-06', 'epoch': '0.6986'}
+
 70%|██████▉   | 26520/37963 [60:11:40<26:12:42,  8.25s/it]
 70%|██████▉   | 26521/37963 [60:11:48<25:47:51,  8.12s/it]
 70%|██████▉   | 26522/37963 [60:11:58<27:51:41,  8.77s/it]
 70%|██████▉   | 26523/37963 [60:12:09<29:30:23,  9.29s/it]
 70%|██████▉   | 26524/37963 [60:12:16<28:04:41,  8.84s/it]
 70%|██████▉   | 26525/37963 [60:12:24<27:12:45,  8.56s/it]
 70%|██████▉   | 26526/37963 [60:12:32<26:22:51,  8.30s/it]
 70%|██████▉   | 26527/37963 [60:12:39<25:36:00,  8.06s/it]
 70%|██████▉   | 26528/37963 [60:12:47<25:23:39,  7.99s/it]
 70%|██████▉   | 26529/37963 [60:12:55<25:05:57,  7.90s/it]
 70%|██████▉   | 26530/37963 [60:13:03<24:51:14,  7.83s/it]
                                                           
{'loss': '0.1203', 'grad_norm': '3.423', 'learning_rate': '4.392e-06', 'epoch': '0.6988'}
+
 70%|██████▉   | 26530/37963 [60:13:03<24:51:14,  7.83s/it]
 70%|██████▉   | 26531/37963 [60:13:10<24:38:54,  7.76s/it]
 70%|██████▉   | 26532/37963 [60:13:18<24:46:00,  7.80s/it]
 70%|██████▉   | 26533/37963 [60:13:26<24:37:42,  7.76s/it]
 70%|██████▉   | 26534/37963 [60:13:34<24:38:09,  7.76s/it]
 70%|██████▉   | 26535/37963 [60:13:44<27:10:52,  8.56s/it]
 70%|██████▉   | 26536/37963 [60:13:52<26:15:51,  8.27s/it]
 70%|██████▉   | 26537/37963 [60:13:59<25:45:02,  8.11s/it]
 70%|██████▉   | 26538/37963 [60:14:07<25:19:11,  7.98s/it]
 70%|██████▉   | 26539/37963 [60:14:15<24:56:40,  7.86s/it]
 70%|██████▉   | 26540/37963 [60:14:22<24:51:23,  7.83s/it]
                                                           
{'loss': '0.1155', 'grad_norm': '2.674', 'learning_rate': '4.385e-06', 'epoch': '0.6991'}
+
 70%|██████▉   | 26540/37963 [60:14:22<24:51:23,  7.83s/it]
 70%|██████▉   | 26541/37963 [60:14:30<24:56:34,  7.86s/it]
 70%|██████▉   | 26542/37963 [60:14:38<24:49:26,  7.82s/it]
 70%|██████▉   | 26543/37963 [60:14:46<24:39:18,  7.77s/it]
 70%|██████▉   | 26544/37963 [60:14:56<26:45:23,  8.44s/it]
 70%|██████▉   | 26545/37963 [60:15:06<28:38:35,  9.03s/it]
 70%|██████▉   | 26546/37963 [60:15:14<27:26:12,  8.65s/it]
 70%|██████▉   | 26547/37963 [60:15:22<26:37:02,  8.39s/it]
 70%|██████▉   | 26548/37963 [60:15:30<26:10:56,  8.26s/it]
 70%|██████▉   | 26549/37963 [60:15:37<25:39:32,  8.09s/it]
 70%|██████▉   | 26550/37963 [60:15:45<25:22:31,  8.00s/it]
                                                           
{'loss': '0.1328', 'grad_norm': '3.966', 'learning_rate': '4.378e-06', 'epoch': '0.6994'}
+
 70%|██████▉   | 26550/37963 [60:15:45<25:22:31,  8.00s/it]
 70%|██████▉   | 26551/37963 [60:15:53<25:04:37,  7.91s/it]
 70%|██████▉   | 26552/37963 [60:16:00<24:49:57,  7.83s/it]
 70%|██████▉   | 26553/37963 [60:16:08<24:46:50,  7.82s/it]
 70%|██████▉   | 26554/37963 [60:16:16<24:43:05,  7.80s/it]
 70%|██████▉   | 26555/37963 [60:16:24<24:37:33,  7.77s/it]
 70%|██████▉   | 26556/37963 [60:16:32<24:54:29,  7.86s/it]
 70%|██████▉   | 26557/37963 [60:16:42<27:28:51,  8.67s/it]
 70%|██████▉   | 26558/37963 [60:16:50<26:37:38,  8.40s/it]
 70%|██████▉   | 26559/37963 [60:16:58<25:58:47,  8.20s/it]
 70%|██████▉   | 26560/37963 [60:17:08<28:05:32,  8.87s/it]
                                                           
{'loss': '0.1256', 'grad_norm': '2.167', 'learning_rate': '4.371e-06', 'epoch': '0.6996'}
+
 70%|██████▉   | 26560/37963 [60:17:08<28:05:32,  8.87s/it]
 70%|██████▉   | 26561/37963 [60:17:16<26:57:11,  8.51s/it]
 70%|██████▉   | 26562/37963 [60:17:24<26:32:39,  8.38s/it]
 70%|██████▉   | 26563/37963 [60:17:32<26:01:27,  8.22s/it]
 70%|██████▉   | 26564/37963 [60:17:39<25:25:13,  8.03s/it]
 70%|██████▉   | 26565/37963 [60:17:47<25:14:01,  7.97s/it]
 70%|██████▉   | 26566/37963 [60:17:55<24:50:16,  7.85s/it]
 70%|██████▉   | 26567/37963 [60:18:05<27:06:43,  8.56s/it]
 70%|██████▉   | 26568/37963 [60:18:13<26:14:38,  8.29s/it]
 70%|██████▉   | 26569/37963 [60:18:20<25:44:05,  8.13s/it]
 70%|██████▉   | 26570/37963 [60:18:28<25:00:22,  7.90s/it]
                                                           
{'loss': '0.1041', 'grad_norm': '1.637', 'learning_rate': '4.364e-06', 'epoch': '0.6999'}
+
 70%|██████▉   | 26570/37963 [60:18:28<25:00:22,  7.90s/it]
 70%|██████▉   | 26571/37963 [60:18:35<24:33:14,  7.76s/it]
 70%|██████▉   | 26572/37963 [60:18:46<27:12:18,  8.60s/it]
 70%|██████▉   | 26573/37963 [60:18:53<26:07:36,  8.26s/it]
 70%|██████▉   | 26574/37963 [60:19:01<25:40:15,  8.11s/it]
 70%|███████   | 26575/37963 [60:19:08<25:02:04,  7.91s/it]
 70%|███████   | 26576/37963 [60:19:19<27:22:40,  8.66s/it]
 70%|███████   | 26577/37963 [60:19:26<26:20:42,  8.33s/it]
 70%|███████   | 26578/37963 [60:19:34<25:43:30,  8.13s/it]
 70%|███████   | 26579/37963 [60:19:42<25:18:37,  8.00s/it]
 70%|███████   | 26580/37963 [60:19:49<24:56:19,  7.89s/it]
                                                           
{'loss': '0.1235', 'grad_norm': '2.508', 'learning_rate': '4.357e-06', 'epoch': '0.7002'}
+
 70%|███████   | 26580/37963 [60:19:49<24:56:19,  7.89s/it]
 70%|███████   | 26581/37963 [60:19:57<24:51:49,  7.86s/it]
 70%|███████   | 26582/37963 [60:20:05<24:41:44,  7.81s/it]
 70%|███████   | 26583/37963 [60:20:13<24:43:03,  7.82s/it]
 70%|███████   | 26584/37963 [60:20:20<24:37:18,  7.79s/it]
 70%|███████   | 26585/37963 [60:20:28<24:12:26,  7.66s/it]
 70%|███████   | 26586/37963 [60:20:36<24:13:01,  7.66s/it]
 70%|███████   | 26587/37963 [60:20:43<24:00:33,  7.60s/it]
 70%|███████   | 26588/37963 [60:20:53<26:45:20,  8.47s/it]
 70%|███████   | 26589/37963 [60:21:04<28:33:15,  9.04s/it]
 70%|███████   | 26590/37963 [60:21:12<27:27:45,  8.69s/it]
                                                           
{'loss': '0.1307', 'grad_norm': '3.762', 'learning_rate': '4.35e-06', 'epoch': '0.7004'}
+
 70%|███████   | 26590/37963 [60:21:12<27:27:45,  8.69s/it]
 70%|███████   | 26591/37963 [60:21:19<26:11:17,  8.29s/it]
 70%|███████   | 26592/37963 [60:21:27<25:36:26,  8.11s/it]
 70%|███████   | 26593/37963 [60:21:34<25:00:57,  7.92s/it]
 70%|███████   | 26594/37963 [60:21:44<26:59:04,  8.54s/it]
 70%|███████   | 26595/37963 [60:21:52<26:16:55,  8.32s/it]
 70%|███████   | 26596/37963 [60:22:00<25:41:23,  8.14s/it]
 70%|███████   | 26597/37963 [60:22:08<25:23:37,  8.04s/it]
 70%|███████   | 26598/37963 [60:22:16<25:18:31,  8.02s/it]
 70%|███████   | 26599/37963 [60:22:23<25:07:25,  7.96s/it]
 70%|███████   | 26600/37963 [60:22:31<25:02:48,  7.94s/it]
                                                           
{'loss': '0.1233', 'grad_norm': '1.668', 'learning_rate': '4.343e-06', 'epoch': '0.7007'}
+
 70%|███████   | 26600/37963 [60:22:31<25:02:48,  7.94s/it]
 70%|███████   | 26601/37963 [60:22:39<24:39:07,  7.81s/it]
 70%|███████   | 26602/37963 [60:22:46<24:30:53,  7.77s/it]
 70%|███████   | 26603/37963 [60:22:54<24:27:43,  7.75s/it]
 70%|███████   | 26604/37963 [60:23:05<27:21:09,  8.67s/it]
 70%|███████   | 26605/37963 [60:23:13<26:43:16,  8.47s/it]
 70%|███████   | 26606/37963 [60:23:21<25:57:41,  8.23s/it]
 70%|███████   | 26607/37963 [60:23:28<25:21:14,  8.04s/it]
 70%|███████   | 26608/37963 [60:23:36<24:55:30,  7.90s/it]
 70%|███████   | 26609/37963 [60:23:44<24:52:48,  7.89s/it]
 70%|███████   | 26610/37963 [60:23:51<24:25:22,  7.74s/it]
                                                           
{'loss': '0.122', 'grad_norm': '1.251', 'learning_rate': '4.336e-06', 'epoch': '0.7009'}
+
 70%|███████   | 26610/37963 [60:23:51<24:25:22,  7.74s/it]
 70%|███████   | 26611/37963 [60:24:01<26:57:32,  8.55s/it]
 70%|███████   | 26612/37963 [60:24:09<26:20:11,  8.35s/it]
 70%|███████   | 26613/37963 [60:24:17<25:43:20,  8.16s/it]
 70%|███████   | 26614/37963 [60:24:25<25:16:24,  8.02s/it]
 70%|███████   | 26615/37963 [60:24:33<25:03:08,  7.95s/it]
 70%|███████   | 26616/37963 [60:24:40<24:39:38,  7.82s/it]
 70%|███████   | 26617/37963 [60:24:48<24:35:02,  7.80s/it]
 70%|███████   | 26618/37963 [60:24:58<27:00:46,  8.57s/it]
 70%|███████   | 26619/37963 [60:25:06<26:14:42,  8.33s/it]
 70%|███████   | 26620/37963 [60:25:14<25:33:52,  8.11s/it]
                                                           
{'loss': '0.1237', 'grad_norm': '1.796', 'learning_rate': '4.329e-06', 'epoch': '0.7012'}
+
 70%|███████   | 26620/37963 [60:25:14<25:33:52,  8.11s/it]
 70%|███████   | 26621/37963 [60:25:21<25:10:16,  7.99s/it]
 70%|███████   | 26622/37963 [60:25:29<25:02:25,  7.95s/it]
 70%|███████   | 26623/37963 [60:25:37<24:57:07,  7.92s/it]
 70%|███████   | 26624/37963 [60:25:47<27:16:48,  8.66s/it]
 70%|███████   | 26625/37963 [60:25:55<26:22:20,  8.37s/it]
 70%|███████   | 26626/37963 [60:26:06<28:21:21,  9.00s/it]
 70%|███████   | 26627/37963 [60:26:13<26:51:29,  8.53s/it]
 70%|███████   | 26628/37963 [60:26:21<26:06:17,  8.29s/it]
 70%|███████   | 26629/37963 [60:26:28<25:38:02,  8.14s/it]
 70%|███████   | 26630/37963 [60:26:36<25:18:40,  8.04s/it]
                                                           
{'loss': '0.1249', 'grad_norm': '3.434', 'learning_rate': '4.322e-06', 'epoch': '0.7015'}
+
 70%|███████   | 26630/37963 [60:26:36<25:18:40,  8.04s/it]
 70%|███████   | 26631/37963 [60:26:44<25:06:32,  7.98s/it]
 70%|███████   | 26632/37963 [60:26:52<24:50:14,  7.89s/it]
 70%|███████   | 26633/37963 [60:27:00<24:50:11,  7.89s/it]
 70%|███████   | 26634/37963 [60:27:07<24:39:18,  7.83s/it]
 70%|███████   | 26635/37963 [60:27:15<24:28:28,  7.78s/it]
 70%|███████   | 26636/37963 [60:27:26<27:01:48,  8.59s/it]
 70%|███████   | 26637/37963 [60:27:34<26:30:16,  8.42s/it]
 70%|███████   | 26638/37963 [60:27:41<25:44:46,  8.18s/it]
 70%|███████   | 26639/37963 [60:27:49<25:24:08,  8.08s/it]
 70%|███████   | 26640/37963 [60:27:59<27:20:38,  8.69s/it]
                                                           
{'loss': '0.1299', 'grad_norm': '1.557', 'learning_rate': '4.315e-06', 'epoch': '0.7017'}
+
 70%|███████   | 26640/37963 [60:27:59<27:20:38,  8.69s/it]
 70%|███████   | 26641/37963 [60:28:07<26:11:06,  8.33s/it]
 70%|███████   | 26642/37963 [60:28:17<27:58:51,  8.90s/it]
 70%|███████   | 26643/37963 [60:28:25<27:09:58,  8.64s/it]
 70%|███████   | 26644/37963 [60:28:33<26:20:56,  8.38s/it]
 70%|███████   | 26645/37963 [60:28:40<25:43:13,  8.18s/it]
 70%|███████   | 26646/37963 [60:28:49<25:39:45,  8.16s/it]
 70%|███████   | 26647/37963 [60:28:56<25:08:32,  8.00s/it]
 70%|███████   | 26648/37963 [60:29:04<24:57:32,  7.94s/it]
 70%|███████   | 26649/37963 [60:29:12<24:44:58,  7.88s/it]
 70%|███████   | 26650/37963 [60:29:19<24:17:46,  7.73s/it]
                                                           
{'loss': '0.1216', 'grad_norm': '2.932', 'learning_rate': '4.308e-06', 'epoch': '0.702'}
+
 70%|███████   | 26650/37963 [60:29:19<24:17:46,  7.73s/it]
 70%|███████   | 26651/37963 [60:29:27<24:28:12,  7.79s/it]
 70%|███████   | 26652/37963 [60:29:37<27:02:02,  8.60s/it]
 70%|███████   | 26653/37963 [60:29:45<26:09:34,  8.33s/it]
 70%|███████   | 26654/37963 [60:29:53<25:14:16,  8.03s/it]
 70%|███████   | 26655/37963 [60:30:00<24:46:47,  7.89s/it]
 70%|███████   | 26656/37963 [60:30:08<24:41:17,  7.86s/it]
 70%|███████   | 26657/37963 [60:30:16<24:29:54,  7.80s/it]
 70%|███████   | 26658/37963 [60:30:23<24:18:42,  7.74s/it]
 70%|███████   | 26659/37963 [60:30:34<26:54:12,  8.57s/it]
 70%|███████   | 26660/37963 [60:30:41<26:03:01,  8.30s/it]
                                                           
{'loss': '0.1213', 'grad_norm': '2.046', 'learning_rate': '4.301e-06', 'epoch': '0.7023'}
+
 70%|███████   | 26660/37963 [60:30:41<26:03:01,  8.30s/it]
 70%|███████   | 26661/37963 [60:30:49<25:16:50,  8.05s/it]
 70%|███████   | 26662/37963 [60:30:56<24:47:20,  7.90s/it]
 70%|███████   | 26663/37963 [60:31:04<24:21:06,  7.76s/it]
 70%|███████   | 26664/37963 [60:31:12<24:22:21,  7.77s/it]
 70%|███████   | 26665/37963 [60:31:19<24:26:01,  7.79s/it]
 70%|███████   | 26666/37963 [60:31:27<24:23:19,  7.77s/it]
 70%|███████   | 26667/37963 [60:31:35<24:29:29,  7.81s/it]
 70%|███████   | 26668/37963 [60:31:43<24:26:27,  7.79s/it]
 70%|███████   | 26669/37963 [60:31:50<24:18:14,  7.75s/it]
 70%|███████   | 26670/37963 [60:32:01<26:50:45,  8.56s/it]
                                                           
{'loss': '0.1293', 'grad_norm': '3.525', 'learning_rate': '4.294e-06', 'epoch': '0.7025'}
+
 70%|███████   | 26670/37963 [60:32:01<26:50:45,  8.56s/it]
 70%|███████   | 26671/37963 [60:32:09<26:22:05,  8.41s/it]
 70%|███████   | 26672/37963 [60:32:19<27:48:31,  8.87s/it]
 70%|███████   | 26673/37963 [60:32:27<26:54:12,  8.58s/it]
 70%|███████   | 26674/37963 [60:32:34<26:07:53,  8.33s/it]
 70%|███████   | 26675/37963 [60:32:42<25:30:54,  8.14s/it]
 70%|███████   | 26676/37963 [60:32:50<25:01:02,  7.98s/it]
 70%|███████   | 26677/37963 [60:32:58<24:56:17,  7.95s/it]
 70%|███████   | 26678/37963 [60:33:08<26:54:08,  8.58s/it]
 70%|███████   | 26679/37963 [60:33:15<25:59:26,  8.29s/it]
 70%|███████   | 26680/37963 [60:33:23<25:36:31,  8.17s/it]
                                                           
{'loss': '0.1241', 'grad_norm': '3.562', 'learning_rate': '4.287e-06', 'epoch': '0.7028'}
+
 70%|███████   | 26680/37963 [60:33:23<25:36:31,  8.17s/it]
 70%|███████   | 26681/37963 [60:33:31<25:13:51,  8.05s/it]
 70%|███████   | 26682/37963 [60:33:39<24:46:07,  7.90s/it]
 70%|███████   | 26683/37963 [60:33:46<24:39:18,  7.87s/it]
 70%|███████   | 26684/37963 [60:33:54<24:19:52,  7.77s/it]
 70%|███████   | 26685/37963 [60:34:04<26:40:03,  8.51s/it]
 70%|███████   | 26686/37963 [60:34:15<28:51:11,  9.21s/it]
 70%|███████   | 26687/37963 [60:34:23<27:30:12,  8.78s/it]
 70%|███████   | 26688/37963 [60:34:30<26:27:09,  8.45s/it]
 70%|███████   | 26689/37963 [60:34:38<25:46:29,  8.23s/it]
 70%|███████   | 26690/37963 [60:34:48<27:39:00,  8.83s/it]
                                                           
{'loss': '0.1349', 'grad_norm': '3.033', 'learning_rate': '4.28e-06', 'epoch': '0.7031'}
+
 70%|███████   | 26690/37963 [60:34:48<27:39:00,  8.83s/it]
 70%|███████   | 26691/37963 [60:34:56<26:39:38,  8.51s/it]
 70%|███████   | 26692/37963 [60:35:04<25:53:14,  8.27s/it]
 70%|███████   | 26693/37963 [60:35:11<25:13:26,  8.06s/it]
 70%|███████   | 26694/37963 [60:35:19<24:57:11,  7.97s/it]
 70%|███████   | 26695/37963 [60:35:27<24:39:44,  7.88s/it]
 70%|███████   | 26696/37963 [60:35:34<24:09:23,  7.72s/it]
 70%|███████   | 26697/37963 [60:35:42<24:03:05,  7.69s/it]
 70%|███████   | 26698/37963 [60:35:49<24:02:00,  7.68s/it]
 70%|███████   | 26699/37963 [60:35:57<24:06:37,  7.71s/it]
 70%|███████   | 26700/37963 [60:36:05<23:59:38,  7.67s/it]
                                                           
{'loss': '0.1156', 'grad_norm': '1.511', 'learning_rate': '4.273e-06', 'epoch': '0.7033'}
+
 70%|███████   | 26700/37963 [60:36:05<23:59:38,  7.67s/it]
 70%|███████   | 26701/37963 [60:36:15<26:39:48,  8.52s/it]
 70%|███████   | 26702/37963 [60:36:23<26:07:36,  8.35s/it]
 70%|███████   | 26703/37963 [60:36:31<25:37:44,  8.19s/it]
 70%|███████   | 26704/37963 [60:36:39<25:09:13,  8.04s/it]
 70%|███████   | 26705/37963 [60:36:47<25:05:00,  8.02s/it]
 70%|███████   | 26706/37963 [60:36:54<24:20:09,  7.78s/it]
 70%|███████   | 26707/37963 [60:37:02<24:19:54,  7.78s/it]
 70%|███████   | 26708/37963 [60:37:12<26:42:33,  8.54s/it]
 70%|███████   | 26709/37963 [60:37:19<25:36:24,  8.19s/it]
 70%|███████   | 26710/37963 [60:37:27<25:17:30,  8.09s/it]
                                                           
{'loss': '0.1163', 'grad_norm': '1.724', 'learning_rate': '4.266e-06', 'epoch': '0.7036'}
+
 70%|███████   | 26710/37963 [60:37:27<25:17:30,  8.09s/it]
 70%|███████   | 26711/37963 [60:37:35<24:55:33,  7.97s/it]
 70%|███████   | 26712/37963 [60:37:43<24:51:21,  7.95s/it]
 70%|███████   | 26713/37963 [60:37:53<27:15:32,  8.72s/it]
 70%|███████   | 26714/37963 [60:38:01<26:23:47,  8.45s/it]
 70%|███████   | 26715/37963 [60:38:09<25:33:01,  8.18s/it]
 70%|███████   | 26716/37963 [60:38:17<25:09:16,  8.05s/it]
 70%|███████   | 26717/37963 [60:38:24<24:49:06,  7.94s/it]
 70%|███████   | 26718/37963 [60:38:32<24:40:13,  7.90s/it]
 70%|███████   | 26719/37963 [60:38:40<24:35:37,  7.87s/it]
 70%|███████   | 26720/37963 [60:38:47<24:18:32,  7.78s/it]
                                                           
{'loss': '0.1219', 'grad_norm': '1.738', 'learning_rate': '4.259e-06', 'epoch': '0.7038'}
+
 70%|███████   | 26720/37963 [60:38:47<24:18:32,  7.78s/it]
 70%|███████   | 26721/37963 [60:38:58<26:39:29,  8.54s/it]
 70%|███████   | 26722/37963 [60:39:08<28:21:40,  9.08s/it]
 70%|███████   | 26723/37963 [60:39:16<27:06:00,  8.68s/it]
 70%|███████   | 26724/37963 [60:39:24<26:15:22,  8.41s/it]
 70%|███████   | 26725/37963 [60:39:31<25:45:30,  8.25s/it]
 70%|███████   | 26726/37963 [60:39:39<25:15:47,  8.09s/it]
 70%|███████   | 26727/37963 [60:39:47<24:49:11,  7.95s/it]
 70%|███████   | 26728/37963 [60:39:54<24:17:31,  7.78s/it]
 70%|███████   | 26729/37963 [60:40:02<24:10:46,  7.75s/it]
 70%|███████   | 26730/37963 [60:40:10<24:08:17,  7.74s/it]
                                                           
{'loss': '0.1363', 'grad_norm': '3.252', 'learning_rate': '4.252e-06', 'epoch': '0.7041'}
+
 70%|███████   | 26730/37963 [60:40:10<24:08:17,  7.74s/it]
 70%|███████   | 26731/37963 [60:40:17<24:04:49,  7.72s/it]
 70%|███████   | 26732/37963 [60:40:25<23:55:48,  7.67s/it]
 70%|███████   | 26733/37963 [60:40:35<26:30:52,  8.50s/it]
 70%|███████   | 26734/37963 [60:40:46<28:10:13,  9.03s/it]
 70%|███████   | 26735/37963 [60:40:53<26:57:03,  8.64s/it]
 70%|███████   | 26736/37963 [60:41:01<26:11:47,  8.40s/it]
 70%|███████   | 26737/37963 [60:41:09<25:45:31,  8.26s/it]
 70%|███████   | 26738/37963 [60:41:17<25:18:20,  8.12s/it]
 70%|███████   | 26739/37963 [60:41:27<27:07:44,  8.70s/it]
 70%|███████   | 26740/37963 [60:41:35<26:34:24,  8.52s/it]
                                                           
{'loss': '0.1301', 'grad_norm': '2.462', 'learning_rate': '4.245e-06', 'epoch': '0.7044'}
+
 70%|███████   | 26740/37963 [60:41:35<26:34:24,  8.52s/it]
 70%|███████   | 26741/37963 [60:41:43<25:53:11,  8.30s/it]
 70%|███████   | 26742/37963 [60:41:51<25:21:06,  8.13s/it]
 70%|███████   | 26743/37963 [60:41:58<24:58:50,  8.02s/it]
 70%|███████   | 26744/37963 [60:42:09<27:16:12,  8.75s/it]
 70%|███████   | 26745/37963 [60:42:16<26:16:55,  8.43s/it]
 70%|███████   | 26746/37963 [60:42:24<25:35:43,  8.21s/it]
 70%|███████   | 26747/37963 [60:42:32<25:03:08,  8.04s/it]
 70%|███████   | 26748/37963 [60:42:40<24:50:24,  7.97s/it]
 70%|███████   | 26749/37963 [60:42:47<24:27:11,  7.85s/it]
 70%|███████   | 26750/37963 [60:42:55<24:33:24,  7.88s/it]
                                                           
{'loss': '0.1363', 'grad_norm': '2.603', 'learning_rate': '4.238e-06', 'epoch': '0.7046'}
+
 70%|███████   | 26750/37963 [60:42:55<24:33:24,  7.88s/it]
 70%|███████   | 26751/37963 [60:43:06<27:07:15,  8.71s/it]
 70%|███████   | 26752/37963 [60:43:14<26:21:05,  8.46s/it]
 70%|███████   | 26753/37963 [60:43:21<25:37:32,  8.23s/it]
 70%|███████   | 26754/37963 [60:43:29<25:13:07,  8.10s/it]
 70%|███████   | 26755/37963 [60:43:37<24:40:29,  7.93s/it]
 70%|███████   | 26756/37963 [60:43:44<24:24:55,  7.84s/it]
 70%|███████   | 26757/37963 [60:43:55<27:00:09,  8.67s/it]
 70%|███████   | 26758/37963 [60:44:03<26:14:11,  8.43s/it]
 70%|███████   | 26759/37963 [60:44:10<25:19:23,  8.14s/it]
 70%|███████   | 26760/37963 [60:44:17<24:32:35,  7.89s/it]
                                                           
{'loss': '0.1349', 'grad_norm': '2.114', 'learning_rate': '4.231e-06', 'epoch': '0.7049'}
+
 70%|███████   | 26760/37963 [60:44:17<24:32:35,  7.89s/it]
 70%|███████   | 26761/37963 [60:44:25<24:29:26,  7.87s/it]
 70%|███████   | 26762/37963 [60:44:33<24:20:48,  7.83s/it]
 70%|███████   | 26763/37963 [60:44:41<24:12:11,  7.78s/it]
 71%|███████   | 26764/37963 [60:44:48<24:00:20,  7.72s/it]
 71%|███████   | 26765/37963 [60:44:58<26:07:28,  8.40s/it]
 71%|███████   | 26766/37963 [60:45:06<25:26:41,  8.18s/it]
 71%|███████   | 26767/37963 [60:45:14<25:12:28,  8.11s/it]
 71%|███████   | 26768/37963 [60:45:22<25:02:00,  8.05s/it]
 71%|███████   | 26769/37963 [60:45:32<27:07:18,  8.72s/it]
 71%|███████   | 26770/37963 [60:45:40<26:19:07,  8.46s/it]
                                                           
{'loss': '0.1205', 'grad_norm': '2.365', 'learning_rate': '4.224e-06', 'epoch': '0.7052'}
+
 71%|███████   | 26770/37963 [60:45:40<26:19:07,  8.46s/it]
 71%|███████   | 26771/37963 [60:45:48<25:47:58,  8.30s/it]
 71%|███████   | 26772/37963 [60:45:56<25:29:10,  8.20s/it]
 71%|███████   | 26773/37963 [60:46:03<24:49:03,  7.98s/it]
 71%|███████   | 26774/37963 [60:46:11<24:23:12,  7.85s/it]
 71%|███████   | 26775/37963 [60:46:19<24:13:15,  7.79s/it]
 71%|███████   | 26776/37963 [60:46:26<24:20:22,  7.83s/it]
 71%|███████   | 26777/37963 [60:46:37<26:30:06,  8.53s/it]
 71%|███████   | 26778/37963 [60:46:44<25:44:25,  8.28s/it]
 71%|███████   | 26779/37963 [60:46:52<25:12:38,  8.12s/it]
 71%|███████   | 26780/37963 [60:47:00<24:46:32,  7.98s/it]
                                                           
{'loss': '0.1373', 'grad_norm': '2.081', 'learning_rate': '4.217e-06', 'epoch': '0.7054'}
+
 71%|███████   | 26780/37963 [60:47:00<24:46:32,  7.98s/it]
 71%|███████   | 26781/37963 [60:47:07<24:24:52,  7.86s/it]
 71%|███████   | 26782/37963 [60:47:15<24:06:07,  7.76s/it]
 71%|███████   | 26783/37963 [60:47:22<23:59:52,  7.73s/it]
 71%|███████   | 26784/37963 [60:47:30<23:52:47,  7.69s/it]
 71%|███████   | 26785/37963 [60:47:38<23:50:48,  7.68s/it]
 71%|███████   | 26786/37963 [60:47:48<26:10:24,  8.43s/it]
 71%|███████   | 26787/37963 [60:47:56<25:27:06,  8.20s/it]
 71%|███████   | 26788/37963 [60:48:03<25:04:56,  8.08s/it]
 71%|███████   | 26789/37963 [60:48:11<24:51:04,  8.01s/it]
 71%|███████   | 26790/37963 [60:48:19<24:25:17,  7.87s/it]
                                                           
{'loss': '0.1274', 'grad_norm': '2.051', 'learning_rate': '4.21e-06', 'epoch': '0.7057'}
+
 71%|███████   | 26790/37963 [60:48:19<24:25:17,  7.87s/it]
 71%|███████   | 26791/37963 [60:48:27<24:38:22,  7.94s/it]
 71%|███████   | 26792/37963 [60:48:38<27:26:51,  8.85s/it]
 71%|███████   | 26793/37963 [60:48:46<26:29:20,  8.54s/it]
 71%|███████   | 26794/37963 [60:48:53<25:46:58,  8.31s/it]
 71%|███████   | 26795/37963 [60:49:01<25:21:11,  8.17s/it]
 71%|███████   | 26796/37963 [60:49:09<24:56:04,  8.04s/it]
 71%|███████   | 26797/37963 [60:49:17<24:43:22,  7.97s/it]
 71%|███████   | 26798/37963 [60:49:27<27:01:51,  8.72s/it]
 71%|███████   | 26799/37963 [60:49:35<25:58:48,  8.38s/it]
 71%|███████   | 26800/37963 [60:49:42<25:14:25,  8.14s/it]
                                                           
{'loss': '0.1276', 'grad_norm': '2.488', 'learning_rate': '4.203e-06', 'epoch': '0.706'}
+
 71%|███████   | 26800/37963 [60:49:42<25:14:25,  8.14s/it]
 71%|███████   | 26801/37963 [60:49:50<25:10:36,  8.12s/it]
 71%|███████   | 26802/37963 [60:49:58<24:55:58,  8.04s/it]
 71%|███████   | 26803/37963 [60:50:06<24:55:41,  8.04s/it]
 71%|███████   | 26804/37963 [60:50:14<24:53:50,  8.03s/it]
 71%|███████   | 26805/37963 [60:50:28<29:47:00,  9.61s/it]
 71%|███████   | 26806/37963 [60:50:35<27:59:41,  9.03s/it]
 71%|███████   | 26807/37963 [60:50:43<26:52:59,  8.68s/it]
 71%|███████   | 26808/37963 [60:50:51<26:01:18,  8.40s/it]
 71%|███████   | 26809/37963 [60:51:01<27:42:15,  8.94s/it]
 71%|███████   | 26810/37963 [60:51:09<26:46:17,  8.64s/it]
                                                           
{'loss': '0.1409', 'grad_norm': '1.928', 'learning_rate': '4.196e-06', 'epoch': '0.7062'}
+
 71%|███████   | 26810/37963 [60:51:09<26:46:17,  8.64s/it]
 71%|███████   | 26811/37963 [60:51:17<26:08:12,  8.44s/it]
 71%|███████   | 26812/37963 [60:51:25<25:30:46,  8.24s/it]
 71%|███████   | 26813/37963 [60:51:32<24:55:09,  8.05s/it]
 71%|███████   | 26814/37963 [60:51:40<24:32:51,  7.93s/it]
 71%|███████   | 26815/37963 [60:51:48<24:27:34,  7.90s/it]
 71%|███████   | 26816/37963 [60:51:55<24:04:23,  7.77s/it]
 71%|███████   | 26817/37963 [60:52:06<26:26:46,  8.54s/it]
 71%|███████   | 26818/37963 [60:52:13<25:36:41,  8.27s/it]
 71%|███████   | 26819/37963 [60:52:21<24:57:18,  8.06s/it]
 71%|███████   | 26820/37963 [60:52:29<24:33:58,  7.94s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '1.59', 'learning_rate': '4.189e-06', 'epoch': '0.7065'}
+
 71%|███████   | 26820/37963 [60:52:29<24:33:58,  7.94s/it]
 71%|███████   | 26821/37963 [60:52:39<27:08:26,  8.77s/it]
 71%|███████   | 26822/37963 [60:52:47<26:06:51,  8.44s/it]
 71%|███████   | 26823/37963 [60:52:55<25:31:15,  8.25s/it]
 71%|███████   | 26824/37963 [60:53:03<25:11:08,  8.14s/it]
 71%|███████   | 26825/37963 [60:53:10<24:39:58,  7.97s/it]
 71%|███████   | 26826/37963 [60:53:18<24:33:13,  7.94s/it]
 71%|███████   | 26827/37963 [60:53:26<24:11:28,  7.82s/it]
 71%|███████   | 26828/37963 [60:53:34<24:17:21,  7.85s/it]
 71%|███████   | 26829/37963 [60:53:41<24:10:30,  7.82s/it]
 71%|███████   | 26830/37963 [60:53:49<23:59:07,  7.76s/it]
                                                           
{'loss': '0.1262', 'grad_norm': '1.997', 'learning_rate': '4.182e-06', 'epoch': '0.7067'}
+
 71%|███████   | 26830/37963 [60:53:49<23:59:07,  7.76s/it]
 71%|███████   | 26831/37963 [60:53:57<23:53:42,  7.73s/it]
 71%|███████   | 26832/37963 [60:54:05<24:17:29,  7.86s/it]
 71%|███████   | 26833/37963 [60:54:12<24:11:20,  7.82s/it]
 71%|███████   | 26834/37963 [60:54:20<24:07:10,  7.80s/it]
 71%|███████   | 26835/37963 [60:54:28<23:50:36,  7.71s/it]
 71%|███████   | 26836/37963 [60:54:35<23:50:05,  7.71s/it]
 71%|███████   | 26837/37963 [60:54:43<23:57:01,  7.75s/it]
 71%|███████   | 26838/37963 [60:54:51<23:47:31,  7.70s/it]
 71%|███████   | 26839/37963 [60:55:01<26:06:12,  8.45s/it]
 71%|███████   | 26840/37963 [60:55:11<27:54:59,  9.04s/it]
                                                           
{'loss': '0.1224', 'grad_norm': '1.748', 'learning_rate': '4.175e-06', 'epoch': '0.707'}
+
 71%|███████   | 26840/37963 [60:55:11<27:54:59,  9.04s/it]
 71%|███████   | 26841/37963 [60:55:19<26:53:35,  8.70s/it]
 71%|███��███   | 26842/37963 [60:55:27<26:04:34,  8.44s/it]
 71%|███████   | 26843/37963 [60:55:35<25:23:38,  8.22s/it]
 71%|███████   | 26844/37963 [60:55:43<24:56:37,  8.08s/it]
 71%|███████   | 26845/37963 [60:55:50<24:32:31,  7.95s/it]
 71%|███████   | 26846/37963 [60:55:58<24:34:54,  7.96s/it]
 71%|███████   | 26847/37963 [60:56:06<24:21:28,  7.89s/it]
 71%|███████   | 26848/37963 [60:56:14<23:59:29,  7.77s/it]
 71%|███████   | 26849/37963 [60:56:24<26:29:58,  8.58s/it]
 71%|███████   | 26850/37963 [60:56:32<25:50:38,  8.37s/it]
                                                           
{'loss': '0.1153', 'grad_norm': '1.9', 'learning_rate': '4.168e-06', 'epoch': '0.7073'}
+
 71%|███████   | 26850/37963 [60:56:32<25:50:38,  8.37s/it]
 71%|███████   | 26851/37963 [60:56:40<25:09:34,  8.15s/it]
 71%|███████   | 26852/37963 [60:56:50<27:27:42,  8.90s/it]
 71%|███████   | 26853/37963 [60:57:00<28:43:11,  9.31s/it]
 71%|███████   | 26854/37963 [60:57:08<27:24:51,  8.88s/it]
 71%|███████   | 26855/37963 [60:57:16<26:15:21,  8.51s/it]
 71%|███████   | 26856/37963 [60:57:24<25:23:13,  8.23s/it]
 71%|███████   | 26857/37963 [60:57:31<24:37:28,  7.98s/it]
 71%|███████   | 26858/37963 [60:57:39<24:29:35,  7.94s/it]
 71%|███████   | 26859/37963 [60:57:50<27:07:01,  8.79s/it]
 71%|███████   | 26860/37963 [60:57:57<26:10:50,  8.49s/it]
                                                           
{'loss': '0.1242', 'grad_norm': '2.61', 'learning_rate': '4.161e-06', 'epoch': '0.7075'}
+
 71%|███████   | 26860/37963 [60:57:57<26:10:50,  8.49s/it]
 71%|███████   | 26861/37963 [60:58:05<25:24:05,  8.24s/it]
 71%|███████   | 26862/37963 [60:58:15<27:13:22,  8.83s/it]
 71%|███████   | 26863/37963 [60:58:23<26:16:29,  8.52s/it]
 71%|███████   | 26864/37963 [60:58:31<25:35:01,  8.30s/it]
 71%|███████   | 26865/37963 [60:58:41<27:25:48,  8.90s/it]
 71%|███████   | 26866/37963 [60:58:49<26:26:38,  8.58s/it]
 71%|███████   | 26867/37963 [60:58:56<25:21:52,  8.23s/it]
 71%|███████   | 26868/37963 [60:59:04<24:59:11,  8.11s/it]
 71%|███████   | 26869/37963 [60:59:12<24:49:26,  8.06s/it]
 71%|███████   | 26870/37963 [60:59:20<24:27:52,  7.94s/it]
                                                           
{'loss': '0.1347', 'grad_norm': '3.961', 'learning_rate': '4.154e-06', 'epoch': '0.7078'}
+
 71%|███████   | 26870/37963 [60:59:20<24:27:52,  7.94s/it]
 71%|███████   | 26871/37963 [60:59:28<24:25:20,  7.93s/it]
 71%|███████   | 26872/37963 [60:59:35<24:19:59,  7.90s/it]
 71%|███████   | 26873/37963 [60:59:43<23:52:28,  7.75s/it]
 71%|███████   | 26874/37963 [60:59:51<23:50:55,  7.74s/it]
 71%|███████   | 26875/37963 [60:59:58<23:43:25,  7.70s/it]
 71%|███████   | 26876/37963 [61:00:06<23:38:40,  7.68s/it]
 71%|███████   | 26877/37963 [61:00:14<23:43:34,  7.70s/it]
 71%|███████   | 26878/37963 [61:00:21<23:48:56,  7.73s/it]
 71%|███████   | 26879/37963 [61:00:29<23:48:31,  7.73s/it]
 71%|███████   | 26880/37963 [61:00:36<23:24:24,  7.60s/it]
                                                           
{'loss': '0.1286', 'grad_norm': '2.754', 'learning_rate': '4.148e-06', 'epoch': '0.7081'}
+
 71%|███████   | 26880/37963 [61:00:36<23:24:24,  7.60s/it]
 71%|███████   | 26881/37963 [61:00:44<23:43:28,  7.71s/it]
 71%|███████   | 26882/37963 [61:00:52<23:44:06,  7.71s/it]
 71%|███████   | 26883/37963 [61:01:00<23:46:03,  7.72s/it]
 71%|███████   | 26884/37963 [61:01:08<23:43:33,  7.71s/it]
 71%|███████   | 26885/37963 [61:01:15<23:43:05,  7.71s/it]
 71%|███████   | 26886/37963 [61:01:23<23:55:41,  7.78s/it]
 71%|███████   | 26887/37963 [61:01:31<23:52:10,  7.76s/it]
 71%|███████   | 26888/37963 [61:01:39<23:46:34,  7.73s/it]
 71%|███████   | 26889/37963 [61:01:49<26:21:04,  8.57s/it]
 71%|███████   | 26890/37963 [61:01:56<25:13:17,  8.20s/it]
                                                           
{'loss': '0.1155', 'grad_norm': '1.481', 'learning_rate': '4.141e-06', 'epoch': '0.7083'}
+
 71%|███████   | 26890/37963 [61:01:56<25:13:17,  8.20s/it]
 71%|███████   | 26891/37963 [61:02:04<24:45:33,  8.05s/it]
 71%|███████   | 26892/37963 [61:02:15<27:15:21,  8.86s/it]
 71%|███████   | 26893/37963 [61:02:25<28:43:10,  9.34s/it]
 71%|███████   | 26894/37963 [61:02:33<27:09:54,  8.84s/it]
 71%|███████   | 26895/37963 [61:02:41<26:11:03,  8.52s/it]
 71%|██��████   | 26896/37963 [61:02:48<25:08:04,  8.18s/it]
 71%|███████   | 26897/37963 [61:02:56<24:47:01,  8.06s/it]
 71%|███████   | 26898/37963 [61:03:04<24:20:45,  7.92s/it]
 71%|███████   | 26899/37963 [61:03:11<24:13:48,  7.88s/it]
 71%|███████   | 26900/37963 [61:03:19<24:14:02,  7.89s/it]
                                                           
{'loss': '0.1231', 'grad_norm': '2.618', 'learning_rate': '4.134e-06', 'epoch': '0.7086'}
+
 71%|███████   | 26900/37963 [61:03:19<24:14:02,  7.89s/it]
 71%|███████   | 26901/37963 [61:03:32<29:07:24,  9.48s/it]
 71%|███████   | 26902/37963 [61:03:40<27:44:41,  9.03s/it]
 71%|███████   | 26903/37963 [61:03:48<26:38:10,  8.67s/it]
 71%|███████   | 26904/37963 [61:03:59<28:18:45,  9.22s/it]
 71%|███████   | 26905/37963 [61:04:09<29:14:31,  9.52s/it]
 71%|███████   | 26906/37963 [61:04:17<27:35:27,  8.98s/it]
 71%|███████   | 26907/37963 [61:04:25<26:31:14,  8.64s/it]
 71%|███████   | 26908/37963 [61:04:32<25:30:02,  8.30s/it]
 71%|███████   | 26909/37963 [61:04:40<24:52:20,  8.10s/it]
 71%|███████   | 26910/37963 [61:04:48<24:52:06,  8.10s/it]
                                                           
{'loss': '0.1229', 'grad_norm': '1.828', 'learning_rate': '4.127e-06', 'epoch': '0.7089'}
+
 71%|███████   | 26910/37963 [61:04:48<24:52:06,  8.10s/it]
 71%|███████   | 26911/37963 [61:04:55<24:30:15,  7.98s/it]
 71%|███████   | 26912/37963 [61:05:03<24:19:58,  7.93s/it]
 71%|███████   | 26913/37963 [61:05:13<26:17:51,  8.57s/it]
 71%|███████   | 26914/37963 [61:05:21<25:43:03,  8.38s/it]
 71%|███████   | 26915/37963 [61:05:29<25:03:18,  8.16s/it]
 71%|███████   | 26916/37963 [61:05:37<24:32:57,  8.00s/it]
 71%|███████   | 26917/37963 [61:05:44<24:21:04,  7.94s/it]
 71%|███████   | 26918/37963 [61:05:52<24:03:10,  7.84s/it]
 71%|███████   | 26919/37963 [61:05:59<23:38:29,  7.71s/it]
 71%|███████   | 26920/37963 [61:06:07<23:34:05,  7.68s/it]
                                                           
{'loss': '0.1235', 'grad_norm': '2.345', 'learning_rate': '4.12e-06', 'epoch': '0.7091'}
+
 71%|███████   | 26920/37963 [61:06:07<23:34:05,  7.68s/it]
 71%|███████   | 26921/37963 [61:06:15<23:33:36,  7.68s/it]
 71%|███████   | 26922/37963 [61:06:22<23:20:18,  7.61s/it]
 71%|███████   | 26923/37963 [61:06:29<23:02:19,  7.51s/it]
 71%|███████   | 26924/37963 [61:06:37<23:22:20,  7.62s/it]
 71%|███████   | 26925/37963 [61:06:45<23:25:32,  7.64s/it]
 71%|███████   | 26926/37963 [61:06:52<23:15:18,  7.59s/it]
 71%|███████   | 26927/37963 [61:07:00<23:26:38,  7.65s/it]
 71%|███████   | 26928/37963 [61:07:08<23:33:31,  7.69s/it]
 71%|███████   | 26929/37963 [61:07:16<23:42:01,  7.73s/it]
 71%|███████   | 26930/37963 [61:07:23<23:38:08,  7.71s/it]
                                                           
{'loss': '0.1246', 'grad_norm': '1.769', 'learning_rate': '4.113e-06', 'epoch': '0.7094'}
+
 71%|███████   | 26930/37963 [61:07:23<23:38:08,  7.71s/it]
 71%|███████   | 26931/37963 [61:07:31<23:37:11,  7.71s/it]
 71%|███████   | 26932/37963 [61:07:39<23:28:41,  7.66s/it]
 71%|███████   | 26933/37963 [61:07:46<23:34:19,  7.69s/it]
 71%|███████   | 26934/37963 [61:07:54<23:35:01,  7.70s/it]
 71%|███████   | 26935/37963 [61:08:02<23:38:48,  7.72s/it]
 71%|███████   | 26936/37963 [61:08:10<23:33:55,  7.69s/it]
 71%|███████   | 26937/37963 [61:08:18<23:45:33,  7.76s/it]
 71%|███████   | 26938/37963 [61:08:25<23:27:32,  7.66s/it]
 71%|███████   | 26939/37963 [61:08:33<23:32:38,  7.69s/it]
 71%|███████   | 26940/37963 [61:08:40<23:35:25,  7.70s/it]
                                                           
{'loss': '0.1322', 'grad_norm': '2.665', 'learning_rate': '4.106e-06', 'epoch': '0.7096'}
+
 71%|███████   | 26940/37963 [61:08:40<23:35:25,  7.70s/it]
 71%|███████   | 26941/37963 [61:08:48<23:38:34,  7.72s/it]
 71%|███████   | 26942/37963 [61:08:58<25:56:01,  8.47s/it]
 71%|███████   | 26943/37963 [61:09:06<25:26:02,  8.31s/it]
 71%|███████   | 26944/37963 [61:09:14<25:05:38,  8.20s/it]
 71%|███████   | 26945/37963 [61:09:22<25:01:43,  8.18s/it]
 71%|███████   | 26946/37963 [61:09:36<29:35:21,  9.67s/it]
 71%|███████   | 26947/37963 [61:09:43<27:41:45,  9.05s/it]
 71%|███████   | 26948/37963 [61:09:51<26:20:53,  8.61s/it]
 71%|███████   | 26949/37963 [61:10:01<28:06:29,  9.19s/it]
 71%|███████   | 26950/37963 [61:10:09<26:45:38,  8.75s/it]
                                                           
{'loss': '0.1171', 'grad_norm': '1.845', 'learning_rate': '4.099e-06', 'epoch': '0.7099'}
+
 71%|███████   | 26950/37963 [61:10:09<26:45:38,  8.75s/it]
 71%|███████   | 26951/37963 [61:10:17<25:47:06,  8.43s/it]
 71%|███████   | 26952/37963 [61:10:27<27:29:00,  8.99s/it]
 71%|███████   | 26953/37963 [61:10:35<26:26:46,  8.65s/it]
 71%|███████   | 26954/37963 [61:10:45<27:46:37,  9.08s/it]
 71%|███████   | 26955/37963 [61:10:55<28:31:09,  9.33s/it]
 71%|███████   | 26956/37963 [61:11:03<27:10:55,  8.89s/it]
 71%|███████   | 26957/37963 [61:11:10<26:04:31,  8.53s/it]
 71%|███████   | 26958/37963 [61:11:18<25:12:38,  8.25s/it]
 71%|███████   | 26959/37963 [61:11:26<24:34:49,  8.04s/it]
 71%|███████   | 26960/37963 [61:11:33<24:17:32,  7.95s/it]
                                                           
{'loss': '0.1204', 'grad_norm': '1.908', 'learning_rate': '4.092e-06', 'epoch': '0.7102'}
+
 71%|███████   | 26960/37963 [61:11:33<24:17:32,  7.95s/it]
 71%|███████   | 26961/37963 [61:11:44<26:44:31,  8.75s/it]
 71%|███████   | 26962/37963 [61:11:52<25:56:51,  8.49s/it]
 71%|███████   | 26963/37963 [61:11:59<25:09:04,  8.23s/it]
 71%|███████   | 26964/37963 [61:12:08<25:01:14,  8.19s/it]
 71%|███████   | 26965/37963 [61:12:15<24:36:13,  8.05s/it]
 71%|███████   | 26966/37963 [61:12:23<24:29:45,  8.02s/it]
 71%|███████   | 26967/37963 [61:12:31<24:29:58,  8.02s/it]
 71%|███████   | 26968/37963 [61:12:39<24:18:17,  7.96s/it]
 71%|███████   | 26969/37963 [61:12:47<24:03:50,  7.88s/it]
 71%|███████   | 26970/37963 [61:12:55<24:17:12,  7.95s/it]
                                                           
{'loss': '0.1298', 'grad_norm': '1.988', 'learning_rate': '4.085e-06', 'epoch': '0.7104'}
+
 71%|███████   | 26970/37963 [61:12:55<24:17:12,  7.95s/it]
 71%|███████   | 26971/37963 [61:13:03<24:11:01,  7.92s/it]
 71%|███████   | 26972/37963 [61:13:10<23:39:05,  7.75s/it]
 71%|███████   | 26973/37963 [61:13:18<23:34:02,  7.72s/it]
 71%|███████   | 26974/37963 [61:13:25<23:38:46,  7.75s/it]
 71%|███████   | 26975/37963 [61:13:33<23:36:33,  7.74s/it]
 71%|███████   | 26976/37963 [61:13:41<23:49:36,  7.81s/it]
 71%|███████   | 26977/37963 [61:13:48<23:21:47,  7.66s/it]
 71%|███████   | 26978/37963 [61:13:56<23:30:24,  7.70s/it]
 71%|███████   | 26979/37963 [61:14:04<23:35:22,  7.73s/it]
 71%|███████   | 26980/37963 [61:14:12<23:34:07,  7.73s/it]
                                                           
{'loss': '0.1308', 'grad_norm': '2.142', 'learning_rate': '4.079e-06', 'epoch': '0.7107'}
+
 71%|███████   | 26980/37963 [61:14:12<23:34:07,  7.73s/it]
 71%|███████   | 26981/37963 [61:14:20<23:48:19,  7.80s/it]
 71%|███████   | 26982/37963 [61:14:27<23:39:45,  7.76s/it]
 71%|███████   | 26983/37963 [61:14:35<23:34:41,  7.73s/it]
 71%|███████   | 26984/37963 [61:14:43<23:37:41,  7.75s/it]
 71%|███████   | 26985/37963 [61:14:51<23:35:55,  7.74s/it]
 71%|███████   | 26986/37963 [61:14:58<23:22:40,  7.67s/it]
 71%|███████   | 26987/37963 [61:15:06<23:35:19,  7.74s/it]
 71%|███████   | 26988/37963 [61:15:14<23:26:53,  7.69s/it]
 71%|███████   | 26989/37963 [61:15:21<23:30:49,  7.71s/it]
 71%|███████   | 26990/37963 [61:15:32<26:06:21,  8.56s/it]
                                                           
{'loss': '0.1262', 'grad_norm': '3.362', 'learning_rate': '4.072e-06', 'epoch': '0.711'}
+
 71%|███████   | 26990/37963 [61:15:32<26:06:21,  8.56s/it]
 71%|███████   | 26991/37963 [61:15:40<25:22:57,  8.33s/it]
 71%|███████   | 26992/37963 [61:15:47<24:53:44,  8.17s/it]
 71%|███████   | 26993/37963 [61:15:55<24:24:59,  8.01s/it]
 71%|███████   | 26994/37963 [61:16:03<24:08:16,  7.92s/it]
 71%|███████   | 26995/37963 [61:16:11<23:55:28,  7.85s/it]
 71%|███████   | 26996/37963 [61:16:21<26:31:53,  8.71s/it]
 71%|███████   | 26997/37963 [61:16:31<27:50:54,  9.14s/it]
 71%|███████   | 26998/37963 [61:16:39<26:22:43,  8.66s/it]
 71%|███████   | 26999/37963 [61:16:49<28:01:53,  9.20s/it]
 71%|███████   | 27000/37963 [61:17:02<31:32:41, 10.36s/it]
                                                           
{'loss': '0.1299', 'grad_norm': '4.052', 'learning_rate': '4.065e-06', 'epoch': '0.7112'}
+
 71%|███████   | 27000/37963 [61:17:02<31:32:41, 10.36s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.62s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.62s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 71%|███████   | 27001/37963 [61:18:00<74:19:46, 24.41s/it]
 71%|███████   | 27002/37963 [61:18:08<59:11:51, 19.44s/it]
 71%|███████   | 27003/37963 [61:18:18<50:49:35, 16.69s/it]
 71%|███████   | 27004/37963 [61:18:26<42:45:22, 14.05s/it]
 71%|███████   | 27005/37963 [61:18:33<36:56:26, 12.14s/it]
 71%|███████   | 27006/37963 [61:18:41<32:36:06, 10.71s/it]
 71%|███████   | 27007/37963 [61:18:48<29:52:29,  9.82s/it]
 71%|███████   | 27008/37963 [61:18:59<30:18:01,  9.96s/it]
 71%|███████   | 27009/37963 [61:19:07<28:40:05,  9.42s/it]
 71%|███████   | 27010/37963 [61:19:15<27:00:40,  8.88s/it]
                                                           
{'loss': '0.1224', 'grad_norm': '2.354', 'learning_rate': '4.058e-06', 'epoch': '0.7115'}
+
 71%|███████   | 27010/37963 [61:19:15<27:00:40,  8.88s/it]
 71%|███████   | 27011/37963 [61:19:22<26:00:18,  8.55s/it]
 71%|███████   | 27012/37963 [61:19:30<25:10:16,  8.27s/it]
 71%|███████   | 27013/37963 [61:19:38<24:57:15,  8.20s/it]
 71%|███████   | 27014/37963 [61:19:46<24:37:19,  8.10s/it]
 71%|███████   | 27015/37963 [61:19:54<24:22:23,  8.01s/it]
 71%|███████   | 27016/37963 [61:20:02<24:19:56,  8.00s/it]
 71%|███████   | 27017/37963 [61:20:09<24:04:08,  7.92s/it]
 71%|███████   | 27018/37963 [61:20:17<23:47:26,  7.83s/it]
 71%|███████   | 27019/37963 [61:20:25<23:39:52,  7.78s/it]
 71%|███████   | 27020/37963 [61:20:32<23:31:11,  7.74s/it]
                                                           
{'loss': '0.126', 'grad_norm': '1.557', 'learning_rate': '4.051e-06', 'epoch': '0.7117'}
+
 71%|███████   | 27020/37963 [61:20:32<23:31:11,  7.74s/it]
 71%|███████   | 27021/37963 [61:20:40<23:43:00,  7.80s/it]
 71%|███████   | 27022/37963 [61:20:48<23:43:53,  7.81s/it]
 71%|███████   | 27023/37963 [61:20:56<23:47:57,  7.83s/it]
 71%|███████   | 27024/37963 [61:21:04<23:42:26,  7.80s/it]
 71%|███████   | 27025/37963 [61:21:11<23:25:29,  7.71s/it]
 71%|███████   | 27026/37963 [61:21:19<23:20:28,  7.68s/it]
 71%|███████   | 27027/37963 [61:21:27<23:28:33,  7.73s/it]
 71%|███████   | 27028/37963 [61:21:34<23:07:35,  7.61s/it]
 71%|███████   | 27029/37963 [61:21:42<23:07:44,  7.62s/it]
 71%|███████   | 27030/37963 [61:21:49<23:15:08,  7.66s/it]
                                                           
{'loss': '0.1208', 'grad_norm': '1.918', 'learning_rate': '4.044e-06', 'epoch': '0.712'}
+
 71%|███████   | 27030/37963 [61:21:49<23:15:08,  7.66s/it]
 71%|███████   | 27031/37963 [61:21:57<23:13:29,  7.65s/it]
 71%|███████   | 27032/37963 [61:22:04<22:54:56,  7.55s/it]
 71%|███████   | 27033/37963 [61:22:12<23:04:11,  7.60s/it]
 71%|███████   | 27034/37963 [61:22:23<25:51:05,  8.52s/it]
 71%|███████   | 27035/37963 [61:22:31<25:15:45,  8.32s/it]
 71%|███████   | 27036/37963 [61:22:38<24:47:47,  8.17s/it]
 71%|███████   | 27037/37963 [61:22:46<24:18:48,  8.01s/it]
 71%|███████   | 27038/37963 [61:22:57<26:42:53,  8.80s/it]
 71%|███████   | 27039/37963 [61:23:04<25:49:03,  8.51s/it]
 71%|███████   | 27040/37963 [61:23:12<25:04:52,  8.27s/it]
                                                           
{'loss': '0.1314', 'grad_norm': '2.666', 'learning_rate': '4.037e-06', 'epoch': '0.7123'}
+
 71%|███████   | 27040/37963 [61:23:12<25:04:52,  8.27s/it]
 71%|███████   | 27041/37963 [61:23:20<24:40:02,  8.13s/it]
 71%|███████   | 27042/37963 [61:23:30<26:29:23,  8.73s/it]
 71%|███████   | 27043/37963 [61:23:38<25:46:33,  8.50s/it]
 71%|███████   | 27044/37963 [61:23:46<24:59:22,  8.24s/it]
 71%|███████   | 27045/37963 [61:23:56<26:47:30,  8.83s/it]
 71%|███████   | 27046/37963 [61:24:04<25:59:06,  8.57s/it]
 71%|███████   | 27047/37963 [61:24:14<27:47:26,  9.17s/it]
 71%|███████   | 27048/37963 [61:24:25<28:52:53,  9.53s/it]
 71%|███████▏  | 27049/37963 [61:24:33<27:18:28,  9.01s/it]
 71%|███████▏  | 27050/37963 [61:24:40<25:40:08,  8.47s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '3.113', 'learning_rate': '4.031e-06', 'epoch': '0.7125'}
+
 71%|███████▏  | 27050/37963 [61:24:40<25:40:08,  8.47s/it]
 71%|███████▏  | 27051/37963 [61:24:47<24:59:08,  8.24s/it]
 71%|███████▏  | 27052/37963 [61:25:01<29:26:27,  9.71s/it]
 71%|███████▏  | 27053/37963 [61:25:08<27:44:23,  9.15s/it]
 71%|███████▏  | 27054/37963 [61:25:16<26:24:48,  8.72s/it]
 71%|███████▏  | 27055/37963 [61:25:24<25:27:43,  8.40s/it]
 71%|███████▏  | 27056/37963 [61:25:31<24:34:52,  8.11s/it]
 71%|███████▏  | 27057/37963 [61:25:39<24:14:57,  8.00s/it]
 71%|███████▏  | 27058/37963 [61:25:47<23:45:47,  7.84s/it]
 71%|███████▏  | 27059/37963 [61:25:54<23:33:40,  7.78s/it]
 71%|███████▏  | 27060/37963 [61:26:02<23:26:48,  7.74s/it]
                                                           
{'loss': '0.1235', 'grad_norm': '2.603', 'learning_rate': '4.024e-06', 'epoch': '0.7128'}
+
 71%|███████▏  | 27060/37963 [61:26:02<23:26:48,  7.74s/it]
 71%|███████▏  | 27061/37963 [61:26:10<23:31:36,  7.77s/it]
 71%|███████▏  | 27062/37963 [61:26:17<23:30:20,  7.76s/it]
 71%|███████▏  | 27063/37963 [61:26:25<23:32:42,  7.78s/it]
 71%|███████▏  | 27064/37963 [61:26:33<23:33:28,  7.78s/it]
 71%|███████▏  | 27065/37963 [61:26:41<23:25:31,  7.74s/it]
 71%|███████▏  | 27066/37963 [61:26:48<23:29:36,  7.76s/it]
 71%|███████▏  | 27067/37963 [61:26:56<23:39:40,  7.82s/it]
 71%|███████▏  | 27068/37963 [61:27:04<23:46:33,  7.86s/it]
 71%|███████▏  | 27069/37963 [61:27:12<23:33:50,  7.79s/it]
 71%|███████▏  | 27070/37963 [61:27:19<23:07:41,  7.64s/it]
                                                           
{'loss': '0.1075', 'grad_norm': '1.433', 'learning_rate': '4.017e-06', 'epoch': '0.7131'}
+
 71%|███████▏  | 27070/37963 [61:27:19<23:07:41,  7.64s/it]
 71%|███████▏  | 27071/37963 [61:27:27<22:51:56,  7.56s/it]
 71%|███████▏  | 27072/37963 [61:27:34<22:35:56,  7.47s/it]
 71%|███████▏  | 27073/37963 [61:27:41<22:20:59,  7.39s/it]
 71%|███████▏  | 27074/37963 [61:27:49<22:37:01,  7.48s/it]
 71%|███████▏  | 27075/37963 [61:27:57<22:52:22,  7.56s/it]
 71%|███████▏  | 27076/37963 [61:28:04<23:09:00,  7.66s/it]
 71%|███████▏  | 27077/37963 [61:28:12<23:10:20,  7.66s/it]
 71%|███████▏  | 27078/37963 [61:28:20<23:14:53,  7.69s/it]
 71%|███████▏  | 27079/37963 [61:28:28<23:23:06,  7.73s/it]
 71%|███████▏  | 27080/37963 [61:28:35<23:19:17,  7.71s/it]
                                                           
{'loss': '0.129', 'grad_norm': '2.397', 'learning_rate': '4.01e-06', 'epoch': '0.7133'}
+
 71%|███████▏  | 27080/37963 [61:28:35<23:19:17,  7.71s/it]
 71%|███████▏  | 27081/37963 [61:28:43<23:05:03,  7.64s/it]
 71%|███████▏  | 27082/37963 [61:28:56<28:08:58,  9.31s/it]
 71%|███████▏  | 27083/37963 [61:29:04<27:02:24,  8.95s/it]
 71%|███████▏  | 27084/37963 [61:29:12<25:59:43,  8.60s/it]
 71%|███████▏  | 27085/37963 [61:29:20<25:08:47,  8.32s/it]
 71%|███████▏  | 27086/37963 [61:29:27<24:07:20,  7.98s/it]
 71%|███████▏  | 27087/37963 [61:29:34<23:52:43,  7.90s/it]
 71%|███████▏  | 27088/37963 [61:29:45<26:29:49,  8.77s/it]
 71%|███████▏  | 27089/37963 [61:29:53<25:27:50,  8.43s/it]
 71%|███████▏  | 27090/37963 [61:30:00<24:36:20,  8.15s/it]
                                                           
{'loss': '0.1329', 'grad_norm': '1.722', 'learning_rate': '4.003e-06', 'epoch': '0.7136'}
+
 71%|███████▏  | 27090/37963 [61:30:00<24:36:20,  8.15s/it]
 71%|███████▏  | 27091/37963 [61:30:11<26:42:03,  8.84s/it]
 71%|███████▏  | 27092/37963 [61:30:19<25:43:47,  8.52s/it]
 71%|███████▏  | 27093/37963 [61:30:26<25:05:49,  8.31s/it]
 71%|███████▏  | 27094/37963 [61:30:37<27:08:35,  8.99s/it]
 71%|███████▏  | 27095/37963 [61:30:45<25:54:49,  8.58s/it]
 71%|███████▏  | 27096/37963 [61:30:52<25:01:38,  8.29s/it]
 71%|███████▏  | 27097/37963 [61:31:00<24:34:03,  8.14s/it]
 71%|███████▏  | 27098/37963 [61:31:11<26:40:38,  8.84s/it]
 71%|███████▏  | 27099/37963 [61:31:18<25:44:19,  8.53s/it]
 71%|███████▏  | 27100/37963 [61:31:29<27:13:19,  9.02s/it]
                                                           
{'loss': '0.1321', 'grad_norm': '2.898', 'learning_rate': '3.996e-06', 'epoch': '0.7139'}
+
 71%|███████▏  | 27100/37963 [61:31:29<27:13:19,  9.02s/it]
 71%|███████▏  | 27101/37963 [61:31:39<28:41:43,  9.51s/it]
 71%|███████▏  | 27102/37963 [61:31:47<26:58:20,  8.94s/it]
 71%|███████▏  | 27103/37963 [61:31:54<25:51:27,  8.57s/it]
 71%|███████▏  | 27104/37963 [61:32:03<25:21:26,  8.41s/it]
 71%|███████▏  | 27105/37963 [61:32:10<24:50:40,  8.24s/it]
 71%|███████▏  | 27106/37963 [61:32:18<24:20:43,  8.07s/it]
 71%|███████▏  | 27107/37963 [61:32:26<24:07:10,  8.00s/it]
 71%|███████▏  | 27108/37963 [61:32:34<24:01:58,  7.97s/it]
 71%|███████▏  | 27109/37963 [61:32:42<23:55:41,  7.94s/it]
 71%|███████▏  | 27110/37963 [61:32:49<23:42:02,  7.86s/it]
                                                           
{'loss': '0.1342', 'grad_norm': '2.532', 'learning_rate': '3.99e-06', 'epoch': '0.7141'}
+
 71%|███████▏  | 27110/37963 [61:32:49<23:42:02,  7.86s/it]
 71%|███████▏  | 27111/37963 [61:32:57<23:47:07,  7.89s/it]
 71%|███████▏  | 27112/37963 [61:33:05<23:36:42,  7.83s/it]
 71%|███████▏  | 27113/37963 [61:33:12<23:13:32,  7.71s/it]
 71%|███████▏  | 27114/37963 [61:33:20<23:05:46,  7.66s/it]
 71%|███████▏  | 27115/37963 [61:33:27<22:44:45,  7.55s/it]
 71%|███████▏  | 27116/37963 [61:33:35<22:43:11,  7.54s/it]
 71%|███████▏  | 27117/37963 [61:33:43<22:54:59,  7.61s/it]
 71%|███████▏  | 27118/37963 [61:33:50<22:52:01,  7.59s/it]
 71%|███████▏  | 27119/37963 [61:33:58<22:48:57,  7.57s/it]
 71%|███████▏  | 27120/37963 [61:34:05<22:57:13,  7.62s/it]
                                                           
{'loss': '0.1218', 'grad_norm': '1.611', 'learning_rate': '3.983e-06', 'epoch': '0.7144'}
+
 71%|███████▏  | 27120/37963 [61:34:05<22:57:13,  7.62s/it]
 71%|███████▏  | 27121/37963 [61:34:13<22:59:08,  7.63s/it]
 71%|███████▏  | 27122/37963 [61:34:21<23:22:26,  7.76s/it]
 71%|███████▏  | 27123/37963 [61:34:29<23:28:15,  7.79s/it]
 71%|███████▏  | 27124/37963 [61:34:36<23:13:45,  7.72s/it]
 71%|███████▏  | 27125/37963 [61:34:47<25:45:22,  8.56s/it]
 71%|███████▏  | 27126/37963 [61:34:55<25:04:28,  8.33s/it]
 71%|███████▏  | 27127/37963 [61:35:03<24:41:57,  8.21s/it]
 71%|███████▏  | 27128/37963 [61:35:10<24:11:22,  8.04s/it]
 71%|███████▏  | 27129/37963 [61:35:18<24:10:10,  8.03s/it]
 71%|███████▏  | 27130/37963 [61:35:26<23:51:18,  7.93s/it]
                                                           
{'loss': '0.1296', 'grad_norm': '1.62', 'learning_rate': '3.976e-06', 'epoch': '0.7146'}
+
 71%|███████▏  | 27130/37963 [61:35:26<23:51:18,  7.93s/it]
 71%|███████▏  | 27131/37963 [61:35:37<26:19:56,  8.75s/it]
 71%|███████▏  | 27132/37963 [61:35:45<25:28:56,  8.47s/it]
 71%|███████▏  | 27133/37963 [61:35:52<24:49:43,  8.25s/it]
 71%|███████▏  | 27134/37963 [61:36:03<26:43:41,  8.89s/it]
 71%|███████▏  | 27135/37963 [61:36:10<25:45:14,  8.56s/it]
 71%|███████▏  | 27136/37963 [61:36:21<27:11:14,  9.04s/it]
 71%|███████▏  | 27137/37963 [61:36:28<25:53:02,  8.61s/it]
 71%|███████▏  | 27138/37963 [61:36:39<27:26:15,  9.12s/it]
 71%|███████▏  | 27139/37963 [61:36:47<26:28:15,  8.80s/it]
 71%|███████▏  | 27140/37963 [61:36:54<25:30:12,  8.48s/it]
                                                           
{'loss': '0.1376', 'grad_norm': '1.735', 'learning_rate': '3.969e-06', 'epoch': '0.7149'}
+
 71%|███████▏  | 27140/37963 [61:36:54<25:30:12,  8.48s/it]
 71%|███████▏  | 27141/37963 [61:37:02<24:58:59,  8.31s/it]
 71%|███████▏  | 27142/37963 [61:37:10<24:28:57,  8.14s/it]
 71%|███████▏  | 27143/37963 [61:37:18<24:10:22,  8.04s/it]
 72%|███████▏  | 27144/37963 [61:37:28<26:07:56,  8.70s/it]
 72%|███████▏  | 27145/37963 [61:37:36<25:05:38,  8.35s/it]
 72%|███████▏  | 27146/37963 [61:37:43<24:33:19,  8.17s/it]
 72%|███████▏  | 27147/37963 [61:37:53<26:21:44,  8.77s/it]
 72%|███████▏  | 27148/37963 [61:38:01<25:32:33,  8.50s/it]
 72%|███████▏  | 27149/37963 [61:38:11<26:55:00,  8.96s/it]
 72%|███████▏  | 27150/37963 [61:38:19<25:47:34,  8.59s/it]
                                                           
{'loss': '0.1253', 'grad_norm': '1.859', 'learning_rate': '3.962e-06', 'epoch': '0.7152'}
+
 72%|███████▏  | 27150/37963 [61:38:19<25:47:34,  8.59s/it]
 72%|███████▏  | 27151/37963 [61:38:27<24:57:05,  8.31s/it]
 72%|███████▏  | 27152/37963 [61:38:34<24:06:41,  8.03s/it]
 72%|███████▏  | 27153/37963 [61:38:42<23:53:36,  7.96s/it]
 72%|███████▏  | 27154/37963 [61:38:50<23:40:59,  7.89s/it]
 72%|███████▏  | 27155/37963 [61:38:58<23:47:51,  7.93s/it]
 72%|███████▏  | 27156/37963 [61:39:05<23:35:30,  7.86s/it]
 72%|███████▏  | 27157/37963 [61:39:13<23:31:16,  7.84s/it]
 72%|███████▏  | 27158/37963 [61:39:21<23:28:59,  7.82s/it]
 72%|███████▏  | 27159/37963 [61:39:29<23:20:42,  7.78s/it]
 72%|███████▏  | 27160/37963 [61:39:36<23:21:42,  7.79s/it]
                                                           
{'loss': '0.1264', 'grad_norm': '2.084', 'learning_rate': '3.956e-06', 'epoch': '0.7154'}
+
 72%|███████▏  | 27160/37963 [61:39:36<23:21:42,  7.79s/it]
 72%|███████▏  | 27161/37963 [61:39:44<23:10:41,  7.72s/it]
 72%|███████▏  | 27162/37963 [61:39:52<23:11:01,  7.73s/it]
 72%|███████▏  | 27163/37963 [61:39:59<23:01:01,  7.67s/it]
 72%|███████▏  | 27164/37963 [61:40:07<22:57:14,  7.65s/it]
 72%|███████▏  | 27165/37963 [61:40:15<23:05:44,  7.70s/it]
 72%|███████▏  | 27166/37963 [61:40:22<22:41:38,  7.57s/it]
 72%|███████▏  | 27167/37963 [61:40:30<22:57:36,  7.66s/it]
 72%|███████▏  | 27168/37963 [61:40:38<23:02:11,  7.68s/it]
 72%|███████▏  | 27169/37963 [61:40:48<25:37:40,  8.55s/it]
 72%|███████▏  | 27170/37963 [61:40:56<25:18:23,  8.44s/it]
                                                           
{'loss': '0.1191', 'grad_norm': '2.018', 'learning_rate': '3.949e-06', 'epoch': '0.7157'}
+
 72%|███████▏  | 27170/37963 [61:40:56<25:18:23,  8.44s/it]
 72%|███████▏  | 27171/37963 [61:41:04<24:54:14,  8.31s/it]
 72%|███████▏  | 27172/37963 [61:41:12<24:37:21,  8.21s/it]
 72%|███████▏  | 27173/37963 [61:41:20<24:06:51,  8.05s/it]
 72%|███████▏  | 27174/37963 [61:41:28<23:55:59,  7.99s/it]
 72%|███████▏  | 27175/37963 [61:41:36<24:03:19,  8.03s/it]
 72%|███████▏  | 27176/37963 [61:41:47<26:38:17,  8.89s/it]
 72%|███████▏  | 27177/37963 [61:41:54<25:31:58,  8.52s/it]
 72%|███████▏  | 27178/37963 [61:42:02<25:02:48,  8.36s/it]
 72%|███████▏  | 27179/37963 [61:42:10<24:33:51,  8.20s/it]
 72%|███████▏  | 27180/37963 [61:42:18<23:55:29,  7.99s/it]
                                                           
{'loss': '0.13', 'grad_norm': '3.955', 'learning_rate': '3.942e-06', 'epoch': '0.716'}
+
 72%|███████▏  | 27180/37963 [61:42:18<23:55:29,  7.99s/it]
 72%|███████▏  | 27181/37963 [61:42:28<26:15:11,  8.77s/it]
 72%|███████▏  | 27182/37963 [61:42:39<27:36:12,  9.22s/it]
 72%|███████▏  | 27183/37963 [61:42:46<26:05:41,  8.71s/it]
 72%|███████▏  | 27184/37963 [61:42:57<27:35:35,  9.22s/it]
 72%|███████▏  | 27185/37963 [61:43:05<26:33:45,  8.87s/it]
 72%|███████▏  | 27186/37963 [61:43:12<25:25:01,  8.49s/it]
 72%|███████▏  | 27187/37963 [61:43:20<24:56:49,  8.33s/it]
 72%|███████▏  | 27188/37963 [61:43:28<24:27:16,  8.17s/it]
 72%|███████▏  | 27189/37963 [61:43:36<24:08:54,  8.07s/it]
 72%|███████▏  | 27190/37963 [61:43:44<23:51:56,  7.98s/it]
                                                           
{'loss': '0.1187', 'grad_norm': '2.482', 'learning_rate': '3.935e-06', 'epoch': '0.7162'}
+
 72%|███████▏  | 27190/37963 [61:43:44<23:51:56,  7.98s/it]
 72%|███████▏  | 27191/37963 [61:43:51<23:43:00,  7.93s/it]
 72%|███████▏  | 27192/37963 [61:43:59<23:33:14,  7.87s/it]
 72%|███████▏  | 27193/37963 [61:44:07<23:41:34,  7.92s/it]
 72%|███████▏  | 27194/37963 [61:44:17<25:47:10,  8.62s/it]
 72%|███████▏  | 27195/37963 [61:44:25<24:59:20,  8.35s/it]
 72%|███████▏  | 27196/37963 [61:44:33<24:29:31,  8.19s/it]
 72%|███████▏  | 27197/37963 [61:44:41<24:20:04,  8.14s/it]
 72%|███████▏  | 27198/37963 [61:44:51<26:10:14,  8.75s/it]
 72%|███████▏  | 27199/37963 [61:44:59<25:08:18,  8.41s/it]
 72%|███████▏  | 27200/37963 [61:45:06<24:18:40,  8.13s/it]
                                                           
{'loss': '0.1209', 'grad_norm': '1.56', 'learning_rate': '3.928e-06', 'epoch': '0.7165'}
+
 72%|███████▏  | 27200/37963 [61:45:06<24:18:40,  8.13s/it]
 72%|███████▏  | 27201/37963 [61:45:14<24:00:33,  8.03s/it]
 72%|███████▏  | 27202/37963 [61:45:22<23:48:32,  7.97s/it]
 72%|███████▏  | 27203/37963 [61:45:32<26:09:31,  8.75s/it]
 72%|███████▏  | 27204/37963 [61:45:40<25:23:38,  8.50s/it]
 72%|████��██▏  | 27205/37963 [61:45:48<25:03:03,  8.38s/it]
 72%|███████▏  | 27206/37963 [61:45:57<24:44:03,  8.28s/it]
 72%|███████▏  | 27207/37963 [61:46:04<24:23:47,  8.17s/it]
 72%|███████▏  | 27208/37963 [61:46:12<23:53:09,  8.00s/it]
 72%|███████▏  | 27209/37963 [61:46:20<23:34:12,  7.89s/it]
 72%|███████▏  | 27210/37963 [61:46:27<23:17:07,  7.80s/it]
                                                           
{'loss': '0.1272', 'grad_norm': '2.095', 'learning_rate': '3.922e-06', 'epoch': '0.7168'}
+
 72%|███████▏  | 27210/37963 [61:46:27<23:17:07,  7.80s/it]
 72%|███████▏  | 27211/37963 [61:46:35<23:24:41,  7.84s/it]
 72%|███████▏  | 27212/37963 [61:46:43<23:08:22,  7.75s/it]
 72%|███████▏  | 27213/37963 [61:46:50<23:05:24,  7.73s/it]
 72%|███████▏  | 27214/37963 [61:46:58<23:21:50,  7.83s/it]
 72%|███████▏  | 27215/37963 [61:47:06<23:13:48,  7.78s/it]
 72%|███████▏  | 27216/37963 [61:47:14<23:06:18,  7.74s/it]
 72%|███████▏  | 27217/37963 [61:47:24<25:33:28,  8.56s/it]
 72%|███████▏  | 27218/37963 [61:47:32<24:42:36,  8.28s/it]
 72%|███████▏  | 27219/37963 [61:47:39<24:06:43,  8.08s/it]
 72%|███████▏  | 27220/37963 [61:47:47<23:50:14,  7.99s/it]
                                                           
{'loss': '0.1322', 'grad_norm': '1.823', 'learning_rate': '3.915e-06', 'epoch': '0.717'}
+
 72%|███████▏  | 27220/37963 [61:47:47<23:50:14,  7.99s/it]
 72%|███████▏  | 27221/37963 [61:47:55<23:42:17,  7.94s/it]
 72%|███████▏  | 27222/37963 [61:48:03<23:34:10,  7.90s/it]
 72%|███████▏  | 27223/37963 [61:48:11<23:22:14,  7.83s/it]
 72%|███████▏  | 27224/37963 [61:48:18<23:13:59,  7.79s/it]
 72%|███████▏  | 27225/37963 [61:48:31<28:03:48,  9.41s/it]
 72%|███████▏  | 27226/37963 [61:48:39<26:49:23,  8.99s/it]
 72%|███████▏  | 27227/37963 [61:48:47<25:54:52,  8.69s/it]
 72%|███████▏  | 27228/37963 [61:48:55<25:06:38,  8.42s/it]
 72%|███████▏  | 27229/37963 [61:49:03<24:29:32,  8.21s/it]
 72%|███████▏  | 27230/37963 [61:49:13<26:02:03,  8.73s/it]
                                                           
{'loss': '0.1329', 'grad_norm': '2.65', 'learning_rate': '3.908e-06', 'epoch': '0.7173'}
+
 72%|███████▏  | 27230/37963 [61:49:13<26:02:03,  8.73s/it]
 72%|███████▏  | 27231/37963 [61:49:21<25:13:35,  8.46s/it]
 72%|███████▏  | 27232/37963 [61:49:28<24:22:41,  8.18s/it]
 72%|███████▏  | 27233/37963 [61:49:36<23:59:28,  8.05s/it]
 72%|███████▏  | 27234/37963 [61:49:44<23:42:55,  7.96s/it]
 72%|███████▏  | 27235/37963 [61:49:52<23:37:59,  7.93s/it]
 72%|███████▏  | 27236/37963 [61:50:00<23:37:48,  7.93s/it]
 72%|███████▏  | 27237/37963 [61:50:07<23:27:50,  7.88s/it]
 72%|███████▏  | 27238/37963 [61:50:18<25:51:05,  8.68s/it]
 72%|███████▏  | 27239/37963 [61:50:25<24:47:25,  8.32s/it]
 72%|███████▏  | 27240/37963 [61:50:33<24:05:37,  8.09s/it]
                                                           
{'loss': '0.119', 'grad_norm': '2.719', 'learning_rate': '3.901e-06', 'epoch': '0.7175'}
+
 72%|███████▏  | 27240/37963 [61:50:33<24:05:37,  8.09s/it]
 72%|███████▏  | 27241/37963 [61:50:41<23:51:51,  8.01s/it]
 72%|███████▏  | 27242/37963 [61:50:48<23:32:25,  7.90s/it]
 72%|███████▏  | 27243/37963 [61:50:56<23:29:25,  7.89s/it]
 72%|███████▏  | 27244/37963 [61:51:04<23:22:51,  7.85s/it]
 72%|███████▏  | 27245/37963 [61:51:12<23:15:21,  7.81s/it]
 72%|███████▏  | 27246/37963 [61:51:22<25:38:53,  8.62s/it]
 72%|███████▏  | 27247/37963 [61:51:33<27:34:48,  9.27s/it]
 72%|███████▏  | 27248/37963 [61:51:43<28:29:22,  9.57s/it]
 72%|███████▏  | 27249/37963 [61:51:51<26:43:08,  8.98s/it]
 72%|███████▏  | 27250/37963 [61:51:59<25:43:02,  8.64s/it]
                                                           
{'loss': '0.1317', 'grad_norm': '2.184', 'learning_rate': '3.895e-06', 'epoch': '0.7178'}
+
 72%|███████▏  | 27250/37963 [61:51:59<25:43:02,  8.64s/it]
 72%|███████▏  | 27251/37963 [61:52:06<24:48:24,  8.34s/it]
 72%|███████▏  | 27252/37963 [61:52:14<24:14:00,  8.14s/it]
 72%|███████▏  | 27253/37963 [61:52:21<23:26:50,  7.88s/it]
 72%|███████▏  | 27254/37963 [61:52:29<23:17:56,  7.83s/it]
 72%|███████▏  | 27255/37963 [61:52:37<23:10:41,  7.79s/it]
 72%|███████▏  | 27256/37963 [61:52:45<23:12:50,  7.81s/it]
 72%|███████▏  | 27257/37963 [61:52:52<23:02:39,  7.75s/it]
 72%|███████▏  | 27258/37963 [61:53:00<23:11:27,  7.80s/it]
 72%|███████▏  | 27259/37963 [61:53:08<23:13:38,  7.81s/it]
 72%|███████▏  | 27260/37963 [61:53:16<23:04:21,  7.76s/it]
                                                           
{'loss': '0.1289', 'grad_norm': '1.871', 'learning_rate': '3.888e-06', 'epoch': '0.7181'}
+
 72%|███████▏  | 27260/37963 [61:53:16<23:04:21,  7.76s/it]
 72%|███████▏  | 27261/37963 [61:53:26<25:48:36,  8.68s/it]
 72%|███████▏  | 27262/37963 [61:53:35<25:20:40,  8.53s/it]
 72%|███████▏  | 27263/37963 [61:53:42<24:31:05,  8.25s/it]
 72%|███████▏  | 27264/37963 [61:53:50<23:53:31,  8.04s/it]
 72%|███████▏  | 27265/37963 [61:53:58<23:42:29,  7.98s/it]
 72%|███████▏  | 27266/37963 [61:54:05<23:24:32,  7.88s/it]
 72%|███████▏  | 27267/37963 [61:54:13<23:08:34,  7.79s/it]
 72%|███████▏  | 27268/37963 [61:54:23<25:41:01,  8.65s/it]
 72%|███████▏  | 27269/37963 [61:54:31<24:45:48,  8.34s/it]
 72%|███████▏  | 27270/37963 [61:54:38<23:50:37,  8.03s/it]
                                                           
{'loss': '0.1214', 'grad_norm': '1.424', 'learning_rate': '3.881e-06', 'epoch': '0.7183'}
+
 72%|███████▏  | 27270/37963 [61:54:38<23:50:37,  8.03s/it]
 72%|███████▏  | 27271/37963 [61:54:46<23:13:44,  7.82s/it]
 72%|███████▏  | 27272/37963 [61:54:54<23:21:28,  7.87s/it]
 72%|███████▏  | 27273/37963 [61:55:04<25:27:55,  8.58s/it]
 72%|███████▏  | 27274/37963 [61:55:12<24:46:03,  8.34s/it]
 72%|███████▏  | 27275/37963 [61:55:20<24:17:46,  8.18s/it]
 72%|███████▏  | 27276/37963 [61:55:27<23:40:17,  7.97s/it]
 72%|███████▏  | 27277/37963 [61:55:35<23:17:38,  7.85s/it]
 72%|███████▏  | 27278/37963 [61:55:42<23:03:55,  7.77s/it]
 72%|███████▏  | 27279/37963 [61:55:50<22:57:13,  7.73s/it]
 72%|███████▏  | 27280/37963 [61:55:57<22:47:21,  7.68s/it]
                                                           
{'loss': '0.1214', 'grad_norm': '1.837', 'learning_rate': '3.874e-06', 'epoch': '0.7186'}
+
 72%|███████▏  | 27280/37963 [61:55:57<22:47:21,  7.68s/it]
 72%|███████▏  | 27281/37963 [61:56:05<22:45:44,  7.67s/it]
 72%|███████▏  | 27282/37963 [61:56:13<22:44:18,  7.66s/it]
 72%|███████▏  | 27283/37963 [61:56:20<22:36:22,  7.62s/it]
 72%|███████▏  | 27284/37963 [61:56:30<24:56:01,  8.41s/it]
 72%|███████▏  | 27285/37963 [61:56:41<26:49:30,  9.04s/it]
 72%|███████▏  | 27286/37963 [61:56:49<25:50:16,  8.71s/it]
 72%|███████▏  | 27287/37963 [61:56:57<25:01:59,  8.44s/it]
 72%|███████▏  | 27288/37963 [61:57:04<24:25:12,  8.24s/it]
 72%|███████▏  | 27289/37963 [61:57:12<23:39:18,  7.98s/it]
 72%|███████▏  | 27290/37963 [61:57:22<25:49:01,  8.71s/it]
                                                           
{'loss': '0.1246', 'grad_norm': '2.378', 'learning_rate': '3.868e-06', 'epoch': '0.7189'}
+
 72%|███████▏  | 27290/37963 [61:57:22<25:49:01,  8.71s/it]
 72%|███████▏  | 27291/37963 [61:57:30<24:59:46,  8.43s/it]
 72%|███████▏  | 27292/37963 [61:57:38<24:20:52,  8.21s/it]
 72%|███████▏  | 27293/37963 [61:57:46<23:59:23,  8.09s/it]
 72%|███████▏  | 27294/37963 [61:57:56<25:56:48,  8.76s/it]
 72%|███████▏  | 27295/37963 [61:58:04<25:02:55,  8.45s/it]
 72%|███████▏  | 27296/37963 [61:58:11<24:33:52,  8.29s/it]
 72%|███████▏  | 27297/37963 [61:58:19<24:03:28,  8.12s/it]
 72%|███████▏  | 27298/37963 [61:58:30<26:06:26,  8.81s/it]
 72%|███████▏  | 27299/37963 [61:58:38<25:19:24,  8.55s/it]
 72%|███████▏  | 27300/37963 [61:58:45<24:42:55,  8.34s/it]
                                                           
{'loss': '0.1171', 'grad_norm': '1.534', 'learning_rate': '3.861e-06', 'epoch': '0.7191'}
+
 72%|███████▏  | 27300/37963 [61:58:45<24:42:55,  8.34s/it]
 72%|███████▏  | 27301/37963 [61:58:53<24:18:14,  8.21s/it]
 72%|███████▏  | 27302/37963 [61:59:01<24:02:31,  8.12s/it]
 72%|███████▏  | 27303/37963 [61:59:09<23:32:21,  7.95s/it]
 72%|███████▏  | 27304/37963 [61:59:17<23:22:52,  7.90s/it]
 72%|███████▏  | 27305/37963 [61:59:24<23:12:07,  7.84s/it]
 72%|███████▏  | 27306/37963 [61:59:32<22:54:42,  7.74s/it]
 72%|███████▏  | 27307/37963 [61:59:40<23:13:54,  7.85s/it]
 72%|███████▏  | 27308/37963 [61:59:48<23:23:35,  7.90s/it]
 72%|███████▏  | 27309/37963 [61:59:58<25:26:03,  8.59s/it]
 72%|███████▏  | 27310/37963 [62:00:06<24:37:47,  8.32s/it]
                                                           
{'loss': '0.1278', 'grad_norm': '2.434', 'learning_rate': '3.854e-06', 'epoch': '0.7194'}
+
 72%|███████▏  | 27310/37963 [62:00:06<24:37:47,  8.32s/it]
 72%|███████▏  | 27311/37963 [62:00:13<23:54:46,  8.08s/it]
 72%|███████▏  | 27312/37963 [62:00:24<25:59:09,  8.78s/it]
 72%|███████▏  | 27313/37963 [62:00:31<24:38:26,  8.33s/it]
 72%|███████▏  | 27314/37963 [62:00:38<23:42:29,  8.01s/it]
 72%|███████▏  | 27315/37963 [62:00:46<23:22:12,  7.90s/it]
 72%|███████▏  | 27316/37963 [62:00:54<23:13:08,  7.85s/it]
 72%|███████▏  | 27317/37963 [62:01:02<23:12:54,  7.85s/it]
 72%|███████▏  | 27318/37963 [62:01:09<23:04:57,  7.81s/it]
 72%|███████▏  | 27319/37963 [62:01:17<22:43:25,  7.69s/it]
 72%|███████▏  | 27320/37963 [62:01:24<22:52:46,  7.74s/it]
                                                           
{'loss': '0.128', 'grad_norm': '1.72', 'learning_rate': '3.847e-06', 'epoch': '0.7197'}
+
 72%|███████▏  | 27320/37963 [62:01:24<22:52:46,  7.74s/it]
 72%|███████▏  | 27321/37963 [62:01:35<25:25:47,  8.60s/it]
 72%|███████▏  | 27322/37963 [62:01:43<24:44:35,  8.37s/it]
 72%|███████▏  | 27323/37963 [62:01:51<24:21:01,  8.24s/it]
 72%|███████▏  | 27324/37963 [62:01:58<23:39:48,  8.01s/it]
 72%|███████▏  | 27325/37963 [62:02:06<23:32:09,  7.96s/it]
 72%|███████▏  | 27326/37963 [62:02:14<23:16:48,  7.88s/it]
 72%|███████▏  | 27327/37963 [62:02:22<23:20:30,  7.90s/it]
 72%|███████▏  | 27328/37963 [62:02:32<25:31:43,  8.64s/it]
 72%|███████▏  | 27329/37963 [62:02:40<24:48:02,  8.40s/it]
 72%|███████▏  | 27330/37963 [62:02:48<24:22:46,  8.25s/it]
                                                           
{'loss': '0.1159', 'grad_norm': '1.962', 'learning_rate': '3.841e-06', 'epoch': '0.7199'}
+
 72%|███████▏  | 27330/37963 [62:02:48<24:22:46,  8.25s/it]
 72%|███████▏  | 27331/37963 [62:02:56<23:56:27,  8.11s/it]
 72%|███████▏  | 27332/37963 [62:03:03<23:32:46,  7.97s/it]
 72%|███████▏  | 27333/37963 [62:03:14<25:47:45,  8.74s/it]
 72%|███████▏  | 27334/37963 [62:03:24<27:23:53,  9.28s/it]
 72%|███████▏  | 27335/37963 [62:03:32<25:53:06,  8.77s/it]
 72%|███████▏  | 27336/37963 [62:03:40<24:49:25,  8.41s/it]
 72%|███████▏  | 27337/37963 [62:03:47<24:10:46,  8.19s/it]
 72%|███████▏  | 27338/37963 [62:03:55<23:42:40,  8.03s/it]
 72%|███████▏  | 27339/37963 [62:04:02<23:18:13,  7.90s/it]
 72%|███████▏  | 27340/37963 [62:04:10<23:09:53,  7.85s/it]
                                                           
{'loss': '0.121', 'grad_norm': '2.599', 'learning_rate': '3.834e-06', 'epoch': '0.7202'}
+
 72%|███████▏  | 27340/37963 [62:04:10<23:09:53,  7.85s/it]
 72%|███████▏  | 27341/37963 [62:04:18<23:03:57,  7.82s/it]
 72%|███████▏  | 27342/37963 [62:04:28<25:06:02,  8.51s/it]
 72%|███████▏  | 27343/37963 [62:04:36<24:20:38,  8.25s/it]
 72%|███████▏  | 27344/37963 [62:04:43<23:53:18,  8.10s/it]
 72%|███████▏  | 27345/37963 [62:04:51<23:30:11,  7.97s/it]
 72%|███████▏  | 27346/37963 [62:04:59<23:18:35,  7.90s/it]
 72%|███████▏  | 27347/37963 [62:05:07<23:08:13,  7.85s/it]
 72%|███████▏  | 27348/37963 [62:05:14<22:54:00,  7.77s/it]
 72%|███████▏  | 27349/37963 [62:05:22<22:45:26,  7.72s/it]
 72%|███████▏  | 27350/37963 [62:05:30<22:44:40,  7.72s/it]
                                                           
{'loss': '0.1393', 'grad_norm': '3.166', 'learning_rate': '3.827e-06', 'epoch': '0.7204'}
+
 72%|███████▏  | 27350/37963 [62:05:30<22:44:40,  7.72s/it]
 72%|███████▏  | 27351/37963 [62:05:37<22:22:03,  7.59s/it]
 72%|███████▏  | 27352/37963 [62:05:47<24:49:55,  8.42s/it]
 72%|███████▏  | 27353/37963 [62:05:55<24:12:30,  8.21s/it]
 72%|███████▏  | 27354/37963 [62:06:03<23:47:59,  8.08s/it]
 72%|███████▏  | 27355/37963 [62:06:10<23:32:24,  7.99s/it]
 72%|███████▏  | 27356/37963 [62:06:18<23:15:00,  7.89s/it]
 72%|███████▏  | 27357/37963 [62:06:29<25:40:21,  8.71s/it]
 72%|███████▏  | 27358/37963 [62:06:39<27:24:16,  9.30s/it]
 72%|███████▏  | 27359/37963 [62:06:47<26:04:47,  8.85s/it]
 72%|███████▏  | 27360/37963 [62:06:55<24:47:57,  8.42s/it]
                                                           
{'loss': '0.1261', 'grad_norm': '2.918', 'learning_rate': '3.821e-06', 'epoch': '0.7207'}
+
 72%|███████▏  | 27360/37963 [62:06:55<24:47:57,  8.42s/it]
 72%|███████▏  | 27361/37963 [62:07:02<24:01:32,  8.16s/it]
 72%|███████▏  | 27362/37963 [62:07:10<23:24:34,  7.95s/it]
 72%|███████▏  | 27363/37963 [62:07:17<23:18:05,  7.91s/it]
 72%|███████▏  | 27364/37963 [62:07:25<23:08:01,  7.86s/it]
 72%|███████▏  | 27365/37963 [62:07:35<25:10:32,  8.55s/it]
 72%|███████▏  | 27366/37963 [62:07:43<24:30:10,  8.32s/it]
 72%|███████▏  | 27367/37963 [62:07:51<23:50:26,  8.10s/it]
 72%|███████▏  | 27368/37963 [62:07:59<23:32:17,  8.00s/it]
 72%|███████▏  | 27369/37963 [62:08:06<23:06:21,  7.85s/it]
 72%|███████▏  | 27370/37963 [62:08:14<22:55:48,  7.79s/it]
                                                           
{'loss': '0.1184', 'grad_norm': '2.099', 'learning_rate': '3.814e-06', 'epoch': '0.721'}
+
 72%|███████▏  | 27370/37963 [62:08:14<22:55:48,  7.79s/it]
 72%|███████▏  | 27371/37963 [62:08:22<22:58:19,  7.81s/it]
 72%|███████▏  | 27372/37963 [62:08:29<22:30:23,  7.65s/it]
 72%|███████▏  | 27373/37963 [62:08:36<22:33:05,  7.67s/it]
 72%|███████▏  | 27374/37963 [62:08:44<22:33:35,  7.67s/it]
 72%|███████▏  | 27375/37963 [62:08:52<22:38:56,  7.70s/it]
 72%|███████▏  | 27376/37963 [62:09:00<22:48:34,  7.76s/it]
 72%|███████▏  | 27377/37963 [62:09:08<22:55:09,  7.79s/it]
 72%|███████▏  | 27378/37963 [62:09:18<25:23:27,  8.64s/it]
 72%|███████▏  | 27379/37963 [62:09:26<24:39:20,  8.39s/it]
 72%|███████▏  | 27380/37963 [62:09:34<23:51:48,  8.12s/it]
                                                           
{'loss': '0.136', 'grad_norm': '2.708', 'learning_rate': '3.807e-06', 'epoch': '0.7212'}
+
 72%|███████▏  | 27380/37963 [62:09:34<23:51:48,  8.12s/it]
 72%|███████▏  | 27381/37963 [62:09:44<25:32:20,  8.69s/it]
 72%|███████▏  | 27382/37963 [62:09:51<24:40:19,  8.39s/it]
 72%|███████▏  | 27383/37963 [62:09:59<24:10:34,  8.23s/it]
 72%|███████▏  | 27384/37963 [62:10:07<23:41:09,  8.06s/it]
 72%|███████▏  | 27385/37963 [62:10:14<23:00:12,  7.83s/it]
 72%|███████▏  | 27386/37963 [62:10:24<25:06:13,  8.54s/it]
 72%|███████▏  | 27387/37963 [62:10:32<24:33:22,  8.36s/it]
 72%|███████▏  | 27388/37963 [62:10:40<24:01:40,  8.18s/it]
 72%|███████▏  | 27389/37963 [62:10:48<23:38:14,  8.05s/it]
 72%|███████▏  | 27390/37963 [62:10:56<23:21:57,  7.96s/it]
                                                           
{'loss': '0.1276', 'grad_norm': '3.304', 'learning_rate': '3.8e-06', 'epoch': '0.7215'}
+
 72%|███████▏  | 27390/37963 [62:10:56<23:21:57,  7.96s/it]
 72%|███████▏  | 27391/37963 [62:11:03<23:03:28,  7.85s/it]
 72%|███████▏  | 27392/37963 [62:11:11<22:45:19,  7.75s/it]
 72%|███████▏  | 27393/37963 [62:11:19<22:59:12,  7.83s/it]
 72%|███████▏  | 27394/37963 [62:11:29<24:59:56,  8.52s/it]
 72%|███████▏  | 27395/37963 [62:11:36<24:03:30,  8.20s/it]
 72%|███████▏  | 27396/37963 [62:11:44<23:36:29,  8.04s/it]
 72%|███████▏  | 27397/37963 [62:11:52<23:24:16,  7.97s/it]
 72%|███████▏  | 27398/37963 [62:11:59<23:04:56,  7.87s/it]
 72%|███████▏  | 27399/37963 [62:12:07<22:28:20,  7.66s/it]
 72%|███████▏  | 27400/37963 [62:12:17<24:54:54,  8.49s/it]
                                                           
{'loss': '0.1108', 'grad_norm': '1.962', 'learning_rate': '3.794e-06', 'epoch': '0.7218'}
+
 72%|███████▏  | 27400/37963 [62:12:17<24:54:54,  8.49s/it]
 72%|███████▏  | 27401/37963 [62:12:25<24:19:23,  8.29s/it]
 72%|███████▏  | 27402/37963 [62:12:32<23:46:58,  8.11s/it]
 72%|███████▏  | 27403/37963 [62:12:40<23:26:52,  7.99s/it]
 72%|███████▏  | 27404/37963 [62:12:47<22:44:51,  7.76s/it]
 72%|███████▏  | 27405/37963 [62:12:55<22:55:56,  7.82s/it]
 72%|███████▏  | 27406/37963 [62:13:06<25:37:28,  8.74s/it]
 72%|███████▏  | 27407/37963 [62:13:14<24:46:19,  8.45s/it]
 72%|███████▏  | 27408/37963 [62:13:22<24:06:30,  8.22s/it]
 72%|███████▏  | 27409/37963 [62:13:30<23:51:05,  8.14s/it]
 72%|███████▏  | 27410/37963 [62:13:37<23:36:28,  8.05s/it]
                                                           
{'loss': '0.1275', 'grad_norm': '2.251', 'learning_rate': '3.787e-06', 'epoch': '0.722'}
+
 72%|███████▏  | 27410/37963 [62:13:37<23:36:28,  8.05s/it]
 72%|███████▏  | 27411/37963 [62:13:48<25:43:26,  8.78s/it]
 72%|███████▏  | 27412/37963 [62:13:56<24:57:19,  8.51s/it]
 72%|███████▏  | 27413/37963 [62:14:06<26:18:29,  8.98s/it]
 72%|███████▏  | 27414/37963 [62:14:13<25:05:11,  8.56s/it]
 72%|███████▏  | 27415/37963 [62:14:21<24:11:04,  8.25s/it]
 72%|███████▏  | 27416/37963 [62:14:29<23:52:04,  8.15s/it]
 72%|███████▏  | 27417/37963 [62:14:37<23:28:21,  8.01s/it]
 72%|███████▏  | 27418/37963 [62:14:44<23:09:30,  7.91s/it]
 72%|███████▏  | 27419/37963 [62:14:52<23:15:46,  7.94s/it]
 72%|███████▏  | 27420/37963 [62:15:00<23:02:33,  7.87s/it]
                                                           
{'loss': '0.1338', 'grad_norm': '1.314', 'learning_rate': '3.78e-06', 'epoch': '0.7223'}
+
 72%|███████▏  | 27420/37963 [62:15:00<23:02:33,  7.87s/it]
 72%|███████▏  | 27421/37963 [62:15:10<25:12:55,  8.61s/it]
 72%|███████▏  | 27422/37963 [62:15:18<24:37:00,  8.41s/it]
 72%|███████▏  | 27423/37963 [62:15:26<24:05:36,  8.23s/it]
 72%|███████▏  | 27424/37963 [62:15:34<23:23:58,  7.99s/it]
 72%|███████▏  | 27425/37963 [62:15:41<23:14:38,  7.94s/it]
 72%|███████▏  | 27426/37963 [62:15:49<22:57:30,  7.84s/it]
 72%|███████▏  | 27427/37963 [62:15:56<22:39:31,  7.74s/it]
 72%|███████▏  | 27428/37963 [62:16:04<22:40:30,  7.75s/it]
 72%|███████▏  | 27429/37963 [62:16:12<22:46:43,  7.78s/it]
 72%|███████▏  | 27430/37963 [62:16:23<25:07:35,  8.59s/it]
                                                           
{'loss': '0.1203', 'grad_norm': '1.74', 'learning_rate': '3.774e-06', 'epoch': '0.7225'}
+
 72%|███████▏  | 27430/37963 [62:16:23<25:07:35,  8.59s/it]
 72%|███████▏  | 27431/37963 [62:16:30<24:29:12,  8.37s/it]
 72%|███████▏  | 27432/37963 [62:16:38<24:08:14,  8.25s/it]
 72%|███████▏  | 27433/37963 [62:16:46<23:47:41,  8.13s/it]
 72%|███████▏  | 27434/37963 [62:16:54<23:23:32,  8.00s/it]
 72%|███████▏  | 27435/37963 [62:17:01<22:58:16,  7.85s/it]
 72%|███████▏  | 27436/37963 [62:17:09<22:43:16,  7.77s/it]
 72%|███████▏  | 27437/37963 [62:17:17<22:32:43,  7.71s/it]
 72%|███████▏  | 27438/37963 [62:17:24<22:35:25,  7.73s/it]
 72%|███████▏  | 27439/37963 [62:17:35<25:02:55,  8.57s/it]
 72%|███████▏  | 27440/37963 [62:17:43<24:27:20,  8.37s/it]
                                                           
{'loss': '0.1269', 'grad_norm': '2.033', 'learning_rate': '3.767e-06', 'epoch': '0.7228'}
+
 72%|███████▏  | 27440/37963 [62:17:43<24:27:20,  8.37s/it]
 72%|███████▏  | 27441/37963 [62:17:50<23:49:55,  8.15s/it]
 72%|███████▏  | 27442/37963 [62:18:01<25:43:38,  8.80s/it]
 72%|███████▏  | 27443/37963 [62:18:08<24:44:55,  8.47s/it]
 72%|███████▏  | 27444/37963 [62:18:16<23:55:43,  8.19s/it]
 72%|███████▏  | 27445/37963 [62:18:24<23:19:42,  7.98s/it]
 72%|███████▏  | 27446/37963 [62:18:31<23:00:44,  7.88s/it]
 72%|███████▏  | 27447/37963 [62:18:41<25:04:47,  8.59s/it]
 72%|███████▏  | 27448/37963 [62:18:49<24:23:47,  8.35s/it]
 72%|███████▏  | 27449/37963 [62:18:57<23:48:02,  8.15s/it]
 72%|███████▏  | 27450/37963 [62:19:04<23:17:13,  7.97s/it]
                                                           
{'loss': '0.1252', 'grad_norm': '2.924', 'learning_rate': '3.76e-06', 'epoch': '0.7231'}
+
 72%|███████▏  | 27450/37963 [62:19:04<23:17:13,  7.97s/it]
 72%|███████▏  | 27451/37963 [62:19:12<22:58:35,  7.87s/it]
 72%|███████▏  | 27452/37963 [62:19:23<25:34:40,  8.76s/it]
 72%|███████▏  | 27453/37963 [62:19:31<24:42:21,  8.46s/it]
 72%|███████▏  | 27454/37963 [62:19:38<24:02:44,  8.24s/it]
 72%|███████▏  | 27455/37963 [62:19:46<23:40:59,  8.11s/it]
 72%|███████▏  | 27456/37963 [62:19:54<23:28:18,  8.04s/it]
 72%|███████▏  | 27457/37963 [62:20:02<23:00:30,  7.88s/it]
 72%|███████▏  | 27458/37963 [62:20:09<22:54:32,  7.85s/it]
 72%|███████▏  | 27459/37963 [62:20:20<25:14:45,  8.65s/it]
 72%|███████▏  | 27460/37963 [62:20:28<24:25:24,  8.37s/it]
                                                           
{'loss': '0.118', 'grad_norm': '2.905', 'learning_rate': '3.754e-06', 'epoch': '0.7233'}
+
 72%|███████▏  | 27460/37963 [62:20:28<24:25:24,  8.37s/it]
 72%|███████▏  | 27461/37963 [62:20:38<25:59:43,  8.91s/it]
 72%|███████▏  | 27462/37963 [62:20:46<25:06:32,  8.61s/it]
 72%|███████▏  | 27463/37963 [62:20:54<24:30:23,  8.40s/it]
 72%|█████��█▏  | 27464/37963 [62:21:01<23:55:03,  8.20s/it]
 72%|███████▏  | 27465/37963 [62:21:12<26:14:02,  9.00s/it]
 72%|███████▏  | 27466/37963 [62:21:20<25:12:34,  8.65s/it]
 72%|███████▏  | 27467/37963 [62:21:28<24:24:15,  8.37s/it]
 72%|███████▏  | 27468/37963 [62:21:36<24:06:13,  8.27s/it]
 72%|███████▏  | 27469/37963 [62:21:44<23:39:52,  8.12s/it]
 72%|███████▏  | 27470/37963 [62:21:51<23:26:06,  8.04s/it]
                                                           
{'loss': '0.1197', 'grad_norm': '2.758', 'learning_rate': '3.747e-06', 'epoch': '0.7236'}
+
 72%|███████▏  | 27470/37963 [62:21:51<23:26:06,  8.04s/it]
 72%|███████▏  | 27471/37963 [62:21:59<23:28:02,  8.05s/it]
 72%|███████▏  | 27472/37963 [62:22:07<23:13:59,  7.97s/it]
 72%|███████▏  | 27473/37963 [62:22:15<22:45:30,  7.81s/it]
 72%|███████▏  | 27474/37963 [62:22:22<22:35:55,  7.76s/it]
 72%|███████▏  | 27475/37963 [62:22:30<22:38:33,  7.77s/it]
 72%|███████▏  | 27476/37963 [62:22:38<22:29:39,  7.72s/it]
 72%|███████▏  | 27477/37963 [62:22:45<22:29:23,  7.72s/it]
 72%|███████▏  | 27478/37963 [62:22:53<22:30:00,  7.73s/it]
 72%|███████▏  | 27479/37963 [62:23:01<22:34:46,  7.75s/it]
 72%|███████▏  | 27480/37963 [62:23:09<22:30:12,  7.73s/it]
                                                           
{'loss': '0.1282', 'grad_norm': '3.411', 'learning_rate': '3.74e-06', 'epoch': '0.7239'}
+
 72%|███████▏  | 27480/37963 [62:23:09<22:30:12,  7.73s/it]
 72%|███████▏  | 27481/37963 [62:23:16<22:28:21,  7.72s/it]
 72%|███████▏  | 27482/37963 [62:23:24<22:34:15,  7.75s/it]
 72%|███████▏  | 27483/37963 [62:23:38<27:45:31,  9.54s/it]
 72%|███████▏  | 27484/37963 [62:23:46<26:30:26,  9.11s/it]
 72%|███████▏  | 27485/37963 [62:23:54<25:13:36,  8.67s/it]
 72%|███████▏  | 27486/37963 [62:24:04<26:38:04,  9.15s/it]
 72%|███████▏  | 27487/37963 [62:24:11<25:11:26,  8.66s/it]
 72%|███████▏  | 27488/37963 [62:24:19<24:39:57,  8.48s/it]
 72%|███████▏  | 27489/37963 [62:24:27<24:00:52,  8.25s/it]
 72%|███████▏  | 27490/37963 [62:24:35<23:34:31,  8.10s/it]
                                                           
{'loss': '0.1217', 'grad_norm': '2.129', 'learning_rate': '3.734e-06', 'epoch': '0.7241'}
+
 72%|███████▏  | 27490/37963 [62:24:35<23:34:31,  8.10s/it]
 72%|███████▏  | 27491/37963 [62:24:45<25:33:25,  8.79s/it]
 72%|███████▏  | 27492/37963 [62:24:53<24:24:33,  8.39s/it]
 72%|███████▏  | 27493/37963 [62:25:01<23:59:25,  8.25s/it]
 72%|███████▏  | 27494/37963 [62:25:08<23:24:23,  8.05s/it]
 72%|███████▏  | 27495/37963 [62:25:16<23:20:41,  8.03s/it]
 72%|███████▏  | 27496/37963 [62:25:24<22:57:51,  7.90s/it]
 72%|███████▏  | 27497/37963 [62:25:32<22:53:40,  7.88s/it]
 72%|███████▏  | 27498/37963 [62:25:39<22:36:28,  7.78s/it]
 72%|███████▏  | 27499/37963 [62:25:47<22:47:46,  7.84s/it]
 72%|███████▏  | 27500/37963 [62:25:58<24:58:59,  8.60s/it]
                                                           
{'loss': '0.106', 'grad_norm': '3.595', 'learning_rate': '3.727e-06', 'epoch': '0.7244'}
+
 72%|███████▏  | 27500/37963 [62:25:58<24:58:59,  8.60s/it]
 72%|███████▏  | 27501/37963 [62:26:05<24:05:12,  8.29s/it]
 72%|███████▏  | 27502/37963 [62:26:13<23:17:41,  8.02s/it]
 72%|███████▏  | 27503/37963 [62:26:20<23:10:01,  7.97s/it]
 72%|███████▏  | 27504/37963 [62:26:28<22:49:29,  7.86s/it]
 72%|███████▏  | 27505/37963 [62:26:35<22:23:44,  7.71s/it]
 72%|███████▏  | 27506/37963 [62:26:43<22:21:18,  7.70s/it]
 72%|███████▏  | 27507/37963 [62:26:51<22:38:53,  7.80s/it]
 72%|███████▏  | 27508/37963 [62:27:01<24:53:14,  8.57s/it]
 72%|███████▏  | 27509/37963 [62:27:09<24:04:57,  8.29s/it]
 72%|███████▏  | 27510/37963 [62:27:19<25:47:42,  8.88s/it]
                                                           
{'loss': '0.1084', 'grad_norm': '2.068', 'learning_rate': '3.72e-06', 'epoch': '0.7247'}
+
 72%|███████▏  | 27510/37963 [62:27:19<25:47:42,  8.88s/it]
 72%|███████▏  | 27511/37963 [62:27:27<24:57:36,  8.60s/it]
 72%|███████▏  | 27512/37963 [62:27:35<23:50:59,  8.22s/it]
 72%|███████▏  | 27513/37963 [62:27:42<23:25:55,  8.07s/it]
 72%|███████▏  | 27514/37963 [62:27:50<23:14:37,  8.01s/it]
 72%|███████▏  | 27515/37963 [62:27:58<23:05:51,  7.96s/it]
 72%|███████▏  | 27516/37963 [62:28:06<22:47:27,  7.85s/it]
 72%|███████▏  | 27517/37963 [62:28:14<22:50:28,  7.87s/it]
 72%|███████▏  | 27518/37963 [62:28:21<22:46:36,  7.85s/it]
 72%|███████▏  | 27519/37963 [62:28:32<25:10:13,  8.68s/it]
 72%|███████▏  | 27520/37963 [62:28:40<24:09:59,  8.33s/it]
                                                           
{'loss': '0.1175', 'grad_norm': '2.264', 'learning_rate': '3.714e-06', 'epoch': '0.7249'}
+
 72%|███████▏  | 27520/37963 [62:28:40<24:09:59,  8.33s/it]
 72%|███████▏  | 27521/37963 [62:28:47<23:33:00,  8.12s/it]
 72%|███████▏  | 27522/37963 [62:28:55<23:06:08,  7.97s/it]
 72%|███████▏  | 27523/37963 [62:29:02<22:47:21,  7.86s/it]
 73%|███████▎  | 27524/37963 [62:29:10<22:53:36,  7.90s/it]
 73%|███████▎  | 27525/37963 [62:29:18<22:46:01,  7.85s/it]
 73%|███████▎  | 27526/37963 [62:29:26<22:37:14,  7.80s/it]
 73%|███████▎  | 27527/37963 [62:29:33<22:24:23,  7.73s/it]
 73%|███████▎  | 27528/37963 [62:29:41<22:26:41,  7.74s/it]
 73%|███████▎  | 27529/37963 [62:29:49<22:18:07,  7.69s/it]
 73%|███████▎  | 27530/37963 [62:29:59<24:39:23,  8.51s/it]
                                                           
{'loss': '0.128', 'grad_norm': '2.382', 'learning_rate': '3.707e-06', 'epoch': '0.7252'}
+
 73%|███████▎  | 27530/37963 [62:29:59<24:39:23,  8.51s/it]
 73%|███████▎  | 27531/37963 [62:30:07<24:15:04,  8.37s/it]
 73%|███████▎  | 27532/37963 [62:30:15<23:36:48,  8.15s/it]
 73%|███████▎  | 27533/37963 [62:30:25<25:25:48,  8.78s/it]
 73%|███████▎  | 27534/37963 [62:30:33<24:38:43,  8.51s/it]
 73%|███████▎  | 27535/37963 [62:30:40<23:40:22,  8.17s/it]
 73%|███████▎  | 27536/37963 [62:30:51<25:30:09,  8.80s/it]
 73%|███████▎  | 27537/37963 [62:30:59<24:44:43,  8.54s/it]
 73%|███████▎  | 27538/37963 [62:31:06<24:04:44,  8.32s/it]
 73%|███████▎  | 27539/37963 [62:31:14<23:32:22,  8.13s/it]
 73%|███████▎  | 27540/37963 [62:31:25<25:40:40,  8.87s/it]
                                                           
{'loss': '0.1115', 'grad_norm': '1.876', 'learning_rate': '3.701e-06', 'epoch': '0.7254'}
+
 73%|███████▎  | 27540/37963 [62:31:25<25:40:40,  8.87s/it]
 73%|███████▎  | 27541/37963 [62:31:32<24:42:59,  8.54s/it]
 73%|███████▎  | 27542/37963 [62:31:40<24:14:37,  8.38s/it]
 73%|███████▎  | 27543/37963 [62:31:48<23:43:28,  8.20s/it]
 73%|███████▎  | 27544/37963 [62:31:56<23:12:27,  8.02s/it]
 73%|███████▎  | 27545/37963 [62:32:03<22:38:13,  7.82s/it]
 73%|███████▎  | 27546/37963 [62:32:11<22:21:40,  7.73s/it]
 73%|███████▎  | 27547/37963 [62:32:19<22:34:51,  7.80s/it]
 73%|███████▎  | 27548/37963 [62:32:26<22:35:11,  7.81s/it]
 73%|███████▎  | 27549/37963 [62:32:34<22:44:19,  7.86s/it]
 73%|███████▎  | 27550/37963 [62:32:42<22:44:54,  7.86s/it]
                                                           
{'loss': '0.1161', 'grad_norm': '2.437', 'learning_rate': '3.694e-06', 'epoch': '0.7257'}
+
 73%|███████▎  | 27550/37963 [62:32:42<22:44:54,  7.86s/it]
 73%|███████▎  | 27551/37963 [62:32:53<25:01:37,  8.65s/it]
 73%|███████▎  | 27552/37963 [62:33:00<24:10:59,  8.36s/it]
 73%|███████▎  | 27553/37963 [62:33:10<25:35:15,  8.85s/it]
 73%|███████▎  | 27554/37963 [62:33:18<24:50:54,  8.59s/it]
 73%|███████▎  | 27555/37963 [62:33:26<23:57:23,  8.29s/it]
 73%|███████▎  | 27556/37963 [62:33:37<25:56:15,  8.97s/it]
 73%|███████▎  | 27557/37963 [62:33:44<24:56:00,  8.63s/it]
 73%|███████▎  | 27558/37963 [62:33:52<24:15:50,  8.40s/it]
 73%|███████▎  | 27559/37963 [62:34:00<23:50:04,  8.25s/it]
 73%|███████▎  | 27560/37963 [62:34:08<23:27:25,  8.12s/it]
                                                           
{'loss': '0.1193', 'grad_norm': '2.202', 'learning_rate': '3.687e-06', 'epoch': '0.726'}
+
 73%|███████▎  | 27560/37963 [62:34:08<23:27:25,  8.12s/it]
 73%|███████▎  | 27561/37963 [62:34:16<23:15:51,  8.05s/it]
 73%|███████▎  | 27562/37963 [62:34:23<22:51:00,  7.91s/it]
 73%|███████▎  | 27563/37963 [62:34:31<22:38:13,  7.84s/it]
 73%|███████▎  | 27564/37963 [62:34:39<22:34:37,  7.82s/it]
 73%|███████▎  | 27565/37963 [62:34:47<22:32:29,  7.80s/it]
 73%|███████▎  | 27566/37963 [62:34:54<22:32:33,  7.81s/it]
 73%|███████▎  | 27567/37963 [62:35:02<22:16:47,  7.72s/it]
 73%|███████▎  | 27568/37963 [62:35:10<22:16:13,  7.71s/it]
 73%|��██████▎  | 27569/37963 [62:35:17<22:21:21,  7.74s/it]
 73%|███████▎  | 27570/37963 [62:35:25<22:16:19,  7.71s/it]
                                                           
{'loss': '0.122', 'grad_norm': '1.588', 'learning_rate': '3.681e-06', 'epoch': '0.7262'}
+
 73%|███████▎  | 27570/37963 [62:35:25<22:16:19,  7.71s/it]
 73%|███████▎  | 27571/37963 [62:35:33<22:12:28,  7.69s/it]
 73%|███████▎  | 27572/37963 [62:35:40<22:06:55,  7.66s/it]
 73%|███████▎  | 27573/37963 [62:35:53<26:42:41,  9.26s/it]
 73%|███████▎  | 27574/37963 [62:36:01<25:08:57,  8.71s/it]
 73%|███████▎  | 27575/37963 [62:36:08<24:11:54,  8.39s/it]
 73%|███████▎  | 27576/37963 [62:36:16<23:40:16,  8.20s/it]
 73%|███████▎  | 27577/37963 [62:36:24<23:13:10,  8.05s/it]
 73%|███████▎  | 27578/37963 [62:36:31<22:43:01,  7.87s/it]
 73%|███████▎  | 27579/37963 [62:36:39<22:48:39,  7.91s/it]
 73%|███████▎  | 27580/37963 [62:36:50<25:07:44,  8.71s/it]
                                                           
{'loss': '0.1306', 'grad_norm': '1.676', 'learning_rate': '3.674e-06', 'epoch': '0.7265'}
+
 73%|███████▎  | 27580/37963 [62:36:50<25:07:44,  8.71s/it]
 73%|███████▎  | 27581/37963 [62:36:58<24:18:30,  8.43s/it]
 73%|███████▎  | 27582/37963 [62:37:05<23:43:14,  8.23s/it]
 73%|███████▎  | 27583/37963 [62:37:13<23:24:50,  8.12s/it]
 73%|███████▎  | 27584/37963 [62:37:24<25:14:54,  8.76s/it]
 73%|███████▎  | 27585/37963 [62:37:31<24:21:13,  8.45s/it]
 73%|███████▎  | 27586/37963 [62:37:39<23:48:02,  8.26s/it]
 73%|███████▎  | 27587/37963 [62:37:49<25:36:42,  8.89s/it]
 73%|███████▎  | 27588/37963 [62:37:57<24:43:12,  8.58s/it]
 73%|███████▎  | 27589/37963 [62:38:05<24:04:15,  8.35s/it]
 73%|███████▎  | 27590/37963 [62:38:13<23:25:52,  8.13s/it]
                                                           
{'loss': '0.1253', 'grad_norm': '1.835', 'learning_rate': '3.667e-06', 'epoch': '0.7268'}
+
 73%|███████▎  | 27590/37963 [62:38:13<23:25:52,  8.13s/it]
 73%|███████▎  | 27591/37963 [62:38:21<23:12:48,  8.06s/it]
 73%|███████▎  | 27592/37963 [62:38:28<22:53:38,  7.95s/it]
 73%|███████▎  | 27593/37963 [62:38:36<22:44:24,  7.89s/it]
 73%|███████▎  | 27594/37963 [62:38:44<22:47:01,  7.91s/it]
 73%|███████▎  | 27595/37963 [62:38:52<22:43:23,  7.89s/it]
 73%|███████▎  | 27596/37963 [62:39:00<22:34:02,  7.84s/it]
 73%|███████▎  | 27597/37963 [62:39:07<22:37:06,  7.86s/it]
 73%|███████▎  | 27598/37963 [62:39:15<22:22:56,  7.77s/it]
 73%|███████▎  | 27599/37963 [62:39:23<22:12:00,  7.71s/it]
 73%|███████▎  | 27600/37963 [62:39:33<24:41:48,  8.58s/it]
                                                           
{'loss': '0.1207', 'grad_norm': '1.926', 'learning_rate': '3.661e-06', 'epoch': '0.727'}
+
 73%|███████▎  | 27600/37963 [62:39:33<24:41:48,  8.58s/it]
 73%|███████▎  | 27601/37963 [62:39:43<26:02:27,  9.05s/it]
 73%|███████▎  | 27602/37963 [62:39:51<25:05:53,  8.72s/it]
 73%|███████▎  | 27603/37963 [62:39:59<24:04:54,  8.37s/it]
 73%|███████▎  | 27604/37963 [62:40:07<23:30:24,  8.17s/it]
 73%|███████▎  | 27605/37963 [62:40:17<25:49:06,  8.97s/it]
 73%|███████▎  | 27606/37963 [62:40:25<24:28:25,  8.51s/it]
 73%|███████▎  | 27607/37963 [62:40:33<23:56:56,  8.33s/it]
 73%|███████▎  | 27608/37963 [62:40:40<23:10:33,  8.06s/it]
 73%|███████▎  | 27609/37963 [62:40:48<22:57:05,  7.98s/it]
 73%|███████▎  | 27610/37963 [62:40:56<22:33:58,  7.85s/it]
                                                           
{'loss': '0.1025', 'grad_norm': '1.741', 'learning_rate': '3.654e-06', 'epoch': '0.7273'}
+
 73%|███████▎  | 27610/37963 [62:40:56<22:33:58,  7.85s/it]
 73%|███████▎  | 27611/37963 [62:41:03<22:22:04,  7.78s/it]
 73%|███████▎  | 27612/37963 [62:41:11<22:19:27,  7.76s/it]
 73%|███████▎  | 27613/37963 [62:41:19<22:17:27,  7.75s/it]
 73%|███████▎  | 27614/37963 [62:41:26<22:13:12,  7.73s/it]
 73%|███████▎  | 27615/37963 [62:41:34<21:56:57,  7.64s/it]
 73%|███████▎  | 27616/37963 [62:41:41<21:52:35,  7.61s/it]
 73%|███████▎  | 27617/37963 [62:41:52<24:19:49,  8.47s/it]
 73%|███████▎  | 27618/37963 [62:42:02<25:58:39,  9.04s/it]
 73%|███████▎  | 27619/37963 [62:42:10<24:56:59,  8.68s/it]
 73%|███████▎  | 27620/37963 [62:42:18<24:05:09,  8.38s/it]
                                                           
{'loss': '0.1234', 'grad_norm': '2.378', 'learning_rate': '3.648e-06', 'epoch': '0.7276'}
+
 73%|███████▎  | 27620/37963 [62:42:18<24:05:09,  8.38s/it]
 73%|███████▎  | 27621/37963 [62:42:25<23:21:41,  8.13s/it]
 73%|███████▎  | 27622/37963 [62:42:33<23:01:40,  8.02s/it]
 73%|███████▎  | 27623/37963 [62:42:40<22:20:22,  7.78s/it]
 73%|███████▎  | 27624/37963 [62:42:48<22:17:05,  7.76s/it]
 73%|███████▎  | 27625/37963 [62:42:55<22:09:15,  7.71s/it]
 73%|███████▎  | 27626/37963 [62:43:03<22:07:22,  7.70s/it]
 73%|███████▎  | 27627/37963 [62:43:13<24:08:51,  8.41s/it]
 73%|███████▎  | 27628/37963 [62:43:21<23:24:47,  8.16s/it]
 73%|███████▎  | 27629/37963 [62:43:31<25:36:18,  8.92s/it]
 73%|███████▎  | 27630/37963 [62:43:39<24:43:36,  8.61s/it]
                                                           
{'loss': '0.1363', 'grad_norm': '1.963', 'learning_rate': '3.641e-06', 'epoch': '0.7278'}
+
 73%|███████▎  | 27630/37963 [62:43:39<24:43:36,  8.61s/it]
 73%|███████▎  | 27631/37963 [62:43:47<23:54:30,  8.33s/it]
 73%|███████▎  | 27632/37963 [62:43:55<23:30:59,  8.19s/it]
 73%|███████▎  | 27633/37963 [62:44:03<23:10:37,  8.08s/it]
 73%|███████▎  | 27634/37963 [62:44:11<22:58:30,  8.01s/it]
 73%|███████▎  | 27635/37963 [62:44:18<22:40:23,  7.90s/it]
 73%|███████▎  | 27636/37963 [62:44:26<22:36:56,  7.88s/it]
 73%|███████▎  | 27637/37963 [62:44:34<22:24:26,  7.81s/it]
 73%|███████▎  | 27638/37963 [62:44:41<22:13:14,  7.75s/it]
 73%|███████▎  | 27639/37963 [62:44:49<22:09:19,  7.73s/it]
 73%|███████▎  | 27640/37963 [62:44:57<22:20:48,  7.79s/it]
                                                           
{'loss': '0.1254', 'grad_norm': '1.722', 'learning_rate': '3.634e-06', 'epoch': '0.7281'}
+
 73%|███████▎  | 27640/37963 [62:44:57<22:20:48,  7.79s/it]
 73%|███████▎  | 27641/37963 [62:45:07<24:30:46,  8.55s/it]
 73%|███████▎  | 27642/37963 [62:45:15<23:47:40,  8.30s/it]
 73%|███████▎  | 27643/37963 [62:45:23<23:11:28,  8.09s/it]
 73%|███████▎  | 27644/37963 [62:45:30<22:41:33,  7.92s/it]
 73%|███████▎  | 27645/37963 [62:45:38<22:21:11,  7.80s/it]
 73%|███████▎  | 27646/37963 [62:45:45<22:22:28,  7.81s/it]
 73%|███████▎  | 27647/37963 [62:45:53<22:25:17,  7.82s/it]
 73%|███████▎  | 27648/37963 [62:46:04<24:57:31,  8.71s/it]
 73%|███████▎  | 27649/37963 [62:46:15<26:31:58,  9.26s/it]
 73%|███████▎  | 27650/37963 [62:46:22<25:16:45,  8.82s/it]
                                                           
{'loss': '0.1317', 'grad_norm': '2.847', 'learning_rate': '3.628e-06', 'epoch': '0.7283'}
+
 73%|███████▎  | 27650/37963 [62:46:22<25:16:45,  8.82s/it]
 73%|███████▎  | 27651/37963 [62:46:30<24:25:06,  8.52s/it]
 73%|███████▎  | 27652/37963 [62:46:38<23:29:36,  8.20s/it]
 73%|███████▎  | 27653/37963 [62:46:48<25:16:55,  8.83s/it]
 73%|███████▎  | 27654/37963 [62:46:56<24:20:29,  8.50s/it]
 73%|███████▎  | 27655/37963 [62:47:03<23:36:26,  8.24s/it]
 73%|███████▎  | 27656/37963 [62:47:11<23:07:11,  8.08s/it]
 73%|███████▎  | 27657/37963 [62:47:19<22:37:07,  7.90s/it]
 73%|███████▎  | 27658/37963 [62:47:26<22:27:05,  7.84s/it]
 73%|███████▎  | 27659/37963 [62:47:34<22:20:58,  7.81s/it]
 73%|███████▎  | 27660/37963 [62:47:42<22:12:55,  7.76s/it]
                                                           
{'loss': '0.1233', 'grad_norm': '3.203', 'learning_rate': '3.621e-06', 'epoch': '0.7286'}
+
 73%|███████▎  | 27660/37963 [62:47:42<22:12:55,  7.76s/it]
 73%|███████▎  | 27661/37963 [62:47:55<26:41:21,  9.33s/it]
 73%|███████▎  | 27662/37963 [62:48:02<25:23:46,  8.88s/it]
 73%|███████▎  | 27663/37963 [62:48:10<24:01:10,  8.40s/it]
 73%|███████▎  | 27664/37963 [62:48:18<23:37:00,  8.26s/it]
 73%|███████▎  | 27665/37963 [62:48:25<23:07:17,  8.08s/it]
 73%|███████▎  | 27666/37963 [62:48:33<22:51:56,  7.99s/it]
 73%|███████▎  | 27667/37963 [62:48:41<22:44:50,  7.95s/it]
 73%|███████▎  | 27668/37963 [62:48:49<22:41:46,  7.94s/it]
 73%|███████▎  | 27669/37963 [62:48:57<22:30:26,  7.87s/it]
 73%|███████▎  | 27670/37963 [62:49:04<22:27:34,  7.86s/it]
                                                           
{'loss': '0.1277', 'grad_norm': '1.679', 'learning_rate': '3.615e-06', 'epoch': '0.7289'}
+
 73%|███████▎  | 27670/37963 [62:49:04<22:27:34,  7.86s/it]
 73%|███████▎  | 27671/37963 [62:49:12<22:16:43,  7.79s/it]
 73%|███████▎  | 27672/37963 [62:49:20<22:08:07,  7.74s/it]
 73%|███████▎  | 27673/37963 [62:49:28<22:19:18,  7.81s/it]
 73%|███████▎  | 27674/37963 [62:49:36<22:24:20,  7.84s/it]
 73%|███████▎  | 27675/37963 [62:49:46<24:20:45,  8.52s/it]
 73%|███████▎  | 27676/37963 [62:49:54<23:53:21,  8.36s/it]
 73%|███████▎  | 27677/37963 [62:50:01<23:26:56,  8.21s/it]
 73%|███████▎  | 27678/37963 [62:50:12<25:12:30,  8.82s/it]
 73%|███████▎  | 27679/37963 [62:50:20<24:19:38,  8.52s/it]
 73%|███████▎  | 27680/37963 [62:50:28<23:55:10,  8.37s/it]
                                                           
{'loss': '0.1222', 'grad_norm': '2.614', 'learning_rate': '3.608e-06', 'epoch': '0.7291'}
+
 73%|███████▎  | 27680/37963 [62:50:28<23:55:10,  8.37s/it]
 73%|███████▎  | 27681/37963 [62:50:35<22:56:36,  8.03s/it]
 73%|███████▎  | 27682/37963 [62:50:42<22:16:28,  7.80s/it]
 73%|███████▎  | 27683/37963 [62:50:50<22:07:05,  7.75s/it]
 73%|███████▎  | 27684/37963 [62:50:57<21:58:59,  7.70s/it]
 73%|███████▎  | 27685/37963 [62:51:05<22:08:41,  7.76s/it]
 73%|███████▎  | 27686/37963 [62:51:13<22:14:33,  7.79s/it]
 73%|███████▎  | 27687/37963 [62:51:21<22:02:48,  7.72s/it]
 73%|███████▎  | 27688/37963 [62:51:28<22:09:39,  7.76s/it]
 73%|███████▎  | 27689/37963 [62:51:36<22:14:55,  7.80s/it]
 73%|███████▎  | 27690/37963 [62:51:44<22:10:26,  7.77s/it]
                                                           
{'loss': '0.1162', 'grad_norm': '1.936', 'learning_rate': '3.602e-06', 'epoch': '0.7294'}
+
 73%|███████▎  | 27690/37963 [62:51:44<22:10:26,  7.77s/it]
 73%|███████▎  | 27691/37963 [62:51:52<22:00:04,  7.71s/it]
 73%|███████▎  | 27692/37963 [62:52:02<24:13:02,  8.49s/it]
 73%|███████▎  | 27693/37963 [62:52:10<23:34:14,  8.26s/it]
 73%|███████▎  | 27694/37963 [62:52:18<23:14:09,  8.15s/it]
 73%|███████▎  | 27695/37963 [62:52:28<25:12:27,  8.84s/it]
 73%|███████▎  | 27696/37963 [62:52:39<26:41:24,  9.36s/it]
 73%|███████▎  | 27697/37963 [62:52:46<25:16:43,  8.86s/it]
 73%|███████▎  | 27698/37963 [62:52:54<24:19:50,  8.53s/it]
 73%|███████▎  | 27699/37963 [62:53:02<23:38:21,  8.29s/it]
 73%|███████▎  | 27700/37963 [62:53:10<23:09:57,  8.13s/it]
                                                           
{'loss': '0.1334', 'grad_norm': '2.15', 'learning_rate': '3.595e-06', 'epoch': '0.7297'}
+
 73%|███████▎  | 27700/37963 [62:53:10<23:09:57,  8.13s/it]
 73%|███████▎  | 27701/37963 [62:53:20<25:10:33,  8.83s/it]
 73%|███████▎  | 27702/37963 [62:53:28<24:18:00,  8.53s/it]
 73%|███████▎  | 27703/37963 [62:53:36<23:40:49,  8.31s/it]
 73%|███████▎  | 27704/37963 [62:53:46<25:27:57,  8.94s/it]
 73%|███████▎  | 27705/37963 [62:53:54<24:42:58,  8.67s/it]
 73%|███████▎  | 27706/37963 [62:54:02<23:51:59,  8.38s/it]
 73%|███████▎  | 27707/37963 [62:54:10<23:20:47,  8.19s/it]
 73%|███████▎  | 27708/37963 [62:54:18<23:10:44,  8.14s/it]
 73%|███████▎  | 27709/37963 [62:54:25<22:46:36,  8.00s/it]
 73%|███████▎  | 27710/37963 [62:54:35<24:43:34,  8.68s/it]
                                                           
{'loss': '0.1109', 'grad_norm': '2.102', 'learning_rate': '3.589e-06', 'epoch': '0.7299'}
+
 73%|███████▎  | 27710/37963 [62:54:35<24:43:34,  8.68s/it]
 73%|███████▎  | 27711/37963 [62:54:43<23:46:59,  8.35s/it]
 73%|███████▎  | 27712/37963 [62:54:51<23:25:52,  8.23s/it]
 73%|███████▎  | 27713/37963 [62:54:59<22:58:37,  8.07s/it]
 73%|███████▎  | 27714/37963 [62:55:07<22:49:15,  8.02s/it]
 73%|███████▎  | 27715/37963 [62:55:14<22:35:15,  7.93s/it]
 73%|███████▎  | 27716/37963 [62:55:22<22:13:23,  7.81s/it]
 73%|███████▎  | 27717/37963 [62:55:30<22:12:22,  7.80s/it]
 73%|███████▎  | 27718/37963 [62:55:37<22:05:42,  7.76s/it]
 73%|███████▎  | 27719/37963 [62:55:45<22:01:18,  7.74s/it]
 73%|███████▎  | 27720/37963 [62:55:53<22:01:23,  7.74s/it]
                                                           
{'loss': '0.1268', 'grad_norm': '2.483', 'learning_rate': '3.582e-06', 'epoch': '0.7302'}
+
 73%|███████▎  | 27720/37963 [62:55:53<22:01:23,  7.74s/it]
 73%|███████▎  | 27721/37963 [62:56:01<22:07:25,  7.78s/it]
 73%|███████▎  | 27722/37963 [62:56:09<22:17:31,  7.84s/it]
 73%|████���██▎  | 27723/37963 [62:56:16<22:04:14,  7.76s/it]
 73%|███████▎  | 27724/37963 [62:56:26<24:09:28,  8.49s/it]
 73%|███████▎  | 27725/37963 [62:56:34<23:32:43,  8.28s/it]
 73%|███████▎  | 27726/37963 [62:56:42<23:11:02,  8.15s/it]
 73%|███████▎  | 27727/37963 [62:56:50<22:52:53,  8.05s/it]
 73%|███████▎  | 27728/37963 [62:56:57<22:34:55,  7.94s/it]
 73%|███████▎  | 27729/37963 [62:57:05<22:34:57,  7.94s/it]
 73%|███████▎  | 27730/37963 [62:57:13<22:22:45,  7.87s/it]
                                                           
{'loss': '0.134', 'grad_norm': '4.837', 'learning_rate': '3.575e-06', 'epoch': '0.7305'}
+
 73%|███████▎  | 27730/37963 [62:57:13<22:22:45,  7.87s/it]
 73%|███████▎  | 27731/37963 [62:57:21<22:12:43,  7.82s/it]
 73%|███████▎  | 27732/37963 [62:57:31<24:17:00,  8.54s/it]
 73%|███████▎  | 27733/37963 [62:57:39<23:44:33,  8.36s/it]
 73%|███████▎  | 27734/37963 [62:57:47<23:08:41,  8.15s/it]
 73%|███████▎  | 27735/37963 [62:57:54<22:50:48,  8.04s/it]
 73%|███████▎  | 27736/37963 [62:58:02<22:37:50,  7.97s/it]
 73%|███████▎  | 27737/37963 [62:58:10<22:06:22,  7.78s/it]
 73%|███████▎  | 27738/37963 [62:58:17<22:04:34,  7.77s/it]
 73%|███████▎  | 27739/37963 [62:58:27<24:06:13,  8.49s/it]
 73%|███████▎  | 27740/37963 [62:58:38<25:54:30,  9.12s/it]
                                                           
{'loss': '0.1429', 'grad_norm': '3.417', 'learning_rate': '3.569e-06', 'epoch': '0.7307'}
+
 73%|███████▎  | 27740/37963 [62:58:38<25:54:30,  9.12s/it]
 73%|███████▎  | 27741/37963 [62:58:46<24:27:11,  8.61s/it]
 73%|███████▎  | 27742/37963 [62:58:53<23:31:31,  8.29s/it]
 73%|███████▎  | 27743/37963 [62:59:01<23:00:11,  8.10s/it]
 73%|███████▎  | 27744/37963 [62:59:08<22:22:13,  7.88s/it]
 73%|███████▎  | 27745/37963 [62:59:16<22:15:04,  7.84s/it]
 73%|███████▎  | 27746/37963 [62:59:26<24:16:03,  8.55s/it]
 73%|███████▎  | 27747/37963 [62:59:34<23:45:31,  8.37s/it]
 73%|███████▎  | 27748/37963 [62:59:45<25:48:03,  9.09s/it]
 73%|███████▎  | 27749/37963 [62:59:53<24:39:08,  8.69s/it]
 73%|███████▎  | 27750/37963 [63:00:01<24:04:21,  8.49s/it]
                                                           
{'loss': '0.1252', 'grad_norm': '2.99', 'learning_rate': '3.562e-06', 'epoch': '0.731'}
+
 73%|███████▎  | 27750/37963 [63:00:01<24:04:21,  8.49s/it]
 73%|███████▎  | 27751/37963 [63:00:08<23:21:31,  8.23s/it]
 73%|███████▎  | 27752/37963 [63:00:16<22:48:12,  8.04s/it]
 73%|███████▎  | 27753/37963 [63:00:23<22:27:09,  7.92s/it]
 73%|███████▎  | 27754/37963 [63:00:31<22:15:52,  7.85s/it]
 73%|███████▎  | 27755/37963 [63:00:42<24:30:50,  8.65s/it]
 73%|███████▎  | 27756/37963 [63:00:49<23:33:36,  8.31s/it]
 73%|███████▎  | 27757/37963 [63:00:57<23:03:31,  8.13s/it]
 73%|███████▎  | 27758/37963 [63:01:08<25:15:12,  8.91s/it]
 73%|███████▎  | 27759/37963 [63:01:15<24:21:22,  8.59s/it]
 73%|███████▎  | 27760/37963 [63:01:23<23:47:45,  8.40s/it]
                                                           
{'loss': '0.1216', 'grad_norm': '2.215', 'learning_rate': '3.556e-06', 'epoch': '0.7312'}
+
 73%|███████▎  | 27760/37963 [63:01:23<23:47:45,  8.40s/it]
 73%|███████▎  | 27761/37963 [63:01:31<23:00:12,  8.12s/it]
 73%|███████▎  | 27762/37963 [63:01:39<22:39:42,  8.00s/it]
 73%|███████▎  | 27763/37963 [63:01:46<22:22:37,  7.90s/it]
 73%|███████▎  | 27764/37963 [63:01:54<22:14:27,  7.85s/it]
 73%|███████▎  | 27765/37963 [63:02:02<22:24:15,  7.91s/it]
 73%|███████▎  | 27766/37963 [63:02:10<22:12:41,  7.84s/it]
 73%|███████▎  | 27767/37963 [63:02:17<21:49:53,  7.71s/it]
 73%|███████▎  | 27768/37963 [63:02:25<21:49:00,  7.70s/it]
 73%|███████▎  | 27769/37963 [63:02:33<21:54:14,  7.74s/it]
 73%|███████▎  | 27770/37963 [63:02:40<21:49:00,  7.71s/it]
                                                           
{'loss': '0.1165', 'grad_norm': '1.56', 'learning_rate': '3.549e-06', 'epoch': '0.7315'}
+
 73%|███████▎  | 27770/37963 [63:02:40<21:49:00,  7.71s/it]
 73%|███████▎  | 27771/37963 [63:02:48<21:42:11,  7.67s/it]
 73%|███████▎  | 27772/37963 [63:02:55<21:38:52,  7.65s/it]
 73%|███████▎  | 27773/37963 [63:03:03<21:38:08,  7.64s/it]
 73%|███████▎  | 27774/37963 [63:03:11<21:42:47,  7.67s/it]
 73%|███████▎  | 27775/37963 [63:03:18<21:39:50,  7.66s/it]
 73%|███████▎  | 27776/37963 [63:03:26<21:47:45,  7.70s/it]
 73%|███████▎  | 27777/37963 [63:03:36<23:38:32,  8.36s/it]
 73%|███████▎  | 27778/37963 [63:03:44<23:08:37,  8.18s/it]
 73%|███████▎  | 27779/37963 [63:03:52<22:48:59,  8.07s/it]
 73%|███████▎  | 27780/37963 [63:03:59<22:29:47,  7.95s/it]
                                                           
{'loss': '0.1224', 'grad_norm': '2.843', 'learning_rate': '3.543e-06', 'epoch': '0.7318'}
+
 73%|███████▎  | 27780/37963 [63:03:59<22:29:47,  7.95s/it]
 73%|███████▎  | 27781/37963 [63:04:07<22:17:28,  7.88s/it]
 73%|███████▎  | 27782/37963 [63:04:18<24:30:37,  8.67s/it]
 73%|███████▎  | 27783/37963 [63:04:28<26:04:37,  9.22s/it]
 73%|███████▎  | 27784/37963 [63:04:36<24:58:22,  8.83s/it]
 73%|███████▎  | 27785/37963 [63:04:44<23:56:29,  8.47s/it]
 73%|███████▎  | 27786/37963 [63:04:51<23:22:54,  8.27s/it]
 73%|███████▎  | 27787/37963 [63:04:59<22:58:39,  8.13s/it]
 73%|███████▎  | 27788/37963 [63:05:07<22:43:40,  8.04s/it]
 73%|███████▎  | 27789/37963 [63:05:15<22:24:39,  7.93s/it]
 73%|███████▎  | 27790/37963 [63:05:25<24:29:43,  8.67s/it]
                                                           
{'loss': '0.1254', 'grad_norm': '1.816', 'learning_rate': '3.536e-06', 'epoch': '0.732'}
+
 73%|███████▎  | 27790/37963 [63:05:25<24:29:43,  8.67s/it]
 73%|███████▎  | 27791/37963 [63:05:33<23:40:49,  8.38s/it]
 73%|███████▎  | 27792/37963 [63:05:46<27:41:43,  9.80s/it]
 73%|███████▎  | 27793/37963 [63:05:54<26:02:45,  9.22s/it]
 73%|███████▎  | 27794/37963 [63:06:02<24:55:42,  8.83s/it]
 73%|███████▎  | 27795/37963 [63:06:10<24:06:10,  8.53s/it]
 73%|███████▎  | 27796/37963 [63:06:17<23:30:23,  8.32s/it]
 73%|███████▎  | 27797/37963 [63:06:25<22:58:04,  8.13s/it]
 73%|███████▎  | 27798/37963 [63:06:33<22:37:31,  8.01s/it]
 73%|███████▎  | 27799/37963 [63:06:41<22:23:50,  7.93s/it]
 73%|███████▎  | 27800/37963 [63:06:48<22:16:38,  7.89s/it]
                                                           
{'loss': '0.1288', 'grad_norm': '1.588', 'learning_rate': '3.53e-06', 'epoch': '0.7323'}
+
 73%|███████▎  | 27800/37963 [63:06:48<22:16:38,  7.89s/it]
 73%|███████▎  | 27801/37963 [63:06:59<24:25:03,  8.65s/it]
 73%|███████▎  | 27802/37963 [63:07:07<23:47:34,  8.43s/it]
 73%|███████▎  | 27803/37963 [63:07:15<23:24:40,  8.30s/it]
 73%|███████▎  | 27804/37963 [63:07:22<22:57:34,  8.14s/it]
 73%|███████▎  | 27805/37963 [63:07:33<24:48:41,  8.79s/it]
 73%|███████▎  | 27806/37963 [63:07:41<24:01:06,  8.51s/it]
 73%|███████▎  | 27807/37963 [63:07:48<23:27:44,  8.32s/it]
 73%|███████▎  | 27808/37963 [63:07:56<22:46:33,  8.07s/it]
 73%|███████▎  | 27809/37963 [63:08:04<22:32:45,  7.99s/it]
 73%|███████▎  | 27810/37963 [63:08:12<22:25:20,  7.95s/it]
                                                           
{'loss': '0.1426', 'grad_norm': '2.38', 'learning_rate': '3.523e-06', 'epoch': '0.7326'}
+
 73%|███████▎  | 27810/37963 [63:08:12<22:25:20,  7.95s/it]
 73%|███████▎  | 27811/37963 [63:08:19<22:03:10,  7.82s/it]
 73%|███████▎  | 27812/37963 [63:08:27<21:57:29,  7.79s/it]
 73%|███████▎  | 27813/37963 [63:08:35<22:00:17,  7.80s/it]
 73%|███████▎  | 27814/37963 [63:08:42<21:50:38,  7.75s/it]
 73%|███████▎  | 27815/37963 [63:08:50<21:38:13,  7.68s/it]
 73%|███████▎  | 27816/37963 [63:08:58<21:47:29,  7.73s/it]
 73%|███████▎  | 27817/37963 [63:09:05<21:42:16,  7.70s/it]
 73%|███████▎  | 27818/37963 [63:09:13<21:42:08,  7.70s/it]
 73%|███████▎  | 27819/37963 [63:09:21<21:37:56,  7.68s/it]
 73%|███████▎  | 27820/37963 [63:09:28<21:35:49,  7.67s/it]
                                                           
{'loss': '0.1126', 'grad_norm': '1.807', 'learning_rate': '3.517e-06', 'epoch': '0.7328'}
+
 73%|███████▎  | 27820/37963 [63:09:28<21:35:49,  7.67s/it]
 73%|███████▎  | 27821/37963 [63:09:36<21:33:37,  7.65s/it]
 73%|███████▎  | 27822/37963 [63:09:44<21:41:57,  7.70s/it]
 73%|███████▎  | 27823/37963 [63:09:51<21:35:53,  7.67s/it]
 73%|███████▎  | 27824/37963 [63:09:59<21:52:30,  7.77s/it]
 73%|███████▎  | 27825/37963 [63:10:07<21:54:13,  7.78s/it]
 73%|███████▎  | 27826/37963 [63:10:15<21:52:03,  7.77s/it]
 73%|███████▎  | 27827/37963 [63:10:23<21:57:51,  7.80s/it]
 73%|███████▎  | 27828/37963 [63:10:31<22:04:57,  7.84s/it]
 73%|███████▎  | 27829/37963 [63:10:38<21:56:40,  7.80s/it]
 73%|███████▎  | 27830/37963 [63:10:49<24:17:38,  8.63s/it]
                                                           
{'loss': '0.1225', 'grad_norm': '2.874', 'learning_rate': '3.51e-06', 'epoch': '0.7331'}
+
 73%|███████▎  | 27830/37963 [63:10:49<24:17:38,  8.63s/it]
 73%|███████▎  | 27831/37963 [63:10:59<25:29:09,  9.06s/it]
 73%|███████▎  | 27832/37963 [63:11:07<24:13:12,  8.61s/it]
 73%|███████▎  | 27833/37963 [63:11:17<25:49:50,  9.18s/it]
 73%|███████▎  | 27834/37963 [63:11:25<24:42:15,  8.78s/it]
 73%|███████▎  | 27835/37963 [63:11:33<23:56:21,  8.51s/it]
 73%|███████▎  | 27836/37963 [63:11:46<27:55:22,  9.93s/it]
 73%|███████▎  | 27837/37963 [63:11:56<28:18:20, 10.06s/it]
 73%|███████▎  | 27838/37963 [63:12:04<26:15:04,  9.33s/it]
 73%|███████▎  | 27839/37963 [63:12:12<24:55:34,  8.86s/it]
 73%|███████▎  | 27840/37963 [63:12:19<23:51:31,  8.48s/it]
                                                           
{'loss': '0.1291', 'grad_norm': '1.965', 'learning_rate': '3.504e-06', 'epoch': '0.7333'}
+
 73%|███████▎  | 27840/37963 [63:12:19<23:51:31,  8.48s/it]
 73%|███████▎  | 27841/37963 [63:12:27<23:06:37,  8.22s/it]
 73%|███████▎  | 27842/37963 [63:12:34<22:18:07,  7.93s/it]
 73%|███████▎  | 27843/37963 [63:12:42<22:08:00,  7.87s/it]
 73%|███████▎  | 27844/37963 [63:12:50<22:02:19,  7.84s/it]
 73%|███████▎  | 27845/37963 [63:12:57<21:54:40,  7.80s/it]
 73%|███████▎  | 27846/37963 [63:13:05<21:50:52,  7.77s/it]
 73%|███████▎  | 27847/37963 [63:13:13<21:32:01,  7.66s/it]
 73%|███████▎  | 27848/37963 [63:13:20<21:40:36,  7.71s/it]
 73%|███████▎  | 27849/37963 [63:13:31<24:12:17,  8.62s/it]
 73%|███████▎  | 27850/37963 [63:13:39<23:23:21,  8.33s/it]
                                                           
{'loss': '0.1218', 'grad_norm': '3.183', 'learning_rate': '3.497e-06', 'epoch': '0.7336'}
+
 73%|███████▎  | 27850/37963 [63:13:39<23:23:21,  8.33s/it]
 73%|███████▎  | 27851/37963 [63:13:46<22:50:43,  8.13s/it]
 73%|███████▎  | 27852/37963 [63:13:54<22:19:48,  7.95s/it]
 73%|███████▎  | 27853/37963 [63:14:02<22:04:41,  7.86s/it]
 73%|███████▎  | 27854/37963 [63:14:10<22:04:54,  7.86s/it]
 73%|███████▎  | 27855/37963 [63:14:20<23:56:18,  8.53s/it]
 73%|███████▎  | 27856/37963 [63:14:27<22:58:14,  8.18s/it]
 73%|███████▎  | 27857/37963 [63:14:35<22:31:56,  8.03s/it]
 73%|███████▎  | 27858/37963 [63:14:42<22:16:37,  7.94s/it]
 73%|███████▎  | 27859/37963 [63:14:50<22:13:10,  7.92s/it]
 73%|███████▎  | 27860/37963 [63:14:58<22:06:23,  7.88s/it]
                                                           
{'loss': '0.1186', 'grad_norm': '1.876', 'learning_rate': '3.491e-06', 'epoch': '0.7339'}
+
 73%|███████▎  | 27860/37963 [63:14:58<22:06:23,  7.88s/it]
 73%|███████▎  | 27861/37963 [63:15:06<21:56:20,  7.82s/it]
 73%|███████▎  | 27862/37963 [63:15:14<21:58:44,  7.83s/it]
 73%|███████▎  | 27863/37963 [63:15:21<21:47:41,  7.77s/it]
 73%|███████▎  | 27864/37963 [63:15:29<21:39:03,  7.72s/it]
 73%|███████▎  | 27865/37963 [63:15:36<21:37:09,  7.71s/it]
 73%|███████▎  | 27866/37963 [63:15:44<21:52:10,  7.80s/it]
 73%|███████▎  | 27867/37963 [63:15:52<21:43:15,  7.75s/it]
 73%|███████▎  | 27868/37963 [63:16:00<21:44:20,  7.75s/it]
 73%|███████▎  | 27869/37963 [63:16:08<21:52:22,  7.80s/it]
 73%|███████▎  | 27870/37963 [63:16:16<21:51:05,  7.79s/it]
                                                           
{'loss': '0.1257', 'grad_norm': '2.082', 'learning_rate': '3.484e-06', 'epoch': '0.7341'}
+
 73%|███████▎  | 27870/37963 [63:16:16<21:51:05,  7.79s/it]
 73%|███████▎  | 27871/37963 [63:16:23<21:53:48,  7.81s/it]
 73%|███████▎  | 27872/37963 [63:16:31<21:43:23,  7.75s/it]
 73%|███████▎  | 27873/37963 [63:16:39<21:32:15,  7.68s/it]
 73%|███████▎  | 27874/37963 [63:16:46<21:28:27,  7.66s/it]
 73%|███████▎  | 27875/37963 [63:16:54<21:27:36,  7.66s/it]
 73%|███████▎  | 27876/37963 [63:17:02<21:36:09,  7.71s/it]
 73%|███████▎  | 27877/37963 [63:17:12<24:10:37,  8.63s/it]
 73%|███████▎  | 27878/37963 [63:17:20<23:31:15,  8.40s/it]
 73%|███████▎  | 27879/37963 [63:17:31<25:11:41,  8.99s/it]
 73%|███████▎  | 27880/37963 [63:17:39<24:22:33,  8.70s/it]
                                                           
{'loss': '0.1218', 'grad_norm': '2.247', 'learning_rate': '3.478e-06', 'epoch': '0.7344'}
+
 73%|███████▎  | 27880/37963 [63:17:39<24:22:33,  8.70s/it]
 73%|███████▎  | 27881/37963 [63:17:46<23:36:30,  8.43s/it]
 73%|███████▎  | 27882/37963 [63:17:57<25:11:20,  9.00s/it]
 73%|███████▎  | 27883/37963 [63:18:05<24:08:55,  8.62s/it]
 73%|███████▎  | 27884/37963 [63:18:18<28:01:36, 10.01s/it]
 73%|███████▎  | 27885/37963 [63:18:26<26:06:41,  9.33s/it]
 73%|███████▎  | 27886/37963 [63:18:33<24:50:46,  8.88s/it]
 73%|███████▎  | 27887/37963 [63:18:41<23:52:34,  8.53s/it]
 73%|███████▎  | 27888/37963 [63:18:49<23:10:34,  8.28s/it]
 73%|███████▎  | 27889/37963 [63:18:56<22:36:03,  8.08s/it]
 73%|███████▎  | 27890/37963 [63:19:04<22:22:33,  8.00s/it]
                                                           
{'loss': '0.135', 'grad_norm': '4.081', 'learning_rate': '3.471e-06', 'epoch': '0.7347'}
+
 73%|███████▎  | 27890/37963 [63:19:04<22:22:33,  8.00s/it]
 73%|███████▎  | 27891/37963 [63:19:12<21:59:53,  7.86s/it]
 73%|███████▎  | 27892/37963 [63:19:22<24:17:18,  8.68s/it]
 73%|███████▎  | 27893/37963 [63:19:33<25:55:44,  9.27s/it]
 73%|███████▎  | 27894/37963 [63:19:41<24:40:42,  8.82s/it]
 73%|███████▎  | 27895/37963 [63:19:48<23:47:12,  8.51s/it]
 73%|███████▎  | 27896/37963 [63:19:57<23:24:15,  8.37s/it]
 73%|███████▎  | 27897/37963 [63:20:04<22:48:03,  8.15s/it]
 73%|███████▎  | 27898/37963 [63:20:12<22:35:25,  8.08s/it]
 73%|███████▎  | 27899/37963 [63:20:20<22:25:01,  8.02s/it]
 73%|███████▎  | 27900/37963 [63:20:28<22:20:53,  7.99s/it]
                                                           
{'loss': '0.1247', 'grad_norm': '3.665', 'learning_rate': '3.465e-06', 'epoch': '0.7349'}
+
 73%|███████▎  | 27900/37963 [63:20:28<22:20:53,  7.99s/it]
 73%|███████▎  | 27901/37963 [63:20:36<22:02:55,  7.89s/it]
 73%|███████▎  | 27902/37963 [63:20:43<21:56:18,  7.85s/it]
 74%|███████▎  | 27903/37963 [63:20:51<21:50:02,  7.81s/it]
 74%|███████▎  | 27904/37963 [63:21:01<23:32:36,  8.43s/it]
 74%|███████▎  | 27905/37963 [63:21:09<22:58:04,  8.22s/it]
 74%|███████▎  | 27906/37963 [63:21:16<22:36:55,  8.10s/it]
 74%|███████▎  | 27907/37963 [63:21:24<22:19:18,  7.99s/it]
 74%|███████▎  | 27908/37963 [63:21:32<22:16:16,  7.97s/it]
 74%|███████▎  | 27909/37963 [63:21:40<22:02:30,  7.89s/it]
 74%|███████▎  | 27910/37963 [63:21:48<21:53:22,  7.84s/it]
                                                           
{'loss': '0.1209', 'grad_norm': '1.836', 'learning_rate': '3.459e-06', 'epoch': '0.7352'}
+
 74%|███████▎  | 27910/37963 [63:21:48<21:53:22,  7.84s/it]
 74%|███████▎  | 27911/37963 [63:21:55<21:53:04,  7.84s/it]
 74%|███████▎  | 27912/37963 [63:22:03<21:48:38,  7.81s/it]
 74%|███████▎  | 27913/37963 [63:22:11<21:44:48,  7.79s/it]
 74%|███████▎  | 27914/37963 [63:22:19<21:43:51,  7.78s/it]
 74%|███████▎  | 27915/37963 [63:22:26<21:44:25,  7.79s/it]
 74%|███████▎  | 27916/37963 [63:22:34<21:53:42,  7.85s/it]
 74%|███████▎  | 27917/37963 [63:22:42<21:43:52,  7.79s/it]
 74%|███████▎  | 27918/37963 [63:22:50<21:50:38,  7.83s/it]
 74%|███████▎  | 27919/37963 [63:22:58<21:51:02,  7.83s/it]
 74%|███████▎  | 27920/37963 [63:23:05<21:34:48,  7.74s/it]
                                                           
{'loss': '0.1172', 'grad_norm': '2.055', 'learning_rate': '3.452e-06', 'epoch': '0.7355'}
+
 74%|███████▎  | 27920/37963 [63:23:05<21:34:48,  7.74s/it]
 74%|███████▎  | 27921/37963 [63:23:13<21:34:36,  7.74s/it]
 74%|███████▎  | 27922/37963 [63:23:21<21:37:54,  7.76s/it]
 74%|███████▎  | 27923/37963 [63:23:29<21:44:01,  7.79s/it]
 74%|███████▎  | 27924/37963 [63:23:36<21:37:26,  7.75s/it]
 74%|███████▎  | 27925/37963 [63:23:44<21:28:16,  7.70s/it]
 74%|███████▎  | 27926/37963 [63:23:52<21:29:09,  7.71s/it]
 74%|███████▎  | 27927/37963 [63:23:59<21:20:40,  7.66s/it]
 74%|███████▎  | 27928/37963 [63:24:10<23:38:35,  8.48s/it]
 74%|███████▎  | 27929/37963 [63:24:20<25:10:19,  9.03s/it]
 74%|███████▎  | 27930/37963 [63:24:28<24:13:27,  8.69s/it]
                                                           
{'loss': '0.1199', 'grad_norm': '2.246', 'learning_rate': '3.446e-06', 'epoch': '0.7357'}
+
 74%|███████▎  | 27930/37963 [63:24:28<24:13:27,  8.69s/it]
 74%|███████▎  | 27931/37963 [63:24:38<25:30:26,  9.15s/it]
 74%|███████▎  | 27932/37963 [63:24:46<24:28:20,  8.78s/it]
 74%|███████▎  | 27933/37963 [63:24:54<23:38:44,  8.49s/it]
 74%|███████▎  | 27934/37963 [63:25:02<23:17:09,  8.36s/it]
 74%|███████▎  | 27935/37963 [63:25:12<24:57:24,  8.96s/it]
 74%|███████▎  | 27936/37963 [63:25:20<23:59:20,  8.61s/it]
 74%|███████▎  | 27937/37963 [63:25:30<25:22:35,  9.11s/it]
 74%|███████▎  | 27938/37963 [63:25:38<24:11:49,  8.69s/it]
 74%|███████▎  | 27939/37963 [63:25:46<23:20:01,  8.38s/it]
 74%|███████▎  | 27940/37963 [63:25:56<25:04:31,  9.01s/it]
                                                           
{'loss': '0.1345', 'grad_norm': '2.539', 'learning_rate': '3.439e-06', 'epoch': '0.736'}
+
 74%|███████▎  | 27940/37963 [63:25:56<25:04:31,  9.01s/it]
 74%|███████▎  | 27941/37963 [63:26:04<23:44:05,  8.53s/it]
 74%|███████▎  | 27942/37963 [63:26:11<22:56:21,  8.24s/it]
 74%|███████▎  | 27943/37963 [63:26:19<22:35:33,  8.12s/it]
 74%|███████▎  | 27944/37963 [63:26:27<22:07:08,  7.95s/it]
 74%|███████▎  | 27945/37963 [63:26:34<22:01:27,  7.91s/it]
 74%|███████▎  | 27946/37963 [63:26:45<24:13:02,  8.70s/it]
 74%|███████▎  | 27947/37963 [63:26:53<23:27:02,  8.43s/it]
 74%|███████▎  | 27948/37963 [63:27:03<25:07:55,  9.03s/it]
 74%|███████▎  | 27949/37963 [63:27:11<23:59:43,  8.63s/it]
 74%|███████▎  | 27950/37963 [63:27:18<23:10:25,  8.33s/it]
                                                           
{'loss': '0.1345', 'grad_norm': '2.116', 'learning_rate': '3.433e-06', 'epoch': '0.7362'}
+
 74%|███████▎  | 27950/37963 [63:27:18<23:10:25,  8.33s/it]
 74%|███████▎  | 27951/37963 [63:27:26<22:37:01,  8.13s/it]
 74%|███████▎  | 27952/37963 [63:27:34<22:14:21,  8.00s/it]
 74%|███████▎  | 27953/37963 [63:27:41<21:50:27,  7.85s/it]
 74%|███████▎  | 27954/37963 [63:27:49<21:46:56,  7.83s/it]
 74%|███████▎  | 27955/37963 [63:27:57<21:36:34,  7.77s/it]
 74%|███████▎  | 27956/37963 [63:28:04<21:31:33,  7.74s/it]
 74%|███████▎  | 27957/37963 [63:28:12<21:32:23,  7.75s/it]
 74%|███████▎  | 27958/37963 [63:28:20<21:23:43,  7.70s/it]
 74%|███████▎  | 27959/37963 [63:28:28<21:37:31,  7.78s/it]
 74%|███████▎  | 27960/37963 [63:28:35<21:35:49,  7.77s/it]
                                                           
{'loss': '0.1209', 'grad_norm': '1.797', 'learning_rate': '3.426e-06', 'epoch': '0.7365'}
+
 74%|███████▎  | 27960/37963 [63:28:35<21:35:49,  7.77s/it]
 74%|███████▎  | 27961/37963 [63:28:43<21:27:57,  7.73s/it]
 74%|███████▎  | 27962/37963 [63:28:51<21:25:23,  7.71s/it]
 74%|███████▎  | 27963/37963 [63:28:58<21:23:18,  7.70s/it]
 74%|███████▎  | 27964/37963 [63:29:06<21:28:18,  7.73s/it]
 74%|███████▎  | 27965/37963 [63:29:14<21:27:28,  7.73s/it]
 74%|███████▎  | 27966/37963 [63:29:22<21:23:03,  7.70s/it]
 74%|███████▎  | 27967/37963 [63:29:29<21:15:41,  7.66s/it]
 74%|███████▎  | 27968/37963 [63:29:37<21:30:49,  7.75s/it]
 74%|███████▎  | 27969/37963 [63:29:45<21:43:04,  7.82s/it]
 74%|███████▎  | 27970/37963 [63:29:53<21:38:07,  7.79s/it]
                                                           
{'loss': '0.1103', 'grad_norm': '2.297', 'learning_rate': '3.42e-06', 'epoch': '0.7368'}
+
 74%|███████▎  | 27970/37963 [63:29:53<21:38:07,  7.79s/it]
 74%|███████▎  | 27971/37963 [63:30:01<21:32:28,  7.76s/it]
 74%|███████▎  | 27972/37963 [63:30:08<21:10:21,  7.63s/it]
 74%|███████▎  | 27973/37963 [63:30:16<21:14:36,  7.66s/it]
 74%|███████▎  | 27974/37963 [63:30:23<21:16:32,  7.67s/it]
 74%|███████▎  | 27975/37963 [63:30:31<21:25:43,  7.72s/it]
 74%|███████▎  | 27976/37963 [63:30:42<23:58:49,  8.64s/it]
 74%|███████▎  | 27977/37963 [63:30:50<23:24:14,  8.44s/it]
 74%|███████▎  | 27978/37963 [63:30:58<22:44:44,  8.20s/it]
 74%|███████▎  | 27979/37963 [63:31:10<26:39:51,  9.61s/it]
 74%|███████▎  | 27980/37963 [63:31:18<25:13:48,  9.10s/it]
                                                           
{'loss': '0.134', 'grad_norm': '2.696', 'learning_rate': '3.413e-06', 'epoch': '0.737'}
+
 74%|███████▎  | 27980/37963 [63:31:18<25:13:48,  9.10s/it]
 74%|███████▎  | 27981/37963 [63:31:26<24:10:27,  8.72s/it]
 74%|████��██▎  | 27982/37963 [63:31:34<23:30:54,  8.48s/it]
 74%|███████▎  | 27983/37963 [63:31:44<24:46:58,  8.94s/it]
 74%|███████▎  | 27984/37963 [63:31:51<23:27:28,  8.46s/it]
 74%|███████▎  | 27985/37963 [63:31:59<22:48:25,  8.23s/it]
 74%|███████▎  | 27986/37963 [63:32:10<24:38:53,  8.89s/it]
 74%|███████▎  | 27987/37963 [63:32:18<23:50:02,  8.60s/it]
 74%|███████▎  | 27988/37963 [63:32:25<22:52:56,  8.26s/it]
 74%|███████▎  | 27989/37963 [63:32:32<22:08:36,  7.99s/it]
 74%|███████▎  | 27990/37963 [63:32:40<21:56:29,  7.92s/it]
                                                           
{'loss': '0.1129', 'grad_norm': '2.272', 'learning_rate': '3.407e-06', 'epoch': '0.7373'}
+
 74%|███████▎  | 27990/37963 [63:32:40<21:56:29,  7.92s/it]
 74%|███████▎  | 27991/37963 [63:32:50<23:43:50,  8.57s/it]
 74%|███████▎  | 27992/37963 [63:32:58<22:55:35,  8.28s/it]
 74%|███████▎  | 27993/37963 [63:33:05<22:17:41,  8.05s/it]
 74%|███████▎  | 27994/37963 [63:33:13<22:08:53,  8.00s/it]
 74%|███████▎  | 27995/37963 [63:33:24<24:15:12,  8.76s/it]
 74%|███████▎  | 27996/37963 [63:33:31<23:06:16,  8.35s/it]
 74%|███████▎  | 27997/37963 [63:33:39<22:30:36,  8.13s/it]
 74%|███████▍  | 27998/37963 [63:33:46<21:57:15,  7.93s/it]
 74%|███████▍  | 27999/37963 [63:33:54<21:49:20,  7.88s/it]
 74%|███████▍  | 28000/37963 [63:34:05<24:09:27,  8.73s/it]
                                                           
{'loss': '0.1119', 'grad_norm': '1.756', 'learning_rate': '3.401e-06', 'epoch': '0.7376'}
+
 74%|███████▍  | 28000/37963 [63:34:05<24:09:27,  8.73s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.82s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.82s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 74%|███████▍  | 28001/37963 [63:35:02<64:09:57, 23.19s/it]
 74%|███████▍  | 28002/37963 [63:35:09<51:28:27, 18.60s/it]
 74%|███████▍  | 28003/37963 [63:35:17<42:24:56, 15.33s/it]
 74%|███████▍  | 28004/37963 [63:35:25<36:04:14, 13.04s/it]
 74%|███████▍  | 28005/37963 [63:35:33<31:37:34, 11.43s/it]
 74%|███████▍  | 28006/37963 [63:35:40<28:33:06, 10.32s/it]
 74%|███████▍  | 28007/37963 [63:35:48<26:38:08,  9.63s/it]
 74%|███████▍  | 28008/37963 [63:35:56<24:53:52,  9.00s/it]
 74%|███████▍  | 28009/37963 [63:36:04<23:50:11,  8.62s/it]
 74%|███████▍  | 28010/37963 [63:36:11<22:59:04,  8.31s/it]
                                                           
{'loss': '0.1141', 'grad_norm': '2.358', 'learning_rate': '3.394e-06', 'epoch': '0.7378'}
+
 74%|███████▍  | 28010/37963 [63:36:11<22:59:04,  8.31s/it]
 74%|███████▍  | 28011/37963 [63:36:19<22:29:48,  8.14s/it]
 74%|███████▍  | 28012/37963 [63:36:26<21:57:00,  7.94s/it]
 74%|███████▍  | 28013/37963 [63:36:34<21:51:24,  7.91s/it]
 74%|███████▍  | 28014/37963 [63:36:42<21:44:07,  7.86s/it]
 74%|███████▍  | 28015/37963 [63:36:50<21:45:59,  7.88s/it]
 74%|███████▍  | 28016/37963 [63:36:57<21:32:23,  7.80s/it]
 74%|███████▍  | 28017/37963 [63:37:05<21:26:37,  7.76s/it]
 74%|███████▍  | 28018/37963 [63:37:13<21:21:55,  7.73s/it]
 74%|███████▍  | 28019/37963 [63:37:20<21:11:02,  7.67s/it]
 74%|███████▍  | 28020/37963 [63:37:28<21:12:35,  7.68s/it]
                                                           
{'loss': '0.1123', 'grad_norm': '1.965', 'learning_rate': '3.388e-06', 'epoch': '0.7381'}
+
 74%|███████▍  | 28020/37963 [63:37:28<21:12:35,  7.68s/it]
 74%|███████▍  | 28021/37963 [63:37:36<21:18:35,  7.72s/it]
 74%|███████▍  | 28022/37963 [63:37:44<21:22:35,  7.74s/it]
 74%|███████▍  | 28023/37963 [63:37:51<21:20:03,  7.73s/it]
 74%|███████▍  | 28024/37963 [63:38:02<23:46:48,  8.61s/it]
 74%|███████▍  | 28025/37963 [63:38:12<25:04:06,  9.08s/it]
 74%|███████▍  | 28026/37963 [63:38:20<23:56:55,  8.68s/it]
 74%|███████▍  | 28027/37963 [63:38:28<23:09:53,  8.39s/it]
 74%|███████▍  | 28028/37963 [63:38:38<24:48:39,  8.99s/it]
 74%|███████▍  | 28029/37963 [63:38:46<23:43:21,  8.60s/it]
 74%|███████▍  | 28030/37963 [63:38:53<22:56:54,  8.32s/it]
                                                           
{'loss': '0.1133', 'grad_norm': '1.674', 'learning_rate': '3.381e-06', 'epoch': '0.7384'}
+
 74%|███████▍  | 28030/37963 [63:38:53<22:56:54,  8.32s/it]
 74%|███████▍  | 28031/37963 [63:39:01<22:30:41,  8.16s/it]
 74%|███████▍  | 28032/37963 [63:39:14<26:22:50,  9.56s/it]
 74%|███████▍  | 28033/37963 [63:39:22<24:56:26,  9.04s/it]
 74%|███████▍  | 28034/37963 [63:39:30<23:57:53,  8.69s/it]
 74%|███████▍  | 28035/37963 [63:39:37<22:54:03,  8.30s/it]
 74%|███████▍  | 28036/37963 [63:39:45<22:18:31,  8.09s/it]
 74%|███████▍  | 28037/37963 [63:39:52<21:55:54,  7.95s/it]
 74%|███████▍  | 28038/37963 [63:40:00<21:44:16,  7.88s/it]
 74%|███████▍  | 28039/37963 [63:40:10<23:45:22,  8.62s/it]
 74%|███████▍  | 28040/37963 [63:40:18<23:00:07,  8.34s/it]
                                                           
{'loss': '0.1182', 'grad_norm': '2.23', 'learning_rate': '3.375e-06', 'epoch': '0.7386'}
+
 74%|███████▍  | 28040/37963 [63:40:18<23:00:07,  8.34s/it]
 74%|███████▍  | 28041/37963 [63:40:28<24:24:33,  8.86s/it]
 74%|███████▍  | 28042/37963 [63:40:38<25:37:21,  9.30s/it]
 74%|███████▍  | 28043/37963 [63:40:46<24:30:49,  8.90s/it]
 74%|███████▍  | 28044/37963 [63:40:54<23:04:59,  8.38s/it]
 74%|███████▍  | 28045/37963 [63:41:01<22:33:48,  8.19s/it]
 74%|███████▍  | 28046/37963 [63:41:09<22:15:52,  8.08s/it]
 74%|███████▍  | 28047/37963 [63:41:17<22:02:28,  8.00s/it]
 74%|███████▍  | 28048/37963 [63:41:25<21:53:29,  7.95s/it]
 74%|███████▍  | 28049/37963 [63:41:33<21:46:34,  7.91s/it]
 74%|███████▍  | 28050/37963 [63:41:40<21:27:03,  7.79s/it]
                                                           
{'loss': '0.1239', 'grad_norm': '1.9', 'learning_rate': '3.369e-06', 'epoch': '0.7389'}
+
 74%|███████▍  | 28050/37963 [63:41:40<21:27:03,  7.79s/it]
 74%|███████▍  | 28051/37963 [63:41:48<21:13:38,  7.71s/it]
 74%|███████▍  | 28052/37963 [63:41:55<21:11:10,  7.70s/it]
 74%|███████▍  | 28053/37963 [63:42:03<21:10:53,  7.69s/it]
 74%|███████▍  | 28054/37963 [63:42:11<21:13:46,  7.71s/it]
 74%|███████▍  | 28055/37963 [63:42:18<21:06:38,  7.67s/it]
 74%|███████▍  | 28056/37963 [63:42:26<20:56:55,  7.61s/it]
 74%|███████▍  | 28057/37963 [63:42:34<21:03:28,  7.65s/it]
 74%|███████▍  | 28058/37963 [63:42:41<20:59:17,  7.63s/it]
 74%|███████▍  | 28059/37963 [63:42:49<20:57:11,  7.62s/it]
 74%|███████▍  | 28060/37963 [63:42:56<21:01:14,  7.64s/it]
                                                           
{'loss': '0.1181', 'grad_norm': '3.511', 'learning_rate': '3.362e-06', 'epoch': '0.7391'}
+
 74%|███████▍  | 28060/37963 [63:42:56<21:01:14,  7.64s/it]
 74%|███████▍  | 28061/37963 [63:43:04<20:56:47,  7.62s/it]
 74%|███████▍  | 28062/37963 [63:43:12<21:04:41,  7.66s/it]
 74%|███████▍  | 28063/37963 [63:43:20<21:20:02,  7.76s/it]
 74%|███████▍  | 28064/37963 [63:43:28<21:23:40,  7.78s/it]
 74%|███████▍  | 28065/37963 [63:43:35<21:21:43,  7.77s/it]
 74%|███████▍  | 28066/37963 [63:43:43<21:20:41,  7.76s/it]
 74%|███████▍  | 28067/37963 [63:43:51<21:22:47,  7.78s/it]
 74%|███████▍  | 28068/37963 [63:44:01<23:26:57,  8.53s/it]
 74%|███████▍  | 28069/37963 [63:44:09<22:39:48,  8.25s/it]
 74%|███████▍  | 28070/37963 [63:44:17<22:17:57,  8.11s/it]
                                                           
{'loss': '0.1334', 'grad_norm': '1.994', 'learning_rate': '3.356e-06', 'epoch': '0.7394'}
+
 74%|███████▍  | 28070/37963 [63:44:17<22:17:57,  8.11s/it]
 74%|███████▍  | 28071/37963 [63:44:24<21:54:18,  7.97s/it]
 74%|███████▍  | 28072/37963 [63:44:32<21:46:08,  7.92s/it]
 74%|███████▍  | 28073/37963 [63:44:40<21:40:01,  7.89s/it]
 74%|███████▍  | 28074/37963 [63:44:48<21:37:52,  7.87s/it]
 74%|███████▍  | 28075/37963 [63:44:55<21:32:25,  7.84s/it]
 74%|███████▍  | 28076/37963 [63:45:03<21:11:38,  7.72s/it]
 74%|███████▍  | 28077/37963 [63:45:14<23:42:04,  8.63s/it]
 74%|███████▍  | 28078/37963 [63:45:24<25:19:32,  9.22s/it]
 74%|███████▍  | 28079/37963 [63:45:32<24:06:41,  8.78s/it]
 74%|███████▍  | 28080/37963 [63:45:43<25:33:12,  9.31s/it]
                                                           
{'loss': '0.1268', 'grad_norm': '2.472', 'learning_rate': '3.35e-06', 'epoch': '0.7397'}
+
 74%|██████��▍  | 28080/37963 [63:45:43<25:33:12,  9.31s/it]
 74%|███████▍  | 28081/37963 [63:45:50<24:21:36,  8.87s/it]
 74%|███████▍  | 28082/37963 [63:45:58<23:24:18,  8.53s/it]
 74%|███████▍  | 28083/37963 [63:46:06<22:38:04,  8.25s/it]
 74%|███████▍  | 28084/37963 [63:46:14<22:17:53,  8.13s/it]
 74%|███████▍  | 28085/37963 [63:46:21<22:00:56,  8.02s/it]
 74%|███████▍  | 28086/37963 [63:46:32<24:02:09,  8.76s/it]
 74%|███████▍  | 28087/37963 [63:46:42<25:09:22,  9.17s/it]
 74%|███████▍  | 28088/37963 [63:46:50<23:53:08,  8.71s/it]
 74%|███████▍  | 28089/37963 [63:46:57<23:11:41,  8.46s/it]
 74%|███████▍  | 28090/37963 [63:47:08<25:03:03,  9.13s/it]
                                                           
{'loss': '0.1217', 'grad_norm': '2.088', 'learning_rate': '3.343e-06', 'epoch': '0.7399'}
+
 74%|███████▍  | 28090/37963 [63:47:08<25:03:03,  9.13s/it]
 74%|███████▍  | 28091/37963 [63:47:16<23:54:15,  8.72s/it]
 74%|███████▍  | 28092/37963 [63:47:24<23:04:04,  8.41s/it]
 74%|███████▍  | 28093/37963 [63:47:31<22:11:37,  8.10s/it]
 74%|███████▍  | 28094/37963 [63:47:39<21:45:37,  7.94s/it]
 74%|███████▍  | 28095/37963 [63:47:46<21:40:37,  7.91s/it]
 74%|███████▍  | 28096/37963 [63:47:54<21:19:52,  7.78s/it]
 74%|███████▍  | 28097/37963 [63:48:02<21:36:52,  7.89s/it]
 74%|███████▍  | 28098/37963 [63:48:10<21:24:23,  7.81s/it]
 74%|███████▍  | 28099/37963 [63:48:17<21:20:17,  7.79s/it]
 74%|███████▍  | 28100/37963 [63:48:25<21:17:08,  7.77s/it]
                                                           
{'loss': '0.115', 'grad_norm': '2.136', 'learning_rate': '3.337e-06', 'epoch': '0.7402'}
+
 74%|███████▍  | 28100/37963 [63:48:25<21:17:08,  7.77s/it]
 74%|███████▍  | 28101/37963 [63:48:33<21:18:29,  7.78s/it]
 74%|███████▍  | 28102/37963 [63:48:41<21:22:18,  7.80s/it]
 74%|███████▍  | 28103/37963 [63:48:48<21:05:43,  7.70s/it]
 74%|███████▍  | 28104/37963 [63:48:56<20:49:04,  7.60s/it]
 74%|███████▍  | 28105/37963 [63:49:03<20:56:57,  7.65s/it]
 74%|███████▍  | 28106/37963 [63:49:11<20:44:35,  7.58s/it]
 74%|███████▍  | 28107/37963 [63:49:19<20:55:52,  7.65s/it]
 74%|███████▍  | 28108/37963 [63:49:26<21:03:18,  7.69s/it]
 74%|███████▍  | 28109/37963 [63:49:34<21:06:15,  7.71s/it]
 74%|███████▍  | 28110/37963 [63:49:42<21:11:28,  7.74s/it]
                                                           
{'loss': '0.1196', 'grad_norm': '3.193', 'learning_rate': '3.33e-06', 'epoch': '0.7405'}
+
 74%|███████▍  | 28110/37963 [63:49:42<21:11:28,  7.74s/it]
 74%|███████▍  | 28111/37963 [63:49:49<21:03:45,  7.70s/it]
 74%|███████▍  | 28112/37963 [63:49:58<21:20:08,  7.80s/it]
 74%|███████▍  | 28113/37963 [63:50:05<21:03:33,  7.70s/it]
 74%|███████▍  | 28114/37963 [63:50:13<21:12:20,  7.75s/it]
 74%|███████▍  | 28115/37963 [63:50:21<21:11:55,  7.75s/it]
 74%|███████▍  | 28116/37963 [63:50:31<23:09:04,  8.46s/it]
 74%|███████▍  | 28117/37963 [63:50:38<22:29:27,  8.22s/it]
 74%|███████▍  | 28118/37963 [63:50:46<22:07:52,  8.09s/it]
 74%|███████▍  | 28119/37963 [63:50:54<21:49:19,  7.98s/it]
 74%|███████▍  | 28120/37963 [63:51:02<21:41:22,  7.93s/it]
                                                           
{'loss': '0.1169', 'grad_norm': '1.897', 'learning_rate': '3.324e-06', 'epoch': '0.7407'}
+
 74%|███████▍  | 28120/37963 [63:51:02<21:41:22,  7.93s/it]
 74%|███████▍  | 28121/37963 [63:51:09<21:25:32,  7.84s/it]
 74%|███████▍  | 28122/37963 [63:51:17<21:20:56,  7.81s/it]
 74%|███████▍  | 28123/37963 [63:51:25<21:29:24,  7.86s/it]
 74%|███████▍  | 28124/37963 [63:51:33<21:23:30,  7.83s/it]
 74%|███████▍  | 28125/37963 [63:51:41<21:32:48,  7.88s/it]
 74%|███████▍  | 28126/37963 [63:51:48<21:21:10,  7.81s/it]
 74%|███████▍  | 28127/37963 [63:51:56<21:15:33,  7.78s/it]
 74%|███████▍  | 28128/37963 [63:52:07<23:30:04,  8.60s/it]
 74%|███████▍  | 28129/37963 [63:52:14<22:46:06,  8.34s/it]
 74%|███████▍  | 28130/37963 [63:52:25<24:51:55,  9.10s/it]
                                                           
{'loss': '0.1131', 'grad_norm': '1.678', 'learning_rate': '3.318e-06', 'epoch': '0.741'}
+
 74%|███████▍  | 28130/37963 [63:52:25<24:51:55,  9.10s/it]
 74%|███████▍  | 28131/37963 [63:52:33<23:42:27,  8.68s/it]
 74%|███████▍  | 28132/37963 [63:52:43<25:08:40,  9.21s/it]
 74%|███████▍  | 28133/37963 [63:52:57<28:21:44, 10.39s/it]
 74%|███████▍  | 28134/37963 [63:53:04<26:10:45,  9.59s/it]
 74%|███████▍  | 28135/37963 [63:53:12<24:33:49,  9.00s/it]
 74%|███████▍  | 28136/37963 [63:53:20<23:23:49,  8.57s/it]
 74%|███████▍  | 28137/37963 [63:53:27<22:53:03,  8.38s/it]
 74%|███████▍  | 28138/37963 [63:53:35<22:33:08,  8.26s/it]
 74%|███████▍  | 28139/37963 [63:53:43<22:01:26,  8.07s/it]
 74%|███████▍  | 28140/37963 [63:53:51<21:51:51,  8.01s/it]
                                                           
{'loss': '0.1115', 'grad_norm': '2.458', 'learning_rate': '3.311e-06', 'epoch': '0.7413'}
+
 74%|███████▍  | 28140/37963 [63:53:51<21:51:51,  8.01s/it]
 74%|███████▍  | 28141/37963 [63:54:01<23:30:47,  8.62s/it]
 74%|███████▍  | 28142/37963 [63:54:09<22:40:43,  8.31s/it]
 74%|███████▍  | 28143/37963 [63:54:19<24:11:33,  8.87s/it]
 74%|███████▍  | 28144/37963 [63:54:27<23:19:32,  8.55s/it]
 74%|███████▍  | 28145/37963 [63:54:34<22:39:45,  8.31s/it]
 74%|███████▍  | 28146/37963 [63:54:42<22:12:14,  8.14s/it]
 74%|███████▍  | 28147/37963 [63:54:50<22:00:03,  8.07s/it]
 74%|███████▍  | 28148/37963 [63:54:58<21:43:58,  7.97s/it]
 74%|███████▍  | 28149/37963 [63:55:06<21:39:56,  7.95s/it]
 74%|███████▍  | 28150/37963 [63:55:13<21:27:17,  7.87s/it]
                                                           
{'loss': '0.1059', 'grad_norm': '4.003', 'learning_rate': '3.305e-06', 'epoch': '0.7415'}
+
 74%|███████▍  | 28150/37963 [63:55:13<21:27:17,  7.87s/it]
 74%|███████▍  | 28151/37963 [63:55:21<21:29:48,  7.89s/it]
 74%|███████▍  | 28152/37963 [63:55:29<21:08:19,  7.76s/it]
 74%|███████▍  | 28153/37963 [63:55:36<21:02:28,  7.72s/it]
 74%|███████▍  | 28154/37963 [63:55:44<20:56:53,  7.69s/it]
 74%|███████▍  | 28155/37963 [63:55:52<21:00:14,  7.71s/it]
 74%|███████▍  | 28156/37963 [63:56:00<21:21:22,  7.84s/it]
 74%|███████▍  | 28157/37963 [63:56:07<20:58:14,  7.70s/it]
 74%|███████▍  | 28158/37963 [63:56:15<20:52:35,  7.67s/it]
 74%|███████▍  | 28159/37963 [63:56:23<21:01:19,  7.72s/it]
 74%|███████▍  | 28160/37963 [63:56:30<21:02:33,  7.73s/it]
                                                           
{'loss': '0.1133', 'grad_norm': '2.975', 'learning_rate': '3.299e-06', 'epoch': '0.7418'}
+
 74%|███████▍  | 28160/37963 [63:56:30<21:02:33,  7.73s/it]
 74%|███████▍  | 28161/37963 [63:56:38<20:58:20,  7.70s/it]
 74%|███████▍  | 28162/37963 [63:56:46<20:51:18,  7.66s/it]
 74%|███████▍  | 28163/37963 [63:56:53<21:02:23,  7.73s/it]
 74%|███████▍  | 28164/37963 [63:57:04<23:19:22,  8.57s/it]
 74%|███████▍  | 28165/37963 [63:57:12<22:38:05,  8.32s/it]
 74%|███████▍  | 28166/37963 [63:57:19<22:04:30,  8.11s/it]
 74%|███████▍  | 28167/37963 [63:57:27<21:57:10,  8.07s/it]
 74%|███████▍  | 28168/37963 [63:57:35<21:52:09,  8.04s/it]
 74%|███████▍  | 28169/37963 [63:57:43<21:42:37,  7.98s/it]
 74%|███████▍  | 28170/37963 [63:57:51<21:30:26,  7.91s/it]
                                                           
{'loss': '0.1186', 'grad_norm': '4.339', 'learning_rate': '3.292e-06', 'epoch': '0.742'}
+
 74%|███████▍  | 28170/37963 [63:57:51<21:30:26,  7.91s/it]
 74%|███████▍  | 28171/37963 [63:57:59<21:23:51,  7.87s/it]
 74%|███████▍  | 28172/37963 [63:58:06<21:09:53,  7.78s/it]
 74%|███████▍  | 28173/37963 [63:58:14<21:01:00,  7.73s/it]
 74%|███████▍  | 28174/37963 [63:58:21<20:47:37,  7.65s/it]
 74%|███████▍  | 28175/37963 [63:58:29<21:03:29,  7.75s/it]
 74%|███████▍  | 28176/37963 [63:58:37<21:03:34,  7.75s/it]
 74%|███████▍  | 28177/37963 [63:58:45<21:05:33,  7.76s/it]
 74%|███████▍  | 28178/37963 [63:58:53<21:04:07,  7.75s/it]
 74%|███████▍  | 28179/37963 [63:59:01<21:20:19,  7.85s/it]
 74%|███████▍  | 28180/37963 [63:59:11<23:27:23,  8.63s/it]
                                                           
{'loss': '0.1198', 'grad_norm': '1.753', 'learning_rate': '3.286e-06', 'epoch': '0.7423'}
+
 74%|███████▍  | 28180/37963 [63:59:11<23:27:23,  8.63s/it]
 74%|███████▍  | 28181/37963 [63:59:19<22:31:52,  8.29s/it]
 74%|███████▍  | 28182/37963 [63:59:26<22:03:11,  8.12s/it]
 74%|███████▍  | 28183/37963 [63:59:34<21:52:06,  8.05s/it]
 74%|███████▍  | 28184/37963 [63:59:45<23:51:56,  8.79s/it]
 74%|█���█████▍  | 28185/37963 [63:59:53<23:08:55,  8.52s/it]
 74%|███████▍  | 28186/37963 [64:00:06<26:57:44,  9.93s/it]
 74%|███████▍  | 28187/37963 [64:00:16<27:30:41, 10.13s/it]
 74%|███████▍  | 28188/37963 [64:00:24<25:49:55,  9.51s/it]
 74%|███████▍  | 28189/37963 [64:00:32<24:19:29,  8.96s/it]
 74%|███████▍  | 28190/37963 [64:00:40<23:14:36,  8.56s/it]
                                                           
{'loss': '0.1268', 'grad_norm': '3.852', 'learning_rate': '3.28e-06', 'epoch': '0.7426'}
+
 74%|███████▍  | 28190/37963 [64:00:40<23:14:36,  8.56s/it]
 74%|███████▍  | 28191/37963 [64:00:50<24:47:02,  9.13s/it]
 74%|███████▍  | 28192/37963 [64:00:58<23:40:07,  8.72s/it]
 74%|███████▍  | 28193/37963 [64:01:06<22:46:09,  8.39s/it]
 74%|███████▍  | 28194/37963 [64:01:13<21:45:48,  8.02s/it]
 74%|███████▍  | 28195/37963 [64:01:23<23:34:31,  8.69s/it]
 74%|███████▍  | 28196/37963 [64:01:31<22:54:19,  8.44s/it]
 74%|███████▍  | 28197/37963 [64:01:39<22:15:56,  8.21s/it]
 74%|███████▍  | 28198/37963 [64:01:46<22:04:10,  8.14s/it]
 74%|███████▍  | 28199/37963 [64:01:54<21:53:51,  8.07s/it]
 74%|███████▍  | 28200/37963 [64:02:02<21:51:09,  8.06s/it]
                                                           
{'loss': '0.112', 'grad_norm': '2.648', 'learning_rate': '3.273e-06', 'epoch': '0.7428'}
+
 74%|███████▍  | 28200/37963 [64:02:02<21:51:09,  8.06s/it]
 74%|███████▍  | 28201/37963 [64:02:10<21:27:16,  7.91s/it]
 74%|███████▍  | 28202/37963 [64:02:18<21:15:13,  7.84s/it]
 74%|███████▍  | 28203/37963 [64:02:25<21:05:28,  7.78s/it]
 74%|███████▍  | 28204/37963 [64:02:33<20:46:09,  7.66s/it]
 74%|███████▍  | 28205/37963 [64:02:40<20:36:48,  7.60s/it]
 74%|███████▍  | 28206/37963 [64:02:48<20:42:09,  7.64s/it]
 74%|███████▍  | 28207/37963 [64:02:56<20:40:42,  7.63s/it]
 74%|███████▍  | 28208/37963 [64:03:06<22:46:29,  8.40s/it]
 74%|███████▍  | 28209/37963 [64:03:13<22:08:08,  8.17s/it]
 74%|███████▍  | 28210/37963 [64:03:21<21:37:41,  7.98s/it]
                                                           
{'loss': '0.1253', 'grad_norm': '2.195', 'learning_rate': '3.267e-06', 'epoch': '0.7431'}
+
 74%|███████▍  | 28210/37963 [64:03:21<21:37:41,  7.98s/it]
 74%|███████▍  | 28211/37963 [64:03:29<21:30:39,  7.94s/it]
 74%|███████▍  | 28212/37963 [64:03:37<21:25:41,  7.91s/it]
 74%|███████▍  | 28213/37963 [64:03:44<21:14:19,  7.84s/it]
 74%|███████▍  | 28214/37963 [64:03:52<21:17:09,  7.86s/it]
 74%|███████▍  | 28215/37963 [64:04:00<21:15:14,  7.85s/it]
 74%|███████▍  | 28216/37963 [64:04:08<21:12:30,  7.83s/it]
 74%|███████▍  | 28217/37963 [64:04:15<21:02:09,  7.77s/it]
 74%|███████▍  | 28218/37963 [64:04:23<20:42:07,  7.65s/it]
 74%|███████▍  | 28219/37963 [64:04:31<20:59:04,  7.75s/it]
 74%|███████▍  | 28220/37963 [64:04:38<20:54:21,  7.72s/it]
                                                           
{'loss': '0.1113', 'grad_norm': '1.825', 'learning_rate': '3.261e-06', 'epoch': '0.7434'}
+
 74%|███████▍  | 28220/37963 [64:04:38<20:54:21,  7.72s/it]
 74%|███████▍  | 28221/37963 [64:04:46<21:03:47,  7.78s/it]
 74%|███████▍  | 28222/37963 [64:04:54<21:03:12,  7.78s/it]
 74%|███████▍  | 28223/37963 [64:05:02<21:01:27,  7.77s/it]
 74%|███████▍  | 28224/37963 [64:05:10<20:59:43,  7.76s/it]
 74%|███████▍  | 28225/37963 [64:05:17<20:52:42,  7.72s/it]
 74%|███████▍  | 28226/37963 [64:05:25<20:45:53,  7.68s/it]
 74%|███████▍  | 28227/37963 [64:05:36<23:19:24,  8.62s/it]
 74%|███████▍  | 28228/37963 [64:05:43<22:41:49,  8.39s/it]
 74%|███████▍  | 28229/37963 [64:05:51<22:05:57,  8.17s/it]
 74%|███████▍  | 28230/37963 [64:06:02<24:02:00,  8.89s/it]
                                                           
{'loss': '0.1271', 'grad_norm': '2.673', 'learning_rate': '3.255e-06', 'epoch': '0.7436'}
+
 74%|███████▍  | 28230/37963 [64:06:02<24:02:00,  8.89s/it]
 74%|███████▍  | 28231/37963 [64:06:10<23:12:13,  8.58s/it]
 74%|███████▍  | 28232/37963 [64:06:17<22:35:16,  8.36s/it]
 74%|███████▍  | 28233/37963 [64:06:25<22:03:00,  8.16s/it]
 74%|███████▍  | 28234/37963 [64:06:36<24:01:22,  8.89s/it]
 74%|███████▍  | 28235/37963 [64:06:44<23:10:03,  8.57s/it]
 74%|███████▍  | 28236/37963 [64:06:52<22:40:35,  8.39s/it]
 74%|███████▍  | 28237/37963 [64:06:59<22:07:22,  8.19s/it]
 74%|███████▍  | 28238/37963 [64:07:10<23:55:17,  8.86s/it]
 74%|███████▍  | 28239/37963 [64:07:20<24:58:28,  9.25s/it]
 74%|███████▍  | 28240/37963 [64:07:31<26:15:37,  9.72s/it]
                                                           
{'loss': '0.1036', 'grad_norm': '2.098', 'learning_rate': '3.248e-06', 'epoch': '0.7439'}
+
 74%|███████▍  | 28240/37963 [64:07:31<26:15:37,  9.72s/it]
 74%|███████▍  | 28241/37963 [64:07:38<24:45:51,  9.17s/it]
 74%|███████▍  | 28242/37963 [64:07:49<26:08:32,  9.68s/it]
 74%|███████▍  | 28243/37963 [64:07:57<24:18:45,  9.00s/it]
 74%|███████▍  | 28244/37963 [64:08:04<23:14:58,  8.61s/it]
 74%|███████▍  | 28245/37963 [64:08:12<22:41:42,  8.41s/it]
 74%|███████▍  | 28246/37963 [64:08:20<22:13:40,  8.24s/it]
 74%|███████▍  | 28247/37963 [64:08:28<21:50:20,  8.09s/it]
 74%|███████▍  | 28248/37963 [64:08:36<21:33:52,  7.99s/it]
 74%|███████▍  | 28249/37963 [64:08:43<21:16:42,  7.89s/it]
 74%|███████▍  | 28250/37963 [64:08:51<21:02:07,  7.80s/it]
                                                           
{'loss': '0.114', 'grad_norm': '1.845', 'learning_rate': '3.242e-06', 'epoch': '0.7441'}
+
 74%|███████▍  | 28250/37963 [64:08:51<21:02:07,  7.80s/it]
 74%|███████▍  | 28251/37963 [64:08:59<20:57:07,  7.77s/it]
 74%|███████▍  | 28252/37963 [64:09:06<20:50:21,  7.73s/it]
 74%|███████▍  | 28253/37963 [64:09:14<20:52:22,  7.74s/it]
 74%|███████▍  | 28254/37963 [64:09:22<21:00:57,  7.79s/it]
 74%|███████▍  | 28255/37963 [64:09:30<20:52:31,  7.74s/it]
 74%|███████▍  | 28256/37963 [64:09:37<20:35:08,  7.63s/it]
 74%|███████▍  | 28257/37963 [64:09:45<20:40:52,  7.67s/it]
 74%|███████▍  | 28258/37963 [64:09:53<20:44:47,  7.70s/it]
 74%|███████▍  | 28259/37963 [64:10:00<20:43:06,  7.69s/it]
 74%|███████▍  | 28260/37963 [64:10:08<20:51:52,  7.74s/it]
                                                           
{'loss': '0.121', 'grad_norm': '2.063', 'learning_rate': '3.236e-06', 'epoch': '0.7444'}
+
 74%|███████▍  | 28260/37963 [64:10:08<20:51:52,  7.74s/it]
 74%|███████▍  | 28261/37963 [64:10:16<20:47:44,  7.72s/it]
 74%|███████▍  | 28262/37963 [64:10:26<22:58:01,  8.52s/it]
 74%|███████▍  | 28263/37963 [64:10:34<22:13:07,  8.25s/it]
 74%|███████▍  | 28264/37963 [64:10:41<21:44:29,  8.07s/it]
 74%|███████▍  | 28265/37963 [64:10:49<21:26:30,  7.96s/it]
 74%|███████▍  | 28266/37963 [64:10:57<21:09:52,  7.86s/it]
 74%|███████▍  | 28267/37963 [64:11:04<21:00:43,  7.80s/it]
 74%|███████▍  | 28268/37963 [64:11:12<20:54:37,  7.76s/it]
 74%|███████▍  | 28269/37963 [64:11:20<20:43:50,  7.70s/it]
 74%|███████▍  | 28270/37963 [64:11:27<20:40:25,  7.68s/it]
                                                           
{'loss': '0.1067', 'grad_norm': '2.083', 'learning_rate': '3.229e-06', 'epoch': '0.7447'}
+
 74%|███████▍  | 28270/37963 [64:11:27<20:40:25,  7.68s/it]
 74%|███████▍  | 28271/37963 [64:11:35<20:47:24,  7.72s/it]
 74%|███████▍  | 28272/37963 [64:11:43<21:00:16,  7.80s/it]
 74%|███████▍  | 28273/37963 [64:11:54<23:15:00,  8.64s/it]
 74%|███████▍  | 28274/37963 [64:12:01<22:36:43,  8.40s/it]
 74%|███████▍  | 28275/37963 [64:12:09<22:14:14,  8.26s/it]
 74%|███████▍  | 28276/37963 [64:12:17<21:53:20,  8.13s/it]
 74%|███████▍  | 28277/37963 [64:12:25<21:35:51,  8.03s/it]
 74%|███████▍  | 28278/37963 [64:12:33<21:23:31,  7.95s/it]
 74%|███████▍  | 28279/37963 [64:12:41<21:15:38,  7.90s/it]
 74%|███████▍  | 28280/37963 [64:12:48<21:04:39,  7.84s/it]
                                                           
{'loss': '0.1101', 'grad_norm': '1.788', 'learning_rate': '3.223e-06', 'epoch': '0.7449'}
+
 74%|███████▍  | 28280/37963 [64:12:48<21:04:39,  7.84s/it]
 74%|███████▍  | 28281/37963 [64:12:55<20:32:46,  7.64s/it]
 74%|███████▍  | 28282/37963 [64:13:06<22:59:29,  8.55s/it]
 75%|███████▍  | 28283/37963 [64:13:16<24:25:56,  9.09s/it]
 75%|███████▍  | 28284/37963 [64:13:24<23:17:56,  8.67s/it]
 75%|███████▍  | 28285/37963 [64:13:37<26:50:58,  9.99s/it]
 75%|███████▍  | 28286/37963 [64:13:45<25:12:00,  9.37s/it]
 75%|███████▍  | 28287/37963 [64:13:53<23:43:06,  8.82s/it]
 75%|███████▍  | 28288/37963 [64:14:03<25:07:02,  9.35s/it]
 75%|███████▍  | 28289/37963 [64:14:11<23:28:44,  8.74s/it]
 75%|███████▍  | 28290/37963 [64:14:18<22:19:48,  8.31s/it]
                                                           
{'loss': '0.1163', 'grad_norm': '3.307', 'learning_rate': '3.217e-06', 'epoch': '0.7452'}
+
 75%|███████▍  | 28290/37963 [64:14:18<22:19:48,  8.31s/it]
 75%|███████▍  | 28291/37963 [64:14:26<21:59:36,  8.19s/it]
 75%|███████▍  | 28292/37963 [64:14:34<21:41:17,  8.07s/it]
 75%|███████▍  | 28293/37963 [64:14:42<21:38:23,  8.06s/it]
 75%|███████▍  | 28294/37963 [64:14:49<21:09:33,  7.88s/it]
 75%|███████▍  | 28295/37963 [64:14:57<20:57:33,  7.80s/it]
 75%|███████▍  | 28296/37963 [64:15:07<23:15:45,  8.66s/it]
 75%|███████▍  | 28297/37963 [64:15:15<22:33:17,  8.40s/it]
 75%|███████▍  | 28298/37963 [64:15:23<21:57:19,  8.18s/it]
 75%|███████▍  | 28299/37963 [64:15:30<21:27:07,  7.99s/it]
 75%|███████▍  | 28300/37963 [64:15:38<20:51:42,  7.77s/it]
                                                           
{'loss': '0.1171', 'grad_norm': '4.599', 'learning_rate': '3.211e-06', 'epoch': '0.7455'}
+
 75%|███████▍  | 28300/37963 [64:15:38<20:51:42,  7.77s/it]
 75%|███████▍  | 28301/37963 [64:15:45<20:51:10,  7.77s/it]
 75%|███████▍  | 28302/37963 [64:15:53<20:46:11,  7.74s/it]
 75%|███████▍  | 28303/37963 [64:16:01<20:39:27,  7.70s/it]
 75%|███████▍  | 28304/37963 [64:16:08<20:33:33,  7.66s/it]
 75%|███████▍  | 28305/37963 [64:16:16<20:50:07,  7.77s/it]
 75%|███████▍  | 28306/37963 [64:16:24<20:52:27,  7.78s/it]
 75%|███████▍  | 28307/37963 [64:16:32<20:42:52,  7.72s/it]
 75%|███████▍  | 28308/37963 [64:16:39<20:37:24,  7.69s/it]
 75%|███████▍  | 28309/37963 [64:16:47<20:35:08,  7.68s/it]
 75%|███████▍  | 28310/37963 [64:16:55<20:41:27,  7.72s/it]
                                                           
{'loss': '0.1251', 'grad_norm': '2.559', 'learning_rate': '3.204e-06', 'epoch': '0.7457'}
+
 75%|███████▍  | 28310/37963 [64:16:55<20:41:27,  7.72s/it]
 75%|███████▍  | 28311/37963 [64:17:05<22:52:51,  8.53s/it]
 75%|███████▍  | 28312/37963 [64:17:13<22:15:51,  8.31s/it]
 75%|███████▍  | 28313/37963 [64:17:20<21:37:51,  8.07s/it]
 75%|███████▍  | 28314/37963 [64:17:28<21:26:29,  8.00s/it]
 75%|███████▍  | 28315/37963 [64:17:36<21:30:31,  8.03s/it]
 75%|███████▍  | 28316/37963 [64:17:44<21:20:41,  7.97s/it]
 75%|███████▍  | 28317/37963 [64:17:52<21:05:33,  7.87s/it]
 75%|███████▍  | 28318/37963 [64:18:00<21:02:11,  7.85s/it]
 75%|███████▍  | 28319/37963 [64:18:08<21:02:55,  7.86s/it]
 75%|███████▍  | 28320/37963 [64:18:15<20:51:02,  7.78s/it]
                                                           
{'loss': '0.1212', 'grad_norm': '2.341', 'learning_rate': '3.198e-06', 'epoch': '0.746'}
+
 75%|███████▍  | 28320/37963 [64:18:15<20:51:02,  7.78s/it]
 75%|███████▍  | 28321/37963 [64:18:23<20:47:18,  7.76s/it]
 75%|███████▍  | 28322/37963 [64:18:31<20:59:18,  7.84s/it]
 75%|███████▍  | 28323/37963 [64:18:38<20:32:50,  7.67s/it]
 75%|███████▍  | 28324/37963 [64:18:46<20:33:53,  7.68s/it]
 75%|███████▍  | 28325/37963 [64:18:53<20:26:50,  7.64s/it]
 75%|███████▍  | 28326/37963 [64:19:01<20:41:45,  7.73s/it]
 75%|███████▍  | 28327/37963 [64:19:12<22:50:12,  8.53s/it]
 75%|███████▍  | 28328/37963 [64:19:20<22:18:42,  8.34s/it]
 75%|███████▍  | 28329/37963 [64:19:27<21:50:18,  8.16s/it]
 75%|███████▍  | 28330/37963 [64:19:35<21:33:43,  8.06s/it]
                                                           
{'loss': '0.1257', 'grad_norm': '2.065', 'learning_rate': '3.192e-06', 'epoch': '0.7463'}
+
 75%|███████▍  | 28330/37963 [64:19:35<21:33:43,  8.06s/it]
 75%|███████▍  | 28331/37963 [64:19:45<23:20:01,  8.72s/it]
 75%|███████▍  | 28332/37963 [64:19:53<22:23:23,  8.37s/it]
 75%|███████▍  | 28333/37963 [64:20:06<26:09:43,  9.78s/it]
 75%|███████▍  | 28334/37963 [64:20:14<24:39:02,  9.22s/it]
 75%|███████▍  | 28335/37963 [64:20:22<23:35:40,  8.82s/it]
 75%|███████▍  | 28336/37963 [64:20:32<24:52:31,  9.30s/it]
 75%|███████▍  | 28337/37963 [64:20:43<25:49:49,  9.66s/it]
 75%|███████▍  | 28338/37963 [64:20:51<24:15:09,  9.07s/it]
 75%|███████▍  | 28339/37963 [64:20:58<23:07:58,  8.65s/it]
 75%|███████▍  | 28340/37963 [64:21:09<24:38:18,  9.22s/it]
                                                           
{'loss': '0.1288', 'grad_norm': '2.001', 'learning_rate': '3.186e-06', 'epoch': '0.7465'}
+
 75%|███████▍  | 28340/37963 [64:21:09<24:38:18,  9.22s/it]
 75%|███████▍  | 28341/37963 [64:21:17<23:34:50,  8.82s/it]
 75%|███████▍  | 28342/37963 [64:21:24<22:44:55,  8.51s/it]
 75%|███████▍  | 28343/37963 [64:21:32<21:54:29,  8.20s/it]
 75%|███████▍  | 28344/37963 [64:21:39<21:18:26,  7.97s/it]
 75%|███████▍  | 28345/37963 [64:21:47<20:59:39,  7.86s/it]
 75%|███████▍  | 28346/37963 [64:21:55<20:54:13,  7.83s/it]
 75%|███████▍  | 28347/37963 [64:22:02<20:45:40,  7.77s/it]
 75%|███████▍  | 28348/37963 [64:22:10<20:45:31,  7.77s/it]
 75%|███████▍  | 28349/37963 [64:22:18<20:49:35,  7.80s/it]
 75%|███████▍  | 28350/37963 [64:22:26<20:53:00,  7.82s/it]
                                                           
{'loss': '0.1334', 'grad_norm': '2.369', 'learning_rate': '3.179e-06', 'epoch': '0.7468'}
+
 75%|███████▍  | 28350/37963 [64:22:26<20:53:00,  7.82s/it]
 75%|███████▍  | 28351/37963 [64:22:34<20:50:53,  7.81s/it]
 75%|███████▍  | 28352/37963 [64:22:41<20:46:47,  7.78s/it]
 75%|███████▍  | 28353/37963 [64:22:49<20:44:18,  7.77s/it]
 75%|███████▍  | 28354/37963 [64:22:57<20:43:33,  7.76s/it]
 75%|███████▍  | 28355/37963 [64:23:05<20:51:53,  7.82s/it]
 75%|███████▍  | 28356/37963 [64:23:13<20:54:07,  7.83s/it]
 75%|███████▍  | 28357/37963 [64:23:20<20:35:50,  7.72s/it]
 75%|███████▍  | 28358/37963 [64:23:28<20:44:14,  7.77s/it]
 75%|███████▍  | 28359/37963 [64:23:38<22:46:23,  8.54s/it]
 75%|███████▍  | 28360/37963 [64:23:46<22:05:50,  8.28s/it]
                                                           
{'loss': '0.1141', 'grad_norm': '2.061', 'learning_rate': '3.173e-06', 'epoch': '0.747'}
+
 75%|███████▍  | 28360/37963 [64:23:46<22:05:50,  8.28s/it]
 75%|███████▍  | 28361/37963 [64:23:53<21:26:31,  8.04s/it]
 75%|███████▍  | 28362/37963 [64:24:01<21:19:15,  7.99s/it]
 75%|███████▍  | 28363/37963 [64:24:09<20:54:27,  7.84s/it]
 75%|███████▍  | 28364/37963 [64:24:17<20:47:46,  7.80s/it]
 75%|███████▍  | 28365/37963 [64:24:24<20:45:26,  7.79s/it]
 75%|███████▍  | 28366/37963 [64:24:32<20:40:53,  7.76s/it]
 75%|███████▍  | 28367/37963 [64:24:40<20:35:49,  7.73s/it]
 75%|███████▍  | 28368/37963 [64:24:47<20:29:04,  7.69s/it]
 75%|███████▍  | 28369/37963 [64:24:55<20:22:14,  7.64s/it]
 75%|███████▍  | 28370/37963 [64:25:03<20:33:30,  7.72s/it]
                                                           
{'loss': '0.116', 'grad_norm': '2.584', 'learning_rate': '3.167e-06', 'epoch': '0.7473'}
+
 75%|███████▍  | 28370/37963 [64:25:03<20:33:30,  7.72s/it]
 75%|███████▍  | 28371/37963 [64:25:10<20:28:45,  7.69s/it]
 75%|███████▍  | 28372/37963 [64:25:18<20:18:25,  7.62s/it]
 75%|███████▍  | 28373/37963 [64:25:25<20:12:48,  7.59s/it]
 75%|███████▍  | 28374/37963 [64:25:33<20:07:16,  7.55s/it]
 75%|███████▍  | 28375/37963 [64:25:43<22:27:52,  8.43s/it]
 75%|███████▍  | 28376/37963 [64:25:51<21:55:36,  8.23s/it]
 75%|███████▍  | 28377/37963 [64:26:01<23:35:14,  8.86s/it]
 75%|███████▍  | 28378/37963 [64:26:09<22:40:26,  8.52s/it]
 75%|███████▍  | 28379/37963 [64:26:19<23:57:26,  9.00s/it]
 75%|███████▍  | 28380/37963 [64:26:27<22:49:56,  8.58s/it]
                                                           
{'loss': '0.1267', 'grad_norm': '1.823', 'learning_rate': '3.161e-06', 'epoch': '0.7476'}
+
 75%|███████▍  | 28380/37963 [64:26:27<22:49:56,  8.58s/it]
 75%|███████▍  | 28381/37963 [64:26:37<24:21:43,  9.15s/it]
 75%|███████▍  | 28382/37963 [64:26:45<23:08:58,  8.70s/it]
 75%|███████▍  | 28383/37963 [64:26:56<24:43:10,  9.29s/it]
 75%|███████▍  | 28384/37963 [64:27:03<23:21:50,  8.78s/it]
 75%|███████▍  | 28385/37963 [64:27:11<22:31:27,  8.47s/it]
 75%|███████▍  | 28386/37963 [64:27:19<21:56:33,  8.25s/it]
 75%|███████▍  | 28387/37963 [64:27:26<21:27:09,  8.06s/it]
 75%|███████▍  | 28388/37963 [64:27:34<21:09:18,  7.95s/it]
 75%|███████▍  | 28389/37963 [64:27:45<23:21:52,  8.79s/it]
 75%|███████▍  | 28390/37963 [64:27:52<22:27:18,  8.44s/it]
                                                           
{'loss': '0.1072', 'grad_norm': '2.988', 'learning_rate': '3.154e-06', 'epoch': '0.7478'}
+
 75%|███████▍  | 28390/37963 [64:27:52<22:27:18,  8.44s/it]
 75%|███████▍  | 28391/37963 [64:28:03<24:03:30,  9.05s/it]
 75%|███████▍  | 28392/37963 [64:28:11<22:59:58,  8.65s/it]
 75%|███████▍  | 28393/37963 [64:28:18<22:17:27,  8.39s/it]
 75%|███████▍  | 28394/37963 [64:28:26<21:40:56,  8.16s/it]
 75%|███████▍  | 28395/37963 [64:28:34<21:29:05,  8.08s/it]
 75%|███████▍  | 28396/37963 [64:28:42<21:21:07,  8.03s/it]
 75%|███████▍  | 28397/37963 [64:28:50<21:17:23,  8.01s/it]
 75%|███████▍  | 28398/37963 [64:28:57<21:00:55,  7.91s/it]
 75%|███████▍  | 28399/37963 [64:29:05<20:44:46,  7.81s/it]
 75%|███████▍  | 28400/37963 [64:29:12<20:22:17,  7.67s/it]
                                                           
{'loss': '0.1118', 'grad_norm': '3.028', 'learning_rate': '3.148e-06', 'epoch': '0.7481'}
+
 75%|███████▍  | 28400/37963 [64:29:12<20:22:17,  7.67s/it]
 75%|███████▍  | 28401/37963 [64:29:20<20:10:27,  7.60s/it]
 75%|███████▍  | 28402/37963 [64:29:30<22:29:49,  8.47s/it]
 75%|███████▍  | 28403/37963 [64:29:38<22:04:14,  8.31s/it]
 75%|███████▍  | 28404/37963 [64:29:46<21:38:51,  8.15s/it]
 75%|███████▍  | 28405/37963 [64:29:54<21:14:34,  8.00s/it]
 75%|███████▍  | 28406/37963 [64:30:01<21:00:40,  7.91s/it]
 75%|███████▍  | 28407/37963 [64:30:09<20:44:53,  7.82s/it]
 75%|███████▍  | 28408/37963 [64:30:17<20:37:47,  7.77s/it]
 75%|███████▍  | 28409/37963 [64:30:24<20:38:35,  7.78s/it]
 75%|███████▍  | 28410/37963 [64:30:32<20:41:11,  7.80s/it]
                                                           
{'loss': '0.1169', 'grad_norm': '2.996', 'learning_rate': '3.142e-06', 'epoch': '0.7484'}
+
 75%|███████▍  | 28410/37963 [64:30:32<20:41:11,  7.80s/it]
 75%|███████▍  | 28411/37963 [64:30:40<20:31:39,  7.74s/it]
 75%|███████▍  | 28412/37963 [64:30:48<20:33:13,  7.75s/it]
 75%|███████▍  | 28413/37963 [64:30:56<20:43:04,  7.81s/it]
 75%|███████▍  | 28414/37963 [64:31:03<20:29:46,  7.73s/it]
 75%|███████▍  | 28415/37963 [64:31:11<20:34:24,  7.76s/it]
 75%|███████▍  | 28416/37963 [64:31:19<20:40:14,  7.79s/it]
 75%|███████▍  | 28417/37963 [64:31:27<20:44:52,  7.82s/it]
 75%|███████▍  | 28418/37963 [64:31:34<20:33:29,  7.75s/it]
 75%|███████▍  | 28419/37963 [64:31:42<20:38:15,  7.78s/it]
 75%|███████▍  | 28420/37963 [64:31:50<20:22:36,  7.69s/it]
                                                           
{'loss': '0.1144', 'grad_norm': '2.159', 'learning_rate': '3.136e-06', 'epoch': '0.7486'}
+
 75%|███████▍  | 28420/37963 [64:31:50<20:22:36,  7.69s/it]
 75%|███████▍  | 28421/37963 [64:31:57<20:04:18,  7.57s/it]
 75%|███████▍  | 28422/37963 [64:32:05<20:08:01,  7.60s/it]
 75%|███████▍  | 28423/37963 [64:32:12<20:22:06,  7.69s/it]
 75%|███████▍  | 28424/37963 [64:32:20<20:09:42,  7.61s/it]
 75%|███████▍  | 28425/37963 [64:32:28<20:18:01,  7.66s/it]
 75%|███████▍  | 28426/37963 [64:32:35<20:09:16,  7.61s/it]
 75%|███████▍  | 28427/37963 [64:32:48<24:27:35,  9.23s/it]
 75%|███████▍  | 28428/37963 [64:32:58<25:15:52,  9.54s/it]
 75%|███████▍  | 28429/37963 [64:33:12<28:16:51, 10.68s/it]
 75%|███████▍  | 28430/37963 [64:33:19<25:43:24,  9.71s/it]
                                                           
{'loss': '0.1326', 'grad_norm': '2.183', 'learning_rate': '3.13e-06', 'epoch': '0.7489'}
+
 75%|███████▍  | 28430/37963 [64:33:19<25:43:24,  9.71s/it]
 75%|███████▍  | 28431/37963 [64:33:27<24:00:49,  9.07s/it]
 75%|███████▍  | 28432/37963 [64:33:34<22:41:04,  8.57s/it]
 75%|███████▍  | 28433/37963 [64:33:42<21:57:16,  8.29s/it]
 75%|███████▍  | 28434/37963 [64:33:50<21:33:12,  8.14s/it]
 75%|███████▍  | 28435/37963 [64:33:57<21:11:46,  8.01s/it]
 75%|███████▍  | 28436/37963 [64:34:07<22:46:57,  8.61s/it]
 75%|███████▍  | 28437/37963 [64:34:15<22:17:17,  8.42s/it]
 75%|███████▍  | 28438/37963 [64:34:23<21:40:15,  8.19s/it]
 75%|███████▍  | 28439/37963 [64:34:31<21:14:36,  8.03s/it]
 75%|███████▍  | 28440/37963 [64:34:41<23:18:09,  8.81s/it]
                                                           
{'loss': '0.1309', 'grad_norm': '6.31', 'learning_rate': '3.123e-06', 'epoch': '0.7492'}
+
 75%|███████▍  | 28440/37963 [64:34:41<23:18:09,  8.81s/it]
 75%|███████▍  | 28441/37963 [64:34:49<22:31:06,  8.51s/it]
 75%|███████▍  | 28442/37963 [64:34:57<21:51:13,  8.26s/it]
 75%|███████▍  | 28443/37963 [64:35:05<21:31:42,  8.14s/it]
 75%|���██████▍  | 28444/37963 [64:35:12<21:19:07,  8.06s/it]
 75%|███████▍  | 28445/37963 [64:35:20<21:09:12,  8.00s/it]
 75%|███████▍  | 28446/37963 [64:35:31<23:01:09,  8.71s/it]
 75%|███████▍  | 28447/37963 [64:35:39<22:28:32,  8.50s/it]
 75%|███████▍  | 28448/37963 [64:35:46<21:51:50,  8.27s/it]
 75%|███████▍  | 28449/37963 [64:35:54<21:11:46,  8.02s/it]
 75%|███████▍  | 28450/37963 [64:36:02<21:07:03,  7.99s/it]
                                                           
{'loss': '0.1116', 'grad_norm': '2.903', 'learning_rate': '3.117e-06', 'epoch': '0.7494'}
+
 75%|███████▍  | 28450/37963 [64:36:02<21:07:03,  7.99s/it]
 75%|███████▍  | 28451/37963 [64:36:10<20:57:58,  7.94s/it]
 75%|███████▍  | 28452/37963 [64:36:18<20:58:35,  7.94s/it]
 75%|███████▍  | 28453/37963 [64:36:25<20:50:09,  7.89s/it]
 75%|███████▍  | 28454/37963 [64:36:33<20:48:03,  7.88s/it]
 75%|███████▍  | 28455/37963 [64:36:41<20:42:04,  7.84s/it]
 75%|███████▍  | 28456/37963 [64:36:49<20:35:27,  7.80s/it]
 75%|███████▍  | 28457/37963 [64:36:57<20:53:19,  7.91s/it]
 75%|███████▍  | 28458/37963 [64:37:05<20:48:10,  7.88s/it]
 75%|███████▍  | 28459/37963 [64:37:12<20:48:14,  7.88s/it]
 75%|███████▍  | 28460/37963 [64:37:20<20:32:30,  7.78s/it]
                                                           
{'loss': '0.0989', 'grad_norm': '2.318', 'learning_rate': '3.111e-06', 'epoch': '0.7497'}
+
 75%|███████▍  | 28460/37963 [64:37:20<20:32:30,  7.78s/it]
 75%|███████▍  | 28461/37963 [64:37:28<20:23:01,  7.72s/it]
 75%|███████▍  | 28462/37963 [64:37:35<20:18:01,  7.69s/it]
 75%|███████▍  | 28463/37963 [64:37:43<20:21:23,  7.71s/it]
 75%|███████▍  | 28464/37963 [64:37:51<20:24:05,  7.73s/it]
 75%|███████▍  | 28465/37963 [64:37:59<20:25:10,  7.74s/it]
 75%|███████▍  | 28466/37963 [64:38:06<20:13:59,  7.67s/it]
 75%|███████▍  | 28467/37963 [64:38:14<20:34:49,  7.80s/it]
 75%|███████▍  | 28468/37963 [64:38:21<20:13:32,  7.67s/it]
 75%|███████▍  | 28469/37963 [64:38:29<20:03:10,  7.60s/it]
 75%|███████▍  | 28470/37963 [64:38:36<19:54:42,  7.55s/it]
                                                           
{'loss': '0.1248', 'grad_norm': '1.792', 'learning_rate': '3.105e-06', 'epoch': '0.7499'}
+
 75%|███████▍  | 28470/37963 [64:38:36<19:54:42,  7.55s/it]
 75%|███████▍  | 28471/37963 [64:38:47<22:11:41,  8.42s/it]
 75%|███████▍  | 28472/37963 [64:38:55<21:48:11,  8.27s/it]
 75%|███████▌  | 28473/37963 [64:39:06<23:48:11,  9.03s/it]
 75%|███████▌  | 28474/37963 [64:39:14<22:59:48,  8.72s/it]
 75%|███████▌  | 28475/37963 [64:39:24<24:22:33,  9.25s/it]
 75%|███████▌  | 28476/37963 [64:39:32<23:03:41,  8.75s/it]
 75%|███████▌  | 28477/37963 [64:39:42<24:08:55,  9.16s/it]
 75%|███████▌  | 28478/37963 [64:39:49<22:45:47,  8.64s/it]
 75%|███████▌  | 28479/37963 [64:39:57<22:01:21,  8.36s/it]
 75%|███████▌  | 28480/37963 [64:40:04<21:26:09,  8.14s/it]
                                                           
{'loss': '0.122', 'grad_norm': '2.717', 'learning_rate': '3.099e-06', 'epoch': '0.7502'}
+
 75%|███████▌  | 28480/37963 [64:40:04<21:26:09,  8.14s/it]
 75%|███████▌  | 28481/37963 [64:40:15<23:01:28,  8.74s/it]
 75%|███████▌  | 28482/37963 [64:40:22<22:09:39,  8.41s/it]
 75%|███████▌  | 28483/37963 [64:40:30<21:35:56,  8.20s/it]
 75%|███████▌  | 28484/37963 [64:40:38<21:06:31,  8.02s/it]
 75%|███████▌  | 28485/37963 [64:40:45<20:50:45,  7.92s/it]
 75%|███████▌  | 28486/37963 [64:40:53<20:49:18,  7.91s/it]
 75%|███████▌  | 28487/37963 [64:41:01<20:47:23,  7.90s/it]
 75%|███████▌  | 28488/37963 [64:41:09<20:44:55,  7.88s/it]
 75%|███████▌  | 28489/37963 [64:41:17<20:35:57,  7.83s/it]
 75%|███████▌  | 28490/37963 [64:41:27<22:38:42,  8.61s/it]
                                                           
{'loss': '0.1262', 'grad_norm': '2.404', 'learning_rate': '3.092e-06', 'epoch': '0.7505'}
+
 75%|███████▌  | 28490/37963 [64:41:27<22:38:42,  8.61s/it]
 75%|███████▌  | 28491/37963 [64:41:35<21:57:45,  8.35s/it]
 75%|███████▌  | 28492/37963 [64:41:42<21:22:54,  8.13s/it]
 75%|███████▌  | 28493/37963 [64:41:50<20:59:09,  7.98s/it]
 75%|███████▌  | 28494/37963 [64:42:01<23:00:35,  8.75s/it]
 75%|███████▌  | 28495/37963 [64:42:08<22:08:34,  8.42s/it]
 75%|███████▌  | 28496/37963 [64:42:16<21:20:09,  8.11s/it]
 75%|███████▌  | 28497/37963 [64:42:24<21:22:12,  8.13s/it]
 75%|███████▌  | 28498/37963 [64:42:31<20:56:13,  7.96s/it]
 75%|███████▌  | 28499/37963 [64:42:39<20:42:25,  7.88s/it]
 75%|███████▌  | 28500/37963 [64:42:50<22:49:08,  8.68s/it]
                                                           
{'loss': '0.1154', 'grad_norm': '2.213', 'learning_rate': '3.086e-06', 'epoch': '0.7507'}
+
 75%|███████▌  | 28500/37963 [64:42:50<22:49:08,  8.68s/it]
 75%|███████▌  | 28501/37963 [64:42:57<22:13:20,  8.45s/it]
 75%|███████▌  | 28502/37963 [64:43:05<21:46:26,  8.29s/it]
 75%|███████▌  | 28503/37963 [64:43:13<21:17:17,  8.10s/it]
 75%|███████▌  | 28504/37963 [64:43:21<21:02:42,  8.01s/it]
 75%|███████▌  | 28505/37963 [64:43:29<20:52:05,  7.94s/it]
 75%|███████▌  | 28506/37963 [64:43:36<20:41:25,  7.88s/it]
 75%|███████▌  | 28507/37963 [64:43:44<20:41:40,  7.88s/it]
 75%|███████▌  | 28508/37963 [64:43:52<20:25:32,  7.78s/it]
 75%|███████▌  | 28509/37963 [64:44:00<20:32:50,  7.82s/it]
 75%|███████▌  | 28510/37963 [64:44:07<20:31:10,  7.81s/it]
                                                           
{'loss': '0.1283', 'grad_norm': '2.689', 'learning_rate': '3.08e-06', 'epoch': '0.751'}
+
 75%|███████▌  | 28510/37963 [64:44:07<20:31:10,  7.81s/it]
 75%|███████▌  | 28511/37963 [64:44:15<20:23:32,  7.77s/it]
 75%|███████▌  | 28512/37963 [64:44:23<20:23:58,  7.77s/it]
 75%|███████▌  | 28513/37963 [64:44:31<20:26:51,  7.79s/it]
 75%|███████▌  | 28514/37963 [64:44:39<20:25:15,  7.78s/it]
 75%|███████▌  | 28515/37963 [64:44:46<20:20:10,  7.75s/it]
 75%|███████▌  | 28516/37963 [64:44:54<20:13:30,  7.71s/it]
 75%|███████▌  | 28517/37963 [64:45:01<20:09:00,  7.68s/it]
 75%|███████▌  | 28518/37963 [64:45:09<20:16:24,  7.73s/it]
 75%|███████▌  | 28519/37963 [64:45:20<22:35:13,  8.61s/it]
 75%|███████▌  | 28520/37963 [64:45:28<21:52:47,  8.34s/it]
                                                           
{'loss': '0.1029', 'grad_norm': '2.511', 'learning_rate': '3.074e-06', 'epoch': '0.7513'}
+
 75%|███████▌  | 28520/37963 [64:45:28<21:52:47,  8.34s/it]
 75%|███████▌  | 28521/37963 [64:45:35<21:07:25,  8.05s/it]
 75%|███████▌  | 28522/37963 [64:45:43<20:56:05,  7.98s/it]
 75%|███████▌  | 28523/37963 [64:45:53<22:43:43,  8.67s/it]
 75%|███████▌  | 28524/37963 [64:46:01<22:01:31,  8.40s/it]
 75%|███████▌  | 28525/37963 [64:46:14<25:43:22,  9.81s/it]
 75%|███████▌  | 28526/37963 [64:46:22<23:59:14,  9.15s/it]
 75%|███████▌  | 28527/37963 [64:46:29<22:52:40,  8.73s/it]
 75%|███████▌  | 28528/37963 [64:46:37<22:14:36,  8.49s/it]
 75%|███████▌  | 28529/37963 [64:46:45<21:35:29,  8.24s/it]
 75%|███████▌  | 28530/37963 [64:46:52<21:00:59,  8.02s/it]
                                                           
{'loss': '0.1321', 'grad_norm': '2.394', 'learning_rate': '3.068e-06', 'epoch': '0.7515'}
+
 75%|███████▌  | 28530/37963 [64:46:52<21:00:59,  8.02s/it]
 75%|███████▌  | 28531/37963 [64:47:00<20:57:10,  8.00s/it]
 75%|███████▌  | 28532/37963 [64:47:08<20:38:38,  7.88s/it]
 75%|███████▌  | 28533/37963 [64:47:16<20:31:58,  7.84s/it]
 75%|███████▌  | 28534/37963 [64:47:23<20:24:10,  7.79s/it]
 75%|███████▌  | 28535/37963 [64:47:31<20:18:30,  7.75s/it]
 75%|███████▌  | 28536/37963 [64:47:39<20:21:30,  7.77s/it]
 75%|███████▌  | 28537/37963 [64:47:47<20:24:42,  7.80s/it]
 75%|███████▌  | 28538/37963 [64:47:57<22:19:36,  8.53s/it]
 75%|███████▌  | 28539/37963 [64:48:05<21:42:44,  8.29s/it]
 75%|███████▌  | 28540/37963 [64:48:12<21:14:09,  8.11s/it]
                                                           
{'loss': '0.1189', 'grad_norm': '2.923', 'learning_rate': '3.062e-06', 'epoch': '0.7518'}
+
 75%|███████▌  | 28540/37963 [64:48:12<21:14:09,  8.11s/it]
 75%|███████▌  | 28541/37963 [64:48:20<20:44:38,  7.93s/it]
 75%|███████▌  | 28542/37963 [64:48:28<20:31:20,  7.84s/it]
 75%|███████▌  | 28543/37963 [64:48:35<20:18:42,  7.76s/it]
 75%|███████▌  | 28544/37963 [64:48:43<20:02:40,  7.66s/it]
 75%|███████▌  | 28545/37963 [64:48:50<20:04:20,  7.67s/it]
 75%|███████▌  | 28546/37963 [64:48:58<19:50:18,  7.58s/it]
 75%|███████▌  | 28547/37963 [64:49:08<22:03:56,  8.44s/it]
 75%|███████▌  | 28548/37963 [64:49:18<23:26:08,  8.96s/it]
 75%|███████▌  | 28549/37963 [64:49:26<22:23:25,  8.56s/it]
 75%|███████▌  | 28550/37963 [64:49:34<21:43:06,  8.31s/it]
                                                           
{'loss': '0.1189', 'grad_norm': '1.875', 'learning_rate': '3.056e-06', 'epoch': '0.7521'}
+
 75%|███████▌  | 28550/37963 [64:49:34<21:43:06,  8.31s/it]
 75%|███████▌  | 28551/37963 [64:49:41<21:16:34,  8.14s/it]
 75%|███████▌  | 28552/37963 [64:49:49<21:00:08,  8.03s/it]
 75%|███████▌  | 28553/37963 [64:49:57<20:49:39,  7.97s/it]
 75%|███████▌  | 28554/37963 [64:50:05<20:40:44,  7.91s/it]
 75%|███████▌  | 28555/37963 [64:50:12<20:33:19,  7.87s/it]
 75%|███████▌  | 28556/37963 [64:50:20<20:15:24,  7.75s/it]
 75%|███████▌  | 28557/37963 [64:50:28<20:09:13,  7.71s/it]
 75%|███████▌  | 28558/37963 [64:50:36<20:30:32,  7.85s/it]
 75%|███████▌  | 28559/37963 [64:50:43<20:19:46,  7.78s/it]
 75%|███████▌  | 28560/37963 [64:50:51<20:26:05,  7.82s/it]
                                                           
{'loss': '0.1175', 'grad_norm': '2.757', 'learning_rate': '3.049e-06', 'epoch': '0.7523'}
+
 75%|███████▌  | 28560/37963 [64:50:51<20:26:05,  7.82s/it]
 75%|███████▌  | 28561/37963 [64:50:59<20:01:14,  7.67s/it]
 75%|███████▌  | 28562/37963 [64:51:07<20:13:23,  7.74s/it]
 75%|███████▌  | 28563/37963 [64:51:14<20:14:18,  7.75s/it]
 75%|███████▌  | 28564/37963 [64:51:22<20:24:07,  7.81s/it]
 75%|███████▌  | 28565/37963 [64:51:30<20:22:39,  7.81s/it]
 75%|███████▌  | 28566/37963 [64:51:38<20:22:43,  7.81s/it]
 75%|███████▌  | 28567/37963 [64:51:45<20:11:49,  7.74s/it]
 75%|███████▌  | 28568/37963 [64:51:53<20:09:44,  7.73s/it]
 75%|███████▌  | 28569/37963 [64:52:01<20:11:23,  7.74s/it]
 75%|███████▌  | 28570/37963 [64:52:09<20:12:55,  7.75s/it]
                                                           
{'loss': '0.1171', 'grad_norm': '2.645', 'learning_rate': '3.043e-06', 'epoch': '0.7526'}
+
 75%|███████▌  | 28570/37963 [64:52:09<20:12:55,  7.75s/it]
 75%|███████▌  | 28571/37963 [64:52:16<20:12:56,  7.75s/it]
 75%|███████▌  | 28572/37963 [64:52:27<22:12:56,  8.52s/it]
 75%|███████▌  | 28573/37963 [64:52:37<23:28:51,  9.00s/it]
 75%|███████▌  | 28574/37963 [64:52:45<22:26:12,  8.60s/it]
 75%|███████▌  | 28575/37963 [64:52:52<21:43:14,  8.33s/it]
 75%|███████▌  | 28576/37963 [64:53:00<21:14:21,  8.15s/it]
 75%|███████▌  | 28577/37963 [64:53:08<21:02:24,  8.07s/it]
 75%|███████▌  | 28578/37963 [64:53:16<20:48:18,  7.98s/it]
 75%|███████▌  | 28579/37963 [64:53:31<26:58:02, 10.35s/it]
 75%|███████▌  | 28580/37963 [64:53:39<25:07:53,  9.64s/it]
                                                           
{'loss': '0.118', 'grad_norm': '2.912', 'learning_rate': '3.037e-06', 'epoch': '0.7528'}
+
 75%|███████▌  | 28580/37963 [64:53:39<25:07:53,  9.64s/it]
 75%|███████▌  | 28581/37963 [64:53:47<23:36:50,  9.06s/it]
 75%|███████▌  | 28582/37963 [64:53:55<22:29:38,  8.63s/it]
 75%|███████▌  | 28583/37963 [64:54:03<21:48:20,  8.37s/it]
 75%|███████▌  | 28584/37963 [64:54:10<21:17:06,  8.17s/it]
 75%|███████▌  | 28585/37963 [64:54:18<20:58:03,  8.05s/it]
 75%|███████▌  | 28586/37963 [64:54:28<22:41:15,  8.71s/it]
 75%|███████▌  | 28587/37963 [64:54:36<21:56:36,  8.43s/it]
 75%|███████▌  | 28588/37963 [64:54:44<21:20:10,  8.19s/it]
 75%|███████▌  | 28589/37963 [64:54:51<20:59:59,  8.06s/it]
 75%|███████▌  | 28590/37963 [64:54:59<20:46:58,  7.98s/it]
                                                           
{'loss': '0.123', 'grad_norm': '3.03', 'learning_rate': '3.031e-06', 'epoch': '0.7531'}
+
 75%|███████▌  | 28590/37963 [64:54:59<20:46:58,  7.98s/it]
 75%|███████▌  | 28591/37963 [64:55:07<20:37:18,  7.92s/it]
 75%|███████▌  | 28592/37963 [64:55:15<20:30:06,  7.88s/it]
 75%|███████▌  | 28593/37963 [64:55:23<20:23:04,  7.83s/it]
 75%|███████▌  | 28594/37963 [64:55:30<20:19:24,  7.81s/it]
 75%|███████▌  | 28595/37963 [64:55:41<22:20:36,  8.59s/it]
 75%|███████▌  | 28596/37963 [64:55:49<21:55:50,  8.43s/it]
 75%|███████▌  | 28597/37963 [64:55:56<21:14:05,  8.16s/it]
 75%|███████▌  | 28598/37963 [64:56:03<20:29:45,  7.88s/it]
 75%|███████▌  | 28599/37963 [64:56:11<20:22:11,  7.83s/it]
 75%|███████▌  | 28600/37963 [64:56:19<20:20:05,  7.82s/it]
                                                           
{'loss': '0.1193', 'grad_norm': '1.976', 'learning_rate': '3.025e-06', 'epoch': '0.7534'}
+
 75%|███████▌  | 28600/37963 [64:56:19<20:20:05,  7.82s/it]
 75%|███████▌  | 28601/37963 [64:56:27<20:13:40,  7.78s/it]
 75%|███████▌  | 28602/37963 [64:56:37<22:07:50,  8.51s/it]
 75%|███████▌  | 28603/37963 [64:56:45<21:46:39,  8.38s/it]
 75%|███████▌  | 28604/37963 [64:56:53<21:21:38,  8.22s/it]
 75%|███████▌  | 28605/37963 [64:57:01<21:09:38,  8.14s/it]
 75%|███████▌  | 28606/37963 [64:57:09<20:54:39,  8.05s/it]
 75%|███████▌  | 28607/37963 [64:57:16<20:44:22,  7.98s/it]
 75%|███████▌  | 28608/37963 [64:57:24<20:46:53,  8.00s/it]
 75%|███████▌  | 28609/37963 [64:57:32<20:18:39,  7.82s/it]
 75%|███████▌  | 28610/37963 [64:57:40<20:12:14,  7.78s/it]
                                                           
{'loss': '0.103', 'grad_norm': '2.08', 'learning_rate': '3.019e-06', 'epoch': '0.7536'}
+
 75%|███████▌  | 28610/37963 [64:57:40<20:12:14,  7.78s/it]
 75%|███████▌  | 28611/37963 [64:57:47<20:08:46,  7.76s/it]
 75%|███████▌  | 28612/37963 [64:57:55<20:08:44,  7.76s/it]
 75%|███████▌  | 28613/37963 [64:58:03<20:12:37,  7.78s/it]
 75%|███████▌  | 28614/37963 [64:58:10<20:04:18,  7.73s/it]
 75%|███████▌  | 28615/37963 [64:58:18<20:05:28,  7.74s/it]
 75%|███████▌  | 28616/37963 [64:58:26<20:04:00,  7.73s/it]
 75%|███████▌  | 28617/37963 [64:58:34<20:03:43,  7.73s/it]
 75%|███████▌  | 28618/37963 [64:58:41<19:59:03,  7.70s/it]
 75%|███████▌  | 28619/37963 [64:58:49<19:51:31,  7.65s/it]
 75%|███████▌  | 28620/37963 [64:58:57<20:05:25,  7.74s/it]
                                                           
{'loss': '0.119', 'grad_norm': '3.234', 'learning_rate': '3.013e-06', 'epoch': '0.7539'}
+
 75%|███████▌  | 28620/37963 [64:58:57<20:05:25,  7.74s/it]
 75%|███████▌  | 28621/37963 [64:59:05<20:07:56,  7.76s/it]
 75%|███████▌  | 28622/37963 [64:59:18<24:23:14,  9.40s/it]
 75%|███████▌  | 28623/37963 [64:59:26<23:13:01,  8.95s/it]
 75%|███████▌  | 28624/37963 [64:59:33<22:14:53,  8.58s/it]
 75%|███████▌  | 28625/37963 [64:59:41<21:43:16,  8.37s/it]
 75%|███████▌  | 28626/37963 [64:59:49<21:13:42,  8.18s/it]
 75%|███████▌  | 28627/37963 [65:00:00<23:01:56,  8.88s/it]
 75%|███████▌  | 28628/37963 [65:00:07<22:09:55,  8.55s/it]
 75%|███████▌  | 28629/37963 [65:00:15<21:28:25,  8.28s/it]
 75%|███████▌  | 28630/37963 [65:00:23<21:08:43,  8.16s/it]
                                                           
{'loss': '0.1164', 'grad_norm': '3.625', 'learning_rate': '3.007e-06', 'epoch': '0.7542'}
+
 75%|███████▌  | 28630/37963 [65:00:23<21:08:43,  8.16s/it]
 75%|███████▌  | 28631/37963 [65:00:30<20:32:57,  7.93s/it]
 75%|███████▌  | 28632/37963 [65:00:38<20:22:39,  7.86s/it]
 75%|███████▌  | 28633/37963 [65:00:51<24:24:46,  9.42s/it]
 75%|███████▌  | 28634/37963 [65:01:01<25:08:03,  9.70s/it]
 75%|███████▌  | 28635/37963 [65:01:09<23:38:45,  9.13s/it]
 75%|███████▌  | 28636/37963 [65:01:17<22:32:02,  8.70s/it]
 75%|███████▌  | 28637/37963 [65:01:25<21:48:51,  8.42s/it]
 75%|███████▌  | 28638/37963 [65:01:33<21:23:55,  8.26s/it]
 75%|███████▌  | 28639/37963 [65:01:40<20:44:13,  8.01s/it]
 75%|███████▌  | 28640/37963 [65:01:48<20:31:41,  7.93s/it]
                                                           
{'loss': '0.1117', 'grad_norm': '3.357', 'learning_rate': '3e-06', 'epoch': '0.7544'}
+
 75%|███████▌  | 28640/37963 [65:01:48<20:31:41,  7.93s/it]
 75%|███████▌  | 28641/37963 [65:01:55<20:25:24,  7.89s/it]
 75%|███████▌  | 28642/37963 [65:02:03<20:16:10,  7.83s/it]
 75%|███████▌  | 28643/37963 [65:02:14<22:29:26,  8.69s/it]
 75%|███████▌  | 28644/37963 [65:02:21<21:37:00,  8.35s/it]
 75%|███████▌  | 28645/37963 [65:02:29<21:00:51,  8.12s/it]
 75%|███████▌  | 28646/37963 [65:02:39<22:46:04,  8.80s/it]
 75%|███████▌  | 28647/37963 [65:02:47<22:00:26,  8.50s/it]
 75%|███████▌  | 28648/37963 [65:02:55<21:14:46,  8.21s/it]
 75%|███████▌  | 28649/37963 [65:03:02<20:34:05,  7.95s/it]
 75%|███████▌  | 28650/37963 [65:03:10<20:22:26,  7.88s/it]
                                                           
{'loss': '0.1182', 'grad_norm': '2.044', 'learning_rate': '2.994e-06', 'epoch': '0.7547'}
+
 75%|███████▌  | 28650/37963 [65:03:10<20:22:26,  7.88s/it]
 75%|███████▌  | 28651/37963 [65:03:18<20:19:08,  7.86s/it]
 75%|███████▌  | 28652/37963 [65:03:25<20:08:57,  7.79s/it]
 75%|███████▌  | 28653/37963 [65:03:33<19:58:26,  7.72s/it]
 75%|███████▌  | 28654/37963 [65:03:40<19:55:48,  7.71s/it]
 75%|███████▌  | 28655/37963 [65:03:48<19:51:25,  7.68s/it]
 75%|███████▌  | 28656/37963 [65:03:56<19:43:59,  7.63s/it]
 75%|███████▌  | 28657/37963 [65:04:03<19:48:48,  7.66s/it]
 75%|███████▌  | 28658/37963 [65:04:11<19:56:50,  7.72s/it]
 75%|███████▌  | 28659/37963 [65:04:19<19:53:47,  7.70s/it]
 75%|███████▌  | 28660/37963 [65:04:26<19:52:03,  7.69s/it]
                                                           
{'loss': '0.1064', 'grad_norm': '1.969', 'learning_rate': '2.988e-06', 'epoch': '0.7549'}
+
 75%|███████▌  | 28660/37963 [65:04:26<19:52:03,  7.69s/it]
 75%|███████▌  | 28661/37963 [65:04:34<20:00:58,  7.75s/it]
 75%|███████▌  | 28662/37963 [65:04:42<20:05:02,  7.77s/it]
 76%|███████▌  | 28663/37963 [65:04:50<20:05:33,  7.78s/it]
 76%|███████▌  | 28664/37963 [65:04:58<19:56:58,  7.72s/it]
 76%|███████▌  | 28665/37963 [65:05:05<20:03:10,  7.76s/it]
 76%|███████▌  | 28666/37963 [65:05:13<20:01:29,  7.75s/it]
 76%|███████▌  | 28667/37963 [65:05:21<20:06:32,  7.79s/it]
 76%|███████▌  | 28668/37963 [65:05:29<19:57:37,  7.73s/it]
 76%|███████▌  | 28669/37963 [65:05:37<20:05:49,  7.78s/it]
 76%|███████▌  | 28670/37963 [65:05:47<22:08:35,  8.58s/it]
                                                           
{'loss': '0.1169', 'grad_norm': '2.218', 'learning_rate': '2.982e-06', 'epoch': '0.7552'}
+
 76%|███████▌  | 28670/37963 [65:05:47<22:08:35,  8.58s/it]
 76%|███████▌  | 28671/37963 [65:05:57<23:38:13,  9.16s/it]
 76%|███████▌  | 28672/37963 [65:06:05<22:27:37,  8.70s/it]
 76%|███████▌  | 28673/37963 [65:06:13<21:35:20,  8.37s/it]
 76%|███████▌  | 28674/37963 [65:06:20<20:48:27,  8.06s/it]
 76%|███████▌  | 28675/37963 [65:06:30<22:33:42,  8.74s/it]
 76%|███████▌  | 28676/37963 [65:06:38<21:43:47,  8.42s/it]
 76%|███████▌  | 28677/37963 [65:06:45<20:54:33,  8.11s/it]
 76%|███████▌  | 28678/37963 [65:06:56<22:46:13,  8.83s/it]
 76%|███████▌  | 28679/37963 [65:07:04<21:54:06,  8.49s/it]
 76%|███████▌  | 28680/37963 [65:07:12<21:28:46,  8.33s/it]
                                                           
{'loss': '0.1127', 'grad_norm': '3.055', 'learning_rate': '2.976e-06', 'epoch': '0.7555'}
+
 76%|███████▌  | 28680/37963 [65:07:12<21:28:46,  8.33s/it]
 76%|███████▌  | 28681/37963 [65:07:19<21:06:42,  8.19s/it]
 76%|███████▌  | 28682/37963 [65:07:27<20:40:16,  8.02s/it]
 76%|███████▌  | 28683/37963 [65:07:35<20:24:55,  7.92s/it]
 76%|███████▌  | 28684/37963 [65:07:43<20:30:27,  7.96s/it]
 76%|███████▌  | 28685/37963 [65:07:50<19:59:44,  7.76s/it]
 76%|███████▌  | 28686/37963 [65:07:57<19:41:49,  7.64s/it]
 76%|███████▌  | 28687/37963 [65:08:08<21:57:59,  8.53s/it]
 76%|███████▌  | 28688/37963 [65:08:16<21:18:42,  8.27s/it]
 76%|███████▌  | 28689/37963 [65:08:26<23:01:16,  8.94s/it]
 76%|███████▌  | 28690/37963 [65:08:37<24:22:52,  9.47s/it]
                                                           
{'loss': '0.09957', 'grad_norm': '2.461', 'learning_rate': '2.97e-06', 'epoch': '0.7557'}
+
 76%|███████▌  | 28690/37963 [65:08:37<24:22:52,  9.47s/it]
 76%|███████▌  | 28691/37963 [65:08:45<23:07:39,  8.98s/it]
 76%|███████▌  | 28692/37963 [65:08:53<22:19:25,  8.67s/it]
 76%|███████▌  | 28693/37963 [65:09:01<21:47:28,  8.46s/it]
 76%|███████▌  | 28694/37963 [65:09:09<21:21:54,  8.30s/it]
 76%|███████▌  | 28695/37963 [65:09:16<20:58:08,  8.15s/it]
 76%|███████▌  | 28696/37963 [65:09:24<20:36:51,  8.01s/it]
 76%|███████▌  | 28697/37963 [65:09:32<20:26:36,  7.94s/it]
 76%|███████▌  | 28698/37963 [65:09:40<20:19:32,  7.90s/it]
 76%|███████▌  | 28699/37963 [65:09:47<20:07:14,  7.82s/it]
 76%|███████▌  | 28700/37963 [65:09:55<20:04:34,  7.80s/it]
                                                           
{'loss': '0.1221', 'grad_norm': '3.536', 'learning_rate': '2.964e-06', 'epoch': '0.756'}
+
 76%|███████▌  | 28700/37963 [65:09:55<20:04:34,  7.80s/it]
 76%|███████▌  | 28701/37963 [65:10:03<20:01:36,  7.78s/it]
 76%|███████▌  | 28702/37963 [65:10:11<20:07:27,  7.82s/it]
 76%|███████▌  | 28703/37963 [65:10:19<20:08:00,  7.83s/it]
 76%|███████▌  | 28704/37963 [65:10:26<19:59:40,  7.77s/it]
 76%|███████▌  | 28705/37963 [65:10:34<19:58:42,  7.77s/it]
 76%|███████▌  | 28706/37963 [65:10:42<19:48:23,  7.70s/it]
 76%|███████▌  | 28707/37963 [65:10:49<19:52:42,  7.73s/it]
 76%|███████▌  | 28708/37963 [65:10:57<19:51:45,  7.73s/it]
 76%|███████▌  | 28709/37963 [65:11:05<20:02:55,  7.80s/it]
 76%|███████▌  | 28710/37963 [65:11:13<20:21:33,  7.92s/it]
                                                           
{'loss': '0.1132', 'grad_norm': '1.859', 'learning_rate': '2.958e-06', 'epoch': '0.7563'}
+
 76%|███████▌  | 28710/37963 [65:11:13<20:21:33,  7.92s/it]
 76%|███████▌  | 28711/37963 [65:11:21<19:57:50,  7.77s/it]
 76%|███████▌  | 28712/37963 [65:11:28<19:57:25,  7.77s/it]
 76%|███████▌  | 28713/37963 [65:11:36<19:50:53,  7.72s/it]
 76%|███████▌  | 28714/37963 [65:11:44<19:48:42,  7.71s/it]
 76%|███████▌  | 28715/37963 [65:11:54<22:03:04,  8.58s/it]
 76%|███████▌  | 28716/37963 [65:12:02<21:33:22,  8.39s/it]
 76%|███████▌  | 28717/37963 [65:12:10<21:00:30,  8.18s/it]
 76%|███████▌  | 28718/37963 [65:12:18<20:42:26,  8.06s/it]
 76%|███████▌  | 28719/37963 [65:12:25<20:22:14,  7.93s/it]
 76%|███████▌  | 28720/37963 [65:12:33<20:16:49,  7.90s/it]
                                                           
{'loss': '0.1188', 'grad_norm': '3.612', 'learning_rate': '2.952e-06', 'epoch': '0.7565'}
+
 76%|███████▌  | 28720/37963 [65:12:33<20:16:49,  7.90s/it]
 76%|███████▌  | 28721/37963 [65:12:41<20:08:07,  7.84s/it]
 76%|███████▌  | 28722/37963 [65:12:49<20:15:08,  7.89s/it]
 76%|███████▌  | 28723/37963 [65:12:56<19:58:48,  7.78s/it]
 76%|███████▌  | 28724/37963 [65:13:07<22:04:33,  8.60s/it]
 76%|███████▌  | 28725/37963 [65:13:15<21:21:01,  8.32s/it]
 76%|███████▌  | 28726/37963 [65:13:22<20:56:48,  8.16s/it]
 76%|███████▌  | 28727/37963 [65:13:30<20:30:08,  7.99s/it]
 76%|███████▌  | 28728/37963 [65:13:38<20:27:15,  7.97s/it]
 76%|███████▌  | 28729/37963 [65:13:48<22:12:45,  8.66s/it]
 76%|███████▌  | 28730/37963 [65:13:56<21:20:59,  8.32s/it]
                                                           
{'loss': '0.1219', 'grad_norm': '1.549', 'learning_rate': '2.946e-06', 'epoch': '0.7568'}
+
 76%|███████▌  | 28730/37963 [65:13:56<21:20:59,  8.32s/it]
 76%|███████▌  | 28731/37963 [65:14:03<20:51:41,  8.13s/it]
 76%|███████▌  | 28732/37963 [65:14:13<22:15:00,  8.68s/it]
 76%|███████▌  | 28733/37963 [65:14:21<21:31:04,  8.39s/it]
 76%|███████▌  | 28734/37963 [65:14:29<21:02:36,  8.21s/it]
 76%|███████▌  | 28735/37963 [65:14:39<22:50:18,  8.91s/it]
 76%|███████▌  | 28736/37963 [65:14:47<21:56:26,  8.56s/it]
 76%|███████▌  | 28737/37963 [65:14:57<22:59:46,  8.97s/it]
 76%|███████▌  | 28738/37963 [65:15:05<22:01:50,  8.60s/it]
 76%|███████▌  | 28739/37963 [65:15:13<21:22:23,  8.34s/it]
 76%|███████▌  | 28740/37963 [65:15:23<23:10:24,  9.05s/it]
                                                           
{'loss': '0.1224', 'grad_norm': '2.078', 'learning_rate': '2.94e-06', 'epoch': '0.7571'}
+
 76%|███████▌  | 28740/37963 [65:15:23<23:10:24,  9.05s/it]
 76%|███████▌  | 28741/37963 [65:15:34<24:09:18,  9.43s/it]
 76%|███████▌  | 28742/37963 [65:15:41<22:47:33,  8.90s/it]
 76%|███████▌  | 28743/37963 [65:15:49<21:47:58,  8.51s/it]
 76%|███████▌  | 28744/37963 [65:15:57<21:09:10,  8.26s/it]
 76%|███████▌  | 28745/37963 [65:16:04<20:48:46,  8.13s/it]
 76%|███████▌  | 28746/37963 [65:16:12<20:31:16,  8.02s/it]
 76%|███████▌  | 28747/37963 [65:16:20<20:18:44,  7.93s/it]
 76%|███████▌  | 28748/37963 [65:16:27<19:51:53,  7.76s/it]
 76%|███████▌  | 28749/37963 [65:16:35<19:50:52,  7.75s/it]
 76%|███████▌  | 28750/37963 [65:16:43<19:50:19,  7.75s/it]
                                                           
{'loss': '0.1129', 'grad_norm': '2.811', 'learning_rate': '2.934e-06', 'epoch': '0.7573'}
+
 76%|███████▌  | 28750/37963 [65:16:43<19:50:19,  7.75s/it]
 76%|███████▌  | 28751/37963 [65:16:50<19:22:05,  7.57s/it]
 76%|███████▌  | 28752/37963 [65:16:57<19:15:55,  7.53s/it]
 76%|███████▌  | 28753/37963 [65:17:05<19:25:54,  7.60s/it]
 76%|███████▌  | 28754/37963 [65:17:13<19:30:41,  7.63s/it]
 76%|███████▌  | 28755/37963 [65:17:21<19:48:09,  7.74s/it]
 76%|███████▌  | 28756/37963 [65:17:28<19:31:59,  7.64s/it]
 76%|███████▌  | 28757/37963 [65:17:36<19:30:08,  7.63s/it]
 76%|███████▌  | 28758/37963 [65:17:43<19:28:56,  7.62s/it]
 76%|███████▌  | 28759/37963 [65:17:51<19:23:44,  7.59s/it]
 76%|███████▌  | 28760/37963 [65:17:59<19:41:42,  7.70s/it]
                                                           
{'loss': '0.1285', 'grad_norm': '2.755', 'learning_rate': '2.928e-06', 'epoch': '0.7576'}
+
 76%|███████▌  | 28760/37963 [65:17:59<19:41:42,  7.70s/it]
 76%|███████▌  | 28761/37963 [65:18:07<19:43:43,  7.72s/it]
 76%|███████▌  | 28762/37963 [65:18:14<19:42:43,  7.71s/it]
 76%|███████▌  | 28763/37963 [65:18:25<22:00:31,  8.61s/it]
 76%|███████▌  | 28764/37963 [65:18:33<21:16:03,  8.32s/it]
 76%|███████▌  | 28765/37963 [65:18:40<20:44:51,  8.12s/it]
 76%|███████▌  | 28766/37963 [65:18:48<20:27:53,  8.01s/it]
 76%|███████▌  | 28767/37963 [65:18:58<22:16:09,  8.72s/it]
 76%|███████▌  | 28768/37963 [65:19:06<21:44:52,  8.51s/it]
 76%|███████▌  | 28769/37963 [65:19:14<21:09:07,  8.28s/it]
 76%|███████▌  | 28770/37963 [65:19:22<20:47:54,  8.14s/it]
                                                           
{'loss': '0.1065', 'grad_norm': '1.308', 'learning_rate': '2.922e-06', 'epoch': '0.7578'}
+
 76%|███████▌  | 28770/37963 [65:19:22<20:47:54,  8.14s/it]
 76%|███████▌  | 28771/37963 [65:19:30<20:32:07,  8.04s/it]
 76%|███████▌  | 28772/37963 [65:19:37<20:12:21,  7.91s/it]
 76%|███████▌  | 28773/37963 [65:19:45<20:02:00,  7.85s/it]
 76%|███████▌  | 28774/37963 [65:19:53<19:56:31,  7.81s/it]
 76%|███████▌  | 28775/37963 [65:20:01<19:57:21,  7.82s/it]
 76%|███████▌  | 28776/37963 [65:20:08<19:40:59,  7.71s/it]
 76%|███████▌  | 28777/37963 [65:20:16<19:45:30,  7.74s/it]
 76%|███████▌  | 28778/37963 [65:20:24<19:48:29,  7.76s/it]
 76%|███████▌  | 28779/37963 [65:20:32<19:50:35,  7.78s/it]
 76%|███████▌  | 28780/37963 [65:20:42<21:47:46,  8.54s/it]
                                                           
{'loss': '0.1173', 'grad_norm': '2.65', 'learning_rate': '2.916e-06', 'epoch': '0.7581'}
+
 76%|███████▌  | 28780/37963 [65:20:42<21:47:46,  8.54s/it]
 76%|███████▌  | 28781/37963 [65:20:50<21:06:17,  8.27s/it]
 76%|███████▌  | 28782/37963 [65:20:57<20:47:03,  8.15s/it]
 76%|███████▌  | 28783/37963 [65:21:13<26:39:10, 10.45s/it]
 76%|███████▌  | 28784/37963 [65:21:21<24:44:07,  9.70s/it]
 76%|███████▌  | 28785/37963 [65:21:31<25:10:07,  9.87s/it]
 76%|███████▌  | 28786/37963 [65:21:39<23:27:20,  9.20s/it]
 76%|███████▌  | 28787/37963 [65:21:47<22:30:27,  8.83s/it]
 76%|███████▌  | 28788/37963 [65:21:55<21:28:05,  8.42s/it]
 76%|███████▌  | 28789/37963 [65:22:02<20:36:45,  8.09s/it]
 76%|███████▌  | 28790/37963 [65:22:10<20:23:21,  8.00s/it]
                                                           
{'loss': '0.1106', 'grad_norm': '1.537', 'learning_rate': '2.91e-06', 'epoch': '0.7584'}
+
 76%|███████▌  | 28790/37963 [65:22:10<20:23:21,  8.00s/it]
 76%|███████▌  | 28791/37963 [65:22:20<22:12:17,  8.72s/it]
 76%|███████▌  | 28792/37963 [65:22:28<21:28:38,  8.43s/it]
 76%|███████▌  | 28793/37963 [65:22:36<21:02:09,  8.26s/it]
 76%|███████▌  | 28794/37963 [65:22:43<20:37:18,  8.10s/it]
 76%|███████▌  | 28795/37963 [65:22:51<20:19:44,  7.98s/it]
 76%|███████▌  | 28796/37963 [65:22:59<20:13:46,  7.94s/it]
 76%|███████▌  | 28797/37963 [65:23:06<19:56:16,  7.83s/it]
 76%|███████▌  | 28798/37963 [65:23:14<20:01:23,  7.87s/it]
 76%|███████▌  | 28799/37963 [65:23:22<19:54:17,  7.82s/it]
 76%|███████▌  | 28800/37963 [65:23:30<19:55:38,  7.83s/it]
                                                           
{'loss': '0.1129', 'grad_norm': '1.995', 'learning_rate': '2.904e-06', 'epoch': '0.7586'}
+
 76%|███████▌  | 28800/37963 [65:23:30<19:55:38,  7.83s/it]
 76%|███████▌  | 28801/37963 [65:23:37<19:37:44,  7.71s/it]
 76%|███████▌  | 28802/37963 [65:23:45<19:46:02,  7.77s/it]
 76%|███████▌  | 28803/37963 [65:23:53<19:27:33,  7.65s/it]
 76%|███████▌  | 28804/37963 [65:24:01<19:42:06,  7.74s/it]
 76%|███████▌  | 28805/37963 [65:24:09<19:47:00,  7.78s/it]
 76%|███████▌  | 28806/37963 [65:24:16<19:52:39,  7.81s/it]
 76%|███████▌  | 28807/37963 [65:24:24<19:37:03,  7.71s/it]
 76%|███████▌  | 28808/37963 [65:24:32<19:51:26,  7.81s/it]
 76%|███████▌  | 28809/37963 [65:24:40<19:59:03,  7.86s/it]
 76%|███████▌  | 28810/37963 [65:24:48<19:52:12,  7.82s/it]
                                                           
{'loss': '0.1165', 'grad_norm': '1.895', 'learning_rate': '2.898e-06', 'epoch': '0.7589'}
+
 76%|███████▌  | 28810/37963 [65:24:48<19:52:12,  7.82s/it]
 76%|███████▌  | 28811/37963 [65:24:58<21:48:13,  8.58s/it]
 76%|███████▌  | 28812/37963 [65:25:06<21:13:33,  8.35s/it]
 76%|███████▌  | 28813/37963 [65:25:13<20:39:14,  8.13s/it]
 76%|███████▌  | 28814/37963 [65:25:21<20:19:00,  7.99s/it]
 76%|███████▌  | 28815/37963 [65:25:29<20:04:03,  7.90s/it]
 76%|███████▌  | 28816/37963 [65:25:37<20:00:06,  7.87s/it]
 76%|███████▌  | 28817/37963 [65:25:44<19:53:53,  7.83s/it]
 76%|███████▌  | 28818/37963 [65:25:52<20:04:43,  7.90s/it]
 76%|███████▌  | 28819/37963 [65:26:00<19:56:43,  7.85s/it]
 76%|███████▌  | 28820/37963 [65:26:08<19:57:47,  7.86s/it]
                                                           
{'loss': '0.1218', 'grad_norm': '2.813', 'learning_rate': '2.892e-06', 'epoch': '0.7592'}
+
 76%|███████▌  | 28820/37963 [65:26:08<19:57:47,  7.86s/it]
 76%|███████▌  | 28821/37963 [65:26:18<21:35:24,  8.50s/it]
 76%|███████▌  | 28822/37963 [65:26:26<21:02:18,  8.29s/it]
 76%|███████▌  | 28823/37963 [65:26:34<20:38:28,  8.13s/it]
 76%|███████▌  | 28824/37963 [65:26:41<20:15:31,  7.98s/it]
 76%|███████▌  | 28825/37963 [65:26:49<19:58:51,  7.87s/it]
 76%|███████▌  | 28826/37963 [65:26:56<19:48:53,  7.81s/it]
 76%|███████▌  | 28827/37963 [65:27:07<21:40:55,  8.54s/it]
 76%|███████▌  | 28828/37963 [65:27:14<20:58:12,  8.26s/it]
 76%|███████▌  | 28829/37963 [65:27:25<22:28:19,  8.86s/it]
 76%|███████▌  | 28830/37963 [65:27:32<21:35:29,  8.51s/it]
                                                           
{'loss': '0.1274', 'grad_norm': '2.113', 'learning_rate': '2.886e-06', 'epoch': '0.7594'}
+
 76%|███████▌  | 28830/37963 [65:27:32<21:35:29,  8.51s/it]
 76%|███████▌  | 28831/37963 [65:27:40<21:08:06,  8.33s/it]
 76%|███████▌  | 28832/37963 [65:27:51<22:48:35,  8.99s/it]
 76%|███████▌  | 28833/37963 [65:27:59<21:54:36,  8.64s/it]
 76%|███████▌  | 28834/37963 [65:28:06<21:16:45,  8.39s/it]
 76%|███████▌  | 28835/37963 [65:28:14<20:52:13,  8.23s/it]
 76%|███████▌  | 28836/37963 [65:28:22<20:23:27,  8.04s/it]
 76%|███████▌  | 28837/37963 [65:28:34<23:49:16,  9.40s/it]
 76%|███████▌  | 28838/37963 [65:28:42<22:40:07,  8.94s/it]
 76%|███████▌  | 28839/37963 [65:28:53<23:41:48,  9.35s/it]
 76%|███████▌  | 28840/37963 [65:29:00<22:20:46,  8.82s/it]
                                                           
{'loss': '0.1266', 'grad_norm': '2.771', 'learning_rate': '2.88e-06', 'epoch': '0.7597'}
+
 76%|███████▌  | 28840/37963 [65:29:00<22:20:46,  8.82s/it]
 76%|███████▌  | 28841/37963 [65:29:08<21:33:21,  8.51s/it]
 76%|███████▌  | 28842/37963 [65:29:16<20:57:02,  8.27s/it]
 76%|███████▌  | 28843/37963 [65:29:23<20:34:43,  8.12s/it]
 76%|███████▌  | 28844/37963 [65:29:31<20:18:10,  8.02s/it]
 76%|███████▌  | 28845/37963 [65:29:39<20:11:37,  7.97s/it]
 76%|███████▌  | 28846/37963 [65:29:47<20:01:58,  7.91s/it]
 76%|███████▌  | 28847/37963 [65:29:54<19:48:39,  7.82s/it]
 76%|███████▌  | 28848/37963 [65:30:02<19:55:39,  7.87s/it]
 76%|███████▌  | 28849/37963 [65:30:10<19:51:16,  7.84s/it]
 76%|███████▌  | 28850/37963 [65:30:18<19:48:57,  7.83s/it]
                                                           
{'loss': '0.1174', 'grad_norm': '2.227', 'learning_rate': '2.874e-06', 'epoch': '0.76'}
+
 76%|███████▌  | 28850/37963 [65:30:18<19:48:57,  7.83s/it]
 76%|███████▌  | 28851/37963 [65:30:25<19:31:56,  7.72s/it]
 76%|███████▌  | 28852/37963 [65:30:33<19:40:13,  7.77s/it]
 76%|███████▌  | 28853/37963 [65:30:41<19:43:40,  7.80s/it]
 76%|███████▌  | 28854/37963 [65:30:49<19:33:10,  7.73s/it]
 76%|███████▌  | 28855/37963 [65:30:59<21:38:52,  8.56s/it]
 76%|███████▌  | 28856/37963 [65:31:07<21:11:41,  8.38s/it]
 76%|███████▌  | 28857/37963 [65:31:15<20:46:06,  8.21s/it]
 76%|███████▌  | 28858/37963 [65:31:23<20:21:46,  8.05s/it]
 76%|███████▌  | 28859/37963 [65:31:30<19:57:41,  7.89s/it]
 76%|█████��█▌  | 28860/37963 [65:31:38<19:53:41,  7.87s/it]
                                                           
{'loss': '0.1178', 'grad_norm': '2.591', 'learning_rate': '2.868e-06', 'epoch': '0.7602'}
+
 76%|███████▌  | 28860/37963 [65:31:38<19:53:41,  7.87s/it]
 76%|███████▌  | 28861/37963 [65:31:46<19:44:32,  7.81s/it]
 76%|███████▌  | 28862/37963 [65:31:54<19:43:45,  7.80s/it]
 76%|███████▌  | 28863/37963 [65:32:01<19:39:02,  7.77s/it]
 76%|███████▌  | 28864/37963 [65:32:09<19:35:55,  7.75s/it]
 76%|███████▌  | 28865/37963 [65:32:17<19:31:15,  7.72s/it]
 76%|███████▌  | 28866/37963 [65:32:25<19:40:28,  7.79s/it]
 76%|███████▌  | 28867/37963 [65:32:32<19:36:48,  7.76s/it]
 76%|███████▌  | 28868/37963 [65:32:39<19:09:21,  7.58s/it]
 76%|███████▌  | 28869/37963 [65:32:47<19:00:01,  7.52s/it]
 76%|███████▌  | 28870/37963 [65:32:57<21:20:26,  8.45s/it]
                                                           
{'loss': '0.1096', 'grad_norm': '2.104', 'learning_rate': '2.862e-06', 'epoch': '0.7605'}
+
 76%|███████▌  | 28870/37963 [65:32:57<21:20:26,  8.45s/it]
 76%|███████▌  | 28871/37963 [65:33:08<22:47:09,  9.02s/it]
 76%|███████▌  | 28872/37963 [65:33:16<21:53:54,  8.67s/it]
 76%|███████▌  | 28873/37963 [65:33:23<21:04:23,  8.35s/it]
 76%|███████▌  | 28874/37963 [65:33:31<20:34:57,  8.15s/it]
 76%|███████▌  | 28875/37963 [65:33:39<20:20:42,  8.06s/it]
 76%|███████▌  | 28876/37963 [65:33:46<20:01:32,  7.93s/it]
 76%|███████▌  | 28877/37963 [65:33:54<19:50:32,  7.86s/it]
 76%|███████▌  | 28878/37963 [65:34:02<19:56:56,  7.90s/it]
 76%|███████▌  | 28879/37963 [65:34:10<20:06:13,  7.97s/it]
 76%|███████▌  | 28880/37963 [65:34:21<22:00:15,  8.72s/it]
                                                           
{'loss': '0.111', 'grad_norm': '2.193', 'learning_rate': '2.856e-06', 'epoch': '0.7607'}
+
 76%|███████▌  | 28880/37963 [65:34:21<22:00:15,  8.72s/it]
 76%|███████▌  | 28881/37963 [65:34:28<21:10:30,  8.39s/it]
 76%|███████▌  | 28882/37963 [65:34:36<20:30:08,  8.13s/it]
 76%|███████▌  | 28883/37963 [65:34:46<22:07:34,  8.77s/it]
 76%|███████▌  | 28884/37963 [65:34:54<21:24:32,  8.49s/it]
 76%|███████▌  | 28885/37963 [65:35:04<22:55:48,  9.09s/it]
 76%|███████▌  | 28886/37963 [65:35:12<21:52:02,  8.67s/it]
 76%|███████▌  | 28887/37963 [65:35:20<21:11:37,  8.41s/it]
 76%|███████▌  | 28888/37963 [65:35:27<20:35:06,  8.17s/it]
 76%|███████▌  | 28889/37963 [65:35:35<20:16:33,  8.04s/it]
 76%|███████▌  | 28890/37963 [65:35:43<20:03:34,  7.96s/it]
                                                           
{'loss': '0.09906', 'grad_norm': '1.901', 'learning_rate': '2.85e-06', 'epoch': '0.761'}
+
 76%|███████▌  | 28890/37963 [65:35:43<20:03:34,  7.96s/it]
 76%|███████▌  | 28891/37963 [65:35:54<22:03:46,  8.76s/it]
 76%|███████▌  | 28892/37963 [65:36:01<21:16:29,  8.44s/it]
 76%|███████▌  | 28893/37963 [65:36:09<20:40:54,  8.21s/it]
 76%|███████▌  | 28894/37963 [65:36:16<20:04:35,  7.97s/it]
 76%|███████▌  | 28895/37963 [65:36:24<19:59:31,  7.94s/it]
 76%|███████▌  | 28896/37963 [65:36:32<19:57:02,  7.92s/it]
 76%|███████▌  | 28897/37963 [65:36:40<19:32:35,  7.76s/it]
 76%|███████▌  | 28898/37963 [65:36:47<19:34:00,  7.77s/it]
 76%|███████▌  | 28899/37963 [65:36:55<19:36:43,  7.79s/it]
 76%|███████▌  | 28900/37963 [65:37:03<19:31:18,  7.75s/it]
                                                           
{'loss': '0.1089', 'grad_norm': '2.41', 'learning_rate': '2.844e-06', 'epoch': '0.7613'}
+
 76%|███████▌  | 28900/37963 [65:37:03<19:31:18,  7.75s/it]
 76%|███████▌  | 28901/37963 [65:37:11<19:36:10,  7.79s/it]
 76%|███████▌  | 28902/37963 [65:37:19<19:43:23,  7.84s/it]
 76%|███████▌  | 28903/37963 [65:37:27<19:50:08,  7.88s/it]
 76%|███████▌  | 28904/37963 [65:37:34<19:34:41,  7.78s/it]
 76%|███████▌  | 28905/37963 [65:37:42<19:34:12,  7.78s/it]
 76%|███████▌  | 28906/37963 [65:37:50<19:33:57,  7.78s/it]
 76%|███████▌  | 28907/37963 [65:37:57<19:26:53,  7.73s/it]
 76%|███████▌  | 28908/37963 [65:38:05<19:16:53,  7.67s/it]
 76%|███████▌  | 28909/37963 [65:38:16<21:39:08,  8.61s/it]
 76%|███████▌  | 28910/37963 [65:38:23<20:54:38,  8.32s/it]
                                                           
{'loss': '0.1079', 'grad_norm': '1.594', 'learning_rate': '2.838e-06', 'epoch': '0.7615'}
+
 76%|███████▌  | 28910/37963 [65:38:23<20:54:38,  8.32s/it]
 76%|███████▌  | 28911/37963 [65:38:31<20:25:23,  8.12s/it]
 76%|███████▌  | 28912/37963 [65:38:38<19:46:28,  7.87s/it]
 76%|███████▌  | 28913/37963 [65:38:46<19:35:45,  7.80s/it]
 76%|███████▌  | 28914/37963 [65:38:54<19:30:10,  7.76s/it]
 76%|███████▌  | 28915/37963 [65:39:01<19:25:45,  7.73s/it]
 76%|███████▌  | 28916/37963 [65:39:09<19:36:55,  7.81s/it]
 76%|███████▌  | 28917/37963 [65:39:17<19:30:24,  7.76s/it]
 76%|███████▌  | 28918/37963 [65:39:25<19:26:26,  7.74s/it]
 76%|███████▌  | 28919/37963 [65:39:32<19:20:28,  7.70s/it]
 76%|███████▌  | 28920/37963 [65:39:42<21:15:12,  8.46s/it]
                                                           
{'loss': '0.1067', 'grad_norm': '2.145', 'learning_rate': '2.832e-06', 'epoch': '0.7618'}
+
 76%|███████▌  | 28920/37963 [65:39:42<21:15:12,  8.46s/it]
 76%|███████▌  | 28921/37963 [65:39:50<20:39:14,  8.22s/it]
 76%|███████▌  | 28922/37963 [65:40:00<22:13:23,  8.85s/it]
 76%|███████▌  | 28923/37963 [65:40:11<23:37:13,  9.41s/it]
 76%|███████▌  | 28924/37963 [65:40:19<22:20:50,  8.90s/it]
 76%|███████▌  | 28925/37963 [65:40:26<21:26:49,  8.54s/it]
 76%|███████▌  | 28926/37963 [65:40:34<20:50:35,  8.30s/it]
 76%|███████▌  | 28927/37963 [65:40:42<20:05:00,  8.00s/it]
 76%|███████▌  | 28928/37963 [65:40:49<19:29:32,  7.77s/it]
 76%|███████▌  | 28929/37963 [65:40:56<19:28:29,  7.76s/it]
 76%|███████▌  | 28930/37963 [65:41:04<19:23:00,  7.73s/it]
                                                           
{'loss': '0.1153', 'grad_norm': '2.416', 'learning_rate': '2.826e-06', 'epoch': '0.7621'}
+
 76%|███████▌  | 28930/37963 [65:41:04<19:23:00,  7.73s/it]
 76%|███████▌  | 28931/37963 [65:41:14<21:04:44,  8.40s/it]
 76%|███████▌  | 28932/37963 [65:41:22<20:37:25,  8.22s/it]
 76%|███████▌  | 28933/37963 [65:41:30<20:10:00,  8.04s/it]
 76%|███████▌  | 28934/37963 [65:41:37<20:02:14,  7.99s/it]
 76%|███████▌  | 28935/37963 [65:41:48<21:40:50,  8.65s/it]
 76%|███████▌  | 28936/37963 [65:41:55<20:57:16,  8.36s/it]
 76%|███████▌  | 28937/37963 [65:42:06<22:24:48,  8.94s/it]
 76%|███████▌  | 28938/37963 [65:42:14<21:46:56,  8.69s/it]
 76%|███████▌  | 28939/37963 [65:42:24<22:55:16,  9.14s/it]
 76%|███████▌  | 28940/37963 [65:42:32<22:00:03,  8.78s/it]
                                                           
{'loss': '0.1151', 'grad_norm': '1.691', 'learning_rate': '2.82e-06', 'epoch': '0.7623'}
+
 76%|███████▌  | 28940/37963 [65:42:32<22:00:03,  8.78s/it]
 76%|███████▌  | 28941/37963 [65:42:39<21:04:15,  8.41s/it]
 76%|███████▌  | 28942/37963 [65:42:47<20:27:57,  8.17s/it]
 76%|███████▌  | 28943/37963 [65:42:55<20:26:52,  8.16s/it]
 76%|███████▌  | 28944/37963 [65:43:03<20:07:10,  8.03s/it]
 76%|███████▌  | 28945/37963 [65:43:11<19:58:10,  7.97s/it]
 76%|███████▌  | 28946/37963 [65:43:18<19:51:54,  7.93s/it]
 76%|███████▋  | 28947/37963 [65:43:26<19:36:58,  7.83s/it]
 76%|███████▋  | 28948/37963 [65:43:34<19:43:37,  7.88s/it]
 76%|███████▋  | 28949/37963 [65:43:42<19:32:55,  7.81s/it]
 76%|███████▋  | 28950/37963 [65:43:49<19:31:13,  7.80s/it]
                                                           
{'loss': '0.1067', 'grad_norm': '2.738', 'learning_rate': '2.814e-06', 'epoch': '0.7626'}
+
 76%|███████▋  | 28950/37963 [65:43:49<19:31:13,  7.80s/it]
 76%|███████▋  | 28951/37963 [65:43:57<19:29:19,  7.79s/it]
 76%|███████▋  | 28952/37963 [65:44:05<19:23:54,  7.75s/it]
 76%|███████▋  | 28953/37963 [65:44:13<19:26:37,  7.77s/it]
 76%|███████▋  | 28954/37963 [65:44:20<19:23:44,  7.75s/it]
 76%|███████▋  | 28955/37963 [65:44:28<19:12:52,  7.68s/it]
 76%|███████▋  | 28956/37963 [65:44:36<19:20:24,  7.73s/it]
 76%|███████▋  | 28957/37963 [65:44:46<21:07:23,  8.44s/it]
 76%|███████▋  | 28958/37963 [65:44:53<20:27:24,  8.18s/it]
 76%|███████▋  | 28959/37963 [65:45:01<19:51:33,  7.94s/it]
 76%|███████▋  | 28960/37963 [65:45:08<19:21:49,  7.74s/it]
                                                           
{'loss': '0.1205', 'grad_norm': '2.539', 'learning_rate': '2.808e-06', 'epoch': '0.7629'}
+
 76%|███████▋  | 28960/37963 [65:45:08<19:21:49,  7.74s/it]
 76%|███████▋  | 28961/37963 [65:45:16<19:06:16,  7.64s/it]
 76%|���██████▋  | 28962/37963 [65:45:23<19:12:35,  7.68s/it]
 76%|███████▋  | 28963/37963 [65:45:31<19:16:22,  7.71s/it]
 76%|███████▋  | 28964/37963 [65:45:39<19:15:33,  7.70s/it]
 76%|███████▋  | 28965/37963 [65:45:52<23:11:19,  9.28s/it]
 76%|███████▋  | 28966/37963 [65:46:00<22:04:06,  8.83s/it]
 76%|███████▋  | 28967/37963 [65:46:10<23:32:06,  9.42s/it]
 76%|███████▋  | 28968/37963 [65:46:18<22:01:02,  8.81s/it]
 76%|███████▋  | 28969/37963 [65:46:25<20:55:51,  8.38s/it]
 76%|███████▋  | 28970/37963 [65:46:33<20:28:52,  8.20s/it]
                                                           
{'loss': '0.09954', 'grad_norm': '2.64', 'learning_rate': '2.802e-06', 'epoch': '0.7631'}
+
 76%|███████▋  | 28970/37963 [65:46:33<20:28:52,  8.20s/it]
 76%|███████▋  | 28971/37963 [65:46:41<20:12:10,  8.09s/it]
 76%|███████▋  | 28972/37963 [65:46:49<20:03:54,  8.03s/it]
 76%|███████▋  | 28973/37963 [65:46:56<19:57:44,  7.99s/it]
 76%|███████▋  | 28974/37963 [65:47:04<19:42:23,  7.89s/it]
 76%|███████▋  | 28975/37963 [65:47:12<19:40:40,  7.88s/it]
 76%|███████▋  | 28976/37963 [65:47:20<19:37:23,  7.86s/it]
 76%|███████▋  | 28977/37963 [65:47:28<19:29:51,  7.81s/it]
 76%|███████▋  | 28978/37963 [65:47:35<19:17:38,  7.73s/it]
 76%|███████▋  | 28979/37963 [65:47:48<23:03:22,  9.24s/it]
 76%|███████▋  | 28980/37963 [65:47:56<22:00:02,  8.82s/it]
                                                           
{'loss': '0.1306', 'grad_norm': '3.005', 'learning_rate': '2.796e-06', 'epoch': '0.7634'}
+
 76%|███████▋  | 28980/37963 [65:47:56<22:00:02,  8.82s/it]
 76%|███████▋  | 28981/37963 [65:48:06<23:14:27,  9.31s/it]
 76%|███████▋  | 28982/37963 [65:48:14<22:07:22,  8.87s/it]
 76%|███████▋  | 28983/37963 [65:48:24<23:21:46,  9.37s/it]
 76%|███████▋  | 28984/37963 [65:48:32<22:13:02,  8.91s/it]
 76%|███████▋  | 28985/37963 [65:48:40<21:22:11,  8.57s/it]
 76%|███████▋  | 28986/37963 [65:48:48<20:31:21,  8.23s/it]
 76%|███████▋  | 28987/37963 [65:48:55<20:14:52,  8.12s/it]
 76%|███████▋  | 28988/37963 [65:49:03<20:02:41,  8.04s/it]
 76%|███████▋  | 28989/37963 [65:49:11<19:51:35,  7.97s/it]
 76%|███████▋  | 28990/37963 [65:49:19<19:39:23,  7.89s/it]
                                                           
{'loss': '0.112', 'grad_norm': '2.163', 'learning_rate': '2.79e-06', 'epoch': '0.7636'}
+
 76%|███████▋  | 28990/37963 [65:49:19<19:39:23,  7.89s/it]
 76%|███████▋  | 28991/37963 [65:49:27<19:36:33,  7.87s/it]
 76%|███████▋  | 28992/37963 [65:49:34<19:30:05,  7.83s/it]
 76%|███████▋  | 28993/37963 [65:49:42<19:33:36,  7.85s/it]
 76%|███████▋  | 28994/37963 [65:49:50<19:26:29,  7.80s/it]
 76%|███████▋  | 28995/37963 [65:49:58<19:30:21,  7.83s/it]
 76%|███████▋  | 28996/37963 [65:50:06<19:32:50,  7.85s/it]
 76%|███████▋  | 28997/37963 [65:50:14<19:32:44,  7.85s/it]
 76%|███████▋  | 28998/37963 [65:50:21<19:35:20,  7.87s/it]
 76%|███████▋  | 28999/37963 [65:50:29<19:38:04,  7.89s/it]
 76%|███████▋  | 29000/37963 [65:50:37<19:31:47,  7.84s/it]
                                                           
{'loss': '0.1074', 'grad_norm': '3.923', 'learning_rate': '2.784e-06', 'epoch': '0.7639'}
+
 76%|███████▋  | 29000/37963 [65:50:37<19:31:47,  7.84s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.98s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.98s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 76%|███████▋  | 29001/37963 [65:51:37<58:42:59, 23.59s/it]
 76%|███████▋  | 29002/37963 [65:51:45<46:49:03, 18.81s/it]
 76%|███████▋  | 29003/37963 [65:51:53<38:26:12, 15.44s/it]
 76%|███████▋  | 29004/37963 [65:52:00<32:35:25, 13.10s/it]
 76%|███████▋  | 29005/37963 [65:52:08<28:38:47, 11.51s/it]
 76%|███████▋  | 29006/37963 [65:52:16<25:44:51, 10.35s/it]
 76%|███████▋  | 29007/37963 [65:52:24<23:50:50,  9.59s/it]
 76%|███████▋  | 29008/37963 [65:52:31<22:31:28,  9.06s/it]
 76%|███████▋  | 29009/37963 [65:52:39<21:33:01,  8.66s/it]
 76%|███████▋  | 29010/37963 [65:52:47<20:51:06,  8.38s/it]
                                                           
{'loss': '0.1183', 'grad_norm': '2.439', 'learning_rate': '2.779e-06', 'epoch': '0.7642'}
+
 76%|███████▋  | 29010/37963 [65:52:47<20:51:06,  8.38s/it]
 76%|███████▋  | 29011/37963 [65:52:55<20:23:44,  8.20s/it]
 76%|███████▋  | 29012/37963 [65:53:05<22:05:42,  8.89s/it]
 76%|███████▋  | 29013/37963 [65:53:13<21:07:19,  8.50s/it]
 76%|███████▋  | 29014/37963 [65:53:23<22:14:35,  8.95s/it]
 76%|███████▋  | 29015/37963 [65:53:31<21:31:00,  8.66s/it]
 76%|███████▋  | 29016/37963 [65:53:38<20:46:05,  8.36s/it]
 76%|███████▋  | 29017/37963 [65:53:46<20:19:43,  8.18s/it]
 76%|███████▋  | 29018/37963 [65:53:57<22:07:13,  8.90s/it]
 76%|███████▋  | 29019/37963 [65:54:04<21:15:25,  8.56s/it]
 76%|███████▋  | 29020/37963 [65:54:12<20:41:13,  8.33s/it]
                                                           
{'loss': '0.1149', 'grad_norm': '2.871', 'learning_rate': '2.773e-06', 'epoch': '0.7644'}
+
 76%|███████▋  | 29020/37963 [65:54:12<20:41:13,  8.33s/it]
 76%|███████▋  | 29021/37963 [65:54:20<20:17:33,  8.17s/it]
 76%|███████▋  | 29022/37963 [65:54:28<20:08:22,  8.11s/it]
 76%|███████▋  | 29023/37963 [65:54:35<19:36:22,  7.90s/it]
 76%|███████▋  | 29024/37963 [65:54:46<21:17:58,  8.58s/it]
 76%|███████▋  | 29025/37963 [65:54:53<20:46:08,  8.37s/it]
 76%|███████▋  | 29026/37963 [65:55:01<20:18:01,  8.18s/it]
 76%|███████▋  | 29027/37963 [65:55:12<21:58:15,  8.85s/it]
 76%|███████▋  | 29028/37963 [65:55:22<23:01:29,  9.28s/it]
 76%|███████▋  | 29029/37963 [65:55:30<21:52:56,  8.82s/it]
 76%|███████▋  | 29030/37963 [65:55:40<23:03:47,  9.29s/it]
                                                           
{'loss': '0.114', 'grad_norm': '2.424', 'learning_rate': '2.767e-06', 'epoch': '0.7647'}
+
 76%|███████▋  | 29030/37963 [65:55:40<23:03:47,  9.29s/it]
 76%|███████▋  | 29031/37963 [65:55:48<21:49:01,  8.79s/it]
 76%|███████▋  | 29032/37963 [65:55:55<20:48:26,  8.39s/it]
 76%|███████▋  | 29033/37963 [65:56:03<20:16:55,  8.18s/it]
 76%|███████▋  | 29034/37963 [65:56:11<20:02:41,  8.08s/it]
 76%|███████▋  | 29035/37963 [65:56:18<19:42:45,  7.95s/it]
 76%|███████▋  | 29036/37963 [65:56:26<19:31:17,  7.87s/it]
 76%|███████▋  | 29037/37963 [65:56:34<19:21:59,  7.81s/it]
 76%|███████▋  | 29038/37963 [65:56:41<19:19:18,  7.79s/it]
 76%|███████▋  | 29039/37963 [65:56:49<19:19:33,  7.80s/it]
 76%|███████▋  | 29040/37963 [65:56:57<19:22:17,  7.82s/it]
                                                           
{'loss': '0.1221', 'grad_norm': '2.161', 'learning_rate': '2.761e-06', 'epoch': '0.765'}
+
 76%|███████▋  | 29040/37963 [65:56:57<19:22:17,  7.82s/it]
 76%|███████▋  | 29041/37963 [65:57:05<19:28:26,  7.86s/it]
 77%|███████▋  | 29042/37963 [65:57:13<19:27:29,  7.85s/it]
 77%|███████▋  | 29043/37963 [65:57:20<19:03:36,  7.69s/it]
 77%|███████▋  | 29044/37963 [65:57:28<18:55:50,  7.64s/it]
 77%|███████▋  | 29045/37963 [65:57:36<19:06:07,  7.71s/it]
 77%|███████▋  | 29046/37963 [65:57:43<19:08:16,  7.73s/it]
 77%|███████▋  | 29047/37963 [65:57:51<18:57:26,  7.65s/it]
 77%|███████▋  | 29048/37963 [65:57:58<18:58:45,  7.66s/it]
 77%|███████▋  | 29049/37963 [65:58:09<21:05:37,  8.52s/it]
 77%|███████▋  | 29050/37963 [65:58:17<20:31:19,  8.29s/it]
                                                           
{'loss': '0.1028', 'grad_norm': '2.706', 'learning_rate': '2.755e-06', 'epoch': '0.7652'}
+
 77%|███████▋  | 29050/37963 [65:58:17<20:31:19,  8.29s/it]
 77%|███████▋  | 29051/37963 [65:58:25<20:07:48,  8.13s/it]
 77%|███████▋  | 29052/37963 [65:58:32<19:38:31,  7.94s/it]
 77%|███████▋  | 29053/37963 [65:58:39<19:11:47,  7.76s/it]
 77%|███████▋  | 29054/37963 [65:58:47<19:28:09,  7.87s/it]
 77%|███████▋  | 29055/37963 [65:58:55<19:25:19,  7.85s/it]
 77%|███████▋  | 29056/37963 [65:59:03<19:18:54,  7.81s/it]
 77%|███████▋  | 29057/37963 [65:59:11<19:12:32,  7.76s/it]
 77%|███████▋  | 29058/37963 [65:59:19<19:20:48,  7.82s/it]
 77%|███████▋  | 29059/37963 [65:59:26<19:10:41,  7.75s/it]
 77%|███████▋  | 29060/37963 [65:59:37<21:12:43,  8.58s/it]
                                                           
{'loss': '0.1081', 'grad_norm': '2.422', 'learning_rate': '2.749e-06', 'epoch': '0.7655'}
+
 77%|██���████▋  | 29060/37963 [65:59:37<21:12:43,  8.58s/it]
 77%|███████▋  | 29061/37963 [65:59:45<20:42:21,  8.37s/it]
 77%|███████▋  | 29062/37963 [65:59:52<20:21:04,  8.23s/it]
 77%|███████▋  | 29063/37963 [66:00:01<20:11:46,  8.17s/it]
 77%|███████▋  | 29064/37963 [66:00:10<21:29:56,  8.70s/it]
 77%|███████▋  | 29065/37963 [66:00:18<20:40:18,  8.36s/it]
 77%|███████▋  | 29066/37963 [66:00:26<20:01:33,  8.10s/it]
 77%|███████▋  | 29067/37963 [66:00:36<21:50:25,  8.84s/it]
 77%|███████▋  | 29068/37963 [66:00:44<21:07:50,  8.55s/it]
 77%|███████▋  | 29069/37963 [66:00:52<20:41:40,  8.38s/it]
 77%|███████▋  | 29070/37963 [66:01:00<20:26:04,  8.27s/it]
                                                           
{'loss': '0.1094', 'grad_norm': '2.098', 'learning_rate': '2.743e-06', 'epoch': '0.7657'}
+
 77%|███████▋  | 29070/37963 [66:01:00<20:26:04,  8.27s/it]
 77%|███████▋  | 29071/37963 [66:01:08<19:57:54,  8.08s/it]
 77%|███████▋  | 29072/37963 [66:01:21<23:51:39,  9.66s/it]
 77%|███████▋  | 29073/37963 [66:01:29<22:23:29,  9.07s/it]
 77%|███████▋  | 29074/37963 [66:01:36<21:23:24,  8.66s/it]
 77%|███████▋  | 29075/37963 [66:01:44<20:32:27,  8.32s/it]
 77%|███████▋  | 29076/37963 [66:01:52<20:09:31,  8.17s/it]
 77%|███████▋  | 29077/37963 [66:02:02<21:47:25,  8.83s/it]
 77%|███████▋  | 29078/37963 [66:02:10<21:05:30,  8.55s/it]
 77%|███████▋  | 29079/37963 [66:02:18<20:33:10,  8.33s/it]
 77%|███████▋  | 29080/37963 [66:02:26<20:24:35,  8.27s/it]
                                                           
{'loss': '0.1208', 'grad_norm': '2.189', 'learning_rate': '2.737e-06', 'epoch': '0.766'}
+
 77%|███████▋  | 29080/37963 [66:02:26<20:24:35,  8.27s/it]
 77%|███████▋  | 29081/37963 [66:02:33<19:49:05,  8.03s/it]
 77%|███████▋  | 29082/37963 [66:02:41<19:40:59,  7.98s/it]
 77%|███████▋  | 29083/37963 [66:02:49<19:41:58,  7.99s/it]
 77%|███████▋  | 29084/37963 [66:02:59<21:22:32,  8.67s/it]
 77%|███████▋  | 29085/37963 [66:03:07<20:51:55,  8.46s/it]
 77%|███████▋  | 29086/37963 [66:03:15<20:14:21,  8.21s/it]
 77%|███████▋  | 29087/37963 [66:03:23<19:47:22,  8.03s/it]
 77%|███████▋  | 29088/37963 [66:03:30<19:33:05,  7.93s/it]
 77%|███████▋  | 29089/37963 [66:03:38<19:23:51,  7.87s/it]
 77%|███████▋  | 29090/37963 [66:03:46<19:24:20,  7.87s/it]
                                                           
{'loss': '0.1217', 'grad_norm': '2.681', 'learning_rate': '2.732e-06', 'epoch': '0.7663'}
+
 77%|███████▋  | 29090/37963 [66:03:46<19:24:20,  7.87s/it]
 77%|███████▋  | 29091/37963 [66:03:54<19:35:48,  7.95s/it]
 77%|███████▋  | 29092/37963 [66:04:01<19:04:17,  7.74s/it]
 77%|███████▋  | 29093/37963 [66:04:12<21:25:21,  8.69s/it]
 77%|███████▋  | 29094/37963 [66:04:20<20:28:42,  8.31s/it]
 77%|███████▋  | 29095/37963 [66:04:27<19:58:37,  8.11s/it]
 77%|███████▋  | 29096/37963 [66:04:35<19:39:28,  7.98s/it]
 77%|███████▋  | 29097/37963 [66:04:43<19:20:40,  7.85s/it]
 77%|███████▋  | 29098/37963 [66:04:50<19:12:28,  7.80s/it]
 77%|███████▋  | 29099/37963 [66:04:58<19:17:26,  7.83s/it]
 77%|███████▋  | 29100/37963 [66:05:06<19:06:22,  7.76s/it]
                                                           
{'loss': '0.1108', 'grad_norm': '1.931', 'learning_rate': '2.726e-06', 'epoch': '0.7665'}
+
 77%|███████▋  | 29100/37963 [66:05:06<19:06:22,  7.76s/it]
 77%|███████▋  | 29101/37963 [66:05:13<18:50:44,  7.66s/it]
 77%|███████▋  | 29102/37963 [66:05:21<18:59:29,  7.72s/it]
 77%|███████▋  | 29103/37963 [66:05:29<19:04:38,  7.75s/it]
 77%|███████▋  | 29104/37963 [66:05:37<19:02:09,  7.74s/it]
 77%|███████▋  | 29105/37963 [66:05:44<19:06:38,  7.77s/it]
 77%|███████▋  | 29106/37963 [66:05:52<19:00:09,  7.72s/it]
 77%|███████▋  | 29107/37963 [66:06:00<18:59:32,  7.72s/it]
 77%|███████▋  | 29108/37963 [66:06:10<21:13:02,  8.63s/it]
 77%|███████▋  | 29109/37963 [66:06:19<20:52:21,  8.49s/it]
 77%|███████▋  | 29110/37963 [66:06:26<20:21:54,  8.28s/it]
                                                           
{'loss': '0.1273', 'grad_norm': '2.674', 'learning_rate': '2.72e-06', 'epoch': '0.7668'}
+
 77%|███████▋  | 29110/37963 [66:06:26<20:21:54,  8.28s/it]
 77%|███████▋  | 29111/37963 [66:06:34<20:01:56,  8.15s/it]
 77%|███████▋  | 29112/37963 [66:06:42<19:45:07,  8.03s/it]
 77%|███████▋  | 29113/37963 [66:06:50<19:42:28,  8.02s/it]
 77%|███████▋  | 29114/37963 [66:06:58<19:42:26,  8.02s/it]
 77%|███████▋  | 29115/37963 [66:07:08<21:20:52,  8.69s/it]
 77%|███████▋  | 29116/37963 [66:07:16<20:35:21,  8.38s/it]
 77%|███████▋  | 29117/37963 [66:07:24<20:10:29,  8.21s/it]
 77%|███████▋  | 29118/37963 [66:07:32<19:49:26,  8.07s/it]
 77%|███████▋  | 29119/37963 [66:07:39<19:17:30,  7.85s/it]
 77%|███████▋  | 29120/37963 [66:07:49<20:52:04,  8.50s/it]
                                                           
{'loss': '0.09882', 'grad_norm': '2.034', 'learning_rate': '2.714e-06', 'epoch': '0.7671'}
+
 77%|███████▋  | 29120/37963 [66:07:49<20:52:04,  8.50s/it]
 77%|███████▋  | 29121/37963 [66:08:02<24:03:19,  9.79s/it]
 77%|███████▋  | 29122/37963 [66:08:09<22:26:26,  9.14s/it]
 77%|███████▋  | 29123/37963 [66:08:17<21:27:41,  8.74s/it]
 77%|███████▋  | 29124/37963 [66:08:25<20:35:39,  8.39s/it]
 77%|███████▋  | 29125/37963 [66:08:32<20:03:45,  8.17s/it]
 77%|███████▋  | 29126/37963 [66:08:40<19:46:22,  8.06s/it]
 77%|███████▋  | 29127/37963 [66:08:50<21:25:22,  8.73s/it]
 77%|███████▋  | 29128/37963 [66:08:58<20:48:01,  8.48s/it]
 77%|███████▋  | 29129/37963 [66:09:06<20:20:26,  8.29s/it]
 77%|███████▋  | 29130/37963 [66:09:14<19:56:54,  8.13s/it]
                                                           
{'loss': '0.1165', 'grad_norm': '2.023', 'learning_rate': '2.708e-06', 'epoch': '0.7673'}
+
 77%|███████▋  | 29130/37963 [66:09:14<19:56:54,  8.13s/it]
 77%|███████▋  | 29131/37963 [66:09:22<19:41:20,  8.03s/it]
 77%|███████▋  | 29132/37963 [66:09:30<19:34:29,  7.98s/it]
 77%|███████▋  | 29133/37963 [66:09:37<19:21:27,  7.89s/it]
 77%|███████▋  | 29134/37963 [66:09:45<19:07:16,  7.80s/it]
 77%|███████▋  | 29135/37963 [66:09:52<18:58:09,  7.74s/it]
 77%|███████▋  | 29136/37963 [66:10:00<19:05:34,  7.79s/it]
 77%|███████▋  | 29137/37963 [66:10:08<19:06:51,  7.80s/it]
 77%|███████▋  | 29138/37963 [66:10:16<19:00:57,  7.76s/it]
 77%|███████▋  | 29139/37963 [66:10:24<19:10:33,  7.82s/it]
 77%|███████▋  | 29140/37963 [66:10:31<19:01:25,  7.76s/it]
                                                           
{'loss': '0.1147', 'grad_norm': '2.271', 'learning_rate': '2.702e-06', 'epoch': '0.7676'}
+
 77%|███████▋  | 29140/37963 [66:10:31<19:01:25,  7.76s/it]
 77%|███████▋  | 29141/37963 [66:10:42<21:03:40,  8.59s/it]
 77%|███████▋  | 29142/37963 [66:10:50<20:26:35,  8.34s/it]
 77%|███████▋  | 29143/37963 [66:10:58<20:07:05,  8.21s/it]
 77%|███████▋  | 29144/37963 [66:11:05<19:44:00,  8.06s/it]
 77%|███████▋  | 29145/37963 [66:11:13<19:30:45,  7.97s/it]
 77%|███████▋  | 29146/37963 [66:11:21<19:12:30,  7.84s/it]
 77%|███████▋  | 29147/37963 [66:11:28<19:10:55,  7.83s/it]
 77%|███████▋  | 29148/37963 [66:11:36<19:02:34,  7.78s/it]
 77%|███████▋  | 29149/37963 [66:11:44<18:54:08,  7.72s/it]
 77%|███████▋  | 29150/37963 [66:11:52<19:03:02,  7.78s/it]
                                                           
{'loss': '0.1147', 'grad_norm': '1.96', 'learning_rate': '2.696e-06', 'epoch': '0.7679'}
+
 77%|███████▋  | 29150/37963 [66:11:52<19:03:02,  7.78s/it]
 77%|███████▋  | 29151/37963 [66:12:00<19:21:28,  7.91s/it]
 77%|███████▋  | 29152/37963 [66:12:10<21:22:23,  8.73s/it]
 77%|███████▋  | 29153/37963 [66:12:18<20:25:25,  8.35s/it]
 77%|███████▋  | 29154/37963 [66:12:25<19:46:39,  8.08s/it]
 77%|███████▋  | 29155/37963 [66:12:33<19:26:48,  7.95s/it]
 77%|███████▋  | 29156/37963 [66:12:41<19:15:48,  7.87s/it]
 77%|███████▋  | 29157/37963 [66:12:49<19:22:26,  7.92s/it]
 77%|███████▋  | 29158/37963 [66:12:57<19:23:40,  7.93s/it]
 77%|███████▋  | 29159/37963 [66:13:07<21:12:10,  8.67s/it]
 77%|███████▋  | 29160/37963 [66:13:15<20:45:21,  8.49s/it]
                                                           
{'loss': '0.1085', 'grad_norm': '2.171', 'learning_rate': '2.691e-06', 'epoch': '0.7681'}
+
 77%|███████▋  | 29160/37963 [66:13:15<20:45:21,  8.49s/it]
 77%|███████▋  | 29161/37963 [66:13:23<20:19:40,  8.31s/it]
 77%|███████▋  | 29162/37963 [66:13:31<19:53:09,  8.13s/it]
 77%|███████▋  | 29163/37963 [66:13:39<19:37:24,  8.03s/it]
 77%|███████▋  | 29164/37963 [66:13:49<21:17:08,  8.71s/it]
 77%|███████▋  | 29165/37963 [66:13:57<20:48:04,  8.51s/it]
 77%|███████▋  | 29166/37963 [66:14:07<22:09:09,  9.07s/it]
 77%|███████▋  | 29167/37963 [66:14:15<21:29:57,  8.80s/it]
 77%|███████▋  | 29168/37963 [66:14:26<22:32:20,  9.23s/it]
 77%|███████▋  | 29169/37963 [66:14:33<21:27:39,  8.79s/it]
 77%|███████▋  | 29170/37963 [66:14:41<20:40:59,  8.47s/it]
                                                           
{'loss': '0.09874', 'grad_norm': '2.267', 'learning_rate': '2.685e-06', 'epoch': '0.7684'}
+
 77%|███████▋  | 29170/37963 [66:14:41<20:40:59,  8.47s/it]
 77%|███████▋  | 29171/37963 [66:14:49<20:14:47,  8.29s/it]
 77%|███████▋  | 29172/37963 [66:14:59<21:37:58,  8.86s/it]
 77%|███████▋  | 29173/37963 [66:15:07<20:33:10,  8.42s/it]
 77%|███████▋  | 29174/37963 [66:15:14<19:48:08,  8.11s/it]
 77%|███████▋  | 29175/37963 [66:15:22<19:34:03,  8.02s/it]
 77%|███████▋  | 29176/37963 [66:15:30<19:22:53,  7.94s/it]
 77%|███████▋  | 29177/37963 [66:15:37<19:23:14,  7.94s/it]
 77%|███████▋  | 29178/37963 [66:15:45<19:11:35,  7.87s/it]
 77%|███████▋  | 29179/37963 [66:15:53<19:10:06,  7.86s/it]
 77%|███████▋  | 29180/37963 [66:16:01<18:57:36,  7.77s/it]
                                                           
{'loss': '0.1189', 'grad_norm': '3.204', 'learning_rate': '2.679e-06', 'epoch': '0.7686'}
+
 77%|███████▋  | 29180/37963 [66:16:01<18:57:36,  7.77s/it]
 77%|███████▋  | 29181/37963 [66:16:08<18:56:23,  7.76s/it]
 77%|███████▋  | 29182/37963 [66:16:19<20:44:18,  8.50s/it]
 77%|███████▋  | 29183/37963 [66:16:26<20:10:07,  8.27s/it]
 77%|███████▋  | 29184/37963 [66:16:34<19:48:47,  8.12s/it]
 77%|███████▋  | 29185/37963 [66:16:42<19:32:21,  8.01s/it]
 77%|███████▋  | 29186/37963 [66:16:50<19:31:55,  8.01s/it]
 77%|███████▋  | 29187/37963 [66:16:58<19:28:22,  7.99s/it]
 77%|███████▋  | 29188/37963 [66:17:05<19:13:27,  7.89s/it]
 77%|███████▋  | 29189/37963 [66:17:13<19:01:10,  7.80s/it]
 77%|███████▋  | 29190/37963 [66:17:21<18:55:18,  7.76s/it]
                                                           
{'loss': '0.109', 'grad_norm': '2.25', 'learning_rate': '2.673e-06', 'epoch': '0.7689'}
+
 77%|███████▋  | 29190/37963 [66:17:21<18:55:18,  7.76s/it]
 77%|███████▋  | 29191/37963 [66:17:29<19:09:50,  7.86s/it]
 77%|███████▋  | 29192/37963 [66:17:37<19:03:35,  7.82s/it]
 77%|███████▋  | 29193/37963 [66:17:44<19:02:31,  7.82s/it]
 77%|███████▋  | 29194/37963 [66:17:55<20:54:24,  8.58s/it]
 77%|███████▋  | 29195/37963 [66:18:02<20:15:44,  8.32s/it]
 77%|███████▋  | 29196/37963 [66:18:13<21:49:25,  8.96s/it]
 77%|███████▋  | 29197/37963 [66:18:20<20:46:30,  8.53s/it]
 77%|███████▋  | 29198/37963 [66:18:28<20:25:03,  8.39s/it]
 77%|███████▋  | 29199/37963 [66:18:36<19:52:07,  8.16s/it]
 77%|███████▋  | 29200/37963 [66:18:44<19:29:31,  8.01s/it]
                                                           
{'loss': '0.101', 'grad_norm': '3.131', 'learning_rate': '2.667e-06', 'epoch': '0.7692'}
+
 77%|███████▋  | 29200/37963 [66:18:44<19:29:31,  8.01s/it]
 77%|███████▋  | 29201/37963 [66:18:52<19:20:35,  7.95s/it]
 77%|███████▋  | 29202/37963 [66:18:59<19:13:58,  7.90s/it]
 77%|███████▋  | 29203/37963 [66:19:07<19:12:14,  7.89s/it]
 77%|███████▋  | 29204/37963 [66:19:15<18:52:59,  7.76s/it]
 77%|███████▋  | 29205/37963 [66:19:22<18:57:01,  7.79s/it]
 77%|███████▋  | 29206/37963 [66:19:33<20:51:45,  8.58s/it]
 77%|███████▋  | 29207/37963 [66:19:41<20:25:15,  8.40s/it]
 77%|███████▋  | 29208/37963 [66:19:51<21:56:26,  9.02s/it]
 77%|███████▋  | 29209/37963 [66:19:59<21:05:57,  8.68s/it]
 77%|███████▋  | 29210/37963 [66:20:07<20:24:52,  8.40s/it]
                                                           
{'loss': '0.1148', 'grad_norm': '2.583', 'learning_rate': '2.662e-06', 'epoch': '0.7694'}
+
 77%|███████▋  | 29210/37963 [66:20:07<20:24:52,  8.40s/it]
 77%|███████▋  | 29211/37963 [66:20:14<19:42:48,  8.11s/it]
 77%|███████▋  | 29212/37963 [66:20:22<19:26:31,  8.00s/it]
 77%|███████▋  | 29213/37963 [66:20:29<18:57:21,  7.80s/it]
 77%|███████▋  | 29214/37963 [66:20:40<20:36:34,  8.48s/it]
 77%|███████▋  | 29215/37963 [66:20:47<19:56:58,  8.21s/it]
 77%|███████▋  | 29216/37963 [66:20:55<19:38:25,  8.08s/it]
 77%|██████���▋  | 29217/37963 [66:21:03<19:32:25,  8.04s/it]
 77%|███████▋  | 29218/37963 [66:21:10<19:13:05,  7.91s/it]
 77%|███████▋  | 29219/37963 [66:21:18<19:00:47,  7.83s/it]
 77%|███████▋  | 29220/37963 [66:21:26<18:54:40,  7.79s/it]
                                                           
{'loss': '0.1184', 'grad_norm': '2.265', 'learning_rate': '2.656e-06', 'epoch': '0.7697'}
+
 77%|███████▋  | 29220/37963 [66:21:26<18:54:40,  7.79s/it]
 77%|███████▋  | 29221/37963 [66:21:34<18:51:20,  7.76s/it]
 77%|███████▋  | 29222/37963 [66:21:44<20:58:56,  8.64s/it]
 77%|███████▋  | 29223/37963 [66:21:52<20:19:27,  8.37s/it]
 77%|███████▋  | 29224/37963 [66:22:00<19:56:27,  8.21s/it]
 77%|███████▋  | 29225/37963 [66:22:07<19:30:53,  8.04s/it]
 77%|███████▋  | 29226/37963 [66:22:18<21:26:14,  8.83s/it]
 77%|███████▋  | 29227/37963 [66:22:26<20:40:47,  8.52s/it]
 77%|███████▋  | 29228/37963 [66:22:34<20:04:05,  8.27s/it]
 77%|███████▋  | 29229/37963 [66:22:41<19:37:47,  8.09s/it]
 77%|███████▋  | 29230/37963 [66:22:49<19:07:23,  7.88s/it]
                                                           
{'loss': '0.1022', 'grad_norm': '1.922', 'learning_rate': '2.65e-06', 'epoch': '0.77'}
+
 77%|███████▋  | 29230/37963 [66:22:49<19:07:23,  7.88s/it]
 77%|███████▋  | 29231/37963 [66:22:59<20:49:18,  8.58s/it]
 77%|███████▋  | 29232/37963 [66:23:07<20:10:05,  8.32s/it]
 77%|███████▋  | 29233/37963 [66:23:14<19:51:50,  8.19s/it]
 77%|███████▋  | 29234/37963 [66:23:22<19:40:18,  8.11s/it]
 77%|███████▋  | 29235/37963 [66:23:30<19:31:29,  8.05s/it]
 77%|███████▋  | 29236/37963 [66:23:38<19:25:43,  8.01s/it]
 77%|███████▋  | 29237/37963 [66:23:46<19:08:33,  7.90s/it]
 77%|███████▋  | 29238/37963 [66:23:54<19:11:59,  7.92s/it]
 77%|███████▋  | 29239/37963 [66:24:05<21:16:04,  8.78s/it]
 77%|███████▋  | 29240/37963 [66:24:13<20:51:14,  8.61s/it]
                                                           
{'loss': '0.1114', 'grad_norm': '2.782', 'learning_rate': '2.644e-06', 'epoch': '0.7702'}
+
 77%|███████▋  | 29240/37963 [66:24:13<20:51:14,  8.61s/it]
 77%|███████▋  | 29241/37963 [66:24:21<20:16:46,  8.37s/it]
 77%|███████▋  | 29242/37963 [66:24:28<19:49:22,  8.18s/it]
 77%|███████▋  | 29243/37963 [66:24:36<19:35:21,  8.09s/it]
 77%|███████▋  | 29244/37963 [66:24:44<19:14:11,  7.94s/it]
 77%|███████▋  | 29245/37963 [66:24:52<19:04:40,  7.88s/it]
 77%|███████▋  | 29246/37963 [66:25:00<19:12:41,  7.93s/it]
 77%|███████▋  | 29247/37963 [66:25:07<19:08:01,  7.90s/it]
 77%|███████▋  | 29248/37963 [66:25:18<21:05:38,  8.71s/it]
 77%|███████▋  | 29249/37963 [66:25:26<20:38:14,  8.53s/it]
 77%|███████▋  | 29250/37963 [66:25:37<21:58:51,  9.08s/it]
                                                           
{'loss': '0.1053', 'grad_norm': '2.574', 'learning_rate': '2.638e-06', 'epoch': '0.7705'}
+
 77%|███████▋  | 29250/37963 [66:25:37<21:58:51,  9.08s/it]
 77%|███████▋  | 29251/37963 [66:25:44<21:00:10,  8.68s/it]
 77%|███████▋  | 29252/37963 [66:25:55<22:11:07,  9.17s/it]
 77%|███████▋  | 29253/37963 [66:26:02<21:12:39,  8.77s/it]
 77%|███████▋  | 29254/37963 [66:26:10<20:32:17,  8.49s/it]
 77%|███████▋  | 29255/37963 [66:26:18<19:59:27,  8.26s/it]
 77%|███████▋  | 29256/37963 [66:26:25<19:17:29,  7.98s/it]
 77%|███████▋  | 29257/37963 [66:26:33<18:58:13,  7.84s/it]
 77%|███████▋  | 29258/37963 [66:26:43<20:38:28,  8.54s/it]
 77%|███████▋  | 29259/37963 [66:26:51<20:10:04,  8.34s/it]
 77%|███████▋  | 29260/37963 [66:26:58<19:36:43,  8.11s/it]
                                                           
{'loss': '0.1036', 'grad_norm': '2.29', 'learning_rate': '2.633e-06', 'epoch': '0.7708'}
+
 77%|███████▋  | 29260/37963 [66:26:58<19:36:43,  8.11s/it]
 77%|███████▋  | 29261/37963 [66:27:06<19:10:32,  7.93s/it]
 77%|███████▋  | 29262/37963 [66:27:14<18:55:08,  7.83s/it]
 77%|███████▋  | 29263/37963 [66:27:21<18:55:07,  7.83s/it]
 77%|███████▋  | 29264/37963 [66:27:29<18:43:15,  7.75s/it]
 77%|███████▋  | 29265/37963 [66:27:36<18:23:27,  7.61s/it]
 77%|███████▋  | 29266/37963 [66:27:44<18:26:49,  7.64s/it]
 77%|███████▋  | 29267/37963 [66:27:52<18:41:45,  7.74s/it]
 77%|███████▋  | 29268/37963 [66:28:00<18:42:20,  7.74s/it]
 77%|███████▋  | 29269/37963 [66:28:07<18:44:38,  7.76s/it]
 77%|███████▋  | 29270/37963 [66:28:15<18:48:04,  7.79s/it]
                                                           
{'loss': '0.1128', 'grad_norm': '2.251', 'learning_rate': '2.627e-06', 'epoch': '0.771'}
+
 77%|███████▋  | 29270/37963 [66:28:15<18:48:04,  7.79s/it]
 77%|███████▋  | 29271/37963 [66:28:23<18:48:51,  7.79s/it]
 77%|███████▋  | 29272/37963 [66:28:34<20:46:03,  8.60s/it]
 77%|███████▋  | 29273/37963 [66:28:41<20:05:35,  8.32s/it]
 77%|███████▋  | 29274/37963 [66:28:49<19:38:28,  8.14s/it]
 77%|███████▋  | 29275/37963 [66:28:57<19:10:38,  7.95s/it]
 77%|███████▋  | 29276/37963 [66:29:04<19:01:25,  7.88s/it]
 77%|███████▋  | 29277/37963 [66:29:12<18:58:27,  7.86s/it]
 77%|███████▋  | 29278/37963 [66:29:22<20:37:55,  8.55s/it]
 77%|███████▋  | 29279/37963 [66:29:30<19:55:30,  8.26s/it]
 77%|███████▋  | 29280/37963 [66:29:40<21:37:35,  8.97s/it]
                                                           
{'loss': '0.1069', 'grad_norm': '1.913', 'learning_rate': '2.621e-06', 'epoch': '0.7713'}
+
 77%|███████▋  | 29280/37963 [66:29:40<21:37:35,  8.97s/it]
 77%|███████▋  | 29281/37963 [66:29:48<20:54:28,  8.67s/it]
 77%|███████▋  | 29282/37963 [66:29:56<20:12:18,  8.38s/it]
 77%|███████▋  | 29283/37963 [66:30:07<22:06:56,  9.17s/it]
 77%|███████▋  | 29284/37963 [66:30:15<21:10:51,  8.79s/it]
 77%|███████▋  | 29285/37963 [66:30:23<20:22:50,  8.45s/it]
 77%|███████▋  | 29286/37963 [66:30:30<19:53:31,  8.25s/it]
 77%|███████▋  | 29287/37963 [66:30:38<19:30:31,  8.09s/it]
 77%|███████▋  | 29288/37963 [66:30:46<19:18:03,  8.01s/it]
 77%|███████▋  | 29289/37963 [66:30:54<19:03:44,  7.91s/it]
 77%|███████▋  | 29290/37963 [66:31:01<18:57:22,  7.87s/it]
                                                           
{'loss': '0.1104', 'grad_norm': '2.354', 'learning_rate': '2.615e-06', 'epoch': '0.7715'}
+
 77%|███████▋  | 29290/37963 [66:31:01<18:57:22,  7.87s/it]
 77%|███████▋  | 29291/37963 [66:31:09<18:47:52,  7.80s/it]
 77%|███████▋  | 29292/37963 [66:31:19<20:40:14,  8.58s/it]
 77%|███████▋  | 29293/37963 [66:31:27<20:03:01,  8.33s/it]
 77%|███████▋  | 29294/37963 [66:31:35<19:37:52,  8.15s/it]
 77%|███████▋  | 29295/37963 [66:31:43<19:20:06,  8.03s/it]
 77%|███████▋  | 29296/37963 [66:31:53<20:56:31,  8.70s/it]
 77%|███████▋  | 29297/37963 [66:32:01<20:22:12,  8.46s/it]
 77%|███████▋  | 29298/37963 [66:32:09<19:45:47,  8.21s/it]
 77%|███████▋  | 29299/37963 [66:32:16<19:11:43,  7.98s/it]
 77%|███████▋  | 29300/37963 [66:32:24<18:59:33,  7.89s/it]
                                                           
{'loss': '0.1036', 'grad_norm': '2.393', 'learning_rate': '2.61e-06', 'epoch': '0.7718'}
+
 77%|███████▋  | 29300/37963 [66:32:24<18:59:33,  7.89s/it]
 77%|███████▋  | 29301/37963 [66:32:31<18:46:35,  7.80s/it]
 77%|███████▋  | 29302/37963 [66:32:39<18:49:23,  7.82s/it]
 77%|███████▋  | 29303/37963 [66:32:47<18:34:14,  7.72s/it]
 77%|███████▋  | 29304/37963 [66:32:57<20:47:45,  8.65s/it]
 77%|███████▋  | 29305/37963 [66:33:05<20:17:32,  8.44s/it]
 77%|███████▋  | 29306/37963 [66:33:13<19:54:30,  8.28s/it]
 77%|███████▋  | 29307/37963 [66:33:24<21:31:03,  8.95s/it]
 77%|███████▋  | 29308/37963 [66:33:31<20:34:54,  8.56s/it]
 77%|███████▋  | 29309/37963 [66:33:39<19:47:06,  8.23s/it]
 77%|███████▋  | 29310/37963 [66:33:47<19:25:53,  8.08s/it]
                                                           
{'loss': '0.1278', 'grad_norm': '2.659', 'learning_rate': '2.604e-06', 'epoch': '0.7721'}
+
 77%|███████▋  | 29310/37963 [66:33:47<19:25:53,  8.08s/it]
 77%|███████▋  | 29311/37963 [66:33:54<19:05:31,  7.94s/it]
 77%|███████▋  | 29312/37963 [66:34:02<18:56:26,  7.88s/it]
 77%|███████▋  | 29313/37963 [66:34:10<18:55:28,  7.88s/it]
 77%|███████▋  | 29314/37963 [66:34:18<18:46:14,  7.81s/it]
 77%|███████▋  | 29315/37963 [66:34:28<20:43:41,  8.63s/it]
 77%|███████▋  | 29316/37963 [66:34:36<20:03:48,  8.35s/it]
 77%|███████▋  | 29317/37963 [66:34:43<19:29:37,  8.12s/it]
 77%|███████▋  | 29318/37963 [66:34:51<19:08:25,  7.97s/it]
 77%|███████▋  | 29319/37963 [66:34:59<18:54:13,  7.87s/it]
 77%|███████▋  | 29320/37963 [66:35:06<18:42:29,  7.79s/it]
                                                           
{'loss': '0.1115', 'grad_norm': '1.787', 'learning_rate': '2.598e-06', 'epoch': '0.7723'}
+
 77%|███████▋  | 29320/37963 [66:35:06<18:42:29,  7.79s/it]
 77%|███████▋  | 29321/37963 [66:35:14<18:42:28,  7.79s/it]
 77%|███████▋  | 29322/37963 [66:35:24<20:31:21,  8.55s/it]
 77%|███████▋  | 29323/37963 [66:35:32<19:53:39,  8.29s/it]
 77%|███████▋  | 29324/37963 [66:35:42<21:15:30,  8.86s/it]
 77%|███████▋  | 29325/37963 [66:35:50<20:28:29,  8.53s/it]
 77%|███████▋  | 29326/37963 [66:35:58<19:59:28,  8.33s/it]
 77%|███████▋  | 29327/37963 [66:36:08<21:32:20,  8.98s/it]
 77%|███████▋  | 29328/37963 [66:36:16<20:34:49,  8.58s/it]
 77%|███████▋  | 29329/37963 [66:36:24<19:52:41,  8.29s/it]
 77%|███████▋  | 29330/37963 [66:36:31<19:27:21,  8.11s/it]
                                                           
{'loss': '0.1083', 'grad_norm': '3.595', 'learning_rate': '2.592e-06', 'epoch': '0.7726'}
+
 77%|███████▋  | 29330/37963 [66:36:31<19:27:21,  8.11s/it]
 77%|███████▋  | 29331/37963 [66:36:39<19:06:08,  7.97s/it]
 77%|███████▋  | 29332/37963 [66:36:46<18:46:40,  7.83s/it]
 77%|███████▋  | 29333/37963 [66:36:54<18:42:42,  7.81s/it]
 77%|███████▋  | 29334/37963 [66:37:02<18:43:03,  7.81s/it]
 77%|███████▋  | 29335/37963 [66:37:10<18:35:54,  7.76s/it]
 77%|███████▋  | 29336/37963 [66:37:17<18:31:57,  7.73s/it]
 77%|███████▋  | 29337/37963 [66:37:25<18:28:22,  7.71s/it]
 77%|███████▋  | 29338/37963 [66:37:33<18:22:59,  7.67s/it]
 77%|███████▋  | 29339/37963 [66:37:40<18:30:58,  7.73s/it]
 77%|███████▋  | 29340/37963 [66:37:48<18:28:34,  7.71s/it]
                                                           
{'loss': '0.1201', 'grad_norm': '2.351', 'learning_rate': '2.587e-06', 'epoch': '0.7729'}
+
 77%|███████▋  | 29340/37963 [66:37:48<18:28:34,  7.71s/it]
 77%|███████▋  | 29341/37963 [66:37:56<18:25:36,  7.69s/it]
 77%|███████▋  | 29342/37963 [66:38:03<18:15:42,  7.63s/it]
 77%|███████▋  | 29343/37963 [66:38:11<18:29:13,  7.72s/it]
 77%|███████▋  | 29344/37963 [66:38:19<18:28:37,  7.72s/it]
 77%|███████▋  | 29345/37963 [66:38:29<20:19:29,  8.49s/it]
 77%|███████▋  | 29346/37963 [66:38:40<21:53:12,  9.14s/it]
 77%|███████▋  | 29347/37963 [66:38:48<21:02:31,  8.79s/it]
 77%|███████▋  | 29348/37963 [66:38:59<22:31:51,  9.42s/it]
 77%|███████▋  | 29349/37963 [66:39:06<21:17:54,  8.90s/it]
 77%|███████▋  | 29350/37963 [66:39:14<20:29:33,  8.57s/it]
                                                           
{'loss': '0.1059', 'grad_norm': '3.36', 'learning_rate': '2.581e-06', 'epoch': '0.7731'}
+
 77%|███████▋  | 29350/37963 [66:39:14<20:29:33,  8.57s/it]
 77%|███████▋  | 29351/37963 [66:39:22<19:48:54,  8.28s/it]
 77%|███████▋  | 29352/37963 [66:39:29<19:18:21,  8.07s/it]
 77%|███████▋  | 29353/37963 [66:39:37<19:01:46,  7.96s/it]
 77%|███████▋  | 29354/37963 [66:39:45<18:48:43,  7.87s/it]
 77%|███████▋  | 29355/37963 [66:39:55<20:36:08,  8.62s/it]
 77%|███████▋  | 29356/37963 [66:40:03<20:09:32,  8.43s/it]
 77%|███████▋  | 29357/37963 [66:40:11<19:33:49,  8.18s/it]
 77%|███████▋  | 29358/37963 [66:40:18<19:17:10,  8.07s/it]
 77%|███████▋  | 29359/37963 [66:40:26<19:04:32,  7.98s/it]
 77%|███████▋  | 29360/37963 [66:40:34<18:52:49,  7.90s/it]
                                                           
{'loss': '0.1074', 'grad_norm': '3.216', 'learning_rate': '2.575e-06', 'epoch': '0.7734'}
+
 77%|███████▋  | 29360/37963 [66:40:34<18:52:49,  7.90s/it]
 77%|███████▋  | 29361/37963 [66:40:42<18:43:36,  7.84s/it]
 77%|███████▋  | 29362/37963 [66:40:49<18:34:51,  7.78s/it]
 77%|███████▋  | 29363/37963 [66:41:00<20:31:55,  8.59s/it]
 77%|███████▋  | 29364/37963 [66:41:07<19:49:07,  8.30s/it]
 77%|███████▋  | 29365/37963 [66:41:17<21:02:56,  8.81s/it]
 77%|███████▋  | 29366/37963 [66:41:25<20:30:04,  8.58s/it]
 77%|███████▋  | 29367/37963 [66:41:36<21:52:06,  9.16s/it]
 77%|███████▋  | 29368/37963 [66:41:44<20:54:54,  8.76s/it]
 77%|███████▋  | 29369/37963 [66:41:52<20:22:13,  8.53s/it]
 77%|███████▋  | 29370/37963 [66:41:59<19:44:02,  8.27s/it]
                                                           
{'loss': '0.08975', 'grad_norm': '2.525', 'learning_rate': '2.57e-06', 'epoch': '0.7737'}
+
 77%|███████▋  | 29370/37963 [66:41:59<19:44:02,  8.27s/it]
 77%|███████▋  | 29371/37963 [66:42:07<19:16:32,  8.08s/it]
 77%|███████▋  | 29372/37963 [66:42:15<18:53:05,  7.91s/it]
 77%|███████▋  | 29373/37963 [66:42:22<18:53:07,  7.91s/it]
 77%|███████▋  | 29374/37963 [66:42:30<18:47:54,  7.88s/it]
 77%|███████▋  | 29375/37963 [66:42:41<20:47:56,  8.72s/it]
 77%|███████▋  | 29376/37963 [66:42:49<20:05:40,  8.42s/it]
 77%|███████▋  | 29377/37963 [66:42:57<19:47:07,  8.30s/it]
 77%|███████▋  | 29378/37963 [66:43:05<19:29:29,  8.17s/it]
 77%|███████▋  | 29379/37963 [66:43:13<19:20:36,  8.11s/it]
 77%|███████▋  | 29380/37963 [66:43:20<19:06:29,  8.01s/it]
                                                           
{'loss': '0.1082', 'grad_norm': '3.384', 'learning_rate': '2.564e-06', 'epoch': '0.7739'}
+
 77%|███████▋  | 29380/37963 [66:43:20<19:06:29,  8.01s/it]
 77%|███████▋  | 29381/37963 [66:43:28<18:52:00,  7.91s/it]
 77%|███████▋  | 29382/37963 [66:43:36<18:46:27,  7.88s/it]
 77%|███████▋  | 29383/37963 [66:43:44<18:44:17,  7.86s/it]
 77%|███████▋  | 29384/37963 [66:43:51<18:40:04,  7.83s/it]
 77%|███████▋  | 29385/37963 [66:43:59<18:40:20,  7.84s/it]
 77%|███████▋  | 29386/37963 [66:44:07<18:22:55,  7.72s/it]
 77%|███████▋  | 29387/37963 [66:44:14<18:17:51,  7.68s/it]
 77%|███████▋  | 29388/37963 [66:44:22<18:17:35,  7.68s/it]
 77%|███████▋  | 29389/37963 [66:44:30<18:19:36,  7.69s/it]
 77%|███████▋  | 29390/37963 [66:44:37<18:17:29,  7.68s/it]
                                                           
{'loss': '0.1137', 'grad_norm': '2.497', 'learning_rate': '2.558e-06', 'epoch': '0.7742'}
+
 77%|███████▋  | 29390/37963 [66:44:37<18:17:29,  7.68s/it]
 77%|███████▋  | 29391/37963 [66:44:48<20:13:10,  8.49s/it]
 77%|███████▋  | 29392/37963 [66:44:55<19:36:18,  8.23s/it]
 77%|███████▋  | 29393/37963 [66:45:03<19:10:47,  8.06s/it]
 77%|███████▋  | 29394/37963 [66:45:13<20:54:06,  8.78s/it]
 77%|███████▋  | 29395/37963 [66:45:21<20:03:57,  8.43s/it]
 77%|███████▋  | 29396/37963 [66:45:29<19:29:43,  8.19s/it]
 77%|███████▋  | 29397/37963 [66:45:36<19:10:22,  8.06s/it]
 77%|███████▋  | 29398/37963 [66:45:44<18:52:23,  7.93s/it]
 77%|███████▋  | 29399/37963 [66:45:52<18:43:57,  7.87s/it]
 77%|███████▋  | 29400/37963 [66:46:02<20:34:35,  8.65s/it]
                                                           
{'loss': '0.1021', 'grad_norm': '3.043', 'learning_rate': '2.552e-06', 'epoch': '0.7744'}
+
 77%|███████▋  | 29400/37963 [66:46:02<20:34:35,  8.65s/it]
 77%|███████▋  | 29401/37963 [66:46:10<19:50:09,  8.34s/it]
 77%|███████▋  | 29402/37963 [66:46:17<19:08:18,  8.05s/it]
 77%|███████▋  | 29403/37963 [66:46:25<19:01:11,  8.00s/it]
 77%|███████▋  | 29404/37963 [66:46:33<18:47:16,  7.90s/it]
 77%|███████▋  | 29405/37963 [66:46:40<18:26:42,  7.76s/it]
 77%|███████▋  | 29406/37963 [66:46:51<20:20:39,  8.56s/it]
 77%|███████▋  | 29407/37963 [66:46:59<20:00:44,  8.42s/it]
 77%|███████▋  | 29408/37963 [66:47:06<19:30:02,  8.21s/it]
 77%|███████▋  | 29409/37963 [66:47:17<21:11:43,  8.92s/it]
 77%|███████▋  | 29410/37963 [66:47:24<20:07:02,  8.47s/it]
                                                           
{'loss': '0.1069', 'grad_norm': '1.669', 'learning_rate': '2.547e-06', 'epoch': '0.7747'}
+
 77%|███████▋  | 29410/37963 [66:47:24<20:07:02,  8.47s/it]
 77%|███████▋  | 29411/37963 [66:47:35<21:26:58,  9.03s/it]
 77%|███████▋  | 29412/37963 [66:47:45<22:31:20,  9.48s/it]
 77%|███████▋  | 29413/37963 [66:47:53<21:09:12,  8.91s/it]
 77%|███████▋  | 29414/37963 [66:48:01<20:22:01,  8.58s/it]
 77%|███████▋  | 29415/37963 [66:48:09<20:00:11,  8.42s/it]
 77%|███████▋  | 29416/37963 [66:48:17<19:39:31,  8.28s/it]
 77%|███████▋  | 29417/37963 [66:48:25<19:21:04,  8.15s/it]
 77%|███████▋  | 29418/37963 [66:48:32<18:59:30,  8.00s/it]
 77%|███████▋  | 29419/37963 [66:48:40<18:48:24,  7.92s/it]
 77%|███████▋  | 29420/37963 [66:48:48<18:37:51,  7.85s/it]
                                                           
{'loss': '0.1214', 'grad_norm': '3.49', 'learning_rate': '2.541e-06', 'epoch': '0.775'}
+
 77%|███████▋  | 29420/37963 [66:48:48<18:37:51,  7.85s/it]
 77%|███████▋  | 29421/37963 [66:48:55<18:16:38,  7.70s/it]
 78%|███████▊  | 29422/37963 [66:49:03<18:27:09,  7.78s/it]
 78%|███████▊  | 29423/37963 [66:49:14<20:32:48,  8.66s/it]
 78%|███████▊  | 29424/37963 [66:49:21<19:51:51,  8.37s/it]
 78%|███████▊  | 29425/37963 [66:49:29<19:27:00,  8.20s/it]
 78%|███████▊  | 29426/37963 [66:49:37<19:02:09,  8.03s/it]
 78%|███████▊  | 29427/37963 [66:49:44<18:39:19,  7.87s/it]
 78%|███████▊  | 29428/37963 [66:49:52<18:32:45,  7.82s/it]
 78%|███████▊  | 29429/37963 [66:50:00<18:31:22,  7.81s/it]
 78%|███████▊  | 29430/37963 [66:50:08<18:25:37,  7.77s/it]
                                                           
{'loss': '0.1061', 'grad_norm': '2.478', 'learning_rate': '2.535e-06', 'epoch': '0.7752'}
+
 78%|███████▊  | 29430/37963 [66:50:08<18:25:37,  7.77s/it]
 78%|███████▊  | 29431/37963 [66:50:15<18:22:10,  7.75s/it]
 78%|███████▊  | 29432/37963 [66:50:23<18:26:11,  7.78s/it]
 78%|███████▊  | 29433/37963 [66:50:30<18:03:51,  7.62s/it]
 78%|███████▊  | 29434/37963 [66:50:38<18:11:34,  7.68s/it]
 78%|███████▊  | 29435/37963 [66:50:46<18:25:01,  7.77s/it]
 78%|███████▊  | 29436/37963 [66:50:54<18:26:56,  7.79s/it]
 78%|███████▊  | 29437/37963 [66:51:02<18:24:49,  7.78s/it]
 78%|███████▊  | 29438/37963 [66:51:09<18:16:27,  7.72s/it]
 78%|███████▊  | 29439/37963 [66:51:19<19:53:42,  8.40s/it]
 78%|███████▊  | 29440/37963 [66:51:27<19:31:04,  8.24s/it]
                                                           
{'loss': '0.1113', 'grad_norm': '2.664', 'learning_rate': '2.53e-06', 'epoch': '0.7755'}
+
 78%|███████▊  | 29440/37963 [66:51:27<19:31:04,  8.24s/it]
 78%|███████▊  | 29441/37963 [66:51:35<19:08:25,  8.09s/it]
 78%|███████▊  | 29442/37963 [66:51:45<20:56:47,  8.85s/it]
 78%|███████▊  | 29443/37963 [66:51:54<20:21:46,  8.60s/it]
 78%|███████▊  | 29444/37963 [66:52:02<19:59:02,  8.44s/it]
 78%|███████▊  | 29445/37963 [66:52:09<19:26:43,  8.22s/it]
 78%|███████▊  | 29446/37963 [66:52:17<19:12:55,  8.12s/it]
 78%|███████▊  | 29447/37963 [66:52:25<18:56:52,  8.01s/it]
 78%|███████▊  | 29448/37963 [66:52:36<20:46:36,  8.78s/it]
 78%|███████▊  | 29449/37963 [66:52:43<19:55:20,  8.42s/it]
 78%|███████▊  | 29450/37963 [66:52:51<19:25:07,  8.21s/it]
                                                           
{'loss': '0.1248', 'grad_norm': '3.805', 'learning_rate': '2.524e-06', 'epoch': '0.7758'}
+
 78%|███████▊  | 29450/37963 [66:52:51<19:25:07,  8.21s/it]
 78%|███████▊  | 29451/37963 [66:52:58<18:47:31,  7.95s/it]
 78%|███████▊  | 29452/37963 [66:53:06<18:36:27,  7.87s/it]
 78%|███████▊  | 29453/37963 [66:53:14<18:44:30,  7.93s/it]
 78%|███████▊  | 29454/37963 [66:53:24<20:29:20,  8.67s/it]
 78%|███████▊  | 29455/37963 [66:53:35<21:39:52,  9.17s/it]
 78%|███████▊  | 29456/37963 [66:53:43<20:55:54,  8.86s/it]
 78%|███████▊  | 29457/37963 [66:53:53<21:58:41,  9.30s/it]
 78%|███████▊  | 29458/37963 [66:54:01<21:01:58,  8.90s/it]
 78%|███████▊  | 29459/37963 [66:54:09<20:04:07,  8.50s/it]
 78%|███████▊  | 29460/37963 [66:54:19<21:21:45,  9.04s/it]
                                                           
{'loss': '0.112', 'grad_norm': '2.609', 'learning_rate': '2.518e-06', 'epoch': '0.776'}
+
 78%|███████▊  | 29460/37963 [66:54:19<21:21:45,  9.04s/it]
 78%|███████▊  | 29461/37963 [66:54:27<20:42:53,  8.77s/it]
 78%|███████▊  | 29462/37963 [66:54:35<20:05:50,  8.51s/it]
 78%|███████▊  | 29463/37963 [66:54:43<19:29:38,  8.26s/it]
 78%|███████▊  | 29464/37963 [66:54:50<19:06:30,  8.09s/it]
 78%|███████▊  | 29465/37963 [66:54:58<18:49:25,  7.97s/it]
 78%|███████▊  | 29466/37963 [66:55:06<18:39:54,  7.91s/it]
 78%|███████▊  | 29467/37963 [66:55:16<20:36:38,  8.73s/it]
 78%|███████▊  | 29468/37963 [66:55:24<20:05:28,  8.51s/it]
 78%|███████▊  | 29469/37963 [66:55:32<19:18:15,  8.18s/it]
 78%|███████▊  | 29470/37963 [66:55:40<19:01:43,  8.07s/it]
                                                           
{'loss': '0.1104', 'grad_norm': '3.124', 'learning_rate': '2.513e-06', 'epoch': '0.7763'}
+
 78%|███████▊  | 29470/37963 [66:55:40<19:01:43,  8.07s/it]
 78%|███████▊  | 29471/37963 [66:55:48<18:51:23,  7.99s/it]
 78%|███████▊  | 29472/37963 [66:55:55<18:50:12,  7.99s/it]
 78%|███████▊  | 29473/37963 [66:56:03<18:39:08,  7.91s/it]
 78%|███████▊  | 29474/37963 [66:56:11<18:32:14,  7.86s/it]
 78%|███████▊  | 29475/37963 [66:56:19<18:27:40,  7.83s/it]
 78%|██████���▊  | 29476/37963 [66:56:26<18:22:56,  7.80s/it]
 78%|███████▊  | 29477/37963 [66:56:34<18:02:34,  7.65s/it]
 78%|███████▊  | 29478/37963 [66:56:42<18:13:27,  7.73s/it]
 78%|███████▊  | 29479/37963 [66:56:49<18:15:51,  7.75s/it]
 78%|███████▊  | 29480/37963 [66:56:57<18:17:44,  7.76s/it]
                                                           
{'loss': '0.1026', 'grad_norm': '3.657', 'learning_rate': '2.507e-06', 'epoch': '0.7765'}
+
 78%|███████▊  | 29480/37963 [66:56:57<18:17:44,  7.76s/it]
 78%|███████▊  | 29481/37963 [66:57:05<18:19:31,  7.78s/it]
 78%|███████▊  | 29482/37963 [66:57:13<18:20:00,  7.78s/it]
 78%|███████▊  | 29483/37963 [66:57:23<20:08:10,  8.55s/it]
 78%|███████▊  | 29484/37963 [66:57:31<19:47:08,  8.40s/it]
 78%|███████▊  | 29485/37963 [66:57:39<19:22:42,  8.23s/it]
 78%|███████▊  | 29486/37963 [66:57:47<19:06:12,  8.11s/it]
 78%|███████▊  | 29487/37963 [66:57:55<18:59:21,  8.07s/it]
 78%|███████▊  | 29488/37963 [66:58:02<18:29:40,  7.86s/it]
 78%|███████▊  | 29489/37963 [66:58:10<18:19:02,  7.78s/it]
 78%|███████▊  | 29490/37963 [66:58:18<18:15:41,  7.76s/it]
                                                           
{'loss': '0.1162', 'grad_norm': '2.118', 'learning_rate': '2.501e-06', 'epoch': '0.7768'}
+
 78%|███████▊  | 29490/37963 [66:58:18<18:15:41,  7.76s/it]
 78%|███████▊  | 29491/37963 [66:58:25<17:56:54,  7.63s/it]
 78%|███████▊  | 29492/37963 [66:58:36<20:13:58,  8.60s/it]
 78%|███████▊  | 29493/37963 [66:58:43<19:27:35,  8.27s/it]
 78%|███████▊  | 29494/37963 [66:58:51<19:02:03,  8.09s/it]
 78%|███████▊  | 29495/37963 [66:58:59<18:46:25,  7.98s/it]
 78%|███████▊  | 29496/37963 [66:59:09<20:33:38,  8.74s/it]
 78%|███████▊  | 29497/37963 [66:59:17<19:52:33,  8.45s/it]
 78%|███████▊  | 29498/37963 [66:59:25<19:21:59,  8.24s/it]
 78%|███████▊  | 29499/37963 [66:59:32<19:02:53,  8.10s/it]
 78%|███████▊  | 29500/37963 [66:59:40<18:53:03,  8.03s/it]
                                                           
{'loss': '0.1134', 'grad_norm': '2.578', 'learning_rate': '2.496e-06', 'epoch': '0.7771'}
+
 78%|███████▊  | 29500/37963 [66:59:40<18:53:03,  8.03s/it]
 78%|███████▊  | 29501/37963 [66:59:50<20:15:05,  8.62s/it]
 78%|███████▊  | 29502/37963 [66:59:58<19:33:42,  8.32s/it]
 78%|███████▊  | 29503/37963 [67:00:08<21:04:20,  8.97s/it]
 78%|███████▊  | 29504/37963 [67:00:16<20:08:47,  8.57s/it]
 78%|███████▊  | 29505/37963 [67:00:27<21:32:11,  9.17s/it]
 78%|███████▊  | 29506/37963 [67:00:34<20:37:07,  8.78s/it]
 78%|███████▊  | 29507/37963 [67:00:42<19:59:33,  8.51s/it]
 78%|███████▊  | 29508/37963 [67:00:50<19:29:49,  8.30s/it]
 78%|███████▊  | 29509/37963 [67:00:58<19:03:39,  8.12s/it]
 78%|███████▊  | 29510/37963 [67:01:06<18:43:01,  7.97s/it]
                                                           
{'loss': '0.1187', 'grad_norm': '2.552', 'learning_rate': '2.49e-06', 'epoch': '0.7773'}
+
 78%|███████▊  | 29510/37963 [67:01:06<18:43:01,  7.97s/it]
 78%|███████▊  | 29511/37963 [67:01:13<18:24:28,  7.84s/it]
 78%|███████▊  | 29512/37963 [67:01:21<18:17:45,  7.79s/it]
 78%|███████▊  | 29513/37963 [67:01:31<20:07:48,  8.58s/it]
 78%|███████▊  | 29514/37963 [67:01:39<19:39:57,  8.38s/it]
 78%|███████▊  | 29515/37963 [67:01:47<19:16:35,  8.21s/it]
 78%|███████▊  | 29516/37963 [67:01:55<18:51:10,  8.03s/it]
 78%|███████▊  | 29517/37963 [67:02:02<18:26:49,  7.86s/it]
 78%|███████▊  | 29518/37963 [67:02:10<18:22:53,  7.84s/it]
 78%|███████▊  | 29519/37963 [67:02:18<18:22:20,  7.83s/it]
 78%|███████▊  | 29520/37963 [67:02:25<18:00:11,  7.68s/it]
                                                           
{'loss': '0.1161', 'grad_norm': '1.843', 'learning_rate': '2.485e-06', 'epoch': '0.7776'}
+
 78%|███████▊  | 29520/37963 [67:02:25<18:00:11,  7.68s/it]
 78%|███████▊  | 29521/37963 [67:02:35<19:54:10,  8.49s/it]
 78%|███████▊  | 29522/37963 [67:02:43<19:28:14,  8.30s/it]
 78%|███████▊  | 29523/37963 [67:02:51<19:00:25,  8.11s/it]
 78%|███████▊  | 29524/37963 [67:02:58<18:42:42,  7.98s/it]
 78%|███████▊  | 29525/37963 [67:03:06<18:34:29,  7.92s/it]
 78%|███████▊  | 29526/37963 [67:03:14<18:39:00,  7.96s/it]
 78%|███████▊  | 29527/37963 [67:03:22<18:24:12,  7.85s/it]
 78%|███████▊  | 29528/37963 [67:03:32<20:09:02,  8.60s/it]
 78%|███████▊  | 29529/37963 [67:03:40<19:36:34,  8.37s/it]
 78%|███████▊  | 29530/37963 [67:03:48<19:14:12,  8.21s/it]
                                                           
{'loss': '0.1051', 'grad_norm': '2.436', 'learning_rate': '2.479e-06', 'epoch': '0.7779'}
+
 78%|███████▊  | 29530/37963 [67:03:48<19:14:12,  8.21s/it]
 78%|███████▊  | 29531/37963 [67:03:56<18:49:33,  8.04s/it]
 78%|███████▊  | 29532/37963 [67:04:03<18:35:57,  7.94s/it]
 78%|███████▊  | 29533/37963 [67:04:11<18:24:54,  7.86s/it]
 78%|███████▊  | 29534/37963 [67:04:19<18:17:50,  7.81s/it]
 78%|███████▊  | 29535/37963 [67:04:29<20:10:57,  8.62s/it]
 78%|███████▊  | 29536/37963 [67:04:37<19:45:15,  8.44s/it]
 78%|███████▊  | 29537/37963 [67:04:45<19:18:31,  8.25s/it]
 78%|███████▊  | 29538/37963 [67:04:53<18:54:22,  8.08s/it]
 78%|███████▊  | 29539/37963 [67:05:00<18:35:00,  7.94s/it]
 78%|███████▊  | 29540/37963 [67:05:11<20:31:40,  8.77s/it]
                                                           
{'loss': '0.1134', 'grad_norm': '3.323', 'learning_rate': '2.473e-06', 'epoch': '0.7781'}
+
 78%|███████▊  | 29540/37963 [67:05:11<20:31:40,  8.77s/it]
 78%|███████▊  | 29541/37963 [67:05:19<19:42:17,  8.42s/it]
 78%|███████▊  | 29542/37963 [67:05:26<19:17:33,  8.25s/it]
 78%|███████▊  | 29543/37963 [67:05:34<18:55:38,  8.09s/it]
 78%|███████▊  | 29544/37963 [67:05:42<18:34:09,  7.94s/it]
 78%|███████▊  | 29545/37963 [67:05:49<18:22:52,  7.86s/it]
 78%|███████▊  | 29546/37963 [67:06:00<20:11:15,  8.63s/it]
 78%|███████▊  | 29547/37963 [67:06:08<19:37:38,  8.40s/it]
 78%|███████▊  | 29548/37963 [67:06:15<19:07:18,  8.18s/it]
 78%|███████▊  | 29549/37963 [67:06:26<20:44:02,  8.87s/it]
 78%|███████▊  | 29550/37963 [67:06:34<20:00:33,  8.56s/it]
                                                           
{'loss': '0.111', 'grad_norm': '2.546', 'learning_rate': '2.468e-06', 'epoch': '0.7784'}
+
 78%|███████▊  | 29550/37963 [67:06:34<20:00:33,  8.56s/it]
 78%|███████▊  | 29551/37963 [67:06:42<19:33:31,  8.37s/it]
 78%|███████▊  | 29552/37963 [67:06:49<19:00:47,  8.14s/it]
 78%|███████▊  | 29553/37963 [67:06:59<20:15:12,  8.67s/it]
 78%|███████▊  | 29554/37963 [67:07:07<19:34:21,  8.38s/it]
 78%|███████▊  | 29555/37963 [67:07:15<19:04:30,  8.17s/it]
 78%|███████▊  | 29556/37963 [67:07:22<18:54:40,  8.10s/it]
 78%|███████▊  | 29557/37963 [67:07:30<18:36:49,  7.97s/it]
 78%|███████▊  | 29558/37963 [67:07:38<18:23:30,  7.88s/it]
 78%|███████▊  | 29559/37963 [67:07:45<18:14:47,  7.82s/it]
 78%|███████▊  | 29560/37963 [67:07:53<18:20:49,  7.86s/it]
                                                           
{'loss': '0.1129', 'grad_norm': '1.911', 'learning_rate': '2.462e-06', 'epoch': '0.7787'}
+
 78%|███████▊  | 29560/37963 [67:07:53<18:20:49,  7.86s/it]
 78%|███████▊  | 29561/37963 [67:08:01<18:03:55,  7.74s/it]
 78%|███████▊  | 29562/37963 [67:08:09<18:16:19,  7.83s/it]
 78%|███████▊  | 29563/37963 [67:08:17<18:14:00,  7.81s/it]
 78%|███████▊  | 29564/37963 [67:08:25<18:15:17,  7.82s/it]
 78%|███████▊  | 29565/37963 [67:08:35<20:09:51,  8.64s/it]
 78%|███████▊  | 29566/37963 [67:08:43<19:32:50,  8.38s/it]
 78%|███████▊  | 29567/37963 [67:08:51<19:10:52,  8.22s/it]
 78%|███████▊  | 29568/37963 [67:08:58<18:47:14,  8.06s/it]
 78%|███████▊  | 29569/37963 [67:09:06<18:41:40,  8.02s/it]
 78%|███████▊  | 29570/37963 [67:09:14<18:25:41,  7.90s/it]
                                                           
{'loss': '0.1221', 'grad_norm': '2.858', 'learning_rate': '2.456e-06', 'epoch': '0.7789'}
+
 78%|███████▊  | 29570/37963 [67:09:14<18:25:41,  7.90s/it]
 78%|███████▊  | 29571/37963 [67:09:22<18:22:04,  7.88s/it]
 78%|███████▊  | 29572/37963 [67:09:29<18:08:18,  7.78s/it]
 78%|███████▊  | 29573/37963 [67:09:37<18:14:06,  7.82s/it]
 78%|███████▊  | 29574/37963 [67:09:45<18:11:16,  7.81s/it]
 78%|███████▊  | 29575/37963 [67:09:56<20:13:24,  8.68s/it]
 78%|███████▊  | 29576/37963 [67:10:06<21:19:16,  9.15s/it]
 78%|███████▊  | 29577/37963 [67:10:14<20:18:42,  8.72s/it]
 78%|███████▊  | 29578/37963 [67:10:22<19:49:21,  8.51s/it]
 78%|███████▊  | 29579/37963 [67:10:29<19:12:43,  8.25s/it]
 78%|███████▊  | 29580/37963 [67:10:37<18:43:30,  8.04s/it]
                                                           
{'loss': '0.1047', 'grad_norm': '2.222', 'learning_rate': '2.451e-06', 'epoch': '0.7792'}
+
 78%|███████▊  | 29580/37963 [67:10:37<18:43:30,  8.04s/it]
 78%|███████▊  | 29581/37963 [67:10:45<18:28:35,  7.94s/it]
 78%|███████▊  | 29582/37963 [67:10:52<18:20:08,  7.88s/it]
 78%|███████▊  | 29583/37963 [67:11:03<20:07:14,  8.64s/it]
 78%|███████▊  | 29584/37963 [67:11:11<19:31:29,  8.39s/it]
 78%|███████▊  | 29585/37963 [67:11:18<19:00:58,  8.17s/it]
 78%|███████▊  | 29586/37963 [67:11:26<18:47:43,  8.08s/it]
 78%|███████▊  | 29587/37963 [67:11:34<18:32:03,  7.97s/it]
 78%|███████▊  | 29588/37963 [67:11:44<20:20:52,  8.75s/it]
 78%|███████▊  | 29589/37963 [67:11:52<19:41:50,  8.47s/it]
 78%|███████▊  | 29590/37963 [67:12:00<19:14:10,  8.27s/it]
                                                           
{'loss': '0.1037', 'grad_norm': '3.483', 'learning_rate': '2.445e-06', 'epoch': '0.7794'}
+
 78%|███████▊  | 29590/37963 [67:12:00<19:14:10,  8.27s/it]
 78%|███████▊  | 29591/37963 [67:12:08<19:03:13,  8.19s/it]
 78%|███████▊  | 29592/37963 [67:12:16<18:42:56,  8.05s/it]
 78%|███████▊  | 29593/37963 [67:12:26<20:09:12,  8.67s/it]
 78%|███████▊  | 29594/37963 [67:12:33<19:20:24,  8.32s/it]
 78%|███████▊  | 29595/37963 [67:12:41<19:04:47,  8.21s/it]
 78%|███████▊  | 29596/37963 [67:12:49<18:44:53,  8.07s/it]
 78%|███████▊  | 29597/37963 [67:12:59<20:05:38,  8.65s/it]
 78%|███████▊  | 29598/37963 [67:13:07<19:31:29,  8.40s/it]
 78%|███████▊  | 29599/37963 [67:13:15<19:08:31,  8.24s/it]
 78%|███████▊  | 29600/37963 [67:13:22<18:48:05,  8.09s/it]
                                                           
{'loss': '0.1078', 'grad_norm': '2.402', 'learning_rate': '2.44e-06', 'epoch': '0.7797'}
+
 78%|███████▊  | 29600/37963 [67:13:22<18:48:05,  8.09s/it]
 78%|███████▊  | 29601/37963 [67:13:30<18:24:08,  7.92s/it]
 78%|███████▊  | 29602/37963 [67:13:38<18:13:04,  7.84s/it]
 78%|███████▊  | 29603/37963 [67:13:45<17:50:46,  7.68s/it]
 78%|███████▊  | 29604/37963 [67:13:52<17:37:30,  7.59s/it]
 78%|███████▊  | 29605/37963 [67:14:00<17:29:45,  7.54s/it]
 78%|███████▊  | 29606/37963 [67:14:07<17:20:16,  7.47s/it]
 78%|███████▊  | 29607/37963 [67:14:17<19:12:32,  8.28s/it]
 78%|███████▊  | 29608/37963 [67:14:25<19:00:27,  8.19s/it]
 78%|███████▊  | 29609/37963 [67:14:36<20:33:51,  8.86s/it]
 78%|███████▊  | 29610/37963 [67:14:43<19:31:25,  8.41s/it]
                                                           
{'loss': '0.1255', 'grad_norm': '2.627', 'learning_rate': '2.434e-06', 'epoch': '0.78'}
+
 78%|███████▊  | 29610/37963 [67:14:43<19:31:25,  8.41s/it]
 78%|███████▊  | 29611/37963 [67:14:51<19:05:21,  8.23s/it]
 78%|███████▊  | 29612/37963 [67:14:59<18:54:05,  8.15s/it]
 78%|███████▊  | 29613/37963 [67:15:07<18:37:46,  8.03s/it]
 78%|███████▊  | 29614/37963 [67:15:14<18:30:10,  7.98s/it]
 78%|███████▊  | 29615/37963 [67:15:22<18:03:26,  7.79s/it]
 78%|███████▊  | 29616/37963 [67:15:30<18:04:20,  7.79s/it]
 78%|███████▊  | 29617/37963 [67:15:37<18:03:36,  7.79s/it]
 78%|███████▊  | 29618/37963 [67:15:45<18:00:30,  7.77s/it]
 78%|███████▊  | 29619/37963 [67:15:53<18:09:05,  7.83s/it]
 78%|███████▊  | 29620/37963 [67:16:03<19:46:52,  8.54s/it]
                                                           
{'loss': '0.1089', 'grad_norm': '2.353', 'learning_rate': '2.429e-06', 'epoch': '0.7802'}
+
 78%|███████▊  | 29620/37963 [67:16:03<19:46:52,  8.54s/it]
 78%|███████▊  | 29621/37963 [67:16:11<19:13:13,  8.29s/it]
 78%|███████▊  | 29622/37963 [67:16:19<18:57:34,  8.18s/it]
 78%|███████▊  | 29623/37963 [67:16:26<18:34:33,  8.02s/it]
 78%|███████▊  | 29624/37963 [67:16:34<18:19:37,  7.91s/it]
 78%|███████▊  | 29625/37963 [67:16:42<18:10:56,  7.85s/it]
 78%|███████▊  | 29626/37963 [67:16:49<17:58:45,  7.76s/it]
 78%|███████▊  | 29627/37963 [67:16:57<17:58:43,  7.76s/it]
 78%|███████▊  | 29628/37963 [67:17:05<18:01:40,  7.79s/it]
 78%|███████▊  | 29629/37963 [67:17:16<19:54:43,  8.60s/it]
 78%|███████▊  | 29630/37963 [67:17:24<19:28:53,  8.42s/it]
                                                           
{'loss': '0.1166', 'grad_norm': '1.816', 'learning_rate': '2.423e-06', 'epoch': '0.7805'}
+
 78%|███████▊  | 29630/37963 [67:17:24<19:28:53,  8.42s/it]
 78%|███████▊  | 29631/37963 [67:17:34<20:56:45,  9.05s/it]
 78%|███████▊  | 29632/37963 [67:17:42<20:08:14,  8.70s/it]
 78%|███████▊  | 29633/37963 [67:17:49<19:12:13,  8.30s/it]
 78%|███████▊  | 29634/37963 [67:17:57<18:41:21,  8.08s/it]
 78%|███████▊  | 29635/37963 [67:18:05<18:37:00,  8.05s/it]
 78%|███████▊  | 29636/37963 [67:18:15<20:17:09,  8.77s/it]
 78%|███████▊  | 29637/37963 [67:18:23<19:26:39,  8.41s/it]
 78%|███████▊  | 29638/37963 [67:18:33<20:29:40,  8.86s/it]
 78%|███████▊  | 29639/37963 [67:18:41<19:56:03,  8.62s/it]
 78%|███████▊  | 29640/37963 [67:18:49<19:18:13,  8.35s/it]
                                                           
{'loss': '0.1087', 'grad_norm': '2.965', 'learning_rate': '2.417e-06', 'epoch': '0.7808'}
+
 78%|███████▊  | 29640/37963 [67:18:49<19:18:13,  8.35s/it]
 78%|███████▊  | 29641/37963 [67:18:56<18:48:41,  8.14s/it]
 78%|███████▊  | 29642/37963 [67:19:04<18:22:44,  7.95s/it]
 78%|███████▊  | 29643/37963 [67:19:11<18:14:49,  7.90s/it]
 78%|███████▊  | 29644/37963 [67:19:19<18:15:16,  7.90s/it]
 78%|███████▊  | 29645/37963 [67:19:27<18:14:00,  7.89s/it]
 78%|███████▊  | 29646/37963 [67:19:35<18:08:45,  7.85s/it]
 78%|███████▊  | 29647/37963 [67:19:43<18:08:30,  7.85s/it]
 78%|███████▊  | 29648/37963 [67:19:51<18:02:55,  7.81s/it]
 78%|███████▊  | 29649/37963 [67:19:58<17:52:27,  7.74s/it]
 78%|███████▊  | 29650/37963 [67:20:06<17:53:44,  7.75s/it]
                                                           
{'loss': '0.1072', 'grad_norm': '2.799', 'learning_rate': '2.412e-06', 'epoch': '0.781'}
+
 78%|███████▊  | 29650/37963 [67:20:06<17:53:44,  7.75s/it]
 78%|███████▊  | 29651/37963 [67:20:16<19:29:47,  8.44s/it]
 78%|███████▊  | 29652/37963 [67:20:24<19:08:41,  8.29s/it]
 78%|███████▊  | 29653/37963 [67:20:32<18:45:26,  8.13s/it]
 78%|███████▊  | 29654/37963 [67:20:39<18:22:36,  7.96s/it]
 78%|███████▊  | 29655/37963 [67:20:47<18:17:45,  7.93s/it]
 78%|███████▊  | 29656/37963 [67:20:57<19:58:39,  8.66s/it]
 78%|███████▊  | 29657/37963 [67:21:05<19:14:46,  8.34s/it]
 78%|███████▊  | 29658/37963 [67:21:13<18:42:36,  8.11s/it]
 78%|███████▊  | 29659/37963 [67:21:20<18:26:51,  8.00s/it]
 78%|███████▊  | 29660/37963 [67:21:28<18:23:04,  7.97s/it]
                                                           
{'loss': '0.1056', 'grad_norm': '2.246', 'learning_rate': '2.406e-06', 'epoch': '0.7813'}
+
 78%|███████▊  | 29660/37963 [67:21:28<18:23:04,  7.97s/it]
 78%|███████▊  | 29661/37963 [67:21:36<18:09:30,  7.87s/it]
 78%|███████▊  | 29662/37963 [67:21:43<17:56:13,  7.78s/it]
 78%|███████▊  | 29663/37963 [67:21:57<21:42:07,  9.41s/it]
 78%|███████▊  | 29664/37963 [67:22:05<20:42:54,  8.99s/it]
 78%|███████▊  | 29665/37963 [67:22:13<19:58:21,  8.66s/it]
 78%|███████▊  | 29666/37963 [67:22:21<19:27:54,  8.45s/it]
 78%|███████▊  | 29667/37963 [67:22:28<19:06:12,  8.29s/it]
 78%|███████▊  | 29668/37963 [67:22:36<18:43:49,  8.13s/it]
 78%|███████▊  | 29669/37963 [67:22:44<18:34:51,  8.07s/it]
 78%|███████▊  | 29670/37963 [67:22:51<18:04:49,  7.85s/it]
                                                           
{'loss': '0.1056', 'grad_norm': '2.18', 'learning_rate': '2.401e-06', 'epoch': '0.7816'}
+
 78%|███████▊  | 29670/37963 [67:22:51<18:04:49,  7.85s/it]
 78%|███████▊  | 29671/37963 [67:22:59<17:56:24,  7.79s/it]
 78%|███████▊  | 29672/37963 [67:23:07<17:56:58,  7.79s/it]
 78%|███████▊  | 29673/37963 [67:23:15<18:00:55,  7.82s/it]
 78%|███████▊  | 29674/37963 [67:23:22<17:52:59,  7.77s/it]
 78%|███████▊  | 29675/37963 [67:23:30<17:46:22,  7.72s/it]
 78%|███████▊  | 29676/37963 [67:23:38<17:48:59,  7.74s/it]
 78%|███████▊  | 29677/37963 [67:23:46<17:48:56,  7.74s/it]
 78%|███████▊  | 29678/37963 [67:23:53<17:52:50,  7.77s/it]
 78%|███████▊  | 29679/37963 [67:24:01<17:46:57,  7.73s/it]
 78%|███████▊  | 29680/37963 [67:24:12<19:49:29,  8.62s/it]
                                                           
{'loss': '0.1103', 'grad_norm': '2.146', 'learning_rate': '2.395e-06', 'epoch': '0.7818'}
+
 78%|███████▊  | 29680/37963 [67:24:12<19:49:29,  8.62s/it]
 78%|███████▊  | 29681/37963 [67:24:20<19:20:06,  8.40s/it]
 78%|███████▊  | 29682/37963 [67:24:27<18:51:21,  8.20s/it]
 78%|███████▊  | 29683/37963 [67:24:38<20:45:55,  9.03s/it]
 78%|███████▊  | 29684/37963 [67:24:46<20:08:40,  8.76s/it]
 78%|███████▊  | 29685/37963 [67:24:57<21:20:52,  9.28s/it]
 78%|███████▊  | 29686/37963 [67:25:05<20:24:31,  8.88s/it]
 78%|███████▊  | 29687/37963 [67:25:15<21:33:16,  9.38s/it]
 78%|███████▊  | 29688/37963 [67:25:23<20:32:56,  8.94s/it]
 78%|███████▊  | 29689/37963 [67:25:31<19:45:39,  8.60s/it]
 78%|███████▊  | 29690/37963 [67:25:39<19:07:56,  8.33s/it]
                                                           
{'loss': '0.1099', 'grad_norm': '3.436', 'learning_rate': '2.39e-06', 'epoch': '0.7821'}
+
 78%|███████▊  | 29690/37963 [67:25:39<19:07:56,  8.33s/it]
 78%|███████▊  | 29691/37963 [67:25:46<18:38:22,  8.11s/it]
 78%|███████▊  | 29692/37963 [67:25:54<18:32:47,  8.07s/it]
 78%|███████▊  | 29693/37963 [67:26:02<18:16:36,  7.96s/it]
 78%|███████▊  | 29694/37963 [67:26:10<18:05:32,  7.88s/it]
 78%|███████▊  | 29695/37963 [67:26:20<19:42:59,  8.58s/it]
 78%|███████▊  | 29696/37963 [67:26:28<19:10:46,  8.35s/it]
 78%|███████▊  | 29697/37963 [67:26:36<18:40:34,  8.13s/it]
 78%|███████▊  | 29698/37963 [67:26:43<18:25:05,  8.02s/it]
 78%|███████▊  | 29699/37963 [67:26:54<19:57:09,  8.69s/it]
 78%|███████▊  | 29700/37963 [67:27:01<19:18:45,  8.41s/it]
                                                           
{'loss': '0.1123', 'grad_norm': '2.636', 'learning_rate': '2.384e-06', 'epoch': '0.7823'}
+
 78%|███████▊  | 29700/37963 [67:27:01<19:18:45,  8.41s/it]
 78%|███████▊  | 29701/37963 [67:27:09<18:47:00,  8.18s/it]
 78%|███████▊  | 29702/37963 [67:27:16<18:07:33,  7.90s/it]
 78%|███████▊  | 29703/37963 [67:27:24<18:02:11,  7.86s/it]
 78%|███████▊  | 29704/37963 [67:27:32<17:59:42,  7.84s/it]
 78%|███████▊  | 29705/37963 [67:27:39<17:49:31,  7.77s/it]
 78%|███████▊  | 29706/37963 [67:27:47<17:49:33,  7.77s/it]
 78%|███████▊  | 29707/37963 [67:27:55<18:00:05,  7.85s/it]
 78%|███████▊  | 29708/37963 [67:28:03<17:56:55,  7.83s/it]
 78%|███████▊  | 29709/37963 [67:28:11<17:50:25,  7.78s/it]
 78%|███████▊  | 29710/37963 [67:28:18<17:44:33,  7.74s/it]
                                                           
{'loss': '0.12', 'grad_norm': '2.135', 'learning_rate': '2.379e-06', 'epoch': '0.7826'}
+
 78%|███████▊  | 29710/37963 [67:28:18<17:44:33,  7.74s/it]
 78%|███████▊  | 29711/37963 [67:28:26<17:42:50,  7.73s/it]
 78%|███████▊  | 29712/37963 [67:28:36<19:31:15,  8.52s/it]
 78%|███████▊  | 29713/37963 [67:28:44<18:50:13,  8.22s/it]
 78%|███████▊  | 29714/37963 [67:28:52<18:39:06,  8.14s/it]
 78%|███████▊  | 29715/37963 [67:28:59<18:20:51,  8.01s/it]
 78%|███████▊  | 29716/37963 [67:29:07<18:15:49,  7.97s/it]
 78%|███████▊  | 29717/37963 [67:29:18<19:55:03,  8.70s/it]
 78%|███████▊  | 29718/37963 [67:29:26<19:17:25,  8.42s/it]
 78%|███████▊  | 29719/37963 [67:29:33<18:44:09,  8.18s/it]
 78%|███████▊  | 29720/37963 [67:29:41<18:28:26,  8.07s/it]
                                                           
{'loss': '0.1284', 'grad_norm': '3.73', 'learning_rate': '2.373e-06', 'epoch': '0.7829'}
+
 78%|███████▊  | 29720/37963 [67:29:41<18:28:26,  8.07s/it]
 78%|███████▊  | 29721/37963 [67:29:49<18:06:52,  7.91s/it]
 78%|███████▊  | 29722/37963 [67:29:56<17:57:49,  7.85s/it]
 78%|███████▊  | 29723/37963 [67:30:04<17:56:12,  7.84s/it]
 78%|███████▊  | 29724/37963 [67:30:14<19:43:57,  8.62s/it]
 78%|███████▊  | 29725/37963 [67:30:22<19:03:25,  8.33s/it]
 78%|███████▊  | 29726/37963 [67:30:30<18:44:13,  8.19s/it]
 78%|███████▊  | 29727/37963 [67:30:38<18:38:23,  8.15s/it]
 78%|███████▊  | 29728/37963 [67:30:46<18:21:38,  8.03s/it]
 78%|███████▊  | 29729/37963 [67:30:53<18:06:02,  7.91s/it]
 78%|███████▊  | 29730/37963 [67:31:01<17:54:58,  7.83s/it]
                                                           
{'loss': '0.1113', 'grad_norm': '2.354', 'learning_rate': '2.368e-06', 'epoch': '0.7831'}
+
 78%|███████▊  | 29730/37963 [67:31:01<17:54:58,  7.83s/it]
 78%|███████▊  | 29731/37963 [67:31:11<19:39:34,  8.60s/it]
 78%|███████▊  | 29732/37963 [67:31:22<21:08:27,  9.25s/it]
 78%|███████▊  | 29733/37963 [67:31:30<19:59:19,  8.74s/it]
 78%|███████▊  | 29734/37963 [67:31:37<19:14:09,  8.42s/it]
 78%|███████▊  | 29735/37963 [67:31:45<18:44:13,  8.20s/it]
 78%|███████▊  | 29736/37963 [67:31:53<18:27:42,  8.08s/it]
 78%|███████▊  | 29737/37963 [67:32:00<18:00:42,  7.88s/it]
 78%|███████▊  | 29738/37963 [67:32:11<19:42:26,  8.63s/it]
 78%|███████▊  | 29739/37963 [67:32:19<19:13:29,  8.42s/it]
 78%|███████▊  | 29740/37963 [67:32:26<18:27:11,  8.08s/it]
                                                           
{'loss': '0.1183', 'grad_norm': '2.45', 'learning_rate': '2.362e-06', 'epoch': '0.7834'}
+
 78%|███████▊  | 29740/37963 [67:32:26<18:27:11,  8.08s/it]
 78%|███████▊  | 29741/37963 [67:32:34<18:15:23,  7.99s/it]
 78%|███████▊  | 29742/37963 [67:32:41<17:55:13,  7.85s/it]
 78%|███████▊  | 29743/37963 [67:32:49<17:46:55,  7.79s/it]
 78%|███████▊  | 29744/37963 [67:32:57<17:49:47,  7.81s/it]
 78%|███████▊  | 29745/37963 [67:33:04<17:43:02,  7.76s/it]
 78%|███████▊  | 29746/37963 [67:33:12<17:48:07,  7.80s/it]
 78%|███████▊  | 29747/37963 [67:33:20<17:46:44,  7.79s/it]
 78%|███████▊  | 29748/37963 [67:33:28<17:56:27,  7.86s/it]
 78%|███████▊  | 29749/37963 [67:33:36<17:56:50,  7.87s/it]
 78%|███████▊  | 29750/37963 [67:33:44<17:50:17,  7.82s/it]
                                                           
{'loss': '0.112', 'grad_norm': '2.253', 'learning_rate': '2.357e-06', 'epoch': '0.7837'}
+
 78%|███████▊  | 29750/37963 [67:33:44<17:50:17,  7.82s/it]
 78%|███████▊  | 29751/37963 [67:33:54<19:28:25,  8.54s/it]
 78%|███████▊  | 29752/37963 [67:34:02<18:56:05,  8.30s/it]
 78%|███████▊  | 29753/37963 [67:34:09<18:32:05,  8.13s/it]
 78%|███████▊  | 29754/37963 [67:34:17<18:21:49,  8.05s/it]
 78%|███████▊  | 29755/37963 [67:34:27<19:51:38,  8.71s/it]
 78%|███████▊  | 29756/37963 [67:34:35<19:22:13,  8.50s/it]
 78%|███████▊  | 29757/37963 [67:34:43<18:48:25,  8.25s/it]
 78%|███████▊  | 29758/37963 [67:34:51<18:22:23,  8.06s/it]
 78%|███████▊  | 29759/37963 [67:34:59<18:13:15,  8.00s/it]
 78%|███████▊  | 29760/37963 [67:35:06<18:00:47,  7.91s/it]
                                                           
{'loss': '0.1085', 'grad_norm': '2.245', 'learning_rate': '2.351e-06', 'epoch': '0.7839'}
+
 78%|███████▊  | 29760/37963 [67:35:06<18:00:47,  7.91s/it]
 78%|███████▊  | 29761/37963 [67:35:14<17:51:27,  7.84s/it]
 78%|███████▊  | 29762/37963 [67:35:22<17:49:59,  7.83s/it]
 78%|███████▊  | 29763/37963 [67:35:30<17:46:25,  7.80s/it]
 78%|███████▊  | 29764/37963 [67:35:37<17:42:26,  7.77s/it]
 78%|███████▊  | 29765/37963 [67:35:45<17:40:52,  7.76s/it]
 78%|███████▊  | 29766/37963 [67:35:53<17:38:12,  7.75s/it]
 78%|███████▊  | 29767/37963 [67:36:00<17:34:35,  7.72s/it]
 78%|███████▊  | 29768/37963 [67:36:08<17:39:38,  7.76s/it]
 78%|███████▊  | 29769/37963 [67:36:16<17:48:04,  7.82s/it]
 78%|███████▊  | 29770/37963 [67:36:23<17:26:28,  7.66s/it]
                                                           
{'loss': '0.1121', 'grad_norm': '2.886', 'learning_rate': '2.346e-06', 'epoch': '0.7842'}
+
 78%|███████▊  | 29770/37963 [67:36:23<17:26:28,  7.66s/it]
 78%|███████▊  | 29771/37963 [67:36:37<21:15:14,  9.34s/it]
 78%|███████▊  | 29772/37963 [67:36:44<20:07:46,  8.85s/it]
 78%|███████▊  | 29773/37963 [67:36:52<19:30:51,  8.58s/it]
 78%|███████▊  | 29774/37963 [67:37:00<18:47:10,  8.26s/it]
 78%|███████▊  | 29775/37963 [67:37:08<18:34:10,  8.16s/it]
 78%|███████▊  | 29776/37963 [67:37:16<18:20:09,  8.06s/it]
 78%|███████▊  | 29777/37963 [67:37:24<18:12:59,  8.01s/it]
 78%|███████▊  | 29778/37963 [67:37:31<17:43:49,  7.80s/it]
 78%|███████▊  | 29779/37963 [67:37:39<17:48:37,  7.83s/it]
 78%|███████▊  | 29780/37963 [67:37:46<17:44:22,  7.80s/it]
                                                           
{'loss': '0.1063', 'grad_norm': '2.19', 'learning_rate': '2.34e-06', 'epoch': '0.7845'}
+
 78%|███████▊  | 29780/37963 [67:37:46<17:44:22,  7.80s/it]
 78%|███████▊  | 29781/37963 [67:38:00<21:25:02,  9.42s/it]
 78%|███████▊  | 29782/37963 [67:38:10<22:04:22,  9.71s/it]
 78%|███████▊  | 29783/37963 [67:38:18<20:47:32,  9.15s/it]
 78%|███████▊  | 29784/37963 [67:38:26<19:55:33,  8.77s/it]
 78%|███████▊  | 29785/37963 [67:38:34<19:17:54,  8.50s/it]
 78%|███████▊  | 29786/37963 [67:38:44<20:47:20,  9.15s/it]
 78%|███████▊  | 29787/37963 [67:38:52<19:47:52,  8.72s/it]
 78%|███████▊  | 29788/37963 [67:39:00<18:58:17,  8.35s/it]
 78%|███████▊  | 29789/37963 [67:39:07<18:26:55,  8.13s/it]
 78%|███████▊  | 29790/37963 [67:39:15<18:28:14,  8.14s/it]
                                                           
{'loss': '0.09693', 'grad_norm': '3.791', 'learning_rate': '2.335e-06', 'epoch': '0.7847'}
+
 78%|███████▊  | 29790/37963 [67:39:15<18:28:14,  8.14s/it]
 78%|███████▊  | 29791/37963 [67:39:23<18:07:46,  7.99s/it]
 78%|███████▊  | 29792/37963 [67:39:31<18:03:56,  7.96s/it]
 78%|███████▊  | 29793/37963 [67:39:39<17:53:58,  7.89s/it]
 78%|███████▊  | 29794/37963 [67:39:46<17:55:00,  7.90s/it]
 78%|███████▊  | 29795/37963 [67:39:57<19:36:02,  8.64s/it]
 78%|███████▊  | 29796/37963 [67:40:05<19:14:13,  8.48s/it]
 78%|███████▊  | 29797/37963 [67:40:13<18:53:36,  8.33s/it]
 78%|███████▊  | 29798/37963 [67:40:21<18:26:06,  8.13s/it]
 78%|███████▊  | 29799/37963 [67:40:28<17:53:28,  7.89s/it]
 78%|███████▊  | 29800/37963 [67:40:36<17:49:50,  7.86s/it]
                                                           
{'loss': '0.1106', 'grad_norm': '1.752', 'learning_rate': '2.329e-06', 'epoch': '0.785'}
+
 78%|███████▊  | 29800/37963 [67:40:36<17:49:50,  7.86s/it]
 79%|███████▊  | 29801/37963 [67:40:43<17:40:39,  7.80s/it]
 79%|███████▊  | 29802/37963 [67:40:51<17:25:17,  7.69s/it]
 79%|███████▊  | 29803/37963 [67:40:59<17:38:49,  7.79s/it]
 79%|███████▊  | 29804/37963 [67:41:07<17:46:30,  7.84s/it]
 79%|███████▊  | 29805/37963 [67:41:14<17:41:17,  7.81s/it]
 79%|███████▊  | 29806/37963 [67:41:22<17:25:02,  7.69s/it]
 79%|███████▊  | 29807/37963 [67:41:30<17:28:25,  7.71s/it]
 79%|███████▊  | 29808/37963 [67:41:37<17:25:05,  7.69s/it]
 79%|███████▊  | 29809/37963 [67:41:47<19:02:38,  8.41s/it]
 79%|███████▊  | 29810/37963 [67:41:55<18:35:35,  8.21s/it]
                                                           
{'loss': '0.1', 'grad_norm': '2.233', 'learning_rate': '2.324e-06', 'epoch': '0.7852'}
+
 79%|███████▊  | 29810/37963 [67:41:55<18:35:35,  8.21s/it]
 79%|███████▊  | 29811/37963 [67:42:03<18:03:58,  7.98s/it]
 79%|███████▊  | 29812/37963 [67:42:10<17:58:15,  7.94s/it]
 79%|███████▊  | 29813/37963 [67:42:18<17:48:56,  7.87s/it]
 79%|███████▊  | 29814/37963 [67:42:26<17:42:34,  7.82s/it]
 79%|███████▊  | 29815/37963 [67:42:37<20:01:22,  8.85s/it]
 79%|███████▊  | 29816/37963 [67:42:45<19:12:39,  8.49s/it]
 79%|███████▊  | 29817/37963 [67:42:53<18:43:25,  8.27s/it]
 79%|███████▊  | 29818/37963 [67:43:00<18:16:55,  8.08s/it]
 79%|███████▊  | 29819/37963 [67:43:08<18:05:46,  8.00s/it]
 79%|███████▊  | 29820/37963 [67:43:16<17:51:08,  7.89s/it]
                                                           
{'loss': '0.1059', 'grad_norm': '2.453', 'learning_rate': '2.318e-06', 'epoch': '0.7855'}
+
 79%|███████▊  | 29820/37963 [67:43:16<17:51:08,  7.89s/it]
 79%|███████▊  | 29821/37963 [67:43:23<17:42:05,  7.83s/it]
 79%|███████▊  | 29822/37963 [67:43:31<17:27:59,  7.72s/it]
 79%|███████▊  | 29823/37963 [67:43:39<17:30:05,  7.74s/it]
 79%|███████▊  | 29824/37963 [67:43:49<19:18:36,  8.54s/it]
 79%|███████▊  | 29825/37963 [67:43:56<18:25:23,  8.15s/it]
 79%|███████▊  | 29826/37963 [67:44:06<19:48:46,  8.77s/it]
 79%|███████▊  | 29827/37963 [67:44:14<19:14:41,  8.52s/it]
 79%|███████▊  | 29828/37963 [67:44:25<20:31:51,  9.09s/it]
 79%|███████▊  | 29829/37963 [67:44:36<21:43:18,  9.61s/it]
 79%|███████▊  | 29830/37963 [67:44:43<20:25:31,  9.04s/it]
                                                           
{'loss': '0.1024', 'grad_norm': '3.065', 'learning_rate': '2.313e-06', 'epoch': '0.7858'}
+
 79%|███████▊  | 29830/37963 [67:44:43<20:25:31,  9.04s/it]
 79%|███████▊  | 29831/37963 [67:44:51<19:28:34,  8.62s/it]
 79%|███████▊  | 29832/37963 [67:44:59<18:55:40,  8.38s/it]
 79%|███████▊  | 29833/37963 [67:45:06<18:25:20,  8.16s/it]
 79%|███████▊  | 29834/37963 [67:45:14<18:05:11,  8.01s/it]
 79%|███████▊  | 29835/37963 [67:45:22<17:51:32,  7.91s/it]
 79%|███████▊  | 29836/37963 [67:45:29<17:44:55,  7.86s/it]
 79%|███████▊  | 29837/37963 [67:45:37<17:37:15,  7.81s/it]
 79%|███████▊  | 29838/37963 [67:45:47<19:17:42,  8.55s/it]
 79%|███████▊  | 29839/37963 [67:45:56<18:58:06,  8.41s/it]
 79%|█��█████▊  | 29840/37963 [67:46:03<18:35:43,  8.24s/it]
                                                           
{'loss': '0.1228', 'grad_norm': '2.537', 'learning_rate': '2.307e-06', 'epoch': '0.786'}
+
 79%|███████▊  | 29840/37963 [67:46:03<18:35:43,  8.24s/it]
 79%|███████▊  | 29841/37963 [67:46:11<18:26:08,  8.17s/it]
 79%|███████▊  | 29842/37963 [67:46:19<18:03:25,  8.00s/it]
 79%|███████▊  | 29843/37963 [67:46:27<17:53:36,  7.93s/it]
 79%|███████▊  | 29844/37963 [67:46:34<17:40:55,  7.84s/it]
 79%|███████▊  | 29845/37963 [67:46:42<17:33:29,  7.79s/it]
 79%|███████▊  | 29846/37963 [67:46:50<17:29:36,  7.76s/it]
 79%|███████▊  | 29847/37963 [67:46:57<17:26:10,  7.73s/it]
 79%|███████▊  | 29848/37963 [67:47:05<17:11:40,  7.63s/it]
 79%|███████▊  | 29849/37963 [67:47:13<17:19:28,  7.69s/it]
 79%|███████▊  | 29850/37963 [67:47:20<17:20:03,  7.69s/it]
                                                           
{'loss': '0.1062', 'grad_norm': '2.159', 'learning_rate': '2.302e-06', 'epoch': '0.7863'}
+
 79%|███████▊  | 29850/37963 [67:47:20<17:20:03,  7.69s/it]
 79%|███████▊  | 29851/37963 [67:47:28<17:28:08,  7.75s/it]
 79%|███████▊  | 29852/37963 [67:47:36<17:29:25,  7.76s/it]
 79%|███████▊  | 29853/37963 [67:47:44<17:20:44,  7.70s/it]
 79%|███████▊  | 29854/37963 [67:47:51<17:11:52,  7.64s/it]
 79%|███████▊  | 29855/37963 [67:47:58<17:02:06,  7.56s/it]
 79%|███████▊  | 29856/37963 [67:48:06<17:04:50,  7.58s/it]
 79%|███████▊  | 29857/37963 [67:48:16<18:42:07,  8.31s/it]
 79%|███████▊  | 29858/37963 [67:48:24<18:22:30,  8.16s/it]
 79%|███████▊  | 29859/37963 [67:48:34<19:58:11,  8.87s/it]
 79%|███████▊  | 29860/37963 [67:48:42<19:16:27,  8.56s/it]
                                                           
{'loss': '0.1072', 'grad_norm': '2.438', 'learning_rate': '2.296e-06', 'epoch': '0.7866'}
+
 79%|███████▊  | 29860/37963 [67:48:42<19:16:27,  8.56s/it]
 79%|███████▊  | 29861/37963 [67:48:50<18:37:23,  8.27s/it]
 79%|███████▊  | 29862/37963 [67:48:58<18:16:17,  8.12s/it]
 79%|███████▊  | 29863/37963 [67:49:06<18:08:28,  8.06s/it]
 79%|███████▊  | 29864/37963 [67:49:13<18:01:11,  8.01s/it]
 79%|███████▊  | 29865/37963 [67:49:21<17:52:35,  7.95s/it]
 79%|███████▊  | 29866/37963 [67:49:29<17:44:05,  7.89s/it]
 79%|███████▊  | 29867/37963 [67:49:37<17:40:09,  7.86s/it]
 79%|███████▊  | 29868/37963 [67:49:47<19:32:53,  8.69s/it]
 79%|███████▊  | 29869/37963 [67:49:55<18:53:25,  8.40s/it]
 79%|███████▊  | 29870/37963 [67:50:06<20:14:54,  9.01s/it]
                                                           
{'loss': '0.1145', 'grad_norm': '3.177', 'learning_rate': '2.291e-06', 'epoch': '0.7868'}
+
 79%|███████▊  | 29870/37963 [67:50:06<20:14:54,  9.01s/it]
 79%|███████▊  | 29871/37963 [67:50:13<19:23:48,  8.63s/it]
 79%|███████▊  | 29872/37963 [67:50:21<18:49:11,  8.37s/it]
 79%|███████▊  | 29873/37963 [67:50:29<18:17:59,  8.14s/it]
 79%|███████▊  | 29874/37963 [67:50:37<18:05:13,  8.05s/it]
 79%|███████▊  | 29875/37963 [67:50:47<19:37:54,  8.74s/it]
 79%|███████▊  | 29876/37963 [67:50:55<18:56:43,  8.43s/it]
 79%|███████▊  | 29877/37963 [67:51:02<18:24:05,  8.19s/it]
 79%|███████▊  | 29878/37963 [67:51:10<18:11:40,  8.10s/it]
 79%|███████▊  | 29879/37963 [67:51:18<17:58:50,  8.01s/it]
 79%|███████▊  | 29880/37963 [67:51:26<17:55:26,  7.98s/it]
                                                           
{'loss': '0.09952', 'grad_norm': '2.465', 'learning_rate': '2.285e-06', 'epoch': '0.7871'}
+
 79%|███████▊  | 29880/37963 [67:51:26<17:55:26,  7.98s/it]
 79%|███████▊  | 29881/37963 [67:51:34<17:51:25,  7.95s/it]
 79%|███████▊  | 29882/37963 [67:51:44<19:14:57,  8.58s/it]
 79%|███████▊  | 29883/37963 [67:51:52<18:46:25,  8.36s/it]
 79%|███████▊  | 29884/37963 [67:52:02<20:12:24,  9.00s/it]
 79%|███████▊  | 29885/37963 [67:52:10<19:29:11,  8.68s/it]
 79%|███████▊  | 29886/37963 [67:52:18<18:46:16,  8.37s/it]
 79%|███████▊  | 29887/37963 [67:52:26<18:26:31,  8.22s/it]
 79%|███████▊  | 29888/37963 [67:52:34<18:19:47,  8.17s/it]
 79%|███████▊  | 29889/37963 [67:52:42<18:09:20,  8.10s/it]
 79%|███████▊  | 29890/37963 [67:52:49<17:55:21,  7.99s/it]
                                                           
{'loss': '0.1251', 'grad_norm': '2.762', 'learning_rate': '2.28e-06', 'epoch': '0.7873'}
+
 79%|███████▊  | 29890/37963 [67:52:49<17:55:21,  7.99s/it]
 79%|███████▊  | 29891/37963 [67:52:57<17:26:06,  7.78s/it]
 79%|███████▊  | 29892/37963 [67:53:04<17:21:49,  7.74s/it]
 79%|███████▊  | 29893/37963 [67:53:12<17:07:56,  7.64s/it]
 79%|███████▊  | 29894/37963 [67:53:19<17:10:09,  7.66s/it]
 79%|███████▊  | 29895/37963 [67:53:27<17:08:21,  7.65s/it]
 79%|███████▉  | 29896/37963 [67:53:35<17:10:05,  7.66s/it]
 79%|███████▉  | 29897/37963 [67:53:42<17:13:49,  7.69s/it]
 79%|███████▉  | 29898/37963 [67:53:50<17:18:14,  7.72s/it]
 79%|███████▉  | 29899/37963 [67:53:58<17:22:40,  7.76s/it]
 79%|███████▉  | 29900/37963 [67:54:06<17:27:41,  7.80s/it]
                                                           
{'loss': '0.1099', 'grad_norm': '3.341', 'learning_rate': '2.275e-06', 'epoch': '0.7876'}
+
 79%|███████▉  | 29900/37963 [67:54:06<17:27:41,  7.80s/it]
 79%|███████▉  | 29901/37963 [67:54:14<17:22:30,  7.76s/it]
 79%|███████▉  | 29902/37963 [67:54:24<19:24:05,  8.66s/it]
 79%|███████▉  | 29903/37963 [67:54:32<18:46:55,  8.39s/it]
 79%|███████▉  | 29904/37963 [67:54:39<18:02:08,  8.06s/it]
 79%|███████▉  | 29905/37963 [67:54:47<17:44:33,  7.93s/it]
 79%|███████▉  | 29906/37963 [67:54:57<19:25:53,  8.68s/it]
 79%|███████▉  | 29907/37963 [67:55:05<18:53:35,  8.44s/it]
 79%|███████▉  | 29908/37963 [67:55:13<18:29:08,  8.26s/it]
 79%|███████▉  | 29909/37963 [67:55:21<18:02:11,  8.06s/it]
 79%|███████▉  | 29910/37963 [67:55:28<17:37:49,  7.88s/it]
                                                           
{'loss': '0.1013', 'grad_norm': '2.898', 'learning_rate': '2.269e-06', 'epoch': '0.7879'}
+
 79%|███████▉  | 29910/37963 [67:55:28<17:37:49,  7.88s/it]
 79%|███████▉  | 29911/37963 [67:55:36<17:16:28,  7.72s/it]
 79%|███████▉  | 29912/37963 [67:55:43<17:12:43,  7.70s/it]
 79%|███████▉  | 29913/37963 [67:55:53<18:40:01,  8.35s/it]
 79%|███████▉  | 29914/37963 [67:56:04<20:06:17,  8.99s/it]
 79%|███████▉  | 29915/37963 [67:56:11<19:15:01,  8.61s/it]
 79%|███████▉  | 29916/37963 [67:56:19<18:44:45,  8.39s/it]
 79%|███████▉  | 29917/37963 [67:56:27<18:21:06,  8.21s/it]
 79%|███████▉  | 29918/37963 [67:56:35<18:11:36,  8.14s/it]
 79%|███████▉  | 29919/37963 [67:56:43<17:54:49,  8.02s/it]
 79%|███████▉  | 29920/37963 [67:56:50<17:44:07,  7.94s/it]
                                                           
{'loss': '0.1116', 'grad_norm': '2.327', 'learning_rate': '2.264e-06', 'epoch': '0.7881'}
+
 79%|███████▉  | 29920/37963 [67:56:50<17:44:07,  7.94s/it]
 79%|███████▉  | 29921/37963 [67:56:58<17:33:44,  7.86s/it]
 79%|███████▉  | 29922/37963 [67:57:06<17:35:43,  7.88s/it]
 79%|███████▉  | 29923/37963 [67:57:14<17:26:39,  7.81s/it]
 79%|███████▉  | 29924/37963 [67:57:24<19:08:27,  8.57s/it]
 79%|███████▉  | 29925/37963 [67:57:32<18:34:18,  8.32s/it]
 79%|███████▉  | 29926/37963 [67:57:42<19:52:44,  8.90s/it]
 79%|███████▉  | 29927/37963 [67:57:50<19:06:43,  8.56s/it]
 79%|███████▉  | 29928/37963 [67:57:58<18:44:01,  8.39s/it]
 79%|███████▉  | 29929/37963 [67:58:06<18:18:16,  8.20s/it]
 79%|███████▉  | 29930/37963 [67:58:14<18:09:39,  8.14s/it]
                                                           
{'loss': '0.1125', 'grad_norm': '2.996', 'learning_rate': '2.258e-06', 'epoch': '0.7884'}
+
 79%|███████▉  | 29930/37963 [67:58:14<18:09:39,  8.14s/it]
 79%|███████▉  | 29931/37963 [67:58:21<17:39:54,  7.92s/it]
 79%|███████▉  | 29932/37963 [67:58:29<17:30:43,  7.85s/it]
 79%|███████▉  | 29933/37963 [67:58:36<17:17:55,  7.76s/it]
 79%|███████▉  | 29934/37963 [67:58:44<17:04:58,  7.66s/it]
 79%|███████▉  | 29935/37963 [67:58:51<17:00:02,  7.62s/it]
 79%|███████▉  | 29936/37963 [67:58:59<17:04:18,  7.66s/it]
 79%|███████▉  | 29937/37963 [67:59:07<17:14:30,  7.73s/it]
 79%|███████▉  | 29938/37963 [67:59:17<19:14:01,  8.63s/it]
 79%|███████▉  | 29939/37963 [67:59:25<18:33:59,  8.33s/it]
 79%|███████▉  | 29940/37963 [67:59:33<18:05:46,  8.12s/it]
                                                           
{'loss': '0.1186', 'grad_norm': '2.891', 'learning_rate': '2.253e-06', 'epoch': '0.7887'}
+
 79%|███████▉  | 29940/37963 [67:59:33<18:05:46,  8.12s/it]
 79%|███████▉  | 29941/37963 [67:59:40<17:45:40,  7.97s/it]
 79%|███████▉  | 29942/37963 [67:59:48<17:40:52,  7.94s/it]
 79%|███████▉  | 29943/37963 [67:59:56<17:29:15,  7.85s/it]
 79%|███████▉  | 29944/37963 [68:00:03<17:17:28,  7.76s/it]
 79%|███████▉  | 29945/37963 [68:00:11<17:18:46,  7.77s/it]
 79%|███████▉  | 29946/37963 [68:00:22<19:12:22,  8.62s/it]
 79%|███████▉  | 29947/37963 [68:00:30<18:33:35,  8.34s/it]
 79%|███████▉  | 29948/37963 [68:00:37<18:12:52,  8.18s/it]
 79%|███████▉  | 29949/37963 [68:00:48<19:41:42,  8.85s/it]
 79%|███████▉  | 29950/37963 [68:00:56<19:02:09,  8.55s/it]
                                                           
{'loss': '0.1075', 'grad_norm': '2.373', 'learning_rate': '2.248e-06', 'epoch': '0.7889'}
+
 79%|███████▉  | 29950/37963 [68:00:56<19:02:09,  8.55s/it]
 79%|███████▉  | 29951/37963 [68:01:03<18:24:19,  8.27s/it]
 79%|███████▉  | 29952/37963 [68:01:11<17:59:16,  8.08s/it]
 79%|███████▉  | 29953/37963 [68:01:18<17:35:08,  7.90s/it]
 79%|███████▉  | 29954/37963 [68:01:26<17:32:34,  7.89s/it]
 79%|███████▉  | 29955/37963 [68:01:33<17:06:43,  7.69s/it]
 79%|███████▉  | 29956/37963 [68:01:41<17:07:40,  7.70s/it]
 79%|███████▉  | 29957/37963 [68:01:49<17:10:59,  7.73s/it]
 79%|███████▉  | 29958/37963 [68:01:57<17:24:13,  7.83s/it]
 79%|███████▉  | 29959/37963 [68:02:05<17:25:14,  7.84s/it]
 79%|███████▉  | 29960/37963 [68:02:12<17:17:01,  7.77s/it]
                                                           
{'loss': '0.1025', 'grad_norm': '3.179', 'learning_rate': '2.242e-06', 'epoch': '0.7892'}
+
 79%|███████▉  | 29960/37963 [68:02:12<17:17:01,  7.77s/it]
 79%|███████▉  | 29961/37963 [68:02:23<18:48:43,  8.46s/it]
 79%|███████▉  | 29962/37963 [68:02:33<20:16:04,  9.12s/it]
 79%|███████▉  | 29963/37963 [68:02:41<19:33:44,  8.80s/it]
 79%|███████▉  | 29964/37963 [68:02:49<18:43:32,  8.43s/it]
 79%|███████▉  | 29965/37963 [68:02:57<18:17:53,  8.24s/it]
 79%|███████▉  | 29966/37963 [68:03:05<18:05:55,  8.15s/it]
 79%|███████▉  | 29967/37963 [68:03:15<19:37:02,  8.83s/it]
 79%|███████▉  | 29968/37963 [68:03:23<18:57:51,  8.54s/it]
 79%|███████▉  | 29969/37963 [68:03:33<20:12:49,  9.10s/it]
 79%|███████▉  | 29970/37963 [68:03:41<19:10:22,  8.64s/it]
                                                           
{'loss': '0.108', 'grad_norm': '2.686', 'learning_rate': '2.237e-06', 'epoch': '0.7895'}
+
 79%|███████▉  | 29970/37963 [68:03:41<19:10:22,  8.64s/it]
 79%|███████▉  | 29971/37963 [68:03:49<18:36:22,  8.38s/it]
 79%|███████▉  | 29972/37963 [68:03:56<18:04:07,  8.14s/it]
 79%|███████▉  | 29973/37963 [68:04:04<17:50:41,  8.04s/it]
 79%|███████▉  | 29974/37963 [68:04:12<17:44:57,  8.00s/it]
 79%|███████▉  | 29975/37963 [68:04:19<17:28:52,  7.88s/it]
 79%|███████▉  | 29976/37963 [68:04:27<17:17:18,  7.79s/it]
 79%|███████▉  | 29977/37963 [68:04:35<17:20:23,  7.82s/it]
 79%|███████▉  | 29978/37963 [68:04:43<17:14:06,  7.77s/it]
 79%|███████▉  | 29979/37963 [68:04:50<17:07:17,  7.72s/it]
 79%|███████▉  | 29980/37963 [68:04:58<17:08:08,  7.73s/it]
                                                           
{'loss': '0.09942', 'grad_norm': '2.064', 'learning_rate': '2.231e-06', 'epoch': '0.7897'}
+
 79%|███████▉  | 29980/37963 [68:04:58<17:08:08,  7.73s/it]
 79%|███████▉  | 29981/37963 [68:05:06<17:10:35,  7.75s/it]
 79%|███████▉  | 29982/37963 [68:05:14<17:16:04,  7.79s/it]
 79%|███████▉  | 29983/37963 [68:05:22<17:26:06,  7.87s/it]
 79%|███████▉  | 29984/37963 [68:05:30<17:26:40,  7.87s/it]
 79%|███████▉  | 29985/37963 [68:05:37<17:16:14,  7.79s/it]
 79%|███████▉  | 29986/37963 [68:05:45<17:08:05,  7.73s/it]
 79%|███████▉  | 29987/37963 [68:05:52<17:00:55,  7.68s/it]
 79%|███████▉  | 29988/37963 [68:06:00<17:03:45,  7.70s/it]
 79%|███████▉  | 29989/37963 [68:06:10<18:42:26,  8.45s/it]
 79%|███████▉  | 29990/37963 [68:06:18<18:07:47,  8.19s/it]
                                                           
{'loss': '0.1121', 'grad_norm': '1.932', 'learning_rate': '2.226e-06', 'epoch': '0.79'}
+
 79%|███████▉  | 29990/37963 [68:06:18<18:07:47,  8.19s/it]
 79%|███████▉  | 29991/37963 [68:06:26<17:50:55,  8.06s/it]
 79%|███████▉  | 29992/37963 [68:06:36<19:24:01,  8.76s/it]
 79%|███████▉  | 29993/37963 [68:06:46<20:27:34,  9.24s/it]
 79%|█████���█▉  | 29994/37963 [68:06:54<19:20:06,  8.73s/it]
 79%|███████▉  | 29995/37963 [68:07:02<18:40:21,  8.44s/it]
 79%|███████▉  | 29996/37963 [68:07:09<18:09:10,  8.20s/it]
 79%|███████▉  | 29997/37963 [68:07:17<17:46:39,  8.03s/it]
 79%|███████▉  | 29998/37963 [68:07:25<17:37:32,  7.97s/it]
 79%|███████▉  | 29999/37963 [68:07:33<17:35:57,  7.96s/it]
 79%|███████▉  | 30000/37963 [68:07:40<17:22:43,  7.86s/it]
                                                           
{'loss': '0.111', 'grad_norm': '2.742', 'learning_rate': '2.221e-06', 'epoch': '0.7902'}
+
 79%|███████▉  | 30000/37963 [68:07:40<17:22:43,  7.86s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.08s/it]
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.08s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 79%|███████▉  | 30001/37963 [68:08:42<52:47:26, 23.87s/it]
 79%|███████▉  | 30002/37963 [68:08:49<42:03:39, 19.02s/it]
 79%|███████▉  | 30003/37963 [68:08:57<34:33:06, 15.63s/it]
 79%|███████▉  | 30004/37963 [68:09:05<29:32:05, 13.36s/it]
 79%|███████▉  | 30005/37963 [68:09:13<25:48:57, 11.68s/it]
 79%|███████▉  | 30006/37963 [68:09:21<23:16:05, 10.53s/it]
 79%|███████▉  | 30007/37963 [68:09:31<23:24:17, 10.59s/it]
 79%|███████▉  | 30008/37963 [68:09:39<21:36:54,  9.78s/it]
 79%|███████▉  | 30009/37963 [68:09:47<20:19:38,  9.20s/it]
 79%|███████▉  | 30010/37963 [68:09:55<19:31:09,  8.84s/it]
                                                           
{'loss': '0.1199', 'grad_norm': '2.918', 'learning_rate': '2.215e-06', 'epoch': '0.7905'}
+
 79%|███████▉  | 30010/37963 [68:09:55<19:31:09,  8.84s/it]
 79%|███████▉  | 30011/37963 [68:10:03<18:46:13,  8.50s/it]
 79%|███████▉  | 30012/37963 [68:10:11<18:15:38,  8.27s/it]
 79%|███████▉  | 30013/37963 [68:10:18<18:01:55,  8.17s/it]
 79%|███████▉  | 30014/37963 [68:10:29<19:32:01,  8.85s/it]
 79%|███████▉  | 30015/37963 [68:10:39<20:37:34,  9.34s/it]
 79%|███████▉  | 30016/37963 [68:10:47<19:37:30,  8.89s/it]
 79%|███████▉  | 30017/37963 [68:10:55<18:54:56,  8.57s/it]
 79%|███████▉  | 30018/37963 [68:11:03<18:25:22,  8.35s/it]
 79%|███████▉  | 30019/37963 [68:11:11<18:04:13,  8.19s/it]
 79%|███████▉  | 30020/37963 [68:11:21<19:32:01,  8.85s/it]
                                                           
{'loss': '0.1061', 'grad_norm': '2.041', 'learning_rate': '2.21e-06', 'epoch': '0.7908'}
+
 79%|███████▉  | 30020/37963 [68:11:21<19:32:01,  8.85s/it]
 79%|███████▉  | 30021/37963 [68:11:29<18:48:12,  8.52s/it]
 79%|███████▉  | 30022/37963 [68:11:37<18:16:07,  8.28s/it]
 79%|███████▉  | 30023/37963 [68:11:44<17:41:17,  8.02s/it]
 79%|███████▉  | 30024/37963 [68:11:52<17:35:18,  7.98s/it]
 79%|███████▉  | 30025/37963 [68:11:59<17:20:23,  7.86s/it]
 79%|███████▉  | 30026/37963 [68:12:07<17:19:55,  7.86s/it]
 79%|███████▉  | 30027/37963 [68:12:15<17:29:16,  7.93s/it]
 79%|███████▉  | 30028/37963 [68:12:23<17:22:18,  7.88s/it]
 79%|███████▉  | 30029/37963 [68:12:31<17:09:07,  7.78s/it]
 79%|███████▉  | 30030/37963 [68:12:39<17:13:54,  7.82s/it]
                                                           
{'loss': '0.1043', 'grad_norm': '3.163', 'learning_rate': '2.205e-06', 'epoch': '0.791'}
+
 79%|███████▉  | 30030/37963 [68:12:39<17:13:54,  7.82s/it]
 79%|███████▉  | 30031/37963 [68:12:46<17:15:09,  7.83s/it]
 79%|███████▉  | 30032/37963 [68:12:54<17:07:42,  7.77s/it]
 79%|███████▉  | 30033/37963 [68:13:02<17:09:54,  7.79s/it]
 79%|███████▉  | 30034/37963 [68:13:13<19:00:21,  8.63s/it]
 79%|███████▉  | 30035/37963 [68:13:20<18:28:43,  8.39s/it]
 79%|███████▉  | 30036/37963 [68:13:28<18:10:33,  8.25s/it]
 79%|███████▉  | 30037/37963 [68:13:39<19:43:02,  8.96s/it]
 79%|███████▉  | 30038/37963 [68:13:49<20:40:08,  9.39s/it]
 79%|███████▉  | 30039/37963 [68:14:01<22:08:10, 10.06s/it]
 79%|███████▉  | 30040/37963 [68:14:09<20:36:20,  9.36s/it]
                                                           
{'loss': '0.1044', 'grad_norm': '2.985', 'learning_rate': '2.199e-06', 'epoch': '0.7913'}
+
 79%|███████▉  | 30040/37963 [68:14:09<20:36:20,  9.36s/it]
 79%|███████▉  | 30041/37963 [68:14:17<19:38:24,  8.93s/it]
 79%|███████▉  | 30042/37963 [68:14:24<18:49:49,  8.56s/it]
 79%|███████▉  | 30043/37963 [68:14:32<18:20:05,  8.33s/it]
 79%|███████▉  | 30044/37963 [68:14:40<17:59:20,  8.18s/it]
 79%|███████▉  | 30045/37963 [68:14:48<17:42:32,  8.05s/it]
 79%|███████▉  | 30046/37963 [68:14:56<17:35:06,  8.00s/it]
 79%|███████▉  | 30047/37963 [68:15:03<17:30:00,  7.96s/it]
 79%|███████▉  | 30048/37963 [68:15:11<17:15:44,  7.85s/it]
 79%|███████▉  | 30049/37963 [68:15:19<17:11:30,  7.82s/it]
 79%|███████▉  | 30050/37963 [68:15:26<16:50:46,  7.66s/it]
                                                           
{'loss': '0.1145', 'grad_norm': '2.256', 'learning_rate': '2.194e-06', 'epoch': '0.7916'}
+
 79%|███████▉  | 30050/37963 [68:15:26<16:50:46,  7.66s/it]
 79%|███████▉  | 30051/37963 [68:15:34<16:52:22,  7.68s/it]
 79%|███████▉  | 30052/37963 [68:15:41<16:52:22,  7.68s/it]
 79%|███████▉  | 30053/37963 [68:15:49<16:54:11,  7.69s/it]
 79%|███████▉  | 30054/37963 [68:15:57<16:54:21,  7.70s/it]
 79%|███████▉  | 30055/37963 [68:16:05<16:57:21,  7.72s/it]
 79%|███████▉  | 30056/37963 [68:16:13<17:07:41,  7.80s/it]
 79%|███████▉  | 30057/37963 [68:16:23<19:04:08,  8.68s/it]
 79%|███████▉  | 30058/37963 [68:16:31<18:26:57,  8.40s/it]
 79%|███████▉  | 30059/37963 [68:16:41<19:38:51,  8.95s/it]
 79%|███████▉  | 30060/37963 [68:16:49<18:56:33,  8.63s/it]
                                                           
{'loss': '0.1094', 'grad_norm': '1.93', 'learning_rate': '2.189e-06', 'epoch': '0.7918'}
+
 79%|███████▉  | 30060/37963 [68:16:49<18:56:33,  8.63s/it]
 79%|███████▉  | 30061/37963 [68:16:57<18:40:19,  8.51s/it]
 79%|███████▉  | 30062/37963 [68:17:08<19:50:56,  9.04s/it]
 79%|███████▉  | 30063/37963 [68:17:16<19:03:33,  8.69s/it]
 79%|███████▉  | 30064/37963 [68:17:23<18:05:02,  8.24s/it]
 79%|███████▉  | 30065/37963 [68:17:30<17:42:55,  8.07s/it]
 79%|███████▉  | 30066/37963 [68:17:38<17:34:26,  8.01s/it]
 79%|███████▉  | 30067/37963 [68:17:49<19:12:09,  8.76s/it]
 79%|███████▉  | 30068/37963 [68:17:57<18:42:57,  8.53s/it]
 79%|███████▉  | 30069/37963 [68:18:05<18:10:30,  8.29s/it]
 79%|███████▉  | 30070/37963 [68:18:12<17:52:36,  8.15s/it]
                                                           
{'loss': '0.1077', 'grad_norm': '2.675', 'learning_rate': '2.183e-06', 'epoch': '0.7921'}
+
 79%|███████▉  | 30070/37963 [68:18:12<17:52:36,  8.15s/it]
 79%|███████▉  | 30071/37963 [68:18:20<17:34:15,  8.02s/it]
 79%|███████▉  | 30072/37963 [68:18:28<17:30:56,  7.99s/it]
 79%|███████▉  | 30073/37963 [68:18:36<17:19:58,  7.91s/it]
 79%|███████▉  | 30074/37963 [68:18:43<17:03:48,  7.79s/it]
 79%|███████▉  | 30075/37963 [68:18:51<17:00:06,  7.76s/it]
 79%|███████▉  | 30076/37963 [68:18:59<17:00:54,  7.77s/it]
 79%|███████▉  | 30077/37963 [68:19:06<16:57:58,  7.75s/it]
 79%|███████▉  | 30078/37963 [68:19:17<18:50:46,  8.60s/it]
 79%|███████▉  | 30079/37963 [68:19:25<18:19:10,  8.37s/it]
 79%|███████▉  | 30080/37963 [68:19:33<17:54:03,  8.18s/it]
                                                           
{'loss': '0.0979', 'grad_norm': '2.859', 'learning_rate': '2.178e-06', 'epoch': '0.7924'}
+
 79%|███████▉  | 30080/37963 [68:19:33<17:54:03,  8.18s/it]
 79%|███████▉  | 30081/37963 [68:19:40<17:25:04,  7.96s/it]
 79%|███████▉  | 30082/37963 [68:19:50<19:03:09,  8.70s/it]
 79%|███████▉  | 30083/37963 [68:19:58<18:26:17,  8.42s/it]
 79%|███████▉  | 30084/37963 [68:20:09<19:40:54,  8.99s/it]
 79%|███████▉  | 30085/37963 [68:20:16<18:49:56,  8.61s/it]
 79%|███████▉  | 30086/37963 [68:20:24<18:14:23,  8.34s/it]
 79%|███████▉  | 30087/37963 [68:20:35<19:52:32,  9.08s/it]
 79%|███████▉  | 30088/37963 [68:20:42<18:47:05,  8.59s/it]
 79%|███████▉  | 30089/37963 [68:20:50<18:21:28,  8.39s/it]
 79%|███████▉  | 30090/37963 [68:20:58<17:50:31,  8.16s/it]
                                                           
{'loss': '0.1142', 'grad_norm': '2.39', 'learning_rate': '2.173e-06', 'epoch': '0.7926'}
+
 79%|███████▉  | 30090/37963 [68:20:58<17:50:31,  8.16s/it]
 79%|███████▉  | 30091/37963 [68:21:05<17:21:52,  7.94s/it]
 79%|███████��  | 30092/37963 [68:21:13<17:03:45,  7.80s/it]
 79%|███████▉  | 30093/37963 [68:21:21<17:07:33,  7.83s/it]
 79%|███████▉  | 30094/37963 [68:21:28<16:58:07,  7.76s/it]
 79%|███████▉  | 30095/37963 [68:21:36<17:01:16,  7.79s/it]
 79%|███████▉  | 30096/37963 [68:21:44<16:55:59,  7.75s/it]
 79%|███████▉  | 30097/37963 [68:21:51<16:50:01,  7.70s/it]
 79%|███████▉  | 30098/37963 [68:21:59<16:50:14,  7.71s/it]
 79%|███████▉  | 30099/37963 [68:22:07<16:53:33,  7.73s/it]
 79%|███████▉  | 30100/37963 [68:22:14<16:38:06,  7.62s/it]
                                                           
{'loss': '0.1063', 'grad_norm': '2.294', 'learning_rate': '2.167e-06', 'epoch': '0.7929'}
+
 79%|███████▉  | 30100/37963 [68:22:14<16:38:06,  7.62s/it]
 79%|███████▉  | 30101/37963 [68:22:24<18:22:21,  8.41s/it]
 79%|███████▉  | 30102/37963 [68:22:32<17:53:46,  8.20s/it]
 79%|███████▉  | 30103/37963 [68:22:40<17:35:30,  8.06s/it]
 79%|███████▉  | 30104/37963 [68:22:47<17:18:19,  7.93s/it]
 79%|███████▉  | 30105/37963 [68:22:55<17:11:54,  7.88s/it]
 79%|███████▉  | 30106/37963 [68:23:03<16:51:15,  7.72s/it]
 79%|███████▉  | 30107/37963 [68:23:10<16:47:56,  7.70s/it]
 79%|███████▉  | 30108/37963 [68:23:18<16:56:38,  7.77s/it]
 79%|███████▉  | 30109/37963 [68:23:26<16:53:37,  7.74s/it]
 79%|███████▉  | 30110/37963 [68:23:34<16:58:32,  7.78s/it]
                                                           
{'loss': '0.1114', 'grad_norm': '2.966', 'learning_rate': '2.162e-06', 'epoch': '0.7931'}
+
 79%|███████▉  | 30110/37963 [68:23:34<16:58:32,  7.78s/it]
 79%|███████▉  | 30111/37963 [68:23:41<16:57:43,  7.78s/it]
 79%|███████▉  | 30112/37963 [68:23:49<17:06:10,  7.84s/it]
 79%|███████▉  | 30113/37963 [68:24:00<18:40:41,  8.57s/it]
 79%|███████▉  | 30114/37963 [68:24:07<18:00:04,  8.26s/it]
 79%|███████▉  | 30115/37963 [68:24:18<19:21:01,  8.88s/it]
 79%|███████▉  | 30116/37963 [68:24:28<20:26:25,  9.38s/it]
 79%|███████▉  | 30117/37963 [68:24:36<19:24:44,  8.91s/it]
 79%|███████▉  | 30118/37963 [68:24:43<18:28:47,  8.48s/it]
 79%|███████▉  | 30119/37963 [68:24:51<17:49:20,  8.18s/it]
 79%|███████▉  | 30120/37963 [68:24:59<17:28:22,  8.02s/it]
                                                           
{'loss': '0.09982', 'grad_norm': '2.667', 'learning_rate': '2.157e-06', 'epoch': '0.7934'}
+
 79%|███████▉  | 30120/37963 [68:24:59<17:28:22,  8.02s/it]
 79%|███████▉  | 30121/37963 [68:25:09<19:08:07,  8.78s/it]
 79%|███████▉  | 30122/37963 [68:25:17<18:33:30,  8.52s/it]
 79%|███████▉  | 30123/37963 [68:25:25<18:08:46,  8.33s/it]
 79%|███████▉  | 30124/37963 [68:25:33<17:45:35,  8.16s/it]
 79%|███████▉  | 30125/37963 [68:25:40<17:29:02,  8.03s/it]
 79%|███████▉  | 30126/37963 [68:25:48<17:17:49,  7.95s/it]
 79%|███████▉  | 30127/37963 [68:25:56<17:11:03,  7.89s/it]
 79%|███████▉  | 30128/37963 [68:26:06<18:27:33,  8.48s/it]
 79%|███████▉  | 30129/37963 [68:26:13<17:56:26,  8.24s/it]
 79%|███████▉  | 30130/37963 [68:26:24<19:20:58,  8.89s/it]
                                                           
{'loss': '0.1146', 'grad_norm': '4.511', 'learning_rate': '2.152e-06', 'epoch': '0.7937'}
+
 79%|███████▉  | 30130/37963 [68:26:24<19:20:58,  8.89s/it]
 79%|███████▉  | 30131/37963 [68:26:34<20:23:15,  9.37s/it]
 79%|███████▉  | 30132/37963 [68:26:42<19:10:35,  8.82s/it]
 79%|███████▉  | 30133/37963 [68:26:50<18:31:42,  8.52s/it]
 79%|███████▉  | 30134/37963 [68:26:57<18:00:25,  8.28s/it]
 79%|███████▉  | 30135/37963 [68:27:05<17:40:55,  8.13s/it]
 79%|███████▉  | 30136/37963 [68:27:12<17:06:32,  7.87s/it]
 79%|███████▉  | 30137/37963 [68:27:20<16:59:17,  7.81s/it]
 79%|███████▉  | 30138/37963 [68:27:28<16:50:03,  7.74s/it]
 79%|███████▉  | 30139/37963 [68:27:35<16:36:18,  7.64s/it]
 79%|███████▉  | 30140/37963 [68:27:43<16:40:22,  7.67s/it]
                                                           
{'loss': '0.109', 'grad_norm': '3.046', 'learning_rate': '2.146e-06', 'epoch': '0.7939'}
+
 79%|███████▉  | 30140/37963 [68:27:43<16:40:22,  7.67s/it]
 79%|███████▉  | 30141/37963 [68:27:51<16:45:14,  7.71s/it]
 79%|███████▉  | 30142/37963 [68:27:58<16:42:00,  7.69s/it]
 79%|███████▉  | 30143/37963 [68:28:06<16:37:52,  7.66s/it]
 79%|███████▉  | 30144/37963 [68:28:14<16:41:55,  7.69s/it]
 79%|███████▉  | 30145/37963 [68:28:22<16:49:22,  7.75s/it]
 79%|███████▉  | 30146/37963 [68:28:29<16:44:52,  7.71s/it]
 79%|███████▉  | 30147/37963 [68:28:37<16:38:56,  7.67s/it]
 79%|███████▉  | 30148/37963 [68:28:44<16:35:04,  7.64s/it]
 79%|███████▉  | 30149/37963 [68:28:55<18:31:00,  8.53s/it]
 79%|███████▉  | 30150/37963 [68:29:03<17:53:58,  8.25s/it]
                                                           
{'loss': '0.103', 'grad_norm': '3.01', 'learning_rate': '2.141e-06', 'epoch': '0.7942'}
+
 79%|███████▉  | 30150/37963 [68:29:03<17:53:58,  8.25s/it]
 79%|███████▉  | 30151/37963 [68:29:10<17:25:57,  8.03s/it]
 79%|███████▉  | 30152/37963 [68:29:18<17:29:07,  8.06s/it]
 79%|███████▉  | 30153/37963 [68:29:26<17:17:11,  7.97s/it]
 79%|███████▉  | 30154/37963 [68:29:34<17:06:48,  7.89s/it]
 79%|███████▉  | 30155/37963 [68:29:42<17:05:57,  7.88s/it]
 79%|███████▉  | 30156/37963 [68:29:49<17:07:11,  7.89s/it]
 79%|███████▉  | 30157/37963 [68:29:57<17:03:29,  7.87s/it]
 79%|███████▉  | 30158/37963 [68:30:05<17:05:03,  7.88s/it]
 79%|███████▉  | 30159/37963 [68:30:13<16:57:02,  7.82s/it]
 79%|███████▉  | 30160/37963 [68:30:23<18:28:33,  8.52s/it]
                                                           
{'loss': '0.1159', 'grad_norm': '2.334', 'learning_rate': '2.136e-06', 'epoch': '0.7945'}
+
 79%|███████▉  | 30160/37963 [68:30:23<18:28:33,  8.52s/it]
 79%|███████▉  | 30161/37963 [68:30:31<18:04:28,  8.34s/it]
 79%|███████▉  | 30162/37963 [68:30:39<17:44:39,  8.19s/it]
 79%|███████▉  | 30163/37963 [68:30:46<17:25:14,  8.04s/it]
 79%|███████▉  | 30164/37963 [68:30:57<18:57:39,  8.75s/it]
 79%|███████▉  | 30165/37963 [68:31:05<18:24:53,  8.50s/it]
 79%|███████▉  | 30166/37963 [68:31:13<17:57:31,  8.29s/it]
 79%|███████▉  | 30167/37963 [68:31:23<19:08:33,  8.84s/it]
 79%|███████▉  | 30168/37963 [68:31:30<18:21:42,  8.48s/it]
 79%|███████▉  | 30169/37963 [68:31:38<17:54:09,  8.27s/it]
 79%|███████▉  | 30170/37963 [68:31:46<17:36:17,  8.13s/it]
                                                           
{'loss': '0.102', 'grad_norm': '3.103', 'learning_rate': '2.13e-06', 'epoch': '0.7947'}
+
 79%|███████▉  | 30170/37963 [68:31:46<17:36:17,  8.13s/it]
 79%|███████▉  | 30171/37963 [68:31:54<17:33:00,  8.11s/it]
 79%|███████▉  | 30172/37963 [68:32:02<17:18:43,  8.00s/it]
 79%|███████▉  | 30173/37963 [68:32:10<17:12:20,  7.95s/it]
 79%|███████▉  | 30174/37963 [68:32:17<16:56:49,  7.83s/it]
 79%|███████▉  | 30175/37963 [68:32:28<18:48:45,  8.70s/it]
 79%|███████▉  | 30176/37963 [68:32:38<19:50:19,  9.17s/it]
 79%|███████▉  | 30177/37963 [68:32:45<18:38:23,  8.62s/it]
 79%|███████▉  | 30178/37963 [68:32:53<18:08:12,  8.39s/it]
 79%|███████▉  | 30179/37963 [68:33:01<17:45:31,  8.21s/it]
 79%|███████▉  | 30180/37963 [68:33:11<19:04:30,  8.82s/it]
                                                           
{'loss': '0.1059', 'grad_norm': '1.954', 'learning_rate': '2.125e-06', 'epoch': '0.795'}
+
 79%|███████▉  | 30180/37963 [68:33:11<19:04:30,  8.82s/it]
 80%|███████▉  | 30181/37963 [68:33:19<18:29:00,  8.55s/it]
 80%|███████▉  | 30182/37963 [68:33:27<18:04:09,  8.36s/it]
 80%|███████▉  | 30183/37963 [68:33:35<17:48:41,  8.24s/it]
 80%|███████▉  | 30184/37963 [68:33:43<17:36:01,  8.15s/it]
 80%|███████▉  | 30185/37963 [68:33:54<19:19:29,  8.94s/it]
 80%|███████▉  | 30186/37963 [68:34:02<18:29:54,  8.56s/it]
 80%|███████▉  | 30187/37963 [68:34:09<17:43:05,  8.20s/it]
 80%|███████▉  | 30188/37963 [68:34:17<17:22:04,  8.04s/it]
 80%|███████▉  | 30189/37963 [68:34:25<17:21:27,  8.04s/it]
 80%|███████▉  | 30190/37963 [68:34:32<17:09:12,  7.94s/it]
                                                           
{'loss': '0.1053', 'grad_norm': '3.917', 'learning_rate': '2.12e-06', 'epoch': '0.7953'}
+
 80%|███████▉  | 30190/37963 [68:34:32<17:09:12,  7.94s/it]
 80%|███████▉  | 30191/37963 [68:34:40<17:02:22,  7.89s/it]
 80%|███████▉  | 30192/37963 [68:34:47<16:43:06,  7.74s/it]
 80%|███████▉  | 30193/37963 [68:34:55<16:43:40,  7.75s/it]
 80%|███████▉  | 30194/37963 [68:35:03<16:43:56,  7.75s/it]
 80%|███████▉  | 30195/37963 [68:35:14<18:37:51,  8.63s/it]
 80%|███████▉  | 30196/37963 [68:35:21<17:54:19,  8.30s/it]
 80%|███████▉  | 30197/37963 [68:35:29<17:25:38,  8.08s/it]
 80%|███████▉  | 30198/37963 [68:35:37<17:15:44,  8.00s/it]
 80%|███████▉  | 30199/37963 [68:35:44<16:59:24,  7.88s/it]
 80%|███████▉  | 30200/37963 [68:35:52<16:46:30,  7.78s/it]
                                                           
{'loss': '0.1088', 'grad_norm': '2.789', 'learning_rate': '2.115e-06', 'epoch': '0.7955'}
+
 80%|███████▉  | 30200/37963 [68:35:52<16:46:30,  7.78s/it]
 80%|███████▉  | 30201/37963 [68:35:59<16:44:27,  7.76s/it]
 80%|███████▉  | 30202/37963 [68:36:07<16:41:06,  7.74s/it]
 80%|███████▉  | 30203/37963 [68:36:17<18:18:07,  8.49s/it]
 80%|███████▉  | 30204/37963 [68:36:25<17:33:55,  8.15s/it]
 80%|███████▉  | 30205/37963 [68:36:33<17:22:58,  8.07s/it]
 80%|███████▉  | 30206/37963 [68:36:41<17:19:15,  8.04s/it]
 80%|███████▉  | 30207/37963 [68:36:48<17:07:33,  7.95s/it]
 80%|███████▉  | 30208/37963 [68:36:59<18:44:49,  8.70s/it]
 80%|███████▉  | 30209/37963 [68:37:07<18:15:02,  8.47s/it]
 80%|███████▉  | 30210/37963 [68:37:14<17:44:18,  8.24s/it]
                                                           
{'loss': '0.1105', 'grad_norm': '2.789', 'learning_rate': '2.109e-06', 'epoch': '0.7958'}
+
 80%|███████▉  | 30210/37963 [68:37:14<17:44:18,  8.24s/it]
 80%|███████▉  | 30211/37963 [68:37:22<17:20:39,  8.05s/it]
 80%|███████▉  | 30212/37963 [68:37:30<17:10:57,  7.98s/it]
 80%|███████▉  | 30213/37963 [68:37:38<17:13:29,  8.00s/it]
 80%|███████▉  | 30214/37963 [68:37:45<16:52:58,  7.84s/it]
 80%|███████▉  | 30215/37963 [68:37:53<16:52:08,  7.84s/it]
 80%|███████▉  | 30216/37963 [68:38:01<16:41:06,  7.75s/it]
 80%|███████▉  | 30217/37963 [68:38:08<16:40:55,  7.75s/it]
 80%|███████▉  | 30218/37963 [68:38:16<16:43:45,  7.78s/it]
 80%|███████▉  | 30219/37963 [68:38:24<16:43:32,  7.78s/it]
 80%|███████▉  | 30220/37963 [68:38:32<16:43:09,  7.77s/it]
                                                           
{'loss': '0.1061', 'grad_norm': '3.05', 'learning_rate': '2.104e-06', 'epoch': '0.796'}
+
 80%|███████▉  | 30220/37963 [68:38:32<16:43:09,  7.77s/it]
 80%|███████▉  | 30221/37963 [68:38:42<18:18:59,  8.52s/it]
 80%|███████▉  | 30222/37963 [68:38:50<17:53:40,  8.32s/it]
 80%|███████▉  | 30223/37963 [68:38:58<17:32:36,  8.16s/it]
 80%|███████▉  | 30224/37963 [68:39:11<20:53:58,  9.72s/it]
 80%|███████▉  | 30225/37963 [68:39:19<19:40:03,  9.15s/it]
 80%|███████▉  | 30226/37963 [68:39:26<18:36:50,  8.66s/it]
 80%|███████▉  | 30227/37963 [68:39:34<18:08:20,  8.44s/it]
 80%|███████▉  | 30228/37963 [68:39:42<17:44:33,  8.26s/it]
 80%|███████▉  | 30229/37963 [68:39:50<17:39:00,  8.22s/it]
 80%|███████▉  | 30230/37963 [68:39:58<17:26:08,  8.12s/it]
                                                           
{'loss': '0.1071', 'grad_norm': '2.155', 'learning_rate': '2.099e-06', 'epoch': '0.7963'}
+
 80%|███████▉  | 30230/37963 [68:39:58<17:26:08,  8.12s/it]
 80%|███████▉  | 30231/37963 [68:40:06<16:59:34,  7.91s/it]
 80%|███████▉  | 30232/37963 [68:40:13<16:53:27,  7.87s/it]
 80%|███████▉  | 30233/37963 [68:40:24<18:23:24,  8.56s/it]
 80%|███████▉  | 30234/37963 [68:40:34<19:45:42,  9.20s/it]
 80%|███████▉  | 30235/37963 [68:40:42<18:43:39,  8.72s/it]
 80%|███████▉  | 30236/37963 [68:40:50<18:01:45,  8.40s/it]
 80%|███████▉  | 30237/37963 [68:40:57<17:35:51,  8.20s/it]
 80%|███████▉  | 30238/37963 [68:41:05<17:16:40,  8.05s/it]
 80%|███████▉  | 30239/37963 [68:41:13<17:05:33,  7.97s/it]
 80%|███████▉  | 30240/37963 [68:41:21<17:00:44,  7.93s/it]
                                                           
{'loss': '0.1088', 'grad_norm': '2.326', 'learning_rate': '2.094e-06', 'epoch': '0.7966'}
+
 80%|███████▉  | 30240/37963 [68:41:21<17:00:44,  7.93s/it]
 80%|███████▉  | 30241/37963 [68:41:28<16:55:55,  7.89s/it]
 80%|███████▉  | 30242/37963 [68:41:36<16:51:53,  7.86s/it]
 80%|███████▉  | 30243/37963 [68:41:44<16:50:54,  7.86s/it]
 80%|███████▉  | 30244/37963 [68:41:52<16:41:25,  7.78s/it]
 80%|███████▉  | 30245/37963 [68:41:59<16:34:58,  7.74s/it]
 80%|███████▉  | 30246/37963 [68:42:07<16:36:23,  7.75s/it]
 80%|███████▉  | 30247/37963 [68:42:15<16:35:11,  7.74s/it]
 80%|███████▉  | 30248/37963 [68:42:25<18:19:24,  8.55s/it]
 80%|███████▉  | 30249/37963 [68:42:33<17:44:00,  8.28s/it]
 80%|███████▉  | 30250/37963 [68:42:40<17:11:34,  8.02s/it]
                                                           
{'loss': '0.1104', 'grad_norm': '4.026', 'learning_rate': '2.089e-06', 'epoch': '0.7968'}
+
 80%|███████▉  | 30250/37963 [68:42:40<17:11:34,  8.02s/it]
 80%|███████▉  | 30251/37963 [68:42:51<18:39:34,  8.71s/it]
 80%|███████▉  | 30252/37963 [68:43:01<19:31:51,  9.12s/it]
 80%|███████▉  | 30253/37963 [68:43:08<18:39:56,  8.72s/it]
 80%|███████▉  | 30254/37963 [68:43:16<18:13:03,  8.51s/it]
 80%|███████▉  | 30255/37963 [68:43:24<17:49:19,  8.32s/it]
 80%|███████▉  | 30256/37963 [68:43:32<17:26:35,  8.15s/it]
 80%|███████▉  | 30257/37963 [68:43:40<17:05:46,  7.99s/it]
 80%|███████▉  | 30258/37963 [68:43:48<16:58:44,  7.93s/it]
 80%|███████▉  | 30259/37963 [68:43:55<16:46:52,  7.84s/it]
 80%|███████▉  | 30260/37963 [68:44:03<16:41:50,  7.80s/it]
                                                           
{'loss': '0.1074', 'grad_norm': '3.354', 'learning_rate': '2.083e-06', 'epoch': '0.7971'}
+
 80%|███████▉  | 30260/37963 [68:44:03<16:41:50,  7.80s/it]
 80%|███████▉  | 30261/37963 [68:44:11<16:37:45,  7.77s/it]
 80%|███████▉  | 30262/37963 [68:44:18<16:33:25,  7.74s/it]
 80%|███████▉  | 30263/37963 [68:44:26<16:19:58,  7.64s/it]
 80%|███████▉  | 30264/37963 [68:44:34<16:30:55,  7.72s/it]
 80%|███████▉  | 30265/37963 [68:44:41<16:33:53,  7.75s/it]
 80%|███████▉  | 30266/37963 [68:44:49<16:33:06,  7.74s/it]
 80%|███████▉  | 30267/37963 [68:45:00<18:20:30,  8.58s/it]
 80%|███████▉  | 30268/37963 [68:45:07<17:49:51,  8.34s/it]
 80%|███████▉  | 30269/37963 [68:45:15<17:24:31,  8.15s/it]
 80%|███████▉  | 30270/37963 [68:45:23<17:09:02,  8.03s/it]
                                                           
{'loss': '0.1001', 'grad_norm': '3.427', 'learning_rate': '2.078e-06', 'epoch': '0.7974'}
+
 80%|███████▉  | 30270/37963 [68:45:23<17:09:02,  8.03s/it]
 80%|███████▉  | 30271/37963 [68:45:31<16:57:05,  7.93s/it]
 80%|███████▉  | 30272/37963 [68:45:39<16:59:29,  7.95s/it]
 80%|███████▉  | 30273/37963 [68:45:46<16:51:59,  7.90s/it]
 80%|███████▉  | 30274/37963 [68:45:54<16:55:35,  7.93s/it]
 80%|███████▉  | 30275/37963 [68:46:05<18:36:39,  8.71s/it]
 80%|███████▉  | 30276/37963 [68:46:13<18:06:49,  8.48s/it]
 80%|███████▉  | 30277/37963 [68:46:23<19:02:29,  8.92s/it]
 80%|███████▉  | 30278/37963 [68:46:31<18:20:47,  8.59s/it]
 80%|███████▉  | 30279/37963 [68:46:39<17:54:19,  8.39s/it]
 80%|███████▉  | 30280/37963 [68:46:46<17:21:52,  8.14s/it]
                                                           
{'loss': '0.1062', 'grad_norm': '3.652', 'learning_rate': '2.073e-06', 'epoch': '0.7976'}
+
 80%|███████▉  | 30280/37963 [68:46:46<17:21:52,  8.14s/it]
 80%|███████▉  | 30281/37963 [68:46:54<16:58:32,  7.96s/it]
 80%|███████▉  | 30282/37963 [68:47:01<16:55:58,  7.94s/it]
 80%|███████▉  | 30283/37963 [68:47:09<16:44:05,  7.84s/it]
 80%|███████▉  | 30284/37963 [68:47:16<16:25:23,  7.70s/it]
 80%|███████▉  | 30285/37963 [68:47:24<16:29:58,  7.74s/it]
 80%|███████▉  | 30286/37963 [68:47:35<18:14:43,  8.56s/it]
 80%|███████▉  | 30287/37963 [68:47:45<19:19:43,  9.07s/it]
 80%|███████▉  | 30288/37963 [68:47:53<18:25:50,  8.65s/it]
 80%|███████▉  | 30289/37963 [68:48:01<17:54:51,  8.40s/it]
 80%|███████▉  | 30290/37963 [68:48:08<17:16:12,  8.10s/it]
                                                           
{'loss': '0.09988', 'grad_norm': '2.474', 'learning_rate': '2.068e-06', 'epoch': '0.7979'}
+
 80%|███████▉  | 30290/37963 [68:48:08<17:16:12,  8.10s/it]
 80%|███████▉  | 30291/37963 [68:48:16<16:58:50,  7.97s/it]
 80%|███████▉  | 30292/37963 [68:48:23<16:55:40,  7.94s/it]
 80%|███████▉  | 30293/37963 [68:48:31<16:44:56,  7.86s/it]
 80%|███████▉  | 30294/37963 [68:48:39<16:46:05,  7.87s/it]
 80%|███████▉  | 30295/37963 [68:48:49<18:19:06,  8.60s/it]
 80%|███████▉  | 30296/37963 [68:48:57<17:47:25,  8.35s/it]
 80%|███████▉  | 30297/37963 [68:49:05<17:18:10,  8.13s/it]
 80%|███████▉  | 30298/37963 [68:49:13<17:07:39,  8.04s/it]
 80%|███████▉  | 30299/37963 [68:49:20<16:56:30,  7.96s/it]
 80%|███████▉  | 30300/37963 [68:49:28<16:44:22,  7.86s/it]
                                                           
{'loss': '0.1061', 'grad_norm': '2.454', 'learning_rate': '2.062e-06', 'epoch': '0.7981'}
+
 80%|███████▉  | 30300/37963 [68:49:28<16:44:22,  7.86s/it]
 80%|███████▉  | 30301/37963 [68:49:36<16:41:04,  7.84s/it]
 80%|███████▉  | 30302/37963 [68:49:46<18:12:47,  8.56s/it]
 80%|███████▉  | 30303/37963 [68:49:54<17:43:19,  8.33s/it]
 80%|███████▉  | 30304/37963 [68:50:01<17:19:53,  8.15s/it]
 80%|███████▉  | 30305/37963 [68:50:12<18:54:07,  8.89s/it]
 80%|███████▉  | 30306/37963 [68:50:20<18:21:49,  8.63s/it]
 80%|███████▉  | 30307/37963 [68:50:28<18:00:53,  8.47s/it]
 80%|███████▉  | 30308/37963 [68:50:36<17:30:18,  8.23s/it]
 80%|███████▉  | 30309/37963 [68:50:44<17:07:03,  8.05s/it]
 80%|███████▉  | 30310/37963 [68:50:51<16:55:47,  7.96s/it]
                                                           
{'loss': '0.1141', 'grad_norm': '2.368', 'learning_rate': '2.057e-06', 'epoch': '0.7984'}
+
 80%|███████▉  | 30310/37963 [68:50:51<16:55:47,  7.96s/it]
 80%|███████▉  | 30311/37963 [68:50:59<16:45:31,  7.88s/it]
 80%|███████▉  | 30312/37963 [68:51:07<16:39:24,  7.84s/it]
 80%|███████▉  | 30313/37963 [68:51:14<16:33:59,  7.80s/it]
 80%|███████▉  | 30314/37963 [68:51:22<16:20:37,  7.69s/it]
 80%|███████▉  | 30315/37963 [68:51:29<16:16:53,  7.66s/it]
 80%|███████▉  | 30316/37963 [68:51:37<16:04:37,  7.57s/it]
 80%|███████▉  | 30317/37963 [68:51:45<16:10:40,  7.62s/it]
 80%|███████▉  | 30318/37963 [68:51:52<16:20:18,  7.69s/it]
 80%|███████▉  | 30319/37963 [68:52:00<16:18:15,  7.68s/it]
 80%|███████▉  | 30320/37963 [68:52:08<16:27:45,  7.75s/it]
                                                           
{'loss': '0.1019', 'grad_norm': '2.665', 'learning_rate': '2.052e-06', 'epoch': '0.7987'}
+
 80%|███████▉  | 30320/37963 [68:52:08<16:27:45,  7.75s/it]
 80%|███████▉  | 30321/37963 [68:52:19<18:19:23,  8.63s/it]
 80%|███████▉  | 30322/37963 [68:52:26<17:45:00,  8.36s/it]
 80%|███████▉  | 30323/37963 [68:52:34<17:15:28,  8.13s/it]
 80%|███████▉  | 30324/37963 [68:52:42<17:04:23,  8.05s/it]
 80%|███████▉  | 30325/37963 [68:52:49<16:45:38,  7.90s/it]
 80%|███████▉  | 30326/37963 [68:52:57<16:44:40,  7.89s/it]
 80%|███████▉  | 30327/37963 [68:53:05<16:50:25,  7.94s/it]
 80%|███████▉  | 30328/37963 [68:53:13<16:42:08,  7.88s/it]
 80%|███████▉  | 30329/37963 [68:53:23<18:12:17,  8.58s/it]
 80%|███████▉  | 30330/37963 [68:53:31<17:29:06,  8.25s/it]
                                                           
{'loss': '0.1097', 'grad_norm': '2.25', 'learning_rate': '2.047e-06', 'epoch': '0.7989'}
+
 80%|███████▉  | 30330/37963 [68:53:31<17:29:06,  8.25s/it]
 80%|███████▉  | 30331/37963 [68:53:41<18:46:19,  8.85s/it]
 80%|███████▉  | 30332/37963 [68:53:49<18:04:07,  8.52s/it]
 80%|███████▉  | 30333/37963 [68:53:56<17:15:51,  8.15s/it]
 80%|███████▉  | 30334/37963 [68:54:04<16:58:07,  8.01s/it]
 80%|███████▉  | 30335/37963 [68:54:14<18:37:40,  8.79s/it]
 80%|███████▉  | 30336/37963 [68:54:22<17:45:15,  8.38s/it]
 80%|███████▉  | 30337/37963 [68:54:30<17:28:33,  8.25s/it]
 80%|███████▉  | 30338/37963 [68:54:40<18:48:46,  8.88s/it]
 80%|███████▉  | 30339/37963 [68:54:48<18:11:07,  8.59s/it]
 80%|███████▉  | 30340/37963 [68:54:56<17:43:30,  8.37s/it]
                                                           
{'loss': '0.1198', 'grad_norm': '1.975', 'learning_rate': '2.042e-06', 'epoch': '0.7992'}
+
 80%|███████▉  | 30340/37963 [68:54:56<17:43:30,  8.37s/it]
 80%|███████▉  | 30341/37963 [68:55:03<17:16:07,  8.16s/it]
 80%|███████▉  | 30342/37963 [68:55:11<16:52:09,  7.97s/it]
 80%|███████▉  | 30343/37963 [68:55:19<16:41:44,  7.89s/it]
 80%|███████▉  | 30344/37963 [68:55:26<16:34:28,  7.83s/it]
 80%|███████▉  | 30345/37963 [68:55:34<16:35:45,  7.84s/it]
 80%|███████▉  | 30346/37963 [68:55:42<16:27:54,  7.78s/it]
 80%|███████▉  | 30347/37963 [68:55:52<18:12:49,  8.61s/it]
 80%|███████▉  | 30348/37963 [68:56:00<17:45:51,  8.40s/it]
 80%|███████▉  | 30349/37963 [68:56:11<19:03:23,  9.01s/it]
 80%|███████▉  | 30350/37963 [68:56:18<18:08:11,  8.58s/it]
                                                           
{'loss': '0.1087', 'grad_norm': '2.647', 'learning_rate': '2.037e-06', 'epoch': '0.7995'}
+
 80%|███████▉  | 30350/37963 [68:56:18<18:08:11,  8.58s/it]
 80%|██████���▉  | 30351/37963 [68:56:29<19:09:35,  9.06s/it]
 80%|███████▉  | 30352/37963 [68:56:36<18:24:36,  8.71s/it]
 80%|███████▉  | 30353/37963 [68:56:44<17:53:17,  8.46s/it]
 80%|███████▉  | 30354/37963 [68:56:52<17:31:01,  8.29s/it]
 80%|███████▉  | 30355/37963 [68:57:00<17:14:28,  8.16s/it]
 80%|███████▉  | 30356/37963 [68:57:08<16:55:06,  8.01s/it]
 80%|███████▉  | 30357/37963 [68:57:15<16:39:42,  7.89s/it]
 80%|███████▉  | 30358/37963 [68:57:23<16:36:25,  7.86s/it]
 80%|███████▉  | 30359/37963 [68:57:31<16:41:33,  7.90s/it]
 80%|███████▉  | 30360/37963 [68:57:39<16:34:35,  7.85s/it]
                                                           
{'loss': '0.1015', 'grad_norm': '2.515', 'learning_rate': '2.031e-06', 'epoch': '0.7997'}
+
 80%|███████▉  | 30360/37963 [68:57:39<16:34:35,  7.85s/it]
 80%|███████▉  | 30361/37963 [68:57:46<16:21:33,  7.75s/it]
 80%|███████▉  | 30362/37963 [68:57:54<16:25:49,  7.78s/it]
 80%|███████▉  | 30363/37963 [68:58:02<16:21:43,  7.75s/it]
 80%|███████▉  | 30364/37963 [68:58:10<16:26:05,  7.79s/it]
 80%|███████▉  | 30365/37963 [68:58:18<16:28:59,  7.81s/it]
 80%|███████▉  | 30366/37963 [68:58:26<16:31:59,  7.83s/it]
 80%|███████▉  | 30367/37963 [68:58:33<16:26:30,  7.79s/it]
 80%|███████▉  | 30368/37963 [68:58:41<16:11:29,  7.67s/it]
 80%|███████▉  | 30369/37963 [68:58:48<16:11:01,  7.67s/it]
 80%|███████▉  | 30370/37963 [68:58:59<17:59:42,  8.53s/it]
                                                           
{'loss': '0.1213', 'grad_norm': '3.012', 'learning_rate': '2.026e-06', 'epoch': '0.8'}
+
 80%|███████▉  | 30370/37963 [68:58:59<17:59:42,  8.53s/it]
 80%|████████  | 30371/37963 [68:59:07<17:34:17,  8.33s/it]
 80%|████████  | 30372/37963 [68:59:14<17:12:58,  8.16s/it]
 80%|████████  | 30373/37963 [68:59:22<17:00:33,  8.07s/it]
 80%|████████  | 30374/37963 [68:59:30<16:52:28,  8.00s/it]
 80%|████████  | 30375/37963 [68:59:38<16:32:05,  7.84s/it]
 80%|████████  | 30376/37963 [68:59:45<16:23:59,  7.78s/it]
 80%|████████  | 30377/37963 [68:59:53<16:24:07,  7.78s/it]
 80%|████████  | 30378/37963 [69:00:01<16:18:50,  7.74s/it]
 80%|████████  | 30379/37963 [69:00:08<16:17:41,  7.73s/it]
 80%|████████  | 30380/37963 [69:00:16<16:19:46,  7.75s/it]
                                                           
{'loss': '0.1065', 'grad_norm': '2.956', 'learning_rate': '2.021e-06', 'epoch': '0.8003'}
+
 80%|████████  | 30380/37963 [69:00:16<16:19:46,  7.75s/it]
 80%|████████  | 30381/37963 [69:00:24<16:19:59,  7.76s/it]
 80%|████████  | 30382/37963 [69:00:32<16:12:31,  7.70s/it]
 80%|████████  | 30383/37963 [69:00:45<19:32:15,  9.28s/it]
 80%|████████  | 30384/37963 [69:00:52<18:36:39,  8.84s/it]
 80%|████████  | 30385/37963 [69:01:03<19:27:55,  9.25s/it]
 80%|████████  | 30386/37963 [69:01:13<20:25:29,  9.70s/it]
 80%|████████  | 30387/37963 [69:01:21<19:12:57,  9.13s/it]
 80%|████████  | 30388/37963 [69:01:29<18:15:13,  8.68s/it]
 80%|████████  | 30389/37963 [69:01:37<17:45:07,  8.44s/it]
 80%|████████  | 30390/37963 [69:01:45<17:33:29,  8.35s/it]
                                                           
{'loss': '0.1136', 'grad_norm': '2.251', 'learning_rate': '2.016e-06', 'epoch': '0.8005'}
+
 80%|████████  | 30390/37963 [69:01:45<17:33:29,  8.35s/it]
 80%|████████  | 30391/37963 [69:01:52<17:10:24,  8.16s/it]
 80%|████████  | 30392/37963 [69:02:00<16:55:18,  8.05s/it]
 80%|████████  | 30393/37963 [69:02:08<16:43:31,  7.95s/it]
 80%|████████  | 30394/37963 [69:02:16<16:30:44,  7.85s/it]
 80%|████████  | 30395/37963 [69:02:26<18:13:41,  8.67s/it]
 80%|████████  | 30396/37963 [69:02:37<19:22:29,  9.22s/it]
 80%|████████  | 30397/37963 [69:02:44<18:24:21,  8.76s/it]
 80%|████████  | 30398/37963 [69:02:55<19:24:44,  9.24s/it]
 80%|████████  | 30399/37963 [69:03:03<18:33:57,  8.84s/it]
 80%|████████  | 30400/37963 [69:03:10<17:49:07,  8.48s/it]
                                                           
{'loss': '0.1096', 'grad_norm': '2.457', 'learning_rate': '2.011e-06', 'epoch': '0.8008'}
+
 80%|████████  | 30400/37963 [69:03:10<17:49:07,  8.48s/it]
 80%|████████  | 30401/37963 [69:03:18<17:26:40,  8.30s/it]
 80%|████████  | 30402/37963 [69:03:26<17:00:45,  8.10s/it]
 80%|████████  | 30403/37963 [69:03:34<16:52:45,  8.04s/it]
 80%|████████  | 30404/37963 [69:03:41<16:37:36,  7.92s/it]
 80%|████████  | 30405/37963 [69:03:49<16:35:55,  7.91s/it]
 80%|████████  | 30406/37963 [69:03:57<16:35:21,  7.90s/it]
 80%|████████  | 30407/37963 [69:04:05<16:26:16,  7.83s/it]
 80%|████████  | 30408/37963 [69:04:13<16:29:52,  7.86s/it]
 80%|████████  | 30409/37963 [69:04:21<16:33:26,  7.89s/it]
 80%|████████  | 30410/37963 [69:04:28<16:31:12,  7.87s/it]
                                                           
{'loss': '0.1065', 'grad_norm': '2.611', 'learning_rate': '2.006e-06', 'epoch': '0.801'}
+
 80%|████████  | 30410/37963 [69:04:28<16:31:12,  7.87s/it]
 80%|████████  | 30411/37963 [69:04:36<16:22:58,  7.81s/it]
 80%|████████  | 30412/37963 [69:04:44<16:26:52,  7.84s/it]
 80%|████████  | 30413/37963 [69:04:52<16:18:35,  7.78s/it]
 80%|████████  | 30414/37963 [69:04:59<16:19:23,  7.78s/it]
 80%|████████  | 30415/37963 [69:05:07<16:19:01,  7.78s/it]
 80%|████████  | 30416/37963 [69:05:15<16:13:19,  7.74s/it]
 80%|████████  | 30417/37963 [69:05:23<16:18:21,  7.78s/it]
 80%|████████  | 30418/37963 [69:05:30<16:12:26,  7.73s/it]
 80%|████████  | 30419/37963 [69:05:38<16:03:31,  7.66s/it]
 80%|████████  | 30420/37963 [69:05:45<15:59:23,  7.63s/it]
                                                           
{'loss': '0.09422', 'grad_norm': '3.475', 'learning_rate': '2.001e-06', 'epoch': '0.8013'}
+
 80%|████████  | 30420/37963 [69:05:45<15:59:23,  7.63s/it]
 80%|████████  | 30421/37963 [69:05:53<16:07:49,  7.70s/it]
 80%|████████  | 30422/37963 [69:06:01<16:00:15,  7.64s/it]
 80%|████████  | 30423/37963 [69:06:09<16:16:13,  7.77s/it]
 80%|████████  | 30424/37963 [69:06:19<17:51:10,  8.53s/it]
 80%|████████  | 30425/37963 [69:06:27<17:18:31,  8.27s/it]
 80%|████████  | 30426/37963 [69:06:35<16:57:46,  8.10s/it]
 80%|████████  | 30427/37963 [69:06:45<18:28:25,  8.83s/it]
 80%|████████  | 30428/37963 [69:06:53<17:42:55,  8.46s/it]
 80%|████████  | 30429/37963 [69:07:00<17:09:30,  8.20s/it]
 80%|████████  | 30430/37963 [69:07:08<16:59:49,  8.12s/it]
                                                           
{'loss': '0.1008', 'grad_norm': '2.968', 'learning_rate': '1.996e-06', 'epoch': '0.8016'}
+
 80%|████████  | 30430/37963 [69:07:08<16:59:49,  8.12s/it]
 80%|████████  | 30431/37963 [69:07:19<18:24:40,  8.80s/it]
 80%|████████  | 30432/37963 [69:07:27<17:52:49,  8.55s/it]
 80%|████████  | 30433/37963 [69:07:37<19:03:10,  9.11s/it]
 80%|████████  | 30434/37963 [69:07:48<20:03:17,  9.59s/it]
 80%|████████  | 30435/37963 [69:07:56<18:58:33,  9.07s/it]
 80%|████████  | 30436/37963 [69:08:03<18:15:38,  8.73s/it]
 80%|████████  | 30437/37963 [69:08:11<17:33:52,  8.40s/it]
 80%|████████  | 30438/37963 [69:08:22<18:49:36,  9.01s/it]
 80%|████████  | 30439/37963 [69:08:29<18:01:23,  8.62s/it]
 80%|████████  | 30440/37963 [69:08:37<17:43:25,  8.48s/it]
                                                           
{'loss': '0.09523', 'grad_norm': '2.776', 'learning_rate': '1.99e-06', 'epoch': '0.8018'}
+
 80%|████████  | 30440/37963 [69:08:37<17:43:25,  8.48s/it]
 80%|████████  | 30441/37963 [69:08:45<17:03:59,  8.17s/it]
 80%|████████  | 30442/37963 [69:08:55<18:27:54,  8.84s/it]
 80%|████████  | 30443/37963 [69:09:06<19:26:14,  9.31s/it]
 80%|████████  | 30444/37963 [69:09:13<18:18:11,  8.76s/it]
 80%|████████  | 30445/37963 [69:09:21<17:37:53,  8.44s/it]
 80%|████████  | 30446/37963 [69:09:29<17:09:21,  8.22s/it]
 80%|████████  | 30447/37963 [69:09:36<16:58:27,  8.13s/it]
 80%|████████  | 30448/37963 [69:09:44<16:39:29,  7.98s/it]
 80%|████████  | 30449/37963 [69:09:52<16:34:56,  7.94s/it]
 80%|████████  | 30450/37963 [69:10:00<16:32:06,  7.92s/it]
                                                           
{'loss': '0.09947', 'grad_norm': '3.171', 'learning_rate': '1.985e-06', 'epoch': '0.8021'}
+
 80%|████████  | 30450/37963 [69:10:00<16:32:06,  7.92s/it]
 80%|████████  | 30451/37963 [69:10:07<16:05:55,  7.72s/it]
 80%|████████  | 30452/37963 [69:10:15<16:03:20,  7.70s/it]
 80%|████████  | 30453/37963 [69:10:22<16:02:27,  7.69s/it]
 80%|████████  | 30454/37963 [69:10:30<16:06:52,  7.73s/it]
 80%|████████  | 30455/37963 [69:10:38<16:07:28,  7.73s/it]
 80%|���███████  | 30456/37963 [69:10:46<16:15:28,  7.80s/it]
 80%|████████  | 30457/37963 [69:10:54<16:11:42,  7.77s/it]
 80%|████████  | 30458/37963 [69:11:01<16:12:09,  7.77s/it]
 80%|████████  | 30459/37963 [69:11:09<16:04:41,  7.71s/it]
 80%|████████  | 30460/37963 [69:11:17<16:07:29,  7.74s/it]
                                                           
{'loss': '0.09616', 'grad_norm': '2.721', 'learning_rate': '1.98e-06', 'epoch': '0.8024'}
+
 80%|████████  | 30460/37963 [69:11:17<16:07:29,  7.74s/it]
 80%|████████  | 30461/37963 [69:11:24<16:02:42,  7.70s/it]
 80%|████████  | 30462/37963 [69:11:32<15:57:15,  7.66s/it]
 80%|████████  | 30463/37963 [69:11:40<15:58:19,  7.67s/it]
 80%|████████  | 30464/37963 [69:11:47<16:01:51,  7.70s/it]
 80%|████████  | 30465/37963 [69:11:55<16:08:14,  7.75s/it]
 80%|████████  | 30466/37963 [69:12:03<16:08:10,  7.75s/it]
 80%|████████  | 30467/37963 [69:12:11<16:10:44,  7.77s/it]
 80%|████████  | 30468/37963 [69:12:19<16:09:34,  7.76s/it]
 80%|████████  | 30469/37963 [69:12:26<16:06:07,  7.74s/it]
 80%|████████  | 30470/37963 [69:12:34<16:01:25,  7.70s/it]
                                                           
{'loss': '0.117', 'grad_norm': '2.531', 'learning_rate': '1.975e-06', 'epoch': '0.8026'}
+
 80%|████████  | 30470/37963 [69:12:34<16:01:25,  7.70s/it]
 80%|████████  | 30471/37963 [69:12:44<17:44:44,  8.53s/it]
 80%|████████  | 30472/37963 [69:12:52<17:13:55,  8.28s/it]
 80%|████████  | 30473/37963 [69:13:00<16:50:25,  8.09s/it]
 80%|████████  | 30474/37963 [69:13:07<16:35:24,  7.97s/it]
 80%|████████  | 30475/37963 [69:13:15<16:28:08,  7.92s/it]
 80%|████████  | 30476/37963 [69:13:23<16:14:20,  7.81s/it]
 80%|████████  | 30477/37963 [69:13:31<16:14:24,  7.81s/it]
 80%|████████  | 30478/37963 [69:13:41<17:52:40,  8.60s/it]
 80%|████████  | 30479/37963 [69:13:49<17:21:04,  8.35s/it]
 80%|████████  | 30480/37963 [69:13:59<18:34:45,  8.94s/it]
                                                           
{'loss': '0.09523', 'grad_norm': '3.641', 'learning_rate': '1.97e-06', 'epoch': '0.8029'}
+
 80%|████████  | 30480/37963 [69:13:59<18:34:45,  8.94s/it]
 80%|████████  | 30481/37963 [69:14:07<17:54:52,  8.62s/it]
 80%|████████  | 30482/37963 [69:14:14<17:10:56,  8.27s/it]
 80%|████████  | 30483/37963 [69:14:22<16:48:16,  8.09s/it]
 80%|████████  | 30484/37963 [69:14:33<18:25:49,  8.87s/it]
 80%|████████  | 30485/37963 [69:14:45<20:45:21,  9.99s/it]
 80%|████████  | 30486/37963 [69:14:53<19:20:44,  9.31s/it]
 80%|████████  | 30487/37963 [69:15:01<18:21:29,  8.84s/it]
 80%|████████  | 30488/37963 [69:15:14<20:50:38, 10.04s/it]
 80%|████████  | 30489/37963 [69:15:21<19:29:22,  9.39s/it]
 80%|████████  | 30490/37963 [69:15:29<18:27:09,  8.89s/it]
                                                           
{'loss': '0.1114', 'grad_norm': '4.488', 'learning_rate': '1.965e-06', 'epoch': '0.8032'}
+
 80%|████████  | 30490/37963 [69:15:29<18:27:09,  8.89s/it]
 80%|████████  | 30491/37963 [69:15:37<17:37:27,  8.49s/it]
 80%|████████  | 30492/37963 [69:15:44<16:59:14,  8.19s/it]
 80%|████████  | 30493/37963 [69:15:52<16:39:50,  8.03s/it]
 80%|████████  | 30494/37963 [69:16:00<16:28:08,  7.94s/it]
 80%|████████  | 30495/37963 [69:16:08<16:25:34,  7.92s/it]
 80%|████████  | 30496/37963 [69:16:15<16:15:43,  7.84s/it]
 80%|████████  | 30497/37963 [69:16:23<16:13:04,  7.82s/it]
 80%|████████  | 30498/37963 [69:16:31<16:17:54,  7.86s/it]
 80%|████████  | 30499/37963 [69:16:39<16:11:52,  7.81s/it]
 80%|████████  | 30500/37963 [69:16:46<16:02:35,  7.74s/it]
                                                           
{'loss': '0.09264', 'grad_norm': '2.084', 'learning_rate': '1.96e-06', 'epoch': '0.8034'}
+
 80%|████████  | 30500/37963 [69:16:46<16:02:35,  7.74s/it]
 80%|████████  | 30501/37963 [69:16:54<16:13:35,  7.83s/it]
 80%|████████  | 30502/37963 [69:17:02<16:13:33,  7.83s/it]
 80%|████████  | 30503/37963 [69:17:10<16:06:45,  7.78s/it]
 80%|████████  | 30504/37963 [69:17:17<16:02:34,  7.74s/it]
 80%|████████  | 30505/37963 [69:17:25<15:59:49,  7.72s/it]
 80%|████████  | 30506/37963 [69:17:33<16:00:49,  7.73s/it]
 80%|████████  | 30507/37963 [69:17:41<16:01:12,  7.74s/it]
 80%|████████  | 30508/37963 [69:17:48<15:56:41,  7.70s/it]
 80%|████████  | 30509/37963 [69:17:56<15:53:09,  7.67s/it]
 80%|████████  | 30510/37963 [69:18:04<16:04:19,  7.76s/it]
                                                           
{'loss': '0.1181', 'grad_norm': '2.538', 'learning_rate': '1.955e-06', 'epoch': '0.8037'}
+
 80%|████████  | 30510/37963 [69:18:04<16:04:19,  7.76s/it]
 80%|████████  | 30511/37963 [69:18:12<16:07:15,  7.79s/it]
 80%|████████  | 30512/37963 [69:18:19<16:04:27,  7.77s/it]
 80%|████████  | 30513/37963 [69:18:27<16:00:38,  7.74s/it]
 80%|████████  | 30514/37963 [69:18:37<17:32:46,  8.48s/it]
 80%|████████  | 30515/37963 [69:18:45<16:59:59,  8.22s/it]
 80%|████████  | 30516/37963 [69:18:53<16:45:54,  8.10s/it]
 80%|████████  | 30517/37963 [69:19:00<16:18:32,  7.89s/it]
 80%|████████  | 30518/37963 [69:19:08<16:24:09,  7.93s/it]
 80%|████████  | 30519/37963 [69:19:16<16:17:35,  7.88s/it]
 80%|████████  | 30520/37963 [69:19:23<16:10:09,  7.82s/it]
                                                           
{'loss': '0.09879', 'grad_norm': '2.733', 'learning_rate': '1.95e-06', 'epoch': '0.8039'}
+
 80%|████████  | 30520/37963 [69:19:23<16:10:09,  7.82s/it]
 80%|████████  | 30521/37963 [69:19:31<16:16:07,  7.87s/it]
 80%|████████  | 30522/37963 [69:19:40<16:23:47,  7.93s/it]
 80%|████████  | 30523/37963 [69:19:47<16:18:40,  7.89s/it]
 80%|████████  | 30524/37963 [69:19:55<16:06:07,  7.79s/it]
 80%|████████  | 30525/37963 [69:20:03<16:08:44,  7.81s/it]
 80%|████████  | 30526/37963 [69:20:11<16:09:10,  7.82s/it]
 80%|████████  | 30527/37963 [69:20:21<17:55:24,  8.68s/it]
 80%|████████  | 30528/37963 [69:20:31<18:50:50,  9.13s/it]
 80%|████████  | 30529/37963 [69:20:42<19:39:35,  9.52s/it]
 80%|████████  | 30530/37963 [69:20:50<18:41:01,  9.05s/it]
                                                           
{'loss': '0.1031', 'grad_norm': '2.682', 'learning_rate': '1.945e-06', 'epoch': '0.8042'}
+
 80%|████████  | 30530/37963 [69:20:50<18:41:01,  9.05s/it]
 80%|████████  | 30531/37963 [69:20:58<17:49:57,  8.64s/it]
 80%|████████  | 30532/37963 [69:21:08<19:12:33,  9.31s/it]
 80%|████████  | 30533/37963 [69:21:16<18:10:09,  8.80s/it]
 80%|████████  | 30534/37963 [69:21:26<19:12:22,  9.31s/it]
 80%|████████  | 30535/37963 [69:21:34<18:02:25,  8.74s/it]
 80%|████████  | 30536/37963 [69:21:41<17:11:59,  8.34s/it]
 80%|████████  | 30537/37963 [69:21:52<18:43:01,  9.07s/it]
 80%|████████  | 30538/37963 [69:22:00<17:58:34,  8.72s/it]
 80%|████████  | 30539/37963 [69:22:10<18:41:26,  9.06s/it]
 80%|████████  | 30540/37963 [69:22:18<17:54:31,  8.69s/it]
                                                           
{'loss': '0.1023', 'grad_norm': '4.029', 'learning_rate': '1.94e-06', 'epoch': '0.8045'}
+
 80%|████████  | 30540/37963 [69:22:18<17:54:31,  8.69s/it]
 80%|████████  | 30541/37963 [69:22:25<17:10:06,  8.33s/it]
 80%|████████  | 30542/37963 [69:22:33<16:44:44,  8.12s/it]
 80%|████████  | 30543/37963 [69:22:40<16:26:26,  7.98s/it]
 80%|████████  | 30544/37963 [69:22:48<16:07:44,  7.83s/it]
 80%|████████  | 30545/37963 [69:22:56<16:04:24,  7.80s/it]
 80%|████████  | 30546/37963 [69:23:03<16:05:48,  7.81s/it]
 80%|████████  | 30547/37963 [69:23:11<16:01:45,  7.78s/it]
 80%|████████  | 30548/37963 [69:23:19<16:10:31,  7.85s/it]
 80%|████████  | 30549/37963 [69:23:27<16:06:33,  7.82s/it]
 80%|████████  | 30550/37963 [69:23:35<16:06:19,  7.82s/it]
                                                           
{'loss': '0.111', 'grad_norm': '2.716', 'learning_rate': '1.935e-06', 'epoch': '0.8047'}
+
 80%|████████  | 30550/37963 [69:23:35<16:06:19,  7.82s/it]
 80%|████████  | 30551/37963 [69:23:43<16:03:40,  7.80s/it]
 80%|████████  | 30552/37963 [69:23:50<16:03:31,  7.80s/it]
 80%|████████  | 30553/37963 [69:23:58<16:00:04,  7.77s/it]
 80%|████████  | 30554/37963 [69:24:06<15:55:18,  7.74s/it]
 80%|████████  | 30555/37963 [69:24:14<15:59:38,  7.77s/it]
 80%|████████  | 30556/37963 [69:24:21<15:59:33,  7.77s/it]
 80%|████████  | 30557/37963 [69:24:29<15:55:34,  7.74s/it]
 80%|████████  | 30558/37963 [69:24:37<16:01:40,  7.79s/it]
 80%|████████  | 30559/37963 [69:24:45<16:06:26,  7.83s/it]
 80%|████████  | 30560/37963 [69:24:52<15:59:15,  7.77s/it]
                                                           
{'loss': '0.1088', 'grad_norm': '2.782', 'learning_rate': '1.93e-06', 'epoch': '0.805'}
+
 80%|████████  | 30560/37963 [69:24:52<15:59:15,  7.77s/it]
 81%|████████  | 30561/37963 [69:25:00<16:01:55,  7.80s/it]
 81%|████████  | 30562/37963 [69:25:11<17:43:52,  8.62s/it]
 81%|████████  | 30563/37963 [69:25:19<17:19:02,  8.42s/it]
 81%|████████  | 30564/37963 [69:25:27<17:00:24,  8.27s/it]
 81%|████████  | 30565/37963 [69:25:35<16:44:24,  8.15s/it]
 81%|████████  | 30566/37963 [69:25:42<16:15:49,  7.92s/it]
 81%|████████  | 30567/37963 [69:25:50<16:16:29,  7.92s/it]
 81%|████████  | 30568/37963 [69:25:57<15:51:49,  7.72s/it]
 81%|████████  | 30569/37963 [69:26:04<15:36:49,  7.60s/it]
 81%|████████  | 30570/37963 [69:26:12<15:42:56,  7.65s/it]
                                                           
{'loss': '0.08394', 'grad_norm': '2.572', 'learning_rate': '1.924e-06', 'epoch': '0.8053'}
+
 81%|████████  | 30570/37963 [69:26:12<15:42:56,  7.65s/it]
 81%|████████  | 30571/37963 [69:26:20<15:46:42,  7.68s/it]
 81%|████████  | 30572/37963 [69:26:27<15:35:44,  7.60s/it]
 81%|████████  | 30573/37963 [69:26:40<18:53:08,  9.20s/it]
 81%|████████  | 30574/37963 [69:26:48<17:56:05,  8.74s/it]
 81%|████████  | 30575/37963 [69:26:56<17:22:12,  8.46s/it]
 81%|████████  | 30576/37963 [69:27:09<20:19:21,  9.90s/it]
 81%|████████  | 30577/37963 [69:27:17<18:53:48,  9.21s/it]
 81%|████████  | 30578/37963 [69:27:24<17:58:09,  8.76s/it]
 81%|████████  | 30579/37963 [69:27:32<17:15:13,  8.41s/it]
 81%|████████  | 30580/37963 [69:27:40<16:46:41,  8.18s/it]
                                                           
{'loss': '0.09551', 'grad_norm': '1.969', 'learning_rate': '1.919e-06', 'epoch': '0.8055'}
+
 81%|████████  | 30580/37963 [69:27:40<16:46:41,  8.18s/it]
 81%|████████  | 30581/37963 [69:27:50<18:18:41,  8.93s/it]
 81%|████████  | 30582/37963 [69:27:58<17:36:24,  8.59s/it]
 81%|████████  | 30583/37963 [69:28:06<17:13:03,  8.40s/it]
 81%|████████  | 30584/37963 [69:28:14<16:50:09,  8.21s/it]
 81%|████████  | 30585/37963 [69:28:24<18:06:04,  8.83s/it]
 81%|████████  | 30586/37963 [69:28:32<17:30:49,  8.55s/it]
 81%|████████  | 30587/37963 [69:28:40<17:00:11,  8.30s/it]
 81%|████████  | 30588/37963 [69:28:47<16:35:59,  8.10s/it]
 81%|████████  | 30589/37963 [69:28:55<16:20:10,  7.98s/it]
 81%|████████  | 30590/37963 [69:29:03<16:12:41,  7.92s/it]
                                                           
{'loss': '0.09976', 'grad_norm': '3.199', 'learning_rate': '1.914e-06', 'epoch': '0.8058'}
+
 81%|████████  | 30590/37963 [69:29:03<16:12:41,  7.92s/it]
 81%|████████  | 30591/37963 [69:29:11<16:12:08,  7.91s/it]
 81%|████████  | 30592/37963 [69:29:19<16:08:49,  7.89s/it]
 81%|████████  | 30593/37963 [69:29:29<17:37:37,  8.61s/it]
 81%|████████  | 30594/37963 [69:29:37<17:12:07,  8.40s/it]
 81%|████████  | 30595/37963 [69:29:45<16:50:53,  8.23s/it]
 81%|████████  | 30596/37963 [69:29:52<16:34:33,  8.10s/it]
 81%|████████  | 30597/37963 [69:30:00<16:20:37,  7.99s/it]
 81%|████████  | 30598/37963 [69:30:08<16:06:07,  7.87s/it]
 81%|████████  | 30599/37963 [69:30:15<16:01:21,  7.83s/it]
 81%|████████  | 30600/37963 [69:30:24<16:10:51,  7.91s/it]
                                                           
{'loss': '0.0954', 'grad_norm': '2.379', 'learning_rate': '1.909e-06', 'epoch': '0.8061'}
+
 81%|████████  | 30600/37963 [69:30:24<16:10:51,  7.91s/it]
 81%|████████  | 30601/37963 [69:30:31<16:06:36,  7.88s/it]
 81%|████████  | 30602/37963 [69:30:39<16:06:29,  7.88s/it]
 81%|████████  | 30603/37963 [69:30:47<15:58:40,  7.82s/it]
 81%|████████  | 30604/37963 [69:30:54<15:44:45,  7.70s/it]
 81%|████████  | 30605/37963 [69:31:02<15:42:30,  7.69s/it]
 81%|████████  | 30606/37963 [69:31:10<15:46:43,  7.72s/it]
 81%|████████  | 30607/37963 [69:31:17<15:43:45,  7.70s/it]
 81%|████████  | 30608/37963 [69:31:25<15:46:48,  7.72s/it]
 81%|████████  | 30609/37963 [69:31:33<15:43:39,  7.70s/it]
 81%|████████  | 30610/37963 [69:31:41<15:41:19,  7.68s/it]
                                                           
{'loss': '0.11', 'grad_norm': '2.207', 'learning_rate': '1.904e-06', 'epoch': '0.8063'}
+
 81%|████���███  | 30610/37963 [69:31:41<15:41:19,  7.68s/it]
 81%|████████  | 30611/37963 [69:31:51<17:24:24,  8.52s/it]
 81%|████████  | 30612/37963 [69:31:59<17:01:09,  8.33s/it]
 81%|████████  | 30613/37963 [69:32:07<16:37:14,  8.14s/it]
 81%|████████  | 30614/37963 [69:32:14<16:21:22,  8.01s/it]
 81%|████████  | 30615/37963 [69:32:22<16:16:13,  7.97s/it]
 81%|████████  | 30616/37963 [69:32:30<16:13:40,  7.95s/it]
 81%|████████  | 30617/37963 [69:32:38<16:05:21,  7.88s/it]
 81%|████████  | 30618/37963 [69:32:45<15:41:16,  7.69s/it]
 81%|████████  | 30619/37963 [69:32:53<15:44:08,  7.71s/it]
 81%|████████  | 30620/37963 [69:33:03<17:17:02,  8.47s/it]
                                                           
{'loss': '0.1022', 'grad_norm': '2.315', 'learning_rate': '1.899e-06', 'epoch': '0.8066'}
+
 81%|████████  | 30620/37963 [69:33:03<17:17:02,  8.47s/it]
 81%|████████  | 30621/37963 [69:33:16<19:54:10,  9.76s/it]
 81%|████████  | 30622/37963 [69:33:24<18:45:32,  9.20s/it]
 81%|████████  | 30623/37963 [69:33:31<17:47:07,  8.72s/it]
 81%|████████  | 30624/37963 [69:33:45<20:40:44, 10.14s/it]
 81%|████████  | 30625/37963 [69:33:53<19:25:39,  9.53s/it]
 81%|████████  | 30626/37963 [69:34:01<18:18:17,  8.98s/it]
 81%|████████  | 30627/37963 [69:34:08<17:35:06,  8.63s/it]
 81%|████████  | 30628/37963 [69:34:16<16:58:57,  8.33s/it]
 81%|████████  | 30629/37963 [69:34:24<16:32:57,  8.12s/it]
 81%|████████  | 30630/37963 [69:34:31<16:15:18,  7.98s/it]
                                                           
{'loss': '0.1069', 'grad_norm': '2.835', 'learning_rate': '1.894e-06', 'epoch': '0.8068'}
+
 81%|████████  | 30630/37963 [69:34:31<16:15:18,  7.98s/it]
 81%|████████  | 30631/37963 [69:34:42<17:45:03,  8.72s/it]
 81%|████████  | 30632/37963 [69:34:49<16:59:47,  8.35s/it]
 81%|████████  | 30633/37963 [69:34:57<16:40:09,  8.19s/it]
 81%|████████  | 30634/37963 [69:35:04<16:08:15,  7.93s/it]
 81%|████████  | 30635/37963 [69:35:12<15:58:31,  7.85s/it]
 81%|████████  | 30636/37963 [69:35:20<15:51:20,  7.79s/it]
 81%|████████  | 30637/37963 [69:35:27<15:48:03,  7.76s/it]
 81%|████████  | 30638/37963 [69:35:35<15:50:48,  7.79s/it]
 81%|████████  | 30639/37963 [69:35:43<15:52:30,  7.80s/it]
 81%|████████  | 30640/37963 [69:35:51<15:56:16,  7.84s/it]
                                                           
{'loss': '0.1074', 'grad_norm': '2.9', 'learning_rate': '1.889e-06', 'epoch': '0.8071'}
+
 81%|████████  | 30640/37963 [69:35:51<15:56:16,  7.84s/it]
 81%|████████  | 30641/37963 [69:35:59<15:50:46,  7.79s/it]
 81%|████████  | 30642/37963 [69:36:07<15:56:59,  7.84s/it]
 81%|████████  | 30643/37963 [69:36:14<15:53:21,  7.81s/it]
 81%|████████  | 30644/37963 [69:36:25<17:22:38,  8.55s/it]
 81%|████████  | 30645/37963 [69:36:33<16:58:15,  8.35s/it]
 81%|████████  | 30646/37963 [69:36:40<16:42:50,  8.22s/it]
 81%|████████  | 30647/37963 [69:36:48<16:26:22,  8.09s/it]
 81%|████████  | 30648/37963 [69:36:56<16:17:08,  8.01s/it]
 81%|████████  | 30649/37963 [69:37:04<16:08:07,  7.94s/it]
 81%|████████  | 30650/37963 [69:37:11<15:55:23,  7.84s/it]
                                                           
{'loss': '0.1082', 'grad_norm': '3.498', 'learning_rate': '1.884e-06', 'epoch': '0.8074'}
+
 81%|████████  | 30650/37963 [69:37:11<15:55:23,  7.84s/it]
 81%|████████  | 30651/37963 [69:37:19<15:49:21,  7.79s/it]
 81%|████████  | 30652/37963 [69:37:27<15:39:52,  7.71s/it]
 81%|████████  | 30653/37963 [69:37:34<15:36:37,  7.69s/it]
 81%|████████  | 30654/37963 [69:37:45<17:21:06,  8.55s/it]
 81%|████████  | 30655/37963 [69:37:53<16:58:07,  8.36s/it]
 81%|████████  | 30656/37963 [69:38:00<16:26:41,  8.10s/it]
 81%|████████  | 30657/37963 [69:38:08<16:20:28,  8.05s/it]
 81%|████████  | 30658/37963 [69:38:16<15:56:29,  7.86s/it]
 81%|████████  | 30659/37963 [69:38:23<15:42:49,  7.75s/it]
 81%|████████  | 30660/37963 [69:38:31<15:48:27,  7.79s/it]
                                                           
{'loss': '0.1142', 'grad_norm': '2.819', 'learning_rate': '1.879e-06', 'epoch': '0.8076'}
+
 81%|████████  | 30660/37963 [69:38:31<15:48:27,  7.79s/it]
 81%|████████  | 30661/37963 [69:38:39<15:48:57,  7.80s/it]
 81%|████████  | 30662/37963 [69:38:46<15:41:51,  7.74s/it]
 81%|████████  | 30663/37963 [69:38:56<17:03:45,  8.41s/it]
 81%|████████  | 30664/37963 [69:39:07<18:20:58,  9.05s/it]
 81%|████████  | 30665/37963 [69:39:15<17:36:34,  8.69s/it]
 81%|████████  | 30666/37963 [69:39:23<17:03:22,  8.41s/it]
 81%|████████  | 30667/37963 [69:39:30<16:44:18,  8.26s/it]
 81%|████████  | 30668/37963 [69:39:38<16:29:28,  8.14s/it]
 81%|████████  | 30669/37963 [69:39:46<16:16:35,  8.03s/it]
 81%|████████  | 30670/37963 [69:39:54<16:03:54,  7.93s/it]
                                                           
{'loss': '0.1181', 'grad_norm': '3.054', 'learning_rate': '1.874e-06', 'epoch': '0.8079'}
+
 81%|████████  | 30670/37963 [69:39:54<16:03:54,  7.93s/it]
 81%|████████  | 30671/37963 [69:40:05<17:47:15,  8.78s/it]
 81%|████████  | 30672/37963 [69:40:12<17:06:49,  8.45s/it]
 81%|████████  | 30673/37963 [69:40:20<16:36:26,  8.20s/it]
 81%|████████  | 30674/37963 [69:40:30<17:56:57,  8.87s/it]
 81%|████████  | 30675/37963 [69:40:41<18:51:17,  9.31s/it]
 81%|████████  | 30676/37963 [69:40:48<17:53:18,  8.84s/it]
 81%|████████  | 30677/37963 [69:40:56<17:17:08,  8.54s/it]
 81%|████████  | 30678/37963 [69:41:07<18:30:10,  9.14s/it]
 81%|████████  | 30679/37963 [69:41:15<17:45:53,  8.78s/it]
 81%|████████  | 30680/37963 [69:41:22<17:04:11,  8.44s/it]
                                                           
{'loss': '0.09706', 'grad_norm': '4.322', 'learning_rate': '1.87e-06', 'epoch': '0.8082'}
+
 81%|████████  | 30680/37963 [69:41:22<17:04:11,  8.44s/it]
 81%|████████  | 30681/37963 [69:41:30<16:41:39,  8.25s/it]
 81%|████████  | 30682/37963 [69:41:38<16:27:55,  8.14s/it]
 81%|████████  | 30683/37963 [69:41:46<16:09:05,  7.99s/it]
 81%|████████  | 30684/37963 [69:41:53<15:46:48,  7.80s/it]
 81%|████████  | 30685/37963 [69:42:01<15:56:11,  7.88s/it]
 81%|████████  | 30686/37963 [69:42:09<15:49:41,  7.83s/it]
 81%|████████  | 30687/37963 [69:42:16<15:36:47,  7.73s/it]
 81%|████████  | 30688/37963 [69:42:24<15:41:13,  7.76s/it]
 81%|████████  | 30689/37963 [69:42:32<15:37:34,  7.73s/it]
 81%|████████  | 30690/37963 [69:42:39<15:29:18,  7.67s/it]
                                                           
{'loss': '0.09171', 'grad_norm': '2.691', 'learning_rate': '1.865e-06', 'epoch': '0.8084'}
+
 81%|████████  | 30690/37963 [69:42:39<15:29:18,  7.67s/it]
 81%|████████  | 30691/37963 [69:42:47<15:33:55,  7.71s/it]
 81%|████████  | 30692/37963 [69:42:55<15:44:54,  7.80s/it]
 81%|████████  | 30693/37963 [69:43:03<15:42:10,  7.78s/it]
 81%|████████  | 30694/37963 [69:43:11<15:43:26,  7.79s/it]
 81%|████████  | 30695/37963 [69:43:18<15:33:53,  7.71s/it]
 81%|████████  | 30696/37963 [69:43:26<15:32:25,  7.70s/it]
 81%|████████  | 30697/37963 [69:43:34<15:34:10,  7.71s/it]
 81%|████████  | 30698/37963 [69:43:47<18:58:23,  9.40s/it]
 81%|████████  | 30699/37963 [69:43:55<18:06:18,  8.97s/it]
 81%|████████  | 30700/37963 [69:44:02<17:11:52,  8.52s/it]
                                                           
{'loss': '0.1078', 'grad_norm': '3.629', 'learning_rate': '1.86e-06', 'epoch': '0.8087'}
+
 81%|████████  | 30700/37963 [69:44:02<17:11:52,  8.52s/it]
 81%|████████  | 30701/37963 [69:44:10<16:26:10,  8.15s/it]
 81%|████████  | 30702/37963 [69:44:17<16:13:34,  8.05s/it]
 81%|████████  | 30703/37963 [69:44:25<16:00:22,  7.94s/it]
 81%|████████  | 30704/37963 [69:44:33<15:52:14,  7.87s/it]
 81%|████████  | 30705/37963 [69:44:41<15:47:40,  7.83s/it]
 81%|████████  | 30706/37963 [69:44:48<15:44:40,  7.81s/it]
 81%|████████  | 30707/37963 [69:44:56<15:33:13,  7.72s/it]
 81%|████████  | 30708/37963 [69:45:04<15:37:28,  7.75s/it]
 81%|████████  | 30709/37963 [69:45:11<15:34:06,  7.73s/it]
 81%|████████  | 30710/37963 [69:45:19<15:28:59,  7.68s/it]
                                                           
{'loss': '0.1026', 'grad_norm': '2.374', 'learning_rate': '1.855e-06', 'epoch': '0.8089'}
+
 81%|████████  | 30710/37963 [69:45:19<15:28:59,  7.68s/it]
 81%|████████  | 30711/37963 [69:45:26<15:23:51,  7.64s/it]
 81%|████████  | 30712/37963 [69:45:37<17:04:39,  8.48s/it]
 81%|████████  | 30713/37963 [69:45:44<16:29:21,  8.19s/it]
 81%|████████  | 30714/37963 [69:45:52<16:12:58,  8.05s/it]
 81%|████████  | 30715/37963 [69:46:02<17:34:51,  8.73s/it]
 81%|████████  | 30716/37963 [69:46:10<16:54:45,  8.40s/it]
 81%|████████  | 30717/37963 [69:46:18<16:34:08,  8.23s/it]
 81%|████████  | 30718/37963 [69:46:28<17:48:04,  8.85s/it]
 81%|████████  | 30719/37963 [69:46:39<18:51:43,  9.37s/it]
 81%|████████  | 30720/37963 [69:46:49<19:18:59,  9.60s/it]
                                                           
{'loss': '0.1', 'grad_norm': '2.734', 'learning_rate': '1.85e-06', 'epoch': '0.8092'}
+
 81%|████████  | 30720/37963 [69:46:49<19:18:59,  9.60s/it]
 81%|████████  | 30721/37963 [69:46:57<18:09:07,  9.02s/it]
 81%|████████  | 30722/37963 [69:47:04<17:25:58,  8.67s/it]
 81%|████████  | 30723/37963 [69:47:12<16:51:50,  8.39s/it]
 81%|████████  | 30724/37963 [69:47:20<16:23:07,  8.15s/it]
 81%|████████  | 30725/37963 [69:47:28<16:08:00,  8.02s/it]
 81%|████████  | 30726/37963 [69:47:35<15:53:02,  7.90s/it]
 81%|████████  | 30727/37963 [69:47:43<15:43:52,  7.83s/it]
 81%|████████  | 30728/37963 [69:47:51<15:41:41,  7.81s/it]
 81%|████████  | 30729/37963 [69:47:58<15:35:15,  7.76s/it]
 81%|████████  | 30730/37963 [69:48:06<15:38:30,  7.79s/it]
                                                           
{'loss': '0.1089', 'grad_norm': '3.195', 'learning_rate': '1.845e-06', 'epoch': '0.8095'}
+
 81%|████████  | 30730/37963 [69:48:06<15:38:30,  7.79s/it]
 81%|████████  | 30731/37963 [69:48:14<15:42:49,  7.82s/it]
 81%|████████  | 30732/37963 [69:48:25<17:21:56,  8.65s/it]
 81%|████████  | 30733/37963 [69:48:33<16:59:29,  8.46s/it]
 81%|████████  | 30734/37963 [69:48:40<16:37:13,  8.28s/it]
 81%|████████  | 30735/37963 [69:48:48<16:13:15,  8.08s/it]
 81%|████████  | 30736/37963 [69:48:56<16:05:10,  8.01s/it]
 81%|████████  | 30737/37963 [69:49:04<15:50:48,  7.89s/it]
 81%|████████  | 30738/37963 [69:49:11<15:49:46,  7.89s/it]
 81%|████████  | 30739/37963 [69:49:19<15:33:41,  7.75s/it]
 81%|████████  | 30740/37963 [69:49:27<15:31:52,  7.74s/it]
                                                           
{'loss': '0.1023', 'grad_norm': '3.297', 'learning_rate': '1.84e-06', 'epoch': '0.8097'}
+
 81%|████████  | 30740/37963 [69:49:27<15:31:52,  7.74s/it]
 81%|████████  | 30741/37963 [69:49:34<15:40:00,  7.81s/it]
 81%|████████  | 30742/37963 [69:49:47<18:41:01,  9.31s/it]
 81%|████████  | 30743/37963 [69:49:55<17:45:27,  8.85s/it]
 81%|████████  | 30744/37963 [69:50:03<17:15:14,  8.60s/it]
 81%|████████  | 30745/37963 [69:50:11<16:42:56,  8.34s/it]
 81%|████████  | 30746/37963 [69:50:19<16:26:05,  8.20s/it]
 81%|████████  | 30747/37963 [69:50:26<16:10:02,  8.07s/it]
 81%|████████  | 30748/37963 [69:50:34<15:57:59,  7.97s/it]
 81%|████████  | 30749/37963 [69:50:42<15:46:07,  7.87s/it]
 81%|████████  | 30750/37963 [69:50:50<15:40:15,  7.82s/it]
                                                           
{'loss': '0.114', 'grad_norm': '1.644', 'learning_rate': '1.835e-06', 'epoch': '0.81'}
+
 81%|████████  | 30750/37963 [69:50:50<15:40:15,  7.82s/it]
 81%|████████  | 30751/37963 [69:50:57<15:35:08,  7.78s/it]
 81%|████████  | 30752/37963 [69:51:04<15:16:19,  7.62s/it]
 81%|████████  | 30753/37963 [69:51:12<15:16:55,  7.63s/it]
 81%|████████  | 30754/37963 [69:51:20<15:07:09,  7.55s/it]
 81%|████████  | 30755/37963 [69:51:27<15:10:06,  7.58s/it]
 81%|████████  | 30756/37963 [69:51:35<15:19:29,  7.65s/it]
 81%|████████  | 30757/37963 [69:51:42<15:10:02,  7.58s/it]
 81%|████████  | 30758/37963 [69:51:50<15:14:12,  7.61s/it]
 81%|████████  | 30759/37963 [69:51:58<15:27:57,  7.73s/it]
 81%|████████  | 30760/37963 [69:52:08<16:55:40,  8.46s/it]
                                                           
{'loss': '0.1045', 'grad_norm': '2.034', 'learning_rate': '1.83e-06', 'epoch': '0.8103'}
+
 81%|████████  | 30760/37963 [69:52:08<16:55:40,  8.46s/it]
 81%|████████  | 30761/37963 [69:52:16<16:30:46,  8.25s/it]
 81%|████████  | 30762/37963 [69:52:27<17:54:56,  8.96s/it]
 81%|████████  | 30763/37963 [69:52:35<17:19:49,  8.67s/it]
 81%|████████  | 30764/37963 [69:52:45<18:18:13,  9.15s/it]
 81%|████████  | 30765/37963 [69:52:53<17:36:15,  8.80s/it]
 81%|████████  | 30766/37963 [69:53:03<18:31:58,  9.27s/it]
 81%|████████  | 30767/37963 [69:53:11<17:28:29,  8.74s/it]
 81%|████████  | 30768/37963 [69:53:21<18:21:12,  9.18s/it]
 81%|████████  | 30769/37963 [69:53:29<17:31:20,  8.77s/it]
 81%|████████  | 30770/37963 [69:53:36<16:50:34,  8.43s/it]
                                                           
{'loss': '0.1014', 'grad_norm': '2.347', 'learning_rate': '1.825e-06', 'epoch': '0.8105'}
+
 81%|████████  | 30770/37963 [69:53:36<16:50:34,  8.43s/it]
 81%|████████  | 30771/37963 [69:53:44<16:20:37,  8.18s/it]
 81%|████████  | 30772/37963 [69:53:52<16:12:42,  8.12s/it]
 81%|████████  | 30773/37963 [69:54:00<16:08:03,  8.08s/it]
 81%|████████  | 30774/37963 [69:54:08<16:03:36,  8.04s/it]
 81%|████████  | 30775/37963 [69:54:16<15:50:29,  7.93s/it]
 81%|████████  | 30776/37963 [69:54:23<15:45:09,  7.89s/it]
 81%|████████  | 30777/37963 [69:54:31<15:47:56,  7.91s/it]
 81%|████████  | 30778/37963 [69:54:39<15:45:13,  7.89s/it]
 81%|████████  | 30779/37963 [69:54:47<15:34:33,  7.81s/it]
 81%|████████  | 30780/37963 [69:54:54<15:29:33,  7.76s/it]
                                                           
{'loss': '0.1131', 'grad_norm': '2.333', 'learning_rate': '1.82e-06', 'epoch': '0.8108'}
+
 81%|████████  | 30780/37963 [69:54:54<15:29:33,  7.76s/it]
 81%|████████  | 30781/37963 [69:55:05<17:14:14,  8.64s/it]
 81%|████████  | 30782/37963 [69:55:13<16:47:06,  8.41s/it]
 81%|████████  | 30783/37963 [69:55:21<16:27:15,  8.25s/it]
 81%|████████  | 30784/37963 [69:55:29<16:08:28,  8.09s/it]
 81%|████████  | 30785/37963 [69:55:36<15:51:23,  7.95s/it]
 81%|████████  | 30786/37963 [69:55:46<17:12:02,  8.63s/it]
 81%|████████  | 30787/37963 [69:55:54<16:48:58,  8.44s/it]
 81%|████████  | 30788/37963 [69:56:02<16:20:40,  8.20s/it]
 81%|████████  | 30789/37963 [69:56:10<16:01:52,  8.04s/it]
 81%|████████  | 30790/37963 [69:56:17<15:48:55,  7.94s/it]
                                                           
{'loss': '0.1261', 'grad_norm': '2.401', 'learning_rate': '1.815e-06', 'epoch': '0.8111'}
+
 81%|████████  | 30790/37963 [69:56:17<15:48:55,  7.94s/it]
 81%|████████  | 30791/37963 [69:56:25<15:46:34,  7.92s/it]
 81%|████████  | 30792/37963 [69:56:33<15:25:09,  7.74s/it]
 81%|████████  | 30793/37963 [69:56:40<15:27:37,  7.76s/it]
 81%|████████  | 30794/37963 [69:56:48<15:25:47,  7.75s/it]
 81%|████████  | 30795/37963 [69:56:55<15:07:46,  7.60s/it]
 81%|████████  | 30796/37963 [69:57:06<16:46:47,  8.43s/it]
 81%|████████  | 30797/37963 [69:57:13<16:18:27,  8.19s/it]
 81%|████████  | 30798/37963 [69:57:21<15:53:30,  7.98s/it]
 81%|████████  | 30799/37963 [69:57:29<15:40:46,  7.88s/it]
 81%|████████  | 30800/37963 [69:57:36<15:41:22,  7.89s/it]
                                                           
{'loss': '0.1107', 'grad_norm': '2.722', 'learning_rate': '1.81e-06', 'epoch': '0.8113'}
+
 81%|████████  | 30800/37963 [69:57:36<15:41:22,  7.89s/it]
 81%|████████  | 30801/37963 [69:57:44<15:26:15,  7.76s/it]
 81%|████████  | 30802/37963 [69:57:52<15:23:09,  7.73s/it]
 81%|████████  | 30803/37963 [69:57:59<15:19:47,  7.71s/it]
 81%|████████  | 30804/37963 [69:58:07<15:23:09,  7.74s/it]
 81%|████████  | 30805/37963 [69:58:15<15:15:38,  7.68s/it]
 81%|████████  | 30806/37963 [69:58:22<15:21:13,  7.72s/it]
 81%|████████  | 30807/37963 [69:58:30<15:24:49,  7.75s/it]
 81%|████████  | 30808/37963 [69:58:40<16:50:10,  8.47s/it]
 81%|████████  | 30809/37963 [69:58:48<16:13:31,  8.16s/it]
 81%|████████  | 30810/37963 [69:58:59<17:46:46,  8.95s/it]
                                                           
{'loss': '0.1041', 'grad_norm': '2.459', 'learning_rate': '1.805e-06', 'epoch': '0.8116'}
+
 81%|████████  | 30810/37963 [69:58:59<17:46:46,  8.95s/it]
 81%|████████  | 30811/37963 [69:59:07<17:13:17,  8.67s/it]
 81%|████████  | 30812/37963 [69:59:17<18:20:54,  9.24s/it]
 81%|████████  | 30813/37963 [69:59:25<17:33:55,  8.84s/it]
 81%|████████  | 30814/37963 [69:59:33<17:05:01,  8.60s/it]
 81%|████████  | 30815/37963 [69:59:43<18:05:51,  9.11s/it]
 81%|████████  | 30816/37963 [69:59:54<18:53:20,  9.51s/it]
 81%|████████  | 30817/37963 [70:00:02<18:00:05,  9.07s/it]
 81%|████████  | 30818/37963 [70:00:10<17:15:21,  8.69s/it]
 81%|████████  | 30819/37963 [70:00:18<16:42:27,  8.42s/it]
 81%|████████  | 30820/37963 [70:00:25<16:20:50,  8.24s/it]
                                                           
{'loss': '0.1095', 'grad_norm': '2.584', 'learning_rate': '1.801e-06', 'epoch': '0.8118'}
+
 81%|████████  | 30820/37963 [70:00:25<16:20:50,  8.24s/it]
 81%|████████  | 30821/37963 [70:00:33<16:06:36,  8.12s/it]
 81%|████████  | 30822/37963 [70:00:41<15:43:36,  7.93s/it]
 81%|████████  | 30823/37963 [70:00:48<15:36:41,  7.87s/it]
 81%|████████  | 30824/37963 [70:00:56<15:33:38,  7.85s/it]
 81%|████████  | 30825/37963 [70:01:04<15:27:57,  7.80s/it]
 81%|████████  | 30826/37963 [70:01:12<15:32:19,  7.84s/it]
 81%|████████  | 30827/37963 [70:01:19<15:19:32,  7.73s/it]
 81%|████████  | 30828/37963 [70:01:27<15:17:04,  7.71s/it]
 81%|████████  | 30829/37963 [70:01:38<17:02:21,  8.60s/it]
 81%|████████  | 30830/37963 [70:01:46<16:38:00,  8.39s/it]
                                                           
{'loss': '0.0891', 'grad_norm': '2.474', 'learning_rate': '1.796e-06', 'epoch': '0.8121'}
+
 81%|████████  | 30830/37963 [70:01:46<16:38:00,  8.39s/it]
 81%|████████  | 30831/37963 [70:01:53<16:16:32,  8.22s/it]
 81%|████████  | 30832/37963 [70:02:01<16:02:32,  8.10s/it]
 81%|████████  | 30833/37963 [70:02:09<15:47:45,  7.98s/it]
 81%|████████  | 30834/37963 [70:02:17<15:50:08,  8.00s/it]
 81%|████████  | 30835/37963 [70:02:25<15:43:19,  7.94s/it]
 81%|████████  | 30836/37963 [70:02:32<15:28:05,  7.81s/it]
 81%|████████  | 30837/37963 [70:02:40<15:21:48,  7.76s/it]
 81%|████████  | 30838/37963 [70:02:48<15:25:08,  7.79s/it]
 81%|████████  | 30839/37963 [70:02:58<16:46:59,  8.48s/it]
 81%|████████  | 30840/37963 [70:03:05<16:15:53,  8.22s/it]
                                                           
{'loss': '0.09654', 'grad_norm': '2.25', 'learning_rate': '1.791e-06', 'epoch': '0.8124'}
+
 81%|████████  | 30840/37963 [70:03:05<16:15:53,  8.22s/it]
 81%|████████  | 30841/37963 [70:03:13<15:50:49,  8.01s/it]
 81%|████████  | 30842/37963 [70:03:21<15:34:09,  7.87s/it]
 81%|████████  | 30843/37963 [70:03:28<15:29:49,  7.84s/it]
 81%|████████  | 30844/37963 [70:03:39<17:13:57,  8.71s/it]
 81%|████████▏ | 30845/37963 [70:03:47<16:37:33,  8.41s/it]
 81%|████████▏ | 30846/37963 [70:03:54<16:11:34,  8.19s/it]
 81%|████████▏ | 30847/37963 [70:04:02<15:52:24,  8.03s/it]
 81%|████████▏ | 30848/37963 [70:04:10<15:44:46,  7.97s/it]
 81%|████████▏ | 30849/37963 [70:04:18<15:40:49,  7.93s/it]
 81%|████████▏ | 30850/37963 [70:04:26<15:38:24,  7.92s/it]
                                                           
{'loss': '0.1152', 'grad_norm': '3.743', 'learning_rate': '1.786e-06', 'epoch': '0.8126'}
+
 81%|████████▏ | 30850/37963 [70:04:26<15:38:24,  7.92s/it]
 81%|████████▏ | 30851/37963 [70:04:34<15:39:44,  7.93s/it]
 81%|████████▏ | 30852/37963 [70:04:42<15:45:34,  7.98s/it]
 81%|████████▏ | 30853/37963 [70:04:52<16:58:56,  8.60s/it]
 81%|████████▏ | 30854/37963 [70:04:59<16:28:13,  8.34s/it]
 81%|████████▏ | 30855/37963 [70:05:07<16:09:47,  8.19s/it]
 81%|████████▏ | 30856/37963 [70:05:15<16:04:03,  8.14s/it]
 81%|████████▏ | 30857/37963 [70:05:23<15:40:13,  7.94s/it]
 81%|████████▏ | 30858/37963 [70:05:30<15:30:33,  7.86s/it]
 81%|████████▏ | 30859/37963 [70:05:38<15:23:44,  7.80s/it]
 81%|████████▏ | 30860/37963 [70:05:46<15:21:26,  7.78s/it]
                                                           
{'loss': '0.1073', 'grad_norm': '3.109', 'learning_rate': '1.781e-06', 'epoch': '0.8129'}
+
 81%|████████▏ | 30860/37963 [70:05:46<15:21:26,  7.78s/it]
 81%|████████▏ | 30861/37963 [70:05:56<16:48:00,  8.52s/it]
 81%|████████▏ | 30862/37963 [70:06:04<16:21:58,  8.30s/it]
 81%|████████▏ | 30863/37963 [70:06:14<17:26:32,  8.84s/it]
 81%|████████▏ | 30864/37963 [70:06:22<16:49:12,  8.53s/it]
 81%|████████▏ | 30865/37963 [70:06:30<16:29:22,  8.36s/it]
 81%|████████▏ | 30866/37963 [70:06:40<17:34:51,  8.92s/it]
 81%|████████▏ | 30867/37963 [70:06:48<16:48:43,  8.53s/it]
 81%|████████▏ | 30868/37963 [70:06:55<16:24:59,  8.33s/it]
 81%|████████▏ | 30869/37963 [70:07:03<16:02:37,  8.14s/it]
 81%|████████▏ | 30870/37963 [70:07:13<17:14:28,  8.75s/it]
                                                           
{'loss': '0.09423', 'grad_norm': '1.886', 'learning_rate': '1.776e-06', 'epoch': '0.8132'}
+
 81%|████████▏ | 30870/37963 [70:07:13<17:14:28,  8.75s/it]
 81%|████████▏ | 30871/37963 [70:07:21<16:40:42,  8.47s/it]
 81%|████████▏ | 30872/37963 [70:07:29<16:09:21,  8.20s/it]
 81%|████████▏ | 30873/37963 [70:07:36<15:47:21,  8.02s/it]
 81%|████████▏ | 30874/37963 [70:07:44<15:29:38,  7.87s/it]
 81%|████████▏ | 30875/37963 [70:07:52<15:30:28,  7.88s/it]
 81%|████████▏ | 30876/37963 [70:07:59<15:20:32,  7.79s/it]
 81%|████████▏ | 30877/37963 [70:08:07<15:22:14,  7.81s/it]
 81%|████████▏ | 30878/37963 [70:08:15<15:23:57,  7.82s/it]
 81%|████████▏ | 30879/37963 [70:08:23<15:21:41,  7.81s/it]
 81%|████████▏ | 30880/37963 [70:08:30<15:14:08,  7.74s/it]
                                                           
{'loss': '0.09625', 'grad_norm': '2.361', 'learning_rate': '1.771e-06', 'epoch': '0.8134'}
+
 81%|████████▏ | 30880/37963 [70:08:30<15:14:08,  7.74s/it]
 81%|████████▏ | 30881/37963 [70:08:38<15:11:49,  7.73s/it]
 81%|████████▏ | 30882/37963 [70:08:46<15:11:29,  7.72s/it]
 81%|████████▏ | 30883/37963 [70:08:56<16:44:24,  8.51s/it]
 81%|████████▏ | 30884/37963 [70:09:04<16:17:40,  8.29s/it]
 81%|████████▏ | 30885/37963 [70:09:12<15:54:38,  8.09s/it]
 81%|████████▏ | 30886/37963 [70:09:19<15:28:00,  7.87s/it]
 81%|████████▏ | 30887/37963 [70:09:29<16:53:11,  8.59s/it]
 81%|████████▏ | 30888/37963 [70:09:37<16:25:07,  8.35s/it]
 81%|████████▏ | 30889/37963 [70:09:45<16:03:57,  8.18s/it]
 81%|████████▏ | 30890/37963 [70:09:52<15:41:45,  7.99s/it]
                                                           
{'loss': '0.09843', 'grad_norm': '2.188', 'learning_rate': '1.767e-06', 'epoch': '0.8137'}
+
 81%|████████▏ | 30890/37963 [70:09:52<15:41:45,  7.99s/it]
 81%|████████▏ | 30891/37963 [70:10:00<15:30:09,  7.89s/it]
 81%|████████▏ | 30892/37963 [70:10:10<16:59:24,  8.65s/it]
 81%|████████▏ | 30893/37963 [70:10:18<16:14:48,  8.27s/it]
 81%|████████▏ | 30894/37963 [70:10:26<15:55:51,  8.11s/it]
 81%|████████▏ | 30895/37963 [70:10:34<15:55:37,  8.11s/it]
 81%|████████▏ | 30896/37963 [70:10:41<15:45:41,  8.03s/it]
 81%|████████▏ | 30897/37963 [70:10:52<17:08:26,  8.73s/it]
 81%|████████▏ | 30898/37963 [70:11:00<16:36:08,  8.46s/it]
 81%|████████▏ | 30899/37963 [70:11:07<16:11:30,  8.25s/it]
 81%|████████▏ | 30900/37963 [70:11:15<15:54:29,  8.11s/it]
                                                           
{'loss': '0.112', 'grad_norm': '4.585', 'learning_rate': '1.762e-06', 'epoch': '0.814'}
+
 81%|████████▏ | 30900/37963 [70:11:15<15:54:29,  8.11s/it]
 81%|████████▏ | 30901/37963 [70:11:23<15:40:35,  7.99s/it]
 81%|████████▏ | 30902/37963 [70:11:30<15:18:28,  7.80s/it]
 81%|████████▏ | 30903/37963 [70:11:38<15:15:04,  7.78s/it]
 81%|████████▏ | 30904/37963 [70:11:45<15:02:04,  7.67s/it]
 81%|████████▏ | 30905/37963 [70:11:56<16:39:18,  8.50s/it]
 81%|████████▏ | 30906/37963 [70:12:06<17:47:00,  9.07s/it]
 81%|████████▏ | 30907/37963 [70:12:14<17:07:51,  8.74s/it]
 81%|████████▏ | 30908/37963 [70:12:22<16:40:16,  8.51s/it]
 81%|████████▏ | 30909/37963 [70:12:30<16:01:18,  8.18s/it]
 81%|████████▏ | 30910/37963 [70:12:38<15:56:47,  8.14s/it]
                                                           
{'loss': '0.1076', 'grad_norm': '2.555', 'learning_rate': '1.757e-06', 'epoch': '0.8142'}
+
 81%|████████▏ | 30910/37963 [70:12:38<15:56:47,  8.14s/it]
 81%|████████▏ | 30911/37963 [70:12:45<15:41:31,  8.01s/it]
 81%|████████▏ | 30912/37963 [70:12:53<15:32:08,  7.93s/it]
 81%|████████▏ | 30913/37963 [70:13:01<15:21:45,  7.84s/it]
 81%|████████▏ | 30914/37963 [70:13:11<16:52:47,  8.62s/it]
 81%|████████▏ | 30915/37963 [70:13:21<17:49:21,  9.10s/it]
 81%|████████▏ | 30916/37963 [70:13:29<17:01:40,  8.70s/it]
 81%|████████▏ | 30917/37963 [70:13:36<16:07:44,  8.24s/it]
 81%|████████▏ | 30918/37963 [70:13:44<15:42:19,  8.03s/it]
 81%|████████▏ | 30919/37963 [70:13:52<15:31:35,  7.94s/it]
 81%|████████▏ | 30920/37963 [70:13:59<15:24:20,  7.87s/it]
                                                           
{'loss': '0.1004', 'grad_norm': '2.539', 'learning_rate': '1.752e-06', 'epoch': '0.8145'}
+
 81%|████████▏ | 30920/37963 [70:13:59<15:24:20,  7.87s/it]
 81%|████████▏ | 30921/37963 [70:14:07<15:21:05,  7.85s/it]
 81%|████████▏ | 30922/37963 [70:14:15<15:13:34,  7.79s/it]
 81%|████████▏ | 30923/37963 [70:14:22<14:57:35,  7.65s/it]
 81%|████████▏ | 30924/37963 [70:14:30<14:52:32,  7.61s/it]
 81%|████████▏ | 30925/37963 [70:14:37<14:57:27,  7.65s/it]
 81%|████████▏ | 30926/37963 [70:14:45<14:59:27,  7.67s/it]
 81%|████████▏ | 30927/37963 [70:14:53<14:59:01,  7.67s/it]
 81%|████████▏ | 30928/37963 [70:15:01<15:03:44,  7.71s/it]
 81%|████████▏ | 30929/37963 [70:15:08<14:50:02,  7.59s/it]
 81%|████████▏ | 30930/37963 [70:15:16<15:00:03,  7.68s/it]
                                                           
{'loss': '0.1062', 'grad_norm': '3.862', 'learning_rate': '1.747e-06', 'epoch': '0.8147'}
+
 81%|████████▏ | 30930/37963 [70:15:16<15:00:03,  7.68s/it]
 81%|████████▏ | 30931/37963 [70:15:26<16:40:23,  8.54s/it]
 81%|████████▏ | 30932/37963 [70:15:34<16:09:32,  8.27s/it]
 81%|████████▏ | 30933/37963 [70:15:41<15:40:42,  8.03s/it]
 81%|████████▏ | 30934/37963 [70:15:49<15:25:32,  7.90s/it]
 81%|████████▏ | 30935/37963 [70:15:59<16:38:42,  8.53s/it]
 81%|████████▏ | 30936/37963 [70:16:07<16:10:05,  8.28s/it]
 81%|████████▏ | 30937/37963 [70:16:14<15:48:02,  8.10s/it]
 81%|████████▏ | 30938/37963 [70:16:22<15:22:18,  7.88s/it]
 81%|████████▏ | 30939/37963 [70:16:29<15:10:09,  7.77s/it]
 82%|████████▏ | 30940/37963 [70:16:40<16:54:10,  8.66s/it]
                                                           
{'loss': '0.1018', 'grad_norm': '3.488', 'learning_rate': '1.742e-06', 'epoch': '0.815'}
+
 82%|████████▏ | 30940/37963 [70:16:40<16:54:10,  8.66s/it]
 82%|████████▏ | 30941/37963 [70:16:50<17:50:22,  9.15s/it]
 82%|████████▏ | 30942/37963 [70:16:58<17:04:09,  8.75s/it]
 82%|████████▏ | 30943/37963 [70:17:06<16:29:00,  8.45s/it]
 82%|████████▏ | 30944/37963 [70:17:13<15:59:44,  8.20s/it]
 82%|████████▏ | 30945/37963 [70:17:21<15:37:57,  8.02s/it]
 82%|████████▏ | 30946/37963 [70:17:29<15:33:41,  7.98s/it]
 82%|████████▏ | 30947/37963 [70:17:37<15:31:10,  7.96s/it]
 82%|████████▏ | 30948/37963 [70:17:47<16:45:42,  8.60s/it]
 82%|████████▏ | 30949/37963 [70:17:55<16:11:21,  8.31s/it]
 82%|████████▏ | 30950/37963 [70:18:05<17:21:24,  8.91s/it]
                                                           
{'loss': '0.103', 'grad_norm': '4.053', 'learning_rate': '1.738e-06', 'epoch': '0.8153'}
+
 82%|████████▏ | 30950/37963 [70:18:05<17:21:24,  8.91s/it]
 82%|████████▏ | 30951/37963 [70:18:13<16:37:09,  8.53s/it]
 82%|████████▏ | 30952/37963 [70:18:20<16:04:59,  8.26s/it]
 82%|████████▏ | 30953/37963 [70:18:28<15:53:12,  8.16s/it]
 82%|████████▏ | 30954/37963 [70:18:36<15:46:03,  8.10s/it]
 82%|████████▏ | 30955/37963 [70:18:44<15:33:27,  7.99s/it]
 82%|████████▏ | 30956/37963 [70:18:52<15:24:57,  7.92s/it]
 82%|████████▏ | 30957/37963 [70:18:59<15:21:49,  7.89s/it]
 82%|████████▏ | 30958/37963 [70:19:07<15:15:27,  7.84s/it]
 82%|████████▏ | 30959/37963 [70:19:14<14:56:52,  7.68s/it]
 82%|████████▏ | 30960/37963 [70:19:22<14:50:32,  7.63s/it]
                                                           
{'loss': '0.1044', 'grad_norm': '1.679', 'learning_rate': '1.733e-06', 'epoch': '0.8155'}
+
 82%|████████▏ | 30960/37963 [70:19:22<14:50:32,  7.63s/it]
 82%|████████▏ | 30961/37963 [70:19:30<14:57:30,  7.69s/it]
 82%|████████▏ | 30962/37963 [70:19:37<14:51:45,  7.64s/it]
 82%|████████▏ | 30963/37963 [70:19:48<16:24:14,  8.44s/it]
 82%|████████▏ | 30964/37963 [70:19:55<15:59:55,  8.23s/it]
 82%|████████▏ | 30965/37963 [70:20:03<15:44:33,  8.10s/it]
 82%|████████▏ | 30966/37963 [70:20:11<15:21:31,  7.90s/it]
 82%|████████▏ | 30967/37963 [70:20:18<15:19:03,  7.88s/it]
 82%|████████▏ | 30968/37963 [70:20:29<16:37:52,  8.56s/it]
 82%|████████▏ | 30969/37963 [70:20:36<16:08:09,  8.31s/it]
 82%|████████▏ | 30970/37963 [70:20:44<15:48:52,  8.14s/it]
                                                           
{'loss': '0.09996', 'grad_norm': '2.964', 'learning_rate': '1.728e-06', 'epoch': '0.8158'}
+
 82%|███████���▏ | 30970/37963 [70:20:44<15:48:52,  8.14s/it]
 82%|████████▏ | 30971/37963 [70:20:52<15:43:23,  8.10s/it]
 82%|████████▏ | 30972/37963 [70:21:00<15:29:48,  7.98s/it]
 82%|████████▏ | 30973/37963 [70:21:07<15:04:36,  7.76s/it]
 82%|████████▏ | 30974/37963 [70:21:15<15:04:08,  7.76s/it]
 82%|████████▏ | 30975/37963 [70:21:23<15:06:31,  7.78s/it]
 82%|████████▏ | 30976/37963 [70:21:30<15:10:25,  7.82s/it]
 82%|████████▏ | 30977/37963 [70:21:38<15:08:14,  7.80s/it]
 82%|████████▏ | 30978/37963 [70:21:46<15:14:10,  7.85s/it]
 82%|████████▏ | 30979/37963 [70:21:57<16:46:06,  8.64s/it]
 82%|████████▏ | 30980/37963 [70:22:04<16:17:01,  8.39s/it]
                                                           
{'loss': '0.1095', 'grad_norm': '3.983', 'learning_rate': '1.723e-06', 'epoch': '0.8161'}
+
 82%|████████▏ | 30980/37963 [70:22:04<16:17:01,  8.39s/it]
 82%|████████▏ | 30981/37963 [70:22:12<15:57:37,  8.23s/it]
 82%|████████▏ | 30982/37963 [70:22:20<15:47:35,  8.14s/it]
 82%|████████▏ | 30983/37963 [70:22:28<15:38:22,  8.07s/it]
 82%|████████▏ | 30984/37963 [70:22:43<19:50:56, 10.24s/it]
 82%|████████▏ | 30985/37963 [70:22:51<18:26:49,  9.52s/it]
 82%|████████▏ | 30986/37963 [70:22:59<17:30:09,  9.03s/it]
 82%|████████▏ | 30987/37963 [70:23:07<16:51:28,  8.70s/it]
 82%|████████▏ | 30988/37963 [70:23:15<16:18:38,  8.42s/it]
 82%|████████▏ | 30989/37963 [70:23:23<15:58:50,  8.25s/it]
 82%|████████▏ | 30990/37963 [70:23:30<15:33:09,  8.03s/it]
                                                           
{'loss': '0.1005', 'grad_norm': '2.997', 'learning_rate': '1.718e-06', 'epoch': '0.8163'}
+
 82%|████████▏ | 30990/37963 [70:23:30<15:33:09,  8.03s/it]
 82%|████████▏ | 30991/37963 [70:23:38<15:24:02,  7.95s/it]
 82%|████████▏ | 30992/37963 [70:23:45<15:05:36,  7.79s/it]
 82%|████████▏ | 30993/37963 [70:23:53<15:05:41,  7.80s/it]
 82%|████████▏ | 30994/37963 [70:24:01<15:02:46,  7.77s/it]
 82%|████████▏ | 30995/37963 [70:24:09<15:02:01,  7.77s/it]
 82%|████████▏ | 30996/37963 [70:24:16<14:55:06,  7.71s/it]
 82%|████████▏ | 30997/37963 [70:24:23<14:36:22,  7.55s/it]
 82%|████████▏ | 30998/37963 [70:24:34<16:10:58,  8.36s/it]
 82%|████████▏ | 30999/37963 [70:24:42<15:51:39,  8.20s/it]
 82%|████████▏ | 31000/37963 [70:24:49<15:40:46,  8.11s/it]
                                                           
{'loss': '0.09375', 'grad_norm': '2.163', 'learning_rate': '1.714e-06', 'epoch': '0.8166'}
+
 82%|████████▏ | 31000/37963 [70:24:49<15:40:46,  8.11s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.12s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.13s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 82%|████████▏ | 31001/37963 [70:25:47<44:31:12, 23.02s/it]
 82%|████████▏ | 31002/37963 [70:25:57<37:05:07, 19.18s/it]
 82%|████████▏ | 31003/37963 [70:26:05<30:30:10, 15.78s/it]
 82%|████████▏ | 31004/37963 [70:26:13<25:44:10, 13.31s/it]
 82%|████████▏ | 31005/37963 [70:26:21<22:29:32, 11.64s/it]
 82%|████████▏ | 31006/37963 [70:26:29<20:22:19, 10.54s/it]
 82%|████████▏ | 31007/37963 [70:26:36<18:45:30,  9.71s/it]
 82%|████████▏ | 31008/37963 [70:26:44<17:26:55,  9.03s/it]
 82%|████████▏ | 31009/37963 [70:26:52<16:41:15,  8.64s/it]
 82%|████████▏ | 31010/37963 [70:26:59<15:58:21,  8.27s/it]
                                                           
{'loss': '0.105', 'grad_norm': '2.372', 'learning_rate': '1.709e-06', 'epoch': '0.8169'}
+
 82%|████████▏ | 31010/37963 [70:26:59<15:58:21,  8.27s/it]
 82%|████████▏ | 31011/37963 [70:27:07<15:39:38,  8.11s/it]
 82%|████████▏ | 31012/37963 [70:27:14<15:22:46,  7.97s/it]
 82%|████████▏ | 31013/37963 [70:27:25<16:44:40,  8.67s/it]
 82%|████████▏ | 31014/37963 [70:27:32<16:09:37,  8.37s/it]
 82%|████████▏ | 31015/37963 [70:27:42<17:11:19,  8.91s/it]
 82%|████████▏ | 31016/37963 [70:27:50<16:31:40,  8.56s/it]
 82%|████████▏ | 31017/37963 [70:27:58<16:05:04,  8.34s/it]
 82%|████████▏ | 31018/37963 [70:28:06<15:41:43,  8.14s/it]
 82%|████████▏ | 31019/37963 [70:28:14<15:30:07,  8.04s/it]
 82%|████████▏ | 31020/37963 [70:28:21<15:19:10,  7.94s/it]
                                                           
{'loss': '0.1049', 'grad_norm': '2.347', 'learning_rate': '1.704e-06', 'epoch': '0.8171'}
+
 82%|████████▏ | 31020/37963 [70:28:21<15:19:10,  7.94s/it]
 82%|████████▏ | 31021/37963 [70:28:32<16:56:49,  8.79s/it]
 82%|████████▏ | 31022/37963 [70:28:40<16:31:55,  8.57s/it]
 82%|████████▏ | 31023/37963 [70:28:48<16:04:12,  8.34s/it]
 82%|████████▏ | 31024/37963 [70:28:56<15:45:30,  8.18s/it]
 82%|████████▏ | 31025/37963 [70:29:03<15:23:07,  7.98s/it]
 82%|████████▏ | 31026/37963 [70:29:11<15:13:39,  7.90s/it]
 82%|████████▏ | 31027/37963 [70:29:19<15:07:39,  7.85s/it]
 82%|████████▏ | 31028/37963 [70:29:26<14:56:58,  7.76s/it]
 82%|████████▏ | 31029/37963 [70:29:39<18:06:02,  9.40s/it]
 82%|████████▏ | 31030/37963 [70:29:47<17:19:38,  9.00s/it]
                                                           
{'loss': '0.09265', 'grad_norm': '2.895', 'learning_rate': '1.699e-06', 'epoch': '0.8174'}
+
 82%|████████▏ | 31030/37963 [70:29:47<17:19:38,  9.00s/it]
 82%|████████▏ | 31031/37963 [70:29:55<16:40:18,  8.66s/it]
 82%|████████▏ | 31032/37963 [70:30:03<16:06:50,  8.37s/it]
 82%|████████▏ | 31033/37963 [70:30:13<17:05:24,  8.88s/it]
 82%|████████▏ | 31034/37963 [70:30:21<16:26:51,  8.55s/it]
 82%|████████▏ | 31035/37963 [70:30:29<16:02:34,  8.34s/it]
 82%|████████▏ | 31036/37963 [70:30:36<15:29:44,  8.05s/it]
 82%|████████▏ | 31037/37963 [70:30:44<15:20:23,  7.97s/it]
 82%|████████▏ | 31038/37963 [70:30:51<15:00:57,  7.81s/it]
 82%|████████▏ | 31039/37963 [70:30:59<14:56:37,  7.77s/it]
 82%|████████▏ | 31040/37963 [70:31:06<14:41:31,  7.64s/it]
                                                           
{'loss': '0.102', 'grad_norm': '2.551', 'learning_rate': '1.695e-06', 'epoch': '0.8176'}
+
 82%|████████▏ | 31040/37963 [70:31:06<14:41:31,  7.64s/it]
 82%|████████▏ | 31041/37963 [70:31:14<14:46:01,  7.68s/it]
 82%|████████▏ | 31042/37963 [70:31:21<14:32:28,  7.56s/it]
 82%|████████▏ | 31043/37963 [70:31:29<14:43:38,  7.66s/it]
 82%|████████▏ | 31044/37963 [70:31:37<14:34:00,  7.58s/it]
 82%|████████▏ | 31045/37963 [70:31:45<14:55:26,  7.77s/it]
 82%|████████▏ | 31046/37963 [70:31:58<18:05:59,  9.42s/it]
 82%|████████▏ | 31047/37963 [70:32:06<17:08:20,  8.92s/it]
 82%|████████▏ | 31048/37963 [70:32:14<16:30:58,  8.60s/it]
 82%|████████▏ | 31049/37963 [70:32:21<15:57:34,  8.31s/it]
 82%|████████▏ | 31050/37963 [70:32:29<15:42:05,  8.18s/it]
                                                           
{'loss': '0.101', 'grad_norm': '2.024', 'learning_rate': '1.69e-06', 'epoch': '0.8179'}
+
 82%|████████▏ | 31050/37963 [70:32:29<15:42:05,  8.18s/it]
 82%|████████▏ | 31051/37963 [70:32:37<15:26:20,  8.04s/it]
 82%|████████▏ | 31052/37963 [70:32:45<15:09:46,  7.90s/it]
 82%|████████▏ | 31053/37963 [70:32:52<15:04:40,  7.86s/it]
 82%|████████▏ | 31054/37963 [70:33:00<15:02:51,  7.84s/it]
 82%|████████▏ | 31055/37963 [70:33:08<14:55:23,  7.78s/it]
 82%|████████▏ | 31056/37963 [70:33:15<14:47:43,  7.71s/it]
 82%|████████▏ | 31057/37963 [70:33:26<16:17:41,  8.49s/it]
 82%|████████▏ | 31058/37963 [70:33:33<15:54:23,  8.29s/it]
 82%|████████▏ | 31059/37963 [70:33:42<15:46:49,  8.23s/it]
 82%|████████▏ | 31060/37963 [70:33:49<15:36:50,  8.14s/it]
                                                           
{'loss': '0.1093', 'grad_norm': '3.675', 'learning_rate': '1.685e-06', 'epoch': '0.8182'}
+
 82%|████████▏ | 31060/37963 [70:33:49<15:36:50,  8.14s/it]
 82%|████████▏ | 31061/37963 [70:33:57<15:18:52,  7.99s/it]
 82%|████████▏ | 31062/37963 [70:34:05<15:11:59,  7.93s/it]
 82%|████████▏ | 31063/37963 [70:34:13<15:02:18,  7.85s/it]
 82%|████████▏ | 31064/37963 [70:34:20<15:05:23,  7.87s/it]
 82%|████████▏ | 31065/37963 [70:34:28<14:57:53,  7.81s/it]
 82%|████████▏ | 31066/37963 [70:34:36<15:04:29,  7.87s/it]
 82%|████████▏ | 31067/37963 [70:34:44<14:57:51,  7.81s/it]
 82%|████████▏ | 31068/37963 [70:34:57<18:04:00,  9.43s/it]
 82%|████████▏ | 31069/37963 [70:35:05<17:07:28,  8.94s/it]
 82%|████████▏ | 31070/37963 [70:35:12<16:21:07,  8.54s/it]
                                                           
{'loss': '0.1006', 'grad_norm': '3.236', 'learning_rate': '1.68e-06', 'epoch': '0.8184'}
+
 82%|████████▏ | 31070/37963 [70:35:12<16:21:07,  8.54s/it]
 82%|████████▏ | 31071/37963 [70:35:20<15:49:30,  8.27s/it]
 82%|████████▏ | 31072/37963 [70:35:28<15:33:12,  8.13s/it]
 82%|████████▏ | 31073/37963 [70:35:38<16:54:45,  8.84s/it]
 82%|████████▏ | 31074/37963 [70:35:46<16:16:44,  8.51s/it]
 82%|████████▏ | 31075/37963 [70:35:54<15:45:40,  8.24s/it]
 82%|████████▏ | 31076/37963 [70:36:01<15:26:00,  8.07s/it]
 82%|████████▏ | 31077/37963 [70:36:09<15:14:50,  7.97s/it]
 82%|████████▏ | 31078/37963 [70:36:19<16:30:18,  8.63s/it]
 82%|████████▏ | 31079/37963 [70:36:27<15:52:12,  8.30s/it]
 82%|████████▏ | 31080/37963 [70:36:35<15:32:39,  8.13s/it]
                                                           
{'loss': '0.09216', 'grad_norm': '3.088', 'learning_rate': '1.676e-06', 'epoch': '0.8187'}
+
 82%|████████▏ | 31080/37963 [70:36:35<15:32:39,  8.13s/it]
 82%|████████▏ | 31081/37963 [70:36:45<16:37:40,  8.70s/it]
 82%|████████▏ | 31082/37963 [70:36:52<16:10:36,  8.46s/it]
 82%|████████▏ | 31083/37963 [70:37:00<15:42:14,  8.22s/it]
 82%|████████▏ | 31084/37963 [70:37:08<15:16:53,  8.00s/it]
 82%|████████▏ | 31085/37963 [70:37:15<15:09:43,  7.94s/it]
 82%|████████▏ | 31086/37963 [70:37:23<15:05:26,  7.90s/it]
 82%|████████▏ | 31087/37963 [70:37:31<15:06:20,  7.91s/it]
 82%|████████▏ | 31088/37963 [70:37:39<14:57:36,  7.83s/it]
 82%|████████▏ | 31089/37963 [70:37:47<14:57:36,  7.83s/it]
 82%|████████▏ | 31090/37963 [70:37:57<16:14:54,  8.51s/it]
                                                           
{'loss': '0.1044', 'grad_norm': '2.49', 'learning_rate': '1.671e-06', 'epoch': '0.819'}
+
 82%|████████▏ | 31090/37963 [70:37:57<16:14:54,  8.51s/it]
 82%|████████▏ | 31091/37963 [70:38:05<15:49:33,  8.29s/it]
 82%|████████▏ | 31092/37963 [70:38:12<15:25:22,  8.08s/it]
 82%|████████▏ | 31093/37963 [70:38:20<15:17:59,  8.02s/it]
 82%|████████▏ | 31094/37963 [70:38:30<16:39:36,  8.73s/it]
 82%|████████▏ | 31095/37963 [70:38:38<16:08:00,  8.46s/it]
 82%|████████▏ | 31096/37963 [70:38:46<15:54:33,  8.34s/it]
 82%|████████▏ | 31097/37963 [70:38:54<15:34:38,  8.17s/it]
 82%|████████▏ | 31098/37963 [70:39:02<15:19:50,  8.04s/it]
 82%|████████▏ | 31099/37963 [70:39:09<14:59:34,  7.86s/it]
 82%|████████▏ | 31100/37963 [70:39:17<14:50:43,  7.79s/it]
                                                           
{'loss': '0.09343', 'grad_norm': '2.654', 'learning_rate': '1.666e-06', 'epoch': '0.8192'}
+
 82%|████████▏ | 31100/37963 [70:39:17<14:50:43,  7.79s/it]
 82%|████████▏ | 31101/37963 [70:39:25<14:49:17,  7.78s/it]
 82%|████████▏ | 31102/37963 [70:39:32<14:31:02,  7.62s/it]
 82%|████████▏ | 31103/37963 [70:39:40<14:33:38,  7.64s/it]
 82%|████████▏ | 31104/37963 [70:39:47<14:39:16,  7.69s/it]
 82%|████████▏ | 31105/37963 [70:39:55<14:27:54,  7.59s/it]
 82%|████████▏ | 31106/37963 [70:40:03<14:37:12,  7.68s/it]
 82%|████████▏ | 31107/37963 [70:40:10<14:44:37,  7.74s/it]
 82%|████████▏ | 31108/37963 [70:40:18<14:45:05,  7.75s/it]
 82%|████████▏ | 31109/37963 [70:40:28<16:06:58,  8.46s/it]
 82%|████████▏ | 31110/37963 [70:40:36<15:37:57,  8.21s/it]
                                                           
{'loss': '0.09441', 'grad_norm': '2.821', 'learning_rate': '1.661e-06', 'epoch': '0.8195'}
+
 82%|████████▏ | 31110/37963 [70:40:36<15:37:57,  8.21s/it]
 82%|████████▏ | 31111/37963 [70:40:44<15:24:37,  8.10s/it]
 82%|████████▏ | 31112/37963 [70:40:54<16:47:01,  8.82s/it]
 82%|████████▏ | 31113/37963 [70:41:02<16:07:36,  8.48s/it]
 82%|████████▏ | 31114/37963 [70:41:10<15:38:57,  8.23s/it]
 82%|████████▏ | 31115/37963 [70:41:18<15:34:39,  8.19s/it]
 82%|████████▏ | 31116/37963 [70:41:25<15:19:55,  8.06s/it]
 82%|████████▏ | 31117/37963 [70:41:33<15:02:22,  7.91s/it]
 82%|████████▏ | 31118/37963 [70:41:41<14:55:22,  7.85s/it]
 82%|████████▏ | 31119/37963 [70:41:48<14:46:19,  7.77s/it]
 82%|████████▏ | 31120/37963 [70:42:01<17:39:33,  9.29s/it]
                                                           
{'loss': '0.09498', 'grad_norm': '2.756', 'learning_rate': '1.657e-06', 'epoch': '0.8197'}
+
 82%|████████▏ | 31120/37963 [70:42:01<17:39:33,  9.29s/it]
 82%|████████▏ | 31121/37963 [70:42:12<18:15:05,  9.60s/it]
 82%|████████▏ | 31122/37963 [70:42:19<17:16:09,  9.09s/it]
 82%|████████▏ | 31123/37963 [70:42:27<16:31:10,  8.69s/it]
 82%|████████▏ | 31124/37963 [70:42:35<15:57:37,  8.40s/it]
 82%|████████▏ | 31125/37963 [70:42:43<15:40:54,  8.26s/it]
 82%|████████▏ | 31126/37963 [70:42:50<15:10:17,  7.99s/it]
 82%|████████▏ | 31127/37963 [70:42:58<14:53:17,  7.84s/it]
 82%|████████▏ | 31128/37963 [70:43:05<14:51:01,  7.82s/it]
 82%|████████▏ | 31129/37963 [70:43:13<14:48:30,  7.80s/it]
 82%|████████▏ | 31130/37963 [70:43:21<14:44:15,  7.76s/it]
                                                           
{'loss': '0.08957', 'grad_norm': '3.131', 'learning_rate': '1.652e-06', 'epoch': '0.82'}
+
 82%|████████▏ | 31130/37963 [70:43:21<14:44:15,  7.76s/it]
 82%|████████▏ | 31131/37963 [70:43:29<14:40:24,  7.73s/it]
 82%|████████▏ | 31132/37963 [70:43:36<14:39:38,  7.73s/it]
 82%|████████▏ | 31133/37963 [70:43:47<16:06:34,  8.49s/it]
 82%|████████▏ | 31134/37963 [70:43:54<15:31:53,  8.19s/it]
 82%|████████▏ | 31135/37963 [70:44:04<16:44:32,  8.83s/it]
 82%|████████▏ | 31136/37963 [70:44:12<16:11:57,  8.54s/it]
 82%|████████▏ | 31137/37963 [70:44:20<15:48:28,  8.34s/it]
 82%|████████▏ | 31138/37963 [70:44:28<15:26:12,  8.14s/it]
 82%|████████▏ | 31139/37963 [70:44:36<15:15:54,  8.05s/it]
 82%|████████▏ | 31140/37963 [70:44:43<15:01:24,  7.93s/it]
                                                           
{'loss': '0.08848', 'grad_norm': '2.063', 'learning_rate': '1.647e-06', 'epoch': '0.8203'}
+
 82%|████████▏ | 31140/37963 [70:44:43<15:01:24,  7.93s/it]
 82%|████████▏ | 31141/37963 [70:44:51<14:53:35,  7.86s/it]
 82%|████████▏ | 31142/37963 [70:44:59<14:48:51,  7.82s/it]
 82%|████████▏ | 31143/37963 [70:45:07<14:50:47,  7.84s/it]
 82%|████████▏ | 31144/37963 [70:45:14<14:32:54,  7.68s/it]
 82%|████████▏ | 31145/37963 [70:45:21<14:31:30,  7.67s/it]
 82%|████████▏ | 31146/37963 [70:45:29<14:29:52,  7.66s/it]
 82%|████████▏ | 31147/37963 [70:45:37<14:31:41,  7.67s/it]
 82%|████████▏ | 31148/37963 [70:45:47<16:12:28,  8.56s/it]
 82%|████████▏ | 31149/37963 [70:45:55<15:38:55,  8.27s/it]
 82%|████████▏ | 31150/37963 [70:46:03<15:23:55,  8.14s/it]
                                                           
{'loss': '0.104', 'grad_norm': '3.587', 'learning_rate': '1.643e-06', 'epoch': '0.8205'}
+
 82%|████████▏ | 31150/37963 [70:46:03<15:23:55,  8.14s/it]
 82%|████████▏ | 31151/37963 [70:46:11<15:06:33,  7.98s/it]
 82%|████████▏ | 31152/37963 [70:46:18<14:55:45,  7.89s/it]
 82%|████████▏ | 31153/37963 [70:46:26<14:44:29,  7.79s/it]
 82%|████████▏ | 31154/37963 [70:46:33<14:32:31,  7.69s/it]
 82%|████████▏ | 31155/37963 [70:46:44<16:05:05,  8.51s/it]
 82%|████████▏ | 31156/37963 [70:46:55<17:33:18,  9.28s/it]
 82%|████████▏ | 31157/37963 [70:47:02<16:40:17,  8.82s/it]
 82%|████████▏ | 31158/37963 [70:47:10<15:56:35,  8.43s/it]
 82%|████████▏ | 31159/37963 [70:47:18<15:39:21,  8.28s/it]
 82%|████████▏ | 31160/37963 [70:47:26<15:19:03,  8.11s/it]
                                                           
{'loss': '0.105', 'grad_norm': '3.13', 'learning_rate': '1.638e-06', 'epoch': '0.8208'}
+
 82%|████████▏ | 31160/37963 [70:47:26<15:19:03,  8.11s/it]
 82%|████████▏ | 31161/37963 [70:47:33<15:04:45,  7.98s/it]
 82%|████████▏ | 31162/37963 [70:47:41<15:01:28,  7.95s/it]
 82%|████████▏ | 31163/37963 [70:47:49<14:52:11,  7.87s/it]
 82%|████████▏ | 31164/37963 [70:47:57<14:48:44,  7.84s/it]
 82%|████████▏ | 31165/37963 [70:48:04<14:42:56,  7.79s/it]
 82%|████████▏ | 31166/37963 [70:48:12<14:32:52,  7.71s/it]
 82%|████████▏ | 31167/37963 [70:48:19<14:31:30,  7.69s/it]
 82%|████████▏ | 31168/37963 [70:48:27<14:30:32,  7.69s/it]
 82%|████████▏ | 31169/37963 [70:48:40<17:26:15,  9.24s/it]
 82%|████████�� | 31170/37963 [70:48:48<16:36:13,  8.80s/it]
                                                           
{'loss': '0.09918', 'grad_norm': '3.047', 'learning_rate': '1.633e-06', 'epoch': '0.8211'}
+
 82%|████████▏ | 31170/37963 [70:48:48<16:36:13,  8.80s/it]
 82%|████████▏ | 31171/37963 [70:48:56<16:00:00,  8.48s/it]
 82%|████████▏ | 31172/37963 [70:49:03<15:41:51,  8.32s/it]
 82%|████████▏ | 31173/37963 [70:49:11<15:28:28,  8.20s/it]
 82%|████████▏ | 31174/37963 [70:49:22<17:01:58,  9.03s/it]
 82%|████████▏ | 31175/37963 [70:49:30<16:16:32,  8.63s/it]
 82%|████████▏ | 31176/37963 [70:49:38<15:45:36,  8.36s/it]
 82%|████████▏ | 31177/37963 [70:49:45<15:18:39,  8.12s/it]
 82%|████████▏ | 31178/37963 [70:49:53<15:05:07,  8.00s/it]
 82%|████████▏ | 31179/37963 [70:50:01<14:54:32,  7.91s/it]
 82%|████████▏ | 31180/37963 [70:50:08<14:40:36,  7.79s/it]
                                                           
{'loss': '0.0879', 'grad_norm': '3.37', 'learning_rate': '1.629e-06', 'epoch': '0.8213'}
+
 82%|████████▏ | 31180/37963 [70:50:08<14:40:36,  7.79s/it]
 82%|████████▏ | 31181/37963 [70:50:18<16:00:19,  8.50s/it]
 82%|████████▏ | 31182/37963 [70:50:26<15:38:56,  8.31s/it]
 82%|████████▏ | 31183/37963 [70:50:34<15:10:57,  8.06s/it]
 82%|████████▏ | 31184/37963 [70:50:42<15:04:01,  8.00s/it]
 82%|████████▏ | 31185/37963 [70:50:49<14:53:08,  7.91s/it]
 82%|████████▏ | 31186/37963 [70:50:57<14:50:06,  7.88s/it]
 82%|████████▏ | 31187/37963 [70:51:05<14:41:25,  7.80s/it]
 82%|████████▏ | 31188/37963 [70:51:12<14:36:42,  7.76s/it]
 82%|████████▏ | 31189/37963 [70:51:23<16:02:08,  8.52s/it]
 82%|████████▏ | 31190/37963 [70:51:30<15:34:48,  8.28s/it]
                                                           
{'loss': '0.1016', 'grad_norm': '3.56', 'learning_rate': '1.624e-06', 'epoch': '0.8216'}
+
 82%|████████▏ | 31190/37963 [70:51:30<15:34:48,  8.28s/it]
 82%|████████▏ | 31191/37963 [70:51:38<15:12:47,  8.09s/it]
 82%|████████▏ | 31192/37963 [70:51:46<14:57:53,  7.96s/it]
 82%|████████▏ | 31193/37963 [70:51:53<14:49:16,  7.88s/it]
 82%|████████▏ | 31194/37963 [70:52:01<14:46:17,  7.86s/it]
 82%|████████▏ | 31195/37963 [70:52:09<14:47:38,  7.87s/it]
 82%|████████▏ | 31196/37963 [70:52:17<14:34:44,  7.76s/it]
 82%|████████▏ | 31197/37963 [70:52:24<14:31:43,  7.73s/it]
 82%|████████▏ | 31198/37963 [70:52:32<14:32:03,  7.73s/it]
 82%|████████▏ | 31199/37963 [70:52:43<16:14:03,  8.64s/it]
 82%|████████▏ | 31200/37963 [70:52:51<15:47:10,  8.40s/it]
                                                           
{'loss': '0.1123', 'grad_norm': '3.16', 'learning_rate': '1.619e-06', 'epoch': '0.8219'}
+
 82%|████████▏ | 31200/37963 [70:52:51<15:47:10,  8.40s/it]
 82%|████████▏ | 31201/37963 [70:52:58<15:11:38,  8.09s/it]
 82%|████████▏ | 31202/37963 [70:53:09<16:39:26,  8.87s/it]
 82%|████████▏ | 31203/37963 [70:53:16<15:58:52,  8.51s/it]
 82%|████████▏ | 31204/37963 [70:53:26<16:40:42,  8.88s/it]
 82%|████████▏ | 31205/37963 [70:53:34<15:55:56,  8.49s/it]
 82%|████████▏ | 31206/37963 [70:53:41<15:26:26,  8.23s/it]
 82%|████████▏ | 31207/37963 [70:53:49<15:08:08,  8.07s/it]
 82%|████████▏ | 31208/37963 [70:53:57<14:57:38,  7.97s/it]
 82%|████████▏ | 31209/37963 [70:54:05<14:52:39,  7.93s/it]
 82%|████████▏ | 31210/37963 [70:54:12<14:22:51,  7.67s/it]
                                                           
{'loss': '0.1011', 'grad_norm': '2.664', 'learning_rate': '1.615e-06', 'epoch': '0.8221'}
+
 82%|████████▏ | 31210/37963 [70:54:12<14:22:51,  7.67s/it]
 82%|████████▏ | 31211/37963 [70:54:19<14:28:37,  7.72s/it]
 82%|████████▏ | 31212/37963 [70:54:30<16:02:49,  8.56s/it]
 82%|████████▏ | 31213/37963 [70:54:38<15:42:45,  8.38s/it]
 82%|████████▏ | 31214/37963 [70:54:46<15:18:01,  8.16s/it]
 82%|████████▏ | 31215/37963 [70:54:53<15:04:08,  8.04s/it]
 82%|████████▏ | 31216/37963 [70:55:01<14:57:09,  7.98s/it]
 82%|████████▏ | 31217/37963 [70:55:09<14:47:15,  7.89s/it]
 82%|████████▏ | 31218/37963 [70:55:19<16:05:34,  8.59s/it]
 82%|████████▏ | 31219/37963 [70:55:27<15:33:59,  8.31s/it]
 82%|████████▏ | 31220/37963 [70:55:35<15:21:55,  8.20s/it]
                                                           
{'loss': '0.1116', 'grad_norm': '2.825', 'learning_rate': '1.61e-06', 'epoch': '0.8224'}
+
 82%|████████▏ | 31220/37963 [70:55:35<15:21:55,  8.20s/it]
 82%|████████▏ | 31221/37963 [70:55:42<15:07:38,  8.08s/it]
 82%|████████▏ | 31222/37963 [70:55:50<14:53:11,  7.95s/it]
 82%|████████▏ | 31223/37963 [70:55:58<14:49:23,  7.92s/it]
 82%|████████▏ | 31224/37963 [70:56:06<14:45:49,  7.89s/it]
 82%|████████▏ | 31225/37963 [70:56:14<14:46:36,  7.89s/it]
 82%|████████▏ | 31226/37963 [70:56:21<14:39:41,  7.83s/it]
 82%|████████▏ | 31227/37963 [70:56:29<14:37:00,  7.81s/it]
 82%|████████▏ | 31228/37963 [70:56:40<16:10:42,  8.65s/it]
 82%|████████▏ | 31229/37963 [70:56:47<15:35:35,  8.34s/it]
 82%|████████▏ | 31230/37963 [70:56:58<16:40:53,  8.92s/it]
                                                           
{'loss': '0.1143', 'grad_norm': '2.479', 'learning_rate': '1.605e-06', 'epoch': '0.8226'}
+
 82%|████████▏ | 31230/37963 [70:56:58<16:40:53,  8.92s/it]
 82%|████████▏ | 31231/37963 [70:57:06<16:08:35,  8.63s/it]
 82%|████████▏ | 31232/37963 [70:57:13<15:30:34,  8.30s/it]
 82%|████████▏ | 31233/37963 [70:57:21<15:02:36,  8.05s/it]
 82%|████████▏ | 31234/37963 [70:57:28<14:41:25,  7.86s/it]
 82%|████████▏ | 31235/37963 [70:57:36<14:35:44,  7.81s/it]
 82%|████████▏ | 31236/37963 [70:57:44<14:41:03,  7.86s/it]
 82%|████████▏ | 31237/37963 [70:57:54<15:52:17,  8.50s/it]
 82%|████████▏ | 31238/37963 [70:58:01<15:17:01,  8.18s/it]
 82%|████████▏ | 31239/37963 [70:58:09<14:57:37,  8.01s/it]
 82%|████████▏ | 31240/37963 [70:58:16<14:49:29,  7.94s/it]
                                                           
{'loss': '0.1017', 'grad_norm': '3.156', 'learning_rate': '1.601e-06', 'epoch': '0.8229'}
+
 82%|████████▏ | 31240/37963 [70:58:16<14:49:29,  7.94s/it]
 82%|████████▏ | 31241/37963 [70:58:24<14:37:47,  7.84s/it]
 82%|████████▏ | 31242/37963 [70:58:32<14:35:35,  7.82s/it]
 82%|████████▏ | 31243/37963 [70:58:40<14:30:52,  7.78s/it]
 82%|████████▏ | 31244/37963 [70:58:47<14:27:26,  7.75s/it]
 82%|████████▏ | 31245/37963 [70:58:55<14:31:02,  7.78s/it]
 82%|████████▏ | 31246/37963 [70:59:03<14:29:36,  7.77s/it]
 82%|████████▏ | 31247/37963 [70:59:11<14:27:01,  7.75s/it]
 82%|████████▏ | 31248/37963 [70:59:18<14:28:33,  7.76s/it]
 82%|████████▏ | 31249/37963 [70:59:26<14:28:58,  7.77s/it]
 82%|████████▏ | 31250/37963 [70:59:34<14:27:53,  7.76s/it]
                                                           
{'loss': '0.09579', 'grad_norm': '2.838', 'learning_rate': '1.596e-06', 'epoch': '0.8232'}
+
 82%|████████▏ | 31250/37963 [70:59:34<14:27:53,  7.76s/it]
 82%|████████▏ | 31251/37963 [70:59:42<14:37:06,  7.84s/it]
 82%|████████▏ | 31252/37963 [70:59:49<14:17:33,  7.67s/it]
 82%|████████▏ | 31253/37963 [70:59:59<15:47:47,  8.48s/it]
 82%|████████▏ | 31254/37963 [71:00:08<15:34:22,  8.36s/it]
 82%|████████▏ | 31255/37963 [71:00:15<15:09:20,  8.13s/it]
 82%|████████▏ | 31256/37963 [71:00:28<17:59:25,  9.66s/it]
 82%|████████▏ | 31257/37963 [71:00:37<17:08:35,  9.20s/it]
 82%|████████▏ | 31258/37963 [71:00:44<16:17:00,  8.74s/it]
 82%|████████▏ | 31259/37963 [71:00:52<15:37:34,  8.39s/it]
 82%|████████▏ | 31260/37963 [71:01:02<16:50:07,  9.04s/it]
                                                           
{'loss': '0.09885', 'grad_norm': '3.056', 'learning_rate': '1.591e-06', 'epoch': '0.8234'}
+
 82%|████████▏ | 31260/37963 [71:01:02<16:50:07,  9.04s/it]
 82%|████████▏ | 31261/37963 [71:01:10<16:02:18,  8.62s/it]
 82%|████████▏ | 31262/37963 [71:01:17<15:19:24,  8.23s/it]
 82%|████████▏ | 31263/37963 [71:01:25<15:07:39,  8.13s/it]
 82%|████████▏ | 31264/37963 [71:01:33<14:50:23,  7.97s/it]
 82%|████████▏ | 31265/37963 [71:01:40<14:35:39,  7.84s/it]
 82%|████████▏ | 31266/37963 [71:01:51<15:59:53,  8.60s/it]
 82%|████████▏ | 31267/37963 [71:01:58<15:31:50,  8.35s/it]
 82%|████████▏ | 31268/37963 [71:02:06<14:57:30,  8.04s/it]
 82%|████████▏ | 31269/37963 [71:02:13<14:42:34,  7.91s/it]
 82%|████████▏ | 31270/37963 [71:02:21<14:39:38,  7.89s/it]
                                                           
{'loss': '0.09698', 'grad_norm': '2.601', 'learning_rate': '1.587e-06', 'epoch': '0.8237'}
+
 82%|████████▏ | 31270/37963 [71:02:21<14:39:38,  7.89s/it]
 82%|████████▏ | 31271/37963 [71:02:29<14:24:16,  7.75s/it]
 82%|████████▏ | 31272/37963 [71:02:36<14:20:54,  7.72s/it]
 82%|████████▏ | 31273/37963 [71:02:44<14:22:35,  7.74s/it]
 82%|████████▏ | 31274/37963 [71:02:52<14:21:29,  7.73s/it]
 82%|████████▏ | 31275/37963 [71:02:59<14:17:18,  7.69s/it]
 82%|████████▏ | 31276/37963 [71:03:07<14:08:46,  7.62s/it]
 82%|████████▏ | 31277/37963 [71:03:14<14:09:30,  7.62s/it]
 82%|████████▏ | 31278/37963 [71:03:25<15:40:10,  8.44s/it]
 82%|████████▏ | 31279/37963 [71:03:33<15:18:34,  8.25s/it]
 82%|████████▏ | 31280/37963 [71:03:40<15:05:38,  8.13s/it]
                                                           
{'loss': '0.1133', 'grad_norm': '3.111', 'learning_rate': '1.582e-06', 'epoch': '0.824'}
+
 82%|████████▏ | 31280/37963 [71:03:40<15:05:38,  8.13s/it]
 82%|████████▏ | 31281/37963 [71:03:48<14:52:08,  8.01s/it]
 82%|████████▏ | 31282/37963 [71:03:59<16:11:44,  8.73s/it]
 82%|████████▏ | 31283/37963 [71:04:06<15:35:43,  8.40s/it]
 82%|████████▏ | 31284/37963 [71:04:14<15:09:34,  8.17s/it]
 82%|████████▏ | 31285/37963 [71:04:22<14:57:32,  8.06s/it]
 82%|████████▏ | 31286/37963 [71:04:32<16:18:58,  8.80s/it]
 82%|████████▏ | 31287/37963 [71:04:40<15:47:39,  8.52s/it]
 82%|████████▏ | 31288/37963 [71:04:48<15:31:02,  8.37s/it]
 82%|████████▏ | 31289/37963 [71:04:56<15:13:26,  8.21s/it]
 82%|████████▏ | 31290/37963 [71:05:04<15:02:25,  8.11s/it]
                                                           
{'loss': '0.08866', 'grad_norm': '2.088', 'learning_rate': '1.578e-06', 'epoch': '0.8242'}
+
 82%|████████▏ | 31290/37963 [71:05:04<15:02:25,  8.11s/it]
 82%|████████▏ | 31291/37963 [71:05:12<14:49:02,  7.99s/it]
 82%|████████▏ | 31292/37963 [71:05:19<14:38:25,  7.90s/it]
 82%|████████▏ | 31293/37963 [71:05:27<14:41:29,  7.93s/it]
 82%|████████▏ | 31294/37963 [71:05:35<14:36:16,  7.88s/it]
 82%|████████▏ | 31295/37963 [71:05:43<14:31:23,  7.84s/it]
 82%|████████▏ | 31296/37963 [71:05:50<14:27:32,  7.81s/it]
 82%|████████▏ | 31297/37963 [71:05:58<14:31:45,  7.85s/it]
 82%|████████▏ | 31298/37963 [71:06:06<14:34:25,  7.87s/it]
 82%|████████▏ | 31299/37963 [71:06:14<14:30:42,  7.84s/it]
 82%|████████▏ | 31300/37963 [71:06:22<14:32:34,  7.86s/it]
                                                           
{'loss': '0.09703', 'grad_norm': '2.488', 'learning_rate': '1.573e-06', 'epoch': '0.8245'}
+
 82%|████████▏ | 31300/37963 [71:06:22<14:32:34,  7.86s/it]
 82%|████████▏ | 31301/37963 [71:06:30<14:27:51,  7.82s/it]
 82%|████████▏ | 31302/37963 [71:06:38<14:28:37,  7.82s/it]
 82%|████████▏ | 31303/37963 [71:06:48<15:47:51,  8.54s/it]
 82%|████████▏ | 31304/37963 [71:07:01<18:25:40,  9.96s/it]
 82%|████████▏ | 31305/37963 [71:07:09<17:18:30,  9.36s/it]
 82%|████████▏ | 31306/37963 [71:07:16<16:16:43,  8.80s/it]
 82%|████████▏ | 31307/37963 [71:07:27<17:08:38,  9.27s/it]
 82%|████████▏ | 31308/37963 [71:07:34<16:10:18,  8.75s/it]
 82%|████████▏ | 31309/37963 [71:07:42<15:35:25,  8.43s/it]
 82%|████████▏ | 31310/37963 [71:07:50<15:12:01,  8.23s/it]
                                                           
{'loss': '0.1036', 'grad_norm': '2.147', 'learning_rate': '1.568e-06', 'epoch': '0.8248'}
+
 82%|████████▏ | 31310/37963 [71:07:50<15:12:01,  8.23s/it]
 82%|████████▏ | 31311/37963 [71:07:58<14:56:01,  8.08s/it]
 82%|████████▏ | 31312/37963 [71:08:05<14:42:59,  7.97s/it]
 82%|████████▏ | 31313/37963 [71:08:13<14:32:43,  7.87s/it]
 82%|████████▏ | 31314/37963 [71:08:21<14:32:13,  7.87s/it]
 82%|████████▏ | 31315/37963 [71:08:28<14:20:35,  7.77s/it]
 82%|████████▏ | 31316/37963 [71:08:36<14:22:38,  7.79s/it]
 82%|████████▏ | 31317/37963 [71:08:44<14:16:02,  7.73s/it]
 82%|████████▏ | 31318/37963 [71:08:52<14:22:14,  7.79s/it]
 82%|████████▏ | 31319/37963 [71:08:59<14:19:44,  7.76s/it]
 83%|████████▎ | 31320/37963 [71:09:10<15:46:38,  8.55s/it]
                                                           
{'loss': '0.1195', 'grad_norm': '3.287', 'learning_rate': '1.564e-06', 'epoch': '0.825'}
+
 83%|████████▎ | 31320/37963 [71:09:10<15:46:38,  8.55s/it]
 83%|████████▎ | 31321/37963 [71:09:17<15:14:33,  8.26s/it]
 83%|████████▎ | 31322/37963 [71:09:25<14:57:55,  8.11s/it]
 83%|████████▎ | 31323/37963 [71:09:33<14:52:44,  8.07s/it]
 83%|████████▎ | 31324/37963 [71:09:41<14:38:12,  7.94s/it]
 83%|████████▎ | 31325/37963 [71:09:48<14:26:04,  7.83s/it]
 83%|████████▎ | 31326/37963 [71:09:56<14:30:34,  7.87s/it]
 83%|████████▎ | 31327/37963 [71:10:04<14:21:14,  7.79s/it]
 83%|████████▎ | 31328/37963 [71:10:12<14:23:06,  7.81s/it]
 83%|████████▎ | 31329/37963 [71:10:22<15:54:24,  8.63s/it]
 83%|████████▎ | 31330/37963 [71:10:30<15:23:13,  8.35s/it]
                                                           
{'loss': '0.09871', 'grad_norm': '3.458', 'learning_rate': '1.559e-06', 'epoch': '0.8253'}
+
 83%|████████▎ | 31330/37963 [71:10:30<15:23:13,  8.35s/it]
 83%|████████▎ | 31331/37963 [71:10:40<16:28:24,  8.94s/it]
 83%|████████▎ | 31332/37963 [71:10:48<15:43:45,  8.54s/it]
 83%|████████▎ | 31333/37963 [71:10:56<15:21:22,  8.34s/it]
 83%|████████▎ | 31334/37963 [71:11:03<14:56:33,  8.11s/it]
 83%|████████▎ | 31335/37963 [71:11:11<14:47:11,  8.03s/it]
 83%|████████▎ | 31336/37963 [71:11:22<16:03:12,  8.72s/it]
 83%|████████▎ | 31337/37963 [71:11:29<15:22:22,  8.35s/it]
 83%|████████▎ | 31338/37963 [71:11:37<14:58:37,  8.14s/it]
 83%|████████▎ | 31339/37963 [71:11:44<14:47:52,  8.04s/it]
 83%|████████▎ | 31340/37963 [71:11:52<14:29:14,  7.87s/it]
                                                           
{'loss': '0.09012', 'grad_norm': '2.993', 'learning_rate': '1.555e-06', 'epoch': '0.8255'}
+
 83%|████████▎ | 31340/37963 [71:11:52<14:29:14,  7.87s/it]
 83%|████████▎ | 31341/37963 [71:12:00<14:23:53,  7.83s/it]
 83%|████████▎ | 31342/37963 [71:12:08<14:24:35,  7.83s/it]
 83%|████████▎ | 31343/37963 [71:12:15<14:27:03,  7.86s/it]
 83%|████████▎ | 31344/37963 [71:12:23<14:29:25,  7.88s/it]
 83%|████████▎ | 31345/37963 [71:12:31<14:22:09,  7.82s/it]
 83%|████████▎ | 31346/37963 [71:12:39<14:22:27,  7.82s/it]
 83%|████████▎ | 31347/37963 [71:12:47<14:17:03,  7.77s/it]
 83%|████████▎ | 31348/37963 [71:12:54<14:15:19,  7.76s/it]
 83%|████████▎ | 31349/37963 [71:13:02<14:26:49,  7.86s/it]
 83%|████████▎ | 31350/37963 [71:13:10<14:21:03,  7.81s/it]
                                                           
{'loss': '0.1036', 'grad_norm': '2.066', 'learning_rate': '1.55e-06', 'epoch': '0.8258'}
+
 83%|████████▎ | 31350/37963 [71:13:10<14:21:03,  7.81s/it]
 83%|████████▎ | 31351/37963 [71:13:18<14:13:51,  7.75s/it]
 83%|████████▎ | 31352/37963 [71:13:28<15:46:43,  8.59s/it]
 83%|████████▎ | 31353/37963 [71:13:36<15:21:02,  8.36s/it]
 83%|████████▎ | 31354/37963 [71:13:44<15:00:23,  8.17s/it]
 83%|████████▎ | 31355/37963 [71:13:51<14:43:12,  8.02s/it]
 83%|████████▎ | 31356/37963 [71:14:02<15:59:24,  8.71s/it]
 83%|████████▎ | 31357/37963 [71:14:12<16:57:59,  9.25s/it]
 83%|████████▎ | 31358/37963 [71:14:23<17:42:43,  9.65s/it]
 83%|████████▎ | 31359/37963 [71:14:31<16:44:49,  9.13s/it]
 83%|████████▎ | 31360/37963 [71:14:38<15:55:05,  8.68s/it]
                                                           
{'loss': '0.1041', 'grad_norm': '2.48', 'learning_rate': '1.546e-06', 'epoch': '0.8261'}
+
 83%|████████▎ | 31360/37963 [71:14:38<15:55:05,  8.68s/it]
 83%|████████▎ | 31361/37963 [71:14:46<15:24:49,  8.40s/it]
 83%|████████▎ | 31362/37963 [71:14:54<15:02:00,  8.20s/it]
 83%|████████▎ | 31363/37963 [71:15:02<14:48:14,  8.07s/it]
 83%|████████▎ | 31364/37963 [71:15:09<14:35:36,  7.96s/it]
 83%|████████▎ | 31365/37963 [71:15:17<14:38:54,  7.99s/it]
 83%|████████▎ | 31366/37963 [71:15:25<14:29:41,  7.91s/it]
 83%|████████▎ | 31367/37963 [71:15:33<14:16:21,  7.79s/it]
 83%|████████▎ | 31368/37963 [71:15:40<14:11:31,  7.75s/it]
 83%|████████▎ | 31369/37963 [71:15:48<14:01:21,  7.66s/it]
 83%|████████▎ | 31370/37963 [71:15:56<14:09:37,  7.73s/it]
                                                           
{'loss': '0.09599', 'grad_norm': '2.616', 'learning_rate': '1.541e-06', 'epoch': '0.8263'}
+
 83%|████████▎ | 31370/37963 [71:15:56<14:09:37,  7.73s/it]
 83%|████████▎ | 31371/37963 [71:16:03<14:06:18,  7.70s/it]
 83%|████████▎ | 31372/37963 [71:16:11<14:04:08,  7.68s/it]
 83%|████████▎ | 31373/37963 [71:16:21<15:33:22,  8.50s/it]
 83%|████████▎ | 31374/37963 [71:16:31<16:22:08,  8.94s/it]
 83%|████████▎ | 31375/37963 [71:16:42<17:09:03,  9.37s/it]
 83%|████████▎ | 31376/37963 [71:16:49<16:14:44,  8.88s/it]
 83%|████████▎ | 31377/37963 [71:16:57<15:39:22,  8.56s/it]
 83%|████████▎ | 31378/37963 [71:17:05<15:18:18,  8.37s/it]
 83%|████████▎ | 31379/37963 [71:17:13<15:03:05,  8.23s/it]
 83%|████████▎ | 31380/37963 [71:17:24<16:23:03,  8.96s/it]
                                                           
{'loss': '0.09762', 'grad_norm': '2.144', 'learning_rate': '1.537e-06', 'epoch': '0.8266'}
+
 83%|████████▎ | 31380/37963 [71:17:24<16:23:03,  8.96s/it]
 83%|████████▎ | 31381/37963 [71:17:31<15:33:40,  8.51s/it]
 83%|████████▎ | 31382/37963 [71:17:39<15:07:36,  8.27s/it]
 83%|████████▎ | 31383/37963 [71:17:46<14:36:21,  7.99s/it]
 83%|████████▎ | 31384/37963 [71:17:54<14:33:14,  7.96s/it]
 83%|████████▎ | 31385/37963 [71:18:02<14:24:41,  7.89s/it]
 83%|████████▎ | 31386/37963 [71:18:10<14:19:51,  7.84s/it]
 83%|████████▎ | 31387/37963 [71:18:17<14:16:57,  7.82s/it]
 83%|████████▎ | 31388/37963 [71:18:25<14:09:47,  7.75s/it]
 83%|████████▎ | 31389/37963 [71:18:33<14:12:10,  7.78s/it]
 83%|████████▎ | 31390/37963 [71:18:40<14:00:18,  7.67s/it]
                                                           
{'loss': '0.08685', 'grad_norm': '2.076', 'learning_rate': '1.532e-06', 'epoch': '0.8269'}
+
 83%|████████▎ | 31390/37963 [71:18:40<14:00:18,  7.67s/it]
 83%|████████▎ | 31391/37963 [71:18:48<14:00:26,  7.67s/it]
 83%|████████▎ | 31392/37963 [71:18:56<14:01:47,  7.69s/it]
 83%|████████▎ | 31393/37963 [71:19:03<14:04:13,  7.71s/it]
 83%|████████▎ | 31394/37963 [71:19:11<14:03:26,  7.70s/it]
 83%|████████▎ | 31395/37963 [71:19:22<15:35:24,  8.55s/it]
 83%|████████▎ | 31396/37963 [71:19:29<15:01:48,  8.24s/it]
 83%|████████▎ | 31397/37963 [71:19:37<14:50:45,  8.14s/it]
 83%|████████▎ | 31398/37963 [71:19:45<14:33:03,  7.98s/it]
 83%|████████▎ | 31399/37963 [71:19:52<14:20:54,  7.87s/it]
 83%|████████▎ | 31400/37963 [71:20:00<14:14:57,  7.82s/it]
                                                           
{'loss': '0.1123', 'grad_norm': '2.548', 'learning_rate': '1.527e-06', 'epoch': '0.8271'}
+
 83%|████████▎ | 31400/37963 [71:20:00<14:14:57,  7.82s/it]
 83%|████████▎ | 31401/37963 [71:20:08<14:11:01,  7.78s/it]
 83%|████████▎ | 31402/37963 [71:20:15<14:05:47,  7.73s/it]
 83%|████████▎ | 31403/37963 [71:20:23<14:10:05,  7.78s/it]
 83%|████████▎ | 31404/37963 [71:20:33<15:29:35,  8.50s/it]
 83%|████████▎ | 31405/37963 [71:20:41<15:00:32,  8.24s/it]
 83%|████████▎ | 31406/37963 [71:20:49<14:45:36,  8.10s/it]
 83%|████████▎ | 31407/37963 [71:20:59<16:05:43,  8.84s/it]
 83%|████████▎ | 31408/37963 [71:21:07<15:29:04,  8.50s/it]
 83%|████████▎ | 31409/37963 [71:21:15<15:03:23,  8.27s/it]
 83%|████████▎ | 31410/37963 [71:21:22<14:42:23,  8.08s/it]
                                                           
{'loss': '0.1008', 'grad_norm': '2.73', 'learning_rate': '1.523e-06', 'epoch': '0.8274'}
+
 83%|████████▎ | 31410/37963 [71:21:22<14:42:23,  8.08s/it]
 83%|████████▎ | 31411/37963 [71:21:33<16:00:08,  8.79s/it]
 83%|████████▎ | 31412/37963 [71:21:41<15:34:51,  8.56s/it]
 83%|████████▎ | 31413/37963 [71:21:48<14:59:18,  8.24s/it]
 83%|████████▎ | 31414/37963 [71:21:56<14:47:08,  8.13s/it]
 83%|████████▎ | 31415/37963 [71:22:04<14:37:24,  8.04s/it]
 83%|████████▎ | 31416/37963 [71:22:12<14:23:25,  7.91s/it]
 83%|████████▎ | 31417/37963 [71:22:25<17:20:40,  9.54s/it]
 83%|████████▎ | 31418/37963 [71:22:33<16:25:26,  9.03s/it]
 83%|████████▎ | 31419/37963 [71:22:43<17:06:24,  9.41s/it]
 83%|████████▎ | 31420/37963 [71:22:51<16:13:07,  8.92s/it]
                                                           
{'loss': '0.09733', 'grad_norm': '2.371', 'learning_rate': '1.518e-06', 'epoch': '0.8277'}
+
 83%|████████▎ | 31420/37963 [71:22:51<16:13:07,  8.92s/it]
 83%|████████▎ | 31421/37963 [71:22:59<15:35:33,  8.58s/it]
 83%|████████▎ | 31422/37963 [71:23:06<14:56:33,  8.22s/it]
 83%|████████▎ | 31423/37963 [71:23:14<14:34:16,  8.02s/it]
 83%|████████▎ | 31424/37963 [71:23:21<14:15:20,  7.85s/it]
 83%|████████▎ | 31425/37963 [71:23:29<14:14:51,  7.85s/it]
 83%|████████▎ | 31426/37963 [71:23:37<14:09:49,  7.80s/it]
 83%|████████▎ | 31427/37963 [71:23:44<14:00:13,  7.71s/it]
 83%|████████▎ | 31428/37963 [71:23:54<15:16:22,  8.41s/it]
 83%|████████▎ | 31429/37963 [71:24:02<14:56:56,  8.24s/it]
 83%|████████▎ | 31430/37963 [71:24:10<14:50:49,  8.18s/it]
                                                           
{'loss': '0.1005', 'grad_norm': '2.747', 'learning_rate': '1.514e-06', 'epoch': '0.8279'}
+
 83%|████████▎ | 31430/37963 [71:24:10<14:50:49,  8.18s/it]
 83%|████████▎ | 31431/37963 [71:24:18<14:34:04,  8.03s/it]
 83%|████████▎ | 31432/37963 [71:24:26<14:29:54,  7.99s/it]
 83%|████████▎ | 31433/37963 [71:24:33<14:23:04,  7.93s/it]
 83%|████████▎ | 31434/37963 [71:24:41<14:16:45,  7.87s/it]
 83%|████████▎ | 31435/37963 [71:24:49<14:17:51,  7.88s/it]
 83%|████████▎ | 31436/37963 [71:24:56<14:03:10,  7.75s/it]
 83%|████████▎ | 31437/37963 [71:25:04<14:09:09,  7.81s/it]
 83%|████████▎ | 31438/37963 [71:25:12<14:08:02,  7.80s/it]
 83%|████████▎ | 31439/37963 [71:25:20<14:09:16,  7.81s/it]
 83%|████████▎ | 31440/37963 [71:25:28<14:10:06,  7.82s/it]
                                                           
{'loss': '0.1028', 'grad_norm': '2.182', 'learning_rate': '1.509e-06', 'epoch': '0.8282'}
+
 83%|████████▎ | 31440/37963 [71:25:28<14:10:06,  7.82s/it]
 83%|████████▎ | 31441/37963 [71:25:38<15:23:40,  8.50s/it]
 83%|████████▎ | 31442/37963 [71:25:46<14:58:57,  8.27s/it]
 83%|████████▎ | 31443/37963 [71:25:53<14:34:14,  8.05s/it]
 83%|████████▎ | 31444/37963 [71:26:01<14:24:47,  7.96s/it]
 83%|████████▎ | 31445/37963 [71:26:09<14:12:02,  7.84s/it]
 83%|████████▎ | 31446/37963 [71:26:16<14:08:19,  7.81s/it]
 83%|████████▎ | 31447/37963 [71:26:24<14:00:32,  7.74s/it]
 83%|████████▎ | 31448/37963 [71:26:31<13:49:00,  7.63s/it]
 83%|████████▎ | 31449/37963 [71:26:39<13:58:46,  7.73s/it]
 83%|████████▎ | 31450/37963 [71:26:47<13:58:18,  7.72s/it]
                                                           
{'loss': '0.1102', 'grad_norm': '2.812', 'learning_rate': '1.505e-06', 'epoch': '0.8284'}
+
 83%|████████▎ | 31450/37963 [71:26:47<13:58:18,  7.72s/it]
 83%|████████▎ | 31451/37963 [71:26:54<13:48:02,  7.63s/it]
 83%|████████▎ | 31452/37963 [71:27:05<15:17:14,  8.45s/it]
 83%|████████▎ | 31453/37963 [71:27:12<14:54:03,  8.24s/it]
 83%|████████▎ | 31454/37963 [71:27:20<14:29:18,  8.01s/it]
 83%|████████▎ | 31455/37963 [71:27:30<15:44:43,  8.71s/it]
 83%|████████▎ | 31456/37963 [71:27:41<16:43:12,  9.25s/it]
 83%|████████▎ | 31457/37963 [71:27:49<15:57:01,  8.83s/it]
 83%|████████▎ | 31458/37963 [71:27:57<15:30:04,  8.58s/it]
 83%|████████▎ | 31459/37963 [71:28:04<15:02:16,  8.32s/it]
 83%|████████▎ | 31460/37963 [71:28:12<14:41:19,  8.13s/it]
                                                           
{'loss': '0.1039', 'grad_norm': '2.131', 'learning_rate': '1.5e-06', 'epoch': '0.8287'}
+
 83%|████████▎ | 31460/37963 [71:28:12<14:41:19,  8.13s/it]
 83%|████████▎ | 31461/37963 [71:28:22<15:54:43,  8.81s/it]
 83%|████████▎ | 31462/37963 [71:28:33<16:47:14,  9.30s/it]
 83%|████████▎ | 31463/37963 [71:28:40<15:50:34,  8.77s/it]
 83%|████████▎ | 31464/37963 [71:28:48<15:19:44,  8.49s/it]
 83%|████████▎ | 31465/37963 [71:28:56<14:52:23,  8.24s/it]
 83%|████████▎ | 31466/37963 [71:29:04<14:37:39,  8.11s/it]
 83%|████████▎ | 31467/37963 [71:29:11<14:21:00,  7.95s/it]
 83%|████████▎ | 31468/37963 [71:29:21<15:35:03,  8.64s/it]
 83%|████████▎ | 31469/37963 [71:29:29<15:05:47,  8.37s/it]
 83%|████████▎ | 31470/37963 [71:29:37<14:52:49,  8.25s/it]
                                                           
{'loss': '0.1038', 'grad_norm': '2.496', 'learning_rate': '1.496e-06', 'epoch': '0.829'}
+
 83%|████████▎ | 31470/37963 [71:29:37<14:52:49,  8.25s/it]
 83%|████████▎ | 31471/37963 [71:29:45<14:32:44,  8.07s/it]
 83%|████████▎ | 31472/37963 [71:29:53<14:31:31,  8.06s/it]
 83%|████████▎ | 31473/37963 [71:30:01<14:21:53,  7.97s/it]
 83%|████████▎ | 31474/37963 [71:30:08<14:14:49,  7.90s/it]
 83%|████████▎ | 31475/37963 [71:30:16<13:59:43,  7.77s/it]
 83%|████████▎ | 31476/37963 [71:30:23<13:52:35,  7.70s/it]
 83%|████████▎ | 31477/37963 [71:30:34<15:25:32,  8.56s/it]
 83%|████████▎ | 31478/37963 [71:30:41<14:48:05,  8.22s/it]
 83%|████████▎ | 31479/37963 [71:30:49<14:35:22,  8.10s/it]
 83%|████████▎ | 31480/37963 [71:30:57<14:25:20,  8.01s/it]
                                                           
{'loss': '0.09052', 'grad_norm': '2.381', 'learning_rate': '1.491e-06', 'epoch': '0.8292'}
+
 83%|████████▎ | 31480/37963 [71:30:57<14:25:20,  8.01s/it]
 83%|████████▎ | 31481/37963 [71:31:05<14:17:57,  7.94s/it]
 83%|████████▎ | 31482/37963 [71:31:13<14:16:04,  7.93s/it]
 83%|████████▎ | 31483/37963 [71:31:21<14:14:17,  7.91s/it]
 83%|████████▎ | 31484/37963 [71:31:28<14:09:18,  7.87s/it]
 83%|████████▎ | 31485/37963 [71:31:38<15:09:58,  8.43s/it]
 83%|████████▎ | 31486/37963 [71:31:46<14:44:59,  8.20s/it]
 83%|████████▎ | 31487/37963 [71:31:54<14:33:26,  8.09s/it]
 83%|████████▎ | 31488/37963 [71:32:01<14:21:57,  7.99s/it]
 83%|████████▎ | 31489/37963 [71:32:09<14:12:55,  7.90s/it]
 83%|████████▎ | 31490/37963 [71:32:16<13:56:39,  7.76s/it]
                                                           
{'loss': '0.09235', 'grad_norm': '3.493', 'learning_rate': '1.487e-06', 'epoch': '0.8295'}
+
 83%|████████▎ | 31490/37963 [71:32:16<13:56:39,  7.76s/it]
 83%|████████▎ | 31491/37963 [71:32:24<13:53:27,  7.73s/it]
 83%|████████▎ | 31492/37963 [71:32:31<13:40:52,  7.61s/it]
 83%|████████▎ | 31493/37963 [71:32:39<13:40:37,  7.61s/it]
 83%|████████▎ | 31494/37963 [71:32:46<13:29:56,  7.51s/it]
 83%|████████▎ | 31495/37963 [71:32:54<13:34:49,  7.56s/it]
 83%|████████▎ | 31496/37963 [71:33:04<14:59:30,  8.35s/it]
 83%|████████▎ | 31497/37963 [71:33:12<14:35:38,  8.13s/it]
 83%|████████▎ | 31498/37963 [71:33:19<14:09:42,  7.89s/it]
 83%|████████▎ | 31499/37963 [71:33:29<15:20:02,  8.54s/it]
 83%|████████▎ | 31500/37963 [71:33:37<14:58:55,  8.35s/it]
                                                           
{'loss': '0.09818', 'grad_norm': '2.406', 'learning_rate': '1.482e-06', 'epoch': '0.8298'}
+
 83%|████████▎ | 31500/37963 [71:33:37<14:58:55,  8.35s/it]
 83%|████████▎ | 31501/37963 [71:33:45<14:37:05,  8.14s/it]
 83%|████████▎ | 31502/37963 [71:33:52<14:15:46,  7.95s/it]
 83%|████████▎ | 31503/37963 [71:34:03<15:40:44,  8.74s/it]
 83%|████████▎ | 31504/37963 [71:34:11<15:14:57,  8.50s/it]
 83%|████████▎ | 31505/37963 [71:34:19<14:59:34,  8.36s/it]
 83%|████████▎ | 31506/37963 [71:34:29<16:09:04,  9.00s/it]
 83%|████████▎ | 31507/37963 [71:34:37<15:27:44,  8.62s/it]
 83%|████████▎ | 31508/37963 [71:34:45<15:00:48,  8.37s/it]
 83%|████████▎ | 31509/37963 [71:34:53<14:45:00,  8.23s/it]
 83%|████████▎ | 31510/37963 [71:35:00<14:18:03,  7.98s/it]
                                                           
{'loss': '0.1007', 'grad_norm': '2.14', 'learning_rate': '1.478e-06', 'epoch': '0.83'}
+
 83%|████████▎ | 31510/37963 [71:35:00<14:18:03,  7.98s/it]
 83%|████████▎ | 31511/37963 [71:35:08<14:10:44,  7.91s/it]
 83%|████████▎ | 31512/37963 [71:35:15<14:00:12,  7.81s/it]
 83%|████████▎ | 31513/37963 [71:35:23<13:55:50,  7.78s/it]
 83%|████████▎ | 31514/37963 [71:35:31<14:04:53,  7.86s/it]
 83%|████████▎ | 31515/37963 [71:35:41<15:16:47,  8.53s/it]
 83%|████████▎ | 31516/37963 [71:35:49<14:39:12,  8.18s/it]
 83%|████████▎ | 31517/37963 [71:35:59<15:46:49,  8.81s/it]
 83%|████████▎ | 31518/37963 [71:36:07<15:10:55,  8.48s/it]
 83%|████████▎ | 31519/37963 [71:36:14<14:47:35,  8.26s/it]
 83%|████████▎ | 31520/37963 [71:36:22<14:22:19,  8.03s/it]
                                                           
{'loss': '0.09748', 'grad_norm': '3.013', 'learning_rate': '1.474e-06', 'epoch': '0.8303'}
+
 83%|████████▎ | 31520/37963 [71:36:22<14:22:19,  8.03s/it]
 83%|████████▎ | 31521/37963 [71:36:30<14:14:28,  7.96s/it]
 83%|████████▎ | 31522/37963 [71:36:37<14:08:01,  7.90s/it]
 83%|████████▎ | 31523/37963 [71:36:45<13:59:11,  7.82s/it]
 83%|████████▎ | 31524/37963 [71:36:53<14:00:08,  7.83s/it]
 83%|████████▎ | 31525/37963 [71:37:01<14:08:26,  7.91s/it]
 83%|████████▎ | 31526/37963 [71:37:09<14:07:00,  7.90s/it]
 83%|████████▎ | 31527/37963 [71:37:17<14:00:57,  7.84s/it]
 83%|████████▎ | 31528/37963 [71:37:24<13:44:28,  7.69s/it]
 83%|████████▎ | 31529/37963 [71:37:32<13:50:49,  7.75s/it]
 83%|████████▎ | 31530/37963 [71:37:42<15:16:18,  8.55s/it]
                                                           
{'loss': '0.1053', 'grad_norm': '2.79', 'learning_rate': '1.469e-06', 'epoch': '0.8305'}
+
 83%|████████▎ | 31530/37963 [71:37:42<15:16:18,  8.55s/it]
 83%|████████▎ | 31531/37963 [71:37:50<14:46:07,  8.27s/it]
 83%|████████▎ | 31532/37963 [71:37:58<14:27:58,  8.10s/it]
 83%|████████▎ | 31533/37963 [71:38:05<14:09:19,  7.93s/it]
 83%|████████▎ | 31534/37963 [71:38:13<14:01:40,  7.86s/it]
 83%|████████▎ | 31535/37963 [71:38:20<13:54:15,  7.79s/it]
 83%|████████▎ | 31536/37963 [71:38:28<13:57:14,  7.82s/it]
 83%|████████▎ | 31537/37963 [71:38:39<15:18:04,  8.57s/it]
 83%|████████▎ | 31538/37963 [71:38:46<14:52:02,  8.33s/it]
 83%|████████▎ | 31539/37963 [71:38:54<14:25:57,  8.09s/it]
 83%|████████▎ | 31540/37963 [71:39:01<14:11:23,  7.95s/it]
                                                           
{'loss': '0.1085', 'grad_norm': '3.669', 'learning_rate': '1.465e-06', 'epoch': '0.8308'}
+
 83%|████████▎ | 31540/37963 [71:39:01<14:11:23,  7.95s/it]
 83%|████████▎ | 31541/37963 [71:39:09<14:00:22,  7.85s/it]
 83%|████████▎ | 31542/37963 [71:39:17<13:59:40,  7.85s/it]
 83%|████████▎ | 31543/37963 [71:39:25<13:53:09,  7.79s/it]
 83%|████████▎ | 31544/37963 [71:39:32<13:42:43,  7.69s/it]
 83%|████████▎ | 31545/37963 [71:39:40<13:44:33,  7.71s/it]
 83%|████████▎ | 31546/37963 [71:39:48<13:50:00,  7.76s/it]
 83%|████████▎ | 31547/37963 [71:39:55<13:40:15,  7.67s/it]
 83%|████████▎ | 31548/37963 [71:40:06<15:19:29,  8.60s/it]
 83%|████████▎ | 31549/37963 [71:40:14<15:00:40,  8.43s/it]
 83%|████████▎ | 31550/37963 [71:40:27<17:19:40,  9.73s/it]
                                                           
{'loss': '0.1042', 'grad_norm': '3.006', 'learning_rate': '1.46e-06', 'epoch': '0.8311'}
+
 83%|████████▎ | 31550/37963 [71:40:27<17:19:40,  9.73s/it]
 83%|████████▎ | 31551/37963 [71:40:37<17:51:58, 10.03s/it]
 83%|████████▎ | 31552/37963 [71:40:45<16:34:51,  9.31s/it]
 83%|████████▎ | 31553/37963 [71:40:53<15:50:21,  8.90s/it]
 83%|████████▎ | 31554/37963 [71:41:01<15:12:06,  8.54s/it]
 83%|████████▎ | 31555/37963 [71:41:08<14:38:30,  8.23s/it]
 83%|████████▎ | 31556/37963 [71:41:16<14:21:13,  8.07s/it]
 83%|████████▎ | 31557/37963 [71:41:23<13:57:29,  7.84s/it]
 83%|████████▎ | 31558/37963 [71:41:31<13:57:43,  7.85s/it]
 83%|████████▎ | 31559/37963 [71:41:39<14:00:25,  7.87s/it]
 83%|████████▎ | 31560/37963 [71:41:47<13:53:20,  7.81s/it]
                                                           
{'loss': '0.0884', 'grad_norm': '2.838', 'learning_rate': '1.456e-06', 'epoch': '0.8313'}
+
 83%|████████▎ | 31560/37963 [71:41:47<13:53:20,  7.81s/it]
 83%|████████▎ | 31561/37963 [71:41:54<13:50:46,  7.79s/it]
 83%|████████▎ | 31562/37963 [71:42:02<13:44:16,  7.73s/it]
 83%|████████▎ | 31563/37963 [71:42:12<15:01:49,  8.45s/it]
 83%|████████▎ | 31564/37963 [71:42:20<14:43:27,  8.28s/it]
 83%|████████▎ | 31565/37963 [71:42:28<14:23:37,  8.10s/it]
 83%|████████▎ | 31566/37963 [71:42:35<14:09:02,  7.96s/it]
 83%|████████▎ | 31567/37963 [71:42:45<15:15:40,  8.59s/it]
 83%|████████▎ | 31568/37963 [71:42:53<14:47:43,  8.33s/it]
 83%|████████▎ | 31569/37963 [71:43:01<14:25:40,  8.12s/it]
 83%|████████▎ | 31570/37963 [71:43:08<14:06:59,  7.95s/it]
                                                           
{'loss': '0.1029', 'grad_norm': '2.755', 'learning_rate': '1.451e-06', 'epoch': '0.8316'}
+
 83%|████████▎ | 31570/37963 [71:43:08<14:06:59,  7.95s/it]
 83%|████████▎ | 31571/37963 [71:43:16<14:10:11,  7.98s/it]
 83%|████████▎ | 31572/37963 [71:43:24<13:59:21,  7.88s/it]
 83%|████████▎ | 31573/37963 [71:43:32<13:50:57,  7.80s/it]
 83%|████████▎ | 31574/37963 [71:43:42<15:14:09,  8.58s/it]
 83%|████████▎ | 31575/37963 [71:43:50<14:43:35,  8.30s/it]
 83%|████████▎ | 31576/37963 [71:43:58<14:33:17,  8.20s/it]
 83%|████████▎ | 31577/37963 [71:44:06<14:26:52,  8.14s/it]
 83%|████████▎ | 31578/37963 [71:44:13<14:15:02,  8.03s/it]
 83%|████████▎ | 31579/37963 [71:44:21<14:08:09,  7.97s/it]
 83%|████████▎ | 31580/37963 [71:44:29<13:57:42,  7.87s/it]
                                                           
{'loss': '0.09659', 'grad_norm': '3.358', 'learning_rate': '1.447e-06', 'epoch': '0.8319'}
+
 83%|████████▎ | 31580/37963 [71:44:29<13:57:42,  7.87s/it]
 83%|████████▎ | 31581/37963 [71:44:37<13:58:07,  7.88s/it]
 83%|████████▎ | 31582/37963 [71:44:44<13:41:20,  7.72s/it]
 83%|████████▎ | 31583/37963 [71:44:52<13:44:16,  7.75s/it]
 83%|████████▎ | 31584/37963 [71:44:59<13:36:11,  7.68s/it]
 83%|████████▎ | 31585/37963 [71:45:07<13:29:30,  7.62s/it]
 83%|████████▎ | 31586/37963 [71:45:15<13:35:22,  7.67s/it]
 83%|████████▎ | 31587/37963 [71:45:22<13:32:43,  7.65s/it]
 83%|████████▎ | 31588/37963 [71:45:30<13:20:36,  7.54s/it]
 83%|████████▎ | 31589/37963 [71:45:37<13:17:58,  7.51s/it]
 83%|████████▎ | 31590/37963 [71:45:45<13:23:16,  7.56s/it]
                                                           
{'loss': '0.09317', 'grad_norm': '3.251', 'learning_rate': '1.442e-06', 'epoch': '0.8321'}
+
 83%|████████▎ | 31590/37963 [71:45:45<13:23:16,  7.56s/it]
 83%|████████▎ | 31591/37963 [71:45:55<14:49:07,  8.37s/it]
 83%|████████▎ | 31592/37963 [71:46:03<14:31:37,  8.21s/it]
 83%|████████▎ | 31593/37963 [71:46:10<14:12:44,  8.03s/it]
 83%|████████▎ | 31594/37963 [71:46:18<14:09:24,  8.00s/it]
 83%|████████▎ | 31595/37963 [71:46:29<15:33:48,  8.80s/it]
 83%|████████▎ | 31596/37963 [71:46:37<14:59:21,  8.48s/it]
 83%|████████▎ | 31597/37963 [71:46:45<14:42:57,  8.32s/it]
 83%|████████▎ | 31598/37963 [71:46:53<14:27:46,  8.18s/it]
 83%|████████▎ | 31599/37963 [71:47:00<14:08:18,  8.00s/it]
 83%|████████▎ | 31600/37963 [71:47:08<13:55:25,  7.88s/it]
                                                           
{'loss': '0.1243', 'grad_norm': '2.595', 'learning_rate': '1.438e-06', 'epoch': '0.8324'}
+
 83%|████████▎ | 31600/37963 [71:47:08<13:55:25,  7.88s/it]
 83%|████████▎ | 31601/37963 [71:47:16<13:59:38,  7.92s/it]
 83%|████████▎ | 31602/37963 [71:47:26<15:19:23,  8.67s/it]
 83%|████████▎ | 31603/37963 [71:47:34<14:55:40,  8.45s/it]
 83%|████████▎ | 31604/37963 [71:47:44<15:52:43,  8.99s/it]
 83%|████████▎ | 31605/37963 [71:47:52<15:16:32,  8.65s/it]
 83%|████████▎ | 31606/37963 [71:48:00<14:44:24,  8.35s/it]
 83%|████████▎ | 31607/37963 [71:48:08<14:22:49,  8.14s/it]
 83%|████████▎ | 31608/37963 [71:48:15<14:04:46,  7.98s/it]
 83%|████████▎ | 31609/37963 [71:48:23<13:50:43,  7.84s/it]
 83%|████████▎ | 31610/37963 [71:48:30<13:45:46,  7.80s/it]
                                                           
{'loss': '0.1073', 'grad_norm': '3.116', 'learning_rate': '1.434e-06', 'epoch': '0.8327'}
+
 83%|████████▎ | 31610/37963 [71:48:30<13:45:46,  7.80s/it]
 83%|████████▎ | 31611/37963 [71:48:38<13:41:00,  7.76s/it]
 83%|████████▎ | 31612/37963 [71:48:48<15:05:22,  8.55s/it]
 83%|████████▎ | 31613/37963 [71:48:56<14:45:35,  8.37s/it]
 83%|████████▎ | 31614/37963 [71:49:04<14:25:11,  8.18s/it]
 83%|████████▎ | 31615/37963 [71:49:14<15:33:07,  8.82s/it]
 83%|████████▎ | 31616/37963 [71:49:22<14:53:40,  8.45s/it]
 83%|████████▎ | 31617/37963 [71:49:30<14:36:02,  8.28s/it]
 83%|████████▎ | 31618/37963 [71:49:37<14:02:37,  7.97s/it]
 83%|████████▎ | 31619/37963 [71:49:49<15:51:02,  8.99s/it]
 83%|████████▎ | 31620/37963 [71:49:56<15:12:10,  8.63s/it]
                                                           
{'loss': '0.1022', 'grad_norm': '3.448', 'learning_rate': '1.429e-06', 'epoch': '0.8329'}
+
 83%|████████▎ | 31620/37963 [71:49:56<15:12:10,  8.63s/it]
 83%|████████▎ | 31621/37963 [71:50:04<14:42:43,  8.35s/it]
 83%|████████▎ | 31622/37963 [71:50:11<14:09:28,  8.04s/it]
 83%|████████▎ | 31623/37963 [71:50:19<13:52:59,  7.88s/it]
 83%|████████▎ | 31624/37963 [71:50:26<13:45:42,  7.82s/it]
 83%|████████▎ | 31625/37963 [71:50:34<13:51:51,  7.88s/it]
 83%|████████▎ | 31626/37963 [71:50:42<13:53:16,  7.89s/it]
 83%|████████▎ | 31627/37963 [71:50:50<13:51:12,  7.87s/it]
 83%|████████▎ | 31628/37963 [71:50:58<13:52:52,  7.89s/it]
 83%|████████▎ | 31629/37963 [71:51:06<13:53:25,  7.89s/it]
 83%|████████▎ | 31630/37963 [71:51:14<13:46:25,  7.83s/it]
                                                           
{'loss': '0.1011', 'grad_norm': '2.317', 'learning_rate': '1.425e-06', 'epoch': '0.8332'}
+
 83%|████████▎ | 31630/37963 [71:51:14<13:46:25,  7.83s/it]
 83%|████████▎ | 31631/37963 [71:51:21<13:39:45,  7.77s/it]
 83%|████████▎ | 31632/37963 [71:51:29<13:36:51,  7.74s/it]
 83%|████████▎ | 31633/37963 [71:51:37<13:33:54,  7.71s/it]
 83%|████████▎ | 31634/37963 [71:51:44<13:35:19,  7.73s/it]
 83%|████████▎ | 31635/37963 [71:51:52<13:33:40,  7.71s/it]
 83%|████████▎ | 31636/37963 [71:52:00<13:22:57,  7.61s/it]
 83%|████████▎ | 31637/37963 [71:52:07<13:27:22,  7.66s/it]
 83%|████████▎ | 31638/37963 [71:52:15<13:21:59,  7.61s/it]
 83%|████████▎ | 31639/37963 [71:52:22<13:21:07,  7.60s/it]
 83%|████████▎ | 31640/37963 [71:52:33<14:55:28,  8.50s/it]
                                                           
{'loss': '0.09263', 'grad_norm': '4.165', 'learning_rate': '1.42e-06', 'epoch': '0.8334'}
+
 83%|████████▎ | 31640/37963 [71:52:33<14:55:28,  8.50s/it]
 83%|████████▎ | 31641/37963 [71:52:41<14:32:58,  8.29s/it]
 83%|████████▎ | 31642/37963 [71:52:49<14:16:26,  8.13s/it]
 83%|████████▎ | 31643/37963 [71:52:59<15:28:36,  8.82s/it]
 83%|████████▎ | 31644/37963 [71:53:07<15:05:40,  8.60s/it]
 83%|████████▎ | 31645/37963 [71:53:15<14:40:43,  8.36s/it]
 83%|████████▎ | 31646/37963 [71:53:23<14:19:14,  8.16s/it]
 83%|████████▎ | 31647/37963 [71:53:30<14:06:27,  8.04s/it]
 83%|████████▎ | 31648/37963 [71:53:38<13:54:01,  7.92s/it]
 83%|████████▎ | 31649/37963 [71:53:46<13:43:51,  7.83s/it]
 83%|████████▎ | 31650/37963 [71:53:54<13:48:55,  7.88s/it]
                                                           
{'loss': '0.103', 'grad_norm': '3.582', 'learning_rate': '1.416e-06', 'epoch': '0.8337'}
+
 83%|████████▎ | 31650/37963 [71:53:54<13:48:55,  7.88s/it]
 83%|████████▎ | 31651/37963 [71:54:01<13:39:03,  7.79s/it]
 83%|████████▎ | 31652/37963 [71:54:11<14:58:19,  8.54s/it]
 83%|████████▎ | 31653/37963 [71:54:19<14:32:52,  8.30s/it]
 83%|████████▎ | 31654/37963 [71:54:27<14:17:18,  8.15s/it]
 83%|████████▎ | 31655/37963 [71:54:35<14:12:07,  8.11s/it]
 83%|████████▎ | 31656/37963 [71:54:45<15:27:45,  8.83s/it]
 83%|████████▎ | 31657/37963 [71:54:53<14:45:26,  8.42s/it]
 83%|████████▎ | 31658/37963 [71:55:03<15:41:13,  8.96s/it]
 83%|████████▎ | 31659/37963 [71:55:11<14:52:15,  8.49s/it]
 83%|████████▎ | 31660/37963 [71:55:21<15:46:40,  9.01s/it]
                                                           
{'loss': '0.09637', 'grad_norm': '2.748', 'learning_rate': '1.412e-06', 'epoch': '0.834'}
+
 83%|████████▎ | 31660/37963 [71:55:21<15:46:40,  9.01s/it]
 83%|████████▎ | 31661/37963 [71:55:29<15:10:48,  8.67s/it]
 83%|████████▎ | 31662/37963 [71:55:36<14:33:00,  8.31s/it]
 83%|████████▎ | 31663/37963 [71:55:50<17:18:10,  9.89s/it]
 83%|████████▎ | 31664/37963 [71:55:58<16:12:31,  9.26s/it]
 83%|████████▎ | 31665/37963 [71:56:05<15:26:17,  8.82s/it]
 83%|████████▎ | 31666/37963 [71:56:13<14:41:48,  8.40s/it]
 83%|████████▎ | 31667/37963 [71:56:20<14:15:07,  8.15s/it]
 83%|████████▎ | 31668/37963 [71:56:28<13:59:51,  8.00s/it]
 83%|████████▎ | 31669/37963 [71:56:36<13:50:25,  7.92s/it]
 83%|████████▎ | 31670/37963 [71:56:43<13:47:11,  7.89s/it]
                                                           
{'loss': '0.09314', 'grad_norm': '2.178', 'learning_rate': '1.407e-06', 'epoch': '0.8342'}
+
 83%|████████▎ | 31670/37963 [71:56:43<13:47:11,  7.89s/it]
 83%|████████▎ | 31671/37963 [71:56:51<13:33:39,  7.76s/it]
 83%|████████▎ | 31672/37963 [71:56:59<13:35:40,  7.78s/it]
 83%|████████▎ | 31673/37963 [71:57:06<13:33:25,  7.76s/it]
 83%|████████▎ | 31674/37963 [71:57:14<13:25:15,  7.68s/it]
 83%|████████▎ | 31675/37963 [71:57:22<13:27:39,  7.71s/it]
 83%|████████▎ | 31676/37963 [71:57:29<13:23:46,  7.67s/it]
 83%|████████▎ | 31677/37963 [71:57:37<13:27:17,  7.71s/it]
 83%|████████▎ | 31678/37963 [71:57:45<13:29:10,  7.72s/it]
 83%|████████▎ | 31679/37963 [71:57:52<13:21:00,  7.65s/it]
 83%|████████▎ | 31680/37963 [71:58:00<13:26:11,  7.70s/it]
                                                           
{'loss': '0.102', 'grad_norm': '2.674', 'learning_rate': '1.403e-06', 'epoch': '0.8345'}
+
 83%|████████▎ | 31680/37963 [71:58:00<13:26:11,  7.70s/it]
 83%|████████▎ | 31681/37963 [71:58:08<13:33:14,  7.77s/it]
 83%|████████▎ | 31682/37963 [71:58:16<13:36:39,  7.80s/it]
 83%|████████▎ | 31683/37963 [71:58:24<13:33:56,  7.78s/it]
 83%|████████▎ | 31684/37963 [71:58:31<13:26:51,  7.71s/it]
 83%|████████▎ | 31685/37963 [71:58:39<13:28:36,  7.73s/it]
 83%|████████▎ | 31686/37963 [71:58:49<14:48:23,  8.49s/it]
 83%|████████▎ | 31687/37963 [71:58:57<14:24:43,  8.27s/it]
 83%|████████▎ | 31688/37963 [71:59:05<14:11:04,  8.14s/it]
 83%|████████▎ | 31689/37963 [71:59:13<13:59:58,  8.03s/it]
 83%|████████▎ | 31690/37963 [71:59:20<13:45:14,  7.89s/it]
                                                           
{'loss': '0.1004', 'grad_norm': '2.735', 'learning_rate': '1.399e-06', 'epoch': '0.8348'}
+
 83%|████████▎ | 31690/37963 [71:59:20<13:45:14,  7.89s/it]
 83%|████████▎ | 31691/37963 [71:59:28<13:32:55,  7.78s/it]
 83%|████████▎ | 31692/37963 [71:59:36<13:35:08,  7.80s/it]
 83%|████████▎ | 31693/37963 [71:59:43<13:33:43,  7.79s/it]
 83%|████████▎ | 31694/37963 [71:59:51<13:29:18,  7.75s/it]
 83%|████████▎ | 31695/37963 [71:59:59<13:24:16,  7.70s/it]
 83%|████████▎ | 31696/37963 [72:00:09<14:43:05,  8.45s/it]
 83%|████████▎ | 31697/37963 [72:00:19<15:47:49,  9.08s/it]
 83%|████████▎ | 31698/37963 [72:00:27<15:06:36,  8.68s/it]
 83%|████████▎ | 31699/37963 [72:00:35<14:42:18,  8.45s/it]
 84%|████████▎ | 31700/37963 [72:00:43<14:16:00,  8.20s/it]
                                                           
{'loss': '0.101', 'grad_norm': '2.842', 'learning_rate': '1.394e-06', 'epoch': '0.835'}
+
 84%|████████▎ | 31700/37963 [72:00:43<14:16:00,  8.20s/it]
 84%|████████▎ | 31701/37963 [72:00:50<14:01:16,  8.06s/it]
 84%|████████▎ | 31702/37963 [72:00:58<13:52:55,  7.98s/it]
 84%|████████▎ | 31703/37963 [72:01:06<13:43:32,  7.89s/it]
 84%|████████▎ | 31704/37963 [72:01:14<13:38:36,  7.85s/it]
 84%|████████▎ | 31705/37963 [72:01:21<13:33:09,  7.80s/it]
 84%|████████▎ | 31706/37963 [72:01:29<13:22:48,  7.70s/it]
 84%|████████▎ | 31707/37963 [72:01:36<13:20:29,  7.68s/it]
 84%|████████▎ | 31708/37963 [72:01:44<13:25:04,  7.72s/it]
 84%|████████▎ | 31709/37963 [72:01:52<13:23:17,  7.71s/it]
 84%|████████▎ | 31710/37963 [72:02:05<16:00:31,  9.22s/it]
                                                           
{'loss': '0.09745', 'grad_norm': '2.758', 'learning_rate': '1.39e-06', 'epoch': '0.8353'}
+
 84%|████████▎ | 31710/37963 [72:02:05<16:00:31,  9.22s/it]
 84%|████████▎ | 31711/37963 [72:02:13<15:22:30,  8.85s/it]
 84%|████████▎ | 31712/37963 [72:02:23<16:07:49,  9.29s/it]
 84%|████████▎ | 31713/37963 [72:02:33<16:44:36,  9.64s/it]
 84%|████████▎ | 31714/37963 [72:02:41<15:48:13,  9.10s/it]
 84%|████████▎ | 31715/37963 [72:02:49<15:08:15,  8.72s/it]
 84%|████████▎ | 31716/37963 [72:02:57<14:37:50,  8.43s/it]
 84%|████████▎ | 31717/37963 [72:03:07<15:33:18,  8.97s/it]
 84%|████████▎ | 31718/37963 [72:03:15<14:48:16,  8.53s/it]
 84%|████████▎ | 31719/37963 [72:03:22<14:27:44,  8.34s/it]
 84%|████████▎ | 31720/37963 [72:03:30<13:56:25,  8.04s/it]
                                                           
{'loss': '0.08731', 'grad_norm': '3.221', 'learning_rate': '1.386e-06', 'epoch': '0.8356'}
+
 84%|████████▎ | 31720/37963 [72:03:30<13:56:25,  8.04s/it]
 84%|████████▎ | 31721/37963 [72:03:38<13:54:24,  8.02s/it]
 84%|████████▎ | 31722/37963 [72:03:46<13:49:06,  7.97s/it]
 84%|████████▎ | 31723/37963 [72:03:53<13:44:12,  7.93s/it]
 84%|████████▎ | 31724/37963 [72:04:01<13:39:34,  7.88s/it]
 84%|████████▎ | 31725/37963 [72:04:09<13:36:30,  7.85s/it]
 84%|████████▎ | 31726/37963 [72:04:17<13:38:21,  7.87s/it]
 84%|████████▎ | 31727/37963 [72:04:25<13:36:01,  7.85s/it]
 84%|████████▎ | 31728/37963 [72:04:32<13:33:00,  7.82s/it]
 84%|████████▎ | 31729/37963 [72:04:40<13:30:49,  7.80s/it]
 84%|████████▎ | 31730/37963 [72:04:48<13:23:41,  7.74s/it]
                                                           
{'loss': '0.103', 'grad_norm': '2.679', 'learning_rate': '1.381e-06', 'epoch': '0.8358'}
+
 84%|████████▎ | 31730/37963 [72:04:48<13:23:41,  7.74s/it]
 84%|████████▎ | 31731/37963 [72:04:56<13:25:26,  7.75s/it]
 84%|████████▎ | 31732/37963 [72:05:03<13:25:02,  7.75s/it]
 84%|████████▎ | 31733/37963 [72:05:11<13:29:29,  7.80s/it]
 84%|████████▎ | 31734/37963 [72:05:19<13:26:49,  7.77s/it]
 84%|████████▎ | 31735/37963 [72:05:27<13:29:43,  7.80s/it]
 84%|████████▎ | 31736/37963 [72:05:35<13:34:38,  7.85s/it]
 84%|████████▎ | 31737/37963 [72:05:45<14:42:15,  8.50s/it]
 84%|████████▎ | 31738/37963 [72:05:53<14:19:56,  8.29s/it]
 84%|████████▎ | 31739/37963 [72:06:02<15:09:08,  8.76s/it]
 84%|████████▎ | 31740/37963 [72:06:10<14:31:55,  8.41s/it]
                                                           
{'loss': '0.09354', 'grad_norm': '2.9', 'learning_rate': '1.377e-06', 'epoch': '0.8361'}
+
 84%|████████▎ | 31740/37963 [72:06:10<14:31:55,  8.41s/it]
 84%|████████▎ | 31741/37963 [72:06:18<14:02:38,  8.13s/it]
 84%|████████▎ | 31742/37963 [72:06:25<13:54:56,  8.05s/it]
 84%|████████▎ | 31743/37963 [72:06:33<13:31:13,  7.83s/it]
 84%|████████▎ | 31744/37963 [72:06:40<13:28:42,  7.80s/it]
 84%|████████▎ | 31745/37963 [72:06:48<13:31:47,  7.83s/it]
 84%|████████▎ | 31746/37963 [72:06:56<13:35:18,  7.87s/it]
 84%|████████▎ | 31747/37963 [72:07:04<13:31:38,  7.83s/it]
 84%|████████▎ | 31748/37963 [72:07:12<13:24:29,  7.77s/it]
 84%|████████▎ | 31749/37963 [72:07:19<13:25:39,  7.78s/it]
 84%|████████▎ | 31750/37963 [72:07:27<13:31:52,  7.84s/it]
                                                           
{'loss': '0.1035', 'grad_norm': '2.811', 'learning_rate': '1.373e-06', 'epoch': '0.8363'}
+
 84%|████████▎ | 31750/37963 [72:07:27<13:31:52,  7.84s/it]
 84%|████████▎ | 31751/37963 [72:07:38<15:00:25,  8.70s/it]
 84%|████████▎ | 31752/37963 [72:07:46<14:24:21,  8.35s/it]
 84%|████████▎ | 31753/37963 [72:07:53<14:03:26,  8.15s/it]
 84%|████████▎ | 31754/37963 [72:08:04<15:05:58,  8.75s/it]
 84%|████████▎ | 31755/37963 [72:08:11<14:35:44,  8.46s/it]
 84%|████████▎ | 31756/37963 [72:08:19<14:11:39,  8.23s/it]
 84%|████████▎ | 31757/37963 [72:08:27<13:54:06,  8.06s/it]
 84%|████████▎ | 31758/37963 [72:08:34<13:31:07,  7.84s/it]
 84%|████████▎ | 31759/37963 [72:08:42<13:23:53,  7.77s/it]
 84%|████████▎ | 31760/37963 [72:08:51<14:28:22,  8.40s/it]
                                                           
{'loss': '0.1017', 'grad_norm': '2.323', 'learning_rate': '1.368e-06', 'epoch': '0.8366'}
+
 84%|████████▎ | 31760/37963 [72:08:51<14:28:22,  8.40s/it]
 84%|████████▎ | 31761/37963 [72:08:59<14:13:32,  8.26s/it]
 84%|████████▎ | 31762/37963 [72:09:07<13:50:20,  8.03s/it]
 84%|████████▎ | 31763/37963 [72:09:15<13:42:05,  7.96s/it]
 84%|████████▎ | 31764/37963 [72:09:25<15:02:53,  8.74s/it]
 84%|████████▎ | 31765/37963 [72:09:36<15:50:50,  9.20s/it]
 84%|████████▎ | 31766/37963 [72:09:43<14:54:15,  8.66s/it]
 84%|████████▎ | 31767/37963 [72:09:53<15:40:55,  9.11s/it]
 84%|████████▎ | 31768/37963 [72:10:01<15:02:04,  8.74s/it]
 84%|████████▎ | 31769/37963 [72:10:09<14:35:40,  8.48s/it]
 84%|████████▎ | 31770/37963 [72:10:16<14:05:04,  8.19s/it]
                                                           
{'loss': '0.09374', 'grad_norm': '2.327', 'learning_rate': '1.364e-06', 'epoch': '0.8369'}
+
 84%|████████▎ | 31770/37963 [72:10:16<14:05:04,  8.19s/it]
 84%|████████▎ | 31771/37963 [72:10:24<13:44:56,  7.99s/it]
 84%|████████▎ | 31772/37963 [72:10:32<13:45:20,  8.00s/it]
 84%|████████▎ | 31773/37963 [72:10:40<13:41:16,  7.96s/it]
 84%|████████▎ | 31774/37963 [72:10:48<13:35:14,  7.90s/it]
 84%|████████▎ | 31775/37963 [72:10:55<13:27:17,  7.83s/it]
 84%|████████▎ | 31776/37963 [72:11:03<13:18:27,  7.74s/it]
 84%|████████▎ | 31777/37963 [72:11:11<13:19:53,  7.76s/it]
 84%|████��███▎ | 31778/37963 [72:11:18<13:19:53,  7.76s/it]
 84%|████████▎ | 31779/37963 [72:11:26<13:07:28,  7.64s/it]
 84%|████████▎ | 31780/37963 [72:11:33<13:07:16,  7.64s/it]
                                                           
{'loss': '0.1043', 'grad_norm': '2.523', 'learning_rate': '1.36e-06', 'epoch': '0.8371'}
+
 84%|████████▎ | 31780/37963 [72:11:33<13:07:16,  7.64s/it]
 84%|████████▎ | 31781/37963 [72:11:41<13:00:37,  7.58s/it]
 84%|████████▎ | 31782/37963 [72:11:51<14:23:19,  8.38s/it]
 84%|████████▎ | 31783/37963 [72:11:59<14:04:12,  8.20s/it]
 84%|████████▎ | 31784/37963 [72:12:06<13:48:05,  8.04s/it]
 84%|████████▎ | 31785/37963 [72:12:14<13:40:26,  7.97s/it]
 84%|████████▎ | 31786/37963 [72:12:22<13:30:44,  7.88s/it]
 84%|████████▎ | 31787/37963 [72:12:30<13:25:37,  7.83s/it]
 84%|████████▎ | 31788/37963 [72:12:40<14:40:48,  8.56s/it]
 84%|████████▎ | 31789/37963 [72:12:48<14:15:35,  8.31s/it]
 84%|████████▎ | 31790/37963 [72:12:55<13:44:56,  8.02s/it]
                                                           
{'loss': '0.09247', 'grad_norm': '2.93', 'learning_rate': '1.355e-06', 'epoch': '0.8374'}
+
 84%|████████▎ | 31790/37963 [72:12:55<13:44:56,  8.02s/it]
 84%|████████▎ | 31791/37963 [72:13:03<13:33:10,  7.91s/it]
 84%|████████▎ | 31792/37963 [72:13:10<13:26:54,  7.85s/it]
 84%|████████▎ | 31793/37963 [72:13:18<13:15:50,  7.74s/it]
 84%|████████▎ | 31794/37963 [72:13:25<13:10:39,  7.69s/it]
 84%|████████▍ | 31795/37963 [72:13:33<13:09:49,  7.68s/it]
 84%|████████▍ | 31796/37963 [72:13:41<13:17:35,  7.76s/it]
 84%|████████▍ | 31797/37963 [72:13:49<13:15:45,  7.74s/it]
 84%|████████▍ | 31798/37963 [72:13:56<13:10:18,  7.69s/it]
 84%|████████▍ | 31799/37963 [72:14:04<13:09:14,  7.68s/it]
 84%|████████▍ | 31800/37963 [72:14:11<12:58:16,  7.58s/it]
                                                           
{'loss': '0.1178', 'grad_norm': '2.974', 'learning_rate': '1.351e-06', 'epoch': '0.8377'}
+
 84%|████████▍ | 31800/37963 [72:14:11<12:58:16,  7.58s/it]
 84%|████████▍ | 31801/37963 [72:14:19<12:55:44,  7.55s/it]
 84%|████████▍ | 31802/37963 [72:14:26<12:49:49,  7.50s/it]
 84%|████████▍ | 31803/37963 [72:14:34<12:57:15,  7.57s/it]
 84%|████████▍ | 31804/37963 [72:14:44<14:16:44,  8.35s/it]
 84%|████████▍ | 31805/37963 [72:14:54<15:14:46,  8.91s/it]
 84%|████████▍ | 31806/37963 [72:15:02<14:40:09,  8.58s/it]
 84%|████████▍ | 31807/37963 [72:15:10<14:10:47,  8.29s/it]
 84%|████████▍ | 31808/37963 [72:15:20<15:25:26,  9.02s/it]
 84%|████████▍ | 31809/37963 [72:15:28<14:46:15,  8.64s/it]
 84%|████████▍ | 31810/37963 [72:15:36<14:24:48,  8.43s/it]
                                                           
{'loss': '0.09651', 'grad_norm': '4.623', 'learning_rate': '1.347e-06', 'epoch': '0.8379'}
+
 84%|████████▍ | 31810/37963 [72:15:36<14:24:48,  8.43s/it]
 84%|████████▍ | 31811/37963 [72:15:44<13:56:17,  8.16s/it]
 84%|████████▍ | 31812/37963 [72:15:51<13:41:45,  8.02s/it]
 84%|████████▍ | 31813/37963 [72:15:59<13:43:27,  8.03s/it]
 84%|████████▍ | 31814/37963 [72:16:07<13:40:47,  8.01s/it]
 84%|████████▍ | 31815/37963 [72:16:15<13:26:41,  7.87s/it]
 84%|████████▍ | 31816/37963 [72:16:23<13:23:32,  7.84s/it]
 84%|████████▍ | 31817/37963 [72:16:30<13:18:20,  7.79s/it]
 84%|████████▍ | 31818/37963 [72:16:41<14:41:37,  8.61s/it]
 84%|████████▍ | 31819/37963 [72:16:51<15:33:55,  9.12s/it]
 84%|████████▍ | 31820/37963 [72:16:59<14:52:52,  8.72s/it]
                                                           
{'loss': '0.09295', 'grad_norm': '3.752', 'learning_rate': '1.343e-06', 'epoch': '0.8382'}
+
 84%|████████▍ | 31820/37963 [72:16:59<14:52:52,  8.72s/it]
 84%|████████▍ | 31821/37963 [72:17:09<15:41:56,  9.20s/it]
 84%|████████▍ | 31822/37963 [72:17:17<14:56:39,  8.76s/it]
 84%|████████▍ | 31823/37963 [72:17:25<14:30:50,  8.51s/it]
 84%|████████▍ | 31824/37963 [72:17:33<14:06:36,  8.27s/it]
 84%|████████▍ | 31825/37963 [72:17:40<13:42:58,  8.04s/it]
 84%|████████▍ | 31826/37963 [72:17:48<13:33:10,  7.95s/it]
 84%|████████▍ | 31827/37963 [72:17:55<13:18:59,  7.81s/it]
 84%|████████▍ | 31828/37963 [72:18:03<13:15:16,  7.78s/it]
 84%|█��██████▍ | 31829/37963 [72:18:11<13:09:23,  7.72s/it]
 84%|████████▍ | 31830/37963 [72:18:21<14:29:53,  8.51s/it]
                                                           
{'loss': '0.09487', 'grad_norm': '2.38', 'learning_rate': '1.338e-06', 'epoch': '0.8385'}
+
 84%|████████▍ | 31830/37963 [72:18:21<14:29:53,  8.51s/it]
 84%|████████▍ | 31831/37963 [72:18:29<14:05:39,  8.27s/it]
 84%|████████▍ | 31832/37963 [72:18:36<13:48:32,  8.11s/it]
 84%|████████▍ | 31833/37963 [72:18:44<13:33:24,  7.96s/it]
 84%|████████▍ | 31834/37963 [72:18:52<13:22:49,  7.86s/it]
 84%|████████▍ | 31835/37963 [72:18:59<13:19:46,  7.83s/it]
 84%|████████▍ | 31836/37963 [72:19:10<14:33:27,  8.55s/it]
 84%|████████▍ | 31837/37963 [72:19:17<14:05:58,  8.29s/it]
 84%|████████▍ | 31838/37963 [72:19:25<13:50:48,  8.14s/it]
 84%|████████▍ | 31839/37963 [72:19:33<13:43:44,  8.07s/it]
 84%|████████▍ | 31840/37963 [72:19:41<13:35:12,  7.99s/it]
                                                           
{'loss': '0.1054', 'grad_norm': '3.552', 'learning_rate': '1.334e-06', 'epoch': '0.8387'}
+
 84%|████████▍ | 31840/37963 [72:19:41<13:35:12,  7.99s/it]
 84%|████████▍ | 31841/37963 [72:19:49<13:28:22,  7.92s/it]
 84%|████████▍ | 31842/37963 [72:19:56<13:25:29,  7.90s/it]
 84%|████████▍ | 31843/37963 [72:20:04<13:17:02,  7.81s/it]
 84%|████████▍ | 31844/37963 [72:20:12<13:06:11,  7.71s/it]
 84%|████████▍ | 31845/37963 [72:20:19<13:04:31,  7.69s/it]
 84%|████████▍ | 31846/37963 [72:20:27<13:07:08,  7.72s/it]
 84%|████████▍ | 31847/37963 [72:20:35<13:03:10,  7.68s/it]
 84%|████████▍ | 31848/37963 [72:20:45<14:25:12,  8.49s/it]
 84%|████████▍ | 31849/37963 [72:20:53<14:03:14,  8.28s/it]
 84%|████████▍ | 31850/37963 [72:21:00<13:40:37,  8.05s/it]
                                                           
{'loss': '0.0968', 'grad_norm': '3.463', 'learning_rate': '1.33e-06', 'epoch': '0.839'}
+
 84%|████████▍ | 31850/37963 [72:21:00<13:40:37,  8.05s/it]
 84%|████████▍ | 31851/37963 [72:21:08<13:29:07,  7.94s/it]
 84%|████████▍ | 31852/37963 [72:21:16<13:25:14,  7.91s/it]
 84%|████████▍ | 31853/37963 [72:21:24<13:19:43,  7.85s/it]
 84%|████████▍ | 31854/37963 [72:21:31<13:04:18,  7.70s/it]
 84%|████████▍ | 31855/37963 [72:21:39<13:02:20,  7.69s/it]
 84%|████████▍ | 31856/37963 [72:21:49<14:21:15,  8.46s/it]
 84%|████████▍ | 31857/37963 [72:21:56<13:44:41,  8.10s/it]
 84%|████████▍ | 31858/37963 [72:22:06<14:44:11,  8.69s/it]
 84%|████████▍ | 31859/37963 [72:22:14<14:12:06,  8.38s/it]
 84%|████████▍ | 31860/37963 [72:22:21<13:50:52,  8.17s/it]
                                                           
{'loss': '0.1056', 'grad_norm': '2.93', 'learning_rate': '1.326e-06', 'epoch': '0.8392'}
+
 84%|████████▍ | 31860/37963 [72:22:21<13:50:52,  8.17s/it]
 84%|████████▍ | 31861/37963 [72:22:29<13:38:40,  8.05s/it]
 84%|████████▍ | 31862/37963 [72:22:37<13:25:04,  7.92s/it]
 84%|████████▍ | 31863/37963 [72:22:45<13:19:16,  7.86s/it]
 84%|████████▍ | 31864/37963 [72:22:52<13:14:56,  7.82s/it]
 84%|████████▍ | 31865/37963 [72:23:00<13:09:32,  7.77s/it]
 84%|████████▍ | 31866/37963 [72:23:08<13:15:44,  7.83s/it]
 84%|████████▍ | 31867/37963 [72:23:15<13:05:58,  7.74s/it]
 84%|████████▍ | 31868/37963 [72:23:26<14:35:09,  8.62s/it]
 84%|████████▍ | 31869/37963 [72:23:34<14:03:07,  8.30s/it]
 84%|████████▍ | 31870/37963 [72:23:41<13:45:31,  8.13s/it]
                                                           
{'loss': '0.1034', 'grad_norm': '3.947', 'learning_rate': '1.321e-06', 'epoch': '0.8395'}
+
 84%|████████▍ | 31870/37963 [72:23:41<13:45:31,  8.13s/it]
 84%|████████▍ | 31871/37963 [72:23:49<13:34:27,  8.02s/it]
 84%|████████▍ | 31872/37963 [72:23:57<13:30:32,  7.98s/it]
 84%|████████▍ | 31873/37963 [72:24:10<15:53:12,  9.39s/it]
 84%|████████▍ | 31874/37963 [72:24:18<15:05:14,  8.92s/it]
 84%|████████▍ | 31875/37963 [72:24:26<14:37:06,  8.64s/it]
 84%|████████▍ | 31876/37963 [72:24:33<14:15:43,  8.43s/it]
 84%|████████▍ | 31877/37963 [72:24:41<13:58:23,  8.27s/it]
 84%|████████▍ | 31878/37963 [72:24:52<14:59:49,  8.87s/it]
 84%|████████▍ | 31879/37963 [72:24:59<14:20:40,  8.49s/it]
 84%|████████▍ | 31880/37963 [72:25:07<13:53:41,  8.22s/it]
                                                           
{'loss': '0.1049', 'grad_norm': '2.57', 'learning_rate': '1.317e-06', 'epoch': '0.8398'}
+
 84%|████████▍ | 31880/37963 [72:25:07<13:53:41,  8.22s/it]
 84%|████████▍ | 31881/37963 [72:25:15<13:39:48,  8.09s/it]
 84%|████████▍ | 31882/37963 [72:25:22<13:24:35,  7.94s/it]
 84%|████████▍ | 31883/37963 [72:25:30<13:14:54,  7.84s/it]
 84%|████████▍ | 31884/37963 [72:25:40<14:25:19,  8.54s/it]
 84%|████████▍ | 31885/37963 [72:25:47<13:52:54,  8.22s/it]
 84%|████████▍ | 31886/37963 [72:25:55<13:36:11,  8.06s/it]
 84%|████████▍ | 31887/37963 [72:26:03<13:27:30,  7.97s/it]
 84%|████████▍ | 31888/37963 [72:26:11<13:18:49,  7.89s/it]
 84%|████████▍ | 31889/37963 [72:26:18<13:15:02,  7.85s/it]
 84%|████████▍ | 31890/37963 [72:26:26<13:08:54,  7.79s/it]
                                                           
{'loss': '0.1019', 'grad_norm': '3.64', 'learning_rate': '1.313e-06', 'epoch': '0.84'}
+
 84%|████████▍ | 31890/37963 [72:26:26<13:08:54,  7.79s/it]
 84%|████████▍ | 31891/37963 [72:26:34<13:10:51,  7.81s/it]
 84%|████████▍ | 31892/37963 [72:26:44<14:26:44,  8.57s/it]
 84%|████████▍ | 31893/37963 [72:26:52<13:57:55,  8.28s/it]
 84%|████████▍ | 31894/37963 [72:26:59<13:37:54,  8.09s/it]
 84%|████████▍ | 31895/37963 [72:27:07<13:25:46,  7.97s/it]
 84%|████████▍ | 31896/37963 [72:27:15<13:24:33,  7.96s/it]
 84%|████████▍ | 31897/37963 [72:27:23<13:10:20,  7.82s/it]
 84%|████████▍ | 31898/37963 [72:27:30<13:08:04,  7.80s/it]
 84%|████████▍ | 31899/37963 [72:27:38<13:07:59,  7.80s/it]
 84%|████████▍ | 31900/37963 [72:27:46<12:59:17,  7.71s/it]
                                                           
{'loss': '0.1023', 'grad_norm': '4.308', 'learning_rate': '1.309e-06', 'epoch': '0.8403'}
+
 84%|████████▍ | 31900/37963 [72:27:46<12:59:17,  7.71s/it]
 84%|████████▍ | 31901/37963 [72:27:53<12:48:46,  7.61s/it]
 84%|████████▍ | 31902/37963 [72:28:01<12:58:40,  7.71s/it]
 84%|████████▍ | 31903/37963 [72:28:09<12:58:04,  7.70s/it]
 84%|████████▍ | 31904/37963 [72:28:17<13:03:56,  7.76s/it]
 84%|████████▍ | 31905/37963 [72:28:24<12:55:51,  7.68s/it]
 84%|████████▍ | 31906/37963 [72:28:32<12:54:43,  7.67s/it]
 84%|████████▍ | 31907/37963 [72:28:42<14:07:46,  8.40s/it]
 84%|████████▍ | 31908/37963 [72:28:50<13:53:52,  8.26s/it]
 84%|████████▍ | 31909/37963 [72:28:57<13:38:43,  8.11s/it]
 84%|████████▍ | 31910/37963 [72:29:08<14:44:51,  8.77s/it]
                                                           
{'loss': '0.09298', 'grad_norm': '2.796', 'learning_rate': '1.304e-06', 'epoch': '0.8406'}
+
 84%|████████▍ | 31910/37963 [72:29:08<14:44:51,  8.77s/it]
 84%|████████▍ | 31911/37963 [72:29:18<15:24:13,  9.16s/it]
 84%|████████▍ | 31912/37963 [72:29:25<14:37:21,  8.70s/it]
 84%|████████▍ | 31913/37963 [72:29:33<13:59:28,  8.33s/it]
 84%|████████▍ | 31914/37963 [72:29:41<13:42:42,  8.16s/it]
 84%|████████▍ | 31915/37963 [72:29:49<13:32:17,  8.06s/it]
 84%|████████▍ | 31916/37963 [72:29:56<13:24:19,  7.98s/it]
 84%|████████▍ | 31917/37963 [72:30:04<13:16:54,  7.91s/it]
 84%|████████▍ | 31918/37963 [72:30:12<13:12:21,  7.86s/it]
 84%|████████▍ | 31919/37963 [72:30:20<13:14:00,  7.88s/it]
 84%|████████▍ | 31920/37963 [72:30:30<14:16:34,  8.50s/it]
                                                           
{'loss': '0.09724', 'grad_norm': '2.307', 'learning_rate': '1.3e-06', 'epoch': '0.8408'}
+
 84%|████████▍ | 31920/37963 [72:30:30<14:16:34,  8.50s/it]
 84%|████████▍ | 31921/37963 [72:30:40<15:16:43,  9.10s/it]
 84%|████████▍ | 31922/37963 [72:30:48<14:37:05,  8.71s/it]
 84%|████████▍ | 31923/37963 [72:30:56<14:09:02,  8.43s/it]
 84%|████████▍ | 31924/37963 [72:31:03<13:44:19,  8.19s/it]
 84%|████████▍ | 31925/37963 [72:31:11<13:39:09,  8.14s/it]
 84%|████████▍ | 31926/37963 [72:31:19<13:11:15,  7.86s/it]
 84%|████████▍ | 31927/37963 [72:31:29<14:25:14,  8.60s/it]
 84%|████████▍ | 31928/37963 [72:31:40<15:27:29,  9.22s/it]
 84%|████████▍ | 31929/37963 [72:31:48<14:46:34,  8.82s/it]
 84%|████████▍ | 31930/37963 [72:31:55<14:16:31,  8.52s/it]
                                                           
{'loss': '0.1011', 'grad_norm': '2.293', 'learning_rate': '1.296e-06', 'epoch': '0.8411'}
+
 84%|████████▍ | 31930/37963 [72:31:55<14:16:31,  8.52s/it]
 84%|████████▍ | 31931/37963 [72:32:03<13:50:31,  8.26s/it]
 84%|████████▍ | 31932/37963 [72:32:11<13:34:06,  8.10s/it]
 84%|████████▍ | 31933/37963 [72:32:19<13:30:17,  8.06s/it]
 84%|████████▍ | 31934/37963 [72:32:26<13:18:52,  7.95s/it]
 84%|████████▍ | 31935/37963 [72:32:34<13:17:39,  7.94s/it]
 84%|████████▍ | 31936/37963 [72:32:42<13:02:58,  7.79s/it]
 84%|████████▍ | 31937/37963 [72:32:50<13:03:37,  7.80s/it]
 84%|████████▍ | 31938/37963 [72:32:57<13:01:05,  7.78s/it]
 84%|████████▍ | 31939/37963 [72:33:05<13:06:03,  7.83s/it]
 84%|████████▍ | 31940/37963 [72:33:16<14:24:24,  8.61s/it]
                                                           
{'loss': '0.08641', 'grad_norm': '2.348', 'learning_rate': '1.292e-06', 'epoch': '0.8413'}
+
 84%|████████▍ | 31940/37963 [72:33:16<14:24:24,  8.61s/it]
 84%|████████▍ | 31941/37963 [72:33:24<14:05:18,  8.42s/it]
 84%|████████▍ | 31942/37963 [72:33:31<13:41:53,  8.19s/it]
 84%|████████▍ | 31943/37963 [72:33:39<13:31:04,  8.08s/it]
 84%|████████▍ | 31944/37963 [72:33:47<13:13:13,  7.91s/it]
 84%|████████▍ | 31945/37963 [72:33:54<13:08:18,  7.86s/it]
 84%|████████▍ | 31946/37963 [72:34:02<13:08:10,  7.86s/it]
 84%|████████▍ | 31947/37963 [72:34:10<13:03:42,  7.82s/it]
 84%|████████▍ | 31948/37963 [72:34:18<12:56:07,  7.74s/it]
 84%|████████▍ | 31949/37963 [72:34:25<12:58:40,  7.77s/it]
 84%|████████▍ | 31950/37963 [72:34:36<14:14:10,  8.52s/it]
                                                           
{'loss': '0.1068', 'grad_norm': '2.538', 'learning_rate': '1.288e-06', 'epoch': '0.8416'}
+
 84%|████████▍ | 31950/37963 [72:34:36<14:14:10,  8.52s/it]
 84%|████████▍ | 31951/37963 [72:34:43<13:45:08,  8.23s/it]
 84%|████████▍ | 31952/37963 [72:34:51<13:36:42,  8.15s/it]
 84%|████████▍ | 31953/37963 [72:34:59<13:26:31,  8.05s/it]
 84%|████████▍ | 31954/37963 [72:35:09<14:38:14,  8.77s/it]
 84%|████████▍ | 31955/37963 [72:35:20<15:35:55,  9.35s/it]
 84%|████████▍ | 31956/37963 [72:35:28<14:47:20,  8.86s/it]
 84%|████████▍ | 31957/37963 [72:35:36<14:24:29,  8.64s/it]
 84%|████████▍ | 31958/37963 [72:35:44<13:57:02,  8.36s/it]
 84%|████████▍ | 31959/37963 [72:35:51<13:36:06,  8.16s/it]
 84%|████████▍ | 31960/37963 [72:35:59<13:24:02,  8.04s/it]
                                                           
{'loss': '0.1037', 'grad_norm': '3.075', 'learning_rate': '1.283e-06', 'epoch': '0.8419'}
+
 84%|████████▍ | 31960/37963 [72:35:59<13:24:02,  8.04s/it]
 84%|████████▍ | 31961/37963 [72:36:07<13:13:39,  7.93s/it]
 84%|████████▍ | 31962/37963 [72:36:14<12:57:16,  7.77s/it]
 84%|████████▍ | 31963/37963 [72:36:22<12:54:48,  7.75s/it]
 84%|████████▍ | 31964/37963 [72:36:30<13:05:59,  7.86s/it]
 84%|████████▍ | 31965/37963 [72:36:38<12:55:35,  7.76s/it]
 84%|████████▍ | 31966/37963 [72:36:45<12:45:29,  7.66s/it]
 84%|████████▍ | 31967/37963 [72:36:53<12:48:34,  7.69s/it]
 84%|████████▍ | 31968/37963 [72:37:01<12:51:46,  7.72s/it]
 84%|████████▍ | 31969/37963 [72:37:11<14:09:35,  8.50s/it]
 84%|████████▍ | 31970/37963 [72:37:21<14:58:35,  9.00s/it]
                                                           
{'loss': '0.1046', 'grad_norm': '3.581', 'learning_rate': '1.279e-06', 'epoch': '0.8421'}
+
 84%|████████▍ | 31970/37963 [72:37:21<14:58:35,  9.00s/it]
 84%|████████▍ | 31971/37963 [72:37:29<14:21:19,  8.62s/it]
 84%|████████▍ | 31972/37963 [72:37:36<13:48:09,  8.29s/it]
 84%|████████▍ | 31973/37963 [72:37:44<13:35:02,  8.16s/it]
 84%|████████▍ | 31974/37963 [72:37:51<13:07:57,  7.89s/it]
 84%|████████▍ | 31975/37963 [72:37:59<12:59:23,  7.81s/it]
 84%|████████▍ | 31976/37963 [72:38:12<15:32:36,  9.35s/it]
 84%|████████▍ | 31977/37963 [72:38:20<14:49:27,  8.92s/it]
 84%|████████▍ | 31978/37963 [72:38:27<14:09:01,  8.51s/it]
 84%|████████▍ | 31979/37963 [72:38:35<13:42:14,  8.24s/it]
 84%|████████▍ | 31980/37963 [72:38:43<13:23:57,  8.06s/it]
                                                           
{'loss': '0.09715', 'grad_norm': '2.534', 'learning_rate': '1.275e-06', 'epoch': '0.8424'}
+
 84%|████████▍ | 31980/37963 [72:38:43<13:23:57,  8.06s/it]
 84%|████████▍ | 31981/37963 [72:38:50<13:14:28,  7.97s/it]
 84%|████████▍ | 31982/37963 [72:38:58<13:00:21,  7.83s/it]
 84%|████████▍ | 31983/37963 [72:39:06<12:55:55,  7.79s/it]
 84%|████████▍ | 31984/37963 [72:39:16<14:16:08,  8.59s/it]
 84%|████████▍ | 31985/37963 [72:39:24<13:45:26,  8.28s/it]
 84%|████████▍ | 31986/37963 [72:39:31<13:28:29,  8.12s/it]
 84%|████████▍ | 31987/37963 [72:39:39<13:20:26,  8.04s/it]
 84%|████████▍ | 31988/37963 [72:39:47<13:05:59,  7.89s/it]
 84%|████████▍ | 31989/37963 [72:39:55<12:59:14,  7.83s/it]
 84%|████████▍ | 31990/37963 [72:40:02<12:59:47,  7.83s/it]
                                                           
{'loss': '0.09391', 'grad_norm': '3.194', 'learning_rate': '1.271e-06', 'epoch': '0.8427'}
+
 84%|████████▍ | 31990/37963 [72:40:02<12:59:47,  7.83s/it]
 84%|████████▍ | 31991/37963 [72:40:10<12:54:41,  7.78s/it]
 84%|████████▍ | 31992/37963 [72:40:18<12:46:51,  7.71s/it]
 84%|████████▍ | 31993/37963 [72:40:25<12:53:54,  7.78s/it]
 84%|████████▍ | 31994/37963 [72:40:33<12:37:03,  7.61s/it]
 84%|████████▍ | 31995/37963 [72:40:40<12:28:56,  7.53s/it]
 84%|████████▍ | 31996/37963 [72:40:48<12:34:46,  7.59s/it]
 84%|████████▍ | 31997/37963 [72:40:58<13:57:26,  8.42s/it]
 84%|████████▍ | 31998/37963 [72:41:06<13:34:36,  8.19s/it]
 84%|████████▍ | 31999/37963 [72:41:14<13:21:32,  8.06s/it]
 84%|████████▍ | 32000/37963 [72:41:21<13:10:33,  7.95s/it]
                                                           
{'loss': '0.09662', 'grad_norm': '3.123', 'learning_rate': '1.267e-06', 'epoch': '0.8429'}
+
 84%|████████▍ | 32000/37963 [72:41:21<13:10:33,  7.95s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.85s/it]
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.85s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 84%|████████▍ | 32001/37963 [72:42:22<39:09:09, 23.64s/it]
 84%|████████▍ | 32002/37963 [72:42:34<33:28:45, 20.22s/it]
 84%|████████▍ | 32003/37963 [72:42:44<28:40:31, 17.32s/it]
 84%|████████▍ | 32004/37963 [72:42:52<23:56:10, 14.46s/it]
 84%|████████▍ | 32005/37963 [72:43:00<20:33:49, 12.43s/it]
 84%|████████▍ | 32006/37963 [72:43:07<18:09:09, 10.97s/it]
 84%|████████▍ | 32007/37963 [72:43:15<16:29:20,  9.97s/it]
 84%|████████▍ | 32008/37963 [72:43:23<15:20:15,  9.27s/it]
 84%|████████▍ | 32009/37963 [72:43:30<14:33:03,  8.80s/it]
 84%|████████▍ | 32010/37963 [72:43:38<13:56:59,  8.44s/it]
                                                           
{'loss': '0.09741', 'grad_norm': '2.335', 'learning_rate': '1.263e-06', 'epoch': '0.8432'}
+
 84%|████████▍ | 32010/37963 [72:43:38<13:56:59,  8.44s/it]
 84%|████████▍ | 32011/37963 [72:43:46<13:34:19,  8.21s/it]
 84%|████████▍ | 32012/37963 [72:43:53<13:23:15,  8.10s/it]
 84%|████████▍ | 32013/37963 [72:44:01<13:12:43,  7.99s/it]
 84%|████████▍ | 32014/37963 [72:44:09<13:11:06,  7.98s/it]
 84%|████████▍ | 32015/37963 [72:44:17<13:00:04,  7.87s/it]
 84%|████████▍ | 32016/37963 [72:44:29<15:17:07,  9.25s/it]
 84%|████████▍ | 32017/37963 [72:44:37<14:30:53,  8.79s/it]
 84%|████████▍ | 32018/37963 [72:44:45<13:58:48,  8.47s/it]
 84%|████████▍ | 32019/37963 [72:44:52<13:38:21,  8.26s/it]
 84%|████████▍ | 32020/37963 [72:45:00<13:23:53,  8.12s/it]
                                                           
{'loss': '0.09554', 'grad_norm': '3.052', 'learning_rate': '1.258e-06', 'epoch': '0.8435'}
+
 84%|████████▍ | 32020/37963 [72:45:00<13:23:53,  8.12s/it]
 84%|████████▍ | 32021/37963 [72:45:08<13:11:52,  8.00s/it]
 84%|████████▍ | 32022/37963 [72:45:18<14:18:46,  8.67s/it]
 84%|████████▍ | 32023/37963 [72:45:26<13:52:50,  8.41s/it]
 84%|████████▍ | 32024/37963 [72:45:37<14:56:47,  9.06s/it]
 84%|████████▍ | 32025/37963 [72:45:44<14:17:20,  8.66s/it]
 84%|███���████▍ | 32026/37963 [72:45:52<13:52:37,  8.41s/it]
 84%|████████▍ | 32027/37963 [72:46:00<13:37:38,  8.26s/it]
 84%|████████▍ | 32028/37963 [72:46:08<13:22:43,  8.12s/it]
 84%|████████▍ | 32029/37963 [72:46:16<13:14:23,  8.03s/it]
 84%|████████▍ | 32030/37963 [72:46:24<13:12:50,  8.02s/it]
                                                           
{'loss': '0.1093', 'grad_norm': '2.473', 'learning_rate': '1.254e-06', 'epoch': '0.8437'}
+
 84%|████████▍ | 32030/37963 [72:46:24<13:12:50,  8.02s/it]
 84%|████████▍ | 32031/37963 [72:46:31<12:56:08,  7.85s/it]
 84%|████████▍ | 32032/37963 [72:46:39<12:49:57,  7.79s/it]
 84%|████████▍ | 32033/37963 [72:46:49<14:06:41,  8.57s/it]
 84%|████████▍ | 32034/37963 [72:46:57<13:42:22,  8.32s/it]
 84%|████████▍ | 32035/37963 [72:47:05<13:35:34,  8.25s/it]
 84%|████████▍ | 32036/37963 [72:47:13<13:19:00,  8.09s/it]
 84%|████████▍ | 32037/37963 [72:47:20<13:10:55,  8.01s/it]
 84%|████████▍ | 32038/37963 [72:47:28<13:05:10,  7.95s/it]
 84%|████████▍ | 32039/37963 [72:47:36<12:59:09,  7.89s/it]
 84%|████████▍ | 32040/37963 [72:47:44<12:53:12,  7.83s/it]
                                                           
{'loss': '0.09149', 'grad_norm': '3.48', 'learning_rate': '1.25e-06', 'epoch': '0.844'}
+
 84%|████████▍ | 32040/37963 [72:47:44<12:53:12,  7.83s/it]
 84%|████████▍ | 32041/37963 [72:47:51<12:46:53,  7.77s/it]
 84%|████████▍ | 32042/37963 [72:47:59<12:43:05,  7.73s/it]
 84%|████████▍ | 32043/37963 [72:48:07<12:38:50,  7.69s/it]
 84%|████████▍ | 32044/37963 [72:48:14<12:30:33,  7.61s/it]
 84%|████████▍ | 32045/37963 [72:48:24<13:47:37,  8.39s/it]
 84%|████████▍ | 32046/37963 [72:48:35<15:01:04,  9.14s/it]
 84%|████████▍ | 32047/37963 [72:48:46<15:45:42,  9.59s/it]
 84%|████████▍ | 32048/37963 [72:48:54<14:51:38,  9.04s/it]
 84%|████████▍ | 32049/37963 [72:49:01<14:00:48,  8.53s/it]
 84%|████████▍ | 32050/37963 [72:49:08<13:33:05,  8.25s/it]
                                                           
{'loss': '0.109', 'grad_norm': '3.408', 'learning_rate': '1.246e-06', 'epoch': '0.8442'}
+
 84%|████████▍ | 32050/37963 [72:49:08<13:33:05,  8.25s/it]
 84%|████████▍ | 32051/37963 [72:49:17<13:27:06,  8.19s/it]
 84%|████████▍ | 32052/37963 [72:49:24<13:10:51,  8.03s/it]
 84%|████████▍ | 32053/37963 [72:49:32<13:05:30,  7.97s/it]
 84%|████████▍ | 32054/37963 [72:49:40<13:02:49,  7.95s/it]
 84%|████████▍ | 32055/37963 [72:49:48<12:54:59,  7.87s/it]
 84%|████████▍ | 32056/37963 [72:49:55<12:49:00,  7.81s/it]
 84%|████████▍ | 32057/37963 [72:50:03<12:55:32,  7.88s/it]
 84%|████████▍ | 32058/37963 [72:50:11<12:53:26,  7.86s/it]
 84%|████████▍ | 32059/37963 [72:50:19<12:50:59,  7.84s/it]
 84%|████████▍ | 32060/37963 [72:50:27<12:51:59,  7.85s/it]
                                                           
{'loss': '0.09629', 'grad_norm': '3.075', 'learning_rate': '1.242e-06', 'epoch': '0.8445'}
+
 84%|████████▍ | 32060/37963 [72:50:27<12:51:59,  7.85s/it]
 84%|████████▍ | 32061/37963 [72:50:34<12:48:04,  7.81s/it]
 84%|████████▍ | 32062/37963 [72:50:42<12:47:19,  7.80s/it]
 84%|████████▍ | 32063/37963 [72:50:50<12:44:46,  7.78s/it]
 84%|████████▍ | 32064/37963 [72:50:58<12:41:37,  7.75s/it]
 84%|████████▍ | 32065/37963 [72:51:06<12:44:58,  7.78s/it]
 84%|████████▍ | 32066/37963 [72:51:16<14:06:11,  8.61s/it]
 84%|████████▍ | 32067/37963 [72:51:24<13:39:12,  8.34s/it]
 84%|████████▍ | 32068/37963 [72:51:34<14:36:19,  8.92s/it]
 84%|████████▍ | 32069/37963 [72:51:41<13:49:34,  8.45s/it]
 84%|████████▍ | 32070/37963 [72:51:54<15:50:43,  9.68s/it]
                                                           
{'loss': '0.1015', 'grad_norm': '2.884', 'learning_rate': '1.238e-06', 'epoch': '0.8448'}
+
 84%|████████▍ | 32070/37963 [72:51:54<15:50:43,  9.68s/it]
 84%|████████▍ | 32071/37963 [72:52:02<14:54:55,  9.11s/it]
 84%|████████▍ | 32072/37963 [72:52:09<14:10:42,  8.66s/it]
 84%|████████▍ | 32073/37963 [72:52:17<13:46:06,  8.42s/it]
 84%|████████▍ | 32074/37963 [72:52:25<13:21:20,  8.16s/it]
 84%|████████▍ | 32075/37963 [72:52:33<13:10:45,  8.06s/it]
 84%|████████▍ | 32076/37963 [72:52:40<12:59:53,  7.95s/it]
 84%|█���██████▍ | 32077/37963 [72:52:48<12:50:21,  7.85s/it]
 84%|████████▍ | 32078/37963 [72:52:56<12:46:44,  7.82s/it]
 85%|████████▍ | 32079/37963 [72:53:04<12:48:43,  7.84s/it]
 85%|████████▍ | 32080/37963 [72:53:11<12:51:20,  7.87s/it]
                                                           
{'loss': '0.09771', 'grad_norm': '2.966', 'learning_rate': '1.234e-06', 'epoch': '0.845'}
+
 85%|████████▍ | 32080/37963 [72:53:11<12:51:20,  7.87s/it]
 85%|████████▍ | 32081/37963 [72:53:19<12:49:43,  7.85s/it]
 85%|████████▍ | 32082/37963 [72:53:30<14:03:05,  8.60s/it]
 85%|████████▍ | 32083/37963 [72:53:37<13:34:30,  8.31s/it]
 85%|████████▍ | 32084/37963 [72:53:45<13:09:16,  8.06s/it]
 85%|████████▍ | 32085/37963 [72:53:53<13:01:56,  7.98s/it]
 85%|████████▍ | 32086/37963 [72:54:00<12:52:51,  7.89s/it]
 85%|████████▍ | 32087/37963 [72:54:08<12:49:40,  7.86s/it]
 85%|████████▍ | 32088/37963 [72:54:16<12:46:37,  7.83s/it]
 85%|████████▍ | 32089/37963 [72:54:26<14:03:02,  8.61s/it]
 85%|████████▍ | 32090/37963 [72:54:34<13:34:57,  8.33s/it]
                                                           
{'loss': '0.08548', 'grad_norm': '2.618', 'learning_rate': '1.23e-06', 'epoch': '0.8453'}
+
 85%|████████▍ | 32090/37963 [72:54:34<13:34:57,  8.33s/it]
 85%|████████▍ | 32091/37963 [72:54:42<13:20:15,  8.18s/it]
 85%|████████▍ | 32092/37963 [72:54:49<13:09:28,  8.07s/it]
 85%|████████▍ | 32093/37963 [72:55:00<14:09:44,  8.69s/it]
 85%|████████▍ | 32094/37963 [72:55:08<13:46:37,  8.45s/it]
 85%|████████▍ | 32095/37963 [72:55:15<13:22:59,  8.21s/it]
 85%|████████▍ | 32096/37963 [72:55:23<13:13:39,  8.12s/it]
 85%|████████▍ | 32097/37963 [72:55:30<12:51:35,  7.89s/it]
 85%|████████▍ | 32098/37963 [72:55:38<12:42:35,  7.80s/it]
 85%|████████▍ | 32099/37963 [72:55:46<12:44:22,  7.82s/it]
 85%|████████▍ | 32100/37963 [72:55:56<13:46:32,  8.46s/it]
                                                           
{'loss': '0.0867', 'grad_norm': '3.46', 'learning_rate': '1.226e-06', 'epoch': '0.8456'}
+
 85%|████████▍ | 32100/37963 [72:55:56<13:46:32,  8.46s/it]
 85%|████████▍ | 32101/37963 [72:56:04<13:31:27,  8.31s/it]
 85%|████████▍ | 32102/37963 [72:56:11<13:07:20,  8.06s/it]
 85%|████████▍ | 32103/37963 [72:56:19<12:58:25,  7.97s/it]
 85%|████████▍ | 32104/37963 [72:56:27<12:54:53,  7.94s/it]
 85%|████████▍ | 32105/37963 [72:56:35<12:46:59,  7.86s/it]
 85%|████████▍ | 32106/37963 [72:56:42<12:42:56,  7.82s/it]
 85%|████████▍ | 32107/37963 [72:56:50<12:35:44,  7.74s/it]
 85%|████████▍ | 32108/37963 [72:56:58<12:33:21,  7.72s/it]
 85%|████████▍ | 32109/37963 [72:57:05<12:33:32,  7.72s/it]
 85%|████████▍ | 32110/37963 [72:57:16<13:48:33,  8.49s/it]
                                                           
{'loss': '0.08993', 'grad_norm': '2.84', 'learning_rate': '1.221e-06', 'epoch': '0.8458'}
+
 85%|████████▍ | 32110/37963 [72:57:16<13:48:33,  8.49s/it]
 85%|████████▍ | 32111/37963 [72:57:26<14:43:46,  9.06s/it]
 85%|████████▍ | 32112/37963 [72:57:34<14:10:12,  8.72s/it]
 85%|████████▍ | 32113/37963 [72:57:41<13:35:30,  8.36s/it]
 85%|████████▍ | 32114/37963 [72:57:49<13:20:36,  8.21s/it]
 85%|████████▍ | 32115/37963 [72:57:56<12:52:54,  7.93s/it]
 85%|████████▍ | 32116/37963 [72:58:04<12:48:35,  7.89s/it]
 85%|████████▍ | 32117/37963 [72:58:12<12:47:30,  7.88s/it]
 85%|████████▍ | 32118/37963 [72:58:20<12:36:58,  7.77s/it]
 85%|████████▍ | 32119/37963 [72:58:27<12:29:18,  7.69s/it]
 85%|████████▍ | 32120/37963 [72:58:38<13:48:16,  8.51s/it]
                                                           
{'loss': '0.09588', 'grad_norm': '3.095', 'learning_rate': '1.217e-06', 'epoch': '0.8461'}
+
 85%|████████▍ | 32120/37963 [72:58:38<13:48:16,  8.51s/it]
 85%|████████▍ | 32121/37963 [72:58:45<13:24:31,  8.26s/it]
 85%|████████▍ | 32122/37963 [72:58:53<13:03:55,  8.05s/it]
 85%|████████▍ | 32123/37963 [72:59:01<12:56:27,  7.98s/it]
 85%|████████▍ | 32124/37963 [72:59:11<13:52:38,  8.56s/it]
 85%|████████▍ | 32125/37963 [72:59:21<14:43:49,  9.08s/it]
 85%|████████▍ | 32126/37963 [72:59:29<14:05:49,  8.69s/it]
 85%|████████▍ | 32127/37963 [72:59:37<13:44:35,  8.48s/it]
 85%|████████▍ | 32128/37963 [72:59:44<13:14:08,  8.17s/it]
 85%|████████▍ | 32129/37963 [72:59:52<12:55:20,  7.97s/it]
 85%|████████▍ | 32130/37963 [72:59:59<12:48:47,  7.91s/it]
                                                           
{'loss': '0.09526', 'grad_norm': '3.496', 'learning_rate': '1.213e-06', 'epoch': '0.8464'}
+
 85%|████████▍ | 32130/37963 [72:59:59<12:48:47,  7.91s/it]
 85%|████████▍ | 32131/37963 [73:00:07<12:55:19,  7.98s/it]
 85%|████████▍ | 32132/37963 [73:00:15<12:51:50,  7.94s/it]
 85%|████████▍ | 32133/37963 [73:00:26<14:10:23,  8.75s/it]
 85%|████████▍ | 32134/37963 [73:00:34<13:41:39,  8.46s/it]
 85%|████████▍ | 32135/37963 [73:00:42<13:23:31,  8.27s/it]
 85%|████████▍ | 32136/37963 [73:00:49<13:11:17,  8.15s/it]
 85%|████████▍ | 32137/37963 [73:00:57<12:57:14,  8.00s/it]
 85%|████████▍ | 32138/37963 [73:01:05<12:47:10,  7.90s/it]
 85%|████████▍ | 32139/37963 [73:01:13<12:47:00,  7.90s/it]
 85%|████████▍ | 32140/37963 [73:01:20<12:42:03,  7.85s/it]
                                                           
{'loss': '0.09488', 'grad_norm': '3.645', 'learning_rate': '1.209e-06', 'epoch': '0.8466'}
+
 85%|████████▍ | 32140/37963 [73:01:20<12:42:03,  7.85s/it]
 85%|████████▍ | 32141/37963 [73:01:28<12:37:24,  7.81s/it]
 85%|████████▍ | 32142/37963 [73:01:36<12:43:38,  7.87s/it]
 85%|████████▍ | 32143/37963 [73:01:44<12:40:49,  7.84s/it]
 85%|████████▍ | 32144/37963 [73:01:54<13:47:18,  8.53s/it]
 85%|████████▍ | 32145/37963 [73:02:02<13:29:41,  8.35s/it]
 85%|████████▍ | 32146/37963 [73:02:10<13:15:45,  8.21s/it]
 85%|████████▍ | 32147/37963 [73:02:18<13:01:17,  8.06s/it]
 85%|████████▍ | 32148/37963 [73:02:25<12:50:56,  7.95s/it]
 85%|████████▍ | 32149/37963 [73:02:33<12:43:45,  7.88s/it]
 85%|████████▍ | 32150/37963 [73:02:41<12:40:07,  7.85s/it]
                                                           
{'loss': '0.09604', 'grad_norm': '3.277', 'learning_rate': '1.205e-06', 'epoch': '0.8469'}
+
 85%|████████▍ | 32150/37963 [73:02:41<12:40:07,  7.85s/it]
 85%|████████▍ | 32151/37963 [73:02:48<12:35:04,  7.80s/it]
 85%|████████▍ | 32152/37963 [73:02:56<12:34:07,  7.79s/it]
 85%|████████▍ | 32153/37963 [73:03:07<13:50:39,  8.58s/it]
 85%|████████▍ | 32154/37963 [73:03:17<14:55:21,  9.25s/it]
 85%|████████▍ | 32155/37963 [73:03:25<14:06:16,  8.74s/it]
 85%|████████▍ | 32156/37963 [73:03:33<13:44:56,  8.52s/it]
 85%|████████▍ | 32157/37963 [73:03:41<13:17:08,  8.24s/it]
 85%|████████▍ | 32158/37963 [73:03:48<13:03:20,  8.10s/it]
 85%|████████▍ | 32159/37963 [73:03:56<12:50:05,  7.96s/it]
 85%|████████▍ | 32160/37963 [73:04:06<13:58:36,  8.67s/it]
                                                           
{'loss': '0.09288', 'grad_norm': '3.111', 'learning_rate': '1.201e-06', 'epoch': '0.8471'}
+
 85%|████████▍ | 32160/37963 [73:04:06<13:58:36,  8.67s/it]
 85%|████████▍ | 32161/37963 [73:04:14<13:34:47,  8.43s/it]
 85%|████████▍ | 32162/37963 [73:04:22<13:21:01,  8.28s/it]
 85%|████████▍ | 32163/37963 [73:04:30<13:04:26,  8.11s/it]
 85%|████████▍ | 32164/37963 [73:04:38<12:51:39,  7.98s/it]
 85%|████████▍ | 32165/37963 [73:04:45<12:48:20,  7.95s/it]
 85%|████████▍ | 32166/37963 [73:04:53<12:43:29,  7.90s/it]
 85%|████████▍ | 32167/37963 [73:05:01<12:35:56,  7.83s/it]
 85%|████████▍ | 32168/37963 [73:05:11<13:48:07,  8.57s/it]
 85%|████████▍ | 32169/37963 [73:05:22<14:49:16,  9.21s/it]
 85%|████████▍ | 32170/37963 [73:05:30<14:06:13,  8.76s/it]
                                                           
{'loss': '0.1033', 'grad_norm': '2.688', 'learning_rate': '1.197e-06', 'epoch': '0.8474'}
+
 85%|████████▍ | 32170/37963 [73:05:30<14:06:13,  8.76s/it]
 85%|████████▍ | 32171/37963 [73:05:37<13:34:15,  8.44s/it]
 85%|████████▍ | 32172/37963 [73:05:45<13:17:05,  8.26s/it]
 85%|████████▍ | 32173/37963 [73:05:53<13:01:24,  8.10s/it]
 85%|████████▍ | 32174/37963 [73:06:00<12:47:16,  7.95s/it]
 85%|████████▍ | 32175/37963 [73:06:08<12:37:49,  7.86s/it]
 85%|████████▍ | 32176/37963 [73:06:19<13:57:35,  8.68s/it]
 85%|████████▍ | 32177/37963 [73:06:27<13:35:00,  8.45s/it]
 85%|████████▍ | 32178/37963 [73:06:37<14:30:46,  9.03s/it]
 85%|████████▍ | 32179/37963 [73:06:45<13:57:07,  8.68s/it]
 85%|████████▍ | 32180/37963 [73:06:53<13:33:56,  8.44s/it]
                                                           
{'loss': '0.0984', 'grad_norm': '3.162', 'learning_rate': '1.193e-06', 'epoch': '0.8477'}
+
 85%|████████▍ | 32180/37963 [73:06:53<13:33:56,  8.44s/it]
 85%|████████▍ | 32181/37963 [73:07:00<13:12:35,  8.22s/it]
 85%|████████▍ | 32182/37963 [73:07:08<13:04:06,  8.14s/it]
 85%|████████▍ | 32183/37963 [73:07:16<12:47:28,  7.97s/it]
 85%|████████▍ | 32184/37963 [73:07:24<12:43:39,  7.93s/it]
 85%|████████▍ | 32185/37963 [73:07:32<12:39:45,  7.89s/it]
 85%|████████▍ | 32186/37963 [73:07:39<12:31:19,  7.80s/it]
 85%|████████▍ | 32187/37963 [73:07:47<12:38:14,  7.88s/it]
 85%|████████▍ | 32188/37963 [73:07:57<13:46:10,  8.58s/it]
 85%|████████▍ | 32189/37963 [73:08:05<13:22:06,  8.33s/it]
 85%|████████▍ | 32190/37963 [73:08:13<13:01:38,  8.12s/it]
                                                           
{'loss': '0.1026', 'grad_norm': '2.299', 'learning_rate': '1.189e-06', 'epoch': '0.8479'}
+
 85%|████████▍ | 32190/37963 [73:08:13<13:01:38,  8.12s/it]
 85%|████████▍ | 32191/37963 [73:08:21<12:52:41,  8.03s/it]
 85%|████████▍ | 32192/37963 [73:08:28<12:41:58,  7.92s/it]
 85%|████████▍ | 32193/37963 [73:08:36<12:32:13,  7.82s/it]
 85%|████████▍ | 32194/37963 [73:08:44<12:26:50,  7.77s/it]
 85%|████████▍ | 32195/37963 [73:08:51<12:21:40,  7.72s/it]
 85%|████████▍ | 32196/37963 [73:08:59<12:15:31,  7.65s/it]
 85%|████████▍ | 32197/37963 [73:09:06<12:10:43,  7.60s/it]
 85%|████████▍ | 32198/37963 [73:09:14<12:10:30,  7.60s/it]
 85%|████████▍ | 32199/37963 [73:09:21<12:04:34,  7.54s/it]
 85%|████████▍ | 32200/37963 [73:09:29<12:06:18,  7.56s/it]
                                                           
{'loss': '0.08762', 'grad_norm': '2.165', 'learning_rate': '1.185e-06', 'epoch': '0.8482'}
+
 85%|████████▍ | 32200/37963 [73:09:29<12:06:18,  7.56s/it]
 85%|████████▍ | 32201/37963 [73:09:39<13:23:05,  8.36s/it]
 85%|████████▍ | 32202/37963 [73:09:49<14:12:14,  8.88s/it]
 85%|████████▍ | 32203/37963 [73:09:57<13:46:30,  8.61s/it]
 85%|████████▍ | 32204/37963 [73:10:05<13:16:57,  8.30s/it]
 85%|████████▍ | 32205/37963 [73:10:12<12:58:18,  8.11s/it]
 85%|████████▍ | 32206/37963 [73:10:20<12:39:49,  7.92s/it]
 85%|████████▍ | 32207/37963 [73:10:27<12:30:28,  7.82s/it]
 85%|████████▍ | 32208/37963 [73:10:38<13:44:05,  8.59s/it]
 85%|████████▍ | 32209/37963 [73:10:46<13:21:39,  8.36s/it]
 85%|████████▍ | 32210/37963 [73:10:53<13:01:19,  8.15s/it]
                                                           
{'loss': '0.09567', 'grad_norm': '2.318', 'learning_rate': '1.181e-06', 'epoch': '0.8485'}
+
 85%|████████▍ | 32210/37963 [73:10:53<13:01:19,  8.15s/it]
 85%|████████▍ | 32211/37963 [73:11:01<12:42:54,  7.96s/it]
 85%|████████▍ | 32212/37963 [73:11:08<12:34:09,  7.87s/it]
 85%|████████▍ | 32213/37963 [73:11:19<13:41:38,  8.57s/it]
 85%|████████▍ | 32214/37963 [73:11:26<13:17:39,  8.32s/it]
 85%|████████▍ | 32215/37963 [73:11:34<13:02:05,  8.16s/it]
 85%|████████▍ | 32216/37963 [73:11:45<14:11:01,  8.88s/it]
 85%|████████▍ | 32217/37963 [73:11:52<13:36:28,  8.53s/it]
 85%|████████▍ | 32218/37963 [73:12:00<13:10:09,  8.25s/it]
 85%|████████▍ | 32219/37963 [73:12:08<12:52:26,  8.07s/it]
 85%|████████▍ | 32220/37963 [73:12:15<12:40:43,  7.95s/it]
                                                           
{'loss': '0.1021', 'grad_norm': '2.564', 'learning_rate': '1.177e-06', 'epoch': '0.8487'}
+
 85%|████████▍ | 32220/37963 [73:12:15<12:40:43,  7.95s/it]
 85%|████████▍ | 32221/37963 [73:12:23<12:33:03,  7.87s/it]
 85%|████████▍ | 32222/37963 [73:12:31<12:28:51,  7.83s/it]
 85%|████████▍ | 32223/37963 [73:12:39<12:38:13,  7.93s/it]
 85%|████████▍ | 32224/37963 [73:12:47<12:33:07,  7.87s/it]
 85%|████████▍ | 32225/37963 [73:12:55<12:39:35,  7.94s/it]
 85%|████████▍ | 32226/37963 [73:13:02<12:24:10,  7.78s/it]
 85%|████████▍ | 32227/37963 [73:13:10<12:15:13,  7.69s/it]
 85%|████████▍ | 32228/37963 [73:13:17<12:13:41,  7.68s/it]
 85%|████████▍ | 32229/37963 [73:13:25<12:13:20,  7.67s/it]
 85%|████████▍ | 32230/37963 [73:13:33<12:15:49,  7.70s/it]
                                                           
{'loss': '0.09999', 'grad_norm': '2.777', 'learning_rate': '1.173e-06', 'epoch': '0.849'}
+
 85%|████████▍ | 32230/37963 [73:13:33<12:15:49,  7.70s/it]
 85%|████████▍ | 32231/37963 [73:13:43<13:42:22,  8.61s/it]
 85%|████████▍ | 32232/37963 [73:13:54<14:33:12,  9.14s/it]
 85%|████████▍ | 32233/37963 [73:14:01<13:50:38,  8.70s/it]
 85%|████████▍ | 32234/37963 [73:14:09<13:26:37,  8.45s/it]
 85%|████████▍ | 32235/37963 [73:14:17<13:00:19,  8.17s/it]
 85%|████████▍ | 32236/37963 [73:14:27<14:02:06,  8.82s/it]
 85%|████████▍ | 32237/37963 [73:14:35<13:29:27,  8.48s/it]
 85%|████████▍ | 32238/37963 [73:14:43<13:07:16,  8.25s/it]
 85%|████████▍ | 32239/37963 [73:14:50<12:49:35,  8.07s/it]
 85%|████████▍ | 32240/37963 [73:14:58<12:36:57,  7.94s/it]
                                                           
{'loss': '0.1009', 'grad_norm': '2.777', 'learning_rate': '1.169e-06', 'epoch': '0.8493'}
+
 85%|████████▍ | 32240/37963 [73:14:58<12:36:57,  7.94s/it]
 85%|████████▍ | 32241/37963 [73:15:06<12:27:47,  7.84s/it]
 85%|████████▍ | 32242/37963 [73:15:13<12:30:38,  7.87s/it]
 85%|████████▍ | 32243/37963 [73:15:21<12:27:28,  7.84s/it]
 85%|████████▍ | 32244/37963 [73:15:29<12:25:54,  7.83s/it]
 85%|████████▍ | 32245/37963 [73:15:40<13:43:42,  8.64s/it]
 85%|████████▍ | 32246/37963 [73:15:47<13:10:51,  8.30s/it]
 85%|████████▍ | 32247/37963 [73:15:55<12:59:00,  8.18s/it]
 85%|████████▍ | 32248/37963 [73:16:02<12:37:06,  7.95s/it]
 85%|████████▍ | 32249/37963 [73:16:10<12:28:56,  7.86s/it]
 85%|████████▍ | 32250/37963 [73:16:18<12:22:12,  7.80s/it]
                                                           
{'loss': '0.08827', 'grad_norm': '3.075', 'learning_rate': '1.165e-06', 'epoch': '0.8495'}
+
 85%|████████▍ | 32250/37963 [73:16:18<12:22:12,  7.80s/it]
 85%|████████▍ | 32251/37963 [73:16:31<15:00:02,  9.45s/it]
 85%|████████▍ | 32252/37963 [73:16:38<14:04:03,  8.87s/it]
 85%|████████▍ | 32253/37963 [73:16:46<13:26:50,  8.48s/it]
 85%|████████▍ | 32254/37963 [73:16:54<13:09:19,  8.30s/it]
 85%|████████▍ | 32255/37963 [73:17:02<12:49:42,  8.09s/it]
 85%|████████▍ | 32256/37963 [73:17:09<12:33:07,  7.92s/it]
 85%|████████▍ | 32257/37963 [73:17:19<13:40:45,  8.63s/it]
 85%|████████▍ | 32258/37963 [73:17:27<13:18:00,  8.39s/it]
 85%|████████▍ | 32259/37963 [73:17:35<12:57:33,  8.18s/it]
 85%|████████▍ | 32260/37963 [73:17:43<12:44:33,  8.04s/it]
                                                           
{'loss': '0.09238', 'grad_norm': '3.749', 'learning_rate': '1.161e-06', 'epoch': '0.8498'}
+
 85%|████████▍ | 32260/37963 [73:17:43<12:44:33,  8.04s/it]
 85%|████████▍ | 32261/37963 [73:17:50<12:37:52,  7.97s/it]
 85%|████████▍ | 32262/37963 [73:17:58<12:32:03,  7.92s/it]
 85%|████████▍ | 32263/37963 [73:18:06<12:25:51,  7.85s/it]
 85%|████████▍ | 32264/37963 [73:18:13<12:18:59,  7.78s/it]
 85%|████████▍ | 32265/37963 [73:18:21<12:10:00,  7.69s/it]
 85%|████████▍ | 32266/37963 [73:18:29<12:05:40,  7.64s/it]
 85%|████████▍ | 32267/37963 [73:18:36<12:04:03,  7.63s/it]
 85%|████████▍ | 32268/37963 [73:18:46<13:06:10,  8.28s/it]
 85%|████████▌ | 32269/37963 [73:18:54<12:48:28,  8.10s/it]
 85%|████████▌ | 32270/37963 [73:19:01<12:40:09,  8.01s/it]
                                                           
{'loss': '0.09785', 'grad_norm': '2.797', 'learning_rate': '1.157e-06', 'epoch': '0.85'}
+
 85%|████████▌ | 32270/37963 [73:19:01<12:40:09,  8.01s/it]
 85%|████████▌ | 32271/37963 [73:19:09<12:27:54,  7.88s/it]
 85%|████████▌ | 32272/37963 [73:19:17<12:33:37,  7.95s/it]
 85%|████████▌ | 32273/37963 [73:19:24<12:16:04,  7.76s/it]
 85%|████████▌ | 32274/37963 [73:19:32<12:20:27,  7.81s/it]
 85%|████████▌ | 32275/37963 [73:19:40<12:15:49,  7.76s/it]
 85%|████████▌ | 32276/37963 [73:19:48<12:12:32,  7.73s/it]
 85%|████████▌ | 32277/37963 [73:19:55<12:11:14,  7.72s/it]
 85%|████████▌ | 32278/37963 [73:20:03<12:18:50,  7.80s/it]
 85%|████████▌ | 32279/37963 [73:20:14<13:29:26,  8.54s/it]
 85%|████████▌ | 32280/37963 [73:20:22<13:13:08,  8.37s/it]
                                                           
{'loss': '0.09736', 'grad_norm': '2.745', 'learning_rate': '1.153e-06', 'epoch': '0.8503'}
+
 85%|████████▌ | 32280/37963 [73:20:22<13:13:08,  8.37s/it]
 85%|████████▌ | 32281/37963 [73:20:29<12:54:18,  8.18s/it]
 85%|████████▌ | 32282/37963 [73:20:37<12:51:14,  8.15s/it]
 85%|████████▌ | 32283/37963 [73:20:45<12:32:44,  7.95s/it]
 85%|████████▌ | 32284/37963 [73:20:53<12:34:17,  7.97s/it]
 85%|████████▌ | 32285/37963 [73:21:04<13:53:28,  8.81s/it]
 85%|████████▌ | 32286/37963 [73:21:14<14:42:04,  9.32s/it]
 85%|████████▌ | 32287/37963 [73:21:22<14:00:05,  8.88s/it]
 85%|████████▌ | 32288/37963 [73:21:29<13:18:56,  8.45s/it]
 85%|████████▌ | 32289/37963 [73:21:37<12:56:28,  8.21s/it]
 85%|████████▌ | 32290/37963 [73:21:45<12:41:00,  8.05s/it]
                                                           
{'loss': '0.09503', 'grad_norm': '2.203', 'learning_rate': '1.149e-06', 'epoch': '0.8506'}
+
 85%|████████▌ | 32290/37963 [73:21:45<12:41:00,  8.05s/it]
 85%|████████▌ | 32291/37963 [73:21:52<12:28:33,  7.92s/it]
 85%|████████▌ | 32292/37963 [73:22:00<12:22:35,  7.86s/it]
 85%|████████▌ | 32293/37963 [73:22:08<12:20:26,  7.84s/it]
 85%|████████▌ | 32294/37963 [73:22:15<12:13:12,  7.76s/it]
 85%|████████▌ | 32295/37963 [73:22:26<13:26:53,  8.54s/it]
 85%|████████▌ | 32296/37963 [73:22:34<13:03:19,  8.29s/it]
 85%|████████▌ | 32297/37963 [73:22:41<12:46:50,  8.12s/it]
 85%|████████▌ | 32298/37963 [73:22:49<12:38:18,  8.03s/it]
 85%|████████▌ | 32299/37963 [73:23:02<15:03:18,  9.57s/it]
 85%|████████▌ | 32300/37963 [73:23:13<15:33:47,  9.89s/it]
                                                           
{'loss': '0.08984', 'grad_norm': '2.488', 'learning_rate': '1.145e-06', 'epoch': '0.8508'}
+
 85%|████████▌ | 32300/37963 [73:23:13<15:33:47,  9.89s/it]
 85%|████████▌ | 32301/37963 [73:23:20<14:18:43,  9.10s/it]
 85%|████████▌ | 32302/37963 [73:23:28<13:40:20,  8.69s/it]
 85%|████████▌ | 32303/37963 [73:23:35<13:08:09,  8.35s/it]
 85%|████████▌ | 32304/37963 [73:23:43<12:45:30,  8.12s/it]
 85%|████████▌ | 32305/37963 [73:23:51<12:32:41,  7.98s/it]
 85%|████████▌ | 32306/37963 [73:23:59<12:30:10,  7.96s/it]
 85%|████████▌ | 32307/37963 [73:24:06<12:23:09,  7.88s/it]
 85%|████████▌ | 32308/37963 [73:24:14<12:15:46,  7.81s/it]
 85%|████████▌ | 32309/37963 [73:24:22<12:13:44,  7.79s/it]
 85%|████████▌ | 32310/37963 [73:24:30<12:19:41,  7.85s/it]
                                                           
{'loss': '0.09559', 'grad_norm': '2.953', 'learning_rate': '1.141e-06', 'epoch': '0.8511'}
+
 85%|████████▌ | 32310/37963 [73:24:30<12:19:41,  7.85s/it]
 85%|████████▌ | 32311/37963 [73:24:37<12:18:46,  7.84s/it]
 85%|████████▌ | 32312/37963 [73:24:45<12:14:16,  7.80s/it]
 85%|████████▌ | 32313/37963 [73:24:55<13:21:22,  8.51s/it]
 85%|████████▌ | 32314/37963 [73:25:03<13:00:37,  8.29s/it]
 85%|████████▌ | 32315/37963 [73:25:11<12:42:10,  8.10s/it]
 85%|████████▌ | 32316/37963 [73:25:18<12:26:28,  7.93s/it]
 85%|████████▌ | 32317/37963 [73:25:26<12:23:42,  7.90s/it]
 85%|████████▌ | 32318/37963 [73:25:34<12:21:14,  7.88s/it]
 85%|████████▌ | 32319/37963 [73:25:42<12:19:42,  7.86s/it]
 85%|████████▌ | 32320/37963 [73:25:50<12:19:42,  7.86s/it]
                                                           
{'loss': '0.0906', 'grad_norm': '4.251', 'learning_rate': '1.137e-06', 'epoch': '0.8514'}
+
 85%|████████▌ | 32320/37963 [73:25:50<12:19:42,  7.86s/it]
 85%|████████▌ | 32321/37963 [73:25:57<12:13:22,  7.80s/it]
 85%|████████▌ | 32322/37963 [73:26:05<12:14:22,  7.81s/it]
 85%|████████▌ | 32323/37963 [73:26:13<12:16:07,  7.83s/it]
 85%|████████▌ | 32324/37963 [73:26:21<12:10:25,  7.77s/it]
 85%|████████▌ | 32325/37963 [73:26:31<13:21:28,  8.53s/it]
 85%|████████▌ | 32326/37963 [73:26:39<13:02:24,  8.33s/it]
 85%|████████▌ | 32327/37963 [73:26:47<12:46:46,  8.16s/it]
 85%|████████▌ | 32328/37963 [73:26:54<12:30:48,  7.99s/it]
 85%|████████▌ | 32329/37963 [73:27:02<12:24:47,  7.93s/it]
 85%|████████▌ | 32330/37963 [73:27:10<12:19:52,  7.88s/it]
                                                           
{'loss': '0.09206', 'grad_norm': '2.517', 'learning_rate': '1.133e-06', 'epoch': '0.8516'}
+
 85%|████████▌ | 32330/37963 [73:27:10<12:19:52,  7.88s/it]
 85%|████████▌ | 32331/37963 [73:27:17<12:15:01,  7.83s/it]
 85%|████████▌ | 32332/37963 [73:27:25<12:15:06,  7.83s/it]
 85%|████████▌ | 32333/37963 [73:27:33<12:13:13,  7.81s/it]
 85%|████████▌ | 32334/37963 [73:27:40<12:02:11,  7.70s/it]
 85%|████████▌ | 32335/37963 [73:27:48<11:51:31,  7.59s/it]
 85%|████████▌ | 32336/37963 [73:27:55<11:53:45,  7.61s/it]
 85%|████████▌ | 32337/37963 [73:28:03<12:00:01,  7.68s/it]
 85%|████████▌ | 32338/37963 [73:28:11<12:00:09,  7.68s/it]
 85%|████████▌ | 32339/37963 [73:28:22<13:26:57,  8.61s/it]
 85%|████████▌ | 32340/37963 [73:28:32<14:23:07,  9.21s/it]
                                                           
{'loss': '0.1027', 'grad_norm': '4.067', 'learning_rate': '1.129e-06', 'epoch': '0.8519'}
+
 85%|████████▌ | 32340/37963 [73:28:32<14:23:07,  9.21s/it]
 85%|████████▌ | 32341/37963 [73:28:40<13:41:09,  8.76s/it]
 85%|████████▌ | 32342/37963 [73:28:48<13:06:21,  8.39s/it]
 85%|████████▌ | 32343/37963 [73:28:59<14:32:28,  9.31s/it]
 85%|████████▌ | 32344/37963 [73:29:09<15:00:22,  9.61s/it]
 85%|████████▌ | 32345/37963 [73:29:17<14:07:40,  9.05s/it]
 85%|████████▌ | 32346/37963 [73:29:25<13:31:03,  8.66s/it]
 85%|████████▌ | 32347/37963 [73:29:35<14:16:34,  9.15s/it]
 85%|████████▌ | 32348/37963 [73:29:43<13:35:31,  8.71s/it]
 85%|████████▌ | 32349/37963 [73:29:51<13:05:36,  8.40s/it]
 85%|████████▌ | 32350/37963 [73:29:58<12:43:47,  8.16s/it]
                                                           
{'loss': '0.09468', 'grad_norm': '3.97', 'learning_rate': '1.125e-06', 'epoch': '0.8521'}
+
 85%|████████▌ | 32350/37963 [73:29:58<12:43:47,  8.16s/it]
 85%|████████▌ | 32351/37963 [73:30:06<12:30:54,  8.03s/it]
 85%|████████▌ | 32352/37963 [73:30:16<13:38:45,  8.76s/it]
 85%|████████▌ | 32353/37963 [73:30:24<13:10:07,  8.45s/it]
 85%|████████▌ | 32354/37963 [73:30:32<12:44:58,  8.18s/it]
 85%|████████▌ | 32355/37963 [73:30:39<12:30:05,  8.03s/it]
 85%|████████▌ | 32356/37963 [73:30:47<12:19:41,  7.92s/it]
 85%|████████▌ | 32357/37963 [73:30:55<12:16:19,  7.88s/it]
 85%|████████▌ | 32358/37963 [73:31:05<13:23:55,  8.61s/it]
 85%|████████▌ | 32359/37963 [73:31:13<13:01:54,  8.37s/it]
 85%|████████▌ | 32360/37963 [73:31:21<12:43:37,  8.18s/it]
                                                           
{'loss': '0.09569', 'grad_norm': '3.642', 'learning_rate': '1.121e-06', 'epoch': '0.8524'}
+
 85%|████████▌ | 32360/37963 [73:31:21<12:43:37,  8.18s/it]
 85%|████████▌ | 32361/37963 [73:31:28<12:31:56,  8.05s/it]
 85%|████████▌ | 32362/37963 [73:31:36<12:23:27,  7.96s/it]
 85%|████████▌ | 32363/37963 [73:31:44<12:14:25,  7.87s/it]
 85%|████████▌ | 32364/37963 [73:31:51<12:08:31,  7.81s/it]
 85%|████████▌ | 32365/37963 [73:31:59<12:12:03,  7.85s/it]
 85%|████████▌ | 32366/37963 [73:32:07<12:08:59,  7.81s/it]
 85%|████████▌ | 32367/37963 [73:32:15<12:02:46,  7.75s/it]
 85%|████████▌ | 32368/37963 [73:32:23<12:04:15,  7.77s/it]
 85%|████████▌ | 32369/37963 [73:32:30<12:04:24,  7.77s/it]
 85%|████████▌ | 32370/37963 [73:32:38<12:03:41,  7.76s/it]
                                                           
{'loss': '0.09182', 'grad_norm': '3.046', 'learning_rate': '1.117e-06', 'epoch': '0.8527'}
+
 85%|████████▌ | 32370/37963 [73:32:38<12:03:41,  7.76s/it]
 85%|████████▌ | 32371/37963 [73:32:45<11:49:41,  7.61s/it]
 85%|████████▌ | 32372/37963 [73:32:53<11:49:17,  7.61s/it]
 85%|████████▌ | 32373/37963 [73:33:01<11:51:58,  7.64s/it]
 85%|████████▌ | 32374/37963 [73:33:09<12:01:46,  7.75s/it]
 85%|████████▌ | 32375/37963 [73:33:17<12:05:34,  7.79s/it]
 85%|████████▌ | 32376/37963 [73:33:24<12:02:16,  7.76s/it]
 85%|████████▌ | 32377/37963 [73:33:34<13:04:45,  8.43s/it]
 85%|████████▌ | 32378/37963 [73:33:42<12:36:58,  8.13s/it]
 85%|████████▌ | 32379/37963 [73:33:49<12:26:42,  8.02s/it]
 85%|████████▌ | 32380/37963 [73:33:57<12:26:13,  8.02s/it]
                                                           
{'loss': '0.09767', 'grad_norm': '2.689', 'learning_rate': '1.113e-06', 'epoch': '0.8529'}
+
 85%|████████▌ | 32380/37963 [73:33:57<12:26:13,  8.02s/it]
 85%|████████▌ | 32381/37963 [73:34:05<12:12:27,  7.87s/it]
 85%|████████▌ | 32382/37963 [73:34:13<12:08:17,  7.83s/it]
 85%|████████▌ | 32383/37963 [73:34:23<13:27:16,  8.68s/it]
 85%|████████▌ | 32384/37963 [73:34:31<13:06:17,  8.46s/it]
 85%|████████▌ | 32385/37963 [73:34:39<12:47:55,  8.26s/it]
 85%|████████▌ | 32386/37963 [73:34:47<12:30:11,  8.07s/it]
 85%|████████▌ | 32387/37963 [73:34:57<13:40:14,  8.83s/it]
 85%|████████▌ | 32388/37963 [73:35:05<13:11:25,  8.52s/it]
 85%|████████▌ | 32389/37963 [73:35:13<12:48:14,  8.27s/it]
 85%|████████▌ | 32390/37963 [73:35:21<12:36:22,  8.14s/it]
                                                           
{'loss': '0.09306', 'grad_norm': '3.637', 'learning_rate': '1.11e-06', 'epoch': '0.8532'}
+
 85%|████████▌ | 32390/37963 [73:35:21<12:36:22,  8.14s/it]
 85%|████████▌ | 32391/37963 [73:35:31<13:50:28,  8.94s/it]
 85%|████████▌ | 32392/37963 [73:35:42<14:36:19,  9.44s/it]
 85%|████████▌ | 32393/37963 [73:35:50<13:51:42,  8.96s/it]
 85%|████████▌ | 32394/37963 [73:36:00<14:28:35,  9.36s/it]
 85%|████████▌ | 32395/37963 [73:36:08<13:40:42,  8.84s/it]
 85%|████████▌ | 32396/37963 [73:36:18<14:28:02,  9.36s/it]
 85%|████████▌ | 32397/37963 [73:36:26<13:32:27,  8.76s/it]
 85%|████████▌ | 32398/37963 [73:36:33<13:00:57,  8.42s/it]
 85%|████████▌ | 32399/37963 [73:36:41<12:32:49,  8.12s/it]
 85%|████████▌ | 32400/37963 [73:36:49<12:24:55,  8.03s/it]
                                                           
{'loss': '0.08391', 'grad_norm': '2.559', 'learning_rate': '1.106e-06', 'epoch': '0.8535'}
+
 85%|████████▌ | 32400/37963 [73:36:49<12:24:55,  8.03s/it]
 85%|████████▌ | 32401/37963 [73:36:57<12:25:07,  8.04s/it]
 85%|████████▌ | 32402/37963 [73:37:04<12:14:16,  7.92s/it]
 85%|████████▌ | 32403/37963 [73:37:12<12:09:29,  7.87s/it]
 85%|████████▌ | 32404/37963 [73:37:20<12:06:26,  7.84s/it]
 85%|████████▌ | 32405/37963 [73:37:28<12:03:04,  7.81s/it]
 85%|████████▌ | 32406/37963 [73:37:35<11:59:02,  7.76s/it]
 85%|████████▌ | 32407/37963 [73:37:43<11:59:24,  7.77s/it]
 85%|████████▌ | 32408/37963 [73:37:50<11:50:53,  7.68s/it]
 85%|████████▌ | 32409/37963 [73:37:58<11:49:26,  7.66s/it]
 85%|████████▌ | 32410/37963 [73:38:06<11:53:07,  7.71s/it]
                                                           
{'loss': '0.09328', 'grad_norm': '3.05', 'learning_rate': '1.102e-06', 'epoch': '0.8537'}
+
 85%|████████▌ | 32410/37963 [73:38:06<11:53:07,  7.71s/it]
 85%|████████▌ | 32411/37963 [73:38:16<13:07:16,  8.51s/it]
 85%|████████▌ | 32412/37963 [73:38:24<12:43:15,  8.25s/it]
 85%|████████▌ | 32413/37963 [73:38:32<12:35:37,  8.17s/it]
 85%|████████▌ | 32414/37963 [73:38:40<12:26:57,  8.08s/it]
 85%|████████▌ | 32415/37963 [73:38:47<12:11:51,  7.91s/it]
 85%|████████▌ | 32416/37963 [73:38:55<12:01:26,  7.80s/it]
 85%|████████▌ | 32417/37963 [73:39:03<12:05:40,  7.85s/it]
 85%|████████▌ | 32418/37963 [73:39:11<12:04:22,  7.84s/it]
 85%|████████▌ | 32419/37963 [73:39:18<12:03:08,  7.83s/it]
 85%|████████▌ | 32420/37963 [73:39:26<12:02:27,  7.82s/it]
                                                           
{'loss': '0.1005', 'grad_norm': '3.449', 'learning_rate': '1.098e-06', 'epoch': '0.854'}
+
 85%|████████▌ | 32420/37963 [73:39:26<12:02:27,  7.82s/it]
 85%|████████▌ | 32421/37963 [73:39:34<12:01:33,  7.81s/it]
 85%|████████▌ | 32422/37963 [73:39:42<11:59:08,  7.79s/it]
 85%|████████▌ | 32423/37963 [73:39:50<12:01:17,  7.81s/it]
 85%|████████▌ | 32424/37963 [73:39:57<11:57:31,  7.77s/it]
 85%|████████▌ | 32425/37963 [73:40:05<11:59:00,  7.79s/it]
 85%|████████▌ | 32426/37963 [73:40:18<14:24:10,  9.36s/it]
 85%|████████▌ | 32427/37963 [73:40:26<13:47:24,  8.97s/it]
 85%|████████▌ | 32428/37963 [73:40:34<13:13:57,  8.61s/it]
 85%|████████▌ | 32429/37963 [73:40:42<12:56:05,  8.41s/it]
 85%|████████▌ | 32430/37963 [73:40:50<12:37:50,  8.22s/it]
                                                           
{'loss': '0.09149', 'grad_norm': '2.748', 'learning_rate': '1.094e-06', 'epoch': '0.8543'}
+
 85%|████��███▌ | 32430/37963 [73:40:50<12:37:50,  8.22s/it]
 85%|████████▌ | 32431/37963 [73:40:57<12:23:44,  8.07s/it]
 85%|████████▌ | 32432/37963 [73:41:05<12:17:01,  8.00s/it]
 85%|████████▌ | 32433/37963 [73:41:13<12:01:05,  7.82s/it]
 85%|████████▌ | 32434/37963 [73:41:20<11:57:57,  7.79s/it]
 85%|████████▌ | 32435/37963 [73:41:28<11:55:34,  7.77s/it]
 85%|████████▌ | 32436/37963 [73:41:36<11:54:03,  7.75s/it]
 85%|████████▌ | 32437/37963 [73:41:46<13:04:02,  8.51s/it]
 85%|████████▌ | 32438/37963 [73:41:57<13:59:31,  9.12s/it]
 85%|████████▌ | 32439/37963 [73:42:05<13:28:11,  8.78s/it]
 85%|████████▌ | 32440/37963 [73:42:15<14:12:40,  9.26s/it]
                                                           
{'loss': '0.09877', 'grad_norm': '2.285', 'learning_rate': '1.09e-06', 'epoch': '0.8545'}
+
 85%|████████▌ | 32440/37963 [73:42:15<14:12:40,  9.26s/it]
 85%|████████▌ | 32441/37963 [73:42:25<14:45:37,  9.62s/it]
 85%|████████▌ | 32442/37963 [73:42:33<13:51:30,  9.04s/it]
 85%|████████▌ | 32443/37963 [73:42:41<13:11:09,  8.60s/it]
 85%|████████▌ | 32444/37963 [73:42:48<12:43:37,  8.30s/it]
 85%|████████▌ | 32445/37963 [73:42:56<12:28:20,  8.14s/it]
 85%|████████▌ | 32446/37963 [73:43:07<13:36:07,  8.88s/it]
 85%|████████▌ | 32447/37963 [73:43:15<13:09:12,  8.58s/it]
 85%|████████▌ | 32448/37963 [73:43:22<12:44:26,  8.32s/it]
 85%|████████▌ | 32449/37963 [73:43:30<12:29:44,  8.16s/it]
 85%|████████▌ | 32450/37963 [73:43:38<12:18:40,  8.04s/it]
                                                           
{'loss': '0.09332', 'grad_norm': '4.055', 'learning_rate': '1.086e-06', 'epoch': '0.8548'}
+
 85%|████████▌ | 32450/37963 [73:43:38<12:18:40,  8.04s/it]
 85%|████████▌ | 32451/37963 [73:43:46<12:12:57,  7.98s/it]
 85%|████████▌ | 32452/37963 [73:43:53<12:04:08,  7.88s/it]
 85%|████████▌ | 32453/37963 [73:44:01<11:55:40,  7.79s/it]
 85%|████████▌ | 32454/37963 [73:44:08<11:49:43,  7.73s/it]
 85%|████████▌ | 32455/37963 [73:44:16<11:41:48,  7.64s/it]
 85%|████████▌ | 32456/37963 [73:44:23<11:32:43,  7.55s/it]
 85%|████████▌ | 32457/37963 [73:44:31<11:35:02,  7.57s/it]
 85%|████████▌ | 32458/37963 [73:44:39<11:47:03,  7.71s/it]
 86%|████████▌ | 32459/37963 [73:44:47<11:50:35,  7.75s/it]
 86%|████████▌ | 32460/37963 [73:44:57<13:10:09,  8.62s/it]
                                                           
{'loss': '0.08858', 'grad_norm': '2.695', 'learning_rate': '1.082e-06', 'epoch': '0.855'}
+
 86%|████████▌ | 32460/37963 [73:44:57<13:10:09,  8.62s/it]
 86%|████████▌ | 32461/37963 [73:45:05<12:39:21,  8.28s/it]
 86%|████████▌ | 32462/37963 [73:45:13<12:27:58,  8.16s/it]
 86%|████████▌ | 32463/37963 [73:45:20<12:15:58,  8.03s/it]
 86%|████████▌ | 32464/37963 [73:45:28<12:07:18,  7.94s/it]
 86%|████████▌ | 32465/37963 [73:45:36<12:14:44,  8.02s/it]
 86%|████████▌ | 32466/37963 [73:45:44<12:04:27,  7.91s/it]
 86%|████████▌ | 32467/37963 [73:45:52<12:03:00,  7.89s/it]
 86%|████████▌ | 32468/37963 [73:46:00<12:00:39,  7.87s/it]
 86%|████████▌ | 32469/37963 [73:46:10<13:13:29,  8.67s/it]
 86%|████████▌ | 32470/37963 [73:46:21<14:08:00,  9.26s/it]
                                                           
{'loss': '0.1004', 'grad_norm': '3.89', 'learning_rate': '1.078e-06', 'epoch': '0.8553'}
+
 86%|████████▌ | 32470/37963 [73:46:21<14:08:00,  9.26s/it]
 86%|████████▌ | 32471/37963 [73:46:29<13:24:57,  8.79s/it]
 86%|████████▌ | 32472/37963 [73:46:36<12:56:19,  8.48s/it]
 86%|████████▌ | 32473/37963 [73:46:44<12:34:06,  8.24s/it]
 86%|████████▌ | 32474/37963 [73:46:52<12:21:05,  8.10s/it]
 86%|████████▌ | 32475/37963 [73:47:00<12:12:30,  8.01s/it]
 86%|████████▌ | 32476/37963 [73:47:08<12:11:25,  8.00s/it]
 86%|████████▌ | 32477/37963 [73:47:15<12:03:03,  7.91s/it]
 86%|████████▌ | 32478/37963 [73:47:23<11:59:12,  7.87s/it]
 86%|████████▌ | 32479/37963 [73:47:31<11:57:59,  7.86s/it]
 86%|████████▌ | 32480/37963 [73:47:39<11:55:29,  7.83s/it]
                                                           
{'loss': '0.1013', 'grad_norm': '4.755', 'learning_rate': '1.075e-06', 'epoch': '0.8556'}
+
 86%|████████▌ | 32480/37963 [73:47:39<11:55:29,  7.83s/it]
 86%|████████▌ | 32481/37963 [73:47:47<12:00:17,  7.88s/it]
 86%|████████▌ | 32482/37963 [73:47:57<13:04:38,  8.59s/it]
 86%|████████▌ | 32483/37963 [73:48:05<12:48:40,  8.42s/it]
 86%|████████▌ | 32484/37963 [73:48:15<13:40:23,  8.98s/it]
 86%|████████▌ | 32485/37963 [73:48:26<14:23:06,  9.45s/it]
 86%|████████▌ | 32486/37963 [73:48:34<13:39:58,  8.98s/it]
 86%|████████▌ | 32487/37963 [73:48:44<14:23:04,  9.46s/it]
 86%|████████▌ | 32488/37963 [73:48:52<13:36:28,  8.95s/it]
 86%|████████▌ | 32489/37963 [73:49:00<13:08:57,  8.65s/it]
 86%|████████▌ | 32490/37963 [73:49:08<12:40:50,  8.34s/it]
                                                           
{'loss': '0.1072', 'grad_norm': '2.805', 'learning_rate': '1.071e-06', 'epoch': '0.8558'}
+
 86%|████████▌ | 32490/37963 [73:49:08<12:40:50,  8.34s/it]
 86%|████████▌ | 32491/37963 [73:49:15<12:24:14,  8.16s/it]
 86%|████████▌ | 32492/37963 [73:49:23<12:10:54,  8.02s/it]
 86%|████████▌ | 32493/37963 [73:49:31<12:07:00,  7.97s/it]
 86%|████████▌ | 32494/37963 [73:49:39<12:11:01,  8.02s/it]
 86%|████████▌ | 32495/37963 [73:49:47<12:11:23,  8.03s/it]
 86%|████████▌ | 32496/37963 [73:49:55<12:11:11,  8.02s/it]
 86%|████████▌ | 32497/37963 [73:50:03<12:05:20,  7.96s/it]
 86%|████████▌ | 32498/37963 [73:50:11<11:58:44,  7.89s/it]
 86%|████████▌ | 32499/37963 [73:50:21<13:11:16,  8.69s/it]
 86%|████████▌ | 32500/37963 [73:50:29<12:45:43,  8.41s/it]
                                                           
{'loss': '0.09038', 'grad_norm': '2.962', 'learning_rate': '1.067e-06', 'epoch': '0.8561'}
+
 86%|████████▌ | 32500/37963 [73:50:29<12:45:43,  8.41s/it]
 86%|████████▌ | 32501/37963 [73:50:36<12:20:42,  8.14s/it]
 86%|████████▌ | 32502/37963 [73:50:44<12:08:15,  8.00s/it]
 86%|████████▌ | 32503/37963 [73:50:52<11:59:37,  7.91s/it]
 86%|████████▌ | 32504/37963 [73:51:02<13:08:09,  8.66s/it]
 86%|████████▌ | 32505/37963 [73:51:10<12:38:46,  8.34s/it]
 86%|████████▌ | 32506/37963 [73:51:17<12:13:32,  8.07s/it]
 86%|████████▌ | 32507/37963 [73:51:25<12:01:27,  7.93s/it]
 86%|████████▌ | 32508/37963 [73:51:33<12:01:08,  7.93s/it]
 86%|████████▌ | 32509/37963 [73:51:40<11:56:05,  7.88s/it]
 86%|████████▌ | 32510/37963 [73:51:48<11:57:21,  7.89s/it]
                                                           
{'loss': '0.09019', 'grad_norm': '3.215', 'learning_rate': '1.063e-06', 'epoch': '0.8564'}
+
 86%|████████▌ | 32510/37963 [73:51:48<11:57:21,  7.89s/it]
 86%|████████▌ | 32511/37963 [73:51:56<11:52:03,  7.84s/it]
 86%|████████▌ | 32512/37963 [73:52:04<11:51:09,  7.83s/it]
 86%|████████▌ | 32513/37963 [73:52:12<11:47:21,  7.79s/it]
 86%|████████▌ | 32514/37963 [73:52:19<11:48:17,  7.80s/it]
 86%|████████▌ | 32515/37963 [73:52:27<11:49:44,  7.82s/it]
 86%|████████▌ | 32516/37963 [73:52:35<11:44:42,  7.76s/it]
 86%|████████▌ | 32517/37963 [73:52:45<12:48:48,  8.47s/it]
 86%|████████▌ | 32518/37963 [73:52:53<12:34:42,  8.32s/it]
 86%|████████▌ | 32519/37963 [73:53:01<12:16:49,  8.12s/it]
 86%|████████▌ | 32520/37963 [73:53:08<12:02:44,  7.97s/it]
                                                           
{'loss': '0.1006', 'grad_norm': '4.278', 'learning_rate': '1.059e-06', 'epoch': '0.8566'}
+
 86%|████████▌ | 32520/37963 [73:53:08<12:02:44,  7.97s/it]
 86%|████████▌ | 32521/37963 [73:53:16<11:56:19,  7.90s/it]
 86%|████████▌ | 32522/37963 [73:53:24<11:55:42,  7.89s/it]
 86%|████████▌ | 32523/37963 [73:53:32<11:51:49,  7.85s/it]
 86%|████████▌ | 32524/37963 [73:53:42<13:12:17,  8.74s/it]
 86%|████████▌ | 32525/37963 [73:53:53<13:51:44,  9.18s/it]
 86%|████████▌ | 32526/37963 [73:54:01<13:14:53,  8.77s/it]
 86%|████████▌ | 32527/37963 [73:54:08<12:52:14,  8.52s/it]
 86%|████████▌ | 32528/37963 [73:54:19<13:45:05,  9.11s/it]
 86%|████████▌ | 32529/37963 [73:54:27<13:05:28,  8.67s/it]
 86%|████████▌ | 32530/37963 [73:54:34<12:42:17,  8.42s/it]
                                                           
{'loss': '0.1076', 'grad_norm': '3.46', 'learning_rate': '1.055e-06', 'epoch': '0.8569'}
+
 86%|████████▌ | 32530/37963 [73:54:34<12:42:17,  8.42s/it]
 86%|████████▌ | 32531/37963 [73:54:42<12:33:00,  8.32s/it]
 86%|████████▌ | 32532/37963 [73:54:50<12:20:02,  8.18s/it]
 86%|████████▌ | 32533/37963 [73:54:58<12:05:29,  8.02s/it]
 86%|████████▌ | 32534/37963 [73:55:06<11:55:00,  7.90s/it]
 86%|████████▌ | 32535/37963 [73:55:13<11:47:06,  7.82s/it]
 86%|████████▌ | 32536/37963 [73:55:21<11:38:36,  7.72s/it]
 86%|████████▌ | 32537/37963 [73:55:29<11:40:06,  7.74s/it]
 86%|████████▌ | 32538/37963 [73:55:39<12:51:04,  8.53s/it]
 86%|████████▌ | 32539/37963 [73:55:47<12:29:51,  8.29s/it]
 86%|████████▌ | 32540/37963 [73:55:57<13:20:47,  8.86s/it]
                                                           
{'loss': '0.08934', 'grad_norm': '2.999', 'learning_rate': '1.052e-06', 'epoch': '0.8572'}
+
 86%|████████▌ | 32540/37963 [73:55:57<13:20:47,  8.86s/it]
 86%|████████▌ | 32541/37963 [73:56:05<12:49:05,  8.51s/it]
 86%|████████▌ | 32542/37963 [73:56:12<12:23:50,  8.23s/it]
 86%|████████▌ | 32543/37963 [73:56:23<13:29:00,  8.96s/it]
 86%|████████▌ | 32544/37963 [73:56:31<12:59:55,  8.64s/it]
 86%|████████▌ | 32545/37963 [73:56:38<12:36:14,  8.37s/it]
 86%|████████▌ | 32546/37963 [73:56:46<12:20:14,  8.20s/it]
 86%|████████▌ | 32547/37963 [73:56:54<11:58:59,  7.97s/it]
 86%|████████▌ | 32548/37963 [73:57:01<11:38:53,  7.74s/it]
 86%|████████▌ | 32549/37963 [73:57:09<11:37:01,  7.72s/it]
 86%|████████▌ | 32550/37963 [73:57:16<11:37:03,  7.73s/it]
                                                           
{'loss': '0.09919', 'grad_norm': '2.868', 'learning_rate': '1.048e-06', 'epoch': '0.8574'}
+
 86%|████████▌ | 32550/37963 [73:57:16<11:37:03,  7.73s/it]
 86%|████████▌ | 32551/37963 [73:57:24<11:41:24,  7.78s/it]
 86%|████████▌ | 32552/37963 [73:57:32<11:39:40,  7.76s/it]
 86%|████████▌ | 32553/37963 [73:57:40<11:38:09,  7.74s/it]
 86%|████████▌ | 32554/37963 [73:57:47<11:33:49,  7.70s/it]
 86%|████████▌ | 32555/37963 [73:57:57<12:41:18,  8.45s/it]
 86%|████████▌ | 32556/37963 [73:58:05<12:27:18,  8.29s/it]
 86%|████████▌ | 32557/37963 [73:58:13<12:03:05,  8.03s/it]
 86%|████████▌ | 32558/37963 [73:58:20<11:52:22,  7.91s/it]
 86%|████████▌ | 32559/37963 [73:58:28<11:51:28,  7.90s/it]
 86%|████████▌ | 32560/37963 [73:58:36<11:51:54,  7.91s/it]
                                                           
{'loss': '0.09154', 'grad_norm': '3.361', 'learning_rate': '1.044e-06', 'epoch': '0.8577'}
+
 86%|████████▌ | 32560/37963 [73:58:36<11:51:54,  7.91s/it]
 86%|████████▌ | 32561/37963 [73:58:44<11:46:03,  7.84s/it]
 86%|████████▌ | 32562/37963 [73:58:52<11:46:32,  7.85s/it]
 86%|████████▌ | 32563/37963 [73:58:59<11:37:06,  7.75s/it]
 86%|████████▌ | 32564/37963 [73:59:07<11:31:29,  7.68s/it]
 86%|████████▌ | 32565/37963 [73:59:15<11:35:15,  7.73s/it]
 86%|████████▌ | 32566/37963 [73:59:22<11:31:56,  7.69s/it]
 86%|████████▌ | 32567/37963 [73:59:30<11:36:18,  7.74s/it]
 86%|████████▌ | 32568/37963 [73:59:40<12:37:12,  8.42s/it]
 86%|████████▌ | 32569/37963 [73:59:47<12:10:12,  8.12s/it]
 86%|████████▌ | 32570/37963 [73:59:55<11:54:50,  7.95s/it]
                                                           
{'loss': '0.1096', 'grad_norm': '2.639', 'learning_rate': '1.04e-06', 'epoch': '0.8579'}
+
 86%|████████▌ | 32570/37963 [73:59:55<11:54:50,  7.95s/it]
 86%|████████▌ | 32571/37963 [74:00:03<11:51:40,  7.92s/it]
 86%|████████▌ | 32572/37963 [74:00:11<11:50:56,  7.91s/it]
 86%|████████▌ | 32573/37963 [74:00:21<13:02:10,  8.71s/it]
 86%|████████▌ | 32574/37963 [74:00:29<12:40:35,  8.47s/it]
 86%|████████▌ | 32575/37963 [74:00:37<12:16:32,  8.20s/it]
 86%|████████▌ | 32576/37963 [74:00:47<13:18:12,  8.89s/it]
 86%|████████▌ | 32577/37963 [74:00:55<12:48:03,  8.56s/it]
 86%|████████▌ | 32578/37963 [74:01:03<12:29:23,  8.35s/it]
 86%|████████▌ | 32579/37963 [74:01:13<13:12:02,  8.83s/it]
 86%|████████▌ | 32580/37963 [74:01:21<12:41:59,  8.49s/it]
                                                           
{'loss': '0.09853', 'grad_norm': '5.154', 'learning_rate': '1.036e-06', 'epoch': '0.8582'}
+
 86%|████████▌ | 32580/37963 [74:01:21<12:41:59,  8.49s/it]
 86%|████████▌ | 32581/37963 [74:01:28<12:20:27,  8.25s/it]
 86%|████████▌ | 32582/37963 [74:01:38<13:09:28,  8.80s/it]
 86%|████████▌ | 32583/37963 [74:01:46<12:46:44,  8.55s/it]
 86%|████████▌ | 32584/37963 [74:01:54<12:24:35,  8.31s/it]
 86%|████████▌ | 32585/37963 [74:02:02<12:12:52,  8.18s/it]
 86%|████████▌ | 32586/37963 [74:02:10<12:05:13,  8.09s/it]
 86%|████████▌ | 32587/37963 [74:02:23<14:26:40,  9.67s/it]
 86%|████████▌ | 32588/37963 [74:02:31<13:36:51,  9.12s/it]
 86%|████████▌ | 32589/37963 [74:02:39<13:06:41,  8.78s/it]
 86%|████████▌ | 32590/37963 [74:02:47<12:46:22,  8.56s/it]
                                                           
{'loss': '0.1043', 'grad_norm': '2.766', 'learning_rate': '1.033e-06', 'epoch': '0.8585'}
+
 86%|████████▌ | 32590/37963 [74:02:47<12:46:22,  8.56s/it]
 86%|████████▌ | 32591/37963 [74:02:55<12:25:22,  8.33s/it]
 86%|████████▌ | 32592/37963 [74:03:03<12:13:45,  8.20s/it]
 86%|████████▌ | 32593/37963 [74:03:10<11:57:04,  8.01s/it]
 86%|████████▌ | 32594/37963 [74:03:18<11:48:19,  7.92s/it]
 86%|████████▌ | 32595/37963 [74:03:26<11:38:28,  7.81s/it]
 86%|████████▌ | 32596/37963 [74:03:33<11:26:36,  7.68s/it]
 86%|████████▌ | 32597/37963 [74:03:41<11:26:20,  7.67s/it]
 86%|████████▌ | 32598/37963 [74:03:48<11:26:30,  7.68s/it]
 86%|████████▌ | 32599/37963 [74:03:56<11:21:01,  7.62s/it]
 86%|████████▌ | 32600/37963 [74:04:04<11:31:11,  7.73s/it]
                                                           
{'loss': '0.09898', 'grad_norm': '3.468', 'learning_rate': '1.029e-06', 'epoch': '0.8587'}
+
 86%|████████▌ | 32600/37963 [74:04:04<11:31:11,  7.73s/it]
 86%|████████▌ | 32601/37963 [74:04:12<11:35:26,  7.78s/it]
 86%|████████▌ | 32602/37963 [74:04:19<11:29:20,  7.72s/it]
 86%|████████▌ | 32603/37963 [74:04:27<11:33:49,  7.77s/it]
 86%|████████▌ | 32604/37963 [74:04:35<11:30:47,  7.73s/it]
 86%|████████▌ | 32605/37963 [74:04:42<11:22:12,  7.64s/it]
 86%|████████▌ | 32606/37963 [74:04:50<11:23:44,  7.66s/it]
 86%|████████▌ | 32607/37963 [74:04:58<11:31:44,  7.75s/it]
 86%|████████▌ | 32608/37963 [74:05:06<11:30:28,  7.74s/it]
 86%|████████▌ | 32609/37963 [74:05:16<12:41:02,  8.53s/it]
 86%|████████▌ | 32610/37963 [74:05:24<12:17:38,  8.27s/it]
                                                           
{'loss': '0.1007', 'grad_norm': '3.124', 'learning_rate': '1.025e-06', 'epoch': '0.859'}
+
 86%|████████▌ | 32610/37963 [74:05:24<12:17:38,  8.27s/it]
 86%|████████▌ | 32611/37963 [74:05:31<12:04:32,  8.12s/it]
 86%|████████▌ | 32612/37963 [74:05:42<13:06:32,  8.82s/it]
 86%|████████▌ | 32613/37963 [74:05:49<12:35:25,  8.47s/it]
 86%|████████▌ | 32614/37963 [74:05:57<12:16:58,  8.27s/it]
 86%|████████▌ | 32615/37963 [74:06:05<12:10:28,  8.20s/it]
 86%|████████▌ | 32616/37963 [74:06:13<11:55:16,  8.03s/it]
 86%|████████▌ | 32617/37963 [74:06:21<11:46:32,  7.93s/it]
 86%|████████▌ | 32618/37963 [74:06:28<11:43:00,  7.89s/it]
 86%|████████▌ | 32619/37963 [74:06:36<11:30:32,  7.75s/it]
 86%|████████▌ | 32620/37963 [74:06:43<11:20:58,  7.65s/it]
                                                           
{'loss': '0.07827', 'grad_norm': '2.495', 'learning_rate': '1.021e-06', 'epoch': '0.8593'}
+
 86%|████████▌ | 32620/37963 [74:06:43<11:20:58,  7.65s/it]
 86%|████████▌ | 32621/37963 [74:06:54<12:41:36,  8.55s/it]
 86%|████████▌ | 32622/37963 [74:07:01<12:12:45,  8.23s/it]
 86%|████████▌ | 32623/37963 [74:07:09<11:55:14,  8.04s/it]
 86%|████████▌ | 32624/37963 [74:07:17<11:46:41,  7.94s/it]
 86%|████████▌ | 32625/37963 [74:07:27<12:55:16,  8.71s/it]
 86%|████████▌ | 32626/37963 [74:07:35<12:27:02,  8.40s/it]
 86%|████████▌ | 32627/37963 [74:07:45<13:14:38,  8.94s/it]
 86%|████████▌ | 32628/37963 [74:07:53<12:43:51,  8.59s/it]
 86%|████████▌ | 32629/37963 [74:08:00<12:16:47,  8.29s/it]
 86%|████████▌ | 32630/37963 [74:08:14<14:32:27,  9.82s/it]
                                                           
{'loss': '0.1', 'grad_norm': '2.784', 'learning_rate': '1.018e-06', 'epoch': '0.8595'}
+
 86%|████████▌ | 32630/37963 [74:08:14<14:32:27,  9.82s/it]
 86%|████████▌ | 32631/37963 [74:08:22<13:43:47,  9.27s/it]
 86%|████████▌ | 32632/37963 [74:08:30<13:04:30,  8.83s/it]
 86%|████████▌ | 32633/37963 [74:08:37<12:36:41,  8.52s/it]
 86%|████████▌ | 32634/37963 [74:08:45<12:17:50,  8.31s/it]
 86%|████████▌ | 32635/37963 [74:08:53<12:03:47,  8.15s/it]
 86%|████████▌ | 32636/37963 [74:09:01<11:53:58,  8.04s/it]
 86%|████████▌ | 32637/37963 [74:09:09<11:54:10,  8.05s/it]
 86%|████████▌ | 32638/37963 [74:09:17<11:49:48,  8.00s/it]
 86%|████████▌ | 32639/37963 [74:09:24<11:32:17,  7.80s/it]
 86%|████████▌ | 32640/37963 [74:09:32<11:34:22,  7.83s/it]
                                                           
{'loss': '0.09831', 'grad_norm': '3.235', 'learning_rate': '1.014e-06', 'epoch': '0.8598'}
+
 86%|████████▌ | 32640/37963 [74:09:32<11:34:22,  7.83s/it]
 86%|████████▌ | 32641/37963 [74:09:43<12:45:55,  8.64s/it]
 86%|████████▌ | 32642/37963 [74:09:50<12:23:39,  8.39s/it]
 86%|████████▌ | 32643/37963 [74:09:58<11:59:57,  8.12s/it]
 86%|████████▌ | 32644/37963 [74:10:06<11:51:56,  8.03s/it]
 86%|████████▌ | 32645/37963 [74:10:14<11:48:42,  8.00s/it]
 86%|████████▌ | 32646/37963 [74:10:21<11:40:00,  7.90s/it]
 86%|████████▌ | 32647/37963 [74:10:29<11:40:46,  7.91s/it]
 86%|████████▌ | 32648/37963 [74:10:37<11:44:51,  7.96s/it]
 86%|████████▌ | 32649/37963 [74:10:45<11:38:39,  7.89s/it]
 86%|████████▌ | 32650/37963 [74:10:53<11:31:07,  7.80s/it]
                                                           
{'loss': '0.1106', 'grad_norm': '3.314', 'learning_rate': '1.01e-06', 'epoch': '0.8601'}
+
 86%|████████▌ | 32650/37963 [74:10:53<11:31:07,  7.80s/it]
 86%|████████▌ | 32651/37963 [74:11:00<11:20:04,  7.68s/it]
 86%|████████▌ | 32652/37963 [74:11:08<11:25:49,  7.75s/it]
 86%|████████▌ | 32653/37963 [74:11:16<11:28:25,  7.78s/it]
 86%|████████▌ | 32654/37963 [74:11:24<11:30:11,  7.80s/it]
 86%|████████▌ | 32655/37963 [74:11:31<11:25:44,  7.75s/it]
 86%|████████▌ | 32656/37963 [74:11:39<11:20:23,  7.69s/it]
 86%|████████▌ | 32657/37963 [74:11:49<12:27:27,  8.45s/it]
 86%|████████▌ | 32658/37963 [74:11:56<12:00:08,  8.14s/it]
 86%|████████▌ | 32659/37963 [74:12:04<11:51:36,  8.05s/it]
 86%|████████▌ | 32660/37963 [74:12:14<12:35:54,  8.55s/it]
                                                           
{'loss': '0.09431', 'grad_norm': '4.109', 'learning_rate': '1.006e-06', 'epoch': '0.8603'}
+
 86%|████████▌ | 32660/37963 [74:12:14<12:35:54,  8.55s/it]
 86%|████████▌ | 32661/37963 [74:12:22<12:10:19,  8.26s/it]
 86%|████████▌ | 32662/37963 [74:12:29<11:55:25,  8.10s/it]
 86%|████████▌ | 32663/37963 [74:12:37<11:42:06,  7.95s/it]
 86%|████████▌ | 32664/37963 [74:12:45<11:34:30,  7.86s/it]
 86%|████████▌ | 32665/37963 [74:12:55<12:50:08,  8.72s/it]
 86%|████████▌ | 32666/37963 [74:13:03<12:21:35,  8.40s/it]
 86%|████████▌ | 32667/37963 [74:13:10<11:49:37,  8.04s/it]
 86%|████████▌ | 32668/37963 [74:13:18<11:43:03,  7.97s/it]
 86%|████████▌ | 32669/37963 [74:13:26<11:37:56,  7.91s/it]
 86%|████████▌ | 32670/37963 [74:13:33<11:30:46,  7.83s/it]
                                                           
{'loss': '0.09403', 'grad_norm': '2.56', 'learning_rate': '1.003e-06', 'epoch': '0.8606'}
+
 86%|████████▌ | 32670/37963 [74:13:33<11:30:46,  7.83s/it]
 86%|████████▌ | 32671/37963 [74:13:41<11:26:47,  7.79s/it]
 86%|████████▌ | 32672/37963 [74:13:49<11:20:14,  7.71s/it]
 86%|████████▌ | 32673/37963 [74:13:56<11:22:39,  7.74s/it]
 86%|████████▌ | 32674/37963 [74:14:07<12:35:05,  8.57s/it]
 86%|████████▌ | 32675/37963 [74:14:17<13:11:56,  8.99s/it]
 86%|████████▌ | 32676/37963 [74:14:25<12:44:26,  8.68s/it]
 86%|████████▌ | 32677/37963 [74:14:32<12:17:42,  8.37s/it]
 86%|████████▌ | 32678/37963 [74:14:46<14:36:10,  9.95s/it]
 86%|████████▌ | 32679/37963 [74:14:54<13:33:16,  9.23s/it]
 86%|████████▌ | 32680/37963 [74:15:01<12:53:51,  8.79s/it]
                                                           
{'loss': '0.09399', 'grad_norm': '3.539', 'learning_rate': '9.99e-07', 'epoch': '0.8608'}
+
 86%|████████▌ | 32680/37963 [74:15:01<12:53:51,  8.79s/it]
 86%|████████▌ | 32681/37963 [74:15:09<12:28:07,  8.50s/it]
 86%|████████▌ | 32682/37963 [74:15:17<11:58:04,  8.16s/it]
 86%|████████▌ | 32683/37963 [74:15:24<11:46:20,  8.03s/it]
 86%|████████▌ | 32684/37963 [74:15:35<12:45:33,  8.70s/it]
 86%|████████▌ | 32685/37963 [74:15:42<12:25:05,  8.47s/it]
 86%|████████▌ | 32686/37963 [74:15:50<12:08:40,  8.29s/it]
 86%|████████▌ | 32687/37963 [74:15:58<11:52:32,  8.10s/it]
 86%|████████▌ | 32688/37963 [74:16:06<11:44:36,  8.01s/it]
 86%|████████▌ | 32689/37963 [74:16:13<11:29:06,  7.84s/it]
 86%|████████▌ | 32690/37963 [74:16:21<11:23:14,  7.77s/it]
                                                           
{'loss': '0.09063', 'grad_norm': '3.161', 'learning_rate': '9.953e-07', 'epoch': '0.8611'}
+
 86%|████████▌ | 32690/37963 [74:16:21<11:23:14,  7.77s/it]
 86%|████████▌ | 32691/37963 [74:16:29<11:24:31,  7.79s/it]
 86%|████████▌ | 32692/37963 [74:16:37<11:26:01,  7.81s/it]
 86%|████████▌ | 32693/37963 [74:16:44<11:17:35,  7.71s/it]
 86%|████████▌ | 32694/37963 [74:16:52<11:13:54,  7.67s/it]
 86%|████████▌ | 32695/37963 [74:16:59<11:15:15,  7.69s/it]
 86%|████████▌ | 32696/37963 [74:17:07<11:11:49,  7.65s/it]
 86%|████████▌ | 32697/37963 [74:17:15<11:18:06,  7.73s/it]
 86%|████████▌ | 32698/37963 [74:17:23<11:25:38,  7.81s/it]
 86%|████████▌ | 32699/37963 [74:17:31<11:24:55,  7.81s/it]
 86%|████████▌ | 32700/37963 [74:17:38<11:19:24,  7.75s/it]
                                                           
{'loss': '0.08589', 'grad_norm': '4.104', 'learning_rate': '9.916e-07', 'epoch': '0.8614'}
+
 86%|████████▌ | 32700/37963 [74:17:38<11:19:24,  7.75s/it]
 86%|████████▌ | 32701/37963 [74:17:46<11:24:41,  7.81s/it]
 86%|████████▌ | 32702/37963 [74:17:54<11:22:49,  7.79s/it]
 86%|████████▌ | 32703/37963 [74:18:02<11:27:34,  7.84s/it]
 86%|████████▌ | 32704/37963 [74:18:09<11:15:49,  7.71s/it]
 86%|████████▌ | 32705/37963 [74:18:17<11:17:16,  7.73s/it]
 86%|████████▌ | 32706/37963 [74:18:25<11:17:41,  7.73s/it]
 86%|████████▌ | 32707/37963 [74:18:35<12:29:01,  8.55s/it]
 86%|████████▌ | 32708/37963 [74:18:45<13:12:35,  9.05s/it]
 86%|████████▌ | 32709/37963 [74:18:53<12:39:42,  8.68s/it]
 86%|████████▌ | 32710/37963 [74:19:01<12:19:02,  8.44s/it]
                                                           
{'loss': '0.09053', 'grad_norm': '3.355', 'learning_rate': '9.879e-07', 'epoch': '0.8616'}
+
 86%|████████▌ | 32710/37963 [74:19:01<12:19:02,  8.44s/it]
 86%|████████▌ | 32711/37963 [74:19:09<11:54:40,  8.16s/it]
 86%|████████▌ | 32712/37963 [74:19:17<11:47:54,  8.09s/it]
 86%|████████▌ | 32713/37963 [74:19:24<11:36:06,  7.96s/it]
 86%|████████▌ | 32714/37963 [74:19:32<11:27:31,  7.86s/it]
 86%|████████▌ | 32715/37963 [74:19:39<11:19:55,  7.77s/it]
 86%|████████▌ | 32716/37963 [74:19:47<11:20:49,  7.79s/it]
 86%|████████▌ | 32717/37963 [74:19:55<11:18:57,  7.77s/it]
 86%|████████▌ | 32718/37963 [74:20:06<12:35:14,  8.64s/it]
 86%|████████▌ | 32719/37963 [74:20:16<13:10:53,  9.05s/it]
 86%|████████▌ | 32720/37963 [74:20:23<12:36:16,  8.65s/it]
                                                           
{'loss': '0.09863', 'grad_norm': '3.588', 'learning_rate': '9.842e-07', 'epoch': '0.8619'}
+
 86%|████████▌ | 32720/37963 [74:20:23<12:36:16,  8.65s/it]
 86%|████████▌ | 32721/37963 [74:20:31<12:07:56,  8.33s/it]
 86%|████████▌ | 32722/37963 [74:20:41<12:58:12,  8.91s/it]
 86%|████████▌ | 32723/37963 [74:20:49<12:30:11,  8.59s/it]
 86%|████████▌ | 32724/37963 [74:20:57<12:11:09,  8.37s/it]
 86%|████████▌ | 32725/37963 [74:21:05<12:00:19,  8.25s/it]
 86%|████████▌ | 32726/37963 [74:21:15<12:52:44,  8.85s/it]
 86%|████████▌ | 32727/37963 [74:21:26<13:44:30,  9.45s/it]
 86%|████████▌ | 32728/37963 [74:21:37<14:13:20,  9.78s/it]
 86%|████████▌ | 32729/37963 [74:21:44<13:23:01,  9.21s/it]
 86%|████████▌ | 32730/37963 [74:21:52<12:33:54,  8.64s/it]
                                                           
{'loss': '0.08136', 'grad_norm': '2.526', 'learning_rate': '9.805e-07', 'epoch': '0.8622'}
+
 86%|████████▌ | 32730/37963 [74:21:52<12:33:54,  8.64s/it]
 86%|████████▌ | 32731/37963 [74:22:00<12:15:22,  8.43s/it]
 86%|████████▌ | 32732/37963 [74:22:08<12:00:06,  8.26s/it]
 86%|████████▌ | 32733/37963 [74:22:15<11:46:27,  8.10s/it]
 86%|████████▌ | 32734/37963 [74:22:23<11:35:43,  7.98s/it]
 86%|████████▌ | 32735/37963 [74:22:31<11:31:50,  7.94s/it]
 86%|████████▌ | 32736/37963 [74:22:39<11:25:25,  7.87s/it]
 86%|████████▌ | 32737/37963 [74:22:46<11:17:31,  7.78s/it]
 86%|████████▌ | 32738/37963 [74:22:54<11:18:15,  7.79s/it]
 86%|████████▌ | 32739/37963 [74:23:02<11:14:15,  7.74s/it]
 86%|████████▌ | 32740/37963 [74:23:09<11:15:11,  7.76s/it]
                                                           
{'loss': '0.09847', 'grad_norm': '3.608', 'learning_rate': '9.768e-07', 'epoch': '0.8624'}
+
 86%|████████▌ | 32740/37963 [74:23:09<11:15:11,  7.76s/it]
 86%|████████▌ | 32741/37963 [74:23:17<11:10:17,  7.70s/it]
 86%|████████▌ | 32742/37963 [74:23:25<11:11:55,  7.72s/it]
 86%|████████▌ | 32743/37963 [74:23:32<11:09:35,  7.70s/it]
 86%|████████▋ | 32744/37963 [74:23:40<11:11:23,  7.72s/it]
 86%|████████▋ | 32745/37963 [74:23:48<11:12:40,  7.73s/it]
 86%|████████▋ | 32746/37963 [74:23:56<11:18:31,  7.80s/it]
 86%|████████▋ | 32747/37963 [74:24:04<11:19:34,  7.82s/it]
 86%|████████▋ | 32748/37963 [74:24:11<11:16:06,  7.78s/it]
 86%|████████▋ | 32749/37963 [74:24:19<11:16:37,  7.79s/it]
 86%|████████▋ | 32750/37963 [74:24:27<11:13:30,  7.75s/it]
                                                           
{'loss': '0.09619', 'grad_norm': '3.259', 'learning_rate': '9.731e-07', 'epoch': '0.8627'}
+
 86%|████████▋ | 32750/37963 [74:24:27<11:13:30,  7.75s/it]
 86%|████████▋ | 32751/37963 [74:24:35<11:18:09,  7.81s/it]
 86%|████████▋ | 32752/37963 [74:24:43<11:16:11,  7.79s/it]
 86%|████████▋ | 32753/37963 [74:24:50<11:14:53,  7.77s/it]
 86%|████████▋ | 32754/37963 [74:24:58<11:17:12,  7.80s/it]
 86%|████████▋ | 32755/37963 [74:25:06<11:09:23,  7.71s/it]
 86%|████████▋ | 32756/37963 [74:25:13<11:07:36,  7.69s/it]
 86%|████████▋ | 32757/37963 [74:25:24<12:14:51,  8.47s/it]
 86%|████████▋ | 32758/37963 [74:25:31<11:56:04,  8.25s/it]
 86%|████████▋ | 32759/37963 [74:25:39<11:41:24,  8.09s/it]
 86%|████████▋ | 32760/37963 [74:25:49<12:37:31,  8.74s/it]
                                                           
{'loss': '0.1021', 'grad_norm': '3.11', 'learning_rate': '9.695e-07', 'epoch': '0.8629'}
+
 86%|████████▋ | 32760/37963 [74:25:49<12:37:31,  8.74s/it]
 86%|████████▋ | 32761/37963 [74:25:57<12:11:57,  8.44s/it]
 86%|████████▋ | 32762/37963 [74:26:05<11:51:19,  8.21s/it]
 86%|████████▋ | 32763/37963 [74:26:15<12:42:55,  8.80s/it]
 86%|████████▋ | 32764/37963 [74:26:23<12:15:43,  8.49s/it]
 86%|████████▋ | 32765/37963 [74:26:30<11:57:58,  8.29s/it]
 86%|████████▋ | 32766/37963 [74:26:38<11:50:07,  8.20s/it]
 86%|████████▋ | 32767/37963 [74:26:49<12:46:34,  8.85s/it]
 86%|████████▋ | 32768/37963 [74:26:57<12:16:33,  8.51s/it]
 86%|████████▋ | 32769/37963 [74:27:04<11:57:23,  8.29s/it]
 86%|████████▋ | 32770/37963 [74:27:15<12:48:50,  8.88s/it]
                                                           
{'loss': '0.09742', 'grad_norm': '2.59', 'learning_rate': '9.658e-07', 'epoch': '0.8632'}
+
 86%|████████▋ | 32770/37963 [74:27:15<12:48:50,  8.88s/it]
 86%|████████▋ | 32771/37963 [74:27:22<12:19:53,  8.55s/it]
 86%|████████▋ | 32772/37963 [74:27:30<11:59:46,  8.32s/it]
 86%|████████▋ | 32773/37963 [74:27:38<11:47:35,  8.18s/it]
 86%|████████▋ | 32774/37963 [74:27:46<11:38:07,  8.07s/it]
 86%|████████▋ | 32775/37963 [74:27:56<12:40:42,  8.80s/it]
 86%|████████▋ | 32776/37963 [74:28:04<12:16:33,  8.52s/it]
 86%|████████▋ | 32777/37963 [74:28:15<13:04:58,  9.08s/it]
 86%|████████▋ | 32778/37963 [74:28:22<12:25:47,  8.63s/it]
 86%|████████▋ | 32779/37963 [74:28:30<12:01:09,  8.35s/it]
 86%|████████▋ | 32780/37963 [74:28:38<11:51:18,  8.23s/it]
                                                           
{'loss': '0.09794', 'grad_norm': '4.627', 'learning_rate': '9.622e-07', 'epoch': '0.8635'}
+
 86%|████████▋ | 32780/37963 [74:28:38<11:51:18,  8.23s/it]
 86%|████████▋ | 32781/37963 [74:28:46<11:38:06,  8.08s/it]
 86%|████████▋ | 32782/37963 [74:28:53<11:27:08,  7.96s/it]
 86%|████████▋ | 32783/37963 [74:29:01<11:19:05,  7.87s/it]
 86%|████████▋ | 32784/37963 [74:29:09<11:14:43,  7.82s/it]
 86%|████████▋ | 32785/37963 [74:29:16<11:04:41,  7.70s/it]
 86%|████████�� | 32786/37963 [74:29:24<11:08:17,  7.75s/it]
 86%|████████▋ | 32787/37963 [74:29:32<11:06:40,  7.73s/it]
 86%|████████▋ | 32788/37963 [74:29:39<11:10:49,  7.78s/it]
 86%|████████▋ | 32789/37963 [74:29:47<11:09:40,  7.77s/it]
 86%|████████▋ | 32790/37963 [74:29:55<11:07:18,  7.74s/it]
                                                           
{'loss': '0.09953', 'grad_norm': '2.883', 'learning_rate': '9.585e-07', 'epoch': '0.8637'}
+
 86%|████████▋ | 32790/37963 [74:29:55<11:07:18,  7.74s/it]
 86%|████████▋ | 32791/37963 [74:30:03<11:05:53,  7.72s/it]
 86%|████████▋ | 32792/37963 [74:30:10<11:06:03,  7.73s/it]
 86%|████████▋ | 32793/37963 [74:30:18<11:11:55,  7.80s/it]
 86%|████████▋ | 32794/37963 [74:30:26<11:15:05,  7.84s/it]
 86%|████████▋ | 32795/37963 [74:30:34<11:19:52,  7.89s/it]
 86%|████████▋ | 32796/37963 [74:30:42<11:19:04,  7.89s/it]
 86%|████████▋ | 32797/37963 [74:30:50<11:14:14,  7.83s/it]
 86%|████████▋ | 32798/37963 [74:30:57<11:06:31,  7.74s/it]
 86%|████████▋ | 32799/37963 [74:31:05<11:06:34,  7.74s/it]
 86%|████████▋ | 32800/37963 [74:31:13<11:04:48,  7.73s/it]
                                                           
{'loss': '0.09182', 'grad_norm': '3.42', 'learning_rate': '9.549e-07', 'epoch': '0.864'}
+
 86%|████████▋ | 32800/37963 [74:31:13<11:04:48,  7.73s/it]
 86%|████████▋ | 32801/37963 [74:31:21<11:11:46,  7.81s/it]
 86%|████████▋ | 32802/37963 [74:31:28<11:09:45,  7.79s/it]
 86%|████████▋ | 32803/37963 [74:31:36<11:11:32,  7.81s/it]
 86%|████████▋ | 32804/37963 [74:31:44<11:08:50,  7.78s/it]
 86%|████████▋ | 32805/37963 [74:31:52<11:08:55,  7.78s/it]
 86%|████████▋ | 32806/37963 [74:32:02<12:17:11,  8.58s/it]
 86%|████████▋ | 32807/37963 [74:32:10<11:56:37,  8.34s/it]
 86%|████████▋ | 32808/37963 [74:32:18<11:45:06,  8.21s/it]
 86%|████████▋ | 32809/37963 [74:32:26<11:36:07,  8.10s/it]
 86%|████████▋ | 32810/37963 [74:32:36<12:41:42,  8.87s/it]
                                                           
{'loss': '0.09524', 'grad_norm': '3.169', 'learning_rate': '9.512e-07', 'epoch': '0.8643'}
+
 86%|████████▋ | 32810/37963 [74:32:36<12:41:42,  8.87s/it]
 86%|████████▋ | 32811/37963 [74:32:47<13:19:11,  9.31s/it]
 86%|████████▋ | 32812/37963 [74:32:54<12:36:32,  8.81s/it]
 86%|████████▋ | 32813/37963 [74:33:02<12:06:15,  8.46s/it]
 86%|████████▋ | 32814/37963 [74:33:13<13:01:29,  9.11s/it]
 86%|████████▋ | 32815/37963 [74:33:23<13:41:32,  9.58s/it]
 86%|████████▋ | 32816/37963 [74:33:31<12:54:09,  9.02s/it]
 86%|████████▋ | 32817/37963 [74:33:39<12:26:59,  8.71s/it]
 86%|████████▋ | 32818/37963 [74:33:47<12:01:57,  8.42s/it]
 86%|████████▋ | 32819/37963 [74:33:57<12:56:40,  9.06s/it]
 86%|████████▋ | 32820/37963 [74:34:05<12:23:27,  8.67s/it]
                                                           
{'loss': '0.09425', 'grad_norm': '2.405', 'learning_rate': '9.476e-07', 'epoch': '0.8645'}
+
 86%|████████▋ | 32820/37963 [74:34:05<12:23:27,  8.67s/it]
 86%|████████▋ | 32821/37963 [74:34:13<12:02:00,  8.42s/it]
 86%|████████▋ | 32822/37963 [74:34:21<11:44:23,  8.22s/it]
 86%|████████▋ | 32823/37963 [74:34:29<11:36:01,  8.12s/it]
 86%|████████▋ | 32824/37963 [74:34:36<11:24:18,  7.99s/it]
 86%|████████▋ | 32825/37963 [74:34:47<12:33:58,  8.80s/it]
 86%|████████▋ | 32826/37963 [74:34:55<12:05:45,  8.48s/it]
 86%|████████▋ | 32827/37963 [74:35:02<11:37:30,  8.15s/it]
 86%|████████▋ | 32828/37963 [74:35:10<11:28:53,  8.05s/it]
 86%|████████▋ | 32829/37963 [74:35:18<11:24:20,  8.00s/it]
 86%|████████▋ | 32830/37963 [74:35:25<11:17:03,  7.91s/it]
                                                           
{'loss': '0.1005', 'grad_norm': '4.49', 'learning_rate': '9.44e-07', 'epoch': '0.8648'}
+
 86%|████████▋ | 32830/37963 [74:35:25<11:17:03,  7.91s/it]
 86%|████████▋ | 32831/37963 [74:35:33<11:11:40,  7.85s/it]
 86%|████████▋ | 32832/37963 [74:35:41<11:01:51,  7.74s/it]
 86%|████████▋ | 32833/37963 [74:35:49<11:07:31,  7.81s/it]
 86%|████████▋ | 32834/37963 [74:35:56<11:07:49,  7.81s/it]
 86%|████████▋ | 32835/37963 [74:36:04<11:03:24,  7.76s/it]
 86%|████████▋ | 32836/37963 [74:36:12<11:03:27,  7.76s/it]
 86%|████████▋ | 32837/37963 [74:36:20<11:04:10,  7.77s/it]
 87%|████████▋ | 32838/37963 [74:36:27<11:03:23,  7.77s/it]
 87%|████████▋ | 32839/37963 [74:36:35<11:00:34,  7.74s/it]
 87%|████████▋ | 32840/37963 [74:36:43<10:57:33,  7.70s/it]
                                                           
{'loss': '0.08998', 'grad_norm': '3.552', 'learning_rate': '9.404e-07', 'epoch': '0.8651'}
+
 87%|████████▋ | 32840/37963 [74:36:43<10:57:33,  7.70s/it]
 87%|████████▋ | 32841/37963 [74:36:51<11:03:30,  7.77s/it]
 87%|████████▋ | 32842/37963 [74:36:58<11:01:03,  7.75s/it]
 87%|████████▋ | 32843/37963 [74:37:06<10:58:43,  7.72s/it]
 87%|████████▋ | 32844/37963 [74:37:14<10:59:59,  7.74s/it]
 87%|████████▋ | 32845/37963 [74:37:22<11:03:24,  7.78s/it]
 87%|████████▋ | 32846/37963 [74:37:29<11:02:53,  7.77s/it]
 87%|████████▋ | 32847/37963 [74:37:37<10:59:02,  7.73s/it]
 87%|████████▋ | 32848/37963 [74:37:45<11:02:03,  7.77s/it]
 87%|████████▋ | 32849/37963 [74:37:53<11:02:30,  7.77s/it]
 87%|████████▋ | 32850/37963 [74:38:03<12:13:30,  8.61s/it]
                                                           
{'loss': '0.09884', 'grad_norm': '3.359', 'learning_rate': '9.368e-07', 'epoch': '0.8653'}
+
 87%|████████▋ | 32850/37963 [74:38:03<12:13:30,  8.61s/it]
 87%|████████▋ | 32851/37963 [74:38:11<11:56:06,  8.41s/it]
 87%|████████▋ | 32852/37963 [74:38:19<11:41:21,  8.23s/it]
 87%|████████▋ | 32853/37963 [74:38:27<11:25:03,  8.04s/it]
 87%|████████▋ | 32854/37963 [74:38:37<12:21:57,  8.71s/it]
 87%|████████▋ | 32855/37963 [74:38:45<12:04:46,  8.51s/it]
 87%|████████▋ | 32856/37963 [74:38:53<11:55:11,  8.40s/it]
 87%|████████▋ | 32857/37963 [74:39:04<12:56:27,  9.12s/it]
 87%|████████▋ | 32858/37963 [74:39:14<13:27:45,  9.49s/it]
 87%|████████▋ | 32859/37963 [74:39:25<13:48:36,  9.74s/it]
 87%|████████▋ | 32860/37963 [74:39:32<12:56:07,  9.13s/it]
                                                           
{'loss': '0.101', 'grad_norm': '3.211', 'learning_rate': '9.332e-07', 'epoch': '0.8656'}
+
 87%|████████▋ | 32860/37963 [74:39:32<12:56:07,  9.13s/it]
 87%|████████▋ | 32861/37963 [74:39:40<12:23:25,  8.74s/it]
 87%|████████▋ | 32862/37963 [74:39:48<11:57:32,  8.44s/it]
 87%|████████▋ | 32863/37963 [74:39:55<11:36:43,  8.20s/it]
 87%|████████▋ | 32864/37963 [74:40:03<11:16:52,  7.96s/it]
 87%|████████▋ | 32865/37963 [74:40:13<12:15:41,  8.66s/it]
 87%|████████▋ | 32866/37963 [74:40:21<11:50:44,  8.37s/it]
 87%|████████▋ | 32867/37963 [74:40:31<12:41:53,  8.97s/it]
 87%|████████▋ | 32868/37963 [74:40:39<12:12:42,  8.63s/it]
 87%|████████▋ | 32869/37963 [74:40:47<11:46:49,  8.33s/it]
 87%|████████▋ | 32870/37963 [74:40:54<11:33:21,  8.17s/it]
                                                           
{'loss': '0.08884', 'grad_norm': '2.907', 'learning_rate': '9.296e-07', 'epoch': '0.8658'}
+
 87%|████████▋ | 32870/37963 [74:40:54<11:33:21,  8.17s/it]
 87%|████████▋ | 32871/37963 [74:41:02<11:21:25,  8.03s/it]
 87%|████████▋ | 32872/37963 [74:41:10<11:10:20,  7.90s/it]
 87%|████████▋ | 32873/37963 [74:41:17<11:02:18,  7.81s/it]
 87%|████████▋ | 32874/37963 [74:41:25<11:02:14,  7.81s/it]
 87%|████████▋ | 32875/37963 [74:41:33<10:58:51,  7.77s/it]
 87%|████████▋ | 32876/37963 [74:41:40<10:53:45,  7.71s/it]
 87%|████████▋ | 32877/37963 [74:41:51<11:58:19,  8.47s/it]
 87%|████████▋ | 32878/37963 [74:41:59<11:46:55,  8.34s/it]
 87%|████████▋ | 32879/37963 [74:42:06<11:31:10,  8.16s/it]
 87%|████████▋ | 32880/37963 [74:42:15<11:28:52,  8.13s/it]
                                                           
{'loss': '0.08815', 'grad_norm': '4.263', 'learning_rate': '9.26e-07', 'epoch': '0.8661'}
+
 87%|████████▋ | 32880/37963 [74:42:15<11:28:52,  8.13s/it]
 87%|████████▋ | 32881/37963 [74:42:22<11:17:47,  8.00s/it]
 87%|████████▋ | 32882/37963 [74:42:30<11:15:18,  7.97s/it]
 87%|████████▋ | 32883/37963 [74:42:38<11:07:48,  7.89s/it]
 87%|████████▋ | 32884/37963 [74:42:45<10:52:46,  7.71s/it]
 87%|████████▋ | 32885/37963 [74:42:53<10:57:01,  7.76s/it]
 87%|████████▋ | 32886/37963 [74:43:01<10:56:06,  7.75s/it]
 87%|████████▋ | 32887/37963 [74:43:08<10:55:08,  7.74s/it]
 87%|██��█████▋ | 32888/37963 [74:43:16<10:48:56,  7.67s/it]
 87%|████████▋ | 32889/37963 [74:43:24<10:48:23,  7.67s/it]
 87%|████████▋ | 32890/37963 [74:43:31<10:47:56,  7.66s/it]
                                                           
{'loss': '0.09876', 'grad_norm': '4.228', 'learning_rate': '9.224e-07', 'epoch': '0.8664'}
+
 87%|████████▋ | 32890/37963 [74:43:31<10:47:56,  7.66s/it]
 87%|████████▋ | 32891/37963 [74:43:39<10:50:51,  7.70s/it]
 87%|████████▋ | 32892/37963 [74:43:46<10:44:46,  7.63s/it]
 87%|████████▋ | 32893/37963 [74:43:54<10:45:16,  7.64s/it]
 87%|████████▋ | 32894/37963 [74:44:02<10:55:39,  7.76s/it]
 87%|████████▋ | 32895/37963 [74:44:10<10:57:48,  7.79s/it]
 87%|████████▋ | 32896/37963 [74:44:18<10:56:22,  7.77s/it]
 87%|████████▋ | 32897/37963 [74:44:26<10:58:02,  7.79s/it]
 87%|████████▋ | 32898/37963 [74:44:36<12:06:14,  8.60s/it]
 87%|████████▋ | 32899/37963 [74:44:44<11:51:01,  8.42s/it]
 87%|████████▋ | 32900/37963 [74:44:52<11:34:07,  8.23s/it]
                                                           
{'loss': '0.09521', 'grad_norm': '3.329', 'learning_rate': '9.188e-07', 'epoch': '0.8666'}
+
 87%|████████▋ | 32900/37963 [74:44:52<11:34:07,  8.23s/it]
 87%|████████▋ | 32901/37963 [74:45:03<12:37:46,  8.98s/it]
 87%|████████▋ | 32902/37963 [74:45:11<12:10:07,  8.66s/it]
 87%|████████▋ | 32903/37963 [74:45:18<11:48:52,  8.41s/it]
 87%|████████▋ | 32904/37963 [74:45:26<11:34:55,  8.24s/it]
 87%|████████▋ | 32905/37963 [74:45:34<11:23:02,  8.10s/it]
 87%|████████▋ | 32906/37963 [74:45:41<11:07:33,  7.92s/it]
 87%|████████▋ | 32907/37963 [74:45:52<12:11:33,  8.68s/it]
 87%|████████▋ | 32908/37963 [74:46:03<13:01:10,  9.27s/it]
 87%|████████▋ | 32909/37963 [74:46:10<12:25:39,  8.85s/it]
 87%|████████▋ | 32910/37963 [74:46:21<13:09:59,  9.38s/it]
                                                           
{'loss': '0.09294', 'grad_norm': '3.118', 'learning_rate': '9.152e-07', 'epoch': '0.8669'}
+
 87%|████████▋ | 32910/37963 [74:46:21<13:09:59,  9.38s/it]
 87%|████████▋ | 32911/37963 [74:46:31<13:29:39,  9.62s/it]
 87%|████████▋ | 32912/37963 [74:46:39<12:44:51,  9.09s/it]
 87%|████████▋ | 32913/37963 [74:46:49<13:07:25,  9.36s/it]
 87%|████████▋ | 32914/37963 [74:46:57<12:26:39,  8.87s/it]
 87%|████████▋ | 32915/37963 [74:47:04<11:40:28,  8.33s/it]
 87%|████████▋ | 32916/37963 [74:47:11<11:19:04,  8.07s/it]
 87%|████████▋ | 32917/37963 [74:47:19<11:09:26,  7.96s/it]
 87%|████████▋ | 32918/37963 [74:47:27<11:08:14,  7.95s/it]
 87%|████████▋ | 32919/37963 [74:47:35<11:01:40,  7.87s/it]
 87%|████████▋ | 32920/37963 [74:47:42<11:00:20,  7.86s/it]
                                                           
{'loss': '0.1039', 'grad_norm': '3.128', 'learning_rate': '9.117e-07', 'epoch': '0.8672'}
+
 87%|████████▋ | 32920/37963 [74:47:42<11:00:20,  7.86s/it]
 87%|████████▋ | 32921/37963 [74:47:53<12:01:58,  8.59s/it]
 87%|████████▋ | 32922/37963 [74:48:01<11:43:23,  8.37s/it]
 87%|████████▋ | 32923/37963 [74:48:08<11:27:11,  8.18s/it]
 87%|████████▋ | 32924/37963 [74:48:16<11:15:18,  8.04s/it]
 87%|████████▋ | 32925/37963 [74:48:24<11:06:16,  7.93s/it]
 87%|████████▋ | 32926/37963 [74:48:31<10:56:49,  7.82s/it]
 87%|████████▋ | 32927/37963 [74:48:39<10:57:41,  7.84s/it]
 87%|████████▋ | 32928/37963 [74:48:47<10:55:00,  7.81s/it]
 87%|████████▋ | 32929/37963 [74:48:55<10:56:25,  7.82s/it]
 87%|████████▋ | 32930/37963 [74:49:03<10:55:27,  7.81s/it]
                                                           
{'loss': '0.09164', 'grad_norm': '2.53', 'learning_rate': '9.081e-07', 'epoch': '0.8674'}
+
 87%|████████▋ | 32930/37963 [74:49:03<10:55:27,  7.81s/it]
 87%|████████▋ | 32931/37963 [74:49:10<10:51:05,  7.76s/it]
 87%|████████▋ | 32932/37963 [74:49:18<10:52:12,  7.78s/it]
 87%|████████▋ | 32933/37963 [74:49:26<10:48:09,  7.73s/it]
 87%|████████▋ | 32934/37963 [74:49:34<10:50:40,  7.76s/it]
 87%|████████▋ | 32935/37963 [74:49:41<10:42:50,  7.67s/it]
 87%|████████▋ | 32936/37963 [74:49:49<10:47:50,  7.73s/it]
 87%|████████▋ | 32937/37963 [74:49:57<10:47:45,  7.73s/it]
 87%|████████▋ | 32938/37963 [74:50:04<10:43:59,  7.69s/it]
 87%|████████▋ | 32939/37963 [74:50:12<10:47:22,  7.73s/it]
 87%|████████▋ | 32940/37963 [74:50:19<10:38:45,  7.63s/it]
                                                           
{'loss': '0.09751', 'grad_norm': '3.498', 'learning_rate': '9.046e-07', 'epoch': '0.8677'}
+
 87%|████████▋ | 32940/37963 [74:50:19<10:38:45,  7.63s/it]
 87%|████████▋ | 32941/37963 [74:50:27<10:35:25,  7.59s/it]
 87%|████████▋ | 32942/37963 [74:50:35<10:47:29,  7.74s/it]
 87%|████████▋ | 32943/37963 [74:50:43<10:49:45,  7.77s/it]
 87%|████████▋ | 32944/37963 [74:50:53<11:57:35,  8.58s/it]
 87%|████████▋ | 32945/37963 [74:51:01<11:40:01,  8.37s/it]
 87%|████████▋ | 32946/37963 [74:51:09<11:17:23,  8.10s/it]
 87%|████████▋ | 32947/37963 [74:51:16<11:06:39,  7.97s/it]
 87%|████████▋ | 32948/37963 [74:51:24<11:01:05,  7.91s/it]
 87%|████████▋ | 32949/37963 [74:51:32<10:56:35,  7.86s/it]
 87%|████████▋ | 32950/37963 [74:51:39<10:51:25,  7.80s/it]
                                                           
{'loss': '0.09311', 'grad_norm': '2.855', 'learning_rate': '9.01e-07', 'epoch': '0.868'}
+
 87%|████████▋ | 32950/37963 [74:51:39<10:51:25,  7.80s/it]
 87%|████████▋ | 32951/37963 [74:51:52<12:56:10,  9.29s/it]
 87%|████████▋ | 32952/37963 [74:52:00<12:23:38,  8.90s/it]
 87%|████████▋ | 32953/37963 [74:52:08<11:44:22,  8.44s/it]
 87%|████████▋ | 32954/37963 [74:52:15<11:26:55,  8.23s/it]
 87%|████████▋ | 32955/37963 [74:52:23<11:11:46,  8.05s/it]
 87%|████████▋ | 32956/37963 [74:52:34<12:15:14,  8.81s/it]
 87%|████████▋ | 32957/37963 [74:52:41<11:47:22,  8.48s/it]
 87%|████████▋ | 32958/37963 [74:52:51<12:26:33,  8.95s/it]
 87%|████████▋ | 32959/37963 [74:52:59<11:55:51,  8.58s/it]
 87%|████████▋ | 32960/37963 [74:53:07<11:35:42,  8.34s/it]
                                                           
{'loss': '0.1049', 'grad_norm': '3.842', 'learning_rate': '8.975e-07', 'epoch': '0.8682'}
+
 87%|████████▋ | 32960/37963 [74:53:07<11:35:42,  8.34s/it]
 87%|████████▋ | 32961/37963 [74:53:14<11:18:06,  8.13s/it]
 87%|████████▋ | 32962/37963 [74:53:22<11:09:27,  8.03s/it]
 87%|████████▋ | 32963/37963 [74:53:30<10:59:30,  7.91s/it]
 87%|████████▋ | 32964/37963 [74:53:40<12:03:22,  8.68s/it]
 87%|████████▋ | 32965/37963 [74:53:48<11:33:00,  8.32s/it]
 87%|████████▋ | 32966/37963 [74:53:58<12:28:07,  8.98s/it]
 87%|████████▋ | 32967/37963 [74:54:09<13:07:34,  9.46s/it]
 87%|████████▋ | 32968/37963 [74:54:17<12:25:14,  8.95s/it]
 87%|████████▋ | 32969/37963 [74:54:24<11:49:16,  8.52s/it]
 87%|████████▋ | 32970/37963 [74:54:32<11:31:05,  8.30s/it]
                                                           
{'loss': '0.09952', 'grad_norm': '3.609', 'learning_rate': '8.94e-07', 'epoch': '0.8685'}
+
 87%|████████▋ | 32970/37963 [74:54:32<11:31:05,  8.30s/it]
 87%|████████▋ | 32971/37963 [74:54:40<11:17:34,  8.14s/it]
 87%|████████▋ | 32972/37963 [74:54:48<11:09:21,  8.05s/it]
 87%|████████▋ | 32973/37963 [74:54:55<10:58:15,  7.91s/it]
 87%|████████▋ | 32974/37963 [74:55:03<10:59:38,  7.93s/it]
 87%|████████▋ | 32975/37963 [74:55:11<10:56:29,  7.90s/it]
 87%|████████▋ | 32976/37963 [74:55:19<10:54:18,  7.87s/it]
 87%|████████▋ | 32977/37963 [74:55:26<10:47:49,  7.80s/it]
 87%|████████▋ | 32978/37963 [74:55:34<10:40:06,  7.70s/it]
 87%|████████▋ | 32979/37963 [74:55:42<10:36:51,  7.67s/it]
 87%|████████▋ | 32980/37963 [74:55:49<10:40:20,  7.71s/it]
                                                           
{'loss': '0.09398', 'grad_norm': '2.89', 'learning_rate': '8.905e-07', 'epoch': '0.8687'}
+
 87%|████████▋ | 32980/37963 [74:55:49<10:40:20,  7.71s/it]
 87%|████████▋ | 32981/37963 [74:55:57<10:40:02,  7.71s/it]
 87%|████████▋ | 32982/37963 [74:56:05<10:35:32,  7.66s/it]
 87%|████████▋ | 32983/37963 [74:56:13<10:44:37,  7.77s/it]
 87%|████████▋ | 32984/37963 [74:56:20<10:42:18,  7.74s/it]
 87%|████████▋ | 32985/37963 [74:56:28<10:29:33,  7.59s/it]
 87%|████████▋ | 32986/37963 [74:56:35<10:34:19,  7.65s/it]
 87%|████████▋ | 32987/37963 [74:56:43<10:35:38,  7.66s/it]
 87%|████████▋ | 32988/37963 [74:56:51<10:39:16,  7.71s/it]
 87%|████████▋ | 32989/37963 [74:56:58<10:38:07,  7.70s/it]
 87%|████████▋ | 32990/37963 [74:57:06<10:38:55,  7.71s/it]
                                                           
{'loss': '0.091', 'grad_norm': '2.598', 'learning_rate': '8.869e-07', 'epoch': '0.869'}
+
 87%|████████▋ | 32990/37963 [74:57:06<10:38:55,  7.71s/it]
 87%|████████▋ | 32991/37963 [74:57:14<10:40:45,  7.73s/it]
 87%|████████▋ | 32992/37963 [74:57:22<10:45:22,  7.79s/it]
 87%|████████▋ | 32993/37963 [74:57:30<10:41:43,  7.75s/it]
 87%|████████▋ | 32994/37963 [74:57:37<10:39:06,  7.72s/it]
 87%|████████▋ | 32995/37963 [74:57:45<10:37:00,  7.69s/it]
 87%|████████▋ | 32996/37963 [74:57:53<10:38:49,  7.72s/it]
 87%|████████▋ | 32997/37963 [74:58:00<10:42:01,  7.76s/it]
 87%|████████▋ | 32998/37963 [74:58:11<11:55:49,  8.65s/it]
 87%|████████▋ | 32999/37963 [74:58:19<11:37:51,  8.44s/it]
 87%|████████▋ | 33000/37963 [74:58:27<11:20:44,  8.23s/it]
                                                           
{'loss': '0.09512', 'grad_norm': '3.134', 'learning_rate': '8.834e-07', 'epoch': '0.8693'}
+
 87%|████████▋ | 33000/37963 [74:58:27<11:20:44,  8.23s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.81s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.81s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 87%|████████▋ | 33001/37963 [74:59:30<33:54:19, 24.60s/it]
 87%|████████▋ | 33002/37963 [74:59:38<26:57:26, 19.56s/it]
 87%|████████▋ | 33003/37963 [74:59:45<22:03:58, 16.02s/it]
 87%|████████▋ | 33004/37963 [74:59:58<20:49:03, 15.11s/it]
 87%|████████▋ | 33005/37963 [75:00:06<17:56:22, 13.03s/it]
 87%|████████▋ | 33006/37963 [75:00:14<15:39:33, 11.37s/it]
 87%|████████▋ | 33007/37963 [75:00:24<15:11:13, 11.03s/it]
 87%|████████▋ | 33008/37963 [75:00:32<13:52:16, 10.08s/it]
 87%|████████▋ | 33009/37963 [75:00:40<12:52:18,  9.35s/it]
 87%|████████▋ | 33010/37963 [75:00:47<12:09:16,  8.83s/it]
                                                           
{'loss': '0.09097', 'grad_norm': '2.997', 'learning_rate': '8.799e-07', 'epoch': '0.8695'}
+
 87%|████████▋ | 33010/37963 [75:00:47<12:09:16,  8.83s/it]
 87%|████████▋ | 33011/37963 [75:00:58<12:54:05,  9.38s/it]
 87%|████████▋ | 33012/37963 [75:01:06<12:16:04,  8.92s/it]
 87%|████████▋ | 33013/37963 [75:01:13<11:40:16,  8.49s/it]
 87%|████████▋ | 33014/37963 [75:01:21<11:23:42,  8.29s/it]
 87%|████████▋ | 33015/37963 [75:01:29<11:12:58,  8.16s/it]
 87%|████████▋ | 33016/37963 [75:01:37<11:00:26,  8.01s/it]
 87%|████████▋ | 33017/37963 [75:01:44<10:52:08,  7.91s/it]
 87%|████████▋ | 33018/37963 [75:01:55<12:04:14,  8.79s/it]
 87%|████████▋ | 33019/37963 [75:02:05<12:42:05,  9.25s/it]
 87%|████████▋ | 33020/37963 [75:02:13<12:04:39,  8.80s/it]
                                                           
{'loss': '0.0903', 'grad_norm': '2.294', 'learning_rate': '8.764e-07', 'epoch': '0.8698'}
+
 87%|████████▋ | 33020/37963 [75:02:13<12:04:39,  8.80s/it]
 87%|████████▋ | 33021/37963 [75:02:21<11:41:37,  8.52s/it]
 87%|████████▋ | 33022/37963 [75:02:29<11:28:51,  8.37s/it]
 87%|████████▋ | 33023/37963 [75:02:37<11:13:24,  8.18s/it]
 87%|████████▋ | 33024/37963 [75:02:44<11:00:38,  8.03s/it]
 87%|████████▋ | 33025/37963 [75:02:53<11:00:46,  8.03s/it]
 87%|████████▋ | 33026/37963 [75:03:00<10:54:53,  7.96s/it]
 87%|████████▋ | 33027/37963 [75:03:08<10:58:24,  8.00s/it]
 87%|████████▋ | 33028/37963 [75:03:16<10:44:59,  7.84s/it]
 87%|████████▋ | 33029/37963 [75:03:24<10:41:01,  7.80s/it]
 87%|████████▋ | 33030/37963 [75:03:31<10:36:32,  7.74s/it]
                                                           
{'loss': '0.09935', 'grad_norm': '3.71', 'learning_rate': '8.729e-07', 'epoch': '0.8701'}
+
 87%|████████▋ | 33030/37963 [75:03:31<10:36:32,  7.74s/it]
 87%|████████▋ | 33031/37963 [75:03:39<10:38:23,  7.77s/it]
 87%|████████▋ | 33032/37963 [75:03:47<10:40:35,  7.79s/it]
 87%|████████▋ | 33033/37963 [75:03:55<10:39:36,  7.78s/it]
 87%|█████��██▋ | 33034/37963 [75:04:02<10:31:48,  7.69s/it]
 87%|████████▋ | 33035/37963 [75:04:10<10:34:12,  7.72s/it]
 87%|████████▋ | 33036/37963 [75:04:18<10:33:25,  7.71s/it]
 87%|████████▋ | 33037/37963 [75:04:25<10:31:58,  7.70s/it]
 87%|████████▋ | 33038/37963 [75:04:33<10:28:50,  7.66s/it]
 87%|████████▋ | 33039/37963 [75:04:41<10:34:42,  7.73s/it]
 87%|████████▋ | 33040/37963 [75:04:49<10:37:44,  7.77s/it]
                                                           
{'loss': '0.09655', 'grad_norm': '2.806', 'learning_rate': '8.695e-07', 'epoch': '0.8703'}
+
 87%|████████▋ | 33040/37963 [75:04:49<10:37:44,  7.77s/it]
 87%|████████▋ | 33041/37963 [75:04:57<10:46:11,  7.88s/it]
 87%|████████▋ | 33042/37963 [75:05:04<10:35:49,  7.75s/it]
 87%|████████▋ | 33043/37963 [75:05:12<10:30:37,  7.69s/it]
 87%|████████▋ | 33044/37963 [75:05:22<11:45:35,  8.61s/it]
 87%|████████▋ | 33045/37963 [75:05:30<11:28:46,  8.40s/it]
 87%|████████▋ | 33046/37963 [75:05:38<11:09:01,  8.16s/it]
 87%|████████▋ | 33047/37963 [75:05:45<10:50:08,  7.94s/it]
 87%|████████▋ | 33048/37963 [75:05:56<11:53:31,  8.71s/it]
 87%|████████▋ | 33049/37963 [75:06:04<11:25:40,  8.37s/it]
 87%|████████▋ | 33050/37963 [75:06:11<11:09:06,  8.17s/it]
                                                           
{'loss': '0.09539', 'grad_norm': '2.96', 'learning_rate': '8.66e-07', 'epoch': '0.8706'}
+
 87%|████████▋ | 33050/37963 [75:06:11<11:09:06,  8.17s/it]
 87%|████████▋ | 33051/37963 [75:06:19<10:54:23,  7.99s/it]
 87%|████████▋ | 33052/37963 [75:06:32<13:03:40,  9.57s/it]
 87%|████████▋ | 33053/37963 [75:06:40<12:24:01,  9.09s/it]
 87%|████████▋ | 33054/37963 [75:06:50<12:52:45,  9.44s/it]
 87%|████████▋ | 33055/37963 [75:06:58<12:04:00,  8.85s/it]
 87%|████████▋ | 33056/37963 [75:07:06<11:41:41,  8.58s/it]
 87%|████████▋ | 33057/37963 [75:07:13<11:18:17,  8.30s/it]
 87%|████████▋ | 33058/37963 [75:07:21<11:03:11,  8.11s/it]
 87%|████████▋ | 33059/37963 [75:07:29<10:51:12,  7.97s/it]
 87%|████████▋ | 33060/37963 [75:07:36<10:47:50,  7.93s/it]
                                                           
{'loss': '0.0906', 'grad_norm': '2.147', 'learning_rate': '8.625e-07', 'epoch': '0.8709'}
+
 87%|████████▋ | 33060/37963 [75:07:36<10:47:50,  7.93s/it]
 87%|████████▋ | 33061/37963 [75:07:44<10:44:00,  7.88s/it]
 87%|████████▋ | 33062/37963 [75:07:52<10:36:48,  7.80s/it]
 87%|████████▋ | 33063/37963 [75:08:00<10:37:38,  7.81s/it]
 87%|████████▋ | 33064/37963 [75:08:07<10:27:36,  7.69s/it]
 87%|████████▋ | 33065/37963 [75:08:18<11:38:05,  8.55s/it]
 87%|████████▋ | 33066/37963 [75:08:26<11:20:39,  8.34s/it]
 87%|████████▋ | 33067/37963 [75:08:36<12:05:51,  8.90s/it]
 87%|████████▋ | 33068/37963 [75:08:46<12:38:04,  9.29s/it]
 87%|████████▋ | 33069/37963 [75:08:54<11:57:08,  8.79s/it]
 87%|████████▋ | 33070/37963 [75:09:01<11:33:54,  8.51s/it]
                                                           
{'loss': '0.09267', 'grad_norm': '3.341', 'learning_rate': '8.59e-07', 'epoch': '0.8711'}
+
 87%|████████▋ | 33070/37963 [75:09:01<11:33:54,  8.51s/it]
 87%|████████▋ | 33071/37963 [75:09:09<11:14:34,  8.27s/it]
 87%|████████▋ | 33072/37963 [75:09:17<10:53:11,  8.01s/it]
 87%|████████▋ | 33073/37963 [75:09:24<10:49:16,  7.97s/it]
 87%|████████▋ | 33074/37963 [75:09:32<10:42:28,  7.88s/it]
 87%|████████▋ | 33075/37963 [75:09:40<10:37:58,  7.83s/it]
 87%|████████▋ | 33076/37963 [75:09:48<10:36:06,  7.81s/it]
 87%|████████▋ | 33077/37963 [75:09:55<10:31:23,  7.75s/it]
 87%|████████▋ | 33078/37963 [75:10:03<10:34:31,  7.79s/it]
 87%|████████▋ | 33079/37963 [75:10:11<10:37:12,  7.83s/it]
 87%|████████▋ | 33080/37963 [75:10:19<10:43:16,  7.90s/it]
                                                           
{'loss': '0.0938', 'grad_norm': '2.997', 'learning_rate': '8.556e-07', 'epoch': '0.8714'}
+
 87%|████████▋ | 33080/37963 [75:10:19<10:43:16,  7.90s/it]
 87%|████████▋ | 33081/37963 [75:10:27<10:39:39,  7.86s/it]
 87%|████████▋ | 33082/37963 [75:10:35<10:40:09,  7.87s/it]
 87%|████████▋ | 33083/37963 [75:10:42<10:33:29,  7.79s/it]
 87%|████████▋ | 33084/37963 [75:10:50<10:23:32,  7.67s/it]
 87%|████████▋ | 33085/37963 [75:10:57<10:22:30,  7.66s/it]
 87%|████████▋ | 33086/37963 [75:11:05<10:23:22,  7.67s/it]
 87%|████████▋ | 33087/37963 [75:11:13<10:24:20,  7.68s/it]
 87%|████████▋ | 33088/37963 [75:11:20<10:18:21,  7.61s/it]
 87%|████████▋ | 33089/37963 [75:11:28<10:23:18,  7.67s/it]
 87%|████████▋ | 33090/37963 [75:11:36<10:23:59,  7.68s/it]
                                                           
{'loss': '0.09489', 'grad_norm': '3.237', 'learning_rate': '8.521e-07', 'epoch': '0.8716'}
+
 87%|████████▋ | 33090/37963 [75:11:36<10:23:59,  7.68s/it]
 87%|████████▋ | 33091/37963 [75:11:44<10:27:20,  7.73s/it]
 87%|████████▋ | 33092/37963 [75:11:54<11:36:17,  8.58s/it]
 87%|████████▋ | 33093/37963 [75:12:02<11:13:04,  8.29s/it]
 87%|████████▋ | 33094/37963 [75:12:09<10:58:46,  8.12s/it]
 87%|████████▋ | 33095/37963 [75:12:17<10:48:02,  7.99s/it]
 87%|████████▋ | 33096/37963 [75:12:25<10:37:59,  7.87s/it]
 87%|████████▋ | 33097/37963 [75:12:32<10:31:55,  7.79s/it]
 87%|████████▋ | 33098/37963 [75:12:40<10:27:55,  7.74s/it]
 87%|████████▋ | 33099/37963 [75:12:48<10:29:46,  7.77s/it]
 87%|████████▋ | 33100/37963 [75:12:58<11:24:18,  8.44s/it]
                                                           
{'loss': '0.09379', 'grad_norm': '3.277', 'learning_rate': '8.487e-07', 'epoch': '0.8719'}
+
 87%|████████▋ | 33100/37963 [75:12:58<11:24:18,  8.44s/it]
 87%|████████▋ | 33101/37963 [75:13:10<13:01:06,  9.64s/it]
 87%|████████▋ | 33102/37963 [75:13:18<12:14:50,  9.07s/it]
 87%|████████▋ | 33103/37963 [75:13:26<11:44:33,  8.70s/it]
 87%|████████▋ | 33104/37963 [75:13:34<11:24:53,  8.46s/it]
 87%|████████▋ | 33105/37963 [75:13:41<11:01:44,  8.17s/it]
 87%|████████▋ | 33106/37963 [75:13:52<12:00:05,  8.90s/it]
 87%|████████▋ | 33107/37963 [75:13:59<11:24:43,  8.46s/it]
 87%|████████▋ | 33108/37963 [75:14:07<11:08:50,  8.27s/it]
 87%|████████▋ | 33109/37963 [75:14:15<10:56:26,  8.11s/it]
 87%|████████▋ | 33110/37963 [75:14:22<10:44:55,  7.97s/it]
                                                           
{'loss': '0.08658', 'grad_norm': '3.706', 'learning_rate': '8.453e-07', 'epoch': '0.8722'}
+
 87%|████████▋ | 33110/37963 [75:14:22<10:44:55,  7.97s/it]
 87%|████████▋ | 33111/37963 [75:14:30<10:41:59,  7.94s/it]
 87%|████████▋ | 33112/37963 [75:14:38<10:40:17,  7.92s/it]
 87%|████████▋ | 33113/37963 [75:14:46<10:32:14,  7.82s/it]
 87%|████████▋ | 33114/37963 [75:14:53<10:29:04,  7.78s/it]
 87%|████████▋ | 33115/37963 [75:15:01<10:28:08,  7.77s/it]
 87%|████████▋ | 33116/37963 [75:15:12<11:29:50,  8.54s/it]
 87%|████████▋ | 33117/37963 [75:15:19<11:11:03,  8.31s/it]
 87%|████████▋ | 33118/37963 [75:15:30<11:56:37,  8.87s/it]
 87%|████████▋ | 33119/37963 [75:15:40<12:42:57,  9.45s/it]
 87%|████████▋ | 33120/37963 [75:15:48<12:07:28,  9.01s/it]
                                                           
{'loss': '0.09218', 'grad_norm': '2.851', 'learning_rate': '8.418e-07', 'epoch': '0.8724'}
+
 87%|████████▋ | 33120/37963 [75:15:48<12:07:28,  9.01s/it]
 87%|████████▋ | 33121/37963 [75:15:56<11:29:34,  8.54s/it]
 87%|████████▋ | 33122/37963 [75:16:04<11:13:35,  8.35s/it]
 87%|████████▋ | 33123/37963 [75:16:11<11:00:21,  8.19s/it]
 87%|████████▋ | 33124/37963 [75:16:19<10:54:38,  8.12s/it]
 87%|████████▋ | 33125/37963 [75:16:27<10:44:12,  7.99s/it]
 87%|████████▋ | 33126/37963 [75:16:35<10:40:46,  7.95s/it]
 87%|████████▋ | 33127/37963 [75:16:43<10:39:48,  7.94s/it]
 87%|████████▋ | 33128/37963 [75:16:50<10:25:18,  7.76s/it]
 87%|████████▋ | 33129/37963 [75:16:58<10:27:10,  7.78s/it]
 87%|████████▋ | 33130/37963 [75:17:06<10:23:07,  7.74s/it]
                                                           
{'loss': '0.09671', 'grad_norm': '3.16', 'learning_rate': '8.384e-07', 'epoch': '0.8727'}
+
 87%|████████▋ | 33130/37963 [75:17:06<10:23:07,  7.74s/it]
 87%|████████▋ | 33131/37963 [75:17:13<10:22:26,  7.73s/it]
 87%|████████▋ | 33132/37963 [75:17:21<10:21:22,  7.72s/it]
 87%|████████▋ | 33133/37963 [75:17:29<10:18:26,  7.68s/it]
 87%|████████▋ | 33134/37963 [75:17:36<10:16:59,  7.67s/it]
 87%|████████▋ | 33135/37963 [75:17:44<10:21:56,  7.73s/it]
 87%|████████▋ | 33136/37963 [75:17:55<11:28:35,  8.56s/it]
 87%|████████▋ | 33137/37963 [75:18:02<11:08:00,  8.31s/it]
 87%|████████▋ | 33138/37963 [75:18:10<10:53:11,  8.12s/it]
 87%|████████▋ | 33139/37963 [75:18:18<10:44:43,  8.02s/it]
 87%|████████▋ | 33140/37963 [75:18:25<10:31:22,  7.85s/it]
                                                           
{'loss': '0.08494', 'grad_norm': '2.421', 'learning_rate': '8.35e-07', 'epoch': '0.873'}
+
 87%|████████▋ | 33140/37963 [75:18:25<10:31:22,  7.85s/it]
 87%|████████▋ | 33141/37963 [75:18:33<10:26:38,  7.80s/it]
 87%|████████▋ | 33142/37963 [75:18:41<10:22:33,  7.75s/it]
 87%|████████▋ | 33143/37963 [75:18:48<10:17:57,  7.69s/it]
 87%|████████▋ | 33144/37963 [75:18:59<11:22:07,  8.49s/it]
 87%|████████▋ | 33145/37963 [75:19:06<11:00:32,  8.23s/it]
 87%|████████▋ | 33146/37963 [75:19:14<10:43:17,  8.01s/it]
 87%|████████▋ | 33147/37963 [75:19:24<11:44:40,  8.78s/it]
 87%|████████▋ | 33148/37963 [75:19:32<11:20:48,  8.48s/it]
 87%|████████▋ | 33149/37963 [75:19:43<12:10:31,  9.11s/it]
 87%|████████▋ | 33150/37963 [75:19:50<11:28:27,  8.58s/it]
                                                           
{'loss': '0.1012', 'grad_norm': '2.888', 'learning_rate': '8.316e-07', 'epoch': '0.8732'}
+
 87%|████████▋ | 33150/37963 [75:19:50<11:28:27,  8.58s/it]
 87%|████████▋ | 33151/37963 [75:19:58<11:06:29,  8.31s/it]
 87%|████████▋ | 33152/37963 [75:20:05<10:54:10,  8.16s/it]
 87%|████████▋ | 33153/37963 [75:20:13<10:46:12,  8.06s/it]
 87%|████████▋ | 33154/37963 [75:20:21<10:40:08,  7.99s/it]
 87%|████████▋ | 33155/37963 [75:20:29<10:28:43,  7.85s/it]
 87%|████████▋ | 33156/37963 [75:20:36<10:25:04,  7.80s/it]
 87%|████████▋ | 33157/37963 [75:20:44<10:15:08,  7.68s/it]
 87%|████████▋ | 33158/37963 [75:20:51<10:13:43,  7.66s/it]
 87%|████████▋ | 33159/37963 [75:20:59<10:13:17,  7.66s/it]
 87%|████████▋ | 33160/37963 [75:21:10<11:25:02,  8.56s/it]
                                                           
{'loss': '0.0975', 'grad_norm': '3.08', 'learning_rate': '8.282e-07', 'epoch': '0.8735'}
+
 87%|████████▋ | 33160/37963 [75:21:10<11:25:02,  8.56s/it]
 87%|████████▋ | 33161/37963 [75:21:18<11:09:20,  8.36s/it]
 87%|████████▋ | 33162/37963 [75:21:28<11:58:15,  8.98s/it]
 87%|████████▋ | 33163/37963 [75:21:36<11:33:47,  8.67s/it]
 87%|████████▋ | 33164/37963 [75:21:46<12:17:22,  9.22s/it]
 87%|████████▋ | 33165/37963 [75:21:54<11:38:29,  8.73s/it]
 87%|████████▋ | 33166/37963 [75:22:02<11:16:12,  8.46s/it]
 87%|████████▋ | 33167/37963 [75:22:10<10:58:09,  8.23s/it]
 87%|████████▋ | 33168/37963 [75:22:18<10:53:28,  8.18s/it]
 87%|████████▋ | 33169/37963 [75:22:25<10:45:31,  8.08s/it]
 87%|████████▋ | 33170/37963 [75:22:35<11:26:21,  8.59s/it]
                                                           
{'loss': '0.08794', 'grad_norm': '2.425', 'learning_rate': '8.248e-07', 'epoch': '0.8737'}
+
 87%|████████▋ | 33170/37963 [75:22:35<11:26:21,  8.59s/it]
 87%|████████▋ | 33171/37963 [75:22:43<11:11:04,  8.40s/it]
 87%|████████▋ | 33172/37963 [75:22:51<10:55:24,  8.21s/it]
 87%|████████▋ | 33173/37963 [75:22:59<10:41:46,  8.04s/it]
 87%|████████▋ | 33174/37963 [75:23:06<10:29:22,  7.89s/it]
 87%|████████▋ | 33175/37963 [75:23:14<10:25:54,  7.84s/it]
 87%|████████▋ | 33176/37963 [75:23:21<10:21:44,  7.79s/it]
 87%|████████▋ | 33177/37963 [75:23:29<10:19:34,  7.77s/it]
 87%|████████▋ | 33178/37963 [75:23:37<10:10:58,  7.66s/it]
 87%|████████▋ | 33179/37963 [75:23:44<10:09:24,  7.64s/it]
 87%|████████▋ | 33180/37963 [75:23:55<11:21:40,  8.55s/it]
                                                           
{'loss': '0.08804', 'grad_norm': '2.312', 'learning_rate': '8.214e-07', 'epoch': '0.874'}
+
 87%|████████▋ | 33180/37963 [75:23:55<11:21:40,  8.55s/it]
 87%|████████▋ | 33181/37963 [75:24:03<11:02:30,  8.31s/it]
 87%|████████▋ | 33182/37963 [75:24:11<10:52:45,  8.19s/it]
 87%|████████▋ | 33183/37963 [75:24:18<10:42:44,  8.07s/it]
 87%|████████▋ | 33184/37963 [75:24:26<10:37:07,  8.00s/it]
 87%|████████▋ | 33185/37963 [75:24:34<10:30:59,  7.92s/it]
 87%|████████▋ | 33186/37963 [75:24:42<10:36:06,  7.99s/it]
 87%|████████▋ | 33187/37963 [75:24:50<10:28:20,  7.89s/it]
 87%|████████▋ | 33188/37963 [75:24:57<10:23:44,  7.84s/it]
 87%|████████▋ | 33189/37963 [75:25:05<10:16:08,  7.74s/it]
 87%|████████▋ | 33190/37963 [75:25:13<10:15:10,  7.73s/it]
                                                           
{'loss': '0.09067', 'grad_norm': '2.915', 'learning_rate': '8.18e-07', 'epoch': '0.8743'}
+
 87%|████████▋ | 33190/37963 [75:25:13<10:15:10,  7.73s/it]
 87%|████████▋ | 33191/37963 [75:25:20<10:13:48,  7.72s/it]
 87%|████████▋ | 33192/37963 [75:25:28<10:07:54,  7.65s/it]
 87%|████████▋ | 33193/37963 [75:25:38<11:10:52,  8.44s/it]
 87%|████████▋ | 33194/37963 [75:25:48<11:53:27,  8.98s/it]
 87%|████████▋ | 33195/37963 [75:25:59<12:22:01,  9.34s/it]
 87%|████████▋ | 33196/37963 [75:26:06<11:46:46,  8.90s/it]
 87%|████████▋ | 33197/37963 [75:26:14<11:22:59,  8.60s/it]
 87%|████████▋ | 33198/37963 [75:26:22<11:09:34,  8.43s/it]
 87%|████████▋ | 33199/37963 [75:26:30<10:53:15,  8.23s/it]
 87%|████████▋ | 33200/37963 [75:26:38<10:45:53,  8.14s/it]
                                                           
{'loss': '0.09451', 'grad_norm': '4.55', 'learning_rate': '8.146e-07', 'epoch': '0.8745'}
+
 87%|████████▋ | 33200/37963 [75:26:38<10:45:53,  8.14s/it]
 87%|████████▋ | 33201/37963 [75:26:46<10:35:03,  8.00s/it]
 87%|████████▋ | 33202/37963 [75:26:53<10:29:20,  7.93s/it]
 87%|████████▋ | 33203/37963 [75:27:01<10:22:10,  7.84s/it]
 87%|████████▋ | 33204/37963 [75:27:09<10:18:14,  7.79s/it]
 87%|████████▋ | 33205/37963 [75:27:16<10:15:17,  7.76s/it]
 87%|████████▋ | 33206/37963 [75:27:24<10:16:15,  7.77s/it]
 87%|████████▋ | 33207/37963 [75:27:32<10:12:20,  7.73s/it]
 87%|████████▋ | 33208/37963 [75:27:39<10:05:02,  7.63s/it]
 87%|████████▋ | 33209/37963 [75:27:50<11:07:45,  8.43s/it]
 87%|████████▋ | 33210/37963 [75:27:57<10:54:21,  8.26s/it]
                                                           
{'loss': '0.0926', 'grad_norm': '5.148', 'learning_rate': '8.113e-07', 'epoch': '0.8748'}
+
 87%|████████▋ | 33210/37963 [75:27:57<10:54:21,  8.26s/it]
 87%|████████▋ | 33211/37963 [75:28:05<10:30:34,  7.96s/it]
 87%|████████▋ | 33212/37963 [75:28:12<10:19:32,  7.82s/it]
 87%|████████▋ | 33213/37963 [75:28:20<10:17:02,  7.79s/it]
 87%|████████▋ | 33214/37963 [75:28:33<12:27:38,  9.45s/it]
 87%|████████▋ | 33215/37963 [75:28:41<11:48:47,  8.96s/it]
 87%|████████▋ | 33216/37963 [75:28:49<11:19:29,  8.59s/it]
 87%|████████▋ | 33217/37963 [75:28:57<10:59:01,  8.33s/it]
 88%|████████▊ | 33218/37963 [75:29:04<10:49:28,  8.21s/it]
 88%|████████▊ | 33219/37963 [75:29:15<11:43:21,  8.90s/it]
 88%|████████▊ | 33220/37963 [75:29:23<11:22:16,  8.63s/it]
                                                           
{'loss': '0.09738', 'grad_norm': '3.464', 'learning_rate': '8.079e-07', 'epoch': '0.8751'}
+
 88%|████████▊ | 33220/37963 [75:29:23<11:22:16,  8.63s/it]
 88%|████████▊ | 33221/37963 [75:29:31<11:03:13,  8.39s/it]
 88%|████████▊ | 33222/37963 [75:29:38<10:42:20,  8.13s/it]
 88%|████████▊ | 33223/37963 [75:29:49<11:39:46,  8.86s/it]
 88%|████████▊ | 33224/37963 [75:29:57<11:16:37,  8.57s/it]
 88%|████████▊ | 33225/37963 [75:30:05<10:59:08,  8.35s/it]
 88%|████████▊ | 33226/37963 [75:30:12<10:43:15,  8.15s/it]
 88%|████████▊ | 33227/37963 [75:30:20<10:31:35,  8.00s/it]
 88%|████████▊ | 33228/37963 [75:30:28<10:28:42,  7.97s/it]
 88%|████████▊ | 33229/37963 [75:30:36<10:22:23,  7.89s/it]
 88%|████████▊ | 33230/37963 [75:30:43<10:21:51,  7.88s/it]
                                                           
{'loss': '0.09138', 'grad_norm': '2.522', 'learning_rate': '8.045e-07', 'epoch': '0.8753'}
+
 88%|████████▊ | 33230/37963 [75:30:43<10:21:51,  7.88s/it]
 88%|████████▊ | 33231/37963 [75:30:51<10:19:15,  7.85s/it]
 88%|████████▊ | 33232/37963 [75:30:59<10:10:33,  7.74s/it]
 88%|████████▊ | 33233/37963 [75:31:06<9:59:25,  7.60s/it] 
 88%|████████▊ | 33234/37963 [75:31:14<9:59:42,  7.61s/it]
 88%|████████▊ | 33235/37963 [75:31:21<10:02:48,  7.65s/it]
 88%|████████▊ | 33236/37963 [75:31:32<11:05:17,  8.44s/it]
 88%|████████▊ | 33237/37963 [75:31:40<10:52:33,  8.28s/it]
 88%|████████▊ | 33238/37963 [75:31:47<10:36:03,  8.08s/it]
 88%|████████▊ | 33239/37963 [75:31:57<11:25:16,  8.70s/it]
 88%|████████▊ | 33240/37963 [75:32:05<11:01:58,  8.41s/it]
                                                           
{'loss': '0.1059', 'grad_norm': '3.758', 'learning_rate': '8.012e-07', 'epoch': '0.8756'}
+
 88%|████████▊ | 33240/37963 [75:32:05<11:01:58,  8.41s/it]
 88%|████████▊ | 33241/37963 [75:32:15<11:47:03,  8.98s/it]
 88%|████████▊ | 33242/37963 [75:32:23<11:21:19,  8.66s/it]
 88%|████████▊ | 33243/37963 [75:32:31<10:51:32,  8.28s/it]
 88%|████████▊ | 33244/37963 [75:32:38<10:38:58,  8.12s/it]
 88%|████████▊ | 33245/37963 [75:32:46<10:34:14,  8.07s/it]
 88%|████████▊ | 33246/37963 [75:32:54<10:29:48,  8.01s/it]
 88%|████████▊ | 33247/37963 [75:33:02<10:18:26,  7.87s/it]
 88%|████████▊ | 33248/37963 [75:33:09<10:14:25,  7.82s/it]
 88%|████████▊ | 33249/37963 [75:33:17<10:10:06,  7.77s/it]
 88%|████████▊ | 33250/37963 [75:33:24<9:59:46,  7.64s/it] 
                                                          
{'loss': '0.09324', 'grad_norm': '3.474', 'learning_rate': '7.979e-07', 'epoch': '0.8759'}
+
 88%|████████▊ | 33250/37963 [75:33:24<9:59:46,  7.64s/it]
 88%|████████▊ | 33251/37963 [75:33:32<10:01:33,  7.66s/it]
 88%|████████▊ | 33252/37963 [75:33:40<10:05:09,  7.71s/it]
 88%|████████▊ | 33253/37963 [75:33:48<10:05:20,  7.71s/it]
 88%|████████▊ | 33254/37963 [75:33:55<10:06:30,  7.73s/it]
 88%|████████▊ | 33255/37963 [75:34:03<9:56:05,  7.60s/it] 
 88%|████████▊ | 33256/37963 [75:34:10<9:58:11,  7.63s/it]
 88%|████████▊ | 33257/37963 [75:34:18<9:55:47,  7.60s/it]
 88%|████████▊ | 33258/37963 [75:34:29<11:06:02,  8.49s/it]
 88%|████████▊ | 33259/37963 [75:34:36<10:47:08,  8.25s/it]
 88%|████████▊ | 33260/37963 [75:34:44<10:30:27,  8.04s/it]
                                                           
{'loss': '0.09343', 'grad_norm': '3.121', 'learning_rate': '7.945e-07', 'epoch': '0.8761'}
+
 88%|████████▊ | 33260/37963 [75:34:44<10:30:27,  8.04s/it]
 88%|████████▊ | 33261/37963 [75:34:51<10:21:50,  7.94s/it]
 88%|████████▊ | 33262/37963 [75:35:02<11:26:44,  8.77s/it]
 88%|████████▊ | 33263/37963 [75:35:10<11:01:05,  8.44s/it]
 88%|████████▊ | 33264/37963 [75:35:18<10:43:42,  8.22s/it]
 88%|████████▊ | 33265/37963 [75:35:25<10:33:09,  8.09s/it]
 88%|████████▊ | 33266/37963 [75:35:36<11:26:49,  8.77s/it]
 88%|████████▊ | 33267/37963 [75:35:46<12:06:25,  9.28s/it]
 88%|████████▊ | 33268/37963 [75:35:57<12:35:59,  9.66s/it]
 88%|████████▊ | 33269/37963 [75:36:04<11:50:22,  9.08s/it]
 88%|████████▊ | 33270/37963 [75:36:12<11:22:10,  8.72s/it]
                                                           
{'loss': '0.09007', 'grad_norm': '3.252', 'learning_rate': '7.912e-07', 'epoch': '0.8764'}
+
 88%|████████▊ | 33270/37963 [75:36:12<11:22:10,  8.72s/it]
 88%|████████▊ | 33271/37963 [75:36:20<11:00:25,  8.45s/it]
 88%|████████▊ | 33272/37963 [75:36:28<10:40:49,  8.20s/it]
 88%|████████▊ | 33273/37963 [75:36:36<10:31:18,  8.08s/it]
 88%|████████▊ | 33274/37963 [75:36:43<10:18:09,  7.91s/it]
 88%|████████▊ | 33275/37963 [75:36:51<10:09:55,  7.81s/it]
 88%|████████▊ | 33276/37963 [75:36:59<10:14:08,  7.86s/it]
 88%|████████▊ | 33277/37963 [75:37:06<10:12:57,  7.85s/it]
 88%|████████▊ | 33278/37963 [75:37:14<10:07:20,  7.78s/it]
 88%|████████▊ | 33279/37963 [75:37:22<10:05:25,  7.76s/it]
 88%|████████▊ | 33280/37963 [75:37:29<10:00:52,  7.70s/it]
                                                           
{'loss': '0.08519', 'grad_norm': '3.12', 'learning_rate': '7.879e-07', 'epoch': '0.8766'}
+
 88%|████████▊ | 33280/37963 [75:37:29<10:00:52,  7.70s/it]
 88%|████████▊ | 33281/37963 [75:37:37<10:00:45,  7.70s/it]
 88%|████████▊ | 33282/37963 [75:37:45<10:01:36,  7.71s/it]
 88%|████████▊ | 33283/37963 [75:37:52<9:59:23,  7.68s/it] 
 88%|████████▊ | 33284/37963 [75:38:00<10:02:46,  7.73s/it]
 88%|████████▊ | 33285/37963 [75:38:11<11:07:39,  8.56s/it]
 88%|████████▊ | 33286/37963 [75:38:18<10:39:41,  8.21s/it]
 88%|████████▊ | 33287/37963 [75:38:25<10:17:39,  7.93s/it]
 88%|████████▊ | 33288/37963 [75:38:33<10:14:43,  7.89s/it]
 88%|████████▊ | 33289/37963 [75:38:46<12:14:53,  9.43s/it]
 88%|████████▊ | 33290/37963 [75:38:54<11:32:03,  8.89s/it]
                                                           
{'loss': '0.08926', 'grad_norm': '3.917', 'learning_rate': '7.846e-07', 'epoch': '0.8769'}
+
 88%|████████▊ | 33290/37963 [75:38:54<11:32:03,  8.89s/it]
 88%|████████▊ | 33291/37963 [75:39:01<10:51:52,  8.37s/it]
 88%|████████▊ | 33292/37963 [75:39:09<10:41:30,  8.24s/it]
 88%|████████▊ | 33293/37963 [75:39:17<10:27:23,  8.06s/it]
 88%|████████▊ | 33294/37963 [75:39:24<10:14:30,  7.90s/it]
 88%|████████▊ | 33295/37963 [75:39:32<10:09:38,  7.84s/it]
 88%|████████▊ | 33296/37963 [75:39:40<10:09:54,  7.84s/it]
 88%|████████▊ | 33297/37963 [75:39:47<10:04:48,  7.78s/it]
 88%|████████▊ | 33298/37963 [75:39:55<10:04:14,  7.77s/it]
 88%|████████▊ | 33299/37963 [75:40:03<10:01:51,  7.74s/it]
 88%|████████▊ | 33300/37963 [75:40:10<9:51:47,  7.61s/it] 
                                                          
{'loss': '0.07941', 'grad_norm': '4.797', 'learning_rate': '7.812e-07', 'epoch': '0.8772'}
+
 88%|████████▊ | 33300/37963 [75:40:10<9:51:47,  7.61s/it]
 88%|████████▊ | 33301/37963 [75:40:21<11:02:11,  8.52s/it]
 88%|████████▊ | 33302/37963 [75:40:28<10:35:19,  8.18s/it]
 88%|████████▊ | 33303/37963 [75:40:36<10:27:55,  8.08s/it]
 88%|████████▊ | 33304/37963 [75:40:44<10:17:59,  7.96s/it]
 88%|████████▊ | 33305/37963 [75:40:51<10:12:47,  7.89s/it]
 88%|████████▊ | 33306/37963 [75:40:59<10:03:11,  7.77s/it]
 88%|████████▊ | 33307/37963 [75:41:07<10:07:00,  7.82s/it]
 88%|████████▊ | 33308/37963 [75:41:15<10:08:08,  7.84s/it]
 88%|████████▊ | 33309/37963 [75:41:22<10:05:51,  7.81s/it]
 88%|████████▊ | 33310/37963 [75:41:30<10:08:47,  7.85s/it]
                                                           
{'loss': '0.08665', 'grad_norm': '3.434', 'learning_rate': '7.779e-07', 'epoch': '0.8774'}
+
 88%|████████▊ | 33310/37963 [75:41:30<10:08:47,  7.85s/it]
 88%|████████▊ | 33311/37963 [75:41:38<10:09:54,  7.87s/it]
 88%|████████▊ | 33312/37963 [75:41:46<10:05:28,  7.81s/it]
 88%|████████▊ | 33313/37963 [75:41:54<10:09:08,  7.86s/it]
 88%|████████▊ | 33314/37963 [75:42:01<9:58:49,  7.73s/it] 
 88%|████████▊ | 33315/37963 [75:42:09<9:57:14,  7.71s/it]
 88%|████████▊ | 33316/37963 [75:42:19<11:00:05,  8.52s/it]
 88%|████████▊ | 33317/37963 [75:42:27<10:46:37,  8.35s/it]
 88%|████████▊ | 33318/37963 [75:42:38<11:32:15,  8.94s/it]
 88%|████████▊ | 33319/37963 [75:42:45<11:01:17,  8.54s/it]
 88%|████████▊ | 33320/37963 [75:42:53<10:44:19,  8.33s/it]
                                                           
{'loss': '0.09501', 'grad_norm': '2.922', 'learning_rate': '7.746e-07', 'epoch': '0.8777'}
+
 88%|████████▊ | 33320/37963 [75:42:53<10:44:19,  8.33s/it]
 88%|████████▊ | 33321/37963 [75:43:04<11:39:38,  9.04s/it]
 88%|████████▊ | 33322/37963 [75:43:15<12:22:03,  9.59s/it]
 88%|████████▊ | 33323/37963 [75:43:22<11:39:11,  9.04s/it]
 88%|████████▊ | 33324/37963 [75:43:30<11:09:12,  8.66s/it]
 88%|████████▊ | 33325/37963 [75:43:38<10:50:38,  8.42s/it]
 88%|████████▊ | 33326/37963 [75:43:46<10:37:08,  8.24s/it]
 88%|████████▊ | 33327/37963 [75:43:54<10:23:57,  8.08s/it]
 88%|████████▊ | 33328/37963 [75:44:04<11:15:09,  8.74s/it]
 88%|████████▊ | 33329/37963 [75:44:12<10:55:58,  8.49s/it]
 88%|████████▊ | 33330/37963 [75:44:19<10:38:04,  8.26s/it]
                                                           
{'loss': '0.09935', 'grad_norm': '3.188', 'learning_rate': '7.714e-07', 'epoch': '0.878'}
+
 88%|████████▊ | 33330/37963 [75:44:19<10:38:04,  8.26s/it]
 88%|████████▊ | 33331/37963 [75:44:27<10:22:46,  8.07s/it]
 88%|████████▊ | 33332/37963 [75:44:35<10:15:43,  7.98s/it]
 88%|████████▊ | 33333/37963 [75:44:43<10:13:11,  7.95s/it]
 88%|████████▊ | 33334/37963 [75:44:51<10:12:09,  7.93s/it]
 88%|████████▊ | 33335/37963 [75:45:01<11:07:50,  8.66s/it]
 88%|████████▊ | 33336/37963 [75:45:09<10:50:16,  8.43s/it]
 88%|████████▊ | 33337/37963 [75:45:19<11:28:34,  8.93s/it]
 88%|████████▊ | 33338/37963 [75:45:27<11:01:15,  8.58s/it]
 88%|████████▊ | 33339/37963 [75:45:35<10:44:48,  8.37s/it]
 88%|████████▊ | 33340/37963 [75:45:42<10:29:57,  8.18s/it]
                                                           
{'loss': '0.09477', 'grad_norm': '2.358', 'learning_rate': '7.681e-07', 'epoch': '0.8782'}
+
 88%|████████▊ | 33340/37963 [75:45:42<10:29:57,  8.18s/it]
 88%|████████▊ | 33341/37963 [75:45:50<10:21:22,  8.07s/it]
 88%|████████▊ | 33342/37963 [75:45:58<10:08:01,  7.89s/it]
 88%|████████▊ | 33343/37963 [75:46:05<10:01:19,  7.81s/it]
 88%|████████▊ | 33344/37963 [75:46:13<9:56:28,  7.75s/it] 
 88%|████████▊ | 33345/37963 [75:46:23<11:02:04,  8.60s/it]
 88%|████████▊ | 33346/37963 [75:46:31<10:47:46,  8.42s/it]
 88%|████████▊ | 33347/37963 [75:46:39<10:35:33,  8.26s/it]
 88%|████████▊ | 33348/37963 [75:46:47<10:23:23,  8.10s/it]
 88%|████████▊ | 33349/37963 [75:46:55<10:14:51,  8.00s/it]
 88%|████████▊ | 33350/37963 [75:47:03<10:13:12,  7.98s/it]
                                                           
{'loss': '0.0992', 'grad_norm': '3.404', 'learning_rate': '7.648e-07', 'epoch': '0.8785'}
+
 88%|████████▊ | 33350/37963 [75:47:03<10:13:12,  7.98s/it]
 88%|████████▊ | 33351/37963 [75:47:10<10:04:46,  7.87s/it]
 88%|████████▊ | 33352/37963 [75:47:18<10:02:16,  7.84s/it]
 88%|████████▊ | 33353/37963 [75:47:26<9:58:07,  7.78s/it] 
 88%|████████▊ | 33354/37963 [75:47:34<9:56:53,  7.77s/it]
 88%|████████▊ | 33355/37963 [75:47:41<9:55:44,  7.76s/it]
 88%|████████▊ | 33356/37963 [75:47:49<9:54:43,  7.75s/it]
 88%|████████▊ | 33357/37963 [75:47:57<9:57:49,  7.79s/it]
 88%|████████▊ | 33358/37963 [75:48:05<9:56:25,  7.77s/it]
 88%|████████▊ | 33359/37963 [75:48:12<9:52:05,  7.72s/it]
 88%|████████▊ | 33360/37963 [75:48:20<9:51:55,  7.72s/it]
                                                          
{'loss': '0.07211', 'grad_norm': '2.687', 'learning_rate': '7.615e-07', 'epoch': '0.8788'}
+
 88%|████████▊ | 33360/37963 [75:48:20<9:51:55,  7.72s/it]
 88%|████████▊ | 33361/37963 [75:48:28<9:51:06,  7.71s/it]
 88%|████████▊ | 33362/37963 [75:48:35<9:52:01,  7.72s/it]
 88%|████████▊ | 33363/37963 [75:48:46<10:49:03,  8.47s/it]
 88%|████████▊ | 33364/37963 [75:48:53<10:30:04,  8.22s/it]
 88%|████████▊ | 33365/37963 [75:49:01<10:17:37,  8.06s/it]
 88%|████████▊ | 33366/37963 [75:49:08<10:05:18,  7.90s/it]
 88%|████████▊ | 33367/37963 [75:49:16<10:00:47,  7.84s/it]
 88%|████████▊ | 33368/37963 [75:49:24<10:01:45,  7.86s/it]
 88%|████████▊ | 33369/37963 [75:49:32<9:59:03,  7.82s/it] 
 88%|████████▊ | 33370/37963 [75:49:45<12:04:38,  9.47s/it]
                                                           
{'loss': '0.09329', 'grad_norm': '3.602', 'learning_rate': '7.583e-07', 'epoch': '0.879'}
+
 88%|████████▊ | 33370/37963 [75:49:45<12:04:38,  9.47s/it]
 88%|████████▊ | 33371/37963 [75:49:53<11:20:15,  8.89s/it]
 88%|████████▊ | 33372/37963 [75:50:00<10:50:58,  8.51s/it]
 88%|████████▊ | 33373/37963 [75:50:08<10:31:14,  8.25s/it]
 88%|████████▊ | 33374/37963 [75:50:15<10:07:52,  7.95s/it]
 88%|████████▊ | 33375/37963 [75:50:23<10:00:36,  7.85s/it]
 88%|████████▊ | 33376/37963 [75:50:33<11:03:37,  8.68s/it]
 88%|████████▊ | 33377/37963 [75:50:41<10:47:37,  8.47s/it]
 88%|████████▊ | 33378/37963 [75:50:49<10:32:36,  8.28s/it]
 88%|████████▊ | 33379/37963 [75:50:57<10:21:08,  8.13s/it]
 88%|████████▊ | 33380/37963 [75:51:04<10:06:19,  7.94s/it]
                                                           
{'loss': '0.09315', 'grad_norm': '3.122', 'learning_rate': '7.55e-07', 'epoch': '0.8793'}
+
 88%|████████▊ | 33380/37963 [75:51:04<10:06:19,  7.94s/it]
 88%|████████▊ | 33381/37963 [75:51:12<10:07:12,  7.95s/it]
 88%|████████▊ | 33382/37963 [75:51:23<10:59:57,  8.64s/it]
 88%|████████▊ | 33383/37963 [75:51:30<10:35:59,  8.33s/it]
 88%|████████▊ | 33384/37963 [75:51:38<10:28:30,  8.24s/it]
 88%|████████▊ | 33385/37963 [75:51:46<10:10:06,  8.00s/it]
 88%|████████▊ | 33386/37963 [75:51:56<11:02:33,  8.69s/it]
 88%|████████▊ | 33387/37963 [75:52:04<10:40:41,  8.40s/it]
 88%|████████▊ | 33388/37963 [75:52:11<10:23:13,  8.17s/it]
 88%|████████▊ | 33389/37963 [75:52:22<11:11:53,  8.81s/it]
 88%|████████▊ | 33390/37963 [75:52:29<10:45:24,  8.47s/it]
                                                           
{'loss': '0.08391', 'grad_norm': '3.925', 'learning_rate': '7.518e-07', 'epoch': '0.8795'}
+
 88%|████████▊ | 33390/37963 [75:52:29<10:45:24,  8.47s/it]
 88%|████████▊ | 33391/37963 [75:52:37<10:27:44,  8.24s/it]
 88%|████████▊ | 33392/37963 [75:52:45<10:18:30,  8.12s/it]
 88%|████████▊ | 33393/37963 [75:52:55<11:07:55,  8.77s/it]
 88%|████████▊ | 33394/37963 [75:53:03<10:47:16,  8.50s/it]
 88%|████████▊ | 33395/37963 [75:53:11<10:31:58,  8.30s/it]
 88%|████████▊ | 33396/37963 [75:53:19<10:23:08,  8.19s/it]
 88%|████████▊ | 33397/37963 [75:53:26<10:04:35,  7.94s/it]
 88%|████████▊ | 33398/37963 [75:53:34<9:55:21,  7.83s/it] 
 88%|████████▊ | 33399/37963 [75:53:42<9:58:54,  7.87s/it]
 88%|████████▊ | 33400/37963 [75:53:49<9:49:22,  7.75s/it]
                                                          
{'loss': '0.0864', 'grad_norm': '2.568', 'learning_rate': '7.485e-07', 'epoch': '0.8798'}
+
 88%|████████▊ | 33400/37963 [75:53:49<9:49:22,  7.75s/it]
 88%|████████▊ | 33401/37963 [75:53:57<9:45:24,  7.70s/it]
 88%|████████▊ | 33402/37963 [75:54:05<9:50:00,  7.76s/it]
 88%|████████▊ | 33403/37963 [75:54:13<9:58:14,  7.87s/it]
 88%|████████▊ | 33404/37963 [75:54:21<9:54:55,  7.83s/it]
 88%|████████▊ | 33405/37963 [75:54:28<9:53:11,  7.81s/it]
 88%|████████▊ | 33406/37963 [75:54:36<9:48:34,  7.75s/it]
 88%|████████▊ | 33407/37963 [75:54:44<9:46:53,  7.73s/it]
 88%|████████▊ | 33408/37963 [75:54:51<9:42:45,  7.68s/it]
 88%|████████▊ | 33409/37963 [75:54:59<9:45:22,  7.71s/it]
 88%|████████▊ | 33410/37963 [75:55:07<9:46:54,  7.73s/it]
                                                          
{'loss': '0.09501', 'grad_norm': '3.867', 'learning_rate': '7.453e-07', 'epoch': '0.8801'}
+
 88%|████████▊ | 33410/37963 [75:55:07<9:46:54,  7.73s/it]
 88%|████████▊ | 33411/37963 [75:55:17<10:47:32,  8.54s/it]
 88%|████████▊ | 33412/37963 [75:55:25<10:30:50,  8.32s/it]
 88%|████████▊ | 33413/37963 [75:55:35<11:19:20,  8.96s/it]
 88%|████████▊ | 33414/37963 [75:55:43<10:54:10,  8.63s/it]
 88%|████████▊ | 33415/37963 [75:55:51<10:36:10,  8.39s/it]
 88%|████████▊ | 33416/37963 [75:55:59<10:18:38,  8.16s/it]
 88%|████████▊ | 33417/37963 [75:56:06<10:07:18,  8.02s/it]
 88%|████████▊ | 33418/37963 [75:56:14<10:00:27,  7.93s/it]
 88%|████████▊ | 33419/37963 [75:56:22<9:59:08,  7.91s/it] 
 88%|████████▊ | 33420/37963 [75:56:30<9:50:50,  7.80s/it]
                                                          
{'loss': '0.09857', 'grad_norm': '3.571', 'learning_rate': '7.421e-07', 'epoch': '0.8803'}
+
 88%|████████▊ | 33420/37963 [75:56:30<9:50:50,  7.80s/it]
 88%|████████▊ | 33421/37963 [75:56:37<9:45:56,  7.74s/it]
 88%|████████▊ | 33422/37963 [75:56:45<9:44:01,  7.72s/it]
 88%|████████▊ | 33423/37963 [75:56:52<9:40:38,  7.67s/it]
 88%|████████▊ | 33424/37963 [75:57:03<10:44:00,  8.51s/it]
 88%|████████▊ | 33425/37963 [75:57:10<10:23:14,  8.24s/it]
 88%|████████▊ | 33426/37963 [75:57:18<10:04:02,  7.99s/it]
 88%|████████▊ | 33427/37963 [75:57:26<9:56:24,  7.89s/it] 
 88%|████████▊ | 33428/37963 [75:57:33<9:46:23,  7.76s/it]
 88%|████████▊ | 33429/37963 [75:57:41<9:45:56,  7.75s/it]
 88%|████████▊ | 33430/37963 [75:57:54<11:50:57,  9.41s/it]
                                                           
{'loss': '0.1028', 'grad_norm': '3.009', 'learning_rate': '7.388e-07', 'epoch': '0.8806'}
+
 88%|████████▊ | 33430/37963 [75:57:54<11:50:57,  9.41s/it]
 88%|████████▊ | 33431/37963 [75:58:04<12:13:21,  9.71s/it]
 88%|████████▊ | 33432/37963 [75:58:12<11:30:14,  9.14s/it]
 88%|████████▊ | 33433/37963 [75:58:20<10:55:48,  8.69s/it]
 88%|████████▊ | 33434/37963 [75:58:28<10:40:15,  8.48s/it]
 88%|████████▊ | 33435/37963 [75:58:36<10:30:36,  8.36s/it]
 88%|████████▊ | 33436/37963 [75:58:44<10:17:14,  8.18s/it]
 88%|████████▊ | 33437/37963 [75:58:51<10:02:32,  7.99s/it]
 88%|████████▊ | 33438/37963 [75:58:59<9:49:03,  7.81s/it] 
 88%|████████▊ | 33439/37963 [75:59:06<9:44:43,  7.76s/it]
 88%|████████▊ | 33440/37963 [75:59:14<9:47:06,  7.79s/it]
                                                          
{'loss': '0.08866', 'grad_norm': '3.038', 'learning_rate': '7.356e-07', 'epoch': '0.8809'}
+
 88%|████████▊ | 33440/37963 [75:59:14<9:47:06,  7.79s/it]
 88%|████████▊ | 33441/37963 [75:59:27<11:44:21,  9.35s/it]
 88%|████████▊ | 33442/37963 [75:59:35<11:10:44,  8.90s/it]
 88%|████████▊ | 33443/37963 [75:59:43<10:44:31,  8.56s/it]
 88%|████████▊ | 33444/37963 [75:59:50<10:24:35,  8.29s/it]
 88%|████████▊ | 33445/37963 [75:59:58<10:16:00,  8.18s/it]
 88%|████████▊ | 33446/37963 [76:00:06<10:08:34,  8.08s/it]
 88%|████████▊ | 33447/37963 [76:00:14<9:56:00,  7.92s/it] 
 88%|████████▊ | 33448/37963 [76:00:21<9:44:24,  7.77s/it]
 88%|████████▊ | 33449/37963 [76:00:29<9:46:00,  7.79s/it]
 88%|████████▊ | 33450/37963 [76:00:37<9:48:48,  7.83s/it]
                                                          
{'loss': '0.0929', 'grad_norm': '2.958', 'learning_rate': '7.324e-07', 'epoch': '0.8811'}
+
 88%|████████▊ | 33450/37963 [76:00:37<9:48:48,  7.83s/it]
 88%|████████▊ | 33451/37963 [76:00:45<9:46:16,  7.80s/it]
 88%|████████▊ | 33452/37963 [76:00:52<9:47:17,  7.81s/it]
 88%|████████▊ | 33453/37963 [76:01:00<9:49:53,  7.85s/it]
 88%|████████▊ | 33454/37963 [76:01:08<9:44:07,  7.77s/it]
 88%|████████▊ | 33455/37963 [76:01:18<10:43:12,  8.56s/it]
 88%|████████▊ | 33456/37963 [76:01:26<10:23:17,  8.30s/it]
 88%|████████▊ | 33457/37963 [76:01:37<11:13:38,  8.97s/it]
 88%|████████▊ | 33458/37963 [76:01:44<10:45:03,  8.59s/it]
 88%|████████▊ | 33459/37963 [76:01:52<10:30:23,  8.40s/it]
 88%|████████▊ | 33460/37963 [76:02:00<10:15:09,  8.20s/it]
                                                           
{'loss': '0.08488', 'grad_norm': '3.144', 'learning_rate': '7.292e-07', 'epoch': '0.8814'}
+
 88%|████████▊ | 33460/37963 [76:02:00<10:15:09,  8.20s/it]
 88%|████████▊ | 33461/37963 [76:02:08<10:04:37,  8.06s/it]
 88%|████████▊ | 33462/37963 [76:02:15<9:53:32,  7.91s/it] 
 88%|████████▊ | 33463/37963 [76:02:23<9:55:47,  7.94s/it]
 88%|████████▊ | 33464/37963 [76:02:31<9:54:01,  7.92s/it]
 88%|████████▊ | 33465/37963 [76:02:39<9:48:20,  7.85s/it]
 88%|████████▊ | 33466/37963 [76:02:47<9:44:25,  7.80s/it]
 88%|████████▊ | 33467/37963 [76:02:54<9:41:33,  7.76s/it]
 88%|████████▊ | 33468/37963 [76:03:02<9:43:50,  7.79s/it]
 88%|████████▊ | 33469/37963 [76:03:10<9:43:11,  7.79s/it]
 88%|████████▊ | 33470/37963 [76:03:18<9:49:32,  7.87s/it]
                                                          
{'loss': '0.09305', 'grad_norm': '2.827', 'learning_rate': '7.26e-07', 'epoch': '0.8817'}
+
 88%|████████▊ | 33470/37963 [76:03:18<9:49:32,  7.87s/it]
 88%|████████▊ | 33471/37963 [76:03:26<9:44:35,  7.81s/it]
 88%|████████▊ | 33472/37963 [76:03:33<9:44:20,  7.81s/it]
 88%|████████▊ | 33473/37963 [76:03:44<10:44:58,  8.62s/it]
 88%|████████▊ | 33474/37963 [76:03:52<10:25:57,  8.37s/it]
 88%|████████▊ | 33475/37963 [76:03:59<10:05:58,  8.10s/it]
 88%|████████▊ | 33476/37963 [76:04:07<9:55:45,  7.97s/it] 
 88%|████████▊ | 33477/37963 [76:04:15<9:54:20,  7.95s/it]
 88%|████████▊ | 33478/37963 [76:04:22<9:47:56,  7.87s/it]
 88%|████████▊ | 33479/37963 [76:04:30<9:42:54,  7.80s/it]
 88%|████████▊ | 33480/37963 [76:04:38<9:41:05,  7.78s/it]
                                                          
{'loss': '0.1014', 'grad_norm': '3.065', 'learning_rate': '7.228e-07', 'epoch': '0.8819'}
+
 88%|████████▊ | 33480/37963 [76:04:38<9:41:05,  7.78s/it]
 88%|████████▊ | 33481/37963 [76:04:45<9:38:19,  7.74s/it]
 88%|████████▊ | 33482/37963 [76:04:53<9:28:11,  7.61s/it]
 88%|████████▊ | 33483/37963 [76:05:03<10:36:17,  8.52s/it]
 88%|████████▊ | 33484/37963 [76:05:16<12:06:52,  9.74s/it]
 88%|████████▊ | 33485/37963 [76:05:24<11:25:05,  9.18s/it]
 88%|████████▊ | 33486/37963 [76:05:31<10:52:05,  8.74s/it]
 88%|████████▊ | 33487/37963 [76:05:39<10:34:17,  8.50s/it]
 88%|████████▊ | 33488/37963 [76:05:50<11:17:47,  9.09s/it]
 88%|████████▊ | 33489/37963 [76:05:58<10:49:16,  8.71s/it]
 88%|████████▊ | 33490/37963 [76:06:05<10:22:04,  8.34s/it]
                                                           
{'loss': '0.1051', 'grad_norm': '3.723', 'learning_rate': '7.196e-07', 'epoch': '0.8822'}
+
 88%|████████▊ | 33490/37963 [76:06:05<10:22:04,  8.34s/it]
 88%|████████▊ | 33491/37963 [76:06:13<10:05:37,  8.13s/it]
 88%|████████▊ | 33492/37963 [76:06:21<10:01:30,  8.07s/it]
 88%|████████▊ | 33493/37963 [76:06:29<9:55:09,  7.99s/it] 
 88%|████████▊ | 33494/37963 [76:06:37<9:56:28,  8.01s/it]
 88%|████████▊ | 33495/37963 [76:06:47<10:54:57,  8.80s/it]
 88%|████████▊ | 33496/37963 [76:06:55<10:31:32,  8.48s/it]
 88%|████████▊ | 33497/37963 [76:07:03<10:11:59,  8.22s/it]
 88%|████████▊ | 33498/37963 [76:07:10<9:57:33,  8.03s/it] 
 88%|████████▊ | 33499/37963 [76:07:20<10:46:40,  8.69s/it]
 88%|████████▊ | 33500/37963 [76:07:28<10:27:26,  8.44s/it]
                                                           
{'loss': '0.0746', 'grad_norm': '3.138', 'learning_rate': '7.165e-07', 'epoch': '0.8824'}
+
 88%|████████▊ | 33500/37963 [76:07:28<10:27:26,  8.44s/it]
 88%|████████▊ | 33501/37963 [76:07:36<10:09:29,  8.20s/it]
 88%|████████▊ | 33502/37963 [76:07:44<9:57:47,  8.04s/it] 
 88%|████████▊ | 33503/37963 [76:07:52<9:54:50,  8.00s/it]
 88%|████████▊ | 33504/37963 [76:07:59<9:54:10,  8.00s/it]
 88%|████████▊ | 33505/37963 [76:08:07<9:48:28,  7.92s/it]
 88%|████████▊ | 33506/37963 [76:08:15<9:44:54,  7.87s/it]
 88%|████████▊ | 33507/37963 [76:08:23<9:38:06,  7.78s/it]
 88%|████████▊ | 33508/37963 [76:08:30<9:35:29,  7.75s/it]
 88%|████████▊ | 33509/37963 [76:08:38<9:37:28,  7.78s/it]
 88%|████████▊ | 33510/37963 [76:08:46<9:36:09,  7.76s/it]
                                                          
{'loss': '0.09657', 'grad_norm': '3.25', 'learning_rate': '7.133e-07', 'epoch': '0.8827'}
+
 88%|████████▊ | 33510/37963 [76:08:46<9:36:09,  7.76s/it]
 88%|████████▊ | 33511/37963 [76:08:56<10:37:21,  8.59s/it]
 88%|████████▊ | 33512/37963 [76:09:04<10:13:16,  8.27s/it]
 88%|████████▊ | 33513/37963 [76:09:11<9:58:46,  8.07s/it] 
 88%|████████▊ | 33514/37963 [76:09:19<9:52:52,  8.00s/it]
 88%|████████▊ | 33515/37963 [76:09:27<9:48:55,  7.94s/it]
 88%|████████▊ | 33516/37963 [76:09:38<10:52:03,  8.80s/it]
 88%|████████▊ | 33517/37963 [76:09:46<10:26:53,  8.46s/it]
 88%|████████▊ | 33518/37963 [76:09:54<10:15:51,  8.31s/it]
 88%|████████▊ | 33519/37963 [76:10:01<10:03:41,  8.15s/it]
 88%|████████▊ | 33520/37963 [76:10:09<9:58:22,  8.08s/it] 
                                                          
{'loss': '0.09906', 'grad_norm': '3.616', 'learning_rate': '7.101e-07', 'epoch': '0.883'}
+
 88%|████████▊ | 33520/37963 [76:10:09<9:58:22,  8.08s/it]
 88%|████████▊ | 33521/37963 [76:10:17<9:51:20,  7.99s/it]
 88%|████████▊ | 33522/37963 [76:10:25<9:45:56,  7.92s/it]
 88%|████████▊ | 33523/37963 [76:10:33<9:51:44,  8.00s/it]
 88%|████████▊ | 33524/37963 [76:10:41<9:48:13,  7.95s/it]
 88%|████████▊ | 33525/37963 [76:10:49<9:43:02,  7.88s/it]
 88%|████████▊ | 33526/37963 [76:10:56<9:39:04,  7.83s/it]
 88%|████████▊ | 33527/37963 [76:11:04<9:43:52,  7.90s/it]
 88%|████████▊ | 33528/37963 [76:11:12<9:36:48,  7.80s/it]
 88%|████████▊ | 33529/37963 [76:11:20<9:40:50,  7.86s/it]
 88%|████████▊ | 33530/37963 [76:11:28<9:36:47,  7.81s/it]
                                                          
{'loss': '0.09202', 'grad_norm': '3.249', 'learning_rate': '7.07e-07', 'epoch': '0.8832'}
+
 88%|████████▊ | 33530/37963 [76:11:28<9:36:47,  7.81s/it]
 88%|████████▊ | 33531/37963 [76:11:35<9:35:13,  7.79s/it]
 88%|████████▊ | 33532/37963 [76:11:43<9:38:46,  7.84s/it]
 88%|████████▊ | 33533/37963 [76:11:54<10:34:47,  8.60s/it]
 88%|████████▊ | 33534/37963 [76:12:01<10:12:54,  8.30s/it]
 88%|████████▊ | 33535/37963 [76:12:09<10:02:40,  8.17s/it]
 88%|████████▊ | 33536/37963 [76:12:19<10:50:54,  8.82s/it]
 88%|████████▊ | 33537/37963 [76:12:30<11:28:22,  9.33s/it]
 88%|████████▊ | 33538/37963 [76:12:40<11:53:34,  9.68s/it]
 88%|████████▊ | 33539/37963 [76:12:48<11:11:23,  9.11s/it]
 88%|████████▊ | 33540/37963 [76:12:56<10:37:52,  8.65s/it]
                                                           
{'loss': '0.08827', 'grad_norm': '3.451', 'learning_rate': '7.038e-07', 'epoch': '0.8835'}
+
 88%|████████▊ | 33540/37963 [76:12:56<10:37:52,  8.65s/it]
 88%|████████�� | 33541/37963 [76:13:04<10:17:42,  8.38s/it]
 88%|████████▊ | 33542/37963 [76:13:11<10:00:33,  8.15s/it]
 88%|████████▊ | 33543/37963 [76:13:19<9:44:53,  7.94s/it] 
 88%|████████▊ | 33544/37963 [76:13:26<9:34:03,  7.79s/it]
 88%|████████▊ | 33545/37963 [76:13:34<9:31:48,  7.77s/it]
 88%|████████▊ | 33546/37963 [76:13:44<10:23:08,  8.46s/it]
 88%|████████▊ | 33547/37963 [76:13:52<10:08:02,  8.26s/it]
 88%|████████▊ | 33548/37963 [76:13:59<9:53:18,  8.06s/it] 
 88%|████████▊ | 33549/37963 [76:14:10<10:48:33,  8.82s/it]
 88%|████████▊ | 33550/37963 [76:14:18<10:27:48,  8.54s/it]
                                                           
{'loss': '0.09454', 'grad_norm': '3.137', 'learning_rate': '7.007e-07', 'epoch': '0.8838'}
+
 88%|████████▊ | 33550/37963 [76:14:18<10:27:48,  8.54s/it]
 88%|████████▊ | 33551/37963 [76:14:26<10:13:19,  8.34s/it]
 88%|████████▊ | 33552/37963 [76:14:33<10:03:34,  8.21s/it]
 88%|████████▊ | 33553/37963 [76:14:41<9:51:01,  8.04s/it] 
 88%|████████▊ | 33554/37963 [76:14:49<9:42:37,  7.93s/it]
 88%|████████▊ | 33555/37963 [76:14:59<10:34:21,  8.63s/it]
 88%|████████▊ | 33556/37963 [76:15:07<10:14:18,  8.36s/it]
 88%|████████▊ | 33557/37963 [76:15:15<10:05:30,  8.25s/it]
 88%|████████▊ | 33558/37963 [76:15:23<9:56:39,  8.13s/it] 
 88%|████████▊ | 33559/37963 [76:15:30<9:48:38,  8.02s/it]
 88%|████████▊ | 33560/37963 [76:15:41<10:47:55,  8.83s/it]
                                                           
{'loss': '0.09742', 'grad_norm': '2.248', 'learning_rate': '6.976e-07', 'epoch': '0.884'}
+
 88%|████████▊ | 33560/37963 [76:15:41<10:47:55,  8.83s/it]
 88%|████████▊ | 33561/37963 [76:15:49<10:23:26,  8.50s/it]
 88%|████████▊ | 33562/37963 [76:15:57<10:06:18,  8.27s/it]
 88%|████████▊ | 33563/37963 [76:16:04<9:50:00,  8.05s/it] 
 88%|████████▊ | 33564/37963 [76:16:11<9:35:20,  7.85s/it]
 88%|████████▊ | 33565/37963 [76:16:19<9:32:44,  7.81s/it]
 88%|████████▊ | 33566/37963 [76:16:27<9:30:39,  7.79s/it]
 88%|████████▊ | 33567/37963 [76:16:35<9:30:23,  7.79s/it]
 88%|████████▊ | 33568/37963 [76:16:43<9:32:56,  7.82s/it]
 88%|████████▊ | 33569/37963 [76:16:51<9:35:48,  7.86s/it]
 88%|████████▊ | 33570/37963 [76:16:58<9:32:18,  7.82s/it]
                                                          
{'loss': '0.08358', 'grad_norm': '3.097', 'learning_rate': '6.944e-07', 'epoch': '0.8843'}
+
 88%|████████▊ | 33570/37963 [76:16:58<9:32:18,  7.82s/it]
 88%|████████▊ | 33571/37963 [76:17:06<9:30:37,  7.80s/it]
 88%|████████▊ | 33572/37963 [76:17:14<9:30:02,  7.79s/it]
 88%|████████▊ | 33573/37963 [76:17:21<9:27:36,  7.76s/it]
 88%|████████▊ | 33574/37963 [76:17:29<9:25:56,  7.74s/it]
 88%|████████▊ | 33575/37963 [76:17:37<9:29:51,  7.79s/it]
 88%|████████▊ | 33576/37963 [76:17:47<10:21:52,  8.51s/it]
 88%|████████▊ | 33577/37963 [76:17:55<9:58:54,  8.19s/it] 
 88%|████████▊ | 33578/37963 [76:18:02<9:38:55,  7.92s/it]
 88%|████████▊ | 33579/37963 [76:18:10<9:32:30,  7.84s/it]
 88%|████████▊ | 33580/37963 [76:18:20<10:28:01,  8.60s/it]
                                                           
{'loss': '0.09701', 'grad_norm': '3.413', 'learning_rate': '6.913e-07', 'epoch': '0.8845'}
+
 88%|████████▊ | 33580/37963 [76:18:20<10:28:01,  8.60s/it]
 88%|████████▊ | 33581/37963 [76:18:28<10:09:50,  8.35s/it]
 88%|████████▊ | 33582/37963 [76:18:35<9:54:24,  8.14s/it] 
 88%|████████▊ | 33583/37963 [76:18:43<9:43:32,  7.99s/it]
 88%|████████▊ | 33584/37963 [76:18:51<9:44:00,  8.00s/it]
 88%|████████▊ | 33585/37963 [76:18:59<9:34:54,  7.88s/it]
 88%|████████▊ | 33586/37963 [76:19:07<9:35:35,  7.89s/it]
 88%|████████▊ | 33587/37963 [76:19:14<9:32:36,  7.85s/it]
 88%|████████▊ | 33588/37963 [76:19:22<9:28:10,  7.79s/it]
 88%|████████▊ | 33589/37963 [76:19:30<9:24:52,  7.75s/it]
 88%|████████▊ | 33590/37963 [76:19:38<9:29:43,  7.82s/it]
                                                          
{'loss': '0.09143', 'grad_norm': '3.582', 'learning_rate': '6.882e-07', 'epoch': '0.8848'}
+
 88%|████████▊ | 33590/37963 [76:19:38<9:29:43,  7.82s/it]
 88%|████████▊ | 33591/37963 [76:19:48<10:30:02,  8.65s/it]
 88%|████████▊ | 33592/37963 [76:20:01<12:08:29, 10.00s/it]
 88%|████████▊ | 33593/37963 [76:20:09<11:19:56,  9.34s/it]
 88%|████████▊ | 33594/37963 [76:20:17<10:44:34,  8.85s/it]
 88%|████████▊ | 33595/37963 [76:20:25<10:20:19,  8.52s/it]
 88%|████████▊ | 33596/37963 [76:20:32<10:03:03,  8.29s/it]
 88%|████████▊ | 33597/37963 [76:20:40<9:48:40,  8.09s/it] 
 89%|████████▊ | 33598/37963 [76:20:51<10:46:20,  8.88s/it]
 89%|████████▊ | 33599/37963 [76:20:59<10:21:03,  8.54s/it]
 89%|████████▊ | 33600/37963 [76:21:06<10:07:09,  8.35s/it]
                                                           
{'loss': '0.08295', 'grad_norm': '3.022', 'learning_rate': '6.851e-07', 'epoch': '0.8851'}
+
 89%|████████▊ | 33600/37963 [76:21:06<10:07:09,  8.35s/it]
 89%|████████▊ | 33601/37963 [76:21:14<9:54:43,  8.18s/it] 
 89%|████████▊ | 33602/37963 [76:21:22<9:48:18,  8.09s/it]
 89%|████████▊ | 33603/37963 [76:21:32<10:33:45,  8.72s/it]
 89%|████████▊ | 33604/37963 [76:21:40<10:12:52,  8.44s/it]
 89%|████████▊ | 33605/37963 [76:21:48<9:51:33,  8.14s/it] 
 89%|████████▊ | 33606/37963 [76:21:55<9:47:47,  8.09s/it]
 89%|████████▊ | 33607/37963 [76:22:03<9:39:36,  7.98s/it]
 89%|████████▊ | 33608/37963 [76:22:11<9:32:01,  7.88s/it]
 89%|████████▊ | 33609/37963 [76:22:22<10:35:57,  8.76s/it]
 89%|████████▊ | 33610/37963 [76:22:29<10:13:03,  8.45s/it]
                                                           
{'loss': '0.08774', 'grad_norm': '3.177', 'learning_rate': '6.82e-07', 'epoch': '0.8853'}
+
 89%|████████▊ | 33610/37963 [76:22:29<10:13:03,  8.45s/it]
 89%|████████▊ | 33611/37963 [76:22:37<9:51:58,  8.16s/it] 
 89%|████████▊ | 33612/37963 [76:22:45<9:45:50,  8.08s/it]
 89%|████████▊ | 33613/37963 [76:22:53<9:39:01,  7.99s/it]
 89%|████████▊ | 33614/37963 [76:23:00<9:34:52,  7.93s/it]
 89%|████████▊ | 33615/37963 [76:23:08<9:29:44,  7.86s/it]
 89%|████████▊ | 33616/37963 [76:23:16<9:27:57,  7.84s/it]
 89%|████████▊ | 33617/37963 [76:23:24<9:33:48,  7.92s/it]
 89%|████████▊ | 33618/37963 [76:23:32<9:35:45,  7.95s/it]
 89%|████████▊ | 33619/37963 [76:23:40<9:33:53,  7.93s/it]
 89%|████████▊ | 33620/37963 [76:23:50<10:23:09,  8.61s/it]
                                                           
{'loss': '0.09261', 'grad_norm': '3.238', 'learning_rate': '6.789e-07', 'epoch': '0.8856'}
+
 89%|████████▊ | 33620/37963 [76:23:50<10:23:09,  8.61s/it]
 89%|████████▊ | 33621/37963 [76:23:58<10:03:47,  8.34s/it]
 89%|████████▊ | 33622/37963 [76:24:05<9:45:21,  8.09s/it] 
 89%|████████▊ | 33623/37963 [76:24:15<10:25:29,  8.65s/it]
 89%|████████▊ | 33624/37963 [76:24:23<10:08:34,  8.42s/it]
 89%|████████▊ | 33625/37963 [76:24:31<9:53:29,  8.21s/it] 
 89%|████████▊ | 33626/37963 [76:24:39<9:46:50,  8.12s/it]
 89%|████████▊ | 33627/37963 [76:24:47<9:41:57,  8.05s/it]
 89%|████████▊ | 33628/37963 [76:24:55<9:40:31,  8.04s/it]
 89%|████████▊ | 33629/37963 [76:25:02<9:32:13,  7.92s/it]
 89%|████████▊ | 33630/37963 [76:25:10<9:23:11,  7.80s/it]
                                                          
{'loss': '0.1016', 'grad_norm': '3.146', 'learning_rate': '6.758e-07', 'epoch': '0.8859'}
+
 89%|████████▊ | 33630/37963 [76:25:10<9:23:11,  7.80s/it]
 89%|████████▊ | 33631/37963 [76:25:18<9:22:34,  7.79s/it]
 89%|████████▊ | 33632/37963 [76:25:25<9:11:16,  7.64s/it]
 89%|████████▊ | 33633/37963 [76:25:33<9:15:05,  7.69s/it]
 89%|████████▊ | 33634/37963 [76:25:41<9:19:17,  7.75s/it]
 89%|████████▊ | 33635/37963 [76:25:49<9:24:01,  7.82s/it]
 89%|████████▊ | 33636/37963 [76:25:56<9:18:44,  7.75s/it]
 89%|████████▊ | 33637/37963 [76:26:04<9:17:55,  7.74s/it]
 89%|████████▊ | 33638/37963 [76:26:12<9:19:38,  7.76s/it]
 89%|████████▊ | 33639/37963 [76:26:19<9:10:41,  7.64s/it]
 89%|████████▊ | 33640/37963 [76:26:29<10:05:48,  8.41s/it]
                                                           
{'loss': '0.1038', 'grad_norm': '3.713', 'learning_rate': '6.727e-07', 'epoch': '0.8861'}
+
 89%|████████▊ | 33640/37963 [76:26:29<10:05:48,  8.41s/it]
 89%|████████▊ | 33641/37963 [76:26:37<9:49:32,  8.18s/it] 
 89%|████████▊ | 33642/37963 [76:26:44<9:37:01,  8.01s/it]
 89%|████████▊ | 33643/37963 [76:26:52<9:34:11,  7.97s/it]
 89%|████████▊ | 33644/37963 [76:27:00<9:29:30,  7.91s/it]
 89%|████████▊ | 33645/37963 [76:27:11<10:25:39,  8.69s/it]
 89%|████████▊ | 33646/37963 [76:27:21<11:01:31,  9.19s/it]
 89%|████████▊ | 33647/37963 [76:27:29<10:24:59,  8.69s/it]
 89%|████████▊ | 33648/37963 [76:27:36<10:02:01,  8.37s/it]
 89%|████████▊ | 33649/37963 [76:27:44<9:57:20,  8.31s/it] 
 89%|████████▊ | 33650/37963 [76:27:52<9:39:54,  8.07s/it]
                                                          
{'loss': '0.09313', 'grad_norm': '2.559', 'learning_rate': '6.697e-07', 'epoch': '0.8864'}
+
 89%|████████▊ | 33650/37963 [76:27:52<9:39:54,  8.07s/it]
 89%|████████▊ | 33651/37963 [76:28:03<10:37:27,  8.87s/it]
 89%|████████▊ | 33652/37963 [76:28:10<10:12:32,  8.53s/it]
 89%|████████▊ | 33653/37963 [76:28:21<10:56:41,  9.14s/it]
 89%|████████▊ | 33654/37963 [76:28:29<10:27:34,  8.74s/it]
 89%|████████▊ | 33655/37963 [76:28:36<10:07:23,  8.46s/it]
 89%|████████▊ | 33656/37963 [76:28:44<9:51:32,  8.24s/it] 
 89%|████████▊ | 33657/37963 [76:28:52<9:41:55,  8.11s/it]
 89%|████████▊ | 33658/37963 [76:29:03<10:35:42,  8.86s/it]
 89%|████████▊ | 33659/37963 [76:29:10<10:11:59,  8.53s/it]
 89%|████████▊ | 33660/37963 [76:29:18<10:02:34,  8.40s/it]
                                                           
{'loss': '0.09394', 'grad_norm': '3.153', 'learning_rate': '6.666e-07', 'epoch': '0.8867'}
+
 89%|████████▊ | 33660/37963 [76:29:18<10:02:34,  8.40s/it]
 89%|████████▊ | 33661/37963 [76:29:26<9:39:21,  8.08s/it] 
 89%|████████▊ | 33662/37963 [76:29:33<9:31:03,  7.97s/it]
 89%|████████▊ | 33663/37963 [76:29:41<9:28:04,  7.93s/it]
 89%|████████▊ | 33664/37963 [76:29:49<9:27:05,  7.91s/it]
 89%|████████▊ | 33665/37963 [76:29:57<9:25:11,  7.89s/it]
 89%|████████▊ | 33666/37963 [76:30:05<9:24:51,  7.89s/it]
 89%|████████▊ | 33667/37963 [76:30:15<10:10:07,  8.52s/it]
 89%|████████▊ | 33668/37963 [76:30:25<10:48:10,  9.05s/it]
 89%|████████▊ | 33669/37963 [76:30:33<10:19:30,  8.66s/it]
 89%|████████▊ | 33670/37963 [76:30:41<10:01:36,  8.41s/it]
                                                           
{'loss': '0.09124', 'grad_norm': '2.714', 'learning_rate': '6.635e-07', 'epoch': '0.8869'}
+
 89%|████████▊ | 33670/37963 [76:30:41<10:01:36,  8.41s/it]
 89%|████████▊ | 33671/37963 [76:30:49<9:48:35,  8.23s/it] 
 89%|████████▊ | 33672/37963 [76:30:56<9:34:59,  8.04s/it]
 89%|████████▊ | 33673/37963 [76:31:04<9:32:32,  8.01s/it]
 89%|████████▊ | 33674/37963 [76:31:12<9:24:42,  7.90s/it]
 89%|████████▊ | 33675/37963 [76:31:20<9:22:46,  7.87s/it]
 89%|████████▊ | 33676/37963 [76:31:27<9:12:41,  7.74s/it]
 89%|████████▊ | 33677/37963 [76:31:35<9:17:24,  7.80s/it]
 89%|████████▊ | 33678/37963 [76:31:43<9:17:02,  7.80s/it]
 89%|████████▊ | 33679/37963 [76:31:50<9:13:40,  7.75s/it]
 89%|████████▊ | 33680/37963 [76:31:58<9:11:51,  7.73s/it]
                                                          
{'loss': '0.08968', 'grad_norm': '2.946', 'learning_rate': '6.605e-07', 'epoch': '0.8872'}
+
 89%|████████▊ | 33680/37963 [76:31:58<9:11:51,  7.73s/it]
 89%|████████▊ | 33681/37963 [76:32:06<9:10:50,  7.72s/it]
 89%|████████▊ | 33682/37963 [76:32:14<9:17:05,  7.81s/it]
 89%|████████▊ | 33683/37963 [76:32:22<9:17:54,  7.82s/it]
 89%|████████▊ | 33684/37963 [76:32:29<9:12:54,  7.75s/it]
 89%|████████▊ | 33685/37963 [76:32:37<9:10:54,  7.73s/it]
 89%|████████▊ | 33686/37963 [76:32:47<10:05:34,  8.50s/it]
 89%|████████▊ | 33687/37963 [76:32:55<9:50:58,  8.29s/it] 
 89%|████████▊ | 33688/37963 [76:33:03<9:40:47,  8.15s/it]
 89%|████████▊ | 33689/37963 [76:33:11<9:33:26,  8.05s/it]
 89%|████████▊ | 33690/37963 [76:33:19<9:30:23,  8.01s/it]
                                                          
{'loss': '0.08229', 'grad_norm': '2.982', 'learning_rate': '6.574e-07', 'epoch': '0.8874'}
+
 89%|████████▊ | 33690/37963 [76:33:19<9:30:23,  8.01s/it]
 89%|████████▊ | 33691/37963 [76:33:26<9:17:02,  7.82s/it]
 89%|████████▊ | 33692/37963 [76:33:34<9:12:22,  7.76s/it]
 89%|████████▉ | 33693/37963 [76:33:41<9:11:52,  7.75s/it]
 89%|████████▉ | 33694/37963 [76:33:49<9:13:31,  7.78s/it]
 89%|██��█████▉ | 33695/37963 [76:33:57<9:13:07,  7.78s/it]
 89%|████████▉ | 33696/37963 [76:34:05<9:09:19,  7.72s/it]
 89%|████████▉ | 33697/37963 [76:34:12<9:11:29,  7.76s/it]
 89%|████████▉ | 33698/37963 [76:34:20<9:08:49,  7.72s/it]
 89%|████████▉ | 33699/37963 [76:34:31<10:12:17,  8.62s/it]
 89%|████████▉ | 33700/37963 [76:34:41<10:53:04,  9.19s/it]
                                                           
{'loss': '0.08925', 'grad_norm': '4.465', 'learning_rate': '6.544e-07', 'epoch': '0.8877'}
+
 89%|████████▉ | 33700/37963 [76:34:41<10:53:04,  9.19s/it]
 89%|████████▉ | 33701/37963 [76:34:49<10:19:08,  8.72s/it]
 89%|████████▉ | 33702/37963 [76:34:57<9:59:22,  8.44s/it] 
 89%|████████▉ | 33703/37963 [76:35:04<9:44:16,  8.23s/it]
 89%|████████▉ | 33704/37963 [76:35:12<9:26:53,  7.99s/it]
 89%|████████▉ | 33705/37963 [76:35:22<10:23:38,  8.79s/it]
 89%|████████▉ | 33706/37963 [76:35:33<11:04:01,  9.36s/it]
 89%|████████▉ | 33707/37963 [76:35:44<11:29:18,  9.72s/it]
 89%|████████▉ | 33708/37963 [76:35:51<10:44:42,  9.09s/it]
 89%|████████▉ | 33709/37963 [76:35:59<10:10:17,  8.61s/it]
 89%|████████▉ | 33710/37963 [76:36:06<9:49:18,  8.31s/it] 
                                                          
{'loss': '0.08055', 'grad_norm': '3.515', 'learning_rate': '6.514e-07', 'epoch': '0.888'}
+
 89%|████████▉ | 33710/37963 [76:36:06<9:49:18,  8.31s/it]
 89%|████████▉ | 33711/37963 [76:36:14<9:37:50,  8.15s/it]
 89%|████████▉ | 33712/37963 [76:36:25<10:27:48,  8.86s/it]
 89%|████████▉ | 33713/37963 [76:36:32<10:02:11,  8.50s/it]
 89%|████████▉ | 33714/37963 [76:36:40<9:45:33,  8.27s/it] 
 89%|████████▉ | 33715/37963 [76:36:48<9:31:47,  8.08s/it]
 89%|████████▉ | 33716/37963 [76:36:56<9:27:45,  8.02s/it]
 89%|████████▉ | 33717/37963 [76:37:04<9:24:42,  7.98s/it]
 89%|████████▉ | 33718/37963 [76:37:11<9:21:31,  7.94s/it]
 89%|████████▉ | 33719/37963 [76:37:22<10:10:27,  8.63s/it]
 89%|████████▉ | 33720/37963 [76:37:29<9:53:36,  8.39s/it] 
                                                          
{'loss': '0.09286', 'grad_norm': '4.438', 'learning_rate': '6.483e-07', 'epoch': '0.8882'}
+
 89%|████████▉ | 33720/37963 [76:37:29<9:53:36,  8.39s/it]
 89%|████████▉ | 33721/37963 [76:37:37<9:42:39,  8.24s/it]
 89%|████████▉ | 33722/37963 [76:37:45<9:31:21,  8.08s/it]
 89%|████████▉ | 33723/37963 [76:37:53<9:18:55,  7.91s/it]
 89%|████████▉ | 33724/37963 [76:38:01<9:21:14,  7.94s/it]
 89%|████████▉ | 33725/37963 [76:38:08<9:13:40,  7.84s/it]
 89%|████████▉ | 33726/37963 [76:38:16<9:09:07,  7.78s/it]
 89%|████████▉ | 33727/37963 [76:38:23<9:06:33,  7.74s/it]
 89%|████████▉ | 33728/37963 [76:38:31<9:05:25,  7.73s/it]
 89%|████████▉ | 33729/37963 [76:38:39<9:05:20,  7.73s/it]
 89%|████████▉ | 33730/37963 [76:38:47<9:10:27,  7.80s/it]
                                                          
{'loss': '0.07533', 'grad_norm': '2.867', 'learning_rate': '6.453e-07', 'epoch': '0.8885'}
+
 89%|████████▉ | 33730/37963 [76:38:47<9:10:27,  7.80s/it]
 89%|████████▉ | 33731/37963 [76:38:57<10:05:40,  8.59s/it]
 89%|████████▉ | 33732/37963 [76:39:05<9:51:49,  8.39s/it] 
 89%|████████▉ | 33733/37963 [76:39:13<9:34:31,  8.15s/it]
 89%|████████▉ | 33734/37963 [76:39:20<9:23:36,  8.00s/it]
 89%|████████▉ | 33735/37963 [76:39:28<9:22:25,  7.98s/it]
 89%|████████▉ | 33736/37963 [76:39:36<9:18:26,  7.93s/it]
 89%|████████▉ | 33737/37963 [76:39:44<9:17:37,  7.92s/it]
 89%|████████▉ | 33738/37963 [76:39:52<9:14:30,  7.87s/it]
 89%|████████▉ | 33739/37963 [76:40:00<9:11:56,  7.84s/it]
 89%|████████▉ | 33740/37963 [76:40:07<9:13:02,  7.86s/it]
                                                          
{'loss': '0.08671', 'grad_norm': '1.838', 'learning_rate': '6.423e-07', 'epoch': '0.8888'}
+
 89%|████████▉ | 33740/37963 [76:40:07<9:13:02,  7.86s/it]
 89%|████████▉ | 33741/37963 [76:40:15<9:10:29,  7.82s/it]
 89%|████████▉ | 33742/37963 [76:40:23<9:11:06,  7.83s/it]
 89%|████████▉ | 33743/37963 [76:40:31<9:08:42,  7.80s/it]
 89%|████████▉ | 33744/37963 [76:40:39<9:08:53,  7.81s/it]
 89%|████████▉ | 33745/37963 [76:40:46<9:08:25,  7.80s/it]
 89%|████████▉ | 33746/37963 [76:40:54<9:04:39,  7.75s/it]
 89%|████████▉ | 33747/37963 [76:41:02<8:59:49,  7.68s/it]
 89%|████████▉ | 33748/37963 [76:41:12<9:47:01,  8.36s/it]
 89%|████████▉ | 33749/37963 [76:41:19<9:31:49,  8.14s/it]
 89%|████████▉ | 33750/37963 [76:41:27<9:18:41,  7.96s/it]
                                                          
{'loss': '0.09185', 'grad_norm': '3.137', 'learning_rate': '6.393e-07', 'epoch': '0.889'}
+
 89%|████████▉ | 33750/37963 [76:41:27<9:18:41,  7.96s/it]
 89%|████████▉ | 33751/37963 [76:41:37<10:13:51,  8.74s/it]
 89%|████████▉ | 33752/37963 [76:41:45<9:48:41,  8.39s/it] 
 89%|████████▉ | 33753/37963 [76:41:55<10:35:29,  9.06s/it]
 89%|████████▉ | 33754/37963 [76:42:03<10:02:13,  8.58s/it]
 89%|████████▉ | 33755/37963 [76:42:11<9:46:35,  8.36s/it] 
 89%|████████▉ | 33756/37963 [76:42:18<9:31:52,  8.16s/it]
 89%|████████▉ | 33757/37963 [76:42:26<9:27:49,  8.10s/it]
 89%|████████▉ | 33758/37963 [76:42:34<9:17:47,  7.96s/it]
 89%|████████▉ | 33759/37963 [76:42:45<10:14:05,  8.76s/it]
 89%|████████▉ | 33760/37963 [76:42:55<10:46:08,  9.22s/it]
                                                           
{'loss': '0.09355', 'grad_norm': '3.75', 'learning_rate': '6.363e-07', 'epoch': '0.8893'}
+
 89%|████████▉ | 33760/37963 [76:42:55<10:46:08,  9.22s/it]
 89%|████████▉ | 33761/37963 [76:43:06<11:15:00,  9.64s/it]
 89%|████████▉ | 33762/37963 [76:43:13<10:31:32,  9.02s/it]
 89%|████████▉ | 33763/37963 [76:43:21<10:02:11,  8.60s/it]
 89%|████████▉ | 33764/37963 [76:43:29<9:44:57,  8.36s/it] 
 89%|████████▉ | 33765/37963 [76:43:36<9:30:05,  8.15s/it]
 89%|████████▉ | 33766/37963 [76:43:44<9:21:03,  8.02s/it]
 89%|████████▉ | 33767/37963 [76:43:52<9:11:31,  7.89s/it]
 89%|████████▉ | 33768/37963 [76:43:59<9:04:28,  7.79s/it]
 89%|████████▉ | 33769/37963 [76:44:07<9:03:41,  7.78s/it]
 89%|████████▉ | 33770/37963 [76:44:14<9:00:48,  7.74s/it]
                                                          
{'loss': '0.08625', 'grad_norm': '4.482', 'learning_rate': '6.333e-07', 'epoch': '0.8896'}
+
 89%|████████▉ | 33770/37963 [76:44:14<9:00:48,  7.74s/it]
 89%|████████▉ | 33771/37963 [76:44:22<8:57:10,  7.69s/it]
 89%|████████▉ | 33772/37963 [76:44:30<8:54:23,  7.65s/it]
 89%|████████▉ | 33773/37963 [76:44:40<9:46:44,  8.40s/it]
 89%|████████▉ | 33774/37963 [76:44:47<9:28:30,  8.14s/it]
 89%|████████▉ | 33775/37963 [76:44:55<9:17:24,  7.99s/it]
 89%|████████▉ | 33776/37963 [76:45:03<9:13:43,  7.93s/it]
 89%|████████▉ | 33777/37963 [76:45:11<9:13:39,  7.94s/it]
 89%|████████▉ | 33778/37963 [76:45:18<9:09:01,  7.87s/it]
 89%|████████▉ | 33779/37963 [76:45:28<9:52:59,  8.50s/it]
 89%|████████▉ | 33780/37963 [76:45:36<9:42:17,  8.35s/it]
                                                          
{'loss': '0.08655', 'grad_norm': '2.334', 'learning_rate': '6.303e-07', 'epoch': '0.8898'}
+
 89%|████████▉ | 33780/37963 [76:45:36<9:42:17,  8.35s/it]
 89%|████████▉ | 33781/37963 [76:45:44<9:28:53,  8.16s/it]
 89%|████████▉ | 33782/37963 [76:45:52<9:21:37,  8.06s/it]
 89%|████████▉ | 33783/37963 [76:46:00<9:13:56,  7.95s/it]
 89%|████████▉ | 33784/37963 [76:46:07<9:03:16,  7.80s/it]
 89%|████████▉ | 33785/37963 [76:46:15<9:00:18,  7.76s/it]
 89%|████████▉ | 33786/37963 [76:46:22<8:58:30,  7.74s/it]
 89%|████████▉ | 33787/37963 [76:46:30<8:58:47,  7.74s/it]
 89%|████████▉ | 33788/37963 [76:46:38<8:58:50,  7.74s/it]
 89%|████████▉ | 33789/37963 [76:46:45<8:54:39,  7.69s/it]
 89%|████████▉ | 33790/37963 [76:46:53<8:52:14,  7.65s/it]
                                                          
{'loss': '0.08604', 'grad_norm': '2.958', 'learning_rate': '6.274e-07', 'epoch': '0.8901'}
+
 89%|████████▉ | 33790/37963 [76:46:53<8:52:14,  7.65s/it]
 89%|████████▉ | 33791/37963 [76:47:01<8:56:31,  7.72s/it]
 89%|████████▉ | 33792/37963 [76:47:09<8:57:13,  7.73s/it]
 89%|████████▉ | 33793/37963 [76:47:16<8:53:55,  7.68s/it]
 89%|████████▉ | 33794/37963 [76:47:27<9:51:06,  8.51s/it]
 89%|████████▉ | 33795/37963 [76:47:35<9:37:01,  8.31s/it]
 89%|████████▉ | 33796/37963 [76:47:42<9:24:24,  8.13s/it]
 89%|████████▉ | 33797/37963 [76:47:50<9:17:06,  8.02s/it]
 89%|████████▉ | 33798/37963 [76:47:58<9:10:55,  7.94s/it]
 89%|████████▉ | 33799/37963 [76:48:05<9:06:57,  7.88s/it]
 89%|████████▉ | 33800/37963 [76:48:13<9:04:07,  7.84s/it]
                                                          
{'loss': '0.08967', 'grad_norm': '2.56', 'learning_rate': '6.244e-07', 'epoch': '0.8903'}
+
 89%|████████▉ | 33800/37963 [76:48:13<9:04:07,  7.84s/it]
 89%|████████▉ | 33801/37963 [76:48:21<9:04:37,  7.85s/it]
 89%|████████▉ | 33802/37963 [76:48:31<9:55:20,  8.58s/it]
 89%|████████▉ | 33803/37963 [76:48:39<9:33:08,  8.27s/it]
 89%|████████▉ | 33804/37963 [76:48:46<9:18:05,  8.05s/it]
 89%|████████▉ | 33805/37963 [76:48:54<9:08:23,  7.91s/it]
 89%|████████▉ | 33806/37963 [76:49:02<9:02:26,  7.83s/it]
 89%|████████▉ | 33807/37963 [76:49:12<9:58:16,  8.64s/it]
 89%|████████▉ | 33808/37963 [76:49:22<10:27:29,  9.06s/it]
 89%|████████▉ | 33809/37963 [76:49:33<11:04:38,  9.60s/it]
 89%|████████▉ | 33810/37963 [76:49:41<10:25:21,  9.03s/it]
                                                           
{'loss': '0.07748', 'grad_norm': '3.279', 'learning_rate': '6.214e-07', 'epoch': '0.8906'}
+
 89%|████████▉ | 33810/37963 [76:49:41<10:25:21,  9.03s/it]
 89%|████████▉ | 33811/37963 [76:49:48<9:49:35,  8.52s/it] 
 89%|████████▉ | 33812/37963 [76:49:56<9:35:14,  8.31s/it]
 89%|████████▉ | 33813/37963 [76:50:07<10:23:25,  9.01s/it]
 89%|████████▉ | 33814/37963 [76:50:15<9:59:23,  8.67s/it] 
 89%|████████▉ | 33815/37963 [76:50:22<9:37:41,  8.36s/it]
 89%|████████▉ | 33816/37963 [76:50:30<9:27:20,  8.21s/it]
 89%|████████▉ | 33817/37963 [76:50:38<9:17:37,  8.07s/it]
 89%|████████▉ | 33818/37963 [76:50:46<9:11:11,  7.98s/it]
 89%|████████▉ | 33819/37963 [76:50:53<8:59:39,  7.81s/it]
 89%|████████▉ | 33820/37963 [76:51:01<9:02:23,  7.86s/it]
                                                          
{'loss': '0.09302', 'grad_norm': '3.146', 'learning_rate': '6.185e-07', 'epoch': '0.8909'}
+
 89%|████████▉ | 33820/37963 [76:51:01<9:02:23,  7.86s/it]
 89%|████████▉ | 33821/37963 [76:51:09<8:57:17,  7.78s/it]
 89%|████████▉ | 33822/37963 [76:51:16<8:55:16,  7.76s/it]
 89%|████████▉ | 33823/37963 [76:51:26<9:42:00,  8.43s/it]
 89%|████████▉ | 33824/37963 [76:51:34<9:30:07,  8.26s/it]
 89%|████████▉ | 33825/37963 [76:51:42<9:16:48,  8.07s/it]
 89%|████████▉ | 33826/37963 [76:51:49<9:02:38,  7.87s/it]
 89%|████████▉ | 33827/37963 [76:52:00<9:56:06,  8.65s/it]
 89%|████████▉ | 33828/37963 [76:52:07<9:36:59,  8.37s/it]
 89%|████████▉ | 33829/37963 [76:52:15<9:21:06,  8.14s/it]
 89%|████████▉ | 33830/37963 [76:52:23<9:22:58,  8.17s/it]
                                                          
{'loss': '0.0943', 'grad_norm': '4.075', 'learning_rate': '6.155e-07', 'epoch': '0.8911'}
+
 89%|████████▉ | 33830/37963 [76:52:23<9:22:58,  8.17s/it]
 89%|████████▉ | 33831/37963 [76:52:31<9:15:05,  8.06s/it]
 89%|████████▉ | 33832/37963 [76:52:39<9:07:53,  7.96s/it]
 89%|████████▉ | 33833/37963 [76:52:46<9:00:51,  7.86s/it]
 89%|████████▉ | 33834/37963 [76:52:54<8:53:39,  7.75s/it]
 89%|████████▉ | 33835/37963 [76:53:02<8:52:44,  7.74s/it]
 89%|████████▉ | 33836/37963 [76:53:09<8:54:14,  7.77s/it]
 89%|████████▉ | 33837/37963 [76:53:17<8:52:27,  7.74s/it]
 89%|████████▉ | 33838/37963 [76:53:25<8:56:46,  7.81s/it]
 89%|████████▉ | 33839/37963 [76:53:33<8:55:16,  7.79s/it]
 89%|████████▉ | 33840/37963 [76:53:41<8:54:35,  7.78s/it]
                                                          
{'loss': '0.09021', 'grad_norm': '2.677', 'learning_rate': '6.126e-07', 'epoch': '0.8914'}
+
 89%|████████▉ | 33840/37963 [76:53:41<8:54:35,  7.78s/it]
 89%|████████▉ | 33841/37963 [76:53:48<8:56:54,  7.82s/it]
 89%|████████▉ | 33842/37963 [76:53:56<8:55:47,  7.80s/it]
 89%|████████▉ | 33843/37963 [76:54:04<8:57:26,  7.83s/it]
 89%|████████▉ | 33844/37963 [76:54:12<8:54:53,  7.79s/it]
 89%|████████▉ | 33845/37963 [76:54:20<8:54:48,  7.79s/it]
 89%|████████▉ | 33846/37963 [76:54:27<8:53:02,  7.77s/it]
 89%|████████▉ | 33847/37963 [76:54:37<9:38:42,  8.44s/it]
 89%|████████▉ | 33848/37963 [76:54:45<9:23:44,  8.22s/it]
 89%|████████▉ | 33849/37963 [76:54:53<9:15:32,  8.10s/it]
 89%|████████▉ | 33850/37963 [76:55:03<9:58:17,  8.73s/it]
                                                          
{'loss': '0.1029', 'grad_norm': '4.282', 'learning_rate': '6.096e-07', 'epoch': '0.8917'}
+
 89%|████████▉ | 33850/37963 [76:55:03<9:58:17,  8.73s/it]
 89%|████████▉ | 33851/37963 [76:55:11<9:34:24,  8.38s/it]
 89%|████████▉ | 33852/37963 [76:55:18<9:23:26,  8.22s/it]
 89%|████████▉ | 33853/37963 [76:55:26<9:08:48,  8.01s/it]
 89%|████████▉ | 33854/37963 [76:55:39<10:49:29,  9.48s/it]
 89%|████████▉ | 33855/37963 [76:55:47<10:21:48,  9.08s/it]
 89%|████████▉ | 33856/37963 [76:55:55<9:55:00,  8.69s/it] 
 89%|████████▉ | 33857/37963 [76:56:05<10:33:04,  9.25s/it]
 89%|████████▉ | 33858/37963 [76:56:13<10:00:50,  8.78s/it]
 89%|████████▉ | 33859/37963 [76:56:21<9:35:34,  8.41s/it] 
 89%|████████▉ | 33860/37963 [76:56:28<9:17:15,  8.15s/it]
                                                          
{'loss': '0.0889', 'grad_norm': '3.381', 'learning_rate': '6.067e-07', 'epoch': '0.8919'}
+
 89%|████████▉ | 33860/37963 [76:56:28<9:17:15,  8.15s/it]
 89%|████████▉ | 33861/37963 [76:56:36<9:09:23,  8.04s/it]
 89%|████████▉ | 33862/37963 [76:56:44<9:03:47,  7.96s/it]
 89%|████████▉ | 33863/37963 [76:56:54<9:51:04,  8.65s/it]
 89%|████████▉ | 33864/37963 [76:57:02<9:37:52,  8.46s/it]
 89%|████████▉ | 33865/37963 [76:57:10<9:21:56,  8.23s/it]
 89%|████████▉ | 33866/37963 [76:57:20<9:57:22,  8.75s/it]
 89%|████████▉ | 33867/37963 [76:57:27<9:36:49,  8.45s/it]
 89%|████████▉ | 33868/37963 [76:57:35<9:27:01,  8.31s/it]
 89%|████████▉ | 33869/37963 [76:57:43<9:13:45,  8.12s/it]
 89%|████████▉ | 33870/37963 [76:57:51<9:05:07,  7.99s/it]
                                                          
{'loss': '0.08869', 'grad_norm': '3.686', 'learning_rate': '6.038e-07', 'epoch': '0.8922'}
+
 89%|████████▉ | 33870/37963 [76:57:51<9:05:07,  7.99s/it]
 89%|████████▉ | 33871/37963 [76:57:59<9:01:48,  7.94s/it]
 89%|████████▉ | 33872/37963 [76:58:06<8:57:41,  7.89s/it]
 89%|████████▉ | 33873/37963 [76:58:17<9:49:17,  8.64s/it]
 89%|████████▉ | 33874/37963 [76:58:24<9:24:17,  8.28s/it]
 89%|████████▉ | 33875/37963 [76:58:32<9:09:14,  8.06s/it]
 89%|████████▉ | 33876/37963 [76:58:39<9:04:10,  7.99s/it]
 89%|████████▉ | 33877/37963 [76:58:47<8:51:38,  7.81s/it]
 89%|████████▉ | 33878/37963 [76:58:55<8:48:15,  7.76s/it]
 89%|████████▉ | 33879/37963 [76:59:02<8:51:51,  7.81s/it]
 89%|████████▉ | 33880/37963 [76:59:10<8:50:10,  7.79s/it]
                                                          
{'loss': '0.09289', 'grad_norm': '3.359', 'learning_rate': '6.009e-07', 'epoch': '0.8925'}
+
 89%|████████▉ | 33880/37963 [76:59:10<8:50:10,  7.79s/it]
 89%|████████▉ | 33881/37963 [76:59:18<8:52:20,  7.82s/it]
 89%|████████▉ | 33882/37963 [76:59:26<8:49:05,  7.78s/it]
 89%|████████▉ | 33883/37963 [76:59:34<8:53:13,  7.84s/it]
 89%|████████▉ | 33884/37963 [76:59:41<8:47:57,  7.77s/it]
 89%|████████▉ | 33885/37963 [76:59:49<8:49:06,  7.78s/it]
 89%|████████▉ | 33886/37963 [76:59:57<8:48:16,  7.77s/it]
 89%|████████▉ | 33887/37963 [77:00:04<8:43:22,  7.70s/it]
 89%|████████▉ | 33888/37963 [77:00:12<8:39:36,  7.65s/it]
 89%|████████▉ | 33889/37963 [77:00:20<8:40:48,  7.67s/it]
 89%|████████▉ | 33890/37963 [77:00:27<8:39:34,  7.65s/it]
                                                          
{'loss': '0.08716', 'grad_norm': '3.1', 'learning_rate': '5.98e-07', 'epoch': '0.8927'}
+
 89%|████████▉ | 33890/37963 [77:00:27<8:39:34,  7.65s/it]
 89%|████████▉ | 33891/37963 [77:00:35<8:39:30,  7.65s/it]
 89%|████████▉ | 33892/37963 [77:00:43<8:44:24,  7.73s/it]
 89%|████████▉ | 33893/37963 [77:00:50<8:40:49,  7.68s/it]
 89%|████████▉ | 33894/37963 [77:00:58<8:43:26,  7.72s/it]
 89%|████████▉ | 33895/37963 [77:01:06<8:42:45,  7.71s/it]
 89%|████████▉ | 33896/37963 [77:01:14<8:46:25,  7.77s/it]
 89%|████████▉ | 33897/37963 [77:01:22<8:44:42,  7.74s/it]
 89%|████████▉ | 33898/37963 [77:01:34<10:30:22,  9.30s/it]
 89%|████████▉ | 33899/37963 [77:01:42<9:52:39,  8.75s/it] 
 89%|████████▉ | 33900/37963 [77:01:52<10:29:01,  9.29s/it]
                                                           
{'loss': '0.08184', 'grad_norm': '2.02', 'learning_rate': '5.951e-07', 'epoch': '0.893'}
+
 89%|████████▉ | 33900/37963 [77:01:52<10:29:01,  9.29s/it]
 89%|████████▉ | 33901/37963 [77:02:03<10:45:22,  9.53s/it]
 89%|████████▉ | 33902/37963 [77:02:13<11:00:04,  9.75s/it]
 89%|████████▉ | 33903/37963 [77:02:21<10:22:26,  9.20s/it]
 89%|████████▉ | 33904/37963 [77:02:29<9:55:32,  8.80s/it] 
 89%|████████▉ | 33905/37963 [77:02:37<9:40:49,  8.59s/it]
 89%|████████▉ | 33906/37963 [77:02:44<9:23:01,  8.33s/it]
 89%|████████▉ | 33907/37963 [77:02:52<9:11:19,  8.16s/it]
 89%|████████▉ | 33908/37963 [77:03:00<9:04:30,  8.06s/it]
 89%|████████▉ | 33909/37963 [77:03:08<8:55:35,  7.93s/it]
 89%|████████▉ | 33910/37963 [77:03:16<8:54:00,  7.91s/it]
                                                          
{'loss': '0.08736', 'grad_norm': '2.81', 'learning_rate': '5.922e-07', 'epoch': '0.8932'}
+
 89%|████████▉ | 33910/37963 [77:03:16<8:54:00,  7.91s/it]
 89%|████████▉ | 33911/37963 [77:03:23<8:55:34,  7.93s/it]
 89%|████████▉ | 33912/37963 [77:03:31<8:51:39,  7.87s/it]
 89%|████████▉ | 33913/37963 [77:03:39<8:51:39,  7.88s/it]
 89%|████████▉ | 33914/37963 [77:03:47<8:52:55,  7.90s/it]
 89%|████████▉ | 33915/37963 [77:03:55<8:52:52,  7.90s/it]
 89%|████████▉ | 33916/37963 [77:04:03<8:52:37,  7.90s/it]
 89%|████████▉ | 33917/37963 [77:04:13<9:45:56,  8.69s/it]
 89%|████████▉ | 33918/37963 [77:04:21<9:25:44,  8.39s/it]
 89%|████████▉ | 33919/37963 [77:04:28<9:02:54,  8.05s/it]
 89%|████████▉ | 33920/37963 [77:04:39<9:50:36,  8.77s/it]
                                                          
{'loss': '0.09065', 'grad_norm': '3.484', 'learning_rate': '5.893e-07', 'epoch': '0.8935'}
+
 89%|████████▉ | 33920/37963 [77:04:39<9:50:36,  8.77s/it]
 89%|████████▉ | 33921/37963 [77:04:47<9:31:41,  8.49s/it]
 89%|████████▉ | 33922/37963 [77:04:54<9:13:38,  8.22s/it]
 89%|████████▉ | 33923/37963 [77:05:02<8:58:29,  8.00s/it]
 89%|████████▉ | 33924/37963 [77:05:10<8:54:48,  7.94s/it]
 89%|████████▉ | 33925/37963 [77:05:20<9:48:16,  8.74s/it]
 89%|████████▉ | 33926/37963 [77:05:28<9:30:32,  8.48s/it]
 89%|████████▉ | 33927/37963 [77:05:36<9:12:50,  8.22s/it]
 89%|████████▉ | 33928/37963 [77:05:43<9:03:03,  8.08s/it]
 89%|████████▉ | 33929/37963 [77:05:51<8:57:42,  8.00s/it]
 89%|████████▉ | 33930/37963 [77:05:59<8:48:36,  7.86s/it]
                                                          
{'loss': '0.08069', 'grad_norm': '2.912', 'learning_rate': '5.864e-07', 'epoch': '0.8938'}
+
 89%|████████▉ | 33930/37963 [77:05:59<8:48:36,  7.86s/it]
 89%|████████▉ | 33931/37963 [77:06:07<8:48:11,  7.86s/it]
 89%|████████▉ | 33932/37963 [77:06:14<8:40:09,  7.74s/it]
 89%|████████▉ | 33933/37963 [77:06:22<8:41:49,  7.77s/it]
 89%|████████▉ | 33934/37963 [77:06:29<8:31:26,  7.62s/it]
 89%|████████▉ | 33935/37963 [77:06:37<8:30:59,  7.61s/it]
 89%|████████▉ | 33936/37963 [77:06:44<8:31:16,  7.62s/it]
 89%|████████▉ | 33937/37963 [77:06:52<8:30:33,  7.61s/it]
 89%|████████▉ | 33938/37963 [77:06:59<8:27:24,  7.56s/it]
 89%|████████▉ | 33939/37963 [77:07:08<8:38:21,  7.73s/it]
 89%|████████▉ | 33940/37963 [77:07:15<8:36:33,  7.70s/it]
                                                          
{'loss': '0.08356', 'grad_norm': '3.142', 'learning_rate': '5.835e-07', 'epoch': '0.894'}
+
 89%|████████▉ | 33940/37963 [77:07:15<8:36:33,  7.70s/it]
 89%|████████▉ | 33941/37963 [77:07:23<8:35:07,  7.68s/it]
 89%|████████▉ | 33942/37963 [77:07:31<8:38:07,  7.73s/it]
 89%|████████▉ | 33943/37963 [77:07:38<8:37:21,  7.72s/it]
 89%|████████▉ | 33944/37963 [77:07:46<8:37:43,  7.73s/it]
 89%|████████▉ | 33945/37963 [77:07:54<8:41:11,  7.78s/it]
 89%|████████▉ | 33946/37963 [77:08:02<8:38:20,  7.74s/it]
 89%|████████▉ | 33947/37963 [77:08:09<8:38:10,  7.74s/it]
 89%|████████▉ | 33948/37963 [77:08:17<8:35:25,  7.70s/it]
 89%|████████▉ | 33949/37963 [77:08:25<8:35:00,  7.70s/it]
 89%|████████▉ | 33950/37963 [77:08:35<9:34:54,  8.60s/it]
                                                          
{'loss': '0.08438', 'grad_norm': '2.905', 'learning_rate': '5.806e-07', 'epoch': '0.8943'}
+
 89%|████████▉ | 33950/37963 [77:08:35<9:34:54,  8.60s/it]
 89%|████████▉ | 33951/37963 [77:08:43<9:20:38,  8.38s/it]
 89%|████████▉ | 33952/37963 [77:08:56<10:53:05,  9.77s/it]
 89%|████████▉ | 33953/37963 [77:09:07<11:09:38, 10.02s/it]
 89%|████████▉ | 33954/37963 [77:09:17<11:20:57, 10.19s/it]
 89%|████████▉ | 33955/37963 [77:09:25<10:31:53,  9.46s/it]
 89%|████████▉ | 33956/37963 [77:09:33<9:59:35,  8.98s/it] 
 89%|████████▉ | 33957/37963 [77:09:40<9:27:12,  8.50s/it]
 89%|████████▉ | 33958/37963 [77:09:48<9:07:32,  8.20s/it]
 89%|████████▉ | 33959/37963 [77:09:56<8:56:23,  8.04s/it]
 89%|████████▉ | 33960/37963 [77:10:03<8:50:23,  7.95s/it]
                                                          
{'loss': '0.08032', 'grad_norm': '3.121', 'learning_rate': '5.778e-07', 'epoch': '0.8946'}
+
 89%|████████▉ | 33960/37963 [77:10:03<8:50:23,  7.95s/it]
 89%|████████▉ | 33961/37963 [77:10:11<8:37:24,  7.76s/it]
 89%|████████▉ | 33962/37963 [77:10:18<8:37:45,  7.76s/it]
 89%|████████▉ | 33963/37963 [77:10:26<8:41:27,  7.82s/it]
 89%|████████▉ | 33964/37963 [77:10:34<8:31:28,  7.67s/it]
 89%|████████▉ | 33965/37963 [77:10:41<8:30:37,  7.66s/it]
 89%|████████▉ | 33966/37963 [77:10:49<8:29:00,  7.64s/it]
 89%|████████▉ | 33967/37963 [77:10:57<8:35:57,  7.75s/it]
 89%|████████▉ | 33968/37963 [77:11:05<8:33:56,  7.72s/it]
 89%|████████▉ | 33969/37963 [77:11:12<8:35:20,  7.74s/it]
 89%|████████▉ | 33970/37963 [77:11:20<8:34:46,  7.74s/it]
                                                          
{'loss': '0.08566', 'grad_norm': '3.127', 'learning_rate': '5.749e-07', 'epoch': '0.8948'}
+
 89%|████████▉ | 33970/37963 [77:11:20<8:34:46,  7.74s/it]
 89%|████████▉ | 33971/37963 [77:11:30<9:19:47,  8.41s/it]
 89%|████████▉ | 33972/37963 [77:11:41<10:03:46,  9.08s/it]
 89%|████████▉ | 33973/37963 [77:11:48<9:37:20,  8.68s/it] 
 89%|████████▉ | 33974/37963 [77:11:59<10:08:39,  9.16s/it]
 89%|████████▉ | 33975/37963 [77:12:06<9:37:56,  8.70s/it] 
 89%|████████▉ | 33976/37963 [77:12:14<9:21:54,  8.46s/it]
 90%|████████▉ | 33977/37963 [77:12:22<9:10:04,  8.28s/it]
 90%|████████▉ | 33978/37963 [77:12:30<8:53:07,  8.03s/it]
 90%|████████▉ | 33979/37963 [77:12:37<8:46:58,  7.94s/it]
 90%|████████▉ | 33980/37963 [77:12:45<8:40:52,  7.85s/it]
                                                          
{'loss': '0.09027', 'grad_norm': '4.437', 'learning_rate': '5.721e-07', 'epoch': '0.8951'}
+
 90%|████████▉ | 33980/37963 [77:12:45<8:40:52,  7.85s/it]
 90%|████████▉ | 33981/37963 [77:12:52<8:33:43,  7.74s/it]
 90%|████████▉ | 33982/37963 [77:13:00<8:34:44,  7.76s/it]
 90%|████████▉ | 33983/37963 [77:13:08<8:31:43,  7.71s/it]
 90%|████████▉ | 33984/37963 [77:13:15<8:29:47,  7.69s/it]
 90%|████████▉ | 33985/37963 [77:13:23<8:28:48,  7.67s/it]
 90%|████████▉ | 33986/37963 [77:13:31<8:36:05,  7.79s/it]
 90%|████████▉ | 33987/37963 [77:13:39<8:34:40,  7.77s/it]
 90%|████████▉ | 33988/37963 [77:13:47<8:36:25,  7.80s/it]
 90%|████████▉ | 33989/37963 [77:13:55<8:40:30,  7.86s/it]
 90%|████████▉ | 33990/37963 [77:14:02<8:29:22,  7.69s/it]
                                                          
{'loss': '0.0899', 'grad_norm': '3.327', 'learning_rate': '5.692e-07', 'epoch': '0.8953'}
+
 90%|████████▉ | 33990/37963 [77:14:02<8:29:22,  7.69s/it]
 90%|████████▉ | 33991/37963 [77:14:10<8:28:16,  7.68s/it]
 90%|████████▉ | 33992/37963 [77:14:17<8:25:22,  7.64s/it]
 90%|████████▉ | 33993/37963 [77:14:25<8:28:24,  7.68s/it]
 90%|████████▉ | 33994/37963 [77:14:33<8:25:46,  7.65s/it]
 90%|████████▉ | 33995/37963 [77:14:40<8:30:49,  7.72s/it]
 90%|████████▉ | 33996/37963 [77:14:48<8:32:03,  7.74s/it]
 90%|████████▉ | 33997/37963 [77:14:56<8:32:26,  7.75s/it]
 90%|████████▉ | 33998/37963 [77:15:04<8:32:02,  7.75s/it]
 90%|████████▉ | 33999/37963 [77:15:17<10:22:29,  9.42s/it]
 90%|████████▉ | 34000/37963 [77:15:25<9:47:31,  8.90s/it] 
                                                          
{'loss': '0.07993', 'grad_norm': '2.318', 'learning_rate': '5.664e-07', 'epoch': '0.8956'}
+
 90%|████████▉ | 34000/37963 [77:15:25<9:47:31,  8.90s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.24s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.24s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 90%|████████▉ | 34001/37963 [77:16:24<26:23:22, 23.98s/it]
 90%|████████▉ | 34002/37963 [77:16:34<21:54:50, 19.92s/it]
 90%|████████▉ | 34003/37963 [77:16:42<17:57:12, 16.32s/it]
 90%|████████▉ | 34004/37963 [77:16:50<15:09:50, 13.79s/it]
 90%|████████▉ | 34005/37963 [77:17:01<14:00:31, 12.74s/it]
 90%|████████▉ | 34006/37963 [77:17:11<13:23:28, 12.18s/it]
 90%|████████▉ | 34007/37963 [77:17:19<11:56:11, 10.86s/it]
 90%|████████▉ | 34008/37963 [77:17:27<10:58:28,  9.99s/it]
 90%|████████▉ | 34009/37963 [77:17:35<10:17:18,  9.37s/it]
 90%|████████▉ | 34010/37963 [77:17:43<9:50:21,  8.96s/it] 
                                                          
{'loss': '0.0946', 'grad_norm': '2.821', 'learning_rate': '5.636e-07', 'epoch': '0.8959'}
+
 90%|████████▉ | 34010/37963 [77:17:43<9:50:21,  8.96s/it]
 90%|████████▉ | 34011/37963 [77:17:51<9:30:49,  8.67s/it]
 90%|████████▉ | 34012/37963 [77:17:59<9:12:27,  8.39s/it]
 90%|████████▉ | 34013/37963 [77:18:06<8:57:11,  8.16s/it]
 90%|████████▉ | 34014/37963 [77:18:14<8:51:00,  8.07s/it]
 90%|████████▉ | 34015/37963 [77:18:22<8:45:30,  7.99s/it]
 90%|████████▉ | 34016/37963 [77:18:30<8:36:03,  7.84s/it]
 90%|████████▉ | 34017/37963 [77:18:37<8:31:49,  7.78s/it]
 90%|████████▉ | 34018/37963 [77:18:45<8:32:55,  7.80s/it]
 90%|████████▉ | 34019/37963 [77:18:53<8:27:49,  7.73s/it]
 90%|████████▉ | 34020/37963 [77:19:00<8:25:57,  7.70s/it]
                                                          
{'loss': '0.08804', 'grad_norm': '3.01', 'learning_rate': '5.608e-07', 'epoch': '0.8961'}
+
 90%|████████▉ | 34020/37963 [77:19:00<8:25:57,  7.70s/it]
 90%|████████▉ | 34021/37963 [77:19:11<9:19:51,  8.52s/it]
 90%|████████▉ | 34022/37963 [77:19:21<9:57:13,  9.09s/it]
 90%|████████▉ | 34023/37963 [77:19:32<10:24:36,  9.51s/it]
 90%|████████▉ | 34024/37963 [77:19:39<9:47:42,  8.95s/it] 
 90%|████████▉ | 34025/37963 [77:19:47<9:25:36,  8.62s/it]
 90%|████████▉ | 34026/37963 [77:19:55<9:08:25,  8.36s/it]
 90%|████████▉ | 34027/37963 [77:20:02<8:54:29,  8.15s/it]
 90%|████████▉ | 34028/37963 [77:20:10<8:50:12,  8.08s/it]
 90%|████████▉ | 34029/37963 [77:20:18<8:43:13,  7.98s/it]
 90%|████████▉ | 34030/37963 [77:20:26<8:39:13,  7.92s/it]
                                                          
{'loss': '0.08316', 'grad_norm': '3.522', 'learning_rate': '5.58e-07', 'epoch': '0.8964'}
+
 90%|████████▉ | 34030/37963 [77:20:26<8:39:13,  7.92s/it]
 90%|████████▉ | 34031/37963 [77:20:34<8:39:24,  7.93s/it]
 90%|████████▉ | 34032/37963 [77:20:42<8:41:05,  7.95s/it]
 90%|████████▉ | 34033/37963 [77:20:49<8:33:54,  7.85s/it]
 90%|████████▉ | 34034/37963 [77:20:57<8:34:45,  7.86s/it]
 90%|████████▉ | 34035/37963 [77:21:05<8:34:15,  7.86s/it]
 90%|████████▉ | 34036/37963 [77:21:13<8:33:45,  7.85s/it]
 90%|████████▉ | 34037/37963 [77:21:21<8:33:23,  7.85s/it]
 90%|████████▉ | 34038/37963 [77:21:29<8:28:45,  7.78s/it]
 90%|████████▉ | 34039/37963 [77:21:36<8:31:18,  7.82s/it]
 90%|████████▉ | 34040/37963 [77:21:44<8:22:48,  7.69s/it]
                                                          
{'loss': '0.08427', 'grad_norm': '2.755', 'learning_rate': '5.551e-07', 'epoch': '0.8967'}
+
 90%|████████▉ | 34040/37963 [77:21:44<8:22:48,  7.69s/it]
 90%|████████▉ | 34041/37963 [77:21:52<8:24:09,  7.71s/it]
 90%|████████▉ | 34042/37963 [77:22:02<9:25:05,  8.65s/it]
 90%|████████▉ | 34043/37963 [77:22:10<9:13:05,  8.47s/it]
 90%|████████▉ | 34044/37963 [77:22:18<8:57:10,  8.22s/it]
 90%|████████▉ | 34045/37963 [77:22:26<8:47:42,  8.08s/it]
 90%|████████▉ | 34046/37963 [77:22:34<8:46:43,  8.07s/it]
 90%|████████▉ | 34047/37963 [77:22:42<8:38:43,  7.95s/it]
 90%|████████▉ | 34048/37963 [77:22:50<8:38:26,  7.95s/it]
 90%|█��██████▉ | 34049/37963 [77:23:00<9:21:43,  8.61s/it]
 90%|████████▉ | 34050/37963 [77:23:08<9:09:18,  8.42s/it]
                                                          
{'loss': '0.1041', 'grad_norm': '4.999', 'learning_rate': '5.523e-07', 'epoch': '0.8969'}
+
 90%|████████▉ | 34050/37963 [77:23:08<9:09:18,  8.42s/it]
 90%|████████▉ | 34051/37963 [77:23:15<8:55:24,  8.21s/it]
 90%|████████▉ | 34052/37963 [77:23:26<9:37:57,  8.87s/it]
 90%|████████▉ | 34053/37963 [77:23:33<9:14:08,  8.50s/it]
 90%|████████▉ | 34054/37963 [77:23:44<9:55:09,  9.14s/it]
 90%|████████▉ | 34055/37963 [77:23:52<9:30:23,  8.76s/it]
 90%|████████▉ | 34056/37963 [77:24:03<10:08:31,  9.35s/it]
 90%|████████▉ | 34057/37963 [77:24:10<9:34:22,  8.82s/it] 
 90%|████████▉ | 34058/37963 [77:24:18<9:07:10,  8.41s/it]
 90%|████████▉ | 34059/37963 [77:24:25<8:55:25,  8.23s/it]
 90%|████████▉ | 34060/37963 [77:24:33<8:43:28,  8.05s/it]
                                                          
{'loss': '0.08286', 'grad_norm': '2.179', 'learning_rate': '5.496e-07', 'epoch': '0.8972'}
+
 90%|████████▉ | 34060/37963 [77:24:33<8:43:28,  8.05s/it]
 90%|████████▉ | 34061/37963 [77:24:41<8:42:20,  8.03s/it]
 90%|████████▉ | 34062/37963 [77:24:49<8:42:14,  8.03s/it]
 90%|████████▉ | 34063/37963 [77:24:56<8:27:19,  7.80s/it]
 90%|████████▉ | 34064/37963 [77:25:04<8:28:45,  7.83s/it]
 90%|████████▉ | 34065/37963 [77:25:12<8:29:12,  7.84s/it]
 90%|████████▉ | 34066/37963 [77:25:20<8:27:05,  7.81s/it]
 90%|████████▉ | 34067/37963 [77:25:30<9:18:17,  8.60s/it]
 90%|████████▉ | 34068/37963 [77:25:38<9:03:39,  8.37s/it]
 90%|████████▉ | 34069/37963 [77:25:49<9:48:23,  9.07s/it]
 90%|████████▉ | 34070/37963 [77:25:57<9:21:43,  8.66s/it]
                                                          
{'loss': '0.08257', 'grad_norm': '2.502', 'learning_rate': '5.468e-07', 'epoch': '0.8975'}
+
 90%|████████▉ | 34070/37963 [77:25:57<9:21:43,  8.66s/it]
 90%|████████▉ | 34071/37963 [77:26:04<8:57:36,  8.29s/it]
 90%|████████▉ | 34072/37963 [77:26:12<8:47:18,  8.13s/it]
 90%|████████▉ | 34073/37963 [77:26:20<8:42:28,  8.06s/it]
 90%|████████▉ | 34074/37963 [77:26:27<8:34:49,  7.94s/it]
 90%|████████▉ | 34075/37963 [77:26:35<8:29:52,  7.87s/it]
 90%|████████▉ | 34076/37963 [77:26:45<9:17:48,  8.61s/it]
 90%|████████▉ | 34077/37963 [77:26:53<8:52:59,  8.23s/it]
 90%|████████▉ | 34078/37963 [77:27:01<8:47:14,  8.14s/it]
 90%|████████▉ | 34079/37963 [77:27:08<8:40:34,  8.04s/it]
 90%|████████▉ | 34080/37963 [77:27:16<8:32:13,  7.91s/it]
                                                          
{'loss': '0.09957', 'grad_norm': '3.6', 'learning_rate': '5.44e-07', 'epoch': '0.8977'}
+
 90%|████████▉ | 34080/37963 [77:27:16<8:32:13,  7.91s/it]
 90%|████████▉ | 34081/37963 [77:27:24<8:28:24,  7.86s/it]
 90%|████████▉ | 34082/37963 [77:27:31<8:23:36,  7.79s/it]
 90%|████████▉ | 34083/37963 [77:27:39<8:19:59,  7.73s/it]
 90%|████████▉ | 34084/37963 [77:27:47<8:18:31,  7.71s/it]
 90%|████████▉ | 34085/37963 [77:27:54<8:17:44,  7.70s/it]
 90%|████████▉ | 34086/37963 [77:28:02<8:16:22,  7.68s/it]
 90%|████████▉ | 34087/37963 [77:28:09<8:11:29,  7.61s/it]
 90%|████████▉ | 34088/37963 [77:28:17<8:09:29,  7.58s/it]
 90%|████████▉ | 34089/37963 [77:28:24<8:05:28,  7.52s/it]
 90%|████████▉ | 34090/37963 [77:28:35<9:05:58,  8.46s/it]
                                                          
{'loss': '0.07875', 'grad_norm': '3.506', 'learning_rate': '5.412e-07', 'epoch': '0.898'}
+
 90%|████████▉ | 34090/37963 [77:28:35<9:05:58,  8.46s/it]
 90%|████████▉ | 34091/37963 [77:28:43<8:52:31,  8.25s/it]
 90%|████████▉ | 34092/37963 [77:28:51<8:44:43,  8.13s/it]
 90%|████████▉ | 34093/37963 [77:28:58<8:37:27,  8.02s/it]
 90%|████████▉ | 34094/37963 [77:29:06<8:35:08,  7.99s/it]
 90%|████████▉ | 34095/37963 [77:29:14<8:30:41,  7.92s/it]
 90%|████████▉ | 34096/37963 [77:29:22<8:31:56,  7.94s/it]
 90%|████████▉ | 34097/37963 [77:29:32<9:15:38,  8.62s/it]
 90%|████████▉ | 34098/37963 [77:29:40<8:58:48,  8.36s/it]
 90%|████████▉ | 34099/37963 [77:29:48<8:46:48,  8.18s/it]
 90%|████████▉ | 34100/37963 [77:29:55<8:34:56,  8.00s/it]
                                                          
{'loss': '0.09986', 'grad_norm': '3.128', 'learning_rate': '5.385e-07', 'epoch': '0.8982'}
+
 90%|████████▉ | 34100/37963 [77:29:55<8:34:56,  8.00s/it]
 90%|████████▉ | 34101/37963 [77:30:03<8:33:21,  7.98s/it]
 90%|████████▉ | 34102/37963 [77:30:14<9:24:05,  8.77s/it]
 90%|████████▉ | 34103/37963 [77:30:22<9:04:33,  8.46s/it]
 90%|████████▉ | 34104/37963 [77:30:30<8:53:23,  8.29s/it]
 90%|████████▉ | 34105/37963 [77:30:40<9:38:01,  8.99s/it]
 90%|████████▉ | 34106/37963 [77:30:48<9:17:40,  8.68s/it]
 90%|████████▉ | 34107/37963 [77:30:56<9:01:04,  8.42s/it]
 90%|████████▉ | 34108/37963 [77:31:07<9:44:50,  9.10s/it]
 90%|████████▉ | 34109/37963 [77:31:14<9:21:13,  8.74s/it]
 90%|████████▉ | 34110/37963 [77:31:22<9:02:48,  8.45s/it]
                                                          
{'loss': '0.09943', 'grad_norm': '3.945', 'learning_rate': '5.357e-07', 'epoch': '0.8985'}
+
 90%|████████▉ | 34110/37963 [77:31:22<9:02:48,  8.45s/it]
 90%|████████▉ | 34111/37963 [77:31:30<8:50:29,  8.26s/it]
 90%|████████▉ | 34112/37963 [77:31:38<8:35:49,  8.04s/it]
 90%|████████▉ | 34113/37963 [77:31:48<9:26:45,  8.83s/it]
 90%|████████▉ | 34114/37963 [77:31:56<9:09:44,  8.57s/it]
 90%|████████▉ | 34115/37963 [77:32:07<9:44:55,  9.12s/it]
 90%|████████▉ | 34116/37963 [77:32:14<9:17:08,  8.69s/it]
 90%|████████▉ | 34117/37963 [77:32:22<8:56:22,  8.37s/it]
 90%|████████▉ | 34118/37963 [77:32:30<8:47:57,  8.24s/it]
 90%|████████▉ | 34119/37963 [77:32:38<8:41:18,  8.14s/it]
 90%|████████▉ | 34120/37963 [77:32:48<9:20:04,  8.74s/it]
                                                          
{'loss': '0.09751', 'grad_norm': '3.65', 'learning_rate': '5.329e-07', 'epoch': '0.8988'}
+
 90%|████████▉ | 34120/37963 [77:32:48<9:20:04,  8.74s/it]
 90%|████████▉ | 34121/37963 [77:32:56<9:02:16,  8.47s/it]
 90%|████████▉ | 34122/37963 [77:33:03<8:46:15,  8.22s/it]
 90%|████████▉ | 34123/37963 [77:33:11<8:35:44,  8.06s/it]
 90%|████████▉ | 34124/37963 [77:33:19<8:26:31,  7.92s/it]
 90%|████████▉ | 34125/37963 [77:33:26<8:21:14,  7.84s/it]
 90%|████████▉ | 34126/37963 [77:33:34<8:16:15,  7.76s/it]
 90%|████████▉ | 34127/37963 [77:33:42<8:17:55,  7.79s/it]
 90%|████████▉ | 34128/37963 [77:33:49<8:15:30,  7.75s/it]
 90%|████████▉ | 34129/37963 [77:33:57<8:17:18,  7.78s/it]
 90%|████████▉ | 34130/37963 [77:34:05<8:18:59,  7.81s/it]
                                                          
{'loss': '0.08551', 'grad_norm': '4.336', 'learning_rate': '5.302e-07', 'epoch': '0.899'}
+
 90%|████████▉ | 34130/37963 [77:34:05<8:18:59,  7.81s/it]
 90%|████████▉ | 34131/37963 [77:34:13<8:13:34,  7.73s/it]
 90%|████████▉ | 34132/37963 [77:34:20<8:12:39,  7.72s/it]
 90%|████████▉ | 34133/37963 [77:34:28<8:17:19,  7.79s/it]
 90%|████████▉ | 34134/37963 [77:34:39<9:11:26,  8.64s/it]
 90%|████████▉ | 34135/37963 [77:34:47<8:54:39,  8.38s/it]
 90%|████████▉ | 34136/37963 [77:34:55<8:44:03,  8.22s/it]
 90%|████████▉ | 34137/37963 [77:35:02<8:33:24,  8.05s/it]
 90%|████████▉ | 34138/37963 [77:35:10<8:25:26,  7.93s/it]
 90%|████████▉ | 34139/37963 [77:35:18<8:20:34,  7.85s/it]
 90%|████████▉ | 34140/37963 [77:35:25<8:16:35,  7.79s/it]
                                                          
{'loss': '0.09651', 'grad_norm': '3.616', 'learning_rate': '5.275e-07', 'epoch': '0.8993'}
+
 90%|████████▉ | 34140/37963 [77:35:25<8:16:35,  7.79s/it]
 90%|████████▉ | 34141/37963 [77:35:36<9:04:26,  8.55s/it]
 90%|████████▉ | 34142/37963 [77:35:44<8:54:54,  8.40s/it]
 90%|████████▉ | 34143/37963 [77:35:51<8:43:33,  8.22s/it]
 90%|████████▉ | 34144/37963 [77:35:59<8:38:18,  8.14s/it]
 90%|████████▉ | 34145/37963 [77:36:07<8:30:18,  8.02s/it]
 90%|████████▉ | 34146/37963 [77:36:15<8:27:56,  7.98s/it]
 90%|████████▉ | 34147/37963 [77:36:23<8:24:03,  7.93s/it]
 90%|████████▉ | 34148/37963 [77:36:33<9:14:17,  8.72s/it]
 90%|████████▉ | 34149/37963 [77:36:41<8:57:08,  8.45s/it]
 90%|████████▉ | 34150/37963 [77:36:49<8:44:33,  8.25s/it]
                                                          
{'loss': '0.08608', 'grad_norm': '2.447', 'learning_rate': '5.247e-07', 'epoch': '0.8996'}
+
 90%|████████▉ | 34150/37963 [77:36:49<8:44:33,  8.25s/it]
 90%|████████▉ | 34151/37963 [77:36:59<9:27:34,  8.93s/it]
 90%|████████▉ | 34152/37963 [77:37:10<9:57:20,  9.40s/it]
 90%|████████▉ | 34153/37963 [77:37:18<9:23:40,  8.88s/it]
 90%|████████▉ | 34154/37963 [77:37:26<9:05:48,  8.60s/it]
 90%|████████▉ | 34155/37963 [77:37:33<8:48:48,  8.33s/it]
 90%|████████▉ | 34156/37963 [77:37:41<8:31:20,  8.06s/it]
 90%|████████▉ | 34157/37963 [77:37:48<8:24:53,  7.96s/it]
 90%|████████▉ | 34158/37963 [77:37:56<8:17:48,  7.85s/it]
 90%|████████▉ | 34159/37963 [77:38:04<8:15:20,  7.81s/it]
 90%|████████▉ | 34160/37963 [77:38:12<8:16:04,  7.83s/it]
                                                          
{'loss': '0.0918', 'grad_norm': '3.027', 'learning_rate': '5.22e-07', 'epoch': '0.8998'}
+
 90%|████████▉ | 34160/37963 [77:38:12<8:16:04,  7.83s/it]
 90%|████████▉ | 34161/37963 [77:38:19<8:10:20,  7.74s/it]
 90%|████████▉ | 34162/37963 [77:38:29<8:58:30,  8.50s/it]
 90%|████████▉ | 34163/37963 [77:38:40<9:30:20,  9.01s/it]
 90%|████████▉ | 34164/37963 [77:38:47<9:06:15,  8.63s/it]
 90%|████████▉ | 34165/37963 [77:38:55<8:51:39,  8.40s/it]
 90%|████████▉ | 34166/37963 [77:39:03<8:37:22,  8.18s/it]
 90%|█████████ | 34167/37963 [77:39:14<9:28:01,  8.98s/it]
 90%|█████████ | 34168/37963 [77:39:22<9:07:25,  8.66s/it]
 90%|█████████ | 34169/37963 [77:39:29<8:44:24,  8.29s/it]
 90%|█████████ | 34170/37963 [77:39:37<8:35:23,  8.15s/it]
                                                          
{'loss': '0.08466', 'grad_norm': '2.791', 'learning_rate': '5.193e-07', 'epoch': '0.9001'}
+
 90%|█████████ | 34170/37963 [77:39:37<8:35:23,  8.15s/it]
 90%|█████████ | 34171/37963 [77:39:45<8:30:11,  8.07s/it]
 90%|█████████ | 34172/37963 [77:39:52<8:20:48,  7.93s/it]
 90%|█████████ | 34173/37963 [77:40:00<8:20:51,  7.93s/it]
 90%|█████████ | 34174/37963 [77:40:08<8:17:28,  7.88s/it]
 90%|█████████ | 34175/37963 [77:40:16<8:14:04,  7.83s/it]
 90%|█████████ | 34176/37963 [77:40:23<8:11:47,  7.79s/it]
 90%|█████████ | 34177/37963 [77:40:31<8:12:57,  7.81s/it]
 90%|█████████ | 34178/37963 [77:40:39<8:09:42,  7.76s/it]
 90%|█████████ | 34179/37963 [77:40:47<8:08:51,  7.75s/it]
 90%|█████████ | 34180/37963 [77:40:55<8:10:38,  7.78s/it]
                                                          
{'loss': '0.09361', 'grad_norm': '3.658', 'learning_rate': '5.166e-07', 'epoch': '0.9004'}
+
 90%|█████████ | 34180/37963 [77:40:55<8:10:38,  7.78s/it]
 90%|█████████ | 34181/37963 [77:41:02<8:09:19,  7.76s/it]
 90%|█████████ | 34182/37963 [77:41:10<8:11:44,  7.80s/it]
 90%|█████████ | 34183/37963 [77:41:18<8:06:01,  7.71s/it]
 90%|█████████ | 34184/37963 [77:41:28<8:52:51,  8.46s/it]
 90%|█████████ | 34185/37963 [77:41:36<8:42:22,  8.30s/it]
 90%|█████████ | 34186/37963 [77:41:44<8:32:01,  8.13s/it]
 90%|█████████ | 34187/37963 [77:41:51<8:22:27,  7.98s/it]
 90%|█████████ | 34188/37963 [77:42:02<9:10:46,  8.75s/it]
 90%|█████████ | 34189/37963 [77:42:09<8:42:18,  8.30s/it]
 90%|█████████ | 34190/37963 [77:42:17<8:32:24,  8.15s/it]
                                                          
{'loss': '0.08972', 'grad_norm': '3.685', 'learning_rate': '5.139e-07', 'epoch': '0.9006'}
+
 90%|█████████ | 34190/37963 [77:42:17<8:32:24,  8.15s/it]
 90%|█████████ | 34191/37963 [77:42:24<8:23:10,  8.00s/it]
 90%|█████████ | 34192/37963 [77:42:35<9:11:15,  8.77s/it]
 90%|█████████ | 34193/37963 [77:42:43<8:56:45,  8.54s/it]
 90%|█████████ | 34194/37963 [77:42:51<8:40:27,  8.29s/it]
 90%|█████████ | 34195/37963 [77:42:58<8:28:56,  8.10s/it]
 90%|█████████ | 34196/37963 [77:43:06<8:20:35,  7.97s/it]
 90%|█████████ | 34197/37963 [77:43:14<8:14:34,  7.88s/it]
 90%|█████████ | 34198/37963 [77:43:24<9:03:36,  8.66s/it]
 90%|█████████ | 34199/37963 [77:43:32<8:47:34,  8.41s/it]
 90%|█████████ | 34200/37963 [77:43:40<8:32:48,  8.18s/it]
                                                          
{'loss': '0.1087', 'grad_norm': '4.044', 'learning_rate': '5.112e-07', 'epoch': '0.9009'}
+
 90%|█████████ | 34200/37963 [77:43:40<8:32:48,  8.18s/it]
 90%|█��███████ | 34201/37963 [77:43:47<8:21:36,  8.00s/it]
 90%|█████████ | 34202/37963 [77:43:55<8:20:19,  7.98s/it]
 90%|█████████ | 34203/37963 [77:44:03<8:12:13,  7.85s/it]
 90%|█████████ | 34204/37963 [77:44:13<8:58:02,  8.59s/it]
 90%|█████████ | 34205/37963 [77:44:21<8:43:20,  8.36s/it]
 90%|█████████ | 34206/37963 [77:44:28<8:24:57,  8.06s/it]
 90%|█████████ | 34207/37963 [77:44:36<8:20:19,  7.99s/it]
 90%|█████████ | 34208/37963 [77:44:44<8:16:50,  7.94s/it]
 90%|█████████ | 34209/37963 [77:44:52<8:12:59,  7.88s/it]
 90%|█████████ | 34210/37963 [77:44:59<8:07:56,  7.80s/it]
                                                          
{'loss': '0.08426', 'grad_norm': '3.431', 'learning_rate': '5.085e-07', 'epoch': '0.9011'}
+
 90%|█████████ | 34210/37963 [77:44:59<8:07:56,  7.80s/it]
 90%|█████████ | 34211/37963 [77:45:07<8:06:36,  7.78s/it]
 90%|█████████ | 34212/37963 [77:45:20<9:53:25,  9.49s/it]
 90%|█████████ | 34213/37963 [77:45:28<9:24:04,  9.03s/it]
 90%|█████████ | 34214/37963 [77:45:36<8:56:30,  8.59s/it]
 90%|█████████ | 34215/37963 [77:45:46<9:26:59,  9.08s/it]
 90%|█████████ | 34216/37963 [77:45:54<9:02:47,  8.69s/it]
 90%|█████████ | 34217/37963 [77:46:02<8:51:02,  8.51s/it]
 90%|█████████ | 34218/37963 [77:46:10<8:35:14,  8.25s/it]
 90%|█████████ | 34219/37963 [77:46:18<8:30:10,  8.18s/it]
 90%|█████████ | 34220/37963 [77:46:25<8:21:14,  8.03s/it]
                                                          
{'loss': '0.08562', 'grad_norm': '2.693', 'learning_rate': '5.058e-07', 'epoch': '0.9014'}
+
 90%|█████████ | 34220/37963 [77:46:25<8:21:14,  8.03s/it]
 90%|█████████ | 34221/37963 [77:46:33<8:13:34,  7.91s/it]
 90%|█████████ | 34222/37963 [77:46:41<8:08:20,  7.83s/it]
 90%|█████████ | 34223/37963 [77:46:48<8:05:24,  7.79s/it]
 90%|█████████ | 34224/37963 [77:46:56<8:06:04,  7.80s/it]
 90%|█████████ | 34225/37963 [77:47:04<8:07:37,  7.83s/it]
 90%|█████████ | 34226/37963 [77:47:12<8:03:37,  7.76s/it]
 90%|█████████ | 34227/37963 [77:47:20<8:05:31,  7.80s/it]
 90%|█████████ | 34228/37963 [77:47:27<8:03:56,  7.77s/it]
 90%|█████████ | 34229/37963 [77:47:35<8:00:26,  7.72s/it]
 90%|█████████ | 34230/37963 [77:47:43<8:03:06,  7.76s/it]
                                                          
{'loss': '0.09321', 'grad_norm': '3.134', 'learning_rate': '5.031e-07', 'epoch': '0.9017'}
+
 90%|█████████ | 34230/37963 [77:47:43<8:03:06,  7.76s/it]
 90%|█████████ | 34231/37963 [77:47:53<8:54:37,  8.60s/it]
 90%|█████████ | 34232/37963 [77:48:04<9:30:32,  9.18s/it]
 90%|█████████ | 34233/37963 [77:48:11<8:57:20,  8.64s/it]
 90%|█████████ | 34234/37963 [77:48:19<8:41:50,  8.40s/it]
 90%|█████████ | 34235/37963 [77:48:27<8:30:47,  8.22s/it]
 90%|█████████ | 34236/37963 [77:48:38<9:23:45,  9.08s/it]
 90%|█████████ | 34237/37963 [77:48:46<8:59:45,  8.69s/it]
 90%|█████████ | 34238/37963 [77:48:53<8:36:51,  8.33s/it]
 90%|█████████ | 34239/37963 [77:49:01<8:21:21,  8.08s/it]
 90%|█████████ | 34240/37963 [77:49:08<8:11:51,  7.93s/it]
                                                          
{'loss': '0.103', 'grad_norm': '4.144', 'learning_rate': '5.005e-07', 'epoch': '0.9019'}
+
 90%|█████████ | 34240/37963 [77:49:08<8:11:51,  7.93s/it]
 90%|█████████ | 34241/37963 [77:49:16<8:06:33,  7.84s/it]
 90%|█████████ | 34242/37963 [77:49:24<8:04:04,  7.81s/it]
 90%|█████████ | 34243/37963 [77:49:31<8:00:46,  7.75s/it]
 90%|█████████ | 34244/37963 [77:49:39<8:01:41,  7.77s/it]
 90%|█████████ | 34245/37963 [77:49:50<8:52:00,  8.59s/it]
 90%|█████████ | 34246/37963 [77:49:58<8:41:15,  8.41s/it]
 90%|█████████ | 34247/37963 [77:50:05<8:30:01,  8.24s/it]
 90%|█████████ | 34248/37963 [77:50:16<9:09:03,  8.87s/it]
 90%|█████████ | 34249/37963 [77:50:24<8:51:12,  8.58s/it]
 90%|█████████ | 34250/37963 [77:50:32<8:38:55,  8.39s/it]
                                                          
{'loss': '0.09607', 'grad_norm': '3.065', 'learning_rate': '4.978e-07', 'epoch': '0.9022'}
+
 90%|█████████ | 34250/37963 [77:50:32<8:38:55,  8.39s/it]
 90%|█████████ | 34251/37963 [77:50:40<8:31:09,  8.26s/it]
 90%|█████████ | 34252/37963 [77:50:48<8:27:49,  8.21s/it]
 90%|█████████ | 34253/37963 [77:50:55<8:16:29,  8.03s/it]
 90%|█████████ | 34254/37963 [77:51:03<8:08:46,  7.91s/it]
 90%|█████████ | 34255/37963 [77:51:11<8:06:54,  7.88s/it]
 90%|█████████ | 34256/37963 [77:51:18<8:00:04,  7.77s/it]
 90%|█████████ | 34257/37963 [77:51:26<8:02:58,  7.82s/it]
 90%|█████████ | 34258/37963 [77:51:34<8:06:36,  7.88s/it]
 90%|█████████ | 34259/37963 [77:51:42<8:04:51,  7.85s/it]
 90%|█████████ | 34260/37963 [77:51:52<8:50:56,  8.60s/it]
                                                          
{'loss': '0.09233', 'grad_norm': '3.098', 'learning_rate': '4.951e-07', 'epoch': '0.9025'}
+
 90%|█████████ | 34260/37963 [77:51:52<8:50:56,  8.60s/it]
 90%|█████████ | 34261/37963 [77:52:00<8:35:21,  8.35s/it]
 90%|█████████ | 34262/37963 [77:52:08<8:23:46,  8.17s/it]
 90%|█████████ | 34263/37963 [77:52:16<8:15:35,  8.04s/it]
 90%|█████████ | 34264/37963 [77:52:26<8:57:43,  8.72s/it]
 90%|█████████ | 34265/37963 [77:52:36<9:30:12,  9.25s/it]
 90%|█████████ | 34266/37963 [77:52:44<9:00:19,  8.77s/it]
 90%|█████████ | 34267/37963 [77:52:52<8:41:26,  8.47s/it]
 90%|█████████ | 34268/37963 [77:52:59<8:26:00,  8.22s/it]
 90%|█████████ | 34269/37963 [77:53:07<8:19:20,  8.11s/it]
 90%|█████████ | 34270/37963 [77:53:15<8:14:51,  8.04s/it]
                                                          
{'loss': '0.08531', 'grad_norm': '3.601', 'learning_rate': '4.925e-07', 'epoch': '0.9027'}
+
 90%|█████████ | 34270/37963 [77:53:15<8:14:51,  8.04s/it]
 90%|█████████ | 34271/37963 [77:53:23<8:09:15,  7.95s/it]
 90%|█████████ | 34272/37963 [77:53:31<8:05:46,  7.90s/it]
 90%|█████████ | 34273/37963 [77:53:38<7:58:15,  7.78s/it]
 90%|█████████ | 34274/37963 [77:53:46<7:55:49,  7.74s/it]
 90%|█████████ | 34275/37963 [77:53:53<7:54:15,  7.72s/it]
 90%|█████████ | 34276/37963 [77:54:04<8:49:02,  8.61s/it]
 90%|█████████ | 34277/37963 [77:54:12<8:27:25,  8.26s/it]
 90%|█████████ | 34278/37963 [77:54:19<8:11:15,  8.00s/it]
 90%|█████████ | 34279/37963 [77:54:27<8:08:17,  7.95s/it]
 90%|█████████ | 34280/37963 [77:54:35<8:04:59,  7.90s/it]
                                                          
{'loss': '0.08223', 'grad_norm': '4.034', 'learning_rate': '4.899e-07', 'epoch': '0.903'}
+
 90%|█████████ | 34280/37963 [77:54:35<8:04:59,  7.90s/it]
 90%|█████████ | 34281/37963 [77:54:42<8:02:31,  7.86s/it]
 90%|█████████ | 34282/37963 [77:54:50<7:53:00,  7.71s/it]
 90%|█████████ | 34283/37963 [77:54:57<7:50:08,  7.67s/it]
 90%|█████████ | 34284/37963 [77:55:10<9:25:25,  9.22s/it]
 90%|█████████ | 34285/37963 [77:55:18<8:59:44,  8.81s/it]
 90%|█████████ | 34286/37963 [77:55:26<8:38:03,  8.45s/it]
 90%|█████████ | 34287/37963 [77:55:33<8:17:21,  8.12s/it]
 90%|█████████ | 34288/37963 [77:55:41<8:11:27,  8.02s/it]
 90%|█████████ | 34289/37963 [77:55:49<8:07:31,  7.96s/it]
 90%|█████████ | 34290/37963 [77:55:56<8:05:23,  7.93s/it]
                                                          
{'loss': '0.08862', 'grad_norm': '4.007', 'learning_rate': '4.872e-07', 'epoch': '0.9033'}
+
 90%|█████████ | 34290/37963 [77:55:56<8:05:23,  7.93s/it]
 90%|█████████ | 34291/37963 [77:56:04<8:04:04,  7.91s/it]
 90%|█████████ | 34292/37963 [77:56:12<7:54:54,  7.76s/it]
 90%|█████████ | 34293/37963 [77:56:19<7:44:55,  7.60s/it]
 90%|█████████ | 34294/37963 [77:56:27<7:48:04,  7.65s/it]
 90%|█████████ | 34295/37963 [77:56:37<8:37:29,  8.46s/it]
 90%|█████████ | 34296/37963 [77:56:45<8:21:25,  8.20s/it]
 90%|█████████ | 34297/37963 [77:56:52<8:11:53,  8.05s/it]
 90%|█████████ | 34298/37963 [77:57:03<8:57:55,  8.81s/it]
 90%|█████████ | 34299/37963 [77:57:11<8:38:51,  8.50s/it]
 90%|█████████ | 34300/37963 [77:57:18<8:22:26,  8.23s/it]
                                                          
{'loss': '0.0778', 'grad_norm': '3.173', 'learning_rate': '4.846e-07', 'epoch': '0.9035'}
+
 90%|█████████ | 34300/37963 [77:57:18<8:22:26,  8.23s/it]
 90%|█████████ | 34301/37963 [77:57:26<8:13:36,  8.09s/it]
 90%|█████████ | 34302/37963 [77:57:34<8:08:34,  8.01s/it]
 90%|█████████ | 34303/37963 [77:57:44<8:47:54,  8.65s/it]
 90%|█████████ | 34304/37963 [77:57:52<8:34:50,  8.44s/it]
 90%|█████████ | 34305/37963 [77:58:00<8:18:45,  8.18s/it]
 90%|█████████ | 34306/37963 [77:58:07<8:10:59,  8.06s/it]
 90%|█████████ | 34307/37963 [77:58:15<8:04:28,  7.95s/it]
 90%|█████████ | 34308/37963 [77:58:23<7:58:37,  7.86s/it]
 90%|█████████ | 34309/37963 [77:58:30<7:50:11,  7.72s/it]
 90%|█████████ | 34310/37963 [77:58:38<7:52:29,  7.76s/it]
                                                          
{'loss': '0.09101', 'grad_norm': '3.612', 'learning_rate': '4.82e-07', 'epoch': '0.9038'}
+
 90%|█████████ | 34310/37963 [77:58:38<7:52:29,  7.76s/it]
 90%|█████████ | 34311/37963 [77:58:46<7:50:59,  7.74s/it]
 90%|█████████ | 34312/37963 [77:58:56<8:42:48,  8.59s/it]
 90%|█████████ | 34313/37963 [77:59:06<9:14:02,  9.11s/it]
 90%|█████████ | 34314/37963 [77:59:14<8:49:17,  8.70s/it]
 90%|█████████ | 34315/37963 [77:59:22<8:29:57,  8.39s/it]
 90%|█████████ | 34316/37963 [77:59:30<8:17:38,  8.19s/it]
 90%|█████████ | 34317/37963 [77:59:37<8:09:09,  8.05s/it]
 90%|█████████ | 34318/37963 [77:59:45<8:02:56,  7.95s/it]
 90%|█████████ | 34319/37963 [77:59:53<7:58:37,  7.88s/it]
 90%|█████████ | 34320/37963 [78:00:00<7:53:44,  7.80s/it]
                                                          
{'loss': '0.08097', 'grad_norm': '2.769', 'learning_rate': '4.794e-07', 'epoch': '0.904'}
+
 90%|█████████ | 34320/37963 [78:00:00<7:53:44,  7.80s/it]
 90%|█████████ | 34321/37963 [78:00:08<7:51:30,  7.77s/it]
 90%|█████████ | 34322/37963 [78:00:16<7:48:27,  7.72s/it]
 90%|█████████ | 34323/37963 [78:00:24<7:52:02,  7.78s/it]
 90%|█████████ | 34324/37963 [78:00:31<7:46:27,  7.69s/it]
 90%|█████████ | 34325/37963 [78:00:39<7:49:12,  7.74s/it]
 90%|█████████ | 34326/37963 [78:00:47<7:48:20,  7.73s/it]
 90%|█████████ | 34327/37963 [78:00:57<8:38:11,  8.55s/it]
 90%|█████████ | 34328/37963 [78:01:05<8:26:14,  8.36s/it]
 90%|█████████ | 34329/37963 [78:01:13<8:15:41,  8.18s/it]
 90%|█████████ | 34330/37963 [78:01:24<9:02:02,  8.95s/it]
                                                          
{'loss': '0.09079', 'grad_norm': '4.539', 'learning_rate': '4.768e-07', 'epoch': '0.9043'}
+
 90%|█████████ | 34330/37963 [78:01:24<9:02:02,  8.95s/it]
 90%|█████████ | 34331/37963 [78:01:31<8:40:07,  8.59s/it]
 90%|█████████ | 34332/37963 [78:01:39<8:29:48,  8.42s/it]
 90%|█████████ | 34333/37963 [78:01:50<9:06:34,  9.03s/it]
 90%|█████████ | 34334/37963 [78:01:57<8:37:30,  8.56s/it]
 90%|█████████ | 34335/37963 [78:02:05<8:17:25,  8.23s/it]
 90%|█████████ | 34336/37963 [78:02:12<8:03:51,  8.00s/it]
 90%|█████████ | 34337/37963 [78:02:20<7:53:31,  7.84s/it]
 90%|█████████ | 34338/37963 [78:02:27<7:50:52,  7.79s/it]
 90%|█████████ | 34339/37963 [78:02:35<7:50:25,  7.79s/it]
 90%|█████████ | 34340/37963 [78:02:43<7:47:09,  7.74s/it]
                                                          
{'loss': '0.08245', 'grad_norm': '4.481', 'learning_rate': '4.742e-07', 'epoch': '0.9046'}
+
 90%|█████████ | 34340/37963 [78:02:43<7:47:09,  7.74s/it]
 90%|█████████ | 34341/37963 [78:02:51<7:48:34,  7.76s/it]
 90%|█████████ | 34342/37963 [78:02:58<7:50:24,  7.79s/it]
 90%|█████████ | 34343/37963 [78:03:08<8:31:03,  8.47s/it]
 90%|█████████ | 34344/37963 [78:03:16<8:18:35,  8.27s/it]
 90%|█████████ | 34345/37963 [78:03:24<8:09:39,  8.12s/it]
 90%|█████████ | 34346/37963 [78:03:34<8:47:37,  8.75s/it]
 90%|█████████ | 34347/37963 [78:03:42<8:31:11,  8.48s/it]
 90%|█████████ | 34348/37963 [78:03:50<8:13:26,  8.19s/it]
 90%|█████████ | 34349/37963 [78:03:57<8:04:14,  8.04s/it]
 90%|█████████ | 34350/37963 [78:04:05<8:00:15,  7.98s/it]
                                                          
{'loss': '0.09516', 'grad_norm': '3.209', 'learning_rate': '4.716e-07', 'epoch': '0.9048'}
+
 90%|█████████ | 34350/37963 [78:04:05<8:00:15,  7.98s/it]
 90%|█████████ | 34351/37963 [78:04:13<8:01:50,  8.00s/it]
 90%|█████████ | 34352/37963 [78:04:21<7:56:25,  7.92s/it]
 90%|█████████ | 34353/37963 [78:04:29<7:51:27,  7.84s/it]
 90%|█████████ | 34354/37963 [78:04:39<8:38:41,  8.62s/it]
 90%|█████████ | 34355/37963 [78:04:47<8:26:11,  8.42s/it]
 90%|���████████ | 34356/37963 [78:04:55<8:17:15,  8.27s/it]
 91%|█████████ | 34357/37963 [78:05:03<8:08:37,  8.13s/it]
 91%|█████████ | 34358/37963 [78:05:10<7:59:09,  7.97s/it]
 91%|█████████ | 34359/37963 [78:05:18<7:54:51,  7.91s/it]
 91%|█████████ | 34360/37963 [78:05:28<8:38:41,  8.64s/it]
                                                          
{'loss': '0.08358', 'grad_norm': '2.801', 'learning_rate': '4.69e-07', 'epoch': '0.9051'}
+
 91%|█████████ | 34360/37963 [78:05:28<8:38:41,  8.64s/it]
 91%|█████████ | 34361/37963 [78:05:38<9:01:37,  9.02s/it]
 91%|█████████ | 34362/37963 [78:05:46<8:40:55,  8.68s/it]
 91%|█████████ | 34363/37963 [78:05:54<8:21:23,  8.36s/it]
 91%|█████████ | 34364/37963 [78:06:02<8:09:44,  8.16s/it]
 91%|█████████ | 34365/37963 [78:06:09<8:01:55,  8.04s/it]
 91%|█████████ | 34366/37963 [78:06:17<8:00:04,  8.01s/it]
 91%|█████████ | 34367/37963 [78:06:25<7:52:48,  7.89s/it]
 91%|█████████ | 34368/37963 [78:06:32<7:46:52,  7.79s/it]
 91%|█████████ | 34369/37963 [78:06:40<7:45:36,  7.77s/it]
 91%|█████████ | 34370/37963 [78:06:47<7:37:56,  7.65s/it]
                                                          
{'loss': '0.09209', 'grad_norm': '4.166', 'learning_rate': '4.664e-07', 'epoch': '0.9054'}
+
 91%|█████████ | 34370/37963 [78:06:47<7:37:56,  7.65s/it]
 91%|█████████ | 34371/37963 [78:06:55<7:42:55,  7.73s/it]
 91%|█████████ | 34372/37963 [78:07:03<7:40:54,  7.70s/it]
 91%|█████████ | 34373/37963 [78:07:11<7:46:02,  7.79s/it]
 91%|█████████ | 34374/37963 [78:07:19<7:47:15,  7.81s/it]
 91%|█████████ | 34375/37963 [78:07:27<7:47:07,  7.81s/it]
 91%|█████████ | 34376/37963 [78:07:34<7:44:34,  7.77s/it]
 91%|█████████ | 34377/37963 [78:07:42<7:44:23,  7.77s/it]
 91%|█████████ | 34378/37963 [78:07:50<7:42:04,  7.73s/it]
 91%|█████████ | 34379/37963 [78:07:57<7:41:26,  7.72s/it]
 91%|█████████ | 34380/37963 [78:08:08<8:30:39,  8.55s/it]
                                                          
{'loss': '0.09699', 'grad_norm': '6.173', 'learning_rate': '4.638e-07', 'epoch': '0.9056'}
+
 91%|█████████ | 34380/37963 [78:08:08<8:30:39,  8.55s/it]
 91%|█████████ | 34381/37963 [78:08:19<9:13:18,  9.27s/it]
 91%|█████████ | 34382/37963 [78:08:27<8:45:56,  8.81s/it]
 91%|█████████ | 34383/37963 [78:08:35<8:31:40,  8.58s/it]
 91%|█████████ | 34384/37963 [78:08:42<8:14:04,  8.28s/it]
 91%|█████████ | 34385/37963 [78:08:50<8:04:57,  8.13s/it]
 91%|█████████ | 34386/37963 [78:09:00<8:44:13,  8.79s/it]
 91%|█████████ | 34387/37963 [78:09:08<8:30:07,  8.56s/it]
 91%|█████████ | 34388/37963 [78:09:16<8:16:09,  8.33s/it]
 91%|█████████ | 34389/37963 [78:09:24<8:03:52,  8.12s/it]
 91%|█████████ | 34390/37963 [78:09:31<7:51:24,  7.92s/it]
                                                          
{'loss': '0.07962', 'grad_norm': '3.151', 'learning_rate': '4.613e-07', 'epoch': '0.9059'}
+
 91%|█████████ | 34390/37963 [78:09:31<7:51:24,  7.92s/it]
 91%|█████████ | 34391/37963 [78:09:39<7:49:11,  7.88s/it]
 91%|█████████ | 34392/37963 [78:09:47<7:45:30,  7.82s/it]
 91%|█████████ | 34393/37963 [78:09:54<7:40:09,  7.73s/it]
 91%|█████████ | 34394/37963 [78:10:05<8:24:42,  8.48s/it]
 91%|█████████ | 34395/37963 [78:10:12<8:10:29,  8.25s/it]
 91%|█████████ | 34396/37963 [78:10:20<8:01:07,  8.09s/it]
 91%|█████████ | 34397/37963 [78:10:30<8:43:31,  8.81s/it]
 91%|█████████ | 34398/37963 [78:10:38<8:24:42,  8.49s/it]
 91%|█████████ | 34399/37963 [78:10:46<8:08:55,  8.23s/it]
 91%|█████████ | 34400/37963 [78:10:53<7:53:27,  7.97s/it]
                                                          
{'loss': '0.09581', 'grad_norm': '3.27', 'learning_rate': '4.587e-07', 'epoch': '0.9061'}
+
 91%|█████████ | 34400/37963 [78:10:53<7:53:27,  7.97s/it]
 91%|█████████ | 34401/37963 [78:11:01<7:48:43,  7.90s/it]
 91%|█████████ | 34402/37963 [78:11:08<7:41:20,  7.77s/it]
 91%|█████████ | 34403/37963 [78:11:16<7:38:44,  7.73s/it]
 91%|█████████ | 34404/37963 [78:11:26<8:26:42,  8.54s/it]
 91%|█████████ | 34405/37963 [78:11:34<8:13:21,  8.32s/it]
 91%|█████████ | 34406/37963 [78:11:42<8:04:16,  8.17s/it]
 91%|█████████ | 34407/37963 [78:11:50<7:56:30,  8.04s/it]
 91%|█████████ | 34408/37963 [78:12:00<8:34:58,  8.69s/it]
 91%|█████████ | 34409/37963 [78:12:08<8:24:50,  8.52s/it]
 91%|█████████ | 34410/37963 [78:12:16<8:07:28,  8.23s/it]
                                                          
{'loss': '0.106', 'grad_norm': '2.552', 'learning_rate': '4.562e-07', 'epoch': '0.9064'}
+
 91%|█████████ | 34410/37963 [78:12:16<8:07:28,  8.23s/it]
 91%|█████████ | 34411/37963 [78:12:26<8:45:36,  8.88s/it]
 91%|█████████ | 34412/37963 [78:12:34<8:27:18,  8.57s/it]
 91%|█████████ | 34413/37963 [78:12:41<8:08:48,  8.26s/it]
 91%|█████████ | 34414/37963 [78:12:49<8:02:00,  8.15s/it]
 91%|█████████ | 34415/37963 [78:12:57<7:53:06,  8.00s/it]
 91%|█████████ | 34416/37963 [78:13:05<7:46:29,  7.89s/it]
 91%|█████████ | 34417/37963 [78:13:12<7:42:53,  7.83s/it]
 91%|█████████ | 34418/37963 [78:13:20<7:37:57,  7.75s/it]
 91%|█████████ | 34419/37963 [78:13:28<7:37:16,  7.74s/it]
 91%|█████████ | 34420/37963 [78:13:35<7:33:44,  7.68s/it]
                                                          
{'loss': '0.09263', 'grad_norm': '2.922', 'learning_rate': '4.536e-07', 'epoch': '0.9067'}
+
 91%|█████████ | 34420/37963 [78:13:35<7:33:44,  7.68s/it]
 91%|█████████ | 34421/37963 [78:13:43<7:32:59,  7.67s/it]
 91%|█████████ | 34422/37963 [78:13:51<7:38:24,  7.77s/it]
 91%|█████████ | 34423/37963 [78:13:58<7:36:14,  7.73s/it]
 91%|█████████ | 34424/37963 [78:14:06<7:34:24,  7.70s/it]
 91%|█████████ | 34425/37963 [78:14:14<7:30:42,  7.64s/it]
 91%|█████████ | 34426/37963 [78:14:21<7:34:56,  7.72s/it]
 91%|█████████ | 34427/37963 [78:14:29<7:34:12,  7.71s/it]
 91%|█████████ | 34428/37963 [78:14:40<8:25:11,  8.57s/it]
 91%|█████████ | 34429/37963 [78:14:48<8:10:20,  8.32s/it]
 91%|█████████ | 34430/37963 [78:14:55<7:53:43,  8.05s/it]
                                                          
{'loss': '0.0902', 'grad_norm': '3.367', 'learning_rate': '4.511e-07', 'epoch': '0.9069'}
+
 91%|█████████ | 34430/37963 [78:14:55<7:53:43,  8.05s/it]
 91%|█████████ | 34431/37963 [78:15:02<7:43:55,  7.88s/it]
 91%|█████████ | 34432/37963 [78:15:10<7:40:29,  7.82s/it]
 91%|█████████ | 34433/37963 [78:15:18<7:36:59,  7.77s/it]
 91%|█████████ | 34434/37963 [78:15:25<7:35:33,  7.75s/it]
 91%|█████████ | 34435/37963 [78:15:38<9:09:18,  9.34s/it]
 91%|█████████ | 34436/37963 [78:15:46<8:41:27,  8.87s/it]
 91%|█████████ | 34437/37963 [78:15:54<8:21:18,  8.53s/it]
 91%|█████████ | 34438/37963 [78:16:02<8:10:56,  8.36s/it]
 91%|█████████ | 34439/37963 [78:16:10<8:01:53,  8.20s/it]
 91%|█████████ | 34440/37963 [78:16:17<7:52:30,  8.05s/it]
                                                          
{'loss': '0.08485', 'grad_norm': '3.369', 'learning_rate': '4.485e-07', 'epoch': '0.9072'}
+
 91%|█████████ | 34440/37963 [78:16:17<7:52:30,  8.05s/it]
 91%|█████████ | 34441/37963 [78:16:25<7:48:15,  7.98s/it]
 91%|█████████ | 34442/37963 [78:16:33<7:41:53,  7.87s/it]
 91%|█████████ | 34443/37963 [78:16:41<7:42:11,  7.88s/it]
 91%|█████████ | 34444/37963 [78:16:48<7:33:38,  7.73s/it]
 91%|█████████ | 34445/37963 [78:16:56<7:32:01,  7.71s/it]
 91%|█████████ | 34446/37963 [78:17:04<7:34:39,  7.76s/it]
 91%|█████████ | 34447/37963 [78:17:17<9:13:46,  9.45s/it]
 91%|█████████ | 34448/37963 [78:17:25<8:43:30,  8.94s/it]
 91%|█████████ | 34449/37963 [78:17:33<8:21:06,  8.56s/it]
 91%|█████████ | 34450/37963 [78:17:40<8:06:23,  8.31s/it]
                                                          
{'loss': '0.08383', 'grad_norm': '3.087', 'learning_rate': '4.46e-07', 'epoch': '0.9075'}
+
 91%|█████████ | 34450/37963 [78:17:40<8:06:23,  8.31s/it]
 91%|█████████ | 34451/37963 [78:17:51<8:49:13,  9.04s/it]
 91%|█████████ | 34452/37963 [78:17:59<8:26:15,  8.65s/it]
 91%|█████████ | 34453/37963 [78:18:07<8:13:32,  8.44s/it]
 91%|█████████ | 34454/37963 [78:18:15<8:03:08,  8.26s/it]
 91%|█████████ | 34455/37963 [78:18:22<7:51:53,  8.07s/it]
 91%|█████████ | 34456/37963 [78:18:30<7:48:17,  8.01s/it]
 91%|█████████ | 34457/37963 [78:18:38<7:44:09,  7.94s/it]
 91%|█████████ | 34458/37963 [78:18:45<7:36:35,  7.82s/it]
 91%|████████�� | 34459/37963 [78:18:53<7:37:50,  7.84s/it]
 91%|█████████ | 34460/37963 [78:19:01<7:34:15,  7.78s/it]
                                                          
{'loss': '0.08902', 'grad_norm': '3.207', 'learning_rate': '4.435e-07', 'epoch': '0.9077'}
+
 91%|█████████ | 34460/37963 [78:19:01<7:34:15,  7.78s/it]
 91%|█████████ | 34461/37963 [78:19:09<7:37:58,  7.85s/it]
 91%|█████████ | 34462/37963 [78:19:19<8:25:49,  8.67s/it]
 91%|█████████ | 34463/37963 [78:19:27<8:06:14,  8.34s/it]
 91%|█████████ | 34464/37963 [78:19:38<8:44:45,  9.00s/it]
 91%|█████████ | 34465/37963 [78:19:45<8:24:14,  8.65s/it]
 91%|█████████ | 34466/37963 [78:19:53<8:06:18,  8.34s/it]
 91%|█████████ | 34467/37963 [78:20:01<7:57:38,  8.20s/it]
 91%|█████████ | 34468/37963 [78:20:09<7:49:20,  8.06s/it]
 91%|█████████ | 34469/37963 [78:20:17<7:46:56,  8.02s/it]
 91%|█████████ | 34470/37963 [78:20:24<7:40:43,  7.91s/it]
                                                          
{'loss': '0.1009', 'grad_norm': '4.185', 'learning_rate': '4.41e-07', 'epoch': '0.908'}
+
 91%|█████████ | 34470/37963 [78:20:24<7:40:43,  7.91s/it]
 91%|█████████ | 34471/37963 [78:20:32<7:38:16,  7.87s/it]
 91%|█████████ | 34472/37963 [78:20:40<7:35:17,  7.83s/it]
 91%|█████████ | 34473/37963 [78:20:47<7:27:23,  7.69s/it]
 91%|█████████ | 34474/37963 [78:20:55<7:31:58,  7.77s/it]
 91%|█████████ | 34475/37963 [78:21:03<7:29:03,  7.72s/it]
 91%|█████████ | 34476/37963 [78:21:13<8:19:38,  8.60s/it]
 91%|█████████ | 34477/37963 [78:21:21<8:04:15,  8.33s/it]
 91%|█████████ | 34478/37963 [78:21:29<7:50:10,  8.09s/it]
 91%|█████████ | 34479/37963 [78:21:36<7:43:49,  7.99s/it]
 91%|█████████ | 34480/37963 [78:21:44<7:41:01,  7.94s/it]
                                                          
{'loss': '0.09269', 'grad_norm': '3.956', 'learning_rate': '4.385e-07', 'epoch': '0.9083'}
+
 91%|█████████ | 34480/37963 [78:21:44<7:41:01,  7.94s/it]
 91%|█████████ | 34481/37963 [78:21:52<7:39:28,  7.92s/it]
 91%|█████████ | 34482/37963 [78:22:00<7:39:05,  7.91s/it]
 91%|█████████ | 34483/37963 [78:22:10<8:25:11,  8.71s/it]
 91%|█████████ | 34484/37963 [78:22:18<8:11:19,  8.47s/it]
 91%|█████████ | 34485/37963 [78:22:29<8:43:39,  9.03s/it]
 91%|█████████ | 34486/37963 [78:22:37<8:23:51,  8.69s/it]
 91%|█████████ | 34487/37963 [78:22:45<8:10:29,  8.47s/it]
 91%|█████████ | 34488/37963 [78:22:52<7:59:43,  8.28s/it]
 91%|█████████ | 34489/37963 [78:23:00<7:51:54,  8.15s/it]
 91%|█████████ | 34490/37963 [78:23:11<8:29:28,  8.80s/it]
                                                          
{'loss': '0.08737', 'grad_norm': '3.44', 'learning_rate': '4.36e-07', 'epoch': '0.9085'}
+
 91%|█████████ | 34490/37963 [78:23:11<8:29:28,  8.80s/it]
 91%|█████████ | 34491/37963 [78:23:18<8:11:55,  8.50s/it]
 91%|█████████ | 34492/37963 [78:23:26<7:59:56,  8.30s/it]
 91%|█████████ | 34493/37963 [78:23:34<7:53:27,  8.19s/it]
 91%|█████████ | 34494/37963 [78:23:42<7:46:02,  8.06s/it]
 91%|█████████ | 34495/37963 [78:23:55<9:16:54,  9.64s/it]
 91%|█████████ | 34496/37963 [78:24:03<8:52:56,  9.22s/it]
 91%|█████████ | 34497/37963 [78:24:11<8:26:02,  8.76s/it]
 91%|█████████ | 34498/37963 [78:24:19<8:03:20,  8.37s/it]
 91%|█████████ | 34499/37963 [78:24:26<7:50:48,  8.15s/it]
 91%|█████████ | 34500/37963 [78:24:34<7:41:54,  8.00s/it]
                                                          
{'loss': '0.1019', 'grad_norm': '2.909', 'learning_rate': '4.335e-07', 'epoch': '0.9088'}
+
 91%|█████████ | 34500/37963 [78:24:34<7:41:54,  8.00s/it]
 91%|█████████ | 34501/37963 [78:24:42<7:37:46,  7.93s/it]
 91%|█████████ | 34502/37963 [78:24:49<7:33:05,  7.85s/it]
 91%|█████████ | 34503/37963 [78:24:57<7:34:25,  7.88s/it]
 91%|█████████ | 34504/37963 [78:25:05<7:30:25,  7.81s/it]
 91%|█████████ | 34505/37963 [78:25:13<7:26:45,  7.75s/it]
 91%|█████████ | 34506/37963 [78:25:20<7:25:58,  7.74s/it]
 91%|█████████ | 34507/37963 [78:25:28<7:24:13,  7.71s/it]
 91%|█████████ | 34508/37963 [78:25:38<8:08:35,  8.48s/it]
 91%|█████████ | 34509/37963 [78:25:46<7:53:52,  8.23s/it]
 91%|█████████ | 34510/37963 [78:25:53<7:41:22,  8.02s/it]
                                                          
{'loss': '0.08285', 'grad_norm': '4.458', 'learning_rate': '4.31e-07', 'epoch': '0.909'}
+
 91%|█████████ | 34510/37963 [78:25:53<7:41:22,  8.02s/it]
 91%|█████████ | 34511/37963 [78:26:01<7:31:26,  7.85s/it]
 91%|█████████ | 34512/37963 [78:26:09<7:30:06,  7.83s/it]
 91%|█████████ | 34513/37963 [78:26:16<7:29:54,  7.82s/it]
 91%|█████████ | 34514/37963 [78:26:24<7:30:37,  7.84s/it]
 91%|█████████ | 34515/37963 [78:26:32<7:32:27,  7.87s/it]
 91%|█████████ | 34516/37963 [78:26:40<7:31:37,  7.86s/it]
 91%|█████████ | 34517/37963 [78:26:48<7:29:58,  7.83s/it]
 91%|█████████ | 34518/37963 [78:26:58<8:13:07,  8.59s/it]
 91%|█████████ | 34519/37963 [78:27:06<7:53:44,  8.25s/it]
 91%|█████████ | 34520/37963 [78:27:16<8:33:18,  8.95s/it]
                                                          
{'loss': '0.09505', 'grad_norm': '3.368', 'learning_rate': '4.286e-07', 'epoch': '0.9093'}
+
 91%|█████████ | 34520/37963 [78:27:16<8:33:18,  8.95s/it]
 91%|█████████ | 34521/37963 [78:27:24<8:11:34,  8.57s/it]
 91%|█████████ | 34522/37963 [78:27:31<7:53:36,  8.26s/it]
 91%|█████████ | 34523/37963 [78:27:39<7:43:51,  8.09s/it]
 91%|█████████ | 34524/37963 [78:27:47<7:39:09,  8.01s/it]
 91%|█████████ | 34525/37963 [78:27:55<7:33:56,  7.92s/it]
 91%|█████████ | 34526/37963 [78:28:02<7:26:20,  7.79s/it]
 91%|█████████ | 34527/37963 [78:28:10<7:27:51,  7.82s/it]
 91%|█████████ | 34528/37963 [78:28:18<7:26:29,  7.80s/it]
 91%|█████████ | 34529/37963 [78:28:25<7:18:23,  7.66s/it]
 91%|█████████ | 34530/37963 [78:28:33<7:21:34,  7.72s/it]
                                                          
{'loss': '0.08238', 'grad_norm': '3.688', 'learning_rate': '4.261e-07', 'epoch': '0.9096'}
+
 91%|█████████ | 34530/37963 [78:28:33<7:21:34,  7.72s/it]
 91%|█████████ | 34531/37963 [78:28:41<7:19:43,  7.69s/it]
 91%|█████████ | 34532/37963 [78:28:49<7:24:48,  7.78s/it]
 91%|█████████ | 34533/37963 [78:28:59<8:08:57,  8.55s/it]
 91%|█████████ | 34534/37963 [78:29:09<8:39:17,  9.09s/it]
 91%|█████████ | 34535/37963 [78:29:17<8:17:26,  8.71s/it]
 91%|█████████ | 34536/37963 [78:29:25<8:00:06,  8.41s/it]
 91%|█████████ | 34537/37963 [78:29:35<8:34:50,  9.02s/it]
 91%|█████████ | 34538/37963 [78:29:43<8:09:36,  8.58s/it]
 91%|█████████ | 34539/37963 [78:29:50<7:53:22,  8.30s/it]
 91%|█████████ | 34540/37963 [78:29:58<7:35:11,  7.98s/it]
                                                          
{'loss': '0.08307', 'grad_norm': '3.017', 'learning_rate': '4.236e-07', 'epoch': '0.9098'}
+
 91%|█████████ | 34540/37963 [78:29:58<7:35:11,  7.98s/it]
 91%|█████████ | 34541/37963 [78:30:05<7:29:46,  7.89s/it]
 91%|█████████ | 34542/37963 [78:30:13<7:25:43,  7.82s/it]
 91%|█████████ | 34543/37963 [78:30:24<8:16:13,  8.71s/it]
 91%|█████████ | 34544/37963 [78:30:34<8:48:04,  9.27s/it]
 91%|█████████ | 34545/37963 [78:30:42<8:20:50,  8.79s/it]
 91%|█████████ | 34546/37963 [78:30:50<8:05:01,  8.52s/it]
 91%|█████████ | 34547/37963 [78:30:58<7:51:31,  8.28s/it]
 91%|█████████ | 34548/37963 [78:31:05<7:41:50,  8.11s/it]
 91%|█████████ | 34549/37963 [78:31:13<7:37:07,  8.03s/it]
 91%|█████████ | 34550/37963 [78:31:21<7:30:26,  7.92s/it]
                                                          
{'loss': '0.0921', 'grad_norm': '2.569', 'learning_rate': '4.212e-07', 'epoch': '0.9101'}
+
 91%|█████████ | 34550/37963 [78:31:21<7:30:26,  7.92s/it]
 91%|█████████ | 34551/37963 [78:31:31<8:08:10,  8.58s/it]
 91%|█████████ | 34552/37963 [78:31:39<7:53:30,  8.33s/it]
 91%|█████████ | 34553/37963 [78:31:46<7:41:31,  8.12s/it]
 91%|█████████ | 34554/37963 [78:31:54<7:36:46,  8.04s/it]
 91%|█████████ | 34555/37963 [78:32:02<7:31:51,  7.96s/it]
 91%|█████████ | 34556/37963 [78:32:10<7:31:43,  7.96s/it]
 91%|█████████ | 34557/37963 [78:32:18<7:27:18,  7.88s/it]
 91%|█████████ | 34558/37963 [78:32:25<7:16:27,  7.69s/it]
 91%|█████████ | 34559/37963 [78:32:33<7:19:42,  7.75s/it]
 91%|█████████ | 34560/37963 [78:32:41<7:22:28,  7.80s/it]
                                                          
{'loss': '0.09334', 'grad_norm': '4.467', 'learning_rate': '4.187e-07', 'epoch': '0.9104'}
+
 91%|█████████ | 34560/37963 [78:32:41<7:22:28,  7.80s/it]
 91%|█████████ | 34561/37963 [78:32:49<7:22:13,  7.80s/it]
 91%|█████████ | 34562/37963 [78:32:56<7:23:34,  7.83s/it]
 91%|█████████ | 34563/37963 [78:33:04<7:26:50,  7.89s/it]
 91%|█████████ | 34564/37963 [78:33:12<7:19:42,  7.76s/it]
 91%|█████████ | 34565/37963 [78:33:19<7:15:47,  7.69s/it]
 91%|█████████ | 34566/37963 [78:33:30<8:01:38,  8.51s/it]
 91%|█████████ | 34567/37963 [78:33:38<7:49:17,  8.29s/it]
 91%|█████████ | 34568/37963 [78:33:48<8:27:33,  8.97s/it]
 91%|█████████ | 34569/37963 [78:33:56<8:03:42,  8.55s/it]
 91%|█████████ | 34570/37963 [78:34:03<7:48:37,  8.29s/it]
                                                          
{'loss': '0.09198', 'grad_norm': '3.022', 'learning_rate': '4.163e-07', 'epoch': '0.9106'}
+
 91%|█████████ | 34570/37963 [78:34:03<7:48:37,  8.29s/it]
 91%|█████████ | 34571/37963 [78:34:11<7:38:29,  8.11s/it]
 91%|█████████ | 34572/37963 [78:34:19<7:29:43,  7.96s/it]
 91%|█████████ | 34573/37963 [78:34:27<7:27:50,  7.93s/it]
 91%|█████████ | 34574/37963 [78:34:34<7:24:02,  7.86s/it]
 91%|█████████ | 34575/37963 [78:34:42<7:20:16,  7.80s/it]
 91%|█████████ | 34576/37963 [78:34:50<7:20:34,  7.80s/it]
 91%|█████████ | 34577/37963 [78:35:00<8:02:15,  8.55s/it]
 91%|█████████ | 34578/37963 [78:35:08<7:51:11,  8.35s/it]
 91%|█████████ | 34579/37963 [78:35:16<7:41:02,  8.17s/it]
 91%|█████████ | 34580/37963 [78:35:23<7:27:59,  7.95s/it]
                                                          
{'loss': '0.09343', 'grad_norm': '3.405', 'learning_rate': '4.139e-07', 'epoch': '0.9109'}
+
 91%|█████████ | 34580/37963 [78:35:23<7:27:59,  7.95s/it]
 91%|█████████ | 34581/37963 [78:35:33<8:04:36,  8.60s/it]
 91%|█████████ | 34582/37963 [78:35:41<7:42:28,  8.21s/it]
 91%|█████████ | 34583/37963 [78:35:48<7:33:59,  8.06s/it]
 91%|█████████ | 34584/37963 [78:35:56<7:28:18,  7.96s/it]
 91%|█████████ | 34585/37963 [78:36:04<7:28:20,  7.96s/it]
 91%|█████████ | 34586/37963 [78:36:12<7:23:08,  7.87s/it]
 91%|█████████ | 34587/37963 [78:36:22<8:08:54,  8.69s/it]
 91%|█████████ | 34588/37963 [78:36:30<7:51:57,  8.39s/it]
 91%|█████████ | 34589/37963 [78:36:38<7:40:07,  8.18s/it]
 91%|█████████ | 34590/37963 [78:36:45<7:29:24,  7.99s/it]
                                                          
{'loss': '0.07698', 'grad_norm': '4.161', 'learning_rate': '4.114e-07', 'epoch': '0.9112'}
+
 91%|█████████ | 34590/37963 [78:36:45<7:29:24,  7.99s/it]
 91%|█████████ | 34591/37963 [78:36:56<8:11:02,  8.74s/it]
 91%|█████████ | 34592/37963 [78:37:06<8:40:40,  9.27s/it]
 91%|█████████ | 34593/37963 [78:37:14<8:18:17,  8.87s/it]
 91%|█████████ | 34594/37963 [78:37:22<7:56:23,  8.48s/it]
 91%|█████████ | 34595/37963 [78:37:29<7:42:58,  8.25s/it]
 91%|█████████ | 34596/37963 [78:37:37<7:31:20,  8.04s/it]
 91%|█████████ | 34597/37963 [78:37:45<7:28:58,  8.00s/it]
 91%|█████████ | 34598/37963 [78:37:53<7:26:51,  7.97s/it]
 91%|█████████ | 34599/37963 [78:38:00<7:23:09,  7.90s/it]
 91%|█████████ | 34600/37963 [78:38:08<7:21:58,  7.89s/it]
                                                          
{'loss': '0.08851', 'grad_norm': '3.973', 'learning_rate': '4.09e-07', 'epoch': '0.9114'}
+
 91%|█████████ | 34600/37963 [78:38:08<7:21:58,  7.89s/it]
 91%|█████████ | 34601/37963 [78:38:16<7:20:57,  7.87s/it]
 91%|█████████ | 34602/37963 [78:38:24<7:17:54,  7.82s/it]
 91%|█████████ | 34603/37963 [78:38:32<7:17:17,  7.81s/it]
 91%|█████████ | 34604/37963 [78:38:42<7:56:35,  8.51s/it]
 91%|█████████ | 34605/37963 [78:38:49<7:38:19,  8.19s/it]
 91%|█████████ | 34606/37963 [78:38:57<7:29:27,  8.03s/it]
 91%|█████████ | 34607/37963 [78:39:04<7:19:52,  7.86s/it]
 91%|█████████ | 34608/37963 [78:39:12<7:18:27,  7.84s/it]
 91%|█████████ | 34609/37963 [78:39:20<7:16:17,  7.80s/it]
 91%|█████████ | 34610/37963 [78:39:28<7:14:06,  7.77s/it]
                                                          
{'loss': '0.0899', 'grad_norm': '3.12', 'learning_rate': '4.066e-07', 'epoch': '0.9117'}
+
 91%|█████████ | 34610/37963 [78:39:28<7:14:06,  7.77s/it]
 91%|█████████ | 34611/37963 [78:39:35<7:14:35,  7.78s/it]
 91%|█████████ | 34612/37963 [78:39:43<7:11:16,  7.72s/it]
 91%|█████████ | 34613/37963 [78:39:51<7:12:09,  7.74s/it]
 91%|█████████ | 34614/37963 [78:40:01<7:54:33,  8.50s/it]
 91%|█████████ | 34615/37963 [78:40:09<7:40:39,  8.26s/it]
 91%|█████████ | 34616/37963 [78:40:19<8:17:57,  8.93s/it]
 91%|█████████ | 34617/37963 [78:40:27<7:52:39,  8.48s/it]
 91%|█████████ | 34618/37963 [78:40:34<7:41:36,  8.28s/it]
 91%|█████████ | 34619/37963 [78:40:42<7:31:29,  8.10s/it]
 91%|█████████ | 34620/37963 [78:40:50<7:26:47,  8.02s/it]
                                                          
{'loss': '0.0917', 'grad_norm': '3.429', 'learning_rate': '4.042e-07', 'epoch': '0.9119'}
+
 91%|█████████ | 34620/37963 [78:40:50<7:26:47,  8.02s/it]
 91%|█████████ | 34621/37963 [78:40:58<7:26:57,  8.02s/it]
 91%|█████████ | 34622/37963 [78:41:06<7:20:51,  7.92s/it]
 91%|█████████ | 34623/37963 [78:41:13<7:15:36,  7.83s/it]
 91%|█████████ | 34624/37963 [78:41:21<7:15:19,  7.82s/it]
 91%|█████████ | 34625/37963 [78:41:32<7:59:24,  8.62s/it]
 91%|█████████ | 34626/37963 [78:41:39<7:47:07,  8.40s/it]
 91%|█████████ | 34627/37963 [78:41:47<7:36:44,  8.21s/it]
 91%|█████████ | 34628/37963 [78:41:55<7:28:24,  8.07s/it]
 91%|█████████ | 34629/37963 [78:42:03<7:25:13,  8.01s/it]
 91%|█████████ | 34630/37963 [78:42:10<7:19:46,  7.92s/it]
                                                          
{'loss': '0.08321', 'grad_norm': '3.028', 'learning_rate': '4.018e-07', 'epoch': '0.9122'}
+
 91%|█████████ | 34630/37963 [78:42:11<7:19:46,  7.92s/it]
 91%|█████████ | 34631/37963 [78:42:23<8:41:20,  9.39s/it]
 91%|█████████ | 34632/37963 [78:42:31<8:13:25,  8.89s/it]
 91%|█████████ | 34633/37963 [78:42:39<7:52:38,  8.52s/it]
 91%|█████████ | 34634/37963 [78:42:46<7:40:23,  8.30s/it]
 91%|█████████ | 34635/37963 [78:42:54<7:29:42,  8.11s/it]
 91%|█████████ | 34636/37963 [78:43:05<8:11:26,  8.86s/it]
 91%|█████████ | 34637/37963 [78:43:12<7:49:48,  8.48s/it]
 91%|█████████ | 34638/37963 [78:43:20<7:35:57,  8.23s/it]
 91%|█████████ | 34639/37963 [78:43:27<7:23:14,  8.00s/it]
 91%|█████████ | 34640/37963 [78:43:35<7:16:41,  7.89s/it]
                                                          
{'loss': '0.09336', 'grad_norm': '3.55', 'learning_rate': '3.994e-07', 'epoch': '0.9125'}
+
 91%|█████████ | 34640/37963 [78:43:35<7:16:41,  7.89s/it]
 91%|█████████ | 34641/37963 [78:43:43<7:16:11,  7.88s/it]
 91%|█████████▏| 34642/37963 [78:43:50<7:10:13,  7.77s/it]
 91%|█████████▏| 34643/37963 [78:43:58<7:11:51,  7.80s/it]
 91%|█████████▏| 34644/37963 [78:44:06<7:10:02,  7.77s/it]
 91%|█████████▏| 34645/37963 [78:44:17<7:56:11,  8.61s/it]
 91%|█████████▏| 34646/37963 [78:44:25<7:44:11,  8.40s/it]
 91%|█████████▏| 34647/37963 [78:44:32<7:31:35,  8.17s/it]
 91%|█████████▏| 34648/37963 [78:44:40<7:24:42,  8.05s/it]
 91%|█████████▏| 34649/37963 [78:44:48<7:20:56,  7.98s/it]
 91%|█████████▏| 34650/37963 [78:44:56<7:17:56,  7.93s/it]
                                                          
{'loss': '0.1016', 'grad_norm': '4.78', 'learning_rate': '3.97e-07', 'epoch': '0.9127'}
+
 91%|█████████▏| 34650/37963 [78:44:56<7:17:56,  7.93s/it]
 91%|█████████▏| 34651/37963 [78:45:03<7:08:50,  7.77s/it]
 91%|█████████▏| 34652/37963 [78:45:11<7:10:29,  7.80s/it]
 91%|█████████▏| 34653/37963 [78:45:19<7:09:50,  7.79s/it]
 91%|█████████▏| 34654/37963 [78:45:26<7:09:23,  7.79s/it]
 91%|█████████▏| 34655/37963 [78:45:34<7:01:19,  7.64s/it]
 91%|█████████▏| 34656/37963 [78:45:41<7:01:56,  7.66s/it]
 91%|█████████▏| 34657/37963 [78:45:49<7:05:32,  7.72s/it]
 91%|█████████▏| 34658/37963 [78:46:00<7:48:09,  8.50s/it]
 91%|█████████▏| 34659/37963 [78:46:07<7:30:46,  8.19s/it]
 91%|█████████▏| 34660/37963 [78:46:18<8:10:16,  8.91s/it]
                                                          
{'loss': '0.08243', 'grad_norm': '2.794', 'learning_rate': '3.946e-07', 'epoch': '0.913'}
+
 91%|█████████▏| 34660/37963 [78:46:18<8:10:16,  8.91s/it]
 91%|█████████▏| 34661/37963 [78:46:25<7:52:00,  8.58s/it]
 91%|█████████▏| 34662/37963 [78:46:33<7:40:02,  8.36s/it]
 91%|█████████▏| 34663/37963 [78:46:41<7:27:56,  8.14s/it]
 91%|█████████▏| 34664/37963 [78:46:51<8:05:03,  8.82s/it]
 91%|█████████▏| 34665/37963 [78:46:59<7:47:22,  8.50s/it]
 91%|█████████▏| 34666/37963 [78:47:07<7:31:04,  8.21s/it]
 91%|█████████▏| 34667/37963 [78:47:14<7:21:37,  8.04s/it]
 91%|█████████▏| 34668/37963 [78:47:22<7:15:27,  7.93s/it]
 91%|█████████▏| 34669/37963 [78:47:32<7:56:43,  8.68s/it]
 91%|█████████▏| 34670/37963 [78:47:40<7:43:13,  8.44s/it]
                                                          
{'loss': '0.08069', 'grad_norm': '2.763', 'learning_rate': '3.923e-07', 'epoch': '0.9133'}
+
 91%|█████████▏| 34670/37963 [78:47:40<7:43:13,  8.44s/it]
 91%|█████████▏| 34671/37963 [78:47:48<7:36:45,  8.32s/it]
 91%|█████████▏| 34672/37963 [78:47:56<7:24:42,  8.11s/it]
 91%|█████████▏| 34673/37963 [78:48:04<7:18:40,  8.00s/it]
 91%|█████████▏| 34674/37963 [78:48:11<7:14:55,  7.93s/it]
 91%|█████████▏| 34675/37963 [78:48:22<7:50:53,  8.59s/it]
 91%|█████████▏| 34676/37963 [78:48:29<7:35:41,  8.32s/it]
 91%|█████████▏| 34677/37963 [78:48:40<8:12:02,  8.98s/it]
 91%|█████████▏| 34678/37963 [78:48:47<7:51:40,  8.61s/it]
 91%|█████████▏| 34679/37963 [78:48:58<8:25:26,  9.23s/it]
 91%|█████████▏| 34680/37963 [78:49:06<8:00:13,  8.78s/it]
                                                          
{'loss': '0.09383', 'grad_norm': '3.944', 'learning_rate': '3.899e-07', 'epoch': '0.9135'}
+
 91%|█████████▏| 34680/37963 [78:49:06<8:00:13,  8.78s/it]
 91%|█████████▏| 34681/37963 [78:49:13<7:39:49,  8.41s/it]
 91%|█████████▏| 34682/37963 [78:49:21<7:32:06,  8.27s/it]
 91%|█████████▏| 34683/37963 [78:49:29<7:16:41,  7.99s/it]
 91%|█████████▏| 34684/37963 [78:49:37<7:16:15,  7.98s/it]
 91%|█████████▏| 34685/37963 [78:49:44<7:12:56,  7.92s/it]
 91%|█████████▏| 34686/37963 [78:49:52<7:11:13,  7.90s/it]
 91%|█████████▏| 34687/37963 [78:50:00<7:10:20,  7.88s/it]
 91%|█████████▏| 34688/37963 [78:50:08<7:02:42,  7.74s/it]
 91%|█████████▏| 34689/37963 [78:50:18<7:44:43,  8.52s/it]
 91%|█████████▏| 34690/37963 [78:50:26<7:31:48,  8.28s/it]
                                                          
{'loss': '0.08592', 'grad_norm': '2.683', 'learning_rate': '3.876e-07', 'epoch': '0.9138'}
+
 91%|█████████▏| 34690/37963 [78:50:26<7:31:48,  8.28s/it]
 91%|█████████▏| 34691/37963 [78:50:34<7:25:11,  8.16s/it]
 91%|█████████▏| 34692/37963 [78:50:42<7:22:31,  8.12s/it]
 91%|█████████▏| 34693/37963 [78:50:49<7:12:22,  7.93s/it]
 91%|█████████▏| 34694/37963 [78:50:57<7:13:02,  7.95s/it]
 91%|█████████▏| 34695/37963 [78:51:05<7:11:05,  7.91s/it]
 91%|█████████▏| 34696/37963 [78:51:12<7:05:51,  7.82s/it]
 91%|█████████▏| 34697/37963 [78:51:20<7:05:12,  7.81s/it]
 91%|█████████▏| 34698/37963 [78:51:28<7:02:58,  7.77s/it]
 91%|█████████▏| 34699/37963 [78:51:36<7:01:28,  7.75s/it]
 91%|█████████▏| 34700/37963 [78:51:43<7:03:03,  7.78s/it]
                                                          
{'loss': '0.0991', 'grad_norm': '2.817', 'learning_rate': '3.852e-07', 'epoch': '0.9141'}
+
 91%|█████████▏| 34700/37963 [78:51:43<7:03:03,  7.78s/it]
 91%|█████████▏| 34701/37963 [78:51:51<7:01:31,  7.75s/it]
 91%|█████████▏| 34702/37963 [78:51:59<6:58:04,  7.69s/it]
 91%|█████████▏| 34703/37963 [78:52:06<6:58:20,  7.70s/it]
 91%|█████████▏| 34704/37963 [78:52:17<7:47:02,  8.60s/it]
 91%|█████████▏| 34705/37963 [78:52:27<8:16:01,  9.13s/it]
 91%|█████████▏| 34706/37963 [78:52:35<7:54:29,  8.74s/it]
 91%|█████████▏| 34707/37963 [78:52:43<7:37:52,  8.44s/it]
 91%|█████████▏| 34708/37963 [78:52:51<7:26:22,  8.23s/it]
 91%|█████████▏| 34709/37963 [78:52:59<7:20:14,  8.12s/it]
 91%|█████████▏| 34710/37963 [78:53:06<7:11:45,  7.96s/it]
                                                          
{'loss': '0.08034', 'grad_norm': '3.152', 'learning_rate': '3.829e-07', 'epoch': '0.9143'}
+
 91%|█████████▏| 34710/37963 [78:53:06<7:11:45,  7.96s/it]
 91%|█████████▏| 34711/37963 [78:53:14<7:06:47,  7.87s/it]
 91%|█████████▏| 34712/37963 [78:53:21<7:01:54,  7.79s/it]
 91%|█████████▏| 34713/37963 [78:53:29<7:04:36,  7.84s/it]
 91%|█████████▏| 34714/37963 [78:53:37<7:03:32,  7.82s/it]
 91%|█████████▏| 34715/37963 [78:53:45<6:56:46,  7.70s/it]
 91%|█████████▏| 34716/37963 [78:53:55<7:39:43,  8.50s/it]
 91%|█████████▏| 34717/37963 [78:54:03<7:27:14,  8.27s/it]
 91%|█████████▏| 34718/37963 [78:54:13<7:59:36,  8.87s/it]
 91%|█████████▏| 34719/37963 [78:54:23<8:25:03,  9.34s/it]
 91%|█████████▏| 34720/37963 [78:54:31<7:57:25,  8.83s/it]
                                                          
{'loss': '0.08253', 'grad_norm': '2.924', 'learning_rate': '3.805e-07', 'epoch': '0.9146'}
+
 91%|█████████▏| 34720/37963 [78:54:31<7:57:25,  8.83s/it]
 91%|█████████▏| 34721/37963 [78:54:39<7:36:27,  8.45s/it]
 91%|█████████▏| 34722/37963 [78:54:46<7:24:40,  8.23s/it]
 91%|█████████▏| 34723/37963 [78:54:57<8:02:41,  8.94s/it]
 91%|█████████▏| 34724/37963 [78:55:05<7:41:47,  8.55s/it]
 91%|█████████▏| 34725/37963 [78:55:15<8:06:59,  9.02s/it]
 91%|█████████▏| 34726/37963 [78:55:22<7:45:54,  8.64s/it]
 91%|█████████▏| 34727/37963 [78:55:30<7:31:48,  8.38s/it]
 91%|█████████▏| 34728/37963 [78:55:38<7:22:13,  8.20s/it]
 91%|█████████▏| 34729/37963 [78:55:46<7:11:07,  8.00s/it]
 91%|█████████▏| 34730/37963 [78:55:54<7:11:29,  8.01s/it]
                                                          
{'loss': '0.08245', 'grad_norm': '2.886', 'learning_rate': '3.782e-07', 'epoch': '0.9148'}
+
 91%|█████████▏| 34730/37963 [78:55:54<7:11:29,  8.01s/it]
 91%|█████████▏| 34731/37963 [78:56:01<7:01:29,  7.82s/it]
 91%|█████████▏| 34732/37963 [78:56:08<6:54:11,  7.69s/it]
 91%|█████████▏| 34733/37963 [78:56:19<7:38:35,  8.52s/it]
 91%|█████████▏| 34734/37963 [78:56:26<7:23:55,  8.25s/it]
 91%|█████████▏| 34735/37963 [78:56:34<7:14:43,  8.08s/it]
 91%|█████████▏| 34736/37963 [78:56:42<7:09:51,  7.99s/it]
 92%|█████████▏| 34737/37963 [78:56:50<7:05:03,  7.91s/it]
 92%|█████████▏| 34738/37963 [78:56:57<7:01:46,  7.85s/it]
 92%|█████████▏| 34739/37963 [78:57:05<7:02:08,  7.86s/it]
 92%|█████████▏| 34740/37963 [78:57:13<6:56:22,  7.75s/it]
                                                          
{'loss': '0.08017', 'grad_norm': '2.816', 'learning_rate': '3.759e-07', 'epoch': '0.9151'}
+
 92%|█████████▏| 34740/37963 [78:57:13<6:56:22,  7.75s/it]
 92%|█████████▏| 34741/37963 [78:57:20<6:56:28,  7.76s/it]
 92%|█████████▏| 34742/37963 [78:57:28<6:58:22,  7.79s/it]
 92%|█████████▏| 34743/37963 [78:57:36<6:57:48,  7.79s/it]
 92%|█████████▏| 34744/37963 [78:57:44<6:59:00,  7.81s/it]
 92%|█████████▏| 34745/37963 [78:57:52<6:55:03,  7.74s/it]
 92%|█████████▏| 34746/37963 [78:57:59<6:51:13,  7.67s/it]
 92%|█████████▏| 34747/37963 [78:58:07<6:54:17,  7.73s/it]
 92%|█████████▏| 34748/37963 [78:58:15<6:52:32,  7.70s/it]
 92%|█████████▏| 34749/37963 [78:58:22<6:52:12,  7.70s/it]
 92%|█████████▏| 34750/37963 [78:58:30<6:51:29,  7.68s/it]
                                                          
{'loss': '0.09418', 'grad_norm': '4.197', 'learning_rate': '3.736e-07', 'epoch': '0.9154'}
+
 92%|█████████▏| 34750/37963 [78:58:30<6:51:29,  7.68s/it]
 92%|█████████▏| 34751/37963 [78:58:40<7:37:32,  8.55s/it]
 92%|█████████▏| 34752/37963 [78:58:48<7:28:35,  8.38s/it]
 92%|█████████▏| 34753/37963 [78:58:56<7:17:37,  8.18s/it]
 92%|█████████▏| 34754/37963 [78:59:04<7:13:04,  8.10s/it]
 92%|█████████▏| 34755/37963 [78:59:12<7:07:59,  8.00s/it]
 92%|█████████▏| 34756/37963 [78:59:20<7:03:07,  7.92s/it]
 92%|█████████▏| 34757/37963 [78:59:27<7:02:22,  7.90s/it]
 92%|█████████▏| 34758/37963 [78:59:38<7:41:11,  8.63s/it]
 92%|█████████▏| 34759/37963 [78:59:46<7:27:59,  8.39s/it]
 92%|█████████▏| 34760/37963 [78:59:54<7:19:43,  8.24s/it]
                                                          
{'loss': '0.08752', 'grad_norm': '2.437', 'learning_rate': '3.713e-07', 'epoch': '0.9156'}
+
 92%|█████████▏| 34760/37963 [78:59:54<7:19:43,  8.24s/it]
 92%|█████████▏| 34761/37963 [79:00:01<7:10:33,  8.07s/it]
 92%|█████████▏| 34762/37963 [79:00:11<7:40:47,  8.64s/it]
 92%|█████████▏| 34763/37963 [79:00:21<8:01:39,  9.03s/it]
 92%|█████████▏| 34764/37963 [79:00:29<7:41:21,  8.65s/it]
 92%|█████████▏| 34765/37963 [79:00:37<7:25:51,  8.37s/it]
 92%|█████████▏| 34766/37963 [79:00:44<7:15:31,  8.17s/it]
 92%|█████████▏| 34767/37963 [79:00:55<7:53:58,  8.90s/it]
 92%|█████████▏| 34768/37963 [79:01:03<7:38:38,  8.61s/it]
 92%|█████████▏| 34769/37963 [79:01:10<7:23:37,  8.33s/it]
 92%|█████████▏| 34770/37963 [79:01:18<7:12:49,  8.13s/it]
                                                          
{'loss': '0.08618', 'grad_norm': '3.431', 'learning_rate': '3.69e-07', 'epoch': '0.9159'}
+
 92%|█████████▏| 34770/37963 [79:01:18<7:12:49,  8.13s/it]
 92%|█████████▏| 34771/37963 [79:01:26<7:07:10,  8.03s/it]
 92%|█████████▏| 34772/37963 [79:01:34<7:05:52,  8.01s/it]
 92%|█████████▏| 34773/37963 [79:01:42<7:00:37,  7.91s/it]
 92%|█████████▏| 34774/37963 [79:01:49<6:59:08,  7.89s/it]
 92%|█████████▏| 34775/37963 [79:01:57<7:00:25,  7.91s/it]
 92%|█████████▏| 34776/37963 [79:02:05<6:56:52,  7.85s/it]
 92%|█████████▏| 34777/37963 [79:02:16<7:40:44,  8.68s/it]
 92%|█████████▏| 34778/37963 [79:02:23<7:26:20,  8.41s/it]
 92%|█████████▏| 34779/37963 [79:02:34<7:58:36,  9.02s/it]
 92%|█████████▏| 34780/37963 [79:02:41<7:35:06,  8.58s/it]
                                                          
{'loss': '0.07919', 'grad_norm': '3.079', 'learning_rate': '3.667e-07', 'epoch': '0.9162'}
+
 92%|█████████▏| 34780/37963 [79:02:41<7:35:06,  8.58s/it]
 92%|█████████▏| 34781/37963 [79:02:49<7:18:15,  8.26s/it]
 92%|█████████▏| 34782/37963 [79:02:57<7:08:25,  8.08s/it]
 92%|█████████▏| 34783/37963 [79:03:04<7:01:15,  7.95s/it]
 92%|█████████▏| 34784/37963 [79:03:12<7:03:25,  7.99s/it]
 92%|█████████▏| 34785/37963 [79:03:20<6:59:17,  7.92s/it]
 92%|█████████▏| 34786/37963 [79:03:28<6:55:36,  7.85s/it]
 92%|█████████▏| 34787/37963 [79:03:35<6:51:04,  7.77s/it]
 92%|█████████▏| 34788/37963 [79:03:43<6:53:03,  7.81s/it]
 92%|█████████▏| 34789/37963 [79:03:51<6:50:51,  7.77s/it]
 92%|█████████▏| 34790/37963 [79:03:58<6:45:04,  7.66s/it]
                                                          
{'loss': '0.09512', 'grad_norm': '3.325', 'learning_rate': '3.644e-07', 'epoch': '0.9164'}
+
 92%|█████████▏| 34790/37963 [79:03:58<6:45:04,  7.66s/it]
 92%|█████████▏| 34791/37963 [79:04:06<6:46:52,  7.70s/it]
 92%|█████████▏| 34792/37963 [79:04:14<6:41:43,  7.60s/it]
 92%|█████████▏| 34793/37963 [79:04:21<6:43:10,  7.63s/it]
 92%|█████████▏| 34794/37963 [79:04:29<6:43:14,  7.63s/it]
 92%|█████████▏| 34795/37963 [79:04:37<6:46:00,  7.69s/it]
 92%|█████████▏| 34796/37963 [79:04:44<6:44:48,  7.67s/it]
 92%|█████████▏| 34797/37963 [79:04:52<6:46:39,  7.71s/it]
 92%|█████████▏| 34798/37963 [79:05:00<6:48:00,  7.73s/it]
 92%|█████████▏| 34799/37963 [79:05:08<6:50:56,  7.79s/it]
 92%|█████████▏| 34800/37963 [79:05:16<6:50:49,  7.79s/it]
                                                          
{'loss': '0.08598', 'grad_norm': '3.938', 'learning_rate': '3.621e-07', 'epoch': '0.9167'}
+
 92%|█████████▏| 34800/37963 [79:05:16<6:50:49,  7.79s/it]
 92%|█████████▏| 34801/37963 [79:05:24<6:54:28,  7.86s/it]
 92%|█████████▏| 34802/37963 [79:05:34<7:36:22,  8.66s/it]
 92%|█████████▏| 34803/37963 [79:05:42<7:24:56,  8.45s/it]
 92%|█████████▏| 34804/37963 [79:05:50<7:12:32,  8.22s/it]
 92%|█████████▏| 34805/37963 [79:05:57<7:01:46,  8.01s/it]
 92%|█████████▏| 34806/37963 [79:06:08<7:46:42,  8.87s/it]
 92%|█████████▏| 34807/37963 [79:06:16<7:29:08,  8.54s/it]
 92%|█████████▏| 34808/37963 [79:06:26<7:50:59,  8.96s/it]
 92%|█████████▏| 34809/37963 [79:06:34<7:30:57,  8.58s/it]
 92%|█████████▏| 34810/37963 [79:06:44<7:53:56,  9.02s/it]
                                                          
{'loss': '0.0956', 'grad_norm': '2.825', 'learning_rate': '3.598e-07', 'epoch': '0.9169'}
+
 92%|█████████▏| 34810/37963 [79:06:44<7:53:56,  9.02s/it]
 92%|█████████▏| 34811/37963 [79:06:51<7:28:40,  8.54s/it]
 92%|█████████▏| 34812/37963 [79:07:01<7:52:22,  8.99s/it]
 92%|█████████▏| 34813/37963 [79:07:12<8:13:31,  9.40s/it]
 92%|█████████▏| 34814/37963 [79:07:19<7:51:05,  8.98s/it]
 92%|█████████▏| 34815/37963 [79:07:27<7:33:53,  8.65s/it]
 92%|█████████▏| 34816/37963 [79:07:35<7:21:21,  8.41s/it]
 92%|█████████▏| 34817/37963 [79:07:43<7:10:05,  8.20s/it]
 92%|█████████▏| 34818/37963 [79:07:51<7:02:11,  8.05s/it]
 92%|█████████▏| 34819/37963 [79:07:59<7:01:25,  8.04s/it]
 92%|█████████▏| 34820/37963 [79:08:06<6:55:28,  7.93s/it]
                                                          
{'loss': '0.08025', 'grad_norm': '3.014', 'learning_rate': '3.576e-07', 'epoch': '0.9172'}
+
 92%|█████████▏| 34820/37963 [79:08:06<6:55:28,  7.93s/it]
 92%|█████████▏| 34821/37963 [79:08:14<6:54:36,  7.92s/it]
 92%|█████████▏| 34822/37963 [79:08:22<6:49:44,  7.83s/it]
 92%|█████████▏| 34823/37963 [79:08:30<6:49:24,  7.82s/it]
 92%|█████████▏| 34824/37963 [79:08:40<7:35:42,  8.71s/it]
 92%|█████████▏| 34825/37963 [79:08:48<7:24:10,  8.49s/it]
 92%|█████████▏| 34826/37963 [79:08:56<7:09:01,  8.21s/it]
 92%|█████████▏| 34827/37963 [79:09:04<7:00:27,  8.04s/it]
 92%|█████████▏| 34828/37963 [79:09:11<6:54:38,  7.94s/it]
 92%|█████████▏| 34829/37963 [79:09:19<6:51:06,  7.87s/it]
 92%|█████████▏| 34830/37963 [79:09:27<6:48:53,  7.83s/it]
                                                          
{'loss': '0.08414', 'grad_norm': '3.11', 'learning_rate': '3.553e-07', 'epoch': '0.9175'}
+
 92%|█████████▏| 34830/37963 [79:09:27<6:48:53,  7.83s/it]
 92%|█████████▏| 34831/37963 [79:09:37<7:33:06,  8.68s/it]
 92%|█████████▏| 34832/37963 [79:09:45<7:17:58,  8.39s/it]
 92%|█████████▏| 34833/37963 [79:09:53<7:08:07,  8.21s/it]
 92%|█████████▏| 34834/37963 [79:10:01<7:00:20,  8.06s/it]
 92%|█████████▏| 34835/37963 [79:10:09<7:00:48,  8.07s/it]
 92%|█████████▏| 34836/37963 [79:10:17<7:01:07,  8.08s/it]
 92%|█████████▏| 34837/37963 [79:10:25<6:56:53,  8.00s/it]
 92%|█████████▏| 34838/37963 [79:10:32<6:49:34,  7.86s/it]
 92%|█████████▏| 34839/37963 [79:10:40<6:45:31,  7.79s/it]
 92%|█████████▏| 34840/37963 [79:10:47<6:42:51,  7.74s/it]
                                                          
{'loss': '0.0807', 'grad_norm': '2.642', 'learning_rate': '3.531e-07', 'epoch': '0.9177'}
+
 92%|█████████▏| 34840/37963 [79:10:47<6:42:51,  7.74s/it]
 92%|█████████▏| 34841/37963 [79:10:55<6:40:17,  7.69s/it]
 92%|█████████▏| 34842/37963 [79:11:03<6:45:08,  7.79s/it]
 92%|█████████▏| 34843/37963 [79:11:11<6:42:49,  7.75s/it]
 92%|█████████▏| 34844/37963 [79:11:18<6:42:05,  7.73s/it]
 92%|█████████▏| 34845/37963 [79:11:26<6:44:27,  7.78s/it]
 92%|█████████▏| 34846/37963 [79:11:34<6:45:43,  7.81s/it]
 92%|█████████▏| 34847/37963 [79:11:42<6:43:53,  7.78s/it]
 92%|█████████▏| 34848/37963 [79:11:50<6:42:38,  7.76s/it]
 92%|█████████▏| 34849/37963 [79:11:57<6:44:04,  7.79s/it]
 92%|█████████▏| 34850/37963 [79:12:08<7:27:16,  8.62s/it]
                                                          
{'loss': '0.09196', 'grad_norm': '2.806', 'learning_rate': '3.508e-07', 'epoch': '0.918'}
+
 92%|█████████▏| 34850/37963 [79:12:08<7:27:16,  8.62s/it]
 92%|█████████▏| 34851/37963 [79:12:15<7:08:02,  8.25s/it]
 92%|█████████▏| 34852/37963 [79:12:23<6:58:24,  8.07s/it]
 92%|█████████▏| 34853/37963 [79:12:31<6:53:15,  7.97s/it]
 92%|█████████▏| 34854/37963 [79:12:39<6:53:25,  7.98s/it]
 92%|█████████▏| 34855/37963 [79:12:49<7:23:51,  8.57s/it]
 92%|█████████▏| 34856/37963 [79:12:56<7:11:27,  8.33s/it]
 92%|█████████▏| 34857/37963 [79:13:07<7:43:07,  8.95s/it]
 92%|█████████▏| 34858/37963 [79:13:15<7:29:04,  8.68s/it]
 92%|█████████▏| 34859/37963 [79:13:23<7:18:51,  8.48s/it]
 92%|█████████▏| 34860/37963 [79:13:31<7:08:35,  8.29s/it]
                                                          
{'loss': '0.08341', 'grad_norm': '2.896', 'learning_rate': '3.486e-07', 'epoch': '0.9183'}
+
 92%|█████████▏| 34860/37963 [79:13:31<7:08:35,  8.29s/it]
 92%|█████████▏| 34861/37963 [79:13:41<7:38:40,  8.87s/it]
 92%|█████████▏| 34862/37963 [79:13:52<8:03:43,  9.36s/it]
 92%|█████████▏| 34863/37963 [79:14:00<7:42:29,  8.95s/it]
 92%|█████████▏| 34864/37963 [79:14:10<8:08:40,  9.46s/it]
 92%|█████████▏| 34865/37963 [79:14:18<7:41:28,  8.94s/it]
 92%|█████████▏| 34866/37963 [79:14:26<7:22:49,  8.58s/it]
 92%|█████████▏| 34867/37963 [79:14:33<7:02:55,  8.20s/it]
 92%|█████████▏| 34868/37963 [79:14:41<6:57:47,  8.10s/it]
 92%|█████████▏| 34869/37963 [79:14:48<6:51:14,  7.97s/it]
 92%|█████████▏| 34870/37963 [79:14:56<6:46:31,  7.89s/it]
                                                          
{'loss': '0.09675', 'grad_norm': '5.192', 'learning_rate': '3.464e-07', 'epoch': '0.9185'}
+
 92%|█████████▏| 34870/37963 [79:14:56<6:46:31,  7.89s/it]
 92%|█████████▏| 34871/37963 [79:15:04<6:42:23,  7.81s/it]
 92%|█████████▏| 34872/37963 [79:15:12<6:42:14,  7.81s/it]
 92%|█████████▏| 34873/37963 [79:15:19<6:41:30,  7.80s/it]
 92%|█████████▏| 34874/37963 [79:15:27<6:39:23,  7.76s/it]
 92%|█████████▏| 34875/37963 [79:15:35<6:38:05,  7.73s/it]
 92%|█████████▏| 34876/37963 [79:15:42<6:37:38,  7.73s/it]
 92%|█████████▏| 34877/37963 [79:15:50<6:38:18,  7.74s/it]
 92%|█████████▏| 34878/37963 [79:16:01<7:20:12,  8.56s/it]
 92%|█████████▏| 34879/37963 [79:16:08<7:06:10,  8.29s/it]
 92%|█████████▏| 34880/37963 [79:16:19<7:47:03,  9.09s/it]
                                                          
{'loss': '0.09424', 'grad_norm': '3.67', 'learning_rate': '3.441e-07', 'epoch': '0.9188'}
+
 92%|█████████▏| 34880/37963 [79:16:19<7:47:03,  9.09s/it]
 92%|█████████▏| 34881/37963 [79:16:27<7:26:34,  8.69s/it]
 92%|█████████▏| 34882/37963 [79:16:35<7:12:14,  8.42s/it]
 92%|█████████▏| 34883/37963 [79:16:42<6:56:00,  8.10s/it]
 92%|█████████▏| 34884/37963 [79:16:50<6:44:40,  7.89s/it]
 92%|█████████▏| 34885/37963 [79:16:57<6:43:09,  7.86s/it]
 92%|█████████▏| 34886/37963 [79:17:05<6:42:08,  7.84s/it]
 92%|█████████▏| 34887/37963 [79:17:13<6:41:46,  7.84s/it]
 92%|█████████▏| 34888/37963 [79:17:21<6:40:34,  7.82s/it]
 92%|█████████▏| 34889/37963 [79:17:28<6:37:35,  7.76s/it]
 92%|█████████▏| 34890/37963 [79:17:36<6:37:56,  7.77s/it]
                                                          
{'loss': '0.09001', 'grad_norm': '4.343', 'learning_rate': '3.419e-07', 'epoch': '0.9191'}
+
 92%|█████████▏| 34890/37963 [79:17:36<6:37:56,  7.77s/it]
 92%|█████████▏| 34891/37963 [79:17:44<6:35:41,  7.73s/it]
 92%|█████████▏| 34892/37963 [79:17:52<6:37:51,  7.77s/it]
 92%|█████████▏| 34893/37963 [79:17:59<6:32:53,  7.68s/it]
 92%|█████████▏| 34894/37963 [79:18:09<7:12:16,  8.45s/it]
 92%|█████████▏| 34895/37963 [79:18:17<7:00:53,  8.23s/it]
 92%|█████████▏| 34896/37963 [79:18:25<6:52:16,  8.07s/it]
 92%|█████████▏| 34897/37963 [79:18:32<6:45:48,  7.94s/it]
 92%|█████████▏| 34898/37963 [79:18:40<6:40:35,  7.84s/it]
 92%|█████████▏| 34899/37963 [79:18:48<6:38:10,  7.80s/it]
 92%|█████████▏| 34900/37963 [79:18:56<6:37:27,  7.79s/it]
                                                          
{'loss': '0.0831', 'grad_norm': '2.801', 'learning_rate': '3.397e-07', 'epoch': '0.9193'}
+
 92%|█████████▏| 34900/37963 [79:18:56<6:37:27,  7.79s/it]
 92%|█████████▏| 34901/37963 [79:19:03<6:40:03,  7.84s/it]
 92%|█████████▏| 34902/37963 [79:19:11<6:36:32,  7.77s/it]
 92%|█████████▏| 34903/37963 [79:19:19<6:31:38,  7.68s/it]
 92%|█████████▏| 34904/37963 [79:19:26<6:33:42,  7.72s/it]
 92%|█████████▏| 34905/37963 [79:19:37<7:14:51,  8.53s/it]
 92%|█████████▏| 34906/37963 [79:19:45<7:02:44,  8.30s/it]
 92%|█████████▏| 34907/37963 [79:19:53<6:58:18,  8.21s/it]
 92%|█████████▏| 34908/37963 [79:20:00<6:47:17,  8.00s/it]
 92%|█████████▏| 34909/37963 [79:20:11<7:24:17,  8.73s/it]
 92%|█████████▏| 34910/37963 [79:20:18<7:10:26,  8.46s/it]
                                                          
{'loss': '0.08447', 'grad_norm': '2.655', 'learning_rate': '3.375e-07', 'epoch': '0.9196'}
+
 92%|█████████▏| 34910/37963 [79:20:18<7:10:26,  8.46s/it]
 92%|█████████▏| 34911/37963 [79:20:26<7:03:17,  8.32s/it]
 92%|█████████▏| 34912/37963 [79:20:34<6:54:04,  8.14s/it]
 92%|█████████▏| 34913/37963 [79:20:42<6:46:09,  7.99s/it]
 92%|█████████▏| 34914/37963 [79:20:50<6:45:24,  7.98s/it]
 92%|█████████▏| 34915/37963 [79:21:00<7:16:38,  8.60s/it]
 92%|█████████▏| 34916/37963 [79:21:10<7:42:20,  9.10s/it]
 92%|█████████▏| 34917/37963 [79:21:18<7:21:19,  8.69s/it]
 92%|█████████▏| 34918/37963 [79:21:25<7:01:48,  8.31s/it]
 92%|█████████▏| 34919/37963 [79:21:36<7:35:59,  8.99s/it]
 92%|█████████▏| 34920/37963 [79:21:43<7:16:06,  8.60s/it]
                                                          
{'loss': '0.0866', 'grad_norm': '3.473', 'learning_rate': '3.353e-07', 'epoch': '0.9198'}
+
 92%|█████████▏| 34920/37963 [79:21:43<7:16:06,  8.60s/it]
 92%|█████████▏| 34921/37963 [79:21:51<6:59:40,  8.28s/it]
 92%|█████████▏| 34922/37963 [79:21:58<6:47:08,  8.03s/it]
 92%|█████████▏| 34923/37963 [79:22:06<6:43:47,  7.97s/it]
 92%|█████████▏| 34924/37963 [79:22:14<6:35:16,  7.80s/it]
 92%|█████████▏| 34925/37963 [79:22:21<6:33:10,  7.77s/it]
 92%|█████████▏| 34926/37963 [79:22:32<7:13:20,  8.56s/it]
 92%|█████████▏| 34927/37963 [79:22:40<7:01:54,  8.34s/it]
 92%|█████████▏| 34928/37963 [79:22:50<7:32:58,  8.95s/it]
 92%|█████████▏| 34929/37963 [79:22:58<7:15:28,  8.61s/it]
 92%|█████████▏| 34930/37963 [79:23:05<7:01:30,  8.34s/it]
                                                          
{'loss': '0.08777', 'grad_norm': '4.157', 'learning_rate': '3.331e-07', 'epoch': '0.9201'}
+
 92%|█████████▏| 34930/37963 [79:23:05<7:01:30,  8.34s/it]
 92%|█████████▏| 34931/37963 [79:23:13<6:55:11,  8.22s/it]
 92%|█████████▏| 34932/37963 [79:23:21<6:48:56,  8.10s/it]
 92%|█████████▏| 34933/37963 [79:23:29<6:41:28,  7.95s/it]
 92%|█████████▏| 34934/37963 [79:23:36<6:37:22,  7.87s/it]
 92%|█████████▏| 34935/37963 [79:23:44<6:38:07,  7.89s/it]
 92%|█████████▏| 34936/37963 [79:23:52<6:31:16,  7.76s/it]
 92%|█████████▏| 34937/37963 [79:24:00<6:30:59,  7.75s/it]
 92%|█████████▏| 34938/37963 [79:24:07<6:32:47,  7.79s/it]
 92%|█████████▏| 34939/37963 [79:24:15<6:32:43,  7.79s/it]
 92%|█████████▏| 34940/37963 [79:24:23<6:33:03,  7.80s/it]
                                                          
{'loss': '0.09275', 'grad_norm': '4.207', 'learning_rate': '3.309e-07', 'epoch': '0.9204'}
+
 92%|█████████▏| 34940/37963 [79:24:23<6:33:03,  7.80s/it]
 92%|█████████▏| 34941/37963 [79:24:31<6:29:40,  7.74s/it]
 92%|█████████▏| 34942/37963 [79:24:41<7:12:34,  8.59s/it]
 92%|█████████▏| 34943/37963 [79:24:49<7:04:22,  8.43s/it]
 92%|█████████▏| 34944/37963 [79:24:57<6:53:43,  8.22s/it]
 92%|█████████▏| 34945/37963 [79:25:05<6:47:30,  8.10s/it]
 92%|█████████▏| 34946/37963 [79:25:13<6:46:20,  8.08s/it]
 92%|█████████▏| 34947/37963 [79:25:21<6:41:19,  7.98s/it]
 92%|█████████▏| 34948/37963 [79:25:28<6:38:20,  7.93s/it]
 92%|█████████▏| 34949/37963 [79:25:36<6:37:27,  7.91s/it]
 92%|█████████▏| 34950/37963 [79:25:44<6:33:06,  7.83s/it]
                                                          
{'loss': '0.07914', 'grad_norm': '4.022', 'learning_rate': '3.288e-07', 'epoch': '0.9206'}
+
 92%|█████████▏| 34950/37963 [79:25:44<6:33:06,  7.83s/it]
 92%|█████████▏| 34951/37963 [79:25:52<6:31:10,  7.79s/it]
 92%|█████████▏| 34952/37963 [79:25:59<6:29:45,  7.77s/it]
 92%|█████████▏| 34953/37963 [79:26:10<7:10:14,  8.58s/it]
 92%|█████████▏| 34954/37963 [79:26:20<7:35:18,  9.08s/it]
 92%|█████████▏| 34955/37963 [79:26:28<7:15:26,  8.69s/it]
 92%|█████████▏| 34956/37963 [79:26:36<7:03:53,  8.46s/it]
 92%|█████████▏| 34957/37963 [79:26:44<6:52:55,  8.24s/it]
 92%|█████████▏| 34958/37963 [79:26:51<6:41:28,  8.02s/it]
 92%|█████████▏| 34959/37963 [79:26:59<6:39:05,  7.97s/it]
 92%|█████████▏| 34960/37963 [79:27:07<6:37:15,  7.94s/it]
                                                          
{'loss': '0.09982', 'grad_norm': '3.914', 'learning_rate': '3.266e-07', 'epoch': '0.9209'}
+
 92%|█████████▏| 34960/37963 [79:27:07<6:37:15,  7.94s/it]
 92%|█████████▏| 34961/37963 [79:27:20<7:52:39,  9.45s/it]
 92%|█████████▏| 34962/37963 [79:27:28<7:28:25,  8.97s/it]
 92%|█████████▏| 34963/37963 [79:27:36<7:14:43,  8.69s/it]
 92%|█████████▏| 34964/37963 [79:27:44<7:02:46,  8.46s/it]
 92%|█████████▏| 34965/37963 [79:27:51<6:52:51,  8.26s/it]
 92%|█████████▏| 34966/37963 [79:27:59<6:48:00,  8.17s/it]
 92%|█████████▏| 34967/37963 [79:28:07<6:42:10,  8.05s/it]
 92%|█████████▏| 34968/37963 [79:28:15<6:37:56,  7.97s/it]
 92%|█████████▏| 34969/37963 [79:28:23<6:33:55,  7.89s/it]
 92%|█████████▏| 34970/37963 [79:28:30<6:31:03,  7.84s/it]
                                                          
{'loss': '0.07379', 'grad_norm': '2.894', 'learning_rate': '3.245e-07', 'epoch': '0.9212'}
+
 92%|█████████▏| 34970/37963 [79:28:30<6:31:03,  7.84s/it]
 92%|█████████▏| 34971/37963 [79:28:38<6:24:22,  7.71s/it]
 92%|█████████▏| 34972/37963 [79:28:48<7:06:29,  8.56s/it]
 92%|█████████▏| 34973/37963 [79:28:59<7:38:42,  9.20s/it]
 92%|█████████▏| 34974/37963 [79:29:07<7:16:15,  8.76s/it]
 92%|█████████▏| 34975/37963 [79:29:17<7:43:24,  9.31s/it]
 92%|█████████▏| 34976/37963 [79:29:25<7:18:15,  8.80s/it]
 92%|█████████▏| 34977/37963 [79:29:33<7:02:48,  8.50s/it]
 92%|█████████▏| 34978/37963 [79:29:41<6:53:02,  8.30s/it]
 92%|█████████▏| 34979/37963 [79:29:48<6:43:44,  8.12s/it]
 92%|█████████▏| 34980/37963 [79:29:56<6:37:22,  7.99s/it]
                                                          
{'loss': '0.09053', 'grad_norm': '3.445', 'learning_rate': '3.223e-07', 'epoch': '0.9214'}
+
 92%|█████████▏| 34980/37963 [79:29:56<6:37:22,  7.99s/it]
 92%|█████████▏| 34981/37963 [79:30:04<6:35:45,  7.96s/it]
 92%|█████████▏| 34982/37963 [79:30:12<6:34:56,  7.95s/it]
 92%|█████████▏| 34983/37963 [79:30:19<6:28:34,  7.82s/it]
 92%|█████████▏| 34984/37963 [79:30:27<6:28:05,  7.82s/it]
 92%|█████████▏| 34985/37963 [79:30:35<6:27:13,  7.80s/it]
 92%|█████████▏| 34986/37963 [79:30:42<6:25:13,  7.76s/it]
 92%|█████████▏| 34987/37963 [79:30:50<6:22:33,  7.71s/it]
 92%|█████████▏| 34988/37963 [79:30:58<6:21:36,  7.70s/it]
 92%|█████████▏| 34989/37963 [79:31:05<6:21:58,  7.71s/it]
 92%|█████████▏| 34990/37963 [79:31:16<7:01:46,  8.51s/it]
                                                          
{'loss': '0.09383', 'grad_norm': '3.32', 'learning_rate': '3.202e-07', 'epoch': '0.9217'}
+
 92%|█████████▏| 34990/37963 [79:31:16<7:01:46,  8.51s/it]
 92%|█████████▏| 34991/37963 [79:31:24<6:50:29,  8.29s/it]
 92%|█████████▏| 34992/37963 [79:31:31<6:42:05,  8.12s/it]
 92%|█████████▏| 34993/37963 [79:31:39<6:36:33,  8.01s/it]
 92%|█████████▏| 34994/37963 [79:31:46<6:26:07,  7.80s/it]
 92%|█████████▏| 34995/37963 [79:31:54<6:27:09,  7.83s/it]
 92%|█████████▏| 34996/37963 [79:32:02<6:31:50,  7.92s/it]
 92%|█████████▏| 34997/37963 [79:32:10<6:30:30,  7.90s/it]
 92%|█████████▏| 34998/37963 [79:32:21<7:06:13,  8.63s/it]
 92%|█████████▏| 34999/37963 [79:32:29<6:56:18,  8.43s/it]
 92%|█████████▏| 35000/37963 [79:32:36<6:46:14,  8.23s/it]
                                                          
{'loss': '0.07943', 'grad_norm': '3.635', 'learning_rate': '3.18e-07', 'epoch': '0.922'}
+
 92%|█████████▏| 35000/37963 [79:32:36<6:46:14,  8.23s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.73s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.73s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 92%|█████████▏| 35001/37963 [79:33:34<18:54:04, 22.97s/it]
 92%|█████████▏| 35002/37963 [79:33:44<15:43:38, 19.12s/it]
 92%|█████████▏| 35003/37963 [79:33:51<12:53:17, 15.67s/it]
 92%|█████████▏| 35004/37963 [79:33:59<10:57:08, 13.33s/it]
 92%|█████████▏| 35005/37963 [79:34:07<9:40:21, 11.77s/it] 
 92%|█████████▏| 35006/37963 [79:34:15<8:36:59, 10.49s/it]
 92%|█████████▏| 35007/37963 [79:34:23<7:58:19,  9.71s/it]
 92%|█████████▏| 35008/37963 [79:34:31<7:28:50,  9.11s/it]
 92%|█████████▏| 35009/37963 [79:34:38<7:04:30,  8.62s/it]
 92%|█████████▏| 35010/37963 [79:34:46<6:52:41,  8.39s/it]
                                                          
{'loss': '0.09272', 'grad_norm': '2.906', 'learning_rate': '3.159e-07', 'epoch': '0.9222'}
+
 92%|█████████▏| 35010/37963 [79:34:46<6:52:41,  8.39s/it]
 92%|█████████▏| 35011/37963 [79:34:54<6:44:38,  8.22s/it]
 92%|█████████▏| 35012/37963 [79:35:01<6:37:24,  8.08s/it]
 92%|█████████▏| 35013/37963 [79:35:12<7:08:42,  8.72s/it]
 92%|█████████▏| 35014/37963 [79:35:22<7:31:48,  9.19s/it]
 92%|█████████▏| 35015/37963 [79:35:30<7:11:23,  8.78s/it]
 92%|█████████▏| 35016/37963 [79:35:37<6:54:29,  8.44s/it]
 92%|█████████▏| 35017/37963 [79:35:45<6:43:01,  8.21s/it]
 92%|█████████▏| 35018/37963 [79:35:53<6:36:40,  8.08s/it]
 92%|█████████▏| 35019/37963 [79:36:06<7:55:58,  9.70s/it]
 92%|█████████▏| 35020/37963 [79:36:14<7:25:49,  9.09s/it]
                                                          
{'loss': '0.09153', 'grad_norm': '3.284', 'learning_rate': '3.138e-07', 'epoch': '0.9225'}
+
 92%|█████████▏| 35020/37963 [79:36:14<7:25:49,  9.09s/it]
 92%|█████████▏| 35021/37963 [79:36:22<7:03:15,  8.63s/it]
 92%|█████████▏| 35022/37963 [79:36:32<7:32:22,  9.23s/it]
 92%|█████████▏| 35023/37963 [79:36:40<7:12:24,  8.82s/it]
 92%|█████████▏| 35024/37963 [79:36:48<6:59:17,  8.56s/it]
 92%|█████████▏| 35025/37963 [79:36:56<6:46:53,  8.31s/it]
 92%|█████████▏| 35026/37963 [79:37:04<6:38:04,  8.13s/it]
 92%|█████████▏| 35027/37963 [79:37:11<6:30:35,  7.98s/it]
 92%|█████████▏| 35028/37963 [79:37:19<6:25:09,  7.87s/it]
 92%|█████████▏| 35029/37963 [79:37:27<6:26:49,  7.91s/it]
 92%|█████████▏| 35030/37963 [79:37:34<6:21:47,  7.81s/it]
                                                          
{'loss': '0.07831', 'grad_norm': '2.469', 'learning_rate': '3.116e-07', 'epoch': '0.9227'}
+
 92%|█████████▏| 35030/37963 [79:37:34<6:21:47,  7.81s/it]
 92%|█████████▏| 35031/37963 [79:37:42<6:19:38,  7.77s/it]
 92%|█████████▏| 35032/37963 [79:37:50<6:18:42,  7.75s/it]
 92%|█████████▏| 35033/37963 [79:37:57<6:17:08,  7.72s/it]
 92%|█████████▏| 35034/37963 [79:38:05<6:16:51,  7.72s/it]
 92%|█████████▏| 35035/37963 [79:38:13<6:18:42,  7.76s/it]
 92%|█████████▏| 35036/37963 [79:38:21<6:16:16,  7.71s/it]
 92%|█████████▏| 35037/37963 [79:38:28<6:17:03,  7.73s/it]
 92%|█████████▏| 35038/37963 [79:38:36<6:19:11,  7.78s/it]
 92%|█████████▏| 35039/37963 [79:38:47<6:58:25,  8.59s/it]
 92%|█████████▏| 35040/37963 [79:38:54<6:45:54,  8.33s/it]
                                                          
{'loss': '0.076', 'grad_norm': '4.452', 'learning_rate': '3.095e-07', 'epoch': '0.923'}
+
 92%|█████████▏| 35040/37963 [79:38:54<6:45:54,  8.33s/it]
 92%|█████████▏| 35041/37963 [79:39:02<6:33:09,  8.07s/it]
 92%|█████████▏| 35042/37963 [79:39:10<6:26:38,  7.94s/it]
 92%|█████████▏| 35043/37963 [79:39:17<6:26:28,  7.94s/it]
 92%|█████████▏| 35044/37963 [79:39:25<6:21:29,  7.84s/it]
 92%|█████████▏| 35045/37963 [79:39:33<6:20:37,  7.83s/it]
 92%|█████████▏| 35046/37963 [79:39:40<6:17:16,  7.76s/it]
 92%|█████████▏| 35047/37963 [79:39:48<6:18:00,  7.78s/it]
 92%|█████████▏| 35048/37963 [79:39:59<6:54:09,  8.52s/it]
 92%|█████████▏| 35049/37963 [79:40:07<6:46:18,  8.37s/it]
 92%|█████████▏| 35050/37963 [79:40:14<6:38:33,  8.21s/it]
                                                          
{'loss': '0.09108', 'grad_norm': '3.038', 'learning_rate': '3.074e-07', 'epoch': '0.9233'}
+
 92%|█████████▏| 35050/37963 [79:40:14<6:38:33,  8.21s/it]
 92%|█████████▏| 35051/37963 [79:40:25<7:07:14,  8.80s/it]
 92%|█████████▏| 35052/37963 [79:40:32<6:51:25,  8.48s/it]
 92%|█████████▏| 35053/37963 [79:40:40<6:42:56,  8.31s/it]
 92%|█████████▏| 35054/37963 [79:40:48<6:33:15,  8.11s/it]
 92%|█████████▏| 35055/37963 [79:40:56<6:29:07,  8.03s/it]
 92%|█████████▏| 35056/37963 [79:41:03<6:25:36,  7.96s/it]
 92%|█████████▏| 35057/37963 [79:41:11<6:21:26,  7.88s/it]
 92%|█████████▏| 35058/37963 [79:41:19<6:14:38,  7.74s/it]
 92%|█████████▏| 35059/37963 [79:41:26<6:14:09,  7.73s/it]
 92%|█████████▏| 35060/37963 [79:41:34<6:15:37,  7.76s/it]
                                                          
{'loss': '0.09832', 'grad_norm': '3.789', 'learning_rate': '3.053e-07', 'epoch': '0.9235'}
+
 92%|█████████▏| 35060/37963 [79:41:34<6:15:37,  7.76s/it]
 92%|█████████▏| 35061/37963 [79:41:42<6:16:04,  7.78s/it]
 92%|█████████▏| 35062/37963 [79:41:50<6:16:49,  7.79s/it]
 92%|█████████▏| 35063/37963 [79:42:00<6:57:17,  8.63s/it]
 92%|█████████▏| 35064/37963 [79:42:08<6:45:14,  8.39s/it]
 92%|█████████▏| 35065/37963 [79:42:16<6:30:19,  8.08s/it]
 92%|█████████▏| 35066/37963 [79:42:23<6:25:39,  7.99s/it]
 92%|█████████▏| 35067/37963 [79:42:34<7:01:45,  8.74s/it]
 92%|█████████▏| 35068/37963 [79:42:44<7:26:07,  9.25s/it]
 92%|█████████▏| 35069/37963 [79:42:52<7:06:02,  8.83s/it]
 92%|█████████▏| 35070/37963 [79:43:03<7:29:30,  9.32s/it]
                                                          
{'loss': '0.08625', 'grad_norm': '5.65', 'learning_rate': '3.032e-07', 'epoch': '0.9238'}
+
 92%|█████████▏| 35070/37963 [79:43:03<7:29:30,  9.32s/it]
 92%|█████████▏| 35071/37963 [79:43:10<7:02:23,  8.76s/it]
 92%|█████████▏| 35072/37963 [79:43:18<6:47:07,  8.45s/it]
 92%|█████████▏| 35073/37963 [79:43:28<7:19:58,  9.13s/it]
 92%|█████████▏| 35074/37963 [79:43:36<6:59:04,  8.70s/it]
 92%|█████████▏| 35075/37963 [79:43:44<6:46:14,  8.44s/it]
 92%|█████████▏| 35076/37963 [79:43:52<6:38:00,  8.27s/it]
 92%|█████████▏| 35077/37963 [79:44:00<6:31:21,  8.14s/it]
 92%|█████████▏| 35078/37963 [79:44:07<6:22:49,  7.96s/it]
 92%|█████████▏| 35079/37963 [79:44:15<6:18:40,  7.88s/it]
 92%|█████████▏| 35080/37963 [79:44:23<6:18:50,  7.88s/it]
                                                          
{'loss': '0.09638', 'grad_norm': '3.81', 'learning_rate': '3.012e-07', 'epoch': '0.9241'}
+
 92%|█████████▏| 35080/37963 [79:44:23<6:18:50,  7.88s/it]
 92%|█████████▏| 35081/37963 [79:44:31<6:18:44,  7.89s/it]
 92%|█████████▏| 35082/37963 [79:44:38<6:12:46,  7.76s/it]
 92%|█████████▏| 35083/37963 [79:44:46<6:11:11,  7.73s/it]
 92%|█████████▏| 35084/37963 [79:44:54<6:10:12,  7.72s/it]
 92%|█████████▏| 35085/37963 [79:45:01<6:10:30,  7.72s/it]
 92%|█████████▏| 35086/37963 [79:45:09<6:05:24,  7.62s/it]
 92%|█████████▏| 35087/37963 [79:45:19<6:48:18,  8.52s/it]
 92%|█████████▏| 35088/37963 [79:45:27<6:38:26,  8.32s/it]
 92%|█████████▏| 35089/37963 [79:45:35<6:29:51,  8.14s/it]
 92%|█████████▏| 35090/37963 [79:45:43<6:27:17,  8.09s/it]
                                                          
{'loss': '0.08202', 'grad_norm': '2.885', 'learning_rate': '2.991e-07', 'epoch': '0.9243'}
+
 92%|█████████▏| 35090/37963 [79:45:43<6:27:17,  8.09s/it]
 92%|█████████▏| 35091/37963 [79:45:51<6:21:32,  7.97s/it]
 92%|█████████▏| 35092/37963 [79:45:58<6:17:16,  7.88s/it]
 92%|█████████▏| 35093/37963 [79:46:06<6:10:05,  7.74s/it]
 92%|█████████▏| 35094/37963 [79:46:14<6:16:30,  7.87s/it]
 92%|█████████▏| 35095/37963 [79:46:22<6:15:38,  7.86s/it]
 92%|█████████▏| 35096/37963 [79:46:29<6:10:46,  7.76s/it]
 92%|█████████▏| 35097/37963 [79:46:37<6:06:56,  7.68s/it]
 92%|█████████▏| 35098/37963 [79:46:45<6:09:20,  7.73s/it]
 92%|█████████▏| 35099/37963 [79:46:52<6:11:55,  7.79s/it]
 92%|█████████▏| 35100/37963 [79:47:00<6:10:45,  7.77s/it]
                                                          
{'loss': '0.09708', 'grad_norm': '3.886', 'learning_rate': '2.97e-07', 'epoch': '0.9246'}
+
 92%|█████████▏| 35100/37963 [79:47:00<6:10:45,  7.77s/it]
 92%|█████████▏| 35101/37963 [79:47:08<6:11:53,  7.80s/it]
 92%|█████████▏| 35102/37963 [79:47:18<6:46:05,  8.52s/it]
 92%|█████████▏| 35103/37963 [79:47:26<6:30:25,  8.19s/it]
 92%|█████████▏| 35104/37963 [79:47:34<6:28:01,  8.14s/it]
 92%|█████████▏| 35105/37963 [79:47:44<6:58:12,  8.78s/it]
 92%|█████████▏| 35106/37963 [79:47:55<7:27:22,  9.40s/it]
 92%|█████████▏| 35107/37963 [79:48:03<7:05:39,  8.94s/it]
 92%|█████████▏| 35108/37963 [79:48:11<6:54:39,  8.71s/it]
 92%|█████████▏| 35109/37963 [79:48:19<6:41:00,  8.43s/it]
 92%|█████████▏| 35110/37963 [79:48:26<6:32:51,  8.26s/it]
                                                          
{'loss': '0.0902', 'grad_norm': '4.604', 'learning_rate': '2.95e-07', 'epoch': '0.9249'}
+
 92%|█████████▏| 35110/37963 [79:48:26<6:32:51,  8.26s/it]
 92%|█████████▏| 35111/37963 [79:48:34<6:24:54,  8.10s/it]
 92%|█████████▏| 35112/37963 [79:48:42<6:19:06,  7.98s/it]
 92%|█████████▏| 35113/37963 [79:48:52<6:49:36,  8.62s/it]
 92%|█████████▏| 35114/37963 [79:49:00<6:37:21,  8.37s/it]
 92%|█████████▏| 35115/37963 [79:49:07<6:25:35,  8.12s/it]
 93%|█████████▎| 35116/37963 [79:49:15<6:18:46,  7.98s/it]
 93%|█████████▎| 35117/37963 [79:49:23<6:15:15,  7.91s/it]
 93%|█████████▎| 35118/37963 [79:49:31<6:15:03,  7.91s/it]
 93%|█████████▎| 35119/37963 [79:49:38<6:13:49,  7.89s/it]
 93%|█████████▎| 35120/37963 [79:49:46<6:13:36,  7.88s/it]
                                                          
{'loss': '0.0928', 'grad_norm': '3.61', 'learning_rate': '2.929e-07', 'epoch': '0.9251'}
+
 93%|█████████▎| 35120/37963 [79:49:46<6:13:36,  7.88s/it]
 93%|█████████▎| 35121/37963 [79:49:57<6:48:49,  8.63s/it]
 93%|█████████▎| 35122/37963 [79:50:07<7:16:52,  9.23s/it]
 93%|█████████▎| 35123/37963 [79:50:15<6:56:58,  8.81s/it]
 93%|█████████▎| 35124/37963 [79:50:23<6:40:38,  8.47s/it]
 93%|█████████▎| 35125/37963 [79:50:31<6:29:49,  8.24s/it]
 93%|█████████▎| 35126/37963 [79:50:38<6:16:06,  7.95s/it]
 93%|█████████▎| 35127/37963 [79:50:48<6:52:29,  8.73s/it]
 93%|█████████▎| 35128/37963 [79:50:56<6:36:03,  8.38s/it]
 93%|█████████▎| 35129/37963 [79:51:04<6:28:11,  8.22s/it]
 93%|█████████▎| 35130/37963 [79:51:12<6:23:50,  8.13s/it]
                                                          
{'loss': '0.09362', 'grad_norm': '4.629', 'learning_rate': '2.909e-07', 'epoch': '0.9254'}
+
 93%|█████████▎| 35130/37963 [79:51:12<6:23:50,  8.13s/it]
 93%|█████████▎| 35131/37963 [79:51:19<6:18:40,  8.02s/it]
 93%|█████████▎| 35132/37963 [79:51:27<6:16:57,  7.99s/it]
 93%|█████████▎| 35133/37963 [79:51:35<6:15:19,  7.96s/it]
 93%|█████████▎| 35134/37963 [79:51:43<6:14:55,  7.95s/it]
 93%|█████████▎| 35135/37963 [79:51:51<6:12:11,  7.90s/it]
 93%|█████████▎| 35136/37963 [79:51:59<6:10:40,  7.87s/it]
 93%|█████████▎| 35137/37963 [79:52:06<6:04:39,  7.74s/it]
 93%|█████████▎| 35138/37963 [79:52:14<6:02:56,  7.71s/it]
 93%|█████████▎| 35139/37963 [79:52:21<5:59:29,  7.64s/it]
 93%|█████████▎| 35140/37963 [79:52:29<6:00:27,  7.66s/it]
                                                          
{'loss': '0.07872', 'grad_norm': '3.266', 'learning_rate': '2.888e-07', 'epoch': '0.9256'}
+
 93%|█████████▎| 35140/37963 [79:52:29<6:00:27,  7.66s/it]
 93%|█████████▎| 35141/37963 [79:52:40<6:42:06,  8.55s/it]
 93%|█████████▎| 35142/37963 [79:52:47<6:28:57,  8.27s/it]
 93%|█████████▎| 35143/37963 [79:52:55<6:19:59,  8.09s/it]
 93%|█████████▎| 35144/37963 [79:53:02<6:11:45,  7.91s/it]
 93%|█████████▎| 35145/37963 [79:53:10<6:07:50,  7.83s/it]
 93%|█████████▎| 35146/37963 [79:53:20<6:43:31,  8.59s/it]
 93%|█████████▎| 35147/37963 [79:53:28<6:30:38,  8.32s/it]
 93%|█████████▎| 35148/37963 [79:53:38<6:55:54,  8.86s/it]
 93%|█████████▎| 35149/37963 [79:53:46<6:39:29,  8.52s/it]
 93%|█████████▎| 35150/37963 [79:53:54<6:28:48,  8.29s/it]
                                                          
{'loss': '0.09656', 'grad_norm': '3.08', 'learning_rate': '2.868e-07', 'epoch': '0.9259'}
+
 93%|█████████▎| 35150/37963 [79:53:54<6:28:48,  8.29s/it]
 93%|█████████▎| 35151/37963 [79:54:02<6:21:34,  8.14s/it]
 93%|█████████▎| 35152/37963 [79:54:09<6:16:23,  8.03s/it]
 93%|█████████▎| 35153/37963 [79:54:17<6:05:04,  7.80s/it]
 93%|█████████▎| 35154/37963 [79:54:24<6:04:29,  7.79s/it]
 93%|█████████▎| 35155/37963 [79:54:32<6:02:09,  7.74s/it]
 93%|█████████▎| 35156/37963 [79:54:40<6:03:48,  7.78s/it]
 93%|█████████▎| 35157/37963 [79:54:48<6:02:09,  7.74s/it]
 93%|█████████▎| 35158/37963 [79:54:55<6:02:56,  7.76s/it]
 93%|█████████▎| 35159/37963 [79:55:03<6:05:47,  7.83s/it]
 93%|█████████▎| 35160/37963 [79:55:14<6:43:50,  8.64s/it]
                                                          
{'loss': '0.08653', 'grad_norm': '5.077', 'learning_rate': '2.848e-07', 'epoch': '0.9262'}
+
 93%|█████████▎| 35160/37963 [79:55:14<6:43:50,  8.64s/it]
 93%|█████████▎| 35161/37963 [79:55:25<7:14:22,  9.30s/it]
 93%|█████████▎| 35162/37963 [79:55:33<6:55:33,  8.90s/it]
 93%|█████████▎| 35163/37963 [79:55:40<6:38:40,  8.54s/it]
 93%|█████████▎| 35164/37963 [79:55:48<6:26:58,  8.30s/it]
 93%|█████████▎| 35165/37963 [79:55:56<6:17:13,  8.09s/it]
 93%|█████████▎| 35166/37963 [79:56:03<6:11:57,  7.98s/it]
 93%|█████████▎| 35167/37963 [79:56:11<6:10:56,  7.96s/it]
 93%|█████████▎| 35168/37963 [79:56:19<6:08:42,  7.91s/it]
 93%|█████████▎| 35169/37963 [79:56:29<6:39:45,  8.58s/it]
 93%|█████████▎| 35170/37963 [79:56:40<7:06:32,  9.16s/it]
                                                          
{'loss': '0.08411', 'grad_norm': '3.702', 'learning_rate': '2.828e-07', 'epoch': '0.9264'}
+
 93%|█████████▎| 35170/37963 [79:56:40<7:06:32,  9.16s/it]
 93%|█████████▎| 35171/37963 [79:56:47<6:42:58,  8.66s/it]
 93%|█████████▎| 35172/37963 [79:56:55<6:30:34,  8.40s/it]
 93%|█████████▎| 35173/37963 [79:57:03<6:21:04,  8.20s/it]
 93%|█████████▎| 35174/37963 [79:57:10<6:13:05,  8.03s/it]
 93%|█████████▎| 35175/37963 [79:57:21<6:45:35,  8.73s/it]
 93%|█████████▎| 35176/37963 [79:57:28<6:31:15,  8.42s/it]
 93%|█████████▎| 35177/37963 [79:57:36<6:19:37,  8.18s/it]
 93%|█████████▎| 35178/37963 [79:57:44<6:13:36,  8.05s/it]
 93%|█████████▎| 35179/37963 [79:57:52<6:09:19,  7.96s/it]
 93%|█████████▎| 35180/37963 [79:57:59<6:04:43,  7.86s/it]
                                                          
{'loss': '0.1022', 'grad_norm': '3.597', 'learning_rate': '2.807e-07', 'epoch': '0.9267'}
+
 93%|█████████▎| 35180/37963 [79:57:59<6:04:43,  7.86s/it]
 93%|█████████▎| 35181/37963 [79:58:07<5:59:08,  7.75s/it]
 93%|█████████▎| 35182/37963 [79:58:15<5:59:58,  7.77s/it]
 93%|█████████▎| 35183/37963 [79:58:22<5:58:34,  7.74s/it]
 93%|█████████▎| 35184/37963 [79:58:30<5:57:18,  7.71s/it]
 93%|█████████▎| 35185/37963 [79:58:38<5:58:07,  7.73s/it]
 93%|█████████▎| 35186/37963 [79:58:45<5:58:43,  7.75s/it]
 93%|█████████▎| 35187/37963 [79:58:53<5:58:59,  7.76s/it]
 93%|█████████▎| 35188/37963 [79:59:01<6:01:15,  7.81s/it]
 93%|█████████▎| 35189/37963 [79:59:11<6:34:59,  8.54s/it]
 93%|█████████▎| 35190/37963 [79:59:19<6:25:28,  8.34s/it]
                                                          
{'loss': '0.08869', 'grad_norm': '3.611', 'learning_rate': '2.787e-07', 'epoch': '0.927'}
+
 93%|█████████▎| 35190/37963 [79:59:19<6:25:28,  8.34s/it]
 93%|█████████▎| 35191/37963 [79:59:27<6:20:11,  8.23s/it]
 93%|█████████▎| 35192/37963 [79:59:37<6:48:04,  8.84s/it]
 93%|█████████▎| 35193/37963 [79:59:45<6:32:01,  8.49s/it]
 93%|█████████▎| 35194/37963 [79:59:53<6:21:03,  8.26s/it]
 93%|█████████▎| 35195/37963 [80:00:04<6:55:19,  9.00s/it]
 93%|█████████▎| 35196/37963 [80:00:11<6:38:37,  8.64s/it]
 93%|█████████▎| 35197/37963 [80:00:19<6:25:25,  8.36s/it]
 93%|█████████▎| 35198/37963 [80:00:27<6:16:24,  8.17s/it]
 93%|█████████▎| 35199/37963 [80:00:35<6:13:44,  8.11s/it]
 93%|█████████▎| 35200/37963 [80:00:43<6:09:24,  8.02s/it]
                                                          
{'loss': '0.07697', 'grad_norm': '2.547', 'learning_rate': '2.767e-07', 'epoch': '0.9272'}
+
 93%|█████████▎| 35200/37963 [80:00:43<6:09:24,  8.02s/it]
 93%|█████████▎| 35201/37963 [80:00:50<6:04:18,  7.91s/it]
 93%|█████████▎| 35202/37963 [80:00:58<6:01:45,  7.86s/it]
 93%|█████████▎| 35203/37963 [80:01:06<6:04:40,  7.93s/it]
 93%|█████████▎| 35204/37963 [80:01:17<6:41:22,  8.73s/it]
 93%|█████████▎| 35205/37963 [80:01:25<6:28:34,  8.45s/it]
 93%|█████████▎| 35206/37963 [80:01:32<6:17:56,  8.23s/it]
 93%|█████████▎| 35207/37963 [80:01:40<6:09:30,  8.04s/it]
 93%|█████████▎| 35208/37963 [80:01:47<5:57:29,  7.79s/it]
 93%|█████████▎| 35209/37963 [80:01:55<5:56:52,  7.77s/it]
 93%|█████████▎| 35210/37963 [80:02:03<5:57:06,  7.78s/it]
                                                          
{'loss': '0.08002', 'grad_norm': '3.223', 'learning_rate': '2.747e-07', 'epoch': '0.9275'}
+
 93%|█████████▎| 35210/37963 [80:02:03<5:57:06,  7.78s/it]
 93%|█████████▎| 35211/37963 [80:02:14<6:41:06,  8.74s/it]
 93%|█████████▎| 35212/37963 [80:02:21<6:25:55,  8.42s/it]
 93%|█████████▎| 35213/37963 [80:02:32<6:53:33,  9.02s/it]
 93%|█████████▎| 35214/37963 [80:02:40<6:37:38,  8.68s/it]
 93%|█████████▎| 35215/37963 [80:02:47<6:27:27,  8.46s/it]
 93%|█████████▎| 35216/37963 [80:02:55<6:15:47,  8.21s/it]
 93%|█████████▎| 35217/37963 [80:03:03<6:11:53,  8.13s/it]
 93%|█████████▎| 35218/37963 [80:03:11<6:02:52,  7.93s/it]
 93%|█████████▎| 35219/37963 [80:03:18<6:02:51,  7.93s/it]
 93%|█████████▎| 35220/37963 [80:03:26<5:58:53,  7.85s/it]
                                                          
{'loss': '0.09135', 'grad_norm': '2.963', 'learning_rate': '2.728e-07', 'epoch': '0.9277'}
+
 93%|█████████▎| 35220/37963 [80:03:26<5:58:53,  7.85s/it]
 93%|█████████▎| 35221/37963 [80:03:34<6:00:28,  7.89s/it]
 93%|█████████▎| 35222/37963 [80:03:44<6:25:36,  8.44s/it]
 93%|█████████▎| 35223/37963 [80:03:52<6:19:17,  8.31s/it]
 93%|█████████▎| 35224/37963 [80:04:02<6:46:54,  8.91s/it]
 93%|█████████▎| 35225/37963 [80:04:10<6:34:06,  8.64s/it]
 93%|█████████▎| 35226/37963 [80:04:18<6:23:44,  8.41s/it]
 93%|█████████▎| 35227/37963 [80:04:26<6:12:57,  8.18s/it]
 93%|█████████▎| 35228/37963 [80:04:33<6:07:10,  8.06s/it]
 93%|█████████▎| 35229/37963 [80:04:41<6:01:12,  7.93s/it]
 93%|█████████▎| 35230/37963 [80:04:49<5:56:52,  7.83s/it]
                                                          
{'loss': '0.09679', 'grad_norm': '2.877', 'learning_rate': '2.708e-07', 'epoch': '0.928'}
+
 93%|█████████▎| 35230/37963 [80:04:49<5:56:52,  7.83s/it]
 93%|█████████▎| 35231/37963 [80:04:57<5:58:38,  7.88s/it]
 93%|█████████▎| 35232/37963 [80:05:04<5:55:53,  7.82s/it]
 93%|█████████▎| 35233/37963 [80:05:12<5:55:29,  7.81s/it]
 93%|█████████▎| 35234/37963 [80:05:20<5:56:42,  7.84s/it]
 93%|█████████▎| 35235/37963 [80:05:28<5:54:16,  7.79s/it]
 93%|█████████▎| 35236/37963 [80:05:38<6:28:14,  8.54s/it]
 93%|█████████▎| 35237/37963 [80:05:46<6:17:20,  8.31s/it]
 93%|█████████▎| 35238/37963 [80:05:56<6:44:01,  8.90s/it]
 93%|█████████▎| 35239/37963 [80:06:04<6:31:20,  8.62s/it]
 93%|█████████▎| 35240/37963 [80:06:12<6:18:35,  8.34s/it]
                                                          
{'loss': '0.06771', 'grad_norm': '2.442', 'learning_rate': '2.688e-07', 'epoch': '0.9283'}
+
 93%|█████████▎| 35240/37963 [80:06:12<6:18:35,  8.34s/it]
 93%|█████████▎| 35241/37963 [80:06:22<6:47:34,  8.98s/it]
 93%|█████████▎| 35242/37963 [80:06:30<6:29:12,  8.58s/it]
 93%|█████████▎| 35243/37963 [80:06:38<6:18:15,  8.34s/it]
 93%|█████████▎| 35244/37963 [80:06:45<6:09:10,  8.15s/it]
 93%|█████████▎| 35245/37963 [80:06:53<6:04:12,  8.04s/it]
 93%|█████████▎| 35246/37963 [80:07:01<6:01:37,  7.99s/it]
 93%|█████████▎| 35247/37963 [80:07:09<5:58:31,  7.92s/it]
 93%|█████████▎| 35248/37963 [80:07:16<5:54:54,  7.84s/it]
 93%|█████████▎| 35249/37963 [80:07:24<5:52:06,  7.78s/it]
 93%|█████████▎| 35250/37963 [80:07:32<5:48:40,  7.71s/it]
                                                          
{'loss': '0.08105', 'grad_norm': '2.895', 'learning_rate': '2.669e-07', 'epoch': '0.9285'}
+
 93%|█████████▎| 35250/37963 [80:07:32<5:48:40,  7.71s/it]
 93%|█████████▎| 35251/37963 [80:07:39<5:51:04,  7.77s/it]
 93%|█████████▎| 35252/37963 [80:07:50<6:31:04,  8.66s/it]
 93%|█████████▎| 35253/37963 [80:07:58<6:19:47,  8.41s/it]
 93%|█████████▎| 35254/37963 [80:08:06<6:08:33,  8.16s/it]
 93%|█████████▎| 35255/37963 [80:08:13<6:00:40,  7.99s/it]
 93%|█████████▎| 35256/37963 [80:08:21<5:55:08,  7.87s/it]
 93%|█████████▎| 35257/37963 [80:08:31<6:23:46,  8.51s/it]
 93%|█████████▎| 35258/37963 [80:08:38<6:12:26,  8.26s/it]
 93%|█████████▎| 35259/37963 [80:08:46<6:07:31,  8.16s/it]
 93%|█████████▎| 35260/37963 [80:08:54<6:01:18,  8.02s/it]
                                                          
{'loss': '0.0787', 'grad_norm': '3.434', 'learning_rate': '2.649e-07', 'epoch': '0.9288'}
+
 93%|█████████▎| 35260/37963 [80:08:54<6:01:18,  8.02s/it]
 93%|█████████▎| 35261/37963 [80:09:02<5:56:44,  7.92s/it]
 93%|█████████▎| 35262/37963 [80:09:10<5:56:57,  7.93s/it]
 93%|█████████▎| 35263/37963 [80:09:17<5:53:56,  7.87s/it]
 93%|█████████▎| 35264/37963 [80:09:25<5:46:58,  7.71s/it]
 93%|█████████▎| 35265/37963 [80:09:35<6:26:22,  8.59s/it]
 93%|█████████▎| 35266/37963 [80:09:43<6:17:17,  8.39s/it]
 93%|█████████▎| 35267/37963 [80:09:51<6:10:44,  8.25s/it]
 93%|█████████▎| 35268/37963 [80:09:59<6:02:25,  8.07s/it]
 93%|█████████▎| 35269/37963 [80:10:07<5:56:10,  7.93s/it]
 93%|█████████▎| 35270/37963 [80:10:14<5:50:01,  7.80s/it]
                                                          
{'loss': '0.08725', 'grad_norm': '2.708', 'learning_rate': '2.63e-07', 'epoch': '0.9291'}
+
 93%|█████████▎| 35270/37963 [80:10:14<5:50:01,  7.80s/it]
 93%|█████████▎| 35271/37963 [80:10:22<5:51:03,  7.82s/it]
 93%|█████████▎| 35272/37963 [80:10:30<5:51:43,  7.84s/it]
 93%|█████████▎| 35273/37963 [80:10:38<5:52:27,  7.86s/it]
 93%|█████████▎| 35274/37963 [80:10:48<6:24:27,  8.58s/it]
 93%|█████████▎| 35275/37963 [80:10:56<6:10:33,  8.27s/it]
 93%|█████████▎| 35276/37963 [80:11:03<6:04:29,  8.14s/it]
 93%|█████████▎| 35277/37963 [80:11:11<5:58:18,  8.00s/it]
 93%|█████████▎| 35278/37963 [80:11:21<6:29:11,  8.70s/it]
 93%|█████████▎| 35279/37963 [80:11:29<6:14:57,  8.38s/it]
 93%|█████████▎| 35280/37963 [80:11:39<6:39:15,  8.93s/it]
                                                          
{'loss': '0.0913', 'grad_norm': '3.459', 'learning_rate': '2.61e-07', 'epoch': '0.9293'}
+
 93%|█████████▎| 35280/37963 [80:11:39<6:39:15,  8.93s/it]
 93%|█████████▎| 35281/37963 [80:11:47<6:22:05,  8.55s/it]
 93%|█████████▎| 35282/37963 [80:11:55<6:11:14,  8.31s/it]
 93%|█████████▎| 35283/37963 [80:12:02<6:04:15,  8.16s/it]
 93%|█████████▎| 35284/37963 [80:12:13<6:33:26,  8.81s/it]
 93%|█████████▎| 35285/37963 [80:12:21<6:19:59,  8.51s/it]
 93%|█████████▎| 35286/37963 [80:12:31<6:43:38,  9.05s/it]
 93%|█████████▎| 35287/37963 [80:12:39<6:26:21,  8.66s/it]
 93%|█████████▎| 35288/37963 [80:12:46<6:11:47,  8.34s/it]
 93%|█████████▎| 35289/37963 [80:12:54<6:05:32,  8.20s/it]
 93%|█████████▎| 35290/37963 [80:13:02<6:01:18,  8.11s/it]
                                                          
{'loss': '0.08136', 'grad_norm': '3.767', 'learning_rate': '2.591e-07', 'epoch': '0.9296'}
+
 93%|█████████▎| 35290/37963 [80:13:02<6:01:18,  8.11s/it]
 93%|█████████▎| 35291/37963 [80:13:10<5:55:06,  7.97s/it]
 93%|█████████▎| 35292/37963 [80:13:17<5:51:28,  7.90s/it]
 93%|█████████▎| 35293/37963 [80:13:25<5:51:22,  7.90s/it]
 93%|█████████▎| 35294/37963 [80:13:33<5:49:32,  7.86s/it]
 93%|█████████▎| 35295/37963 [80:13:41<5:45:56,  7.78s/it]
 93%|█████████▎| 35296/37963 [80:13:48<5:40:16,  7.66s/it]
 93%|█████████▎| 35297/37963 [80:13:56<5:39:43,  7.65s/it]
 93%|█████████▎| 35298/37963 [80:14:04<5:44:46,  7.76s/it]
 93%|█████████▎| 35299/37963 [80:14:11<5:44:25,  7.76s/it]
 93%|█████████▎| 35300/37963 [80:14:19<5:45:08,  7.78s/it]
                                                          
{'loss': '0.08326', 'grad_norm': '2.849', 'learning_rate': '2.572e-07', 'epoch': '0.9299'}
+
 93%|█████████▎| 35300/37963 [80:14:19<5:45:08,  7.78s/it]
 93%|█████████▎| 35301/37963 [80:14:27<5:41:59,  7.71s/it]
 93%|█████████▎| 35302/37963 [80:14:34<5:40:48,  7.68s/it]
 93%|█████████▎| 35303/37963 [80:14:42<5:42:08,  7.72s/it]
 93%|█████████▎| 35304/37963 [80:14:50<5:41:04,  7.70s/it]
 93%|█████████▎| 35305/37963 [80:14:58<5:43:55,  7.76s/it]
 93%|█████████▎| 35306/37963 [80:15:08<6:20:48,  8.60s/it]
 93%|█████████▎| 35307/37963 [80:15:16<6:11:56,  8.40s/it]
 93%|█████████▎| 35308/37963 [80:15:24<6:03:07,  8.21s/it]
 93%|█████████▎| 35309/37963 [80:15:32<5:58:33,  8.11s/it]
 93%|█████████▎| 35310/37963 [80:15:40<5:56:34,  8.06s/it]
                                                          
{'loss': '0.08073', 'grad_norm': '5.144', 'learning_rate': '2.552e-07', 'epoch': '0.9301'}
+
 93%|█████████▎| 35310/37963 [80:15:40<5:56:34,  8.06s/it]
 93%|█████████▎| 35311/37963 [80:15:50<6:29:58,  8.82s/it]
 93%|█████████▎| 35312/37963 [80:15:58<6:14:41,  8.48s/it]
 93%|█████████▎| 35313/37963 [80:16:06<6:06:18,  8.29s/it]
 93%|█████████▎| 35314/37963 [80:16:14<5:56:47,  8.08s/it]
 93%|█████████▎| 35315/37963 [80:16:24<6:27:28,  8.78s/it]
 93%|█████████▎| 35316/37963 [80:16:31<6:07:58,  8.34s/it]
 93%|█████████▎| 35317/37963 [80:16:39<6:00:05,  8.17s/it]
 93%|█████████▎| 35318/37963 [80:16:47<5:53:36,  8.02s/it]
 93%|█████████▎| 35319/37963 [80:16:54<5:48:31,  7.91s/it]
 93%|█████████▎| 35320/37963 [80:17:02<5:46:52,  7.87s/it]
                                                          
{'loss': '0.08385', 'grad_norm': '3.655', 'learning_rate': '2.533e-07', 'epoch': '0.9304'}
+
 93%|█████████▎| 35320/37963 [80:17:02<5:46:52,  7.87s/it]
 93%|█████████▎| 35321/37963 [80:17:10<5:42:29,  7.78s/it]
 93%|█████████▎| 35322/37963 [80:17:20<6:13:46,  8.49s/it]
 93%|█████████▎| 35323/37963 [80:17:28<6:05:11,  8.30s/it]
 93%|█████████▎| 35324/37963 [80:17:35<5:55:17,  8.08s/it]
 93%|█████████▎| 35325/37963 [80:17:43<5:51:12,  7.99s/it]
 93%|█████████▎| 35326/37963 [80:17:51<5:48:06,  7.92s/it]
 93%|█████████▎| 35327/37963 [80:18:01<6:22:36,  8.71s/it]
 93%|█████████▎| 35328/37963 [80:18:12<6:42:38,  9.17s/it]
 93%|█████████▎| 35329/37963 [80:18:22<6:59:51,  9.56s/it]
 93%|█████████▎| 35330/37963 [80:18:30<6:34:14,  8.98s/it]
                                                          
{'loss': '0.08644', 'grad_norm': '4.011', 'learning_rate': '2.514e-07', 'epoch': '0.9306'}
+
 93%|█████████▎| 35330/37963 [80:18:30<6:34:14,  8.98s/it]
 93%|█████████▎| 35331/37963 [80:18:38<6:18:28,  8.63s/it]
 93%|█████████▎| 35332/37963 [80:18:45<6:06:03,  8.35s/it]
 93%|█████████▎| 35333/37963 [80:18:53<5:59:25,  8.20s/it]
 93%|█████████▎| 35334/37963 [80:19:01<5:54:13,  8.08s/it]
 93%|█████████▎| 35335/37963 [80:19:09<5:50:11,  8.00s/it]
 93%|█████████▎| 35336/37963 [80:19:16<5:42:26,  7.82s/it]
 93%|█████████▎| 35337/37963 [80:19:24<5:41:19,  7.80s/it]
 93%|█████████▎| 35338/37963 [80:19:34<6:17:38,  8.63s/it]
 93%|█████████▎| 35339/37963 [80:19:42<6:06:32,  8.38s/it]
 93%|█████████▎| 35340/37963 [80:19:50<5:54:19,  8.10s/it]
                                                          
{'loss': '0.08983', 'grad_norm': '2.765', 'learning_rate': '2.495e-07', 'epoch': '0.9309'}
+
 93%|█████████▎| 35340/37963 [80:19:50<5:54:19,  8.10s/it]
 93%|█████████▎| 35341/37963 [80:19:58<5:51:28,  8.04s/it]
 93%|█████████▎| 35342/37963 [80:20:05<5:45:53,  7.92s/it]
 93%|█████████▎| 35343/37963 [80:20:13<5:41:47,  7.83s/it]
 93%|█████████▎| 35344/37963 [80:20:20<5:39:22,  7.78s/it]
 93%|█████████▎| 35345/37963 [80:20:28<5:41:15,  7.82s/it]
 93%|█████████▎| 35346/37963 [80:20:36<5:39:17,  7.78s/it]
 93%|█████████▎| 35347/37963 [80:20:44<5:37:41,  7.75s/it]
 93%|█████████▎| 35348/37963 [80:20:51<5:34:12,  7.67s/it]
 93%|█████████▎| 35349/37963 [80:20:59<5:31:34,  7.61s/it]
 93%|█████████▎| 35350/37963 [80:21:09<6:10:34,  8.51s/it]
                                                          
{'loss': '0.08351', 'grad_norm': '3.212', 'learning_rate': '2.476e-07', 'epoch': '0.9312'}
+
 93%|█████████▎| 35350/37963 [80:21:09<6:10:34,  8.51s/it]
 93%|█████████▎| 35351/37963 [80:21:17<5:59:36,  8.26s/it]
 93%|█████████▎| 35352/37963 [80:21:25<5:50:19,  8.05s/it]
 93%|█████████▎| 35353/37963 [80:21:32<5:48:47,  8.02s/it]
 93%|█████████▎| 35354/37963 [80:21:40<5:45:11,  7.94s/it]
 93%|█████████▎| 35355/37963 [80:21:48<5:40:12,  7.83s/it]
 93%|█████████▎| 35356/37963 [80:21:56<5:39:16,  7.81s/it]
 93%|█████████▎| 35357/37963 [80:22:03<5:38:05,  7.78s/it]
 93%|█████████▎| 35358/37963 [80:22:14<6:12:16,  8.57s/it]
 93%|█████████▎| 35359/37963 [80:22:21<6:00:22,  8.30s/it]
 93%|█████████▎| 35360/37963 [80:22:29<5:53:47,  8.16s/it]
                                                          
{'loss': '0.0881', 'grad_norm': '3.372', 'learning_rate': '2.458e-07', 'epoch': '0.9314'}
+
 93%|█████████▎| 35360/37963 [80:22:29<5:53:47,  8.16s/it]
 93%|█████████▎| 35361/37963 [80:22:37<5:48:41,  8.04s/it]
 93%|█████████▎| 35362/37963 [80:22:45<5:45:36,  7.97s/it]
 93%|█████████▎| 35363/37963 [80:22:53<5:42:42,  7.91s/it]
 93%|█████████▎| 35364/37963 [80:23:00<5:38:00,  7.80s/it]
 93%|█████████▎| 35365/37963 [80:23:08<5:36:00,  7.76s/it]
 93%|█████████▎| 35366/37963 [80:23:15<5:35:06,  7.74s/it]
 93%|█████████▎| 35367/37963 [80:23:23<5:35:27,  7.75s/it]
 93%|█████████▎| 35368/37963 [80:23:34<6:12:11,  8.61s/it]
 93%|█████████▎| 35369/37963 [80:23:42<6:00:24,  8.34s/it]
 93%|█████████▎| 35370/37963 [80:23:55<7:00:56,  9.74s/it]
                                                          
{'loss': '0.09065', 'grad_norm': '3.749', 'learning_rate': '2.439e-07', 'epoch': '0.9317'}
+
 93%|█████████▎| 35370/37963 [80:23:55<7:00:56,  9.74s/it]
 93%|█████████▎| 35371/37963 [80:24:02<6:37:21,  9.20s/it]
 93%|█████████▎| 35372/37963 [80:24:10<6:19:21,  8.78s/it]
 93%|█████████▎| 35373/37963 [80:24:21<6:40:42,  9.28s/it]
 93%|█████████▎| 35374/37963 [80:24:29<6:21:03,  8.83s/it]
 93%|█████████▎| 35375/37963 [80:24:36<6:01:04,  8.37s/it]
 93%|█████████▎| 35376/37963 [80:24:46<6:23:25,  8.89s/it]
 93%|█████████▎| 35377/37963 [80:24:53<6:05:29,  8.48s/it]
 93%|█████████▎| 35378/37963 [80:25:01<5:54:06,  8.22s/it]
 93%|█████████▎| 35379/37963 [80:25:09<5:52:36,  8.19s/it]
 93%|█████████▎| 35380/37963 [80:25:17<5:46:24,  8.05s/it]
                                                          
{'loss': '0.09062', 'grad_norm': '4.803', 'learning_rate': '2.42e-07', 'epoch': '0.932'}
+
 93%|█████████▎| 35380/37963 [80:25:17<5:46:24,  8.05s/it]
 93%|█████████▎| 35381/37963 [80:25:25<5:42:14,  7.95s/it]
 93%|█████████▎| 35382/37963 [80:25:35<6:13:50,  8.69s/it]
 93%|█████████▎| 35383/37963 [80:25:43<6:04:44,  8.48s/it]
 93%|█████████▎| 35384/37963 [80:25:51<5:55:24,  8.27s/it]
 93%|█████████▎| 35385/37963 [80:25:59<5:49:00,  8.12s/it]
 93%|█████████▎| 35386/37963 [80:26:06<5:42:10,  7.97s/it]
 93%|█████████▎| 35387/37963 [80:26:14<5:41:14,  7.95s/it]
 93%|█████████▎| 35388/37963 [80:26:21<5:30:26,  7.70s/it]
 93%|█████████▎| 35389/37963 [80:26:29<5:25:15,  7.58s/it]
 93%|█████████▎| 35390/37963 [80:26:36<5:25:11,  7.58s/it]
                                                          
{'loss': '0.09374', 'grad_norm': '4.087', 'learning_rate': '2.401e-07', 'epoch': '0.9322'}
+
 93%|█████████▎| 35390/37963 [80:26:36<5:25:11,  7.58s/it]
 93%|█████████▎| 35391/37963 [80:26:43<5:21:53,  7.51s/it]
 93%|█████████▎| 35392/37963 [80:26:51<5:27:10,  7.64s/it]
 93%|█████████▎| 35393/37963 [80:27:02<6:02:07,  8.45s/it]
 93%|█████████▎| 35394/37963 [80:27:09<5:51:41,  8.21s/it]
 93%|█████████▎| 35395/37963 [80:27:17<5:47:12,  8.11s/it]
 93%|█████████▎| 35396/37963 [80:27:25<5:38:26,  7.91s/it]
 93%|█████████▎| 35397/37963 [80:27:32<5:32:36,  7.78s/it]
 93%|█████████▎| 35398/37963 [80:27:40<5:31:17,  7.75s/it]
 93%|█████████▎| 35399/37963 [80:27:48<5:30:54,  7.74s/it]
 93%|█████████▎| 35400/37963 [80:27:55<5:31:34,  7.76s/it]
                                                          
{'loss': '0.08707', 'grad_norm': '2.863', 'learning_rate': '2.383e-07', 'epoch': '0.9325'}
+
 93%|█████████▎| 35400/37963 [80:27:55<5:31:34,  7.76s/it]
 93%|█████████▎| 35401/37963 [80:28:03<5:29:53,  7.73s/it]
 93%|█████████▎| 35402/37963 [80:28:11<5:32:34,  7.79s/it]
 93%|█████████▎| 35403/37963 [80:28:19<5:29:46,  7.73s/it]
 93%|█████████▎| 35404/37963 [80:28:26<5:27:48,  7.69s/it]
 93%|█████████▎| 35405/37963 [80:28:34<5:27:25,  7.68s/it]
 93%|█████████▎| 35406/37963 [80:28:42<5:28:52,  7.72s/it]
 93%|█████████▎| 35407/37963 [80:28:49<5:27:48,  7.70s/it]
 93%|█████████▎| 35408/37963 [80:28:57<5:29:54,  7.75s/it]
 93%|█████████▎| 35409/37963 [80:29:05<5:32:09,  7.80s/it]
 93%|█████████▎| 35410/37963 [80:29:13<5:31:10,  7.78s/it]
                                                          
{'loss': '0.0957', 'grad_norm': '4.085', 'learning_rate': '2.364e-07', 'epoch': '0.9328'}
+
 93%|█████████▎| 35410/37963 [80:29:13<5:31:10,  7.78s/it]
 93%|█████████▎| 35411/37963 [80:29:20<5:27:11,  7.69s/it]
 93%|█████████▎| 35412/37963 [80:29:31<6:01:12,  8.50s/it]
 93%|█████████▎| 35413/37963 [80:29:39<5:56:05,  8.38s/it]
 93%|█████████▎| 35414/37963 [80:29:49<6:20:18,  8.95s/it]
 93%|█████████▎| 35415/37963 [80:29:57<6:05:44,  8.61s/it]
 93%|█████████▎| 35416/37963 [80:30:07<6:28:24,  9.15s/it]
 93%|█████████▎| 35417/37963 [80:30:15<6:10:13,  8.73s/it]
 93%|█████████▎| 35418/37963 [80:30:23<5:58:55,  8.46s/it]
 93%|█████████▎| 35419/37963 [80:30:36<6:58:21,  9.87s/it]
 93%|█████████▎| 35420/37963 [80:30:44<6:35:31,  9.33s/it]
                                                          
{'loss': '0.09575', 'grad_norm': '3.727', 'learning_rate': '2.346e-07', 'epoch': '0.933'}
+
 93%|█████████▎| 35420/37963 [80:30:44<6:35:31,  9.33s/it]
 93%|█████████▎| 35421/37963 [80:30:52<6:11:24,  8.77s/it]
 93%|█████████▎| 35422/37963 [80:30:59<5:57:16,  8.44s/it]
 93%|█████████▎| 35423/37963 [80:31:07<5:49:00,  8.24s/it]
 93%|█████████▎| 35424/37963 [80:31:17<6:13:52,  8.84s/it]
 93%|█████████▎| 35425/37963 [80:31:25<6:00:22,  8.52s/it]
 93%|█████████▎| 35426/37963 [80:31:35<6:24:11,  9.09s/it]
 93%|█████████▎| 35427/37963 [80:31:43<6:07:19,  8.69s/it]
 93%|█████████▎| 35428/37963 [80:31:51<5:56:18,  8.43s/it]
 93%|█████████▎| 35429/37963 [80:31:59<5:48:04,  8.24s/it]
 93%|█████████▎| 35430/37963 [80:32:06<5:37:23,  7.99s/it]
                                                          
{'loss': '0.09073', 'grad_norm': '2.47', 'learning_rate': '2.328e-07', 'epoch': '0.9333'}
+
 93%|█████████▎| 35430/37963 [80:32:06<5:37:23,  7.99s/it]
 93%|█████████▎| 35431/37963 [80:32:14<5:35:34,  7.95s/it]
 93%|█████████▎| 35432/37963 [80:32:22<5:33:33,  7.91s/it]
 93%|█████████▎| 35433/37963 [80:32:30<5:33:04,  7.90s/it]
 93%|█████████▎| 35434/37963 [80:32:38<5:31:19,  7.86s/it]
 93%|█████████▎| 35435/37963 [80:32:45<5:27:54,  7.78s/it]
 93%|█████████▎| 35436/37963 [80:32:53<5:25:37,  7.73s/it]
 93%|█████████▎| 35437/37963 [80:33:00<5:23:22,  7.68s/it]
 93%|█████████▎| 35438/37963 [80:33:08<5:23:37,  7.69s/it]
 93%|█████████▎| 35439/37963 [80:33:16<5:25:35,  7.74s/it]
 93%|█████████▎| 35440/37963 [80:33:24<5:27:39,  7.79s/it]
                                                          
{'loss': '0.0834', 'grad_norm': '2.917', 'learning_rate': '2.309e-07', 'epoch': '0.9335'}
+
 93%|█████████▎| 35440/37963 [80:33:24<5:27:39,  7.79s/it]
 93%|█████████▎| 35441/37963 [80:33:35<6:04:52,  8.68s/it]
 93%|█████████▎| 35442/37963 [80:33:42<5:51:58,  8.38s/it]
 93%|█████████▎| 35443/37963 [80:33:50<5:41:35,  8.13s/it]
 93%|█████████▎| 35444/37963 [80:33:57<5:34:33,  7.97s/it]
 93%|█████████▎| 35445/37963 [80:34:05<5:33:38,  7.95s/it]
 93%|█████████▎| 35446/37963 [80:34:13<5:31:35,  7.90s/it]
 93%|█████████▎| 35447/37963 [80:34:21<5:30:53,  7.89s/it]
 93%|█████████▎| 35448/37963 [80:34:29<5:30:09,  7.88s/it]
 93%|█████████▎| 35449/37963 [80:34:36<5:26:03,  7.78s/it]
 93%|█████████▎| 35450/37963 [80:34:44<5:26:00,  7.78s/it]
                                                          
{'loss': '0.07447', 'grad_norm': '5.066', 'learning_rate': '2.291e-07', 'epoch': '0.9338'}
+
 93%|█████████▎| 35450/37963 [80:34:44<5:26:00,  7.78s/it]
 93%|█████████▎| 35451/37963 [80:34:52<5:24:54,  7.76s/it]
 93%|█████████▎| 35452/37963 [80:35:00<5:27:33,  7.83s/it]
 93%|█████████▎| 35453/37963 [80:35:07<5:23:36,  7.74s/it]
 93%|█████████▎| 35454/37963 [80:35:15<5:25:33,  7.79s/it]
 93%|█████████▎| 35455/37963 [80:35:23<5:25:14,  7.78s/it]
 93%|█████████▎| 35456/37963 [80:35:33<5:57:14,  8.55s/it]
 93%|█████████▎| 35457/37963 [80:35:41<5:48:51,  8.35s/it]
 93%|█████████▎| 35458/37963 [80:35:49<5:42:18,  8.20s/it]
 93%|█████████▎| 35459/37963 [80:35:57<5:35:46,  8.05s/it]
 93%|█████████▎| 35460/37963 [80:36:07<6:07:38,  8.81s/it]
                                                          
{'loss': '0.07956', 'grad_norm': '3.481', 'learning_rate': '2.273e-07', 'epoch': '0.9341'}
+
 93%|█████████▎| 35460/37963 [80:36:07<6:07:38,  8.81s/it]
 93%|█████████▎| 35461/37963 [80:36:15<5:56:55,  8.56s/it]
 93%|█████████▎| 35462/37963 [80:36:26<6:20:31,  9.13s/it]
 93%|█████████▎| 35463/37963 [80:36:34<6:03:53,  8.73s/it]
 93%|█████████▎| 35464/37963 [80:36:42<5:54:10,  8.50s/it]
 93%|█████████▎| 35465/37963 [80:36:49<5:43:19,  8.25s/it]
 93%|█████████▎| 35466/37963 [80:36:59<6:07:48,  8.84s/it]
 93%|█████████▎| 35467/37963 [80:37:10<6:24:02,  9.23s/it]
 93%|█████████▎| 35468/37963 [80:37:17<5:59:38,  8.65s/it]
 93%|█████████▎| 35469/37963 [80:37:24<5:46:48,  8.34s/it]
 93%|█████████▎| 35470/37963 [80:37:32<5:34:12,  8.04s/it]
                                                          
{'loss': '0.09397', 'grad_norm': '4.346', 'learning_rate': '2.255e-07', 'epoch': '0.9343'}
+
 93%|█████████▎| 35470/37963 [80:37:32<5:34:12,  8.04s/it]
 93%|█████████▎| 35471/37963 [80:37:39<5:24:21,  7.81s/it]
 93%|█████████▎| 35472/37963 [80:37:47<5:26:46,  7.87s/it]
 93%|█████████▎| 35473/37963 [80:37:55<5:26:53,  7.88s/it]
 93%|█████████▎| 35474/37963 [80:38:03<5:25:10,  7.84s/it]
 93%|█████████▎| 35475/37963 [80:38:11<5:25:19,  7.85s/it]
 93%|█████████▎| 35476/37963 [80:38:18<5:22:15,  7.77s/it]
 93%|█████████▎| 35477/37963 [80:38:29<5:56:32,  8.60s/it]
 93%|█████████▎| 35478/37963 [80:38:39<6:16:41,  9.10s/it]
 93%|█████████▎| 35479/37963 [80:38:47<5:59:10,  8.68s/it]
 93%|█████████▎| 35480/37963 [80:38:55<5:48:17,  8.42s/it]
                                                          
{'loss': '0.07824', 'grad_norm': '3.993', 'learning_rate': '2.237e-07', 'epoch': '0.9346'}
+
 93%|█████████▎| 35480/37963 [80:38:55<5:48:17,  8.42s/it]
 93%|█████████▎| 35481/37963 [80:39:02<5:42:25,  8.28s/it]
 93%|█████████▎| 35482/37963 [80:39:10<5:35:47,  8.12s/it]
 93%|█████████▎| 35483/37963 [80:39:18<5:27:50,  7.93s/it]
 93%|█████████▎| 35484/37963 [80:39:25<5:23:18,  7.83s/it]
 93%|█████████▎| 35485/37963 [80:39:33<5:21:44,  7.79s/it]
 93%|█████████▎| 35486/37963 [80:39:41<5:20:29,  7.76s/it]
 93%|█████████▎| 35487/37963 [80:39:48<5:19:30,  7.74s/it]
 93%|█████████▎| 35488/37963 [80:39:56<5:15:03,  7.64s/it]
 93%|█████████▎| 35489/37963 [80:40:06<5:50:39,  8.50s/it]
 93%|█████████▎| 35490/37963 [80:40:14<5:43:45,  8.34s/it]
                                                          
{'loss': '0.0823', 'grad_norm': '5.266', 'learning_rate': '2.219e-07', 'epoch': '0.9349'}
+
 93%|█████████▎| 35490/37963 [80:40:14<5:43:45,  8.34s/it]
 93%|█████████▎| 35491/37963 [80:40:22<5:37:35,  8.19s/it]
 93%|█████████▎| 35492/37963 [80:40:30<5:30:43,  8.03s/it]
 93%|█████████▎| 35493/37963 [80:40:37<5:23:54,  7.87s/it]
 93%|█████████▎| 35494/37963 [80:40:45<5:21:33,  7.81s/it]
 93%|█████████▎| 35495/37963 [80:40:53<5:19:15,  7.76s/it]
 94%|█████████▎| 35496/37963 [80:41:00<5:19:29,  7.77s/it]
 94%|█████████▎| 35497/37963 [80:41:08<5:19:27,  7.77s/it]
 94%|█████████▎| 35498/37963 [80:41:16<5:21:42,  7.83s/it]
 94%|█████████▎| 35499/37963 [80:41:24<5:19:32,  7.78s/it]
 94%|█████████▎| 35500/37963 [80:41:31<5:18:22,  7.76s/it]
                                                          
{'loss': '0.08089', 'grad_norm': '2.684', 'learning_rate': '2.201e-07', 'epoch': '0.9351'}
+
 94%|█████████▎| 35500/37963 [80:41:31<5:18:22,  7.76s/it]
 94%|█████████▎| 35501/37963 [80:41:39<5:17:09,  7.73s/it]
 94%|█████████▎| 35502/37963 [80:41:47<5:14:43,  7.67s/it]
 94%|█████████▎| 35503/37963 [80:41:55<5:18:00,  7.76s/it]
 94%|█████████▎| 35504/37963 [80:42:03<5:19:12,  7.79s/it]
 94%|█████████▎| 35505/37963 [80:42:11<5:21:59,  7.86s/it]
 94%|█████████▎| 35506/37963 [80:42:18<5:21:43,  7.86s/it]
 94%|█████████▎| 35507/37963 [80:42:26<5:19:46,  7.81s/it]
 94%|█████████▎| 35508/37963 [80:42:34<5:19:00,  7.80s/it]
 94%|█████████▎| 35509/37963 [80:42:44<5:49:06,  8.54s/it]
 94%|█████████▎| 35510/37963 [80:42:55<6:14:40,  9.16s/it]
                                                          
{'loss': '0.08644', 'grad_norm': '3.227', 'learning_rate': '2.184e-07', 'epoch': '0.9354'}
+
 94%|█████████▎| 35510/37963 [80:42:55<6:14:40,  9.16s/it]
 94%|█████████▎| 35511/37963 [80:43:03<5:59:50,  8.81s/it]
 94%|█████████▎| 35512/37963 [80:43:10<5:46:54,  8.49s/it]
 94%|█████████▎| 35513/37963 [80:43:18<5:37:56,  8.28s/it]
 94%|█████████▎| 35514/37963 [80:43:29<6:05:44,  8.96s/it]
 94%|█████████▎| 35515/37963 [80:43:39<6:24:34,  9.43s/it]
 94%|█████████▎| 35516/37963 [80:43:47<6:07:00,  9.00s/it]
 94%|█████████▎| 35517/37963 [80:43:58<6:22:49,  9.39s/it]
 94%|█████████▎| 35518/37963 [80:44:06<6:08:03,  9.03s/it]
 94%|█████████▎| 35519/37963 [80:44:14<5:52:34,  8.66s/it]
 94%|█████████▎| 35520/37963 [80:44:21<5:40:14,  8.36s/it]
                                                          
{'loss': '0.08218', 'grad_norm': '2.777', 'learning_rate': '2.166e-07', 'epoch': '0.9357'}
+
 94%|█████████▎| 35520/37963 [80:44:21<5:40:14,  8.36s/it]
 94%|█████████▎| 35521/37963 [80:44:29<5:34:37,  8.22s/it]
 94%|█████████▎| 35522/37963 [80:44:37<5:29:49,  8.11s/it]
 94%|█████████▎| 35523/37963 [80:44:45<5:25:56,  8.01s/it]
 94%|█████████▎| 35524/37963 [80:44:53<5:24:23,  7.98s/it]
 94%|█████████▎| 35525/37963 [80:45:01<5:23:02,  7.95s/it]
 94%|█████████▎| 35526/37963 [80:45:08<5:15:50,  7.78s/it]
 94%|█████████▎| 35527/37963 [80:45:15<5:11:06,  7.66s/it]
 94%|█████████▎| 35528/37963 [80:45:23<5:12:35,  7.70s/it]
 94%|█████████▎| 35529/37963 [80:45:31<5:14:56,  7.76s/it]
 94%|█████████▎| 35530/37963 [80:45:39<5:15:12,  7.77s/it]
                                                          
{'loss': '0.07848', 'grad_norm': '3.69', 'learning_rate': '2.148e-07', 'epoch': '0.9359'}
+
 94%|█████████▎| 35530/37963 [80:45:39<5:15:12,  7.77s/it]
 94%|█████████▎| 35531/37963 [80:45:49<5:49:28,  8.62s/it]
 94%|█████████▎| 35532/37963 [80:46:00<6:09:38,  9.12s/it]
 94%|█████████▎| 35533/37963 [80:46:07<5:50:33,  8.66s/it]
 94%|█████████▎| 35534/37963 [80:46:15<5:33:08,  8.23s/it]
 94%|█████████▎| 35535/37963 [80:46:22<5:26:37,  8.07s/it]
 94%|█████████▎| 35536/37963 [80:46:30<5:22:58,  7.98s/it]
 94%|█████████▎| 35537/37963 [80:46:41<5:53:44,  8.75s/it]
 94%|█████████▎| 35538/37963 [80:46:48<5:37:16,  8.34s/it]
 94%|█████████▎| 35539/37963 [80:46:56<5:30:04,  8.17s/it]
 94%|█████████▎| 35540/37963 [80:47:03<5:24:23,  8.03s/it]
                                                          
{'loss': '0.08125', 'grad_norm': '2.979', 'learning_rate': '2.131e-07', 'epoch': '0.9362'}
+
 94%|█████████▎| 35540/37963 [80:47:03<5:24:23,  8.03s/it]
 94%|█████████▎| 35541/37963 [80:47:11<5:22:53,  8.00s/it]
 94%|█████████▎| 35542/37963 [80:47:19<5:18:06,  7.88s/it]
 94%|█████████▎| 35543/37963 [80:47:27<5:16:07,  7.84s/it]
 94%|█████████▎| 35544/37963 [80:47:34<5:15:24,  7.82s/it]
 94%|█████████▎| 35545/37963 [80:47:42<5:13:26,  7.78s/it]
 94%|█████████▎| 35546/37963 [80:47:50<5:09:23,  7.68s/it]
 94%|█████████▎| 35547/37963 [80:47:57<5:07:37,  7.64s/it]
 94%|█████████▎| 35548/37963 [80:48:05<5:04:11,  7.56s/it]
 94%|█████████▎| 35549/37963 [80:48:12<5:07:58,  7.65s/it]
 94%|█████████▎| 35550/37963 [80:48:20<5:06:00,  7.61s/it]
                                                          
{'loss': '0.0869', 'grad_norm': '2.552', 'learning_rate': '2.113e-07', 'epoch': '0.9364'}
+
 94%|█████████▎| 35550/37963 [80:48:20<5:06:00,  7.61s/it]
 94%|█████████▎| 35551/37963 [80:48:28<5:09:05,  7.69s/it]
 94%|█████████▎| 35552/37963 [80:48:36<5:09:31,  7.70s/it]
 94%|█████████▎| 35553/37963 [80:48:43<5:10:27,  7.73s/it]
 94%|█████████▎| 35554/37963 [80:48:51<5:10:46,  7.74s/it]
 94%|█████████▎| 35555/37963 [80:49:02<5:46:16,  8.63s/it]
 94%|█████████▎| 35556/37963 [80:49:09<5:33:00,  8.30s/it]
 94%|█████████▎| 35557/37963 [80:49:17<5:29:19,  8.21s/it]
 94%|█████████▎| 35558/37963 [80:49:28<5:54:49,  8.85s/it]
 94%|█████████▎| 35559/37963 [80:49:38<6:11:49,  9.28s/it]
 94%|█████████▎| 35560/37963 [80:49:49<6:28:51,  9.71s/it]
                                                          
{'loss': '0.08685', 'grad_norm': '4.187', 'learning_rate': '2.096e-07', 'epoch': '0.9367'}
+
 94%|█████████▎| 35560/37963 [80:49:49<6:28:51,  9.71s/it]
 94%|█████████▎| 35561/37963 [80:49:56<6:01:48,  9.04s/it]
 94%|█████████▎| 35562/37963 [80:50:04<5:44:58,  8.62s/it]
 94%|█████████▎| 35563/37963 [80:50:11<5:33:10,  8.33s/it]
 94%|█████████▎| 35564/37963 [80:50:19<5:25:21,  8.14s/it]
 94%|█████████▎| 35565/37963 [80:50:27<5:20:07,  8.01s/it]
 94%|█████████▎| 35566/37963 [80:50:35<5:17:51,  7.96s/it]
 94%|█████████▎| 35567/37963 [80:50:42<5:16:10,  7.92s/it]
 94%|█████████▎| 35568/37963 [80:50:50<5:13:40,  7.86s/it]
 94%|█████████▎| 35569/37963 [80:50:58<5:09:14,  7.75s/it]
 94%|█████████▎| 35570/37963 [80:51:08<5:38:44,  8.49s/it]
                                                          
{'loss': '0.07831', 'grad_norm': '3.38', 'learning_rate': '2.078e-07', 'epoch': '0.937'}
+
 94%|█████████▎| 35570/37963 [80:51:08<5:38:44,  8.49s/it]
 94%|█████████▎| 35571/37963 [80:51:16<5:32:16,  8.33s/it]
 94%|█████████▎| 35572/37963 [80:51:23<5:23:05,  8.11s/it]
 94%|█████████▎| 35573/37963 [80:51:31<5:16:29,  7.95s/it]
 94%|█████████▎| 35574/37963 [80:51:39<5:12:23,  7.85s/it]
 94%|█████████▎| 35575/37963 [80:51:46<5:09:10,  7.77s/it]
 94%|█████████▎| 35576/37963 [80:51:59<6:14:13,  9.41s/it]
 94%|█████████▎| 35577/37963 [80:52:07<5:54:50,  8.92s/it]
 94%|█████████▎| 35578/37963 [80:52:15<5:38:38,  8.52s/it]
 94%|█████████▎| 35579/37963 [80:52:23<5:28:37,  8.27s/it]
 94%|█████████▎| 35580/37963 [80:52:30<5:21:14,  8.09s/it]
                                                          
{'loss': '0.07716', 'grad_norm': '3.737', 'learning_rate': '2.061e-07', 'epoch': '0.9372'}
+
 94%|█████████▎| 35580/37963 [80:52:30<5:21:14,  8.09s/it]
 94%|█████████▎| 35581/37963 [80:52:41<5:51:29,  8.85s/it]
 94%|█████████▎| 35582/37963 [80:52:49<5:38:40,  8.53s/it]
 94%|█████████▎| 35583/37963 [80:52:56<5:29:52,  8.32s/it]
 94%|█████████▎| 35584/37963 [80:53:04<5:24:03,  8.17s/it]
 94%|█████████▎| 35585/37963 [80:53:12<5:22:09,  8.13s/it]
 94%|█████████▎| 35586/37963 [80:53:20<5:16:47,  8.00s/it]
 94%|█████████▎| 35587/37963 [80:53:28<5:14:25,  7.94s/it]
 94%|█████████▎| 35588/37963 [80:53:36<5:14:40,  7.95s/it]
 94%|█████████▎| 35589/37963 [80:53:43<5:11:29,  7.87s/it]
 94%|█████████▎| 35590/37963 [80:53:51<5:09:18,  7.82s/it]
                                                          
{'loss': '0.08545', 'grad_norm': '2.88', 'learning_rate': '2.044e-07', 'epoch': '0.9375'}
+
 94%|█████████▎| 35590/37963 [80:53:51<5:09:18,  7.82s/it]
 94%|█████████▍| 35591/37963 [80:53:59<5:09:19,  7.82s/it]
 94%|█████████▍| 35592/37963 [80:54:07<5:07:02,  7.77s/it]
 94%|█████████▍| 35593/37963 [80:54:14<5:04:43,  7.71s/it]
 94%|█████████▍| 35594/37963 [80:54:22<5:05:00,  7.72s/it]
 94%|█████████▍| 35595/37963 [80:54:30<5:04:11,  7.71s/it]
 94%|█████████▍| 35596/37963 [80:54:38<5:07:42,  7.80s/it]
 94%|█████████▍| 35597/37963 [80:54:45<5:07:28,  7.80s/it]
 94%|█████████▍| 35598/37963 [80:54:53<5:04:00,  7.71s/it]
 94%|█████████▍| 35599/37963 [80:55:01<5:06:15,  7.77s/it]
 94%|█████████▍| 35600/37963 [80:55:09<5:04:52,  7.74s/it]
                                                          
{'loss': '0.0832', 'grad_norm': '3.351', 'learning_rate': '2.027e-07', 'epoch': '0.9378'}
+
 94%|█████████▍| 35600/37963 [80:55:09<5:04:52,  7.74s/it]
 94%|█████████▍| 35601/37963 [80:55:16<5:03:51,  7.72s/it]
 94%|█████████▍| 35602/37963 [80:55:27<5:36:49,  8.56s/it]
 94%|█████████▍| 35603/37963 [80:55:37<5:58:37,  9.12s/it]
 94%|█████████▍| 35604/37963 [80:55:45<5:42:14,  8.70s/it]
 94%|█████████▍| 35605/37963 [80:55:53<5:30:05,  8.40s/it]
 94%|█████████▍| 35606/37963 [80:56:00<5:21:37,  8.19s/it]
 94%|█████████▍| 35607/37963 [80:56:08<5:14:42,  8.01s/it]
 94%|█████████▍| 35608/37963 [80:56:18<5:45:07,  8.79s/it]
 94%|█████████▍| 35609/37963 [80:56:29<6:04:40,  9.29s/it]
 94%|█████████▍| 35610/37963 [80:56:37<5:45:54,  8.82s/it]
                                                          
{'loss': '0.08506', 'grad_norm': '3.302', 'learning_rate': '2.01e-07', 'epoch': '0.938'}
+
 94%|████��████▍| 35610/37963 [80:56:37<5:45:54,  8.82s/it]
 94%|█████████▍| 35611/37963 [80:56:44<5:33:39,  8.51s/it]
 94%|█████████▍| 35612/37963 [80:56:52<5:18:45,  8.13s/it]
 94%|█████████▍| 35613/37963 [80:57:00<5:15:03,  8.04s/it]
 94%|█████████▍| 35614/37963 [80:57:07<5:13:12,  8.00s/it]
 94%|█████████▍| 35615/37963 [80:57:15<5:09:58,  7.92s/it]
 94%|█████████▍| 35616/37963 [80:57:23<5:09:10,  7.90s/it]
 94%|█████████▍| 35617/37963 [80:57:31<5:09:34,  7.92s/it]
 94%|█████████▍| 35618/37963 [80:57:41<5:36:08,  8.60s/it]
 94%|█████████▍| 35619/37963 [80:57:52<5:58:01,  9.16s/it]
 94%|█████████▍| 35620/37963 [80:58:02<6:10:27,  9.49s/it]
                                                          
{'loss': '0.08741', 'grad_norm': '3.967', 'learning_rate': '1.993e-07', 'epoch': '0.9383'}
+
 94%|█████████▍| 35620/37963 [80:58:02<6:10:27,  9.49s/it]
 94%|█████████▍| 35621/37963 [80:58:10<5:52:30,  9.03s/it]
 94%|█████████▍| 35622/37963 [80:58:18<5:36:46,  8.63s/it]
 94%|█████████▍| 35623/37963 [80:58:25<5:23:12,  8.29s/it]
 94%|█████████▍| 35624/37963 [80:58:33<5:18:15,  8.16s/it]
 94%|█████████▍| 35625/37963 [80:58:41<5:15:14,  8.09s/it]
 94%|█████████▍| 35626/37963 [80:58:49<5:11:04,  7.99s/it]
 94%|█████████▍| 35627/37963 [80:58:56<5:09:07,  7.94s/it]
 94%|█████████▍| 35628/37963 [80:59:04<5:07:32,  7.90s/it]
 94%|█████████▍| 35629/37963 [80:59:15<5:37:13,  8.67s/it]
 94%|█████████▍| 35630/37963 [80:59:22<5:26:46,  8.40s/it]
                                                          
{'loss': '0.08078', 'grad_norm': '2.934', 'learning_rate': '1.976e-07', 'epoch': '0.9385'}
+
 94%|█████████▍| 35630/37963 [80:59:22<5:26:46,  8.40s/it]
 94%|█████████▍| 35631/37963 [80:59:30<5:17:15,  8.16s/it]
 94%|█████████▍| 35632/37963 [80:59:38<5:11:26,  8.02s/it]
 94%|█████████▍| 35633/37963 [80:59:46<5:10:02,  7.98s/it]
 94%|█████████▍| 35634/37963 [80:59:53<5:07:43,  7.93s/it]
 94%|█████████▍| 35635/37963 [81:00:02<5:08:52,  7.96s/it]
 94%|█████████▍| 35636/37963 [81:00:09<5:07:12,  7.92s/it]
 94%|█████████▍| 35637/37963 [81:00:17<5:06:24,  7.90s/it]
 94%|█████████▍| 35638/37963 [81:00:25<5:03:53,  7.84s/it]
 94%|█████████▍| 35639/37963 [81:00:33<5:01:37,  7.79s/it]
 94%|█████████▍| 35640/37963 [81:00:40<4:59:38,  7.74s/it]
                                                          
{'loss': '0.08097', 'grad_norm': '3.643', 'learning_rate': '1.959e-07', 'epoch': '0.9388'}
+
 94%|█████████▍| 35640/37963 [81:00:40<4:59:38,  7.74s/it]
 94%|█████████▍| 35641/37963 [81:00:48<4:58:32,  7.71s/it]
 94%|█████████▍| 35642/37963 [81:00:56<5:00:28,  7.77s/it]
 94%|█████████▍| 35643/37963 [81:01:04<5:02:02,  7.81s/it]
 94%|█████████▍| 35644/37963 [81:01:11<5:01:37,  7.80s/it]
 94%|█████████▍| 35645/37963 [81:01:19<4:55:12,  7.64s/it]
 94%|█████████▍| 35646/37963 [81:01:29<5:31:10,  8.58s/it]
 94%|█████████▍| 35647/37963 [81:01:37<5:21:45,  8.34s/it]
 94%|█████████▍| 35648/37963 [81:01:45<5:17:02,  8.22s/it]
 94%|█████████▍| 35649/37963 [81:01:53<5:10:44,  8.06s/it]
 94%|█████████▍| 35650/37963 [81:02:01<5:07:27,  7.98s/it]
                                                          
{'loss': '0.08839', 'grad_norm': '3.105', 'learning_rate': '1.942e-07', 'epoch': '0.9391'}
+
 94%|█████████▍| 35650/37963 [81:02:01<5:07:27,  7.98s/it]
 94%|█████████▍| 35651/37963 [81:02:11<5:35:53,  8.72s/it]
 94%|█████████▍| 35652/37963 [81:02:21<5:50:03,  9.09s/it]
 94%|█████████▍| 35653/37963 [81:02:29<5:33:28,  8.66s/it]
 94%|█████████▍| 35654/37963 [81:02:37<5:23:44,  8.41s/it]
 94%|█████████▍| 35655/37963 [81:02:44<5:14:48,  8.18s/it]
 94%|█████████▍| 35656/37963 [81:02:52<5:09:40,  8.05s/it]
 94%|█████████▍| 35657/37963 [81:03:02<5:35:43,  8.74s/it]
 94%|█████████▍| 35658/37963 [81:03:10<5:23:56,  8.43s/it]
 94%|█████████▍| 35659/37963 [81:03:18<5:17:45,  8.28s/it]
 94%|█████████▍| 35660/37963 [81:03:25<5:09:54,  8.07s/it]
                                                          
{'loss': '0.08854', 'grad_norm': '3.329', 'learning_rate': '1.926e-07', 'epoch': '0.9393'}
+
 94%|█████████��| 35660/37963 [81:03:25<5:09:54,  8.07s/it]
 94%|█████████▍| 35661/37963 [81:03:33<5:06:19,  7.98s/it]
 94%|█████████▍| 35662/37963 [81:03:41<5:03:20,  7.91s/it]
 94%|█████████▍| 35663/37963 [81:03:49<5:03:33,  7.92s/it]
 94%|█████████▍| 35664/37963 [81:03:59<5:31:19,  8.65s/it]
 94%|█████████▍| 35665/37963 [81:04:07<5:21:08,  8.38s/it]
 94%|█████████▍| 35666/37963 [81:04:15<5:14:27,  8.21s/it]
 94%|█████████▍| 35667/37963 [81:04:23<5:09:31,  8.09s/it]
 94%|█████████▍| 35668/37963 [81:04:30<5:04:18,  7.96s/it]
 94%|█████████▍| 35669/37963 [81:04:38<5:01:45,  7.89s/it]
 94%|█████████▍| 35670/37963 [81:04:46<5:00:16,  7.86s/it]
                                                          
{'loss': '0.08186', 'grad_norm': '3.577', 'learning_rate': '1.909e-07', 'epoch': '0.9396'}
+
 94%|█████████▍| 35670/37963 [81:04:46<5:00:16,  7.86s/it]
 94%|█████████▍| 35671/37963 [81:04:54<4:58:25,  7.81s/it]
 94%|█████████▍| 35672/37963 [81:05:04<5:29:13,  8.62s/it]
 94%|█████████▍| 35673/37963 [81:05:14<5:45:39,  9.06s/it]
 94%|█████████▍| 35674/37963 [81:05:22<5:32:34,  8.72s/it]
 94%|█████████▍| 35675/37963 [81:05:30<5:22:11,  8.45s/it]
 94%|█████████▍| 35676/37963 [81:05:38<5:14:02,  8.24s/it]
 94%|█████████▍| 35677/37963 [81:05:48<5:37:36,  8.86s/it]
 94%|█████████▍| 35678/37963 [81:05:56<5:25:26,  8.55s/it]
 94%|█████████▍| 35679/37963 [81:06:03<5:15:40,  8.29s/it]
 94%|█████████▍| 35680/37963 [81:06:11<5:09:48,  8.14s/it]
                                                          
{'loss': '0.08817', 'grad_norm': '3.128', 'learning_rate': '1.892e-07', 'epoch': '0.9399'}
+
 94%|█████████▍| 35680/37963 [81:06:11<5:09:48,  8.14s/it]
 94%|█████████▍| 35681/37963 [81:06:19<5:05:45,  8.04s/it]
 94%|█████████▍| 35682/37963 [81:06:27<5:00:26,  7.90s/it]
 94%|█████████▍| 35683/37963 [81:06:34<4:56:59,  7.82s/it]
 94%|█████████▍| 35684/37963 [81:06:42<4:56:27,  7.81s/it]
 94%|█████████▍| 35685/37963 [81:06:50<4:57:08,  7.83s/it]
 94%|█████████▍| 35686/37963 [81:06:58<4:57:47,  7.85s/it]
 94%|█████████▍| 35687/37963 [81:07:06<4:56:37,  7.82s/it]
 94%|█████████▍| 35688/37963 [81:07:13<4:57:56,  7.86s/it]
 94%|█████████▍| 35689/37963 [81:07:24<5:27:30,  8.64s/it]
 94%|█████████▍| 35690/37963 [81:07:32<5:17:57,  8.39s/it]
                                                          
{'loss': '0.09114', 'grad_norm': '3.798', 'learning_rate': '1.876e-07', 'epoch': '0.9401'}
+
 94%|█████████▍| 35690/37963 [81:07:32<5:17:57,  8.39s/it]
 94%|█████████▍| 35691/37963 [81:07:40<5:12:07,  8.24s/it]
 94%|█████████▍| 35692/37963 [81:07:47<5:06:18,  8.09s/it]
 94%|█████████▍| 35693/37963 [81:07:55<5:01:22,  7.97s/it]
 94%|█████████▍| 35694/37963 [81:08:03<4:56:07,  7.83s/it]
 94%|█████████▍| 35695/37963 [81:08:13<5:26:01,  8.62s/it]
 94%|█████████▍| 35696/37963 [81:08:21<5:13:02,  8.29s/it]
 94%|█████████▍| 35697/37963 [81:08:28<5:06:55,  8.13s/it]
 94%|█████████▍| 35698/37963 [81:08:36<5:03:00,  8.03s/it]
 94%|█████████▍| 35699/37963 [81:08:44<4:59:04,  7.93s/it]
 94%|█████████▍| 35700/37963 [81:08:52<4:56:53,  7.87s/it]
                                                          
{'loss': '0.09361', 'grad_norm': '3.966', 'learning_rate': '1.86e-07', 'epoch': '0.9404'}
+
 94%|█████████▍| 35700/37963 [81:08:52<4:56:53,  7.87s/it]
 94%|█████████▍| 35701/37963 [81:09:04<5:51:22,  9.32s/it]
 94%|█████████▍| 35702/37963 [81:09:12<5:32:58,  8.84s/it]
 94%|█████████▍| 35703/37963 [81:09:20<5:21:30,  8.54s/it]
 94%|█████████▍| 35704/37963 [81:09:28<5:12:36,  8.30s/it]
 94%|█████████▍| 35705/37963 [81:09:35<5:05:20,  8.11s/it]
 94%|█████████▍| 35706/37963 [81:09:43<4:56:56,  7.89s/it]
 94%|█████████▍| 35707/37963 [81:09:53<5:25:53,  8.67s/it]
 94%|█████████▍| 35708/37963 [81:10:01<5:12:29,  8.31s/it]
 94%|█████████▍| 35709/37963 [81:10:08<5:04:10,  8.10s/it]
 94%|█████████▍| 35710/37963 [81:10:16<5:02:27,  8.05s/it]
                                                          
{'loss': '0.09372', 'grad_norm': '3.689', 'learning_rate': '1.843e-07', 'epoch': '0.9407'}
+
 94%|█████████▍| 35710/37963 [81:10:16<5:02:27,  8.05s/it]
 94%|█████████▍| 35711/37963 [81:10:24<5:00:26,  8.00s/it]
 94%|█████████▍| 35712/37963 [81:10:32<5:00:25,  8.01s/it]
 94%|█████████▍| 35713/37963 [81:10:40<4:57:46,  7.94s/it]
 94%|█████████▍| 35714/37963 [81:10:48<4:58:05,  7.95s/it]
 94%|█████████▍| 35715/37963 [81:10:56<4:56:56,  7.93s/it]
 94%|█████████▍| 35716/37963 [81:11:03<4:53:45,  7.84s/it]
 94%|█████████▍| 35717/37963 [81:11:11<4:56:32,  7.92s/it]
 94%|█████████▍| 35718/37963 [81:11:19<4:54:30,  7.87s/it]
 94%|█████████▍| 35719/37963 [81:11:27<4:53:36,  7.85s/it]
 94%|█████████▍| 35720/37963 [81:11:37<5:18:09,  8.51s/it]
                                                          
{'loss': '0.07305', 'grad_norm': '2.729', 'learning_rate': '1.827e-07', 'epoch': '0.9409'}
+
 94%|█████████▍| 35720/37963 [81:11:37<5:18:09,  8.51s/it]
 94%|█████████▍| 35721/37963 [81:11:48<5:42:41,  9.17s/it]
 94%|█████████▍| 35722/37963 [81:11:56<5:27:25,  8.77s/it]
 94%|█████████▍| 35723/37963 [81:12:03<5:15:27,  8.45s/it]
 94%|█████████▍| 35724/37963 [81:12:11<5:06:52,  8.22s/it]
 94%|█████████▍| 35725/37963 [81:12:19<5:01:19,  8.08s/it]
 94%|█████████▍| 35726/37963 [81:12:26<4:55:53,  7.94s/it]
 94%|█████████▍| 35727/37963 [81:12:36<5:20:51,  8.61s/it]
 94%|█████████▍| 35728/37963 [81:12:44<5:11:09,  8.35s/it]
 94%|█████████▍| 35729/37963 [81:12:52<5:02:55,  8.14s/it]
 94%|█████████▍| 35730/37963 [81:13:00<4:57:51,  8.00s/it]
                                                          
{'loss': '0.08371', 'grad_norm': '3.366', 'learning_rate': '1.811e-07', 'epoch': '0.9412'}
+
 94%|█████████▍| 35730/37963 [81:13:00<4:57:51,  8.00s/it]
 94%|█████████▍| 35731/37963 [81:13:07<4:53:36,  7.89s/it]
 94%|█████████▍| 35732/37963 [81:13:15<4:51:06,  7.83s/it]
 94%|█████████▍| 35733/37963 [81:13:22<4:45:01,  7.67s/it]
 94%|█████████▍| 35734/37963 [81:13:30<4:44:49,  7.67s/it]
 94%|█████████▍| 35735/37963 [81:13:38<4:48:59,  7.78s/it]
 94%|█████████▍| 35736/37963 [81:13:46<4:49:30,  7.80s/it]
 94%|█████████▍| 35737/37963 [81:13:56<5:20:38,  8.64s/it]
 94%|█████████▍| 35738/37963 [81:14:07<5:38:54,  9.14s/it]
 94%|█████████▍| 35739/37963 [81:14:15<5:25:02,  8.77s/it]
 94%|█████████▍| 35740/37963 [81:14:22<5:11:52,  8.42s/it]
                                                          
{'loss': '0.08127', 'grad_norm': '3.305', 'learning_rate': '1.795e-07', 'epoch': '0.9414'}
+
 94%|█████████▍| 35740/37963 [81:14:22<5:11:52,  8.42s/it]
 94%|█████████▍| 35741/37963 [81:14:29<4:58:00,  8.05s/it]
 94%|█████████▍| 35742/37963 [81:14:37<4:54:35,  7.96s/it]
 94%|█████████▍| 35743/37963 [81:14:45<4:53:32,  7.93s/it]
 94%|█████████▍| 35744/37963 [81:14:52<4:48:57,  7.81s/it]
 94%|█████████▍| 35745/37963 [81:15:00<4:49:12,  7.82s/it]
 94%|█████████▍| 35746/37963 [81:15:08<4:47:16,  7.77s/it]
 94%|█████████▍| 35747/37963 [81:15:16<4:49:02,  7.83s/it]
 94%|█████████▍| 35748/37963 [81:15:24<4:48:34,  7.82s/it]
 94%|█████████▍| 35749/37963 [81:15:34<5:18:43,  8.64s/it]
 94%|█████████▍| 35750/37963 [81:15:42<5:08:27,  8.36s/it]
                                                          
{'loss': '0.09623', 'grad_norm': '2.956', 'learning_rate': '1.779e-07', 'epoch': '0.9417'}
+
 94%|█████████▍| 35750/37963 [81:15:42<5:08:27,  8.36s/it]
 94%|█████████▍| 35751/37963 [81:15:53<5:33:37,  9.05s/it]
 94%|█████████▍| 35752/37963 [81:16:01<5:22:35,  8.75s/it]
 94%|█████████▍| 35753/37963 [81:16:08<5:11:06,  8.45s/it]
 94%|█████████▍| 35754/37963 [81:16:16<5:02:59,  8.23s/it]
 94%|█████████▍| 35755/37963 [81:16:27<5:27:46,  8.91s/it]
 94%|█████████▍| 35756/37963 [81:16:35<5:16:39,  8.61s/it]
 94%|█████████▍| 35757/37963 [81:16:42<5:07:28,  8.36s/it]
 94%|█████████▍| 35758/37963 [81:16:50<4:59:38,  8.15s/it]
 94%|█████████▍| 35759/37963 [81:16:58<4:54:04,  8.01s/it]
 94%|█████████▍| 35760/37963 [81:17:05<4:49:48,  7.89s/it]
                                                          
{'loss': '0.08827', 'grad_norm': '5.207', 'learning_rate': '1.763e-07', 'epoch': '0.942'}
+
 94%|█████████▍| 35760/37963 [81:17:05<4:49:48,  7.89s/it]
 94%|█████████▍| 35761/37963 [81:17:13<4:44:51,  7.76s/it]
 94%|█████████▍| 35762/37963 [81:17:21<4:45:50,  7.79s/it]
 94%|█████████▍| 35763/37963 [81:17:29<4:50:54,  7.93s/it]
 94%|█████████▍| 35764/37963 [81:17:37<4:48:54,  7.88s/it]
 94%|█████████▍| 35765/37963 [81:17:44<4:46:42,  7.83s/it]
 94%|█████████▍| 35766/37963 [81:17:52<4:44:59,  7.78s/it]
 94%|█████████▍| 35767/37963 [81:18:00<4:44:55,  7.78s/it]
 94%|█████████▍| 35768/37963 [81:18:10<5:13:23,  8.57s/it]
 94%|█████████▍| 35769/37963 [81:18:21<5:38:43,  9.26s/it]
 94%|█████████▍| 35770/37963 [81:18:29<5:22:53,  8.83s/it]
                                                          
{'loss': '0.06959', 'grad_norm': '2.879', 'learning_rate': '1.747e-07', 'epoch': '0.9422'}
+
 94%|█████████▍| 35770/37963 [81:18:29<5:22:53,  8.83s/it]
 94%|█████████▍| 35771/37963 [81:18:37<5:12:15,  8.55s/it]
 94%|█████████▍| 35772/37963 [81:18:44<5:00:01,  8.22s/it]
 94%|█████████▍| 35773/37963 [81:18:52<4:55:12,  8.09s/it]
 94%|█████████▍| 35774/37963 [81:19:00<4:51:28,  7.99s/it]
 94%|█████████▍| 35775/37963 [81:19:08<4:48:45,  7.92s/it]
 94%|█████████▍| 35776/37963 [81:19:18<5:13:28,  8.60s/it]
 94%|█████████▍| 35777/37963 [81:19:25<5:02:33,  8.30s/it]
 94%|█████████▍| 35778/37963 [81:19:33<4:57:14,  8.16s/it]
 94%|█████████▍| 35779/37963 [81:19:41<4:52:52,  8.05s/it]
 94%|█████████▍| 35780/37963 [81:19:49<4:52:57,  8.05s/it]
                                                          
{'loss': '0.08041', 'grad_norm': '3.874', 'learning_rate': '1.731e-07', 'epoch': '0.9425'}
+
 94%|█████████▍| 35780/37963 [81:19:49<4:52:57,  8.05s/it]
 94%|█████████▍| 35781/37963 [81:19:57<4:52:35,  8.05s/it]
 94%|█████████▍| 35782/37963 [81:20:08<5:20:50,  8.83s/it]
 94%|█████████▍| 35783/37963 [81:20:15<5:08:55,  8.50s/it]
 94%|█████████▍| 35784/37963 [81:20:23<5:02:19,  8.32s/it]
 94%|█████████▍| 35785/37963 [81:20:34<5:25:55,  8.98s/it]
 94%|█████████▍| 35786/37963 [81:20:42<5:12:56,  8.62s/it]
 94%|█████████▍| 35787/37963 [81:20:49<5:01:17,  8.31s/it]
 94%|█████████▍| 35788/37963 [81:20:57<4:55:50,  8.16s/it]
 94%|█████████▍| 35789/37963 [81:21:05<4:55:24,  8.15s/it]
 94%|█████████▍| 35790/37963 [81:21:13<4:50:34,  8.02s/it]
                                                          
{'loss': '0.09395', 'grad_norm': '3.637', 'learning_rate': '1.715e-07', 'epoch': '0.9428'}
+
 94%|█████████▍| 35790/37963 [81:21:13<4:50:34,  8.02s/it]
 94%|█████████▍| 35791/37963 [81:21:21<4:46:06,  7.90s/it]
 94%|█████████▍| 35792/37963 [81:21:28<4:45:14,  7.88s/it]
 94%|█████████▍| 35793/37963 [81:21:36<4:44:09,  7.86s/it]
 94%|█████████▍| 35794/37963 [81:21:47<5:12:13,  8.64s/it]
 94%|█████████▍| 35795/37963 [81:21:54<5:03:08,  8.39s/it]
 94%|█████████▍| 35796/37963 [81:22:02<4:55:20,  8.18s/it]
 94%|█████████▍| 35797/37963 [81:22:10<4:51:22,  8.07s/it]
 94%|█████████▍| 35798/37963 [81:22:18<4:47:17,  7.96s/it]
 94%|█████████▍| 35799/37963 [81:22:25<4:44:10,  7.88s/it]
 94%|█████████▍| 35800/37963 [81:22:33<4:41:05,  7.80s/it]
                                                          
{'loss': '0.09128', 'grad_norm': '3.938', 'learning_rate': '1.699e-07', 'epoch': '0.943'}
+
 94%|█████████▍| 35800/37963 [81:22:33<4:41:05,  7.80s/it]
 94%|█████████▍| 35801/37963 [81:22:43<5:09:51,  8.60s/it]
 94%|█████████▍| 35802/37963 [81:22:51<4:59:02,  8.30s/it]
 94%|█████████▍| 35803/37963 [81:22:59<4:51:47,  8.11s/it]
 94%|█████████▍| 35804/37963 [81:23:07<4:50:08,  8.06s/it]
 94%|█████████▍| 35805/37963 [81:23:17<5:12:45,  8.70s/it]
 94%|█████████▍| 35806/37963 [81:23:24<5:01:30,  8.39s/it]
 94%|█████████▍| 35807/37963 [81:23:32<4:54:15,  8.19s/it]
 94%|█████████▍| 35808/37963 [81:23:40<4:49:18,  8.05s/it]
 94%|█████████▍| 35809/37963 [81:23:48<4:45:57,  7.97s/it]
 94%|█████████▍| 35810/37963 [81:23:55<4:43:15,  7.89s/it]
                                                          
{'loss': '0.07549', 'grad_norm': '3.468', 'learning_rate': '1.684e-07', 'epoch': '0.9433'}
+
 94%|█████████▍| 35810/37963 [81:23:55<4:43:15,  7.89s/it]
 94%|█████████▍| 35811/37963 [81:24:03<4:42:21,  7.87s/it]
 94%|█████████▍| 35812/37963 [81:24:11<4:42:11,  7.87s/it]
 94%|█████████▍| 35813/37963 [81:24:22<5:13:41,  8.75s/it]
 94%|█████████▍| 35814/37963 [81:24:30<5:02:27,  8.44s/it]
 94%|█████████▍| 35815/37963 [81:24:37<4:54:56,  8.24s/it]
 94%|█████████▍| 35816/37963 [81:24:48<5:17:51,  8.88s/it]
 94%|█████████▍| 35817/37963 [81:24:56<5:08:42,  8.63s/it]
 94%|█████████▍| 35818/37963 [81:25:04<5:01:15,  8.43s/it]
 94%|█████████▍| 35819/37963 [81:25:12<4:53:53,  8.22s/it]
 94%|█████████▍| 35820/37963 [81:25:19<4:49:39,  8.11s/it]
                                                          
{'loss': '0.09974', 'grad_norm': '3.7', 'learning_rate': '1.668e-07', 'epoch': '0.9436'}
+
 94%|█████████▍| 35820/37963 [81:25:19<4:49:39,  8.11s/it]
 94%|█████████▍| 35821/37963 [81:25:27<4:46:07,  8.01s/it]
 94%|█████████▍| 35822/37963 [81:25:35<4:44:40,  7.98s/it]
 94%|█████████▍| 35823/37963 [81:25:43<4:40:55,  7.88s/it]
 94%|█████████▍| 35824/37963 [81:25:53<5:07:28,  8.62s/it]
 94%|█████████▍| 35825/37963 [81:26:01<4:59:32,  8.41s/it]
 94%|█████████▍| 35826/37963 [81:26:11<5:16:03,  8.87s/it]
 94%|█████████▍| 35827/37963 [81:26:19<5:04:23,  8.55s/it]
 94%|█████████▍| 35828/37963 [81:26:27<4:58:18,  8.38s/it]
 94%|█████████▍| 35829/37963 [81:26:37<5:19:27,  8.98s/it]
 94%|█████████▍| 35830/37963 [81:26:45<5:04:02,  8.55s/it]
                                                          
{'loss': '0.09228', 'grad_norm': '3.834', 'learning_rate': '1.653e-07', 'epoch': '0.9438'}
+
 94%|█████████▍| 35830/37963 [81:26:45<5:04:02,  8.55s/it]
 94%|█████████▍| 35831/37963 [81:26:53<4:57:52,  8.38s/it]
 94%|█████████▍| 35832/37963 [81:27:00<4:51:04,  8.20s/it]
 94%|█████████▍| 35833/37963 [81:27:08<4:47:37,  8.10s/it]
 94%|█████████▍| 35834/37963 [81:27:16<4:40:33,  7.91s/it]
 94%|█████████▍| 35835/37963 [81:27:23<4:38:05,  7.84s/it]
 94%|█████████▍| 35836/37963 [81:27:31<4:37:18,  7.82s/it]
 94%|█████████▍| 35837/37963 [81:27:39<4:35:06,  7.76s/it]
 94%|█████████▍| 35838/37963 [81:27:47<4:34:29,  7.75s/it]
 94%|█████████▍| 35839/37963 [81:27:54<4:33:16,  7.72s/it]
 94%|█████████▍| 35840/37963 [81:28:02<4:32:34,  7.70s/it]
                                                          
{'loss': '0.09281', 'grad_norm': '4.467', 'learning_rate': '1.637e-07', 'epoch': '0.9441'}
+
 94%|█████████▍| 35840/37963 [81:28:02<4:32:34,  7.70s/it]
 94%|█████████▍| 35841/37963 [81:28:10<4:34:03,  7.75s/it]
 94%|█████████▍| 35842/37963 [81:28:17<4:32:44,  7.72s/it]
 94%|█████████▍| 35843/37963 [81:28:25<4:33:20,  7.74s/it]
 94%|█████████▍| 35844/37963 [81:28:33<4:33:18,  7.74s/it]
 94%|█████████▍| 35845/37963 [81:28:40<4:31:08,  7.68s/it]
 94%|█████████▍| 35846/37963 [81:28:48<4:33:57,  7.76s/it]
 94%|█████████▍| 35847/37963 [81:28:56<4:34:07,  7.77s/it]
 94%|█████████▍| 35848/37963 [81:29:07<5:03:45,  8.62s/it]
 94%|█████████▍| 35849/37963 [81:29:14<4:54:04,  8.35s/it]
 94%|█████████▍| 35850/37963 [81:29:28<5:45:23,  9.81s/it]
                                                          
{'loss': '0.08204', 'grad_norm': '3.663', 'learning_rate': '1.622e-07', 'epoch': '0.9443'}
+
 94%|█████████▍| 35850/37963 [81:29:28<5:45:23,  9.81s/it]
 94%|█████████▍| 35851/37963 [81:29:35<5:23:29,  9.19s/it]
 94%|█████████▍| 35852/37963 [81:29:43<5:06:49,  8.72s/it]
 94%|█████████▍| 35853/37963 [81:29:51<4:57:50,  8.47s/it]
 94%|█████████▍| 35854/37963 [81:29:59<4:50:12,  8.26s/it]
 94%|█████████▍| 35855/37963 [81:30:07<4:48:02,  8.20s/it]
 94%|█████████▍| 35856/37963 [81:30:14<4:42:16,  8.04s/it]
 94%|█████████▍| 35857/37963 [81:30:25<5:10:24,  8.84s/it]
 94%|█████████▍| 35858/37963 [81:30:33<5:00:56,  8.58s/it]
 94%|█████████▍| 35859/37963 [81:30:41<4:51:17,  8.31s/it]
 94%|█████████▍| 35860/37963 [81:30:49<4:45:14,  8.14s/it]
                                                          
{'loss': '0.08827', 'grad_norm': '3.589', 'learning_rate': '1.607e-07', 'epoch': '0.9446'}
+
 94%|█████████▍| 35860/37963 [81:30:49<4:45:14,  8.14s/it]
 94%|█████████▍| 35861/37963 [81:30:56<4:40:48,  8.02s/it]
 94%|█████████▍| 35862/37963 [81:31:04<4:38:57,  7.97s/it]
 94%|█████████▍| 35863/37963 [81:31:12<4:37:44,  7.94s/it]
 94%|█████████▍| 35864/37963 [81:31:22<5:03:24,  8.67s/it]
 94%|█████████▍| 35865/37963 [81:31:30<4:55:08,  8.44s/it]
 94%|█████████▍| 35866/37963 [81:31:38<4:46:01,  8.18s/it]
 94%|█████████▍| 35867/37963 [81:31:48<5:03:35,  8.69s/it]
 94%|█████████▍| 35868/37963 [81:31:56<4:53:44,  8.41s/it]
 94%|█████████▍| 35869/37963 [81:32:03<4:46:10,  8.20s/it]
 94%|█████████▍| 35870/37963 [81:32:11<4:41:31,  8.07s/it]
                                                          
{'loss': '0.09567', 'grad_norm': '4.193', 'learning_rate': '1.591e-07', 'epoch': '0.9449'}
+
 94%|█████████▍| 35870/37963 [81:32:11<4:41:31,  8.07s/it]
 94%|█████████▍| 35871/37963 [81:32:19<4:38:01,  7.97s/it]
 94%|█████████▍| 35872/37963 [81:32:26<4:35:16,  7.90s/it]
 94%|█████████▍| 35873/37963 [81:32:37<5:01:59,  8.67s/it]
 94%|█████████▍| 35874/37963 [81:32:45<4:53:01,  8.42s/it]
 94%|█████████▍| 35875/37963 [81:32:53<4:46:06,  8.22s/it]
 95%|█████████▍| 35876/37963 [81:33:00<4:42:56,  8.13s/it]
 95%|█████████▍| 35877/37963 [81:33:11<5:05:29,  8.79s/it]
 95%|█████████▍| 35878/37963 [81:33:19<4:55:33,  8.51s/it]
 95%|█████████▍| 35879/37963 [81:33:26<4:48:29,  8.31s/it]
 95%|█████████▍| 35880/37963 [81:33:34<4:42:14,  8.13s/it]
                                                          
{'loss': '0.06987', 'grad_norm': '4.451', 'learning_rate': '1.576e-07', 'epoch': '0.9451'}
+
 95%|█████████▍| 35880/37963 [81:33:34<4:42:14,  8.13s/it]
 95%|█████████▍| 35881/37963 [81:33:42<4:36:48,  7.98s/it]
 95%|█████████▍| 35882/37963 [81:33:50<4:34:11,  7.91s/it]
 95%|█████████▍| 35883/37963 [81:33:57<4:33:41,  7.90s/it]
 95%|█████████▍| 35884/37963 [81:34:05<4:34:00,  7.91s/it]
 95%|█████████▍| 35885/37963 [81:34:13<4:33:27,  7.90s/it]
 95%|█████████▍| 35886/37963 [81:34:21<4:30:51,  7.82s/it]
 95%|█████████▍| 35887/37963 [81:34:28<4:28:03,  7.75s/it]
 95%|█████████▍| 35888/37963 [81:34:36<4:23:39,  7.62s/it]
 95%|█████████▍| 35889/37963 [81:34:43<4:20:52,  7.55s/it]
 95%|█████████▍| 35890/37963 [81:34:51<4:22:03,  7.59s/it]
                                                          
{'loss': '0.08201', 'grad_norm': '3.351', 'learning_rate': '1.561e-07', 'epoch': '0.9454'}
+
 95%|█████████▍| 35890/37963 [81:34:51<4:22:03,  7.59s/it]
 95%|█████████▍| 35891/37963 [81:34:58<4:22:41,  7.61s/it]
 95%|█████████▍| 35892/37963 [81:35:06<4:18:17,  7.48s/it]
 95%|█████████▍| 35893/37963 [81:35:13<4:21:02,  7.57s/it]
 95%|█████████▍| 35894/37963 [81:35:21<4:22:09,  7.60s/it]
 95%|█████████▍| 35895/37963 [81:35:29<4:20:40,  7.56s/it]
 95%|█████████▍| 35896/37963 [81:35:39<4:52:57,  8.50s/it]
 95%|█████████▍| 35897/37963 [81:35:47<4:45:59,  8.31s/it]
 95%|█████████▍| 35898/37963 [81:35:55<4:38:58,  8.11s/it]
 95%|█████████▍| 35899/37963 [81:36:05<5:00:53,  8.75s/it]
 95%|█████████▍| 35900/37963 [81:36:16<5:20:38,  9.33s/it]
                                                          
{'loss': '0.07683', 'grad_norm': '3.298', 'learning_rate': '1.546e-07', 'epoch': '0.9457'}
+
 95%|█████████▍| 35900/37963 [81:36:16<5:20:38,  9.33s/it]
 95%|█████████▍| 35901/37963 [81:36:26<5:32:51,  9.69s/it]
 95%|█████████▍| 35902/37963 [81:36:34<5:11:32,  9.07s/it]
 95%|█████████▍| 35903/37963 [81:36:42<4:57:05,  8.65s/it]
 95%|█████████▍| 35904/37963 [81:36:49<4:46:03,  8.34s/it]
 95%|█████████▍| 35905/37963 [81:36:57<4:39:53,  8.16s/it]
 95%|█████████▍| 35906/37963 [81:37:05<4:35:39,  8.04s/it]
 95%|█████████▍| 35907/37963 [81:37:12<4:32:09,  7.94s/it]
 95%|█████████▍| 35908/37963 [81:37:20<4:29:00,  7.85s/it]
 95%|█████████▍| 35909/37963 [81:37:27<4:23:59,  7.71s/it]
 95%|█████████▍| 35910/37963 [81:37:35<4:24:20,  7.73s/it]
                                                          
{'loss': '0.08133', 'grad_norm': '2.538', 'learning_rate': '1.531e-07', 'epoch': '0.9459'}
+
 95%|█████████▍| 35910/37963 [81:37:35<4:24:20,  7.73s/it]
 95%|█████████▍| 35911/37963 [81:37:45<4:50:05,  8.48s/it]
 95%|█████████▍| 35912/37963 [81:37:53<4:43:18,  8.29s/it]
 95%|█████████▍| 35913/37963 [81:38:01<4:38:02,  8.14s/it]
 95%|█████████▍| 35914/37963 [81:38:09<4:32:22,  7.98s/it]
 95%|█████████▍| 35915/37963 [81:38:16<4:31:33,  7.96s/it]
 95%|█████████▍| 35916/37963 [81:38:27<4:55:13,  8.65s/it]
 95%|█████████▍| 35917/37963 [81:38:34<4:42:32,  8.29s/it]
 95%|█████████▍| 35918/37963 [81:38:45<5:03:26,  8.90s/it]
 95%|█████████▍| 35919/37963 [81:38:53<4:56:19,  8.70s/it]
 95%|█████████▍| 35920/37963 [81:39:01<4:46:31,  8.41s/it]
                                                          
{'loss': '0.08223', 'grad_norm': '2.697', 'learning_rate': '1.517e-07', 'epoch': '0.9462'}
+
 95%|█████████▍| 35920/37963 [81:39:01<4:46:31,  8.41s/it]
 95%|█████████▍| 35921/37963 [81:39:08<4:39:06,  8.20s/it]
 95%|█████████▍| 35922/37963 [81:39:16<4:34:31,  8.07s/it]
 95%|█████████▍| 35923/37963 [81:39:23<4:27:14,  7.86s/it]
 95%|█████████▍| 35924/37963 [81:39:31<4:24:50,  7.79s/it]
 95%|█████████▍| 35925/37963 [81:39:42<4:54:48,  8.68s/it]
 95%|█████████▍| 35926/37963 [81:39:49<4:44:54,  8.39s/it]
 95%|█████████▍| 35927/37963 [81:39:57<4:37:51,  8.19s/it]
 95%|█████████▍| 35928/37963 [81:40:05<4:34:16,  8.09s/it]
 95%|█████████▍| 35929/37963 [81:40:13<4:30:33,  7.98s/it]
 95%|█████████▍| 35930/37963 [81:40:21<4:30:59,  8.00s/it]
                                                          
{'loss': '0.08299', 'grad_norm': '2.634', 'learning_rate': '1.502e-07', 'epoch': '0.9465'}
+
 95%|█████████▍| 35930/37963 [81:40:21<4:30:59,  8.00s/it]
 95%|█████████▍| 35931/37963 [81:40:28<4:27:40,  7.90s/it]
 95%|█████████▍| 35932/37963 [81:40:36<4:25:00,  7.83s/it]
 95%|█████████▍| 35933/37963 [81:40:44<4:26:41,  7.88s/it]
 95%|█████████▍| 35934/37963 [81:40:52<4:27:48,  7.92s/it]
 95%|█████████▍| 35935/37963 [81:41:00<4:25:42,  7.86s/it]
 95%|█████████▍| 35936/37963 [81:41:08<4:24:29,  7.83s/it]
 95%|█████████▍| 35937/37963 [81:41:15<4:22:08,  7.76s/it]
 95%|█████████▍| 35938/37963 [81:41:23<4:21:36,  7.75s/it]
 95%|█████████▍| 35939/37963 [81:41:30<4:19:01,  7.68s/it]
 95%|█████████▍| 35940/37963 [81:41:38<4:21:20,  7.75s/it]
                                                          
{'loss': '0.08284', 'grad_norm': '2.631', 'learning_rate': '1.487e-07', 'epoch': '0.9467'}
+
 95%|█████████▍| 35940/37963 [81:41:38<4:21:20,  7.75s/it]
 95%|█████████▍| 35941/37963 [81:41:46<4:19:44,  7.71s/it]
 95%|█████████▍| 35942/37963 [81:41:53<4:16:53,  7.63s/it]
 95%|█████████▍| 35943/37963 [81:42:01<4:17:11,  7.64s/it]
 95%|█████████▍| 35944/37963 [81:42:15<5:15:43,  9.38s/it]
 95%|█████████▍| 35945/37963 [81:42:22<4:55:11,  8.78s/it]
 95%|█████████▍| 35946/37963 [81:42:32<5:12:27,  9.29s/it]
 95%|█████████▍| 35947/37963 [81:42:40<4:57:14,  8.85s/it]
 95%|█████████▍| 35948/37963 [81:42:48<4:48:10,  8.58s/it]
 95%|█████████▍| 35949/37963 [81:42:56<4:41:09,  8.38s/it]
 95%|█████████▍| 35950/37963 [81:43:04<4:34:23,  8.18s/it]
                                                          
{'loss': '0.08558', 'grad_norm': '4.787', 'learning_rate': '1.473e-07', 'epoch': '0.947'}
+
 95%|█████████▍| 35950/37963 [81:43:04<4:34:23,  8.18s/it]
 95%|█████████▍| 35951/37963 [81:43:12<4:30:33,  8.07s/it]
 95%|█████████▍| 35952/37963 [81:43:22<4:53:04,  8.74s/it]
 95%|█████████▍| 35953/37963 [81:43:30<4:43:14,  8.45s/it]
 95%|█████████▍| 35954/37963 [81:43:37<4:34:49,  8.21s/it]
 95%|█████████▍| 35955/37963 [81:43:48<4:54:55,  8.81s/it]
 95%|█████████▍| 35956/37963 [81:43:55<4:42:20,  8.44s/it]
 95%|█████████▍| 35957/37963 [81:44:03<4:35:26,  8.24s/it]
 95%|█████████▍| 35958/37963 [81:44:11<4:31:19,  8.12s/it]
 95%|█████████▍| 35959/37963 [81:44:19<4:28:01,  8.02s/it]
 95%|█████████▍| 35960/37963 [81:44:29<4:52:24,  8.76s/it]
                                                          
{'loss': '0.0893', 'grad_norm': '3.494', 'learning_rate': '1.458e-07', 'epoch': '0.9472'}
+
 95%|█████████▍| 35960/37963 [81:44:29<4:52:24,  8.76s/it]
 95%|█████████▍| 35961/37963 [81:44:37<4:41:36,  8.44s/it]
 95%|█████████▍| 35962/37963 [81:44:44<4:33:17,  8.19s/it]
 95%|█████████▍| 35963/37963 [81:44:54<4:49:56,  8.70s/it]
 95%|█████████▍| 35964/37963 [81:45:02<4:41:05,  8.44s/it]
 95%|█████████▍| 35965/37963 [81:45:10<4:33:35,  8.22s/it]
 95%|█████████▍| 35966/37963 [81:45:17<4:28:09,  8.06s/it]
 95%|█████████▍| 35967/37963 [81:45:25<4:20:28,  7.83s/it]
 95%|█████████▍| 35968/37963 [81:45:32<4:18:05,  7.76s/it]
 95%|█████████▍| 35969/37963 [81:45:43<4:42:33,  8.50s/it]
 95%|█████████▍| 35970/37963 [81:45:50<4:33:59,  8.25s/it]
                                                          
{'loss': '0.0761', 'grad_norm': '2.712', 'learning_rate': '1.443e-07', 'epoch': '0.9475'}
+
 95%|█████████▍| 35970/37963 [81:45:50<4:33:59,  8.25s/it]
 95%|█████████▍| 35971/37963 [81:45:58<4:32:02,  8.19s/it]
 95%|█████████▍| 35972/37963 [81:46:06<4:28:39,  8.10s/it]
 95%|█████████▍| 35973/37963 [81:46:14<4:25:40,  8.01s/it]
 95%|█████████▍| 35974/37963 [81:46:22<4:22:13,  7.91s/it]
 95%|█████████▍| 35975/37963 [81:46:29<4:20:23,  7.86s/it]
 95%|█████████▍| 35976/37963 [81:46:37<4:18:37,  7.81s/it]
 95%|█████████▍| 35977/37963 [81:46:45<4:17:49,  7.79s/it]
 95%|█████████▍| 35978/37963 [81:46:52<4:15:17,  7.72s/it]
 95%|█████████▍| 35979/37963 [81:47:00<4:13:52,  7.68s/it]
 95%|█████████▍| 35980/37963 [81:47:08<4:14:09,  7.69s/it]
                                                          
{'loss': '0.08196', 'grad_norm': '3.516', 'learning_rate': '1.429e-07', 'epoch': '0.9478'}
+
 95%|█████████▍| 35980/37963 [81:47:08<4:14:09,  7.69s/it]
 95%|█████████▍| 35981/37963 [81:47:15<4:14:41,  7.71s/it]
 95%|█████████▍| 35982/37963 [81:47:23<4:13:35,  7.68s/it]
 95%|█████████▍| 35983/37963 [81:47:31<4:12:19,  7.65s/it]
 95%|█████████▍| 35984/37963 [81:47:38<4:10:23,  7.59s/it]
 95%|█████████▍| 35985/37963 [81:47:46<4:12:02,  7.65s/it]
 95%|█████████▍| 35986/37963 [81:47:54<4:13:03,  7.68s/it]
 95%|█████████▍| 35987/37963 [81:48:01<4:10:42,  7.61s/it]
 95%|█████████▍| 35988/37963 [81:48:12<4:39:21,  8.49s/it]
 95%|█████████▍| 35989/37963 [81:48:22<5:00:32,  9.13s/it]
 95%|█████████▍| 35990/37963 [81:48:30<4:45:34,  8.68s/it]
                                                          
{'loss': '0.08972', 'grad_norm': '3.81', 'learning_rate': '1.415e-07', 'epoch': '0.948'}
+
 95%|█████████▍| 35990/37963 [81:48:30<4:45:34,  8.68s/it]
 95%|█████████▍| 35991/37963 [81:48:40<5:01:06,  9.16s/it]
 95%|█████████▍| 35992/37963 [81:48:48<4:46:50,  8.73s/it]
 95%|█████████▍| 35993/37963 [81:48:56<4:36:28,  8.42s/it]
 95%|█████████▍| 35994/37963 [81:49:03<4:29:11,  8.20s/it]
 95%|█████████▍| 35995/37963 [81:49:11<4:25:50,  8.10s/it]
 95%|█████████▍| 35996/37963 [81:49:19<4:21:30,  7.98s/it]
 95%|█████████▍| 35997/37963 [81:49:27<4:19:59,  7.93s/it]
 95%|█████████▍| 35998/37963 [81:49:34<4:18:39,  7.90s/it]
 95%|█████████▍| 35999/37963 [81:49:42<4:16:25,  7.83s/it]
 95%|█████████▍| 36000/37963 [81:49:50<4:16:10,  7.83s/it]
                                                          
{'loss': '0.09595', 'grad_norm': '3.077', 'learning_rate': '1.4e-07', 'epoch': '0.9483'}
+
 95%|█████████▍| 36000/37963 [81:49:50<4:16:10,  7.83s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.18s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.18s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 95%|█████████▍| 36001/37963 [81:50:48<12:26:53, 22.84s/it]
 95%|█████████▍| 36002/37963 [81:50:56<9:58:51, 18.32s/it] 
 95%|█████████▍| 36003/37963 [81:51:03<8:16:03, 15.19s/it]
 95%|█████████▍| 36004/37963 [81:51:11<7:03:09, 12.96s/it]
 95%|█████████▍| 36005/37963 [81:51:22<6:38:11, 12.20s/it]
 95%|█████████▍| 36006/37963 [81:51:30<5:55:40, 10.90s/it]
 95%|█████████▍| 36007/37963 [81:51:37<5:23:44,  9.93s/it]
 95%|███████��█▍| 36008/37963 [81:51:47<5:26:59, 10.04s/it]
 95%|█████████▍| 36009/37963 [81:51:55<5:06:24,  9.41s/it]
 95%|█████████▍| 36010/37963 [81:52:06<5:17:26,  9.75s/it]
                                                          
{'loss': '0.09062', 'grad_norm': '3.589', 'learning_rate': '1.386e-07', 'epoch': '0.9486'}
+
 95%|█████████▍| 36010/37963 [81:52:06<5:17:26,  9.75s/it]
 95%|█████████▍| 36011/37963 [81:52:14<4:58:58,  9.19s/it]
 95%|█████████▍| 36012/37963 [81:52:21<4:41:08,  8.65s/it]
 95%|█████████▍| 36013/37963 [81:52:29<4:31:48,  8.36s/it]
 95%|█████████▍| 36014/37963 [81:52:37<4:24:04,  8.13s/it]
 95%|█████████▍| 36015/37963 [81:52:47<4:50:03,  8.93s/it]
 95%|█████████▍| 36016/37963 [81:52:55<4:38:33,  8.58s/it]
 95%|█████████▍| 36017/37963 [81:53:03<4:30:52,  8.35s/it]
 95%|█████████▍| 36018/37963 [81:53:11<4:26:41,  8.23s/it]
 95%|█████████▍| 36019/37963 [81:53:19<4:21:26,  8.07s/it]
 95%|█████████▍| 36020/37963 [81:53:26<4:18:52,  7.99s/it]
                                                          
{'loss': '0.08801', 'grad_norm': '3.683', 'learning_rate': '1.372e-07', 'epoch': '0.9488'}
+
 95%|█████████▍| 36020/37963 [81:53:26<4:18:52,  7.99s/it]
 95%|█████████▍| 36021/37963 [81:53:34<4:16:38,  7.93s/it]
 95%|█████████▍| 36022/37963 [81:53:42<4:15:14,  7.89s/it]
 95%|█████████▍| 36023/37963 [81:53:50<4:14:11,  7.86s/it]
 95%|█████████▍| 36024/37963 [81:53:57<4:12:54,  7.83s/it]
 95%|█████████▍| 36025/37963 [81:54:05<4:11:16,  7.78s/it]
 95%|█████████▍| 36026/37963 [81:54:13<4:10:58,  7.77s/it]
 95%|█████████▍| 36027/37963 [81:54:21<4:12:00,  7.81s/it]
 95%|█████████▍| 36028/37963 [81:54:28<4:10:25,  7.77s/it]
 95%|█████████▍| 36029/37963 [81:54:36<4:12:13,  7.82s/it]
 95%|█████████▍| 36030/37963 [81:54:47<4:37:51,  8.62s/it]
                                                          
{'loss': '0.0852', 'grad_norm': '3.209', 'learning_rate': '1.358e-07', 'epoch': '0.9491'}
+
 95%|█████████▍| 36030/37963 [81:54:47<4:37:51,  8.62s/it]
 95%|█████████▍| 36031/37963 [81:54:55<4:30:07,  8.39s/it]
 95%|█████████▍| 36032/37963 [81:55:03<4:25:51,  8.26s/it]
 95%|█████████▍| 36033/37963 [81:55:11<4:23:13,  8.18s/it]
 95%|█████████▍| 36034/37963 [81:55:19<4:19:15,  8.06s/it]
 95%|█████████▍| 36035/37963 [81:55:26<4:18:15,  8.04s/it]
 95%|█████████▍| 36036/37963 [81:55:34<4:14:40,  7.93s/it]
 95%|█████████▍| 36037/37963 [81:55:42<4:12:10,  7.86s/it]
 95%|█████████▍| 36038/37963 [81:55:52<4:34:25,  8.55s/it]
 95%|█████████▍| 36039/37963 [81:56:02<4:51:48,  9.10s/it]
 95%|█████████▍| 36040/37963 [81:56:10<4:40:59,  8.77s/it]
                                                          
{'loss': '0.08956', 'grad_norm': '3.343', 'learning_rate': '1.344e-07', 'epoch': '0.9493'}
+
 95%|█████████▍| 36040/37963 [81:56:10<4:40:59,  8.77s/it]
 95%|█████████▍| 36041/37963 [81:56:18<4:29:49,  8.42s/it]
 95%|█████████▍| 36042/37963 [81:56:26<4:22:10,  8.19s/it]
 95%|█████████▍| 36043/37963 [81:56:34<4:19:00,  8.09s/it]
 95%|█████████▍| 36044/37963 [81:56:41<4:16:43,  8.03s/it]
 95%|█████████▍| 36045/37963 [81:56:49<4:13:17,  7.92s/it]
 95%|█████████▍| 36046/37963 [81:56:57<4:11:07,  7.86s/it]
 95%|█████████▍| 36047/37963 [81:57:05<4:10:58,  7.86s/it]
 95%|█████████▍| 36048/37963 [81:57:12<4:10:10,  7.84s/it]
 95%|█████████▍| 36049/37963 [81:57:20<4:09:30,  7.82s/it]
 95%|█████████▍| 36050/37963 [81:57:28<4:07:20,  7.76s/it]
                                                          
{'loss': '0.0899', 'grad_norm': '4.86', 'learning_rate': '1.33e-07', 'epoch': '0.9496'}
+
 95%|█████████▍| 36050/37963 [81:57:28<4:07:20,  7.76s/it]
 95%|█████████▍| 36051/37963 [81:57:36<4:07:09,  7.76s/it]
 95%|█████████▍| 36052/37963 [81:57:43<4:08:12,  7.79s/it]
 95%|█████████▍| 36053/37963 [81:57:51<4:07:12,  7.77s/it]
 95%|█████████▍| 36054/37963 [81:57:59<4:06:50,  7.76s/it]
 95%|█████████▍| 36055/37963 [81:58:07<4:07:13,  7.77s/it]
 95%|█████████▍| 36056/37963 [81:58:17<4:28:27,  8.45s/it]
 95%|█████████▍| 36057/37963 [81:58:27<4:48:50,  9.09s/it]
 95%|█████████▍| 36058/37963 [81:58:35<4:38:34,  8.77s/it]
 95%|█████████▍| 36059/37963 [81:58:43<4:32:08,  8.58s/it]
 95%|█████████▍| 36060/37963 [81:58:51<4:22:38,  8.28s/it]
                                                          
{'loss': '0.08164', 'grad_norm': '3.354', 'learning_rate': '1.316e-07', 'epoch': '0.9499'}
+
 95%|█████████▍| 36060/37963 [81:58:51<4:22:38,  8.28s/it]
 95%|█████████▍| 36061/37963 [81:58:59<4:20:38,  8.22s/it]
 95%|█████████▍| 36062/37963 [81:59:10<4:42:06,  8.90s/it]
 95%|█████████▍| 36063/37963 [81:59:17<4:30:02,  8.53s/it]
 95%|█████████▍| 36064/37963 [81:59:28<4:47:17,  9.08s/it]
 95%|█████████▌| 36065/37963 [81:59:35<4:33:49,  8.66s/it]
 95%|█████████▌| 36066/37963 [81:59:43<4:23:20,  8.33s/it]
 95%|█████████▌| 36067/37963 [81:59:51<4:18:29,  8.18s/it]
 95%|█████████▌| 36068/37963 [81:59:58<4:13:49,  8.04s/it]
 95%|█████████▌| 36069/37963 [82:00:09<4:36:18,  8.75s/it]
 95%|█████████▌| 36070/37963 [82:00:17<4:26:21,  8.44s/it]
                                                          
{'loss': '0.08335', 'grad_norm': '4.8', 'learning_rate': '1.303e-07', 'epoch': '0.9501'}
+
 95%|█████████▌| 36070/37963 [82:00:17<4:26:21,  8.44s/it]
 95%|█████████▌| 36071/37963 [82:00:24<4:19:09,  8.22s/it]
 95%|█████████▌| 36072/37963 [82:00:32<4:16:06,  8.13s/it]
 95%|█████████▌| 36073/37963 [82:00:43<4:39:36,  8.88s/it]
 95%|█████████▌| 36074/37963 [82:00:51<4:30:20,  8.59s/it]
 95%|█████████▌| 36075/37963 [82:00:58<4:20:41,  8.28s/it]
 95%|█████████▌| 36076/37963 [82:01:06<4:16:46,  8.16s/it]
 95%|█████████▌| 36077/37963 [82:01:14<4:16:50,  8.17s/it]
 95%|█████████▌| 36078/37963 [82:01:22<4:11:34,  8.01s/it]
 95%|█████████▌| 36079/37963 [82:01:30<4:09:13,  7.94s/it]
 95%|█████████▌| 36080/37963 [82:01:38<4:07:28,  7.89s/it]
                                                          
{'loss': '0.08315', 'grad_norm': '2.922', 'learning_rate': '1.289e-07', 'epoch': '0.9504'}
+
 95%|█████████▌| 36080/37963 [82:01:38<4:07:28,  7.89s/it]
 95%|█████████▌| 36081/37963 [82:01:45<4:04:11,  7.79s/it]
 95%|█████████▌| 36082/37963 [82:01:56<4:29:14,  8.59s/it]
 95%|█████████▌| 36083/37963 [82:02:03<4:21:53,  8.36s/it]
 95%|█████████▌| 36084/37963 [82:02:11<4:15:59,  8.17s/it]
 95%|█████████▌| 36085/37963 [82:02:19<4:10:17,  8.00s/it]
 95%|█████████▌| 36086/37963 [82:02:26<4:06:14,  7.87s/it]
 95%|█████████▌| 36087/37963 [82:02:37<4:32:14,  8.71s/it]
 95%|█████████▌| 36088/37963 [82:02:45<4:23:51,  8.44s/it]
 95%|█████████▌| 36089/37963 [82:02:52<4:16:29,  8.21s/it]
 95%|█████████▌| 36090/37963 [82:03:00<4:10:14,  8.02s/it]
                                                          
{'loss': '0.08682', 'grad_norm': '5.455', 'learning_rate': '1.275e-07', 'epoch': '0.9507'}
+
 95%|█████████▌| 36090/37963 [82:03:00<4:10:14,  8.02s/it]
 95%|█████████▌| 36091/37963 [82:03:08<4:09:21,  7.99s/it]
 95%|█████████▌| 36092/37963 [82:03:16<4:06:49,  7.92s/it]
 95%|█████████▌| 36093/37963 [82:03:23<4:00:50,  7.73s/it]
 95%|█████████▌| 36094/37963 [82:03:31<4:02:55,  7.80s/it]
 95%|█████████▌| 36095/37963 [82:03:39<4:00:52,  7.74s/it]
 95%|█████████▌| 36096/37963 [82:03:46<4:00:15,  7.72s/it]
 95%|█████████▌| 36097/37963 [82:03:54<3:57:43,  7.64s/it]
 95%|█████████▌| 36098/37963 [82:04:01<3:56:20,  7.60s/it]
 95%|█████████▌| 36099/37963 [82:04:09<3:56:24,  7.61s/it]
 95%|█████████▌| 36100/37963 [82:04:19<4:21:41,  8.43s/it]
                                                          
{'loss': '0.08736', 'grad_norm': '2.969', 'learning_rate': '1.262e-07', 'epoch': '0.9509'}
+
 95%|█████████▌| 36100/37963 [82:04:19<4:21:41,  8.43s/it]
 95%|█████████▌| 36101/37963 [82:04:30<4:45:12,  9.19s/it]
 95%|█████████▌| 36102/37963 [82:04:38<4:35:12,  8.87s/it]
 95%|█████████▌| 36103/37963 [82:04:46<4:22:36,  8.47s/it]
 95%|█████████▌| 36104/37963 [82:04:53<4:15:14,  8.24s/it]
 95%|█████████▌| 36105/37963 [82:05:01<4:08:38,  8.03s/it]
 95%|█████████▌| 36106/37963 [82:05:09<4:06:39,  7.97s/it]
 95%|█████████▌| 36107/37963 [82:05:17<4:04:44,  7.91s/it]
 95%|█████████▌| 36108/37963 [82:05:24<4:01:31,  7.81s/it]
 95%|█████████▌| 36109/37963 [82:05:32<4:00:20,  7.78s/it]
 95%|█████████▌| 36110/37963 [82:05:40<4:00:44,  7.80s/it]
                                                          
{'loss': '0.09287', 'grad_norm': '4.214', 'learning_rate': '1.248e-07', 'epoch': '0.9512'}
+
 95%|█████████▌| 36110/37963 [82:05:40<4:00:44,  7.80s/it]
 95%|█████████▌| 36111/37963 [82:05:47<3:59:35,  7.76s/it]
 95%|█████████▌| 36112/37963 [82:05:58<4:22:36,  8.51s/it]
 95%|█████████▌| 36113/37963 [82:06:05<4:12:20,  8.18s/it]
 95%|█████████▌| 36114/37963 [82:06:13<4:05:20,  7.96s/it]
 95%|█████████▌| 36115/37963 [82:06:20<4:02:16,  7.87s/it]
 95%|█████████▌| 36116/37963 [82:06:31<4:25:08,  8.61s/it]
 95%|█████████▌| 36117/37963 [82:06:41<4:44:29,  9.25s/it]
 95%|█████████▌| 36118/37963 [82:06:49<4:33:59,  8.91s/it]
 95%|█████████▌| 36119/37963 [82:06:57<4:20:54,  8.49s/it]
 95%|█████████▌| 36120/37963 [82:07:05<4:13:01,  8.24s/it]
                                                          
{'loss': '0.06338', 'grad_norm': '3.181', 'learning_rate': '1.235e-07', 'epoch': '0.9515'}
+
 95%|█████████▌| 36120/37963 [82:07:05<4:13:01,  8.24s/it]
 95%|█████████▌| 36121/37963 [82:07:12<4:08:04,  8.08s/it]
 95%|█████████▌| 36122/37963 [82:07:20<4:05:32,  8.00s/it]
 95%|█████████▌| 36123/37963 [82:07:30<4:26:52,  8.70s/it]
 95%|█████████▌| 36124/37963 [82:07:38<4:18:40,  8.44s/it]
 95%|█████████▌| 36125/37963 [82:07:46<4:13:15,  8.27s/it]
 95%|█████████▌| 36126/37963 [82:07:57<4:33:20,  8.93s/it]
 95%|█████████▌| 36127/37963 [82:08:04<4:22:52,  8.59s/it]
 95%|█████████▌| 36128/37963 [82:08:12<4:14:59,  8.34s/it]
 95%|█████████▌| 36129/37963 [82:08:20<4:06:47,  8.07s/it]
 95%|█████████▌| 36130/37963 [82:08:28<4:05:38,  8.04s/it]
                                                          
{'loss': '0.09095', 'grad_norm': '3.139', 'learning_rate': '1.222e-07', 'epoch': '0.9517'}
+
 95%|█████████▌| 36130/37963 [82:08:28<4:05:38,  8.04s/it]
 95%|█████████▌| 36131/37963 [82:08:35<4:01:49,  7.92s/it]
 95%|█████████▌| 36132/37963 [82:08:43<3:57:59,  7.80s/it]
 95%|█████████▌| 36133/37963 [82:08:50<3:56:28,  7.75s/it]
 95%|█████████▌| 36134/37963 [82:08:58<3:53:47,  7.67s/it]
 95%|█████████▌| 36135/37963 [82:09:08<4:20:47,  8.56s/it]
 95%|█████████▌| 36136/37963 [82:09:16<4:13:01,  8.31s/it]
 95%|█████████▌| 36137/37963 [82:09:24<4:09:31,  8.20s/it]
 95%|█████████▌| 36138/37963 [82:09:31<4:01:07,  7.93s/it]
 95%|█████████▌| 36139/37963 [82:09:39<3:59:47,  7.89s/it]
 95%|█████████▌| 36140/37963 [82:09:47<3:57:49,  7.83s/it]
                                                          
{'loss': '0.09109', 'grad_norm': '4.227', 'learning_rate': '1.208e-07', 'epoch': '0.952'}
+
 95%|█████████▌| 36140/37963 [82:09:47<3:57:49,  7.83s/it]
 95%|█████████▌| 36141/37963 [82:09:55<3:57:41,  7.83s/it]
 95%|█████████▌| 36142/37963 [82:10:02<3:55:16,  7.75s/it]
 95%|█████████▌| 36143/37963 [82:10:10<3:55:06,  7.75s/it]
 95%|█████████▌| 36144/37963 [82:10:20<4:19:20,  8.55s/it]
 95%|█████████▌| 36145/37963 [82:10:28<4:13:09,  8.35s/it]
 95%|█████████▌| 36146/37963 [82:10:36<4:05:54,  8.12s/it]
 95%|█████████▌| 36147/37963 [82:10:43<3:58:45,  7.89s/it]
 95%|█████████▌| 36148/37963 [82:10:51<3:56:20,  7.81s/it]
 95%|█████████▌| 36149/37963 [82:10:58<3:51:31,  7.66s/it]
 95%|█████████▌| 36150/37963 [82:11:06<3:52:47,  7.70s/it]
                                                          
{'loss': '0.08646', 'grad_norm': '3.236', 'learning_rate': '1.195e-07', 'epoch': '0.9522'}
+
 95%|█████████▌| 36150/37963 [82:11:06<3:52:47,  7.70s/it]
 95%|█████████▌| 36151/37963 [82:11:14<3:52:33,  7.70s/it]
 95%|█████████▌| 36152/37963 [82:11:24<4:19:35,  8.60s/it]
 95%|█████████▌| 36153/37963 [82:11:32<4:10:45,  8.31s/it]
 95%|█████████▌| 36154/37963 [82:11:40<4:03:56,  8.09s/it]
 95%|█████████▌| 36155/37963 [82:11:47<3:59:00,  7.93s/it]
 95%|█████████▌| 36156/37963 [82:11:57<4:20:08,  8.64s/it]
 95%|█████████▌| 36157/37963 [82:12:05<4:08:28,  8.25s/it]
 95%|█████████▌| 36158/37963 [82:12:12<4:02:24,  8.06s/it]
 95%|█████████▌| 36159/37963 [82:12:20<3:59:17,  7.96s/it]
 95%|█████████▌| 36160/37963 [82:12:28<3:57:11,  7.89s/it]
                                                          
{'loss': '0.08909', 'grad_norm': '3.293', 'learning_rate': '1.182e-07', 'epoch': '0.9525'}
+
 95%|█████████▌| 36160/37963 [82:12:28<3:57:11,  7.89s/it]
 95%|█████████▌| 36161/37963 [82:12:36<3:55:16,  7.83s/it]
 95%|█████████▌| 36162/37963 [82:12:43<3:52:40,  7.75s/it]
 95%|█████████▌| 36163/37963 [82:12:54<4:16:12,  8.54s/it]
 95%|█████████▌| 36164/37963 [82:13:01<4:10:05,  8.34s/it]
 95%|█████████▌| 36165/37963 [82:13:12<4:31:22,  9.06s/it]
 95%|█████████▌| 36166/37963 [82:13:20<4:18:23,  8.63s/it]
 95%|█████████▌| 36167/37963 [82:13:30<4:32:56,  9.12s/it]
 95%|█████████▌| 36168/37963 [82:13:38<4:20:57,  8.72s/it]
 95%|█████████▌| 36169/37963 [82:13:46<4:11:11,  8.40s/it]
 95%|█████████▌| 36170/37963 [82:13:53<4:04:56,  8.20s/it]
                                                          
{'loss': '0.06887', 'grad_norm': '2.523', 'learning_rate': '1.169e-07', 'epoch': '0.9528'}
+
 95%|█████████▌| 36170/37963 [82:13:53<4:04:56,  8.20s/it]
 95%|█████████▌| 36171/37963 [82:14:01<3:59:05,  8.01s/it]
 95%|█████████▌| 36172/37963 [82:14:09<3:57:51,  7.97s/it]
 95%|█████████▌| 36173/37963 [82:14:16<3:55:58,  7.91s/it]
 95%|█████████▌| 36174/37963 [82:14:27<4:18:39,  8.68s/it]
 95%|█████████▌| 36175/37963 [82:14:35<4:12:29,  8.47s/it]
 95%|█████████▌| 36176/37963 [82:14:43<4:06:29,  8.28s/it]
 95%|█████████▌| 36177/37963 [82:14:50<4:01:37,  8.12s/it]
 95%|█████████▌| 36178/37963 [82:14:58<3:56:54,  7.96s/it]
 95%|█████████▌| 36179/37963 [82:15:09<4:22:13,  8.82s/it]
 95%|█████████▌| 36180/37963 [82:15:17<4:13:02,  8.52s/it]
                                                          
{'loss': '0.08684', 'grad_norm': '3.474', 'learning_rate': '1.156e-07', 'epoch': '0.953'}
+
 95%|█████████▌| 36180/37963 [82:15:17<4:13:02,  8.52s/it]
 95%|█████████▌| 36181/37963 [82:15:24<4:05:52,  8.28s/it]
 95%|█████████▌| 36182/37963 [82:15:32<4:01:06,  8.12s/it]
 95%|█████████▌| 36183/37963 [82:15:40<4:00:01,  8.09s/it]
 95%|█████████▌| 36184/37963 [82:15:48<3:57:14,  8.00s/it]
 95%|█████████▌| 36185/37963 [82:15:56<3:53:35,  7.88s/it]
 95%|█████████▌| 36186/37963 [82:16:04<3:53:43,  7.89s/it]
 95%|█████████▌| 36187/37963 [82:16:11<3:51:47,  7.83s/it]
 95%|█████████▌| 36188/37963 [82:16:19<3:51:25,  7.82s/it]
 95%|█████████▌| 36189/37963 [82:16:27<3:52:17,  7.86s/it]
 95%|█████████▌| 36190/37963 [82:16:35<3:52:51,  7.88s/it]
                                                          
{'loss': '0.09844', 'grad_norm': '3.911', 'learning_rate': '1.143e-07', 'epoch': '0.9533'}
+
 95%|█████████▌| 36190/37963 [82:16:35<3:52:51,  7.88s/it]
 95%|█████████▌| 36191/37963 [82:16:43<3:51:59,  7.85s/it]
 95%|█████████▌| 36192/37963 [82:16:53<4:14:10,  8.61s/it]
 95%|█████████▌| 36193/37963 [82:17:01<4:07:04,  8.38s/it]
 95%|█████████▌| 36194/37963 [82:17:09<4:02:32,  8.23s/it]
 95%|█████████▌| 36195/37963 [82:17:17<3:58:51,  8.11s/it]
 95%|█████████▌| 36196/37963 [82:17:24<3:51:05,  7.85s/it]
 95%|█████████▌| 36197/37963 [82:17:32<3:49:52,  7.81s/it]
 95%|█████████▌| 36198/37963 [82:17:39<3:50:44,  7.84s/it]
 95%|█████████▌| 36199/37963 [82:17:50<4:14:21,  8.65s/it]
 95%|█████████▌| 36200/37963 [82:18:00<4:27:03,  9.09s/it]
                                                          
{'loss': '0.08497', 'grad_norm': '3.207', 'learning_rate': '1.13e-07', 'epoch': '0.9536'}
+
 95%|█████████▌| 36200/37963 [82:18:00<4:27:03,  9.09s/it]
 95%|█████████▌| 36201/37963 [82:18:08<4:15:13,  8.69s/it]
 95%|█████████▌| 36202/37963 [82:18:15<4:04:04,  8.32s/it]
 95%|█████████▌| 36203/37963 [82:18:23<3:58:33,  8.13s/it]
 95%|█████████▌| 36204/37963 [82:18:31<3:54:37,  8.00s/it]
 95%|█████████▌| 36205/37963 [82:18:38<3:51:18,  7.89s/it]
 95%|█████████▌| 36206/37963 [82:18:46<3:49:24,  7.83s/it]
 95%|█████████▌| 36207/37963 [82:18:56<4:12:17,  8.62s/it]
 95%|█████████▌| 36208/37963 [82:19:04<4:05:41,  8.40s/it]
 95%|████���████▌| 36209/37963 [82:19:12<3:58:24,  8.16s/it]
 95%|█████████▌| 36210/37963 [82:19:19<3:51:22,  7.92s/it]
                                                          
{'loss': '0.08741', 'grad_norm': '3.32', 'learning_rate': '1.118e-07', 'epoch': '0.9538'}
+
 95%|█████████▌| 36210/37963 [82:19:19<3:51:22,  7.92s/it]
 95%|█████████▌| 36211/37963 [82:19:27<3:47:14,  7.78s/it]
 95%|█████████▌| 36212/37963 [82:19:35<3:46:45,  7.77s/it]
 95%|█████████▌| 36213/37963 [82:19:45<4:13:20,  8.69s/it]
 95%|█████████▌| 36214/37963 [82:19:53<4:04:15,  8.38s/it]
 95%|█████████▌| 36215/37963 [82:20:04<4:23:08,  9.03s/it]
 95%|█████████▌| 36216/37963 [82:20:12<4:13:34,  8.71s/it]
 95%|█████████▌| 36217/37963 [82:20:19<4:04:59,  8.42s/it]
 95%|█████████▌| 36218/37963 [82:20:27<3:56:27,  8.13s/it]
 95%|█████████▌| 36219/37963 [82:20:34<3:50:58,  7.95s/it]
 95%|█████████▌| 36220/37963 [82:20:42<3:49:30,  7.90s/it]
                                                          
{'loss': '0.08526', 'grad_norm': '4.191', 'learning_rate': '1.105e-07', 'epoch': '0.9541'}
+
 95%|█████████▌| 36220/37963 [82:20:42<3:49:30,  7.90s/it]
 95%|█████████▌| 36221/37963 [82:20:50<3:49:28,  7.90s/it]
 95%|█████████▌| 36222/37963 [82:21:01<4:12:39,  8.71s/it]
 95%|█████████▌| 36223/37963 [82:21:08<4:04:50,  8.44s/it]
 95%|█████████▌| 36224/37963 [82:21:16<3:59:57,  8.28s/it]
 95%|█████████▌| 36225/37963 [82:21:24<3:54:39,  8.10s/it]
 95%|█████████▌| 36226/37963 [82:21:34<4:15:02,  8.81s/it]
 95%|█████████▌| 36227/37963 [82:21:42<4:04:12,  8.44s/it]
 95%|█████████▌| 36228/37963 [82:21:50<3:56:07,  8.17s/it]
 95%|█████████▌| 36229/37963 [82:21:57<3:48:30,  7.91s/it]
 95%|█████████▌| 36230/37963 [82:22:04<3:45:53,  7.82s/it]
                                                          
{'loss': '0.09251', 'grad_norm': '2.89', 'learning_rate': '1.092e-07', 'epoch': '0.9544'}
+
 95%|█████████▌| 36230/37963 [82:22:04<3:45:53,  7.82s/it]
 95%|█████████▌| 36231/37963 [82:22:12<3:43:14,  7.73s/it]
 95%|█████████▌| 36232/37963 [82:22:20<3:43:21,  7.74s/it]
 95%|█████████▌| 36233/37963 [82:22:27<3:42:13,  7.71s/it]
 95%|█████████▌| 36234/37963 [82:22:35<3:43:34,  7.76s/it]
 95%|█████████▌| 36235/37963 [82:22:43<3:42:35,  7.73s/it]
 95%|█████████▌| 36236/37963 [82:22:50<3:41:22,  7.69s/it]
 95%|█████████▌| 36237/37963 [82:22:58<3:41:41,  7.71s/it]
 95%|█████████▌| 36238/37963 [82:23:06<3:43:35,  7.78s/it]
 95%|█████████▌| 36239/37963 [82:23:14<3:43:22,  7.77s/it]
 95%|█████████▌| 36240/37963 [82:23:22<3:42:33,  7.75s/it]
                                                          
{'loss': '0.08066', 'grad_norm': '3.333', 'learning_rate': '1.08e-07', 'epoch': '0.9546'}
+
 95%|█████████▌| 36240/37963 [82:23:22<3:42:33,  7.75s/it]
 95%|█████████▌| 36241/37963 [82:23:29<3:41:59,  7.74s/it]
 95%|█████████▌| 36242/37963 [82:23:37<3:41:25,  7.72s/it]
 95%|█████████▌| 36243/37963 [82:23:45<3:42:27,  7.76s/it]
 95%|█████████▌| 36244/37963 [82:23:53<3:41:11,  7.72s/it]
 95%|█████████▌| 36245/37963 [82:24:00<3:38:09,  7.62s/it]
 95%|█████████▌| 36246/37963 [82:24:10<4:01:38,  8.44s/it]
 95%|█████████▌| 36247/37963 [82:24:21<4:22:52,  9.19s/it]
 95%|█████████▌| 36248/37963 [82:24:32<4:32:50,  9.55s/it]
 95%|█████████▌| 36249/37963 [82:24:39<4:18:21,  9.04s/it]
 95%|█████████▌| 36250/37963 [82:24:47<4:07:12,  8.66s/it]
                                                          
{'loss': '0.08461', 'grad_norm': '3.409', 'learning_rate': '1.067e-07', 'epoch': '0.9549'}
+
 95%|█████████▌| 36250/37963 [82:24:47<4:07:12,  8.66s/it]
 95%|█████████▌| 36251/37963 [82:24:55<4:00:16,  8.42s/it]
 95%|█████████▌| 36252/37963 [82:25:03<3:52:48,  8.16s/it]
 95%|█████████▌| 36253/37963 [82:25:10<3:49:13,  8.04s/it]
 95%|█████████▌| 36254/37963 [82:25:18<3:45:27,  7.92s/it]
 96%|█████████▌| 36255/37963 [82:25:28<4:06:09,  8.65s/it]
 96%|█████████▌| 36256/37963 [82:25:36<3:58:49,  8.39s/it]
 96%|█████████▌| 36257/37963 [82:25:47<4:16:49,  9.03s/it]
 96%|█████████▌| 36258/37963 [82:25:57<4:24:48,  9.32s/it]
 96%|█████████▌| 36259/37963 [82:26:04<4:09:54,  8.80s/it]
 96%|█████████▌| 36260/37963 [82:26:12<3:59:46,  8.45s/it]
                                                          
{'loss': '0.07691', 'grad_norm': '3.374', 'learning_rate': '1.055e-07', 'epoch': '0.9551'}
+
 96%|█████████▌| 36260/37963 [82:26:12<3:59:46,  8.45s/it]
 96%|█████████▌| 36261/37963 [82:26:20<3:54:21,  8.26s/it]
 96%|█████████▌| 36262/37963 [82:26:27<3:49:32,  8.10s/it]
 96%|█████████▌| 36263/37963 [82:26:35<3:46:41,  8.00s/it]
 96%|█████████▌| 36264/37963 [82:26:43<3:44:25,  7.93s/it]
 96%|█████████▌| 36265/37963 [82:26:51<3:43:15,  7.89s/it]
 96%|█████████▌| 36266/37963 [82:26:59<3:43:24,  7.90s/it]
 96%|█████████▌| 36267/37963 [82:27:06<3:41:07,  7.82s/it]
 96%|█████████▌| 36268/37963 [82:27:14<3:42:11,  7.87s/it]
 96%|█████████▌| 36269/37963 [82:27:22<3:42:36,  7.88s/it]
 96%|█████████▌| 36270/37963 [82:27:33<4:03:30,  8.63s/it]
                                                          
{'loss': '0.07697', 'grad_norm': '3.824', 'learning_rate': '1.043e-07', 'epoch': '0.9554'}
+
 96%|█████████▌| 36270/37963 [82:27:33<4:03:30,  8.63s/it]
 96%|█████████▌| 36271/37963 [82:27:43<4:19:23,  9.20s/it]
 96%|█████████▌| 36272/37963 [82:27:51<4:07:15,  8.77s/it]
 96%|█████████▌| 36273/37963 [82:27:59<3:57:56,  8.45s/it]
 96%|█████████▌| 36274/37963 [82:28:06<3:50:58,  8.20s/it]
 96%|█████████▌| 36275/37963 [82:28:14<3:44:23,  7.98s/it]
 96%|█████████▌| 36276/37963 [82:28:21<3:41:32,  7.88s/it]
 96%|█████████▌| 36277/37963 [82:28:29<3:35:43,  7.68s/it]
 96%|█████████▌| 36278/37963 [82:28:36<3:34:30,  7.64s/it]
 96%|█████████▌| 36279/37963 [82:28:44<3:35:36,  7.68s/it]
 96%|█████████▌| 36280/37963 [82:28:52<3:36:04,  7.70s/it]
                                                          
{'loss': '0.08639', 'grad_norm': '4.217', 'learning_rate': '1.03e-07', 'epoch': '0.9557'}
+
 96%|█████████▌| 36280/37963 [82:28:52<3:36:04,  7.70s/it]
 96%|█████████▌| 36281/37963 [82:28:59<3:35:31,  7.69s/it]
 96%|█████████▌| 36282/37963 [82:29:07<3:36:22,  7.72s/it]
 96%|█████████▌| 36283/37963 [82:29:15<3:36:30,  7.73s/it]
 96%|█████████▌| 36284/37963 [82:29:22<3:35:46,  7.71s/it]
 96%|█████████▌| 36285/37963 [82:29:30<3:36:17,  7.73s/it]
 96%|█████████▌| 36286/37963 [82:29:38<3:36:55,  7.76s/it]
 96%|█████████▌| 36287/37963 [82:29:46<3:39:13,  7.85s/it]
 96%|█████████▌| 36288/37963 [82:29:54<3:37:44,  7.80s/it]
 96%|█████████▌| 36289/37963 [82:30:01<3:36:05,  7.75s/it]
 96%|█████████▌| 36290/37963 [82:30:09<3:35:24,  7.73s/it]
                                                          
{'loss': '0.08496', 'grad_norm': '3.113', 'learning_rate': '1.018e-07', 'epoch': '0.9559'}
+
 96%|█████████▌| 36290/37963 [82:30:09<3:35:24,  7.73s/it]
 96%|█████████▌| 36291/37963 [82:30:17<3:34:42,  7.71s/it]
 96%|█████████▌| 36292/37963 [82:30:24<3:34:17,  7.69s/it]
 96%|█████████▌| 36293/37963 [82:30:32<3:32:11,  7.62s/it]
 96%|█████████▌| 36294/37963 [82:30:40<3:34:30,  7.71s/it]
 96%|█████████▌| 36295/37963 [82:30:47<3:32:56,  7.66s/it]
 96%|█████████▌| 36296/37963 [82:30:57<3:53:09,  8.39s/it]
 96%|█████████▌| 36297/37963 [82:31:08<4:10:21,  9.02s/it]
 96%|█████████▌| 36298/37963 [82:31:16<3:59:06,  8.62s/it]
 96%|█████████▌| 36299/37963 [82:31:23<3:52:07,  8.37s/it]
 96%|█████████▌| 36300/37963 [82:31:34<4:08:17,  8.96s/it]
                                                          
{'loss': '0.07197', 'grad_norm': '3.291', 'learning_rate': '1.006e-07', 'epoch': '0.9562'}
+
 96%|█████████▌| 36300/37963 [82:31:34<4:08:17,  8.96s/it]
 96%|█████████▌| 36301/37963 [82:31:45<4:24:18,  9.54s/it]
 96%|█████████▌| 36302/37963 [82:31:52<4:07:13,  8.93s/it]
 96%|█████████▌| 36303/37963 [82:32:03<4:19:02,  9.36s/it]
 96%|█████████▌| 36304/37963 [82:32:11<4:09:10,  9.01s/it]
 96%|█████████▌| 36305/37963 [82:32:18<3:58:16,  8.62s/it]
 96%|█████████▌| 36306/37963 [82:32:26<3:49:38,  8.32s/it]
 96%|█████████▌| 36307/37963 [82:32:34<3:45:28,  8.17s/it]
 96%|█████████▌| 36308/37963 [82:32:41<3:40:42,  8.00s/it]
 96%|█████████▌| 36309/37963 [82:32:49<3:38:54,  7.94s/it]
 96%|█████████▌| 36310/37963 [82:32:57<3:36:38,  7.86s/it]
                                                          
{'loss': '0.07536', 'grad_norm': '3.38', 'learning_rate': '9.939e-08', 'epoch': '0.9565'}
+
 96%|█████████▌| 36310/37963 [82:32:57<3:36:38,  7.86s/it]
 96%|█████████▌| 36311/37963 [82:33:05<3:34:21,  7.79s/it]
 96%|█████████▌| 36312/37963 [82:33:15<3:53:08,  8.47s/it]
 96%|█████████▌| 36313/37963 [82:33:23<3:49:02,  8.33s/it]
 96%|█████████▌| 36314/37963 [82:33:30<3:41:03,  8.04s/it]
 96%|█████████▌| 36315/37963 [82:33:38<3:38:58,  7.97s/it]
 96%|█████████▌| 36316/37963 [82:33:45<3:35:06,  7.84s/it]
 96%|█████████▌| 36317/37963 [82:33:53<3:35:42,  7.86s/it]
 96%|█████████▌| 36318/37963 [82:34:01<3:33:35,  7.79s/it]
 96%|█████████▌| 36319/37963 [82:34:09<3:32:05,  7.74s/it]
 96%|█████████▌| 36320/37963 [82:34:16<3:31:09,  7.71s/it]
                                                          
{'loss': '0.0855', 'grad_norm': '3.119', 'learning_rate': '9.82e-08', 'epoch': '0.9567'}
+
 96%|█████████▌| 36320/37963 [82:34:16<3:31:09,  7.71s/it]
 96%|█████████▌| 36321/37963 [82:34:24<3:31:00,  7.71s/it]
 96%|█████████▌| 36322/37963 [82:34:34<3:52:35,  8.50s/it]
 96%|█████████▌| 36323/37963 [82:34:42<3:45:49,  8.26s/it]
 96%|█████████▌| 36324/37963 [82:34:53<4:05:02,  8.97s/it]
 96%|█████████▌| 36325/37963 [82:35:00<3:55:34,  8.63s/it]
 96%|█████████▌| 36326/37963 [82:35:08<3:44:56,  8.24s/it]
 96%|█████████▌| 36327/37963 [82:35:15<3:40:31,  8.09s/it]
 96%|█████████▌| 36328/37963 [82:35:23<3:38:43,  8.03s/it]
 96%|█████████▌| 36329/37963 [82:35:31<3:34:30,  7.88s/it]
 96%|█████████▌| 36330/37963 [82:35:38<3:31:27,  7.77s/it]
                                                          
{'loss': '0.08922', 'grad_norm': '2.814', 'learning_rate': '9.701e-08', 'epoch': '0.957'}
+
 96%|█████████▌| 36330/37963 [82:35:38<3:31:27,  7.77s/it]
 96%|█████████▌| 36331/37963 [82:35:46<3:33:05,  7.83s/it]
 96%|█████████▌| 36332/37963 [82:35:54<3:32:52,  7.83s/it]
 96%|█████████▌| 36333/37963 [82:36:02<3:32:09,  7.81s/it]
 96%|█████████▌| 36334/37963 [82:36:10<3:30:29,  7.75s/it]
 96%|█████████▌| 36335/37963 [82:36:17<3:30:30,  7.76s/it]
 96%|█████████▌| 36336/37963 [82:36:25<3:32:08,  7.82s/it]
 96%|█████████▌| 36337/37963 [82:36:33<3:31:14,  7.79s/it]
 96%|█████████▌| 36338/37963 [82:36:41<3:30:45,  7.78s/it]
 96%|█████████▌| 36339/37963 [82:36:48<3:30:00,  7.76s/it]
 96%|█████████▌| 36340/37963 [82:36:57<3:32:29,  7.86s/it]
                                                          
{'loss': '0.08373', 'grad_norm': '2.608', 'learning_rate': '9.583e-08', 'epoch': '0.9573'}
+
 96%|█████████▌| 36340/37963 [82:36:57<3:32:29,  7.86s/it]
 96%|█████████▌| 36341/37963 [82:37:04<3:28:14,  7.70s/it]
 96%|█████████▌| 36342/37963 [82:37:12<3:29:07,  7.74s/it]
 96%|█████████▌| 36343/37963 [82:37:20<3:31:01,  7.82s/it]
 96%|█████████▌| 36344/37963 [82:37:33<4:12:46,  9.37s/it]
 96%|█████████▌| 36345/37963 [82:37:40<3:59:21,  8.88s/it]
 96%|█████████▌| 36346/37963 [82:37:51<4:09:16,  9.25s/it]
 96%|█████████▌| 36347/37963 [82:37:58<3:57:55,  8.83s/it]
 96%|█████████▌| 36348/37963 [82:38:09<4:07:53,  9.21s/it]
 96%|█████████▌| 36349/37963 [82:38:17<3:58:14,  8.86s/it]
 96%|█████████▌| 36350/37963 [82:38:24<3:48:55,  8.52s/it]
                                                          
{'loss': '0.07349', 'grad_norm': '3.904', 'learning_rate': '9.465e-08', 'epoch': '0.9575'}
+
 96%|█████████▌| 36350/37963 [82:38:24<3:48:55,  8.52s/it]
 96%|█████████▌| 36351/37963 [82:38:32<3:42:46,  8.29s/it]
 96%|█████████▌| 36352/37963 [82:38:40<3:38:41,  8.15s/it]
 96%|█████████▌| 36353/37963 [82:38:47<3:34:17,  7.99s/it]
 96%|█████████▌| 36354/37963 [82:38:57<3:49:36,  8.56s/it]
 96%|█████████▌| 36355/37963 [82:39:05<3:41:53,  8.28s/it]
 96%|█████████▌| 36356/37963 [82:39:13<3:37:25,  8.12s/it]
 96%|█████████▌| 36357/37963 [82:39:20<3:32:35,  7.94s/it]
 96%|█████████▌| 36358/37963 [82:39:28<3:31:13,  7.90s/it]
 96%|█████████▌| 36359/37963 [82:39:36<3:29:58,  7.85s/it]
 96%|█████████▌| 36360/37963 [82:39:43<3:26:48,  7.74s/it]
                                                          
{'loss': '0.08378', 'grad_norm': '3.249', 'learning_rate': '9.348e-08', 'epoch': '0.9578'}
+
 96%|█████████▌| 36360/37963 [82:39:43<3:26:48,  7.74s/it]
 96%|█████████▌| 36361/37963 [82:39:51<3:25:41,  7.70s/it]
 96%|█████████▌| 36362/37963 [82:39:59<3:28:15,  7.80s/it]
 96%|█████████▌| 36363/37963 [82:40:07<3:28:31,  7.82s/it]
 96%|█████████▌| 36364/37963 [82:40:14<3:26:59,  7.77s/it]
 96%|█████████▌| 36365/37963 [82:40:22<3:25:35,  7.72s/it]
 96%|█████████▌| 36366/37963 [82:40:35<4:09:20,  9.37s/it]
 96%|█████████▌| 36367/37963 [82:40:43<3:57:10,  8.92s/it]
 96%|█████████▌| 36368/37963 [82:40:51<3:48:17,  8.59s/it]
 96%|█████████▌| 36369/37963 [82:40:59<3:42:07,  8.36s/it]
 96%|█████████▌| 36370/37963 [82:41:06<3:36:33,  8.16s/it]
                                                          
{'loss': '0.08314', 'grad_norm': '3.404', 'learning_rate': '9.232e-08', 'epoch': '0.958'}
+
 96%|█████████▌| 36370/37963 [82:41:06<3:36:33,  8.16s/it]
 96%|█████████▌| 36371/37963 [82:41:14<3:34:08,  8.07s/it]
 96%|█████████▌| 36372/37963 [82:41:22<3:31:13,  7.97s/it]
 96%|█████████▌| 36373/37963 [82:41:30<3:29:25,  7.90s/it]
 96%|█████████▌| 36374/37963 [82:41:38<3:28:22,  7.87s/it]
 96%|█████████▌| 36375/37963 [82:41:45<3:27:47,  7.85s/it]
 96%|█████████▌| 36376/37963 [82:41:53<3:25:52,  7.78s/it]
 96%|█████████▌| 36377/37963 [82:42:01<3:24:17,  7.73s/it]
 96%|█████████▌| 36378/37963 [82:42:11<3:47:14,  8.60s/it]
 96%|█████████▌| 36379/37963 [82:42:19<3:42:16,  8.42s/it]
 96%|█████████▌| 36380/37963 [82:42:27<3:37:00,  8.23s/it]
                                                          
{'loss': '0.08913', 'grad_norm': '3.99', 'learning_rate': '9.117e-08', 'epoch': '0.9583'}
+
 96%|█████████▌| 36380/37963 [82:42:27<3:37:00,  8.23s/it]
 96%|█████████▌| 36381/37963 [82:42:35<3:33:12,  8.09s/it]
 96%|█████████▌| 36382/37963 [82:42:42<3:29:48,  7.96s/it]
 96%|█████████▌| 36383/37963 [82:42:50<3:28:19,  7.91s/it]
 96%|█████████▌| 36384/37963 [82:42:58<3:27:06,  7.87s/it]
 96%|█████████▌| 36385/37963 [82:43:06<3:26:13,  7.84s/it]
 96%|█████████▌| 36386/37963 [82:43:14<3:25:28,  7.82s/it]
 96%|█████████▌| 36387/37963 [82:43:21<3:23:30,  7.75s/it]
 96%|█████████▌| 36388/37963 [82:43:29<3:22:35,  7.72s/it]
 96%|█████████▌| 36389/37963 [82:43:37<3:24:01,  7.78s/it]
 96%|█████████▌| 36390/37963 [82:43:45<3:24:58,  7.82s/it]
                                                          
{'loss': '0.0861', 'grad_norm': '3.227', 'learning_rate': '9.003e-08', 'epoch': '0.9586'}
+
 96%|█████████▌| 36390/37963 [82:43:45<3:24:58,  7.82s/it]
 96%|█████████▌| 36391/37963 [82:43:52<3:25:06,  7.83s/it]
 96%|█████████▌| 36392/37963 [82:44:03<3:47:11,  8.68s/it]
 96%|█████████▌| 36393/37963 [82:44:11<3:40:42,  8.43s/it]
 96%|█████████▌| 36394/37963 [82:44:21<3:55:18,  9.00s/it]
 96%|█████████▌| 36395/37963 [82:44:32<4:05:39,  9.40s/it]
 96%|█████████▌| 36396/37963 [82:44:40<3:53:16,  8.93s/it]
 96%|█████████▌| 36397/37963 [82:44:47<3:41:45,  8.50s/it]
 96%|█████████▌| 36398/37963 [82:44:55<3:35:48,  8.27s/it]
 96%|█████████▌| 36399/37963 [82:45:03<3:32:00,  8.13s/it]
 96%|█████████▌| 36400/37963 [82:45:10<3:28:24,  8.00s/it]
                                                          
{'loss': '0.08323', 'grad_norm': '4.269', 'learning_rate': '8.889e-08', 'epoch': '0.9588'}
+
 96%|█████████▌| 36400/37963 [82:45:10<3:28:24,  8.00s/it]
 96%|█████████▌| 36401/37963 [82:45:18<3:26:43,  7.94s/it]
 96%|█████████▌| 36402/37963 [82:45:29<3:46:33,  8.71s/it]
 96%|█████████▌| 36403/37963 [82:45:36<3:39:06,  8.43s/it]
 96%|█████████▌| 36404/37963 [82:45:44<3:32:48,  8.19s/it]
 96%|█████████▌| 36405/37963 [82:45:52<3:28:17,  8.02s/it]
 96%|█████████▌| 36406/37963 [82:45:59<3:26:17,  7.95s/it]
 96%|█████████▌| 36407/37963 [82:46:07<3:24:09,  7.87s/it]
 96%|█████████▌| 36408/37963 [82:46:17<3:42:22,  8.58s/it]
 96%|█████████▌| 36409/37963 [82:46:27<3:54:20,  9.05s/it]
 96%|█��███████▌| 36410/37963 [82:46:35<3:45:18,  8.70s/it]
                                                          
{'loss': '0.07606', 'grad_norm': '3.509', 'learning_rate': '8.776e-08', 'epoch': '0.9591'}
+
 96%|█████████▌| 36410/37963 [82:46:35<3:45:18,  8.70s/it]
 96%|█████████▌| 36411/37963 [82:46:43<3:37:26,  8.41s/it]
 96%|█████████▌| 36412/37963 [82:46:51<3:34:17,  8.29s/it]
 96%|█████████▌| 36413/37963 [82:46:59<3:30:13,  8.14s/it]
 96%|█████████▌| 36414/37963 [82:47:07<3:27:18,  8.03s/it]
 96%|█████████▌| 36415/37963 [82:47:15<3:26:30,  8.00s/it]
 96%|█████████▌| 36416/37963 [82:47:22<3:24:26,  7.93s/it]
 96%|█████████▌| 36417/37963 [82:47:30<3:22:18,  7.85s/it]
 96%|█████████▌| 36418/37963 [82:47:38<3:23:20,  7.90s/it]
 96%|█████████▌| 36419/37963 [82:47:46<3:22:20,  7.86s/it]
 96%|█████████▌| 36420/37963 [82:47:56<3:43:05,  8.68s/it]
                                                          
{'loss': '0.07801', 'grad_norm': '4.351', 'learning_rate': '8.663e-08', 'epoch': '0.9594'}
+
 96%|█████████▌| 36420/37963 [82:47:56<3:43:05,  8.68s/it]
 96%|█████████▌| 36421/37963 [82:48:04<3:34:29,  8.35s/it]
 96%|█████████▌| 36422/37963 [82:48:15<3:51:45,  9.02s/it]
 96%|█████████▌| 36423/37963 [82:48:22<3:41:32,  8.63s/it]
 96%|█████████▌| 36424/37963 [82:48:30<3:34:34,  8.37s/it]
 96%|█████████▌| 36425/37963 [82:48:38<3:30:04,  8.20s/it]
 96%|█████████▌| 36426/37963 [82:48:46<3:26:24,  8.06s/it]
 96%|█████████▌| 36427/37963 [82:48:53<3:24:24,  7.98s/it]
 96%|█████████▌| 36428/37963 [82:49:01<3:21:40,  7.88s/it]
 96%|█████████▌| 36429/37963 [82:49:09<3:20:24,  7.84s/it]
 96%|█████████▌| 36430/37963 [82:49:16<3:19:12,  7.80s/it]
                                                          
{'loss': '0.08809', 'grad_norm': '2.956', 'learning_rate': '8.551e-08', 'epoch': '0.9596'}
+
 96%|█████████▌| 36430/37963 [82:49:16<3:19:12,  7.80s/it]
 96%|█████████▌| 36431/37963 [82:49:24<3:19:57,  7.83s/it]
 96%|█████████▌| 36432/37963 [82:49:32<3:18:35,  7.78s/it]
 96%|█████████▌| 36433/37963 [82:49:40<3:16:33,  7.71s/it]
 96%|█████████▌| 36434/37963 [82:49:47<3:17:20,  7.74s/it]
 96%|█████████▌| 36435/37963 [82:49:55<3:16:51,  7.73s/it]
 96%|█████████▌| 36436/37963 [82:50:03<3:16:28,  7.72s/it]
 96%|█████████▌| 36437/37963 [82:50:11<3:17:37,  7.77s/it]
 96%|█████████▌| 36438/37963 [82:50:21<3:37:46,  8.57s/it]
 96%|█████████▌| 36439/37963 [82:50:29<3:31:32,  8.33s/it]
 96%|█████████▌| 36440/37963 [82:50:37<3:27:36,  8.18s/it]
                                                          
{'loss': '0.09254', 'grad_norm': '4.433', 'learning_rate': '8.44e-08', 'epoch': '0.9599'}
+
 96%|█████████▌| 36440/37963 [82:50:37<3:27:36,  8.18s/it]
 96%|█████████▌| 36441/37963 [82:50:48<3:47:40,  8.98s/it]
 96%|█████████▌| 36442/37963 [82:50:55<3:38:30,  8.62s/it]
 96%|█████████▌| 36443/37963 [82:51:03<3:32:38,  8.39s/it]
 96%|█████████▌| 36444/37963 [82:51:11<3:28:06,  8.22s/it]
 96%|█████████▌| 36445/37963 [82:51:21<3:43:48,  8.85s/it]
 96%|█████████▌| 36446/37963 [82:51:29<3:33:55,  8.46s/it]
 96%|█████████▌| 36447/37963 [82:51:37<3:27:53,  8.23s/it]
 96%|█████████▌| 36448/37963 [82:51:44<3:24:27,  8.10s/it]
 96%|█████████▌| 36449/37963 [82:51:52<3:21:52,  8.00s/it]
 96%|█████████▌| 36450/37963 [82:52:00<3:19:16,  7.90s/it]
                                                          
{'loss': '0.09531', 'grad_norm': '2.551', 'learning_rate': '8.33e-08', 'epoch': '0.9601'}
+
 96%|█████████▌| 36450/37963 [82:52:00<3:19:16,  7.90s/it]
 96%|█████████▌| 36451/37963 [82:52:07<3:17:33,  7.84s/it]
 96%|█████████▌| 36452/37963 [82:52:15<3:16:36,  7.81s/it]
 96%|█████████▌| 36453/37963 [82:52:23<3:16:49,  7.82s/it]
 96%|█████████▌| 36454/37963 [82:52:31<3:16:57,  7.83s/it]
 96%|█████████▌| 36455/37963 [82:52:39<3:15:23,  7.77s/it]
 96%|█████████▌| 36456/37963 [82:52:49<3:36:46,  8.63s/it]
 96%|█████████▌| 36457/37963 [82:52:57<3:31:20,  8.42s/it]
 96%|█████████▌| 36458/37963 [82:53:05<3:26:26,  8.23s/it]
 96%|█████████▌| 36459/37963 [82:53:13<3:22:59,  8.10s/it]
 96%|███████���█▌| 36460/37963 [82:53:21<3:21:12,  8.03s/it]
                                                          
{'loss': '0.09099', 'grad_norm': '3.742', 'learning_rate': '8.221e-08', 'epoch': '0.9604'}
+
 96%|█████████▌| 36460/37963 [82:53:21<3:21:12,  8.03s/it]
 96%|█████████▌| 36461/37963 [82:53:29<3:21:25,  8.05s/it]
 96%|█████████▌| 36462/37963 [82:53:39<3:37:24,  8.69s/it]
 96%|█████████▌| 36463/37963 [82:53:49<3:49:10,  9.17s/it]
 96%|█████████▌| 36464/37963 [82:53:57<3:39:58,  8.80s/it]
 96%|█████████▌| 36465/37963 [82:54:05<3:32:12,  8.50s/it]
 96%|█████████▌| 36466/37963 [82:54:15<3:47:46,  9.13s/it]
 96%|█████████▌| 36467/37963 [82:54:23<3:37:55,  8.74s/it]
 96%|█████████▌| 36468/37963 [82:54:31<3:29:03,  8.39s/it]
 96%|█████████▌| 36469/37963 [82:54:39<3:25:46,  8.26s/it]
 96%|█████████▌| 36470/37963 [82:54:46<3:19:00,  8.00s/it]
                                                          
{'loss': '0.08594', 'grad_norm': '2.824', 'learning_rate': '8.112e-08', 'epoch': '0.9607'}
+
 96%|█████████▌| 36470/37963 [82:54:46<3:19:00,  8.00s/it]
 96%|█████████▌| 36471/37963 [82:54:54<3:16:04,  7.89s/it]
 96%|█████████▌| 36472/37963 [82:55:02<3:17:11,  7.94s/it]
 96%|█████████▌| 36473/37963 [82:55:10<3:16:47,  7.92s/it]
 96%|█████████▌| 36474/37963 [82:55:20<3:37:14,  8.75s/it]
 96%|█████████▌| 36475/37963 [82:55:28<3:30:01,  8.47s/it]
 96%|█████████▌| 36476/37963 [82:55:36<3:25:07,  8.28s/it]
 96%|█████████▌| 36477/37963 [82:55:44<3:21:41,  8.14s/it]
 96%|█████████▌| 36478/37963 [82:55:52<3:19:16,  8.05s/it]
 96%|█████████▌| 36479/37963 [82:55:59<3:16:38,  7.95s/it]
 96%|█████████▌| 36480/37963 [82:56:07<3:15:02,  7.89s/it]
                                                          
{'loss': '0.08317', 'grad_norm': '3.303', 'learning_rate': '8.004e-08', 'epoch': '0.9609'}
+
 96%|█████████▌| 36480/37963 [82:56:07<3:15:02,  7.89s/it]
 96%|█████████▌| 36481/37963 [82:56:15<3:12:26,  7.79s/it]
 96%|█████████▌| 36482/37963 [82:56:22<3:11:03,  7.74s/it]
 96%|█████████▌| 36483/37963 [82:56:30<3:10:40,  7.73s/it]
 96%|█████████▌| 36484/37963 [82:56:41<3:31:19,  8.57s/it]
 96%|█████████▌| 36485/37963 [82:56:48<3:24:13,  8.29s/it]
 96%|█████████▌| 36486/37963 [82:56:56<3:19:03,  8.09s/it]
 96%|█████████▌| 36487/37963 [82:57:04<3:17:06,  8.01s/it]
 96%|█████████▌| 36488/37963 [82:57:12<3:15:14,  7.94s/it]
 96%|█████████▌| 36489/37963 [82:57:19<3:14:24,  7.91s/it]
 96%|█████████▌| 36490/37963 [82:57:27<3:14:49,  7.94s/it]
                                                          
{'loss': '0.08354', 'grad_norm': '5.353', 'learning_rate': '7.896e-08', 'epoch': '0.9612'}
+
 96%|█████████▌| 36490/37963 [82:57:27<3:14:49,  7.94s/it]
 96%|█████████▌| 36491/37963 [82:57:35<3:12:44,  7.86s/it]
 96%|█████████▌| 36492/37963 [82:57:47<3:45:59,  9.22s/it]
 96%|█████████▌| 36493/37963 [82:57:55<3:35:47,  8.81s/it]
 96%|█████████▌| 36494/37963 [82:58:03<3:26:36,  8.44s/it]
 96%|█████████▌| 36495/37963 [82:58:11<3:22:44,  8.29s/it]
 96%|█████████▌| 36496/37963 [82:58:19<3:19:25,  8.16s/it]
 96%|█████████▌| 36497/37963 [82:58:26<3:15:37,  8.01s/it]
 96%|█████████▌| 36498/37963 [82:58:34<3:11:02,  7.82s/it]
 96%|█████████▌| 36499/37963 [82:58:41<3:07:54,  7.70s/it]
 96%|█████████▌| 36500/37963 [82:58:52<3:28:21,  8.55s/it]
                                                          
{'loss': '0.08313', 'grad_norm': '3.721', 'learning_rate': '7.79e-08', 'epoch': '0.9615'}
+
 96%|█████████▌| 36500/37963 [82:58:52<3:28:21,  8.55s/it]
 96%|█████████▌| 36501/37963 [82:58:59<3:23:11,  8.34s/it]
 96%|█████████▌| 36502/37963 [82:59:07<3:18:57,  8.17s/it]
 96%|█████████▌| 36503/37963 [82:59:15<3:16:44,  8.09s/it]
 96%|█████████▌| 36504/37963 [82:59:23<3:14:42,  8.01s/it]
 96%|█████████▌| 36505/37963 [82:59:31<3:12:10,  7.91s/it]
 96%|█████████▌| 36506/37963 [82:59:38<3:09:50,  7.82s/it]
 96%|█████████▌| 36507/37963 [82:59:46<3:08:22,  7.76s/it]
 96%|█████████▌| 36508/37963 [82:59:54<3:08:07,  7.76s/it]
 96%|█████████▌| 36509/37963 [83:00:04<3:29:28,  8.64s/it]
 96%|█████████▌| 36510/37963 [83:00:12<3:20:49,  8.29s/it]
                                                          
{'loss': '0.08419', 'grad_norm': '3.957', 'learning_rate': '7.684e-08', 'epoch': '0.9617'}
+
 96%|█████████▌| 36510/37963 [83:00:12<3:20:49,  8.29s/it]
 96%|█████████▌| 36511/37963 [83:00:20<3:17:50,  8.18s/it]
 96%|█████████▌| 36512/37963 [83:00:30<3:33:12,  8.82s/it]
 96%|█████████▌| 36513/37963 [83:00:38<3:28:14,  8.62s/it]
 96%|█████████▌| 36514/37963 [83:00:45<3:18:09,  8.21s/it]
 96%|█████████▌| 36515/37963 [83:00:53<3:15:03,  8.08s/it]
 96%|█████████▌| 36516/37963 [83:01:04<3:32:46,  8.82s/it]
 96%|█████████▌| 36517/37963 [83:01:11<3:24:07,  8.47s/it]
 96%|█████████▌| 36518/37963 [83:01:22<3:39:51,  9.13s/it]
 96%|█████████▌| 36519/37963 [83:01:30<3:29:08,  8.69s/it]
 96%|█████████▌| 36520/37963 [83:01:38<3:23:11,  8.45s/it]
                                                          
{'loss': '0.08312', 'grad_norm': '4.404', 'learning_rate': '7.579e-08', 'epoch': '0.962'}
+
 96%|█████████▌| 36520/37963 [83:01:38<3:23:11,  8.45s/it]
 96%|█████████▌| 36521/37963 [83:01:46<3:18:58,  8.28s/it]
 96%|█████████▌| 36522/37963 [83:01:54<3:16:57,  8.20s/it]
 96%|█████████▌| 36523/37963 [83:02:01<3:12:42,  8.03s/it]
 96%|█████████▌| 36524/37963 [83:02:09<3:09:45,  7.91s/it]
 96%|█████████▌| 36525/37963 [83:02:16<3:07:14,  7.81s/it]
 96%|█████████▌| 36526/37963 [83:02:24<3:06:29,  7.79s/it]
 96%|█████████▌| 36527/37963 [83:02:32<3:06:04,  7.77s/it]
 96%|█████████▌| 36528/37963 [83:02:40<3:05:55,  7.77s/it]
 96%|█████████▌| 36529/37963 [83:02:48<3:06:47,  7.82s/it]
 96%|█████████▌| 36530/37963 [83:02:55<3:03:31,  7.68s/it]
                                                          
{'loss': '0.09115', 'grad_norm': '4.448', 'learning_rate': '7.474e-08', 'epoch': '0.9623'}
+
 96%|█████████▌| 36530/37963 [83:02:55<3:03:31,  7.68s/it]
 96%|█████████▌| 36531/37963 [83:03:03<3:04:10,  7.72s/it]
 96%|█████████▌| 36532/37963 [83:03:10<3:03:09,  7.68s/it]
 96%|█████████▌| 36533/37963 [83:03:18<3:03:31,  7.70s/it]
 96%|█████████▌| 36534/37963 [83:03:26<3:03:40,  7.71s/it]
 96%|█████████▌| 36535/37963 [83:03:34<3:05:46,  7.81s/it]
 96%|█████████▌| 36536/37963 [83:03:42<3:05:00,  7.78s/it]
 96%|█████████▌| 36537/37963 [83:03:49<3:04:11,  7.75s/it]
 96%|█████████▌| 36538/37963 [83:04:00<3:24:57,  8.63s/it]
 96%|█████████▌| 36539/37963 [83:04:08<3:20:35,  8.45s/it]
 96%|█████████▋| 36540/37963 [83:04:16<3:16:05,  8.27s/it]
                                                          
{'loss': '0.07601', 'grad_norm': '3.333', 'learning_rate': '7.37e-08', 'epoch': '0.9625'}
+
 96%|█████████▋| 36540/37963 [83:04:16<3:16:05,  8.27s/it]
 96%|█████████▋| 36541/37963 [83:04:23<3:11:25,  8.08s/it]
 96%|█████████▋| 36542/37963 [83:04:36<3:44:36,  9.48s/it]
 96%|█████████▋| 36543/37963 [83:04:44<3:31:35,  8.94s/it]
 96%|█████████▋| 36544/37963 [83:04:51<3:22:05,  8.55s/it]
 96%|█████████▋| 36545/37963 [83:04:59<3:16:13,  8.30s/it]
 96%|█████████▋| 36546/37963 [83:05:07<3:11:05,  8.09s/it]
 96%|█████████▋| 36547/37963 [83:05:15<3:08:54,  8.00s/it]
 96%|█████████▋| 36548/37963 [83:05:25<3:28:33,  8.84s/it]
 96%|█████████▋| 36549/37963 [83:05:33<3:21:48,  8.56s/it]
 96%|█████████▋| 36550/37963 [83:05:41<3:12:40,  8.18s/it]
                                                          
{'loss': '0.07714', 'grad_norm': '2.788', 'learning_rate': '7.267e-08', 'epoch': '0.9628'}
+
 96%|█████████▋| 36550/37963 [83:05:41<3:12:40,  8.18s/it]
 96%|█████████▋| 36551/37963 [83:05:48<3:09:14,  8.04s/it]
 96%|█████████▋| 36552/37963 [83:05:56<3:06:15,  7.92s/it]
 96%|█████████▋| 36553/37963 [83:06:04<3:04:36,  7.86s/it]
 96%|█████████▋| 36554/37963 [83:06:12<3:05:27,  7.90s/it]
 96%|█████████▋| 36555/37963 [83:06:19<3:03:42,  7.83s/it]
 96%|█████████▋| 36556/37963 [83:06:30<3:22:19,  8.63s/it]
 96%|█████████▋| 36557/37963 [83:06:40<3:35:59,  9.22s/it]
 96%|█████████▋| 36558/37963 [83:06:48<3:25:42,  8.78s/it]
 96%|█████████▋| 36559/37963 [83:06:56<3:19:36,  8.53s/it]
 96%|█████████▋| 36560/37963 [83:07:06<3:31:56,  9.06s/it]
                                                          
{'loss': '0.09042', 'grad_norm': '2.83', 'learning_rate': '7.165e-08', 'epoch': '0.963'}
+
 96%|█████████▋| 36560/37963 [83:07:06<3:31:56,  9.06s/it]
 96%|█████████▋| 36561/37963 [83:07:14<3:22:36,  8.67s/it]
 96%|█████████▋| 36562/37963 [83:07:22<3:13:45,  8.30s/it]
 96%|█████████▋| 36563/37963 [83:07:30<3:10:51,  8.18s/it]
 96%|█████████▋| 36564/37963 [83:07:37<3:08:19,  8.08s/it]
 96%|█████████▋| 36565/37963 [83:07:45<3:07:16,  8.04s/it]
 96%|█████████▋| 36566/37963 [83:07:53<3:04:17,  7.92s/it]
 96%|█████████▋| 36567/37963 [83:08:00<3:01:38,  7.81s/it]
 96%|█████████▋| 36568/37963 [83:08:08<3:00:25,  7.76s/it]
 96%|█████████▋| 36569/37963 [83:08:16<3:01:31,  7.81s/it]
 96%|█████████▋| 36570/37963 [83:08:24<3:01:57,  7.84s/it]
                                                          
{'loss': '0.09038', 'grad_norm': '2.831', 'learning_rate': '7.064e-08', 'epoch': '0.9633'}
+
 96%|█████████▋| 36570/37963 [83:08:24<3:01:57,  7.84s/it]
 96%|█████████▋| 36571/37963 [83:08:32<3:02:24,  7.86s/it]
 96%|█████████▋| 36572/37963 [83:08:42<3:20:54,  8.67s/it]
 96%|█████████▋| 36573/37963 [83:08:50<3:13:49,  8.37s/it]
 96%|█████████▋| 36574/37963 [83:08:58<3:10:06,  8.21s/it]
 96%|█████████▋| 36575/37963 [83:09:05<3:03:33,  7.93s/it]
 96%|█████████▋| 36576/37963 [83:09:13<3:03:01,  7.92s/it]
 96%|█████████▋| 36577/37963 [83:09:21<3:01:41,  7.87s/it]
 96%|█████████▋| 36578/37963 [83:09:29<3:00:38,  7.83s/it]
 96%|█████████▋| 36579/37963 [83:09:36<2:59:14,  7.77s/it]
 96%|█████████▋| 36580/37963 [83:09:44<2:59:47,  7.80s/it]
                                                          
{'loss': '0.08886', 'grad_norm': '4.04', 'learning_rate': '6.963e-08', 'epoch': '0.9636'}
+
 96%|█████████▋| 36580/37963 [83:09:44<2:59:47,  7.80s/it]
 96%|█████████▋| 36581/37963 [83:09:52<2:57:14,  7.69s/it]
 96%|█████████▋| 36582/37963 [83:09:59<2:58:20,  7.75s/it]
 96%|█████████▋| 36583/37963 [83:10:07<2:59:20,  7.80s/it]
 96%|█████████▋| 36584/37963 [83:10:15<2:58:17,  7.76s/it]
 96%|█████████▋| 36585/37963 [83:10:23<2:57:39,  7.74s/it]
 96%|█████████▋| 36586/37963 [83:10:30<2:57:58,  7.75s/it]
 96%|█████████▋| 36587/37963 [83:10:38<2:59:20,  7.82s/it]
 96%|█████████▋| 36588/37963 [83:10:46<2:58:51,  7.80s/it]
 96%|█████████▋| 36589/37963 [83:10:54<2:59:27,  7.84s/it]
 96%|█████████▋| 36590/37963 [83:11:02<2:58:12,  7.79s/it]
                                                          
{'loss': '0.07175', 'grad_norm': '3.608', 'learning_rate': '6.863e-08', 'epoch': '0.9638'}
+
 96%|█████████▋| 36590/37963 [83:11:02<2:58:12,  7.79s/it]
 96%|█████████▋| 36591/37963 [83:11:10<2:58:11,  7.79s/it]
 96%|█████████▋| 36592/37963 [83:11:23<3:34:26,  9.38s/it]
 96%|█████████▋| 36593/37963 [83:11:30<3:23:13,  8.90s/it]
 96%|█████████▋| 36594/37963 [83:11:38<3:16:15,  8.60s/it]
 96%|█████████▋| 36595/37963 [83:11:46<3:09:31,  8.31s/it]
 96%|█████████▋| 36596/37963 [83:11:59<3:43:38,  9.82s/it]
 96%|█████████▋| 36597/37963 [83:12:07<3:29:31,  9.20s/it]
 96%|█████████▋| 36598/37963 [83:12:15<3:19:45,  8.78s/it]
 96%|█████████▋| 36599/37963 [83:12:23<3:13:42,  8.52s/it]
 96%|█████████▋| 36600/37963 [83:12:31<3:08:32,  8.30s/it]
                                                          
{'loss': '0.08015', 'grad_norm': '3.91', 'learning_rate': '6.763e-08', 'epoch': '0.9641'}
+
 96%|█████████▋| 36600/37963 [83:12:31<3:08:32,  8.30s/it]
 96%|█████████▋| 36601/37963 [83:12:38<3:05:29,  8.17s/it]
 96%|█████████▋| 36602/37963 [83:12:46<3:02:02,  8.03s/it]
 96%|█████████▋| 36603/37963 [83:12:54<2:59:50,  7.93s/it]
 96%|█████████▋| 36604/37963 [83:13:02<2:58:00,  7.86s/it]
 96%|█████████▋| 36605/37963 [83:13:15<3:33:11,  9.42s/it]
 96%|█████████▋| 36606/37963 [83:13:22<3:21:25,  8.91s/it]
 96%|█████████▋| 36607/37963 [83:13:30<3:11:41,  8.48s/it]
 96%|█████████▋| 36608/37963 [83:13:40<3:23:40,  9.02s/it]
 96%|█████████▋| 36609/37963 [83:13:47<3:12:07,  8.51s/it]
 96%|█████████▋| 36610/37963 [83:13:55<3:06:13,  8.26s/it]
                                                          
{'loss': '0.1035', 'grad_norm': '3.636', 'learning_rate': '6.664e-08', 'epoch': '0.9644'}
+
 96%|█████████▋| 36610/37963 [83:13:55<3:06:13,  8.26s/it]
 96%|█████████▋| 36611/37963 [83:14:03<3:03:02,  8.12s/it]
 96%|█████████▋| 36612/37963 [83:14:11<3:01:34,  8.06s/it]
 96%|█████████▋| 36613/37963 [83:14:19<2:58:50,  7.95s/it]
 96%|█████████▋| 36614/37963 [83:14:26<2:58:02,  7.92s/it]
 96%|█████████▋| 36615/37963 [83:14:34<2:56:40,  7.86s/it]
 96%|█████████▋| 36616/37963 [83:14:41<2:53:05,  7.71s/it]
 96%|█████████▋| 36617/37963 [83:14:49<2:53:55,  7.75s/it]
 96%|█████████▋| 36618/37963 [83:14:57<2:53:29,  7.74s/it]
 96%|█████████▋| 36619/37963 [83:15:05<2:55:20,  7.83s/it]
 96%|█████████▋| 36620/37963 [83:15:13<2:54:39,  7.80s/it]
                                                          
{'loss': '0.08182', 'grad_norm': '3.478', 'learning_rate': '6.566e-08', 'epoch': '0.9646'}
+
 96%|█████████▋| 36620/37963 [83:15:13<2:54:39,  7.80s/it]
 96%|█████████▋| 36621/37963 [83:15:20<2:53:26,  7.75s/it]
 96%|█████████▋| 36622/37963 [83:15:28<2:53:14,  7.75s/it]
 96%|█████████▋| 36623/37963 [83:15:39<3:12:02,  8.60s/it]
 96%|█████████▋| 36624/37963 [83:15:47<3:08:48,  8.46s/it]
 96%|█████████▋| 36625/37963 [83:15:54<3:01:22,  8.13s/it]
 96%|█████████▋| 36626/37963 [83:16:02<2:55:33,  7.88s/it]
 96%|█████████▋| 36627/37963 [83:16:10<2:57:13,  7.96s/it]
 96%|█████████▋| 36628/37963 [83:16:17<2:55:42,  7.90s/it]
 96%|█████████▋| 36629/37963 [83:16:25<2:55:14,  7.88s/it]
 96%|█████████▋| 36630/37963 [83:16:33<2:55:23,  7.89s/it]
                                                          
{'loss': '0.09021', 'grad_norm': '2.79', 'learning_rate': '6.469e-08', 'epoch': '0.9649'}
+
 96%|█████████▋| 36630/37963 [83:16:33<2:55:23,  7.89s/it]
 96%|█████████▋| 36631/37963 [83:16:41<2:53:54,  7.83s/it]
 96%|█████████▋| 36632/37963 [83:16:49<2:52:35,  7.78s/it]
 96%|█████████▋| 36633/37963 [83:16:56<2:52:21,  7.78s/it]
 96%|█████████▋| 36634/37963 [83:17:04<2:51:11,  7.73s/it]
 97%|█████████▋| 36635/37963 [83:17:12<2:51:47,  7.76s/it]
 97%|█████████▋| 36636/37963 [83:17:25<3:28:55,  9.45s/it]
 97%|█████████▋| 36637/37963 [83:17:33<3:16:41,  8.90s/it]
 97%|█████████▋| 36638/37963 [83:17:41<3:09:29,  8.58s/it]
 97%|█████████▋| 36639/37963 [83:17:48<3:04:10,  8.35s/it]
 97%|█████████▋| 36640/37963 [83:17:56<2:58:52,  8.11s/it]
                                                          
{'loss': '0.07806', 'grad_norm': '3.507', 'learning_rate': '6.373e-08', 'epoch': '0.9652'}
+
 97%|█████████▋| 36640/37963 [83:17:56<2:58:52,  8.11s/it]
 97%|█████████▋| 36641/37963 [83:18:04<2:55:57,  7.99s/it]
 97%|█████████▋| 36642/37963 [83:18:11<2:53:40,  7.89s/it]
 97%|█████████▋| 36643/37963 [83:18:19<2:53:38,  7.89s/it]
 97%|█████████▋| 36644/37963 [83:18:30<3:10:03,  8.65s/it]
 97%|█████████▋| 36645/37963 [83:18:37<3:01:57,  8.28s/it]
 97%|█████████▋| 36646/37963 [83:18:45<2:57:58,  8.11s/it]
 97%|█████████▋| 36647/37963 [83:18:52<2:52:58,  7.89s/it]
 97%|█████████▋| 36648/37963 [83:19:00<2:53:12,  7.90s/it]
 97%|█████████▋| 36649/37963 [83:19:13<3:27:47,  9.49s/it]
 97%|█████████▋| 36650/37963 [83:19:24<3:36:36,  9.90s/it]
                                                          
{'loss': '0.07816', 'grad_norm': '4.441', 'learning_rate': '6.277e-08', 'epoch': '0.9654'}
+
 97%|█████████▋| 36650/37963 [83:19:24<3:36:36,  9.90s/it]
 97%|█████████▋| 36651/37963 [83:19:32<3:22:50,  9.28s/it]
 97%|█████████▋| 36652/37963 [83:19:39<3:09:37,  8.68s/it]
 97%|█████████▋| 36653/37963 [83:19:46<2:59:24,  8.22s/it]
 97%|█████████▋| 36654/37963 [83:19:54<2:55:22,  8.04s/it]
 97%|█████████▋| 36655/37963 [83:20:02<2:53:21,  7.95s/it]
 97%|█████████▋| 36656/37963 [83:20:10<2:52:13,  7.91s/it]
 97%|█████████▋| 36657/37963 [83:20:17<2:51:18,  7.87s/it]
 97%|█████████▋| 36658/37963 [83:20:25<2:52:52,  7.95s/it]
 97%|█████████▋| 36659/37963 [83:20:33<2:52:30,  7.94s/it]
 97%|█████████▋| 36660/37963 [83:20:41<2:50:51,  7.87s/it]
                                                          
{'loss': '0.07664', 'grad_norm': '2.302', 'learning_rate': '6.182e-08', 'epoch': '0.9657'}
+
 97%|█████████▋| 36660/37963 [83:20:41<2:50:51,  7.87s/it]
 97%|█████████▋| 36661/37963 [83:20:49<2:47:59,  7.74s/it]
 97%|█████████▋| 36662/37963 [83:20:59<3:04:16,  8.50s/it]
 97%|█████████▋| 36663/37963 [83:21:07<3:00:18,  8.32s/it]
 97%|█████████▋| 36664/37963 [83:21:14<2:55:21,  8.10s/it]
 97%|█████████▋| 36665/37963 [83:21:22<2:51:27,  7.93s/it]
 97%|█████████▋| 36666/37963 [83:21:30<2:49:49,  7.86s/it]
 97%|█████████▋| 36667/37963 [83:21:37<2:48:26,  7.80s/it]
 97%|█████████▋| 36668/37963 [83:21:45<2:47:02,  7.74s/it]
 97%|█████████▋| 36669/37963 [83:21:52<2:46:05,  7.70s/it]
 97%|█████████▋| 36670/37963 [83:22:00<2:44:11,  7.62s/it]
                                                          
{'loss': '0.08029', 'grad_norm': '3.18', 'learning_rate': '6.087e-08', 'epoch': '0.9659'}
+
 97%|█████████▋| 36670/37963 [83:22:00<2:44:11,  7.62s/it]
 97%|█████████▋| 36671/37963 [83:22:08<2:47:22,  7.77s/it]
 97%|█████████▋| 36672/37963 [83:22:16<2:47:04,  7.77s/it]
 97%|█████████▋| 36673/37963 [83:22:23<2:46:23,  7.74s/it]
 97%|█████████▋| 36674/37963 [83:22:31<2:46:05,  7.73s/it]
 97%|█████████▋| 36675/37963 [83:22:39<2:46:10,  7.74s/it]
 97%|█████████▋| 36676/37963 [83:22:47<2:45:39,  7.72s/it]
 97%|█████████▋| 36677/37963 [83:22:57<3:02:14,  8.50s/it]
 97%|█████████▋| 36678/37963 [83:23:05<2:58:28,  8.33s/it]
 97%|█████████▋| 36679/37963 [83:23:13<2:54:55,  8.17s/it]
 97%|█████████▋| 36680/37963 [83:23:21<2:53:05,  8.09s/it]
                                                          
{'loss': '0.09603', 'grad_norm': '3.873', 'learning_rate': '5.994e-08', 'epoch': '0.9662'}
+
 97%|█████████▋| 36680/37963 [83:23:21<2:53:05,  8.09s/it]
 97%|█████████▋| 36681/37963 [83:23:28<2:49:31,  7.93s/it]
 97%|█████████▋| 36682/37963 [83:23:36<2:48:34,  7.90s/it]
 97%|█████████▋| 36683/37963 [83:23:44<2:49:20,  7.94s/it]
 97%|█████████▋| 36684/37963 [83:23:55<3:07:58,  8.82s/it]
 97%|█████████▋| 36685/37963 [83:24:03<3:01:29,  8.52s/it]
 97%|█████████▋| 36686/37963 [83:24:10<2:55:30,  8.25s/it]
 97%|█████████▋| 36687/37963 [83:24:18<2:51:51,  8.08s/it]
 97%|█████████▋| 36688/37963 [83:24:26<2:49:09,  7.96s/it]
 97%|█████████▋| 36689/37963 [83:24:36<3:04:50,  8.71s/it]
 97%|█████████▋| 36690/37963 [83:24:44<2:56:54,  8.34s/it]
                                                          
{'loss': '0.08256', 'grad_norm': '3.729', 'learning_rate': '5.901e-08', 'epoch': '0.9665'}
+
 97%|█████████▋| 36690/37963 [83:24:44<2:56:54,  8.34s/it]
 97%|█████████▋| 36691/37963 [83:24:51<2:52:14,  8.12s/it]
 97%|█████████▋| 36692/37963 [83:25:04<3:23:14,  9.59s/it]
 97%|█████████▋| 36693/37963 [83:25:12<3:12:45,  9.11s/it]
 97%|█████████▋| 36694/37963 [83:25:20<3:03:10,  8.66s/it]
 97%|█████████▋| 36695/37963 [83:25:30<3:13:29,  9.16s/it]
 97%|█████████▋| 36696/37963 [83:25:38<3:04:33,  8.74s/it]
 97%|█████████▋| 36697/37963 [83:25:45<2:57:02,  8.39s/it]
 97%|█████████▋| 36698/37963 [83:25:56<3:08:23,  8.94s/it]
 97%|█████████▋| 36699/37963 [83:26:04<3:02:31,  8.66s/it]
 97%|█████████▋| 36700/37963 [83:26:11<2:53:12,  8.23s/it]
                                                          
{'loss': '0.08714', 'grad_norm': '4.835', 'learning_rate': '5.809e-08', 'epoch': '0.9667'}
+
 97%|█████████▋| 36700/37963 [83:26:11<2:53:12,  8.23s/it]
 97%|█████████▋| 36701/37963 [83:26:19<2:49:59,  8.08s/it]
 97%|█████████▋| 36702/37963 [83:26:26<2:47:57,  7.99s/it]
 97%|█████████▋| 36703/37963 [83:26:34<2:45:37,  7.89s/it]
 97%|█████████▋| 36704/37963 [83:26:42<2:46:16,  7.92s/it]
 97%|█████████▋| 36705/37963 [83:26:52<3:01:45,  8.67s/it]
 97%|█████████▋| 36706/37963 [83:27:00<2:55:45,  8.39s/it]
 97%|█████████▋| 36707/37963 [83:27:08<2:52:10,  8.22s/it]
 97%|█████████▋| 36708/37963 [83:27:15<2:46:27,  7.96s/it]
 97%|█████████▋| 36709/37963 [83:27:23<2:45:05,  7.90s/it]
 97%|█████████▋| 36710/37963 [83:27:31<2:43:46,  7.84s/it]
                                                          
{'loss': '0.07401', 'grad_norm': '3.915', 'learning_rate': '5.717e-08', 'epoch': '0.967'}
+
 97%|█████████▋| 36710/37963 [83:27:31<2:43:46,  7.84s/it]
 97%|█████████▋| 36711/37963 [83:27:39<2:43:02,  7.81s/it]
 97%|█████████▋| 36712/37963 [83:27:46<2:42:16,  7.78s/it]
 97%|█████████▋| 36713/37963 [83:27:54<2:41:57,  7.77s/it]
 97%|█████████▋| 36714/37963 [83:28:02<2:42:20,  7.80s/it]
 97%|█████████▋| 36715/37963 [83:28:10<2:42:25,  7.81s/it]
 97%|█████████▋| 36716/37963 [83:28:17<2:40:35,  7.73s/it]
 97%|█████████▋| 36717/37963 [83:28:25<2:42:14,  7.81s/it]
 97%|█████████▋| 36718/37963 [83:28:33<2:41:58,  7.81s/it]
 97%|█████████▋| 36719/37963 [83:28:41<2:41:48,  7.80s/it]
 97%|█████████▋| 36720/37963 [83:28:49<2:40:55,  7.77s/it]
                                                          
{'loss': '0.09041', 'grad_norm': '3.513', 'learning_rate': '5.627e-08', 'epoch': '0.9673'}
+
 97%|█████████▋| 36720/37963 [83:28:49<2:40:55,  7.77s/it]
 97%|█████████▋| 36721/37963 [83:28:56<2:40:09,  7.74s/it]
 97%|█████████▋| 36722/37963 [83:29:04<2:39:26,  7.71s/it]
 97%|█████████▋| 36723/37963 [83:29:11<2:37:49,  7.64s/it]
 97%|█████████▋| 36724/37963 [83:29:19<2:37:59,  7.65s/it]
 97%|█████████▋| 36725/37963 [83:29:27<2:39:49,  7.75s/it]
 97%|█████████▋| 36726/37963 [83:29:35<2:40:18,  7.78s/it]
 97%|█████████▋| 36727/37963 [83:29:43<2:40:03,  7.77s/it]
 97%|█████████▋| 36728/37963 [83:29:53<2:57:49,  8.64s/it]
 97%|█████████▋| 36729/37963 [83:30:01<2:50:57,  8.31s/it]
 97%|█████████▋| 36730/37963 [83:30:09<2:48:18,  8.19s/it]
                                                          
{'loss': '0.09092', 'grad_norm': '3.988', 'learning_rate': '5.537e-08', 'epoch': '0.9675'}
+
 97%|█████████▋| 36730/37963 [83:30:09<2:48:18,  8.19s/it]
 97%|█████████▋| 36731/37963 [83:30:19<3:04:04,  8.96s/it]
 97%|█████████▋| 36732/37963 [83:30:27<2:57:41,  8.66s/it]
 97%|█████████▋| 36733/37963 [83:30:35<2:52:56,  8.44s/it]
 97%|█████████▋| 36734/37963 [83:30:43<2:47:42,  8.19s/it]
 97%|█████████▋| 36735/37963 [83:30:51<2:45:04,  8.07s/it]
 97%|█████████▋| 36736/37963 [83:31:01<3:01:04,  8.85s/it]
 97%|█████████▋| 36737/37963 [83:31:09<2:54:23,  8.53s/it]
 97%|█████████▋| 36738/37963 [83:31:17<2:49:22,  8.30s/it]
 97%|█████████▋| 36739/37963 [83:31:25<2:45:03,  8.09s/it]
 97%|█████████▋| 36740/37963 [83:31:32<2:42:52,  7.99s/it]
                                                          
{'loss': '0.08082', 'grad_norm': '2.542', 'learning_rate': '5.447e-08', 'epoch': '0.9678'}
+
 97%|█████████▋| 36740/37963 [83:31:32<2:42:52,  7.99s/it]
 97%|█████████▋| 36741/37963 [83:31:40<2:41:01,  7.91s/it]
 97%|█████████▋| 36742/37963 [83:31:51<2:56:45,  8.69s/it]
 97%|█████████▋| 36743/37963 [83:32:04<3:23:00,  9.98s/it]
 97%|█████████▋| 36744/37963 [83:32:11<3:09:56,  9.35s/it]
 97%|█████████▋| 36745/37963 [83:32:19<3:01:28,  8.94s/it]
 97%|█████████▋| 36746/37963 [83:32:30<3:09:30,  9.34s/it]
 97%|█████████▋| 36747/37963 [83:32:38<3:00:52,  8.92s/it]
 97%|█████████▋| 36748/37963 [83:32:46<2:54:30,  8.62s/it]
 97%|█████████▋| 36749/37963 [83:32:53<2:49:06,  8.36s/it]
 97%|█████████▋| 36750/37963 [83:33:01<2:47:43,  8.30s/it]
                                                          
{'loss': '0.07455', 'grad_norm': '3.068', 'learning_rate': '5.359e-08', 'epoch': '0.9681'}
+
 97%|█████████▋| 36750/37963 [83:33:01<2:47:43,  8.30s/it]
 97%|█████████▋| 36751/37963 [83:33:09<2:45:21,  8.19s/it]
 97%|█████████▋| 36752/37963 [83:33:17<2:42:46,  8.06s/it]
 97%|█████████▋| 36753/37963 [83:33:25<2:39:58,  7.93s/it]
 97%|█████████▋| 36754/37963 [83:33:33<2:38:53,  7.89s/it]
 97%|█████████▋| 36755/37963 [83:33:41<2:39:35,  7.93s/it]
 97%|█████████▋| 36756/37963 [83:33:49<2:39:41,  7.94s/it]
 97%|█████████▋| 36757/37963 [83:33:56<2:39:07,  7.92s/it]
 97%|█████████▋| 36758/37963 [83:34:04<2:37:42,  7.85s/it]
 97%|█████████▋| 36759/37963 [83:34:14<2:48:21,  8.39s/it]
 97%|█████████▋| 36760/37963 [83:34:21<2:43:24,  8.15s/it]
                                                          
{'loss': '0.0764', 'grad_norm': '3.489', 'learning_rate': '5.271e-08', 'epoch': '0.9683'}
+
 97%|█████████▋| 36760/37963 [83:34:21<2:43:24,  8.15s/it]
 97%|█████████▋| 36761/37963 [83:34:29<2:40:45,  8.02s/it]
 97%|█████████▋| 36762/37963 [83:34:37<2:38:53,  7.94s/it]
 97%|█████████▋| 36763/37963 [83:34:44<2:36:54,  7.85s/it]
 97%|█████████▋| 36764/37963 [83:34:52<2:36:35,  7.84s/it]
 97%|█████████▋| 36765/37963 [83:35:00<2:35:43,  7.80s/it]
 97%|█████████▋| 36766/37963 [83:35:08<2:34:10,  7.73s/it]
 97%|█████████▋| 36767/37963 [83:35:15<2:33:55,  7.72s/it]
 97%|█████████▋| 36768/37963 [83:35:23<2:34:18,  7.75s/it]
 97%|█████████▋| 36769/37963 [83:35:31<2:35:12,  7.80s/it]
 97%|█████████▋| 36770/37963 [83:35:39<2:34:30,  7.77s/it]
                                                          
{'loss': '0.07987', 'grad_norm': '3.437', 'learning_rate': '5.184e-08', 'epoch': '0.9686'}
+
 97%|█████████▋| 36770/37963 [83:35:39<2:34:30,  7.77s/it]
 97%|█████████▋| 36771/37963 [83:35:47<2:36:48,  7.89s/it]
 97%|█████████▋| 36772/37963 [83:35:58<2:53:58,  8.76s/it]
 97%|█████████▋| 36773/37963 [83:36:06<2:48:43,  8.51s/it]
 97%|█████████▋| 36774/37963 [83:36:13<2:43:56,  8.27s/it]
 97%|█████████▋| 36775/37963 [83:36:21<2:38:24,  8.00s/it]
 97%|█████████▋| 36776/37963 [83:36:28<2:36:28,  7.91s/it]
 97%|█████████▋| 36777/37963 [83:36:36<2:35:53,  7.89s/it]
 97%|█████████▋| 36778/37963 [83:36:44<2:35:25,  7.87s/it]
 97%|█████████▋| 36779/37963 [83:36:55<2:51:08,  8.67s/it]
 97%|█████████▋| 36780/37963 [83:37:02<2:45:47,  8.41s/it]
                                                          
{'loss': '0.07973', 'grad_norm': '3.776', 'learning_rate': '5.097e-08', 'epoch': '0.9688'}
+
 97%|█████████▋| 36780/37963 [83:37:02<2:45:47,  8.41s/it]
 97%|█████████▋| 36781/37963 [83:37:10<2:41:15,  8.19s/it]
 97%|█████████▋| 36782/37963 [83:37:18<2:37:21,  7.99s/it]
 97%|█████████▋| 36783/37963 [83:37:25<2:34:50,  7.87s/it]
 97%|█████████▋| 36784/37963 [83:37:36<2:51:41,  8.74s/it]
 97%|█████████▋| 36785/37963 [83:37:46<2:59:30,  9.14s/it]
 97%|█████████▋| 36786/37963 [83:37:54<2:51:24,  8.74s/it]
 97%|█████████▋| 36787/37963 [83:38:02<2:45:56,  8.47s/it]
 97%|█████████▋| 36788/37963 [83:38:09<2:40:45,  8.21s/it]
 97%|█████████▋| 36789/37963 [83:38:17<2:38:02,  8.08s/it]
 97%|█████████▋| 36790/37963 [83:38:27<2:50:36,  8.73s/it]
                                                          
{'loss': '0.08674', 'grad_norm': '3.246', 'learning_rate': '5.012e-08', 'epoch': '0.9691'}
+
 97%|█████████▋| 36790/37963 [83:38:27<2:50:36,  8.73s/it]
 97%|█████████▋| 36791/37963 [83:38:38<3:02:14,  9.33s/it]
 97%|█████████▋| 36792/37963 [83:38:48<3:07:46,  9.62s/it]
 97%|█████████▋| 36793/37963 [83:38:56<2:56:54,  9.07s/it]
 97%|█████████▋| 36794/37963 [83:39:04<2:49:51,  8.72s/it]
 97%|█████████▋| 36795/37963 [83:39:11<2:42:16,  8.34s/it]
 97%|█████████▋| 36796/37963 [83:39:19<2:39:14,  8.19s/it]
 97%|█████████▋| 36797/37963 [83:39:27<2:37:10,  8.09s/it]
 97%|█████████▋| 36798/37963 [83:39:35<2:34:13,  7.94s/it]
 97%|█████████▋| 36799/37963 [83:39:42<2:32:42,  7.87s/it]
 97%|█████████▋| 36800/37963 [83:39:50<2:32:11,  7.85s/it]
                                                          
{'loss': '0.07665', 'grad_norm': '3.592', 'learning_rate': '4.927e-08', 'epoch': '0.9694'}
+
 97%|█████████▋| 36800/37963 [83:39:50<2:32:11,  7.85s/it]
 97%|█████████▋| 36801/37963 [83:39:58<2:31:08,  7.80s/it]
 97%|█████████▋| 36802/37963 [83:40:06<2:31:20,  7.82s/it]
 97%|█████████▋| 36803/37963 [83:40:14<2:31:51,  7.85s/it]
 97%|█████████▋| 36804/37963 [83:40:21<2:30:56,  7.81s/it]
 97%|█████████▋| 36805/37963 [83:40:29<2:30:31,  7.80s/it]
 97%|█████████▋| 36806/37963 [83:40:37<2:29:55,  7.77s/it]
 97%|█████████▋| 36807/37963 [83:40:45<2:30:48,  7.83s/it]
 97%|█████████▋| 36808/37963 [83:40:55<2:43:56,  8.52s/it]
 97%|█████████▋| 36809/37963 [83:41:03<2:39:27,  8.29s/it]
 97%|█████████▋| 36810/37963 [83:41:11<2:37:35,  8.20s/it]
                                                          
{'loss': '0.09435', 'grad_norm': '4.218', 'learning_rate': '4.842e-08', 'epoch': '0.9696'}
+
 97%|█████████▋| 36810/37963 [83:41:11<2:37:35,  8.20s/it]
 97%|█████████▋| 36811/37963 [83:41:19<2:35:11,  8.08s/it]
 97%|█████████▋| 36812/37963 [83:41:26<2:33:58,  8.03s/it]
 97%|█████████▋| 36813/37963 [83:41:34<2:32:15,  7.94s/it]
 97%|█████████▋| 36814/37963 [83:41:42<2:31:18,  7.90s/it]
 97%|█████████▋| 36815/37963 [83:41:50<2:30:36,  7.87s/it]
 97%|█████████▋| 36816/37963 [83:41:57<2:28:00,  7.74s/it]
 97%|█████████▋| 36817/37963 [83:42:05<2:29:00,  7.80s/it]
 97%|█████████▋| 36818/37963 [83:42:13<2:28:30,  7.78s/it]
 97%|█████████▋| 36819/37963 [83:42:21<2:28:35,  7.79s/it]
 97%|█████████▋| 36820/37963 [83:42:32<2:46:00,  8.71s/it]
                                                          
{'loss': '0.09384', 'grad_norm': '2.652', 'learning_rate': '4.759e-08', 'epoch': '0.9699'}
+
 97%|█████████▋| 36820/37963 [83:42:32<2:46:00,  8.71s/it]
 97%|█████████▋| 36821/37963 [83:42:39<2:39:43,  8.39s/it]
 97%|█████████▋| 36822/37963 [83:42:47<2:34:57,  8.15s/it]
 97%|█████████▋| 36823/37963 [83:42:54<2:31:51,  7.99s/it]
 97%|█████████▋| 36824/37963 [83:43:02<2:28:55,  7.85s/it]
 97%|█████████▋| 36825/37963 [83:43:10<2:28:59,  7.86s/it]
 97%|█████████▋| 36826/37963 [83:43:17<2:27:52,  7.80s/it]
 97%|█████████▋| 36827/37963 [83:43:25<2:27:11,  7.77s/it]
 97%|█████████▋| 36828/37963 [83:43:36<2:44:13,  8.68s/it]
 97%|█████████▋| 36829/37963 [83:43:46<2:53:40,  9.19s/it]
 97%|█████████▋| 36830/37963 [83:43:54<2:47:05,  8.85s/it]
                                                          
{'loss': '0.09558', 'grad_norm': '3.622', 'learning_rate': '4.676e-08', 'epoch': '0.9702'}
+
 97%|█████████▋| 36830/37963 [83:43:54<2:47:05,  8.85s/it]
 97%|█████████▋| 36831/37963 [83:44:02<2:38:37,  8.41s/it]
 97%|█████████▋| 36832/37963 [83:44:09<2:33:18,  8.13s/it]
 97%|█████████▋| 36833/37963 [83:44:20<2:46:49,  8.86s/it]
 97%|█████████▋| 36834/37963 [83:44:28<2:41:25,  8.58s/it]
 97%|█████████▋| 36835/37963 [83:44:35<2:35:45,  8.29s/it]
 97%|█████████▋| 36836/37963 [83:44:46<2:46:55,  8.89s/it]
 97%|█████████▋| 36837/37963 [83:44:53<2:40:14,  8.54s/it]
 97%|█████████▋| 36838/37963 [83:45:04<2:51:55,  9.17s/it]
 97%|█████████▋| 36839/37963 [83:45:12<2:44:16,  8.77s/it]
 97%|█████████▋| 36840/37963 [83:45:20<2:39:17,  8.51s/it]
                                                          
{'loss': '0.09406', 'grad_norm': '5.036', 'learning_rate': '4.594e-08', 'epoch': '0.9704'}
+
 97%|█████████▋| 36840/37963 [83:45:20<2:39:17,  8.51s/it]
 97%|█████████▋| 36841/37963 [83:45:27<2:32:58,  8.18s/it]
 97%|█████████▋| 36842/37963 [83:45:35<2:28:02,  7.92s/it]
 97%|█████████▋| 36843/37963 [83:45:45<2:40:53,  8.62s/it]
 97%|█████████▋| 36844/37963 [83:45:52<2:35:12,  8.32s/it]
 97%|█████████▋| 36845/37963 [83:46:00<2:32:39,  8.19s/it]
 97%|█████████▋| 36846/37963 [83:46:08<2:29:26,  8.03s/it]
 97%|█████████▋| 36847/37963 [83:46:15<2:26:40,  7.89s/it]
 97%|█████████▋| 36848/37963 [83:46:23<2:24:32,  7.78s/it]
 97%|█████████▋| 36849/37963 [83:46:31<2:24:14,  7.77s/it]
 97%|█████████▋| 36850/37963 [83:46:39<2:24:06,  7.77s/it]
                                                          
{'loss': '0.105', 'grad_norm': '3.527', 'learning_rate': '4.513e-08', 'epoch': '0.9707'}
+
 97%|█████████▋| 36850/37963 [83:46:39<2:24:06,  7.77s/it]
 97%|█████████▋| 36851/37963 [83:46:46<2:23:07,  7.72s/it]
 97%|█████████▋| 36852/37963 [83:46:54<2:23:11,  7.73s/it]
 97%|█████████▋| 36853/37963 [83:47:02<2:22:36,  7.71s/it]
 97%|█████████▋| 36854/37963 [83:47:09<2:22:50,  7.73s/it]
 97%|█████████▋| 36855/37963 [83:47:17<2:20:55,  7.63s/it]
 97%|█████████▋| 36856/37963 [83:47:24<2:21:20,  7.66s/it]
 97%|█████████▋| 36857/37963 [83:47:33<2:23:32,  7.79s/it]
 97%|█████████▋| 36858/37963 [83:47:40<2:23:20,  7.78s/it]
 97%|█████████▋| 36859/37963 [83:47:51<2:36:37,  8.51s/it]
 97%|█████████▋| 36860/37963 [83:47:58<2:30:12,  8.17s/it]
                                                          
{'loss': '0.07791', 'grad_norm': '2.699', 'learning_rate': '4.432e-08', 'epoch': '0.9709'}
+
 97%|█████████▋| 36860/37963 [83:47:58<2:30:12,  8.17s/it]
 97%|█████████▋| 36861/37963 [83:48:06<2:27:57,  8.06s/it]
 97%|█████████▋| 36862/37963 [83:48:13<2:24:37,  7.88s/it]
 97%|█████████▋| 36863/37963 [83:48:24<2:39:47,  8.72s/it]
 97%|█████████▋| 36864/37963 [83:48:31<2:31:21,  8.26s/it]
 97%|█████████▋| 36865/37963 [83:48:39<2:28:48,  8.13s/it]
 97%|█████████▋| 36866/37963 [83:48:47<2:26:23,  8.01s/it]
 97%|█████████▋| 36867/37963 [83:48:54<2:23:00,  7.83s/it]
 97%|█████████▋| 36868/37963 [83:49:01<2:20:09,  7.68s/it]
 97%|█████████▋| 36869/37963 [83:49:09<2:21:04,  7.74s/it]
 97%|█████████▋| 36870/37963 [83:49:17<2:20:14,  7.70s/it]
                                                          
{'loss': '0.07565', 'grad_norm': '3.584', 'learning_rate': '4.352e-08', 'epoch': '0.9712'}
+
 97%|█████████▋| 36870/37963 [83:49:17<2:20:14,  7.70s/it]
 97%|█████████▋| 36871/37963 [83:49:28<2:36:51,  8.62s/it]
 97%|█████████▋| 36872/37963 [83:49:38<2:46:01,  9.13s/it]
 97%|█████████▋| 36873/37963 [83:49:46<2:38:14,  8.71s/it]
 97%|█████████▋| 36874/37963 [83:49:53<2:33:06,  8.44s/it]
 97%|█████████▋| 36875/37963 [83:50:01<2:29:10,  8.23s/it]
 97%|█████████▋| 36876/37963 [83:50:09<2:25:08,  8.01s/it]
 97%|█████████▋| 36877/37963 [83:50:19<2:37:57,  8.73s/it]
 97%|█████████▋| 36878/37963 [83:50:27<2:32:53,  8.46s/it]
 97%|█████████▋| 36879/37963 [83:50:34<2:27:45,  8.18s/it]
 97%|█████████▋| 36880/37963 [83:50:42<2:24:12,  7.99s/it]
                                                          
{'loss': '0.08167', 'grad_norm': '5.096', 'learning_rate': '4.273e-08', 'epoch': '0.9715'}
+
 97%|█████████▋| 36880/37963 [83:50:42<2:24:12,  7.99s/it]
 97%|█████████▋| 36881/37963 [83:50:50<2:22:19,  7.89s/it]
 97%|█████████▋| 36882/37963 [83:50:57<2:21:37,  7.86s/it]
 97%|█████████▋| 36883/37963 [83:51:05<2:18:42,  7.71s/it]
 97%|█████████▋| 36884/37963 [83:51:13<2:19:43,  7.77s/it]
 97%|█████████▋| 36885/37963 [83:51:20<2:18:55,  7.73s/it]
 97%|█████████▋| 36886/37963 [83:51:31<2:33:14,  8.54s/it]
 97%|█████████▋| 36887/37963 [83:51:41<2:41:40,  9.02s/it]
 97%|█████████▋| 36888/37963 [83:51:49<2:34:21,  8.62s/it]
 97%|█████████▋| 36889/37963 [83:51:56<2:29:06,  8.33s/it]
 97%|█████████▋| 36890/37963 [83:52:07<2:39:42,  8.93s/it]
                                                          
{'loss': '0.08993', 'grad_norm': '3.484', 'learning_rate': '4.195e-08', 'epoch': '0.9717'}
+
 97%|█████████▋| 36890/37963 [83:52:07<2:39:42,  8.93s/it]
 97%|█████████▋| 36891/37963 [83:52:14<2:32:46,  8.55s/it]
 97%|█████████▋| 36892/37963 [83:52:22<2:28:42,  8.33s/it]
 97%|█████████▋| 36893/37963 [83:52:30<2:24:35,  8.11s/it]
 97%|█████████▋| 36894/37963 [83:52:37<2:21:56,  7.97s/it]
 97%|█████████▋| 36895/37963 [83:52:45<2:20:38,  7.90s/it]
 97%|█████████▋| 36896/37963 [83:52:53<2:20:47,  7.92s/it]
 97%|█████████▋| 36897/37963 [83:53:01<2:20:03,  7.88s/it]
 97%|█████████▋| 36898/37963 [83:53:08<2:18:56,  7.83s/it]
 97%|█████████▋| 36899/37963 [83:53:16<2:16:50,  7.72s/it]
 97%|█████████▋| 36900/37963 [83:53:24<2:17:27,  7.76s/it]
                                                          
{'loss': '0.08246', 'grad_norm': '3.562', 'learning_rate': '4.117e-08', 'epoch': '0.972'}
+
 97%|█████████▋| 36900/37963 [83:53:24<2:17:27,  7.76s/it]
 97%|█████████▋| 36901/37963 [83:53:32<2:18:43,  7.84s/it]
 97%|█████████▋| 36902/37963 [83:53:40<2:18:32,  7.84s/it]
 97%|█████████▋| 36903/37963 [83:53:50<2:31:32,  8.58s/it]
 97%|█████████▋| 36904/37963 [83:53:57<2:25:32,  8.25s/it]
 97%|█████████▋| 36905/37963 [83:54:05<2:23:42,  8.15s/it]
 97%|█████████▋| 36906/37963 [83:54:13<2:21:00,  8.00s/it]
 97%|█████████▋| 36907/37963 [83:54:20<2:17:30,  7.81s/it]
 97%|█████████▋| 36908/37963 [83:54:28<2:18:11,  7.86s/it]
 97%|█████████▋| 36909/37963 [83:54:36<2:18:20,  7.88s/it]
 97%|█████████▋| 36910/37963 [83:54:44<2:17:10,  7.82s/it]
                                                          
{'loss': '0.08046', 'grad_norm': '3.039', 'learning_rate': '4.04e-08', 'epoch': '0.9723'}
+
 97%|█████████▋| 36910/37963 [83:54:44<2:17:10,  7.82s/it]
 97%|█████████▋| 36911/37963 [83:54:52<2:17:21,  7.83s/it]
 97%|█████████▋| 36912/37963 [83:54:59<2:16:18,  7.78s/it]
 97%|█████████▋| 36913/37963 [83:55:07<2:14:52,  7.71s/it]
 97%|█████████▋| 36914/37963 [83:55:15<2:16:02,  7.78s/it]
 97%|█████████▋| 36915/37963 [83:55:25<2:28:30,  8.50s/it]
 97%|█████████▋| 36916/37963 [83:55:33<2:25:28,  8.34s/it]
 97%|█████████▋| 36917/37963 [83:55:44<2:36:41,  8.99s/it]
 97%|█████████▋| 36918/37963 [83:55:51<2:29:53,  8.61s/it]
 97%|█████████▋| 36919/37963 [83:56:02<2:39:53,  9.19s/it]
 97%|█████████▋| 36920/37963 [83:56:09<2:29:55,  8.62s/it]
                                                          
{'loss': '0.084', 'grad_norm': '3.796', 'learning_rate': '3.964e-08', 'epoch': '0.9725'}
+
 97%|█████████▋| 36920/37963 [83:56:09<2:29:55,  8.62s/it]
 97%|█████████▋| 36921/37963 [83:56:17<2:25:02,  8.35s/it]
 97%|█████████▋| 36922/37963 [83:56:24<2:20:51,  8.12s/it]
 97%|█████████▋| 36923/37963 [83:56:32<2:18:23,  7.98s/it]
 97%|█████████▋| 36924/37963 [83:56:40<2:17:24,  7.93s/it]
 97%|█████████▋| 36925/37963 [83:56:50<2:30:21,  8.69s/it]
 97%|█████████▋| 36926/37963 [83:56:58<2:24:57,  8.39s/it]
 97%|█████████▋| 36927/37963 [83:57:06<2:21:00,  8.17s/it]
 97%|█████████▋| 36928/37963 [83:57:14<2:19:43,  8.10s/it]
 97%|█████████▋| 36929/37963 [83:57:21<2:16:37,  7.93s/it]
 97%|█████████▋| 36930/37963 [83:57:29<2:15:07,  7.85s/it]
                                                          
{'loss': '0.07628', 'grad_norm': '3.754', 'learning_rate': '3.888e-08', 'epoch': '0.9728'}
+
 97%|█████████▋| 36930/37963 [83:57:29<2:15:07,  7.85s/it]
 97%|█████████▋| 36931/37963 [83:57:37<2:15:10,  7.86s/it]
 97%|█████████▋| 36932/37963 [83:57:44<2:14:25,  7.82s/it]
 97%|█████████▋| 36933/37963 [83:57:52<2:13:46,  7.79s/it]
 97%|█████████▋| 36934/37963 [83:58:03<2:26:49,  8.56s/it]
 97%|█████████▋| 36935/37963 [83:58:13<2:34:05,  8.99s/it]
 97%|█████████▋| 36936/37963 [83:58:20<2:27:24,  8.61s/it]
 97%|█████████▋| 36937/37963 [83:58:28<2:23:00,  8.36s/it]
 97%|█████████▋| 36938/37963 [83:58:36<2:20:38,  8.23s/it]
 97%|█████████▋| 36939/37963 [83:58:44<2:17:53,  8.08s/it]
 97%|█████████▋| 36940/37963 [83:58:52<2:17:03,  8.04s/it]
                                                          
{'loss': '0.09899', 'grad_norm': '3.721', 'learning_rate': '3.814e-08', 'epoch': '0.9731'}
+
 97%|█████████▋| 36940/37963 [83:58:52<2:17:03,  8.04s/it]
 97%|█████████▋| 36941/37963 [83:58:59<2:15:07,  7.93s/it]
 97%|█████████▋| 36942/37963 [83:59:07<2:15:35,  7.97s/it]
 97%|█████████▋| 36943/37963 [83:59:15<2:12:39,  7.80s/it]
 97%|█████████▋| 36944/37963 [83:59:25<2:25:53,  8.59s/it]
 97%|█████████▋| 36945/37963 [83:59:33<2:21:27,  8.34s/it]
 97%|█████████▋| 36946/37963 [83:59:41<2:18:04,  8.15s/it]
 97%|█████████▋| 36947/37963 [83:59:51<2:28:32,  8.77s/it]
 97%|█████████▋| 36948/37963 [83:59:59<2:23:38,  8.49s/it]
 97%|█████████▋| 36949/37963 [84:00:07<2:21:08,  8.35s/it]
 97%|█████████▋| 36950/37963 [84:00:15<2:20:15,  8.31s/it]
                                                          
{'loss': '0.09374', 'grad_norm': '2.957', 'learning_rate': '3.739e-08', 'epoch': '0.9733'}
+
 97%|█████████▋| 36950/37963 [84:00:15<2:20:15,  8.31s/it]
 97%|█████████▋| 36951/37963 [84:00:23<2:18:42,  8.22s/it]
 97%|█████████▋| 36952/37963 [84:00:31<2:16:30,  8.10s/it]
 97%|█████████▋| 36953/37963 [84:00:38<2:14:01,  7.96s/it]
 97%|█████████▋| 36954/37963 [84:00:46<2:12:51,  7.90s/it]
 97%|█████████▋| 36955/37963 [84:00:54<2:14:15,  7.99s/it]
 97%|█████████▋| 36956/37963 [84:01:02<2:12:01,  7.87s/it]
 97%|█████████▋| 36957/37963 [84:01:10<2:11:06,  7.82s/it]
 97%|█████████▋| 36958/37963 [84:01:17<2:09:40,  7.74s/it]
 97%|█████████▋| 36959/37963 [84:01:25<2:10:12,  7.78s/it]
 97%|█████████▋| 36960/37963 [84:01:33<2:10:16,  7.79s/it]
                                                          
{'loss': '0.08018', 'grad_norm': '3.279', 'learning_rate': '3.666e-08', 'epoch': '0.9736'}
+
 97%|█████████▋| 36960/37963 [84:01:33<2:10:16,  7.79s/it]
 97%|█████████▋| 36961/37963 [84:01:40<2:08:36,  7.70s/it]
 97%|█████████▋| 36962/37963 [84:01:48<2:09:24,  7.76s/it]
 97%|█████████▋| 36963/37963 [84:01:59<2:23:01,  8.58s/it]
 97%|█████████▋| 36964/37963 [84:02:07<2:20:04,  8.41s/it]
 97%|█████████▋| 36965/37963 [84:02:14<2:16:00,  8.18s/it]
 97%|█████████▋| 36966/37963 [84:02:25<2:28:41,  8.95s/it]
 97%|█████████▋| 36967/37963 [84:02:33<2:23:32,  8.65s/it]
 97%|█████████▋| 36968/37963 [84:02:44<2:33:29,  9.26s/it]
 97%|█████████▋| 36969/37963 [84:02:54<2:40:03,  9.66s/it]
 97%|█████████▋| 36970/37963 [84:03:02<2:31:21,  9.15s/it]
                                                          
{'loss': '0.06336', 'grad_norm': '3.53', 'learning_rate': '3.594e-08', 'epoch': '0.9738'}
+
 97%|█████████▋| 36970/37963 [84:03:02<2:31:21,  9.15s/it]
 97%|█████████▋| 36971/37963 [84:03:10<2:24:55,  8.77s/it]
 97%|█████████▋| 36972/37963 [84:03:18<2:18:23,  8.38s/it]
 97%|█████████▋| 36973/37963 [84:03:25<2:14:28,  8.15s/it]
 97%|█████████▋| 36974/37963 [84:03:33<2:12:50,  8.06s/it]
 97%|█████████▋| 36975/37963 [84:03:41<2:11:09,  7.97s/it]
 97%|█████████▋| 36976/37963 [84:03:48<2:08:25,  7.81s/it]
 97%|█████████▋| 36977/37963 [84:03:56<2:06:29,  7.70s/it]
 97%|█████████▋| 36978/37963 [84:04:04<2:06:31,  7.71s/it]
 97%|█████████▋| 36979/37963 [84:04:14<2:18:20,  8.44s/it]
 97%|█████████▋| 36980/37963 [84:04:22<2:15:17,  8.26s/it]
                                                          
{'loss': '0.08604', 'grad_norm': '3.848', 'learning_rate': '3.522e-08', 'epoch': '0.9741'}
+
 97%|█████████▋| 36980/37963 [84:04:22<2:15:17,  8.26s/it]
 97%|█████████▋| 36981/37963 [84:04:29<2:11:52,  8.06s/it]
 97%|█████████▋| 36982/37963 [84:04:37<2:10:12,  7.96s/it]
 97%|█████████▋| 36983/37963 [84:04:45<2:09:09,  7.91s/it]
 97%|█████████▋| 36984/37963 [84:04:52<2:08:18,  7.86s/it]
 97%|█████████▋| 36985/37963 [84:05:00<2:08:49,  7.90s/it]
 97%|█████████▋| 36986/37963 [84:05:08<2:08:20,  7.88s/it]
 97%|█████████▋| 36987/37963 [84:05:18<2:18:32,  8.52s/it]
 97%|█████████▋| 36988/37963 [84:05:26<2:13:59,  8.25s/it]
 97%|█████████▋| 36989/37963 [84:05:34<2:11:25,  8.10s/it]
 97%|█████████▋| 36990/37963 [84:05:42<2:10:21,  8.04s/it]
                                                          
{'loss': '0.08167', 'grad_norm': '4.538', 'learning_rate': '3.45e-08', 'epoch': '0.9744'}
+
 97%|█████████▋| 36990/37963 [84:05:42<2:10:21,  8.04s/it]
 97%|█████████▋| 36991/37963 [84:05:49<2:07:55,  7.90s/it]
 97%|█████████▋| 36992/37963 [84:05:56<2:04:21,  7.68s/it]
 97%|█████████▋| 36993/37963 [84:06:04<2:04:48,  7.72s/it]
 97%|█████████▋| 36994/37963 [84:06:12<2:04:37,  7.72s/it]
 97%|█████████▋| 36995/37963 [84:06:19<2:04:25,  7.71s/it]
 97%|█████████▋| 36996/37963 [84:06:27<2:04:15,  7.71s/it]
 97%|█████████▋| 36997/37963 [84:06:35<2:04:19,  7.72s/it]
 97%|█████████▋| 36998/37963 [84:06:46<2:17:57,  8.58s/it]
 97%|█████████▋| 36999/37963 [84:06:54<2:14:59,  8.40s/it]
 97%|█████████▋| 37000/37963 [84:07:01<2:11:34,  8.20s/it]
                                                          
{'loss': '0.07924', 'grad_norm': '4.258', 'learning_rate': '3.38e-08', 'epoch': '0.9746'}
+
 97%|█████████▋| 37000/37963 [84:07:01<2:11:34,  8.20s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.36s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.36s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:319: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 97%|█████████▋| 37001/37963 [84:07:58<6:03:55, 22.70s/it]
 97%|█████████▋| 37002/37963 [84:08:06<4:53:41, 18.34s/it]
 97%|█████████▋| 37003/37963 [84:08:13<4:00:51, 15.05s/it]
 97%|█████████▋| 37004/37963 [84:08:21<3:24:45, 12.81s/it]
 97%|█████████▋| 37005/37963 [84:08:29<3:00:15, 11.29s/it]
 97%|████��████▋| 37006/37963 [84:08:36<2:42:07, 10.17s/it]
 97%|█████████▋| 37007/37963 [84:08:44<2:29:42,  9.40s/it]
 97%|█████████▋| 37008/37963 [84:08:55<2:35:55,  9.80s/it]
 97%|█████████▋| 37009/37963 [84:09:03<2:27:42,  9.29s/it]
 97%|█████████▋| 37010/37963 [84:09:11<2:21:58,  8.94s/it]
                                                          
{'loss': '0.07543', 'grad_norm': '3.393', 'learning_rate': '3.31e-08', 'epoch': '0.9749'}
+
 97%|█████████▋| 37010/37963 [84:09:11<2:21:58,  8.94s/it]
 97%|█████████▋| 37011/37963 [84:09:21<2:27:34,  9.30s/it]
 97%|█████████▋| 37012/37963 [84:09:29<2:20:22,  8.86s/it]
 97%|█████████▋| 37013/37963 [84:09:37<2:15:20,  8.55s/it]
 98%|█████████▊| 37014/37963 [84:09:44<2:10:18,  8.24s/it]
 98%|█████████▊| 37015/37963 [84:09:57<2:33:27,  9.71s/it]
 98%|█████████▊| 37016/37963 [84:10:05<2:24:43,  9.17s/it]
 98%|█████████▊| 37017/37963 [84:10:13<2:17:35,  8.73s/it]
 98%|█████████▊| 37018/37963 [84:10:21<2:13:10,  8.46s/it]
 98%|█████████▊| 37019/37963 [84:10:28<2:09:56,  8.26s/it]
 98%|█████████▊| 37020/37963 [84:10:36<2:06:29,  8.05s/it]
                                                          
{'loss': '0.07579', 'grad_norm': '4.73', 'learning_rate': '3.241e-08', 'epoch': '0.9752'}
+
 98%|█████████▊| 37020/37963 [84:10:36<2:06:29,  8.05s/it]
 98%|█████████▊| 37021/37963 [84:10:44<2:04:02,  7.90s/it]
 98%|█████████▊| 37022/37963 [84:10:51<2:03:37,  7.88s/it]
 98%|█████████▊| 37023/37963 [84:10:59<2:03:54,  7.91s/it]
 98%|█████████▊| 37024/37963 [84:11:07<2:03:25,  7.89s/it]
 98%|█████████▊| 37025/37963 [84:11:15<2:03:10,  7.88s/it]
 98%|█████████▊| 37026/37963 [84:11:23<2:01:29,  7.78s/it]
 98%|█████████▊| 37027/37963 [84:11:30<1:59:39,  7.67s/it]
 98%|█████████▊| 37028/37963 [84:11:40<2:12:02,  8.47s/it]
 98%|█████████▊| 37029/37963 [84:11:48<2:08:06,  8.23s/it]
 98%|█████████▊| 37030/37963 [84:11:56<2:05:56,  8.10s/it]
                                                          
{'loss': '0.07392', 'grad_norm': '3.542', 'learning_rate': '3.173e-08', 'epoch': '0.9754'}
+
 98%|█████████▊| 37030/37963 [84:11:56<2:05:56,  8.10s/it]
 98%|█████████▊| 37031/37963 [84:12:04<2:04:55,  8.04s/it]
 98%|█████████▊| 37032/37963 [84:12:12<2:05:09,  8.07s/it]
 98%|█████████▊| 37033/37963 [84:12:20<2:03:41,  7.98s/it]
 98%|█████████▊| 37034/37963 [84:12:27<2:00:48,  7.80s/it]
 98%|█████████▊| 37035/37963 [84:12:35<1:59:52,  7.75s/it]
 98%|█████████▊| 37036/37963 [84:12:42<2:00:05,  7.77s/it]
 98%|█████████▊| 37037/37963 [84:12:53<2:10:52,  8.48s/it]
 98%|█████████▊| 37038/37963 [84:13:01<2:08:49,  8.36s/it]
 98%|█████████▊| 37039/37963 [84:13:08<2:06:19,  8.20s/it]
 98%|█████████▊| 37040/37963 [84:13:16<2:03:18,  8.02s/it]
                                                          
{'loss': '0.07374', 'grad_norm': '3.064', 'learning_rate': '3.105e-08', 'epoch': '0.9757'}
+
 98%|█████████▊| 37040/37963 [84:13:16<2:03:18,  8.02s/it]
 98%|█████████▊| 37041/37963 [84:13:24<2:02:07,  7.95s/it]
 98%|█████████▊| 37042/37963 [84:13:32<2:00:58,  7.88s/it]
 98%|█████████▊| 37043/37963 [84:13:39<1:59:55,  7.82s/it]
 98%|█████████▊| 37044/37963 [84:13:47<1:59:04,  7.77s/it]
 98%|█████████▊| 37045/37963 [84:13:55<1:58:31,  7.75s/it]
 98%|█████████▊| 37046/37963 [84:14:02<1:57:19,  7.68s/it]
 98%|█████████▊| 37047/37963 [84:14:10<1:56:35,  7.64s/it]
 98%|█████████▊| 37048/37963 [84:14:17<1:55:08,  7.55s/it]
 98%|█████████▊| 37049/37963 [84:14:30<2:20:18,  9.21s/it]
 98%|█████████▊| 37050/37963 [84:14:38<2:13:21,  8.76s/it]
                                                          
{'loss': '0.1015', 'grad_norm': '4.168', 'learning_rate': '3.039e-08', 'epoch': '0.976'}
+
 98%|█████████▊| 37050/37963 [84:14:38<2:13:21,  8.76s/it]
 98%|█████████▊| 37051/37963 [84:14:48<2:21:46,  9.33s/it]
 98%|█████████▊| 37052/37963 [84:14:56<2:14:20,  8.85s/it]
 98%|█████████▊| 37053/37963 [84:15:04<2:09:33,  8.54s/it]
 98%|█████████▊| 37054/37963 [84:15:12<2:05:22,  8.28s/it]
 98%|█████████▊| 37055/37963 [84:15:19<2:02:53,  8.12s/it]
 98%|█████████▊| 37056/37963 [84:15:27<2:01:47,  8.06s/it]
 98%|█████████▊| 37057/37963 [84:15:35<2:00:06,  7.95s/it]
 98%|█████████▊| 37058/37963 [84:15:43<1:59:51,  7.95s/it]
 98%|█████████▊| 37059/37963 [84:15:51<1:58:28,  7.86s/it]
 98%|█████████▊| 37060/37963 [84:16:01<2:10:31,  8.67s/it]
                                                          
{'loss': '0.0927', 'grad_norm': '3.681', 'learning_rate': '2.973e-08', 'epoch': '0.9762'}
+
 98%|█████████▊| 37060/37963 [84:16:01<2:10:31,  8.67s/it]
 98%|█████████▊| 37061/37963 [84:16:09<2:05:27,  8.35s/it]
 98%|█████████▊| 37062/37963 [84:16:17<2:03:28,  8.22s/it]
 98%|█████████▊| 37063/37963 [84:16:25<2:01:49,  8.12s/it]
 98%|█████████▊| 37064/37963 [84:16:35<2:12:38,  8.85s/it]
 98%|█████████▊| 37065/37963 [84:16:43<2:07:59,  8.55s/it]
 98%|█████████▊| 37066/37963 [84:16:51<2:04:16,  8.31s/it]
 98%|█████████▊| 37067/37963 [84:16:59<2:01:37,  8.14s/it]
 98%|█████████▊| 37068/37963 [84:17:06<2:00:03,  8.05s/it]
 98%|█████████▊| 37069/37963 [84:17:17<2:11:09,  8.80s/it]
 98%|█████████▊| 37070/37963 [84:17:25<2:07:19,  8.55s/it]
                                                          
{'loss': '0.09479', 'grad_norm': '4.02', 'learning_rate': '2.907e-08', 'epoch': '0.9765'}
+
 98%|█████████▊| 37070/37963 [84:17:25<2:07:19,  8.55s/it]
 98%|█████████▊| 37071/37963 [84:17:33<2:03:11,  8.29s/it]
 98%|█████████▊| 37072/37963 [84:17:40<1:58:59,  8.01s/it]
 98%|█████████▊| 37073/37963 [84:17:48<1:58:00,  7.96s/it]
 98%|█████████▊| 37074/37963 [84:17:55<1:56:47,  7.88s/it]
 98%|█████████▊| 37075/37963 [84:18:03<1:56:27,  7.87s/it]
 98%|█████████▊| 37076/37963 [84:18:11<1:55:49,  7.84s/it]
 98%|█████████▊| 37077/37963 [84:18:19<1:54:10,  7.73s/it]
 98%|█████████▊| 37078/37963 [84:18:26<1:53:13,  7.68s/it]
 98%|█████████▊| 37079/37963 [84:18:34<1:53:18,  7.69s/it]
 98%|█████████▊| 37080/37963 [84:18:44<2:03:24,  8.39s/it]
                                                          
{'loss': '0.07861', 'grad_norm': '2.858', 'learning_rate': '2.843e-08', 'epoch': '0.9767'}
+
 98%|█████████▊| 37080/37963 [84:18:44<2:03:24,  8.39s/it]
 98%|█████████▊| 37081/37963 [84:18:54<2:10:18,  8.86s/it]
 98%|█████████▊| 37082/37963 [84:19:01<2:04:50,  8.50s/it]
 98%|█████████▊| 37083/37963 [84:19:09<2:01:10,  8.26s/it]
 98%|█████████▊| 37084/37963 [84:19:17<1:59:16,  8.14s/it]
 98%|█████████▊| 37085/37963 [84:19:25<1:57:20,  8.02s/it]
 98%|█████████▊| 37086/37963 [84:19:33<1:56:52,  8.00s/it]
 98%|█████████▊| 37087/37963 [84:19:40<1:55:12,  7.89s/it]
 98%|█████████▊| 37088/37963 [84:19:48<1:53:48,  7.80s/it]
 98%|█████████▊| 37089/37963 [84:19:56<1:54:30,  7.86s/it]
 98%|█████████▊| 37090/37963 [84:20:04<1:54:04,  7.84s/it]
                                                          
{'loss': '0.07783', 'grad_norm': '3.515', 'learning_rate': '2.779e-08', 'epoch': '0.977'}
+
 98%|█████████▊| 37090/37963 [84:20:04<1:54:04,  7.84s/it]
 98%|█████████▊| 37091/37963 [84:20:11<1:53:25,  7.80s/it]
 98%|█████████▊| 37092/37963 [84:20:19<1:53:55,  7.85s/it]
 98%|█████████▊| 37093/37963 [84:20:27<1:52:38,  7.77s/it]
 98%|█████████▊| 37094/37963 [84:20:37<2:03:39,  8.54s/it]
 98%|█████████▊| 37095/37963 [84:20:45<1:59:56,  8.29s/it]
 98%|█████████▊| 37096/37963 [84:20:53<1:57:14,  8.11s/it]
 98%|█████████▊| 37097/37963 [84:21:03<2:06:29,  8.76s/it]
 98%|█████████▊| 37098/37963 [84:21:11<2:03:09,  8.54s/it]
 98%|█████████▊| 37099/37963 [84:21:22<2:11:31,  9.13s/it]
 98%|█████████▊| 37100/37963 [84:21:29<2:05:17,  8.71s/it]
                                                          
{'loss': '0.07275', 'grad_norm': '3.037', 'learning_rate': '2.715e-08', 'epoch': '0.9773'}
+
 98%|█████████▊| 37100/37963 [84:21:29<2:05:17,  8.71s/it]
 98%|█████████▊| 37101/37963 [84:21:37<2:00:49,  8.41s/it]
 98%|█████████▊| 37102/37963 [84:21:45<1:59:07,  8.30s/it]
 98%|█████████▊| 37103/37963 [84:21:53<1:56:17,  8.11s/it]
 98%|█████████▊| 37104/37963 [84:22:00<1:53:24,  7.92s/it]
 98%|█████████▊| 37105/37963 [84:22:08<1:51:19,  7.79s/it]
 98%|█████████▊| 37106/37963 [84:22:15<1:51:08,  7.78s/it]
 98%|█████████▊| 37107/37963 [84:22:26<2:03:28,  8.65s/it]
 98%|█████████▊| 37108/37963 [84:22:34<2:00:29,  8.46s/it]
 98%|█████████▊| 37109/37963 [84:22:42<1:57:09,  8.23s/it]
 98%|█████████▊| 37110/37963 [84:22:50<1:55:00,  8.09s/it]
                                                          
{'loss': '0.08102', 'grad_norm': '3.95', 'learning_rate': '2.653e-08', 'epoch': '0.9775'}
+
 98%|█████████▊| 37110/37963 [84:22:50<1:55:00,  8.09s/it]
 98%|█████████▊| 37111/37963 [84:22:57<1:53:13,  7.97s/it]
 98%|█████████▊| 37112/37963 [84:23:08<2:03:57,  8.74s/it]
 98%|█████████▊| 37113/37963 [84:23:15<1:58:30,  8.36s/it]
 98%|█████████▊| 37114/37963 [84:23:23<1:55:50,  8.19s/it]
 98%|█████████▊| 37115/37963 [84:23:31<1:53:42,  8.05s/it]
 98%|█████████▊| 37116/37963 [84:23:39<1:53:00,  8.00s/it]
 98%|█████████▊| 37117/37963 [84:23:46<1:51:15,  7.89s/it]
 98%|█████████▊| 37118/37963 [84:23:54<1:49:53,  7.80s/it]
 98%|█████████▊| 37119/37963 [84:24:02<1:50:14,  7.84s/it]
 98%|█████████▊| 37120/37963 [84:24:10<1:49:59,  7.83s/it]
                                                          
{'loss': '0.08298', 'grad_norm': '3.03', 'learning_rate': '2.591e-08', 'epoch': '0.9778'}
+
 98%|█████████▊| 37120/37963 [84:24:10<1:49:59,  7.83s/it]
 98%|█████████▊| 37121/37963 [84:24:20<2:01:15,  8.64s/it]
 98%|█████████▊| 37122/37963 [84:24:28<1:58:18,  8.44s/it]
 98%|█████████▊| 37123/37963 [84:24:36<1:55:25,  8.24s/it]
 98%|█████████▊| 37124/37963 [84:24:46<2:04:04,  8.87s/it]
 98%|█████████▊| 37125/37963 [84:24:54<1:59:49,  8.58s/it]
 98%|█████████▊| 37126/37963 [84:25:02<1:55:57,  8.31s/it]
 98%|█████████▊| 37127/37963 [84:25:09<1:52:53,  8.10s/it]
 98%|█████████▊| 37128/37963 [84:25:17<1:50:45,  7.96s/it]
 98%|█████████▊| 37129/37963 [84:25:25<1:49:47,  7.90s/it]
 98%|█████████▊| 37130/37963 [84:25:32<1:48:21,  7.80s/it]
                                                          
{'loss': '0.08792', 'grad_norm': '3.869', 'learning_rate': '2.53e-08', 'epoch': '0.9781'}
+
 98%|█████████▊| 37130/37963 [84:25:32<1:48:21,  7.80s/it]
 98%|█████████▊| 37131/37963 [84:25:40<1:47:36,  7.76s/it]
 98%|█████████▊| 37132/37963 [84:25:50<1:58:12,  8.53s/it]
 98%|█████████▊| 37133/37963 [84:25:58<1:55:34,  8.36s/it]
 98%|█████████▊| 37134/37963 [84:26:06<1:51:54,  8.10s/it]
 98%|█████████▊| 37135/37963 [84:26:14<1:50:29,  8.01s/it]
 98%|█████████▊| 37136/37963 [84:26:21<1:48:15,  7.85s/it]
 98%|█████████▊| 37137/37963 [84:26:29<1:46:25,  7.73s/it]
 98%|█████████▊| 37138/37963 [84:26:36<1:46:11,  7.72s/it]
 98%|█████████▊| 37139/37963 [84:26:44<1:47:05,  7.80s/it]
 98%|█████████▊| 37140/37963 [84:26:52<1:46:28,  7.76s/it]
                                                          
{'loss': '0.09095', 'grad_norm': '4.278', 'learning_rate': '2.47e-08', 'epoch': '0.9783'}
+
 98%|█████████▊| 37140/37963 [84:26:52<1:46:28,  7.76s/it]
 98%|█████████▊| 37141/37963 [84:27:00<1:45:24,  7.69s/it]
 98%|█████████▊| 37142/37963 [84:27:08<1:46:36,  7.79s/it]
 98%|█████████▊| 37143/37963 [84:27:18<1:58:05,  8.64s/it]
 98%|█████████▊| 37144/37963 [84:27:26<1:54:26,  8.38s/it]
 98%|█████████▊| 37145/37963 [84:27:36<2:02:24,  8.98s/it]
 98%|█████████▊| 37146/37963 [84:27:44<1:57:24,  8.62s/it]
 98%|█████████▊| 37147/37963 [84:27:54<2:04:25,  9.15s/it]
 98%|█████████▊| 37148/37963 [84:28:02<1:57:49,  8.67s/it]
 98%|█████████▊| 37149/37963 [84:28:09<1:52:36,  8.30s/it]
 98%|█████████▊| 37150/37963 [84:28:17<1:49:54,  8.11s/it]
                                                          
{'loss': '0.09241', 'grad_norm': '6.506', 'learning_rate': '2.41e-08', 'epoch': '0.9786'}
+
 98%|█████████▊| 37150/37963 [84:28:17<1:49:54,  8.11s/it]
 98%|█████████▊| 37151/37963 [84:28:28<2:00:14,  8.88s/it]
 98%|█████████▊| 37152/37963 [84:28:35<1:55:01,  8.51s/it]
 98%|█████████▊| 37153/37963 [84:28:43<1:51:01,  8.22s/it]
 98%|█████████▊| 37154/37963 [84:28:51<1:49:41,  8.13s/it]
 98%|█████████▊| 37155/37963 [84:28:59<1:48:30,  8.06s/it]
 98%|█████████▊| 37156/37963 [84:29:09<1:58:35,  8.82s/it]
 98%|█████████▊| 37157/37963 [84:29:17<1:53:08,  8.42s/it]
 98%|█████████▊| 37158/37963 [84:29:25<1:50:24,  8.23s/it]
 98%|█████████▊| 37159/37963 [84:29:32<1:48:15,  8.08s/it]
 98%|█████████▊| 37160/37963 [84:29:40<1:47:03,  8.00s/it]
                                                          
{'loss': '0.08693', 'grad_norm': '4.101', 'learning_rate': '2.352e-08', 'epoch': '0.9789'}
+
 98%|█████████▊| 37160/37963 [84:29:40<1:47:03,  8.00s/it]
 98%|█████████▊| 37161/37963 [84:29:48<1:45:39,  7.90s/it]
 98%|█████████▊| 37162/37963 [84:29:56<1:44:34,  7.83s/it]
 98%|█████████▊| 37163/37963 [84:30:03<1:44:41,  7.85s/it]
 98%|█████████▊| 37164/37963 [84:30:14<1:54:44,  8.62s/it]
 98%|█████████▊| 37165/37963 [84:30:22<1:51:28,  8.38s/it]
 98%|█████████▊| 37166/37963 [84:30:29<1:48:45,  8.19s/it]
 98%|█████████▊| 37167/37963 [84:30:37<1:47:16,  8.09s/it]
 98%|█████████▊| 37168/37963 [84:30:45<1:45:47,  7.98s/it]
 98%|█████████▊| 37169/37963 [84:30:53<1:44:53,  7.93s/it]
 98%|█████████▊| 37170/37963 [84:31:00<1:43:34,  7.84s/it]
                                                          
{'loss': '0.09952', 'grad_norm': '3.027', 'learning_rate': '2.293e-08', 'epoch': '0.9791'}
+
 98%|█████████▊| 37170/37963 [84:31:00<1:43:34,  7.84s/it]
 98%|█████████▊| 37171/37963 [84:31:08<1:43:00,  7.80s/it]
 98%|█████████▊| 37172/37963 [84:31:16<1:42:07,  7.75s/it]
 98%|█████████▊| 37173/37963 [84:31:24<1:42:11,  7.76s/it]
 98%|█████████▊| 37174/37963 [84:31:34<1:51:50,  8.51s/it]
 98%|█████████▊| 37175/37963 [84:31:42<1:49:21,  8.33s/it]
 98%|█████████▊| 37176/37963 [84:31:49<1:45:20,  8.03s/it]
 98%|█████████▊| 37177/37963 [84:31:57<1:44:04,  7.94s/it]
 98%|█████████▊| 37178/37963 [84:32:04<1:42:43,  7.85s/it]
 98%|█████████▊| 37179/37963 [84:32:12<1:40:52,  7.72s/it]
 98%|█████████▊| 37180/37963 [84:32:20<1:40:54,  7.73s/it]
                                                          
{'loss': '0.07666', 'grad_norm': '4.476', 'learning_rate': '2.236e-08', 'epoch': '0.9794'}
+
 98%|█████████▊| 37180/37963 [84:32:20<1:40:54,  7.73s/it]
 98%|█████████▊| 37181/37963 [84:32:28<1:41:47,  7.81s/it]
 98%|█████████▊| 37182/37963 [84:32:35<1:41:26,  7.79s/it]
 98%|█████████▊| 37183/37963 [84:32:43<1:40:16,  7.71s/it]
 98%|█████████▊| 37184/37963 [84:32:51<1:39:59,  7.70s/it]
 98%|█████████▊| 37185/37963 [84:33:01<1:50:06,  8.49s/it]
 98%|█████████▊| 37186/37963 [84:33:09<1:47:11,  8.28s/it]
 98%|█████████▊| 37187/37963 [84:33:17<1:46:19,  8.22s/it]
 98%|█████████▊| 37188/37963 [84:33:24<1:44:03,  8.06s/it]
 98%|█████████▊| 37189/37963 [84:33:32<1:42:42,  7.96s/it]
 98%|█████████▊| 37190/37963 [84:33:40<1:41:14,  7.86s/it]
                                                          
{'loss': '0.08868', 'grad_norm': '3.071', 'learning_rate': '2.179e-08', 'epoch': '0.9796'}
+
 98%|█████████▊| 37190/37963 [84:33:40<1:41:14,  7.86s/it]
 98%|█████████▊| 37191/37963 [84:33:50<1:50:56,  8.62s/it]
 98%|█████████▊| 37192/37963 [84:33:58<1:46:38,  8.30s/it]
 98%|█████████▊| 37193/37963 [84:34:06<1:44:31,  8.14s/it]
 98%|█████████▊| 37194/37963 [84:34:13<1:43:08,  8.05s/it]
 98%|█████████▊| 37195/37963 [84:34:27<2:03:08,  9.62s/it]
 98%|█████████▊| 37196/37963 [84:34:34<1:55:32,  9.04s/it]
 98%|█████████▊| 37197/37963 [84:34:42<1:49:01,  8.54s/it]
 98%|█████████▊| 37198/37963 [84:34:49<1:45:36,  8.28s/it]
 98%|█████████▊| 37199/37963 [84:35:00<1:53:14,  8.89s/it]
 98%|█████████▊| 37200/37963 [84:35:07<1:48:37,  8.54s/it]
                                                          
{'loss': '0.07896', 'grad_norm': '3.304', 'learning_rate': '2.123e-08', 'epoch': '0.9799'}
+
 98%|█████████▊| 37200/37963 [84:35:07<1:48:37,  8.54s/it]
 98%|█████████▊| 37201/37963 [84:35:15<1:45:41,  8.32s/it]
 98%|█████████▊| 37202/37963 [84:35:23<1:43:09,  8.13s/it]
 98%|█████████▊| 37203/37963 [84:35:31<1:41:45,  8.03s/it]
 98%|█████████▊| 37204/37963 [84:35:38<1:40:24,  7.94s/it]
 98%|█████████▊| 37205/37963 [84:35:46<1:38:17,  7.78s/it]
 98%|█████████▊| 37206/37963 [84:35:54<1:37:43,  7.75s/it]
 98%|██���██████▊| 37207/37963 [84:36:01<1:37:36,  7.75s/it]
 98%|█████████▊| 37208/37963 [84:36:09<1:37:59,  7.79s/it]
 98%|█████████▊| 37209/37963 [84:36:19<1:46:46,  8.50s/it]
 98%|█████████▊| 37210/37963 [84:36:27<1:43:32,  8.25s/it]
                                                          
{'loss': '0.08902', 'grad_norm': '3.048', 'learning_rate': '2.068e-08', 'epoch': '0.9802'}
+
 98%|█████████▊| 37210/37963 [84:36:27<1:43:32,  8.25s/it]
 98%|█████████▊| 37211/37963 [84:36:35<1:41:02,  8.06s/it]
 98%|█████████▊| 37212/37963 [84:36:42<1:38:07,  7.84s/it]
 98%|█████████▊| 37213/37963 [84:36:50<1:38:34,  7.89s/it]
 98%|█████████▊| 37214/37963 [84:36:58<1:38:30,  7.89s/it]
 98%|█████████▊| 37215/37963 [84:37:06<1:38:21,  7.89s/it]
 98%|█████████▊| 37216/37963 [84:37:13<1:36:54,  7.78s/it]
 98%|█████████▊| 37217/37963 [84:37:21<1:36:10,  7.74s/it]
 98%|█████████▊| 37218/37963 [84:37:31<1:46:28,  8.58s/it]
 98%|█████████▊| 37219/37963 [84:37:40<1:44:36,  8.44s/it]
 98%|█████████▊| 37220/37963 [84:37:47<1:42:29,  8.28s/it]
                                                          
{'loss': '0.08371', 'grad_norm': '4.76', 'learning_rate': '2.014e-08', 'epoch': '0.9804'}
+
 98%|█████████▊| 37220/37963 [84:37:47<1:42:29,  8.28s/it]
 98%|█████████▊| 37221/37963 [84:37:55<1:39:30,  8.05s/it]
 98%|█████████▊| 37222/37963 [84:38:03<1:38:23,  7.97s/it]
 98%|█████████▊| 37223/37963 [84:38:13<1:46:52,  8.67s/it]
 98%|█████████▊| 37224/37963 [84:38:20<1:41:32,  8.24s/it]
 98%|█████████▊| 37225/37963 [84:38:28<1:39:02,  8.05s/it]
 98%|█████████▊| 37226/37963 [84:38:36<1:38:24,  8.01s/it]
 98%|█████████▊| 37227/37963 [84:38:43<1:36:55,  7.90s/it]
 98%|█████████▊| 37228/37963 [84:38:51<1:35:47,  7.82s/it]
 98%|█████████▊| 37229/37963 [84:38:59<1:35:59,  7.85s/it]
 98%|█████████▊| 37230/37963 [84:39:09<1:45:21,  8.62s/it]
                                                          
{'loss': '0.07371', 'grad_norm': '4.431', 'learning_rate': '1.96e-08', 'epoch': '0.9807'}
+
 98%|█████████▊| 37230/37963 [84:39:09<1:45:21,  8.62s/it]
 98%|█████████▊| 37231/37963 [84:39:17<1:41:15,  8.30s/it]
 98%|█████████▊| 37232/37963 [84:39:24<1:37:27,  8.00s/it]
 98%|█████████▊| 37233/37963 [84:39:32<1:36:05,  7.90s/it]
 98%|█████████▊| 37234/37963 [84:39:40<1:35:18,  7.84s/it]
 98%|█████████▊| 37235/37963 [84:39:47<1:34:18,  7.77s/it]
 98%|█████████▊| 37236/37963 [84:39:55<1:33:27,  7.71s/it]
 98%|█████████▊| 37237/37963 [84:40:03<1:33:33,  7.73s/it]
 98%|█████████▊| 37238/37963 [84:40:13<1:43:37,  8.58s/it]
 98%|█████████▊| 37239/37963 [84:40:26<1:58:52,  9.85s/it]
 98%|█████████▊| 37240/37963 [84:40:34<1:50:50,  9.20s/it]
                                                          
{'loss': '0.07637', 'grad_norm': '3.802', 'learning_rate': '1.907e-08', 'epoch': '0.981'}
+
 98%|█████████▊| 37240/37963 [84:40:34<1:50:50,  9.20s/it]
 98%|█████████▊| 37241/37963 [84:40:41<1:44:42,  8.70s/it]
 98%|█████████▊| 37242/37963 [84:40:49<1:40:56,  8.40s/it]
 98%|█████████▊| 37243/37963 [84:40:57<1:38:34,  8.21s/it]
 98%|█████████▊| 37244/37963 [84:41:04<1:36:08,  8.02s/it]
 98%|█████████▊| 37245/37963 [84:41:12<1:33:28,  7.81s/it]
 98%|█████████▊| 37246/37963 [84:41:19<1:32:14,  7.72s/it]
 98%|█████████▊| 37247/37963 [84:41:27<1:31:53,  7.70s/it]
 98%|█████████▊| 37248/37963 [84:41:34<1:30:42,  7.61s/it]
 98%|█████████▊| 37249/37963 [84:41:42<1:31:17,  7.67s/it]
 98%|█████████▊| 37250/37963 [84:41:49<1:30:45,  7.64s/it]
                                                          
{'loss': '0.08026', 'grad_norm': '2.796', 'learning_rate': '1.855e-08', 'epoch': '0.9812'}
+
 98%|█████████▊| 37250/37963 [84:41:49<1:30:45,  7.64s/it]
 98%|█████████▊| 37251/37963 [84:41:57<1:30:45,  7.65s/it]
 98%|█████████▊| 37252/37963 [84:42:05<1:31:10,  7.69s/it]
 98%|█████████▊| 37253/37963 [84:42:15<1:40:09,  8.46s/it]
 98%|█████████▊| 37254/37963 [84:42:23<1:36:44,  8.19s/it]
 98%|█████████▊| 37255/37963 [84:42:31<1:35:20,  8.08s/it]
 98%|█████████▊| 37256/37963 [84:42:38<1:33:31,  7.94s/it]
 98%|████████���▊| 37257/37963 [84:42:46<1:32:43,  7.88s/it]
 98%|█████████▊| 37258/37963 [84:42:54<1:32:07,  7.84s/it]
 98%|█████████▊| 37259/37963 [84:43:01<1:31:12,  7.77s/it]
 98%|█████████▊| 37260/37963 [84:43:09<1:31:02,  7.77s/it]
                                                          
{'loss': '0.09313', 'grad_norm': '4.758', 'learning_rate': '1.803e-08', 'epoch': '0.9815'}
+
 98%|█████████▊| 37260/37963 [84:43:09<1:31:02,  7.77s/it]
 98%|█████████▊| 37261/37963 [84:43:17<1:30:49,  7.76s/it]
 98%|█████████▊| 37262/37963 [84:43:25<1:30:34,  7.75s/it]
 98%|█████████▊| 37263/37963 [84:43:35<1:39:58,  8.57s/it]
 98%|█████████▊| 37264/37963 [84:43:43<1:37:16,  8.35s/it]
 98%|█████████▊| 37265/37963 [84:43:51<1:35:10,  8.18s/it]
 98%|█████████▊| 37266/37963 [84:43:59<1:33:57,  8.09s/it]
 98%|█████████▊| 37267/37963 [84:44:09<1:42:55,  8.87s/it]
 98%|█████████▊| 37268/37963 [84:44:17<1:39:09,  8.56s/it]
 98%|█████████▊| 37269/37963 [84:44:25<1:36:03,  8.30s/it]
 98%|█████████▊| 37270/37963 [84:44:33<1:33:59,  8.14s/it]
                                                          
{'loss': '0.08499', 'grad_norm': '2.948', 'learning_rate': '1.752e-08', 'epoch': '0.9817'}
+
 98%|█████████▊| 37270/37963 [84:44:33<1:33:59,  8.14s/it]
 98%|█████████▊| 37271/37963 [84:44:43<1:40:57,  8.75s/it]
 98%|█████████▊| 37272/37963 [84:44:51<1:37:43,  8.49s/it]
 98%|█████████▊| 37273/37963 [84:44:58<1:34:16,  8.20s/it]
 98%|█████████▊| 37274/37963 [84:45:06<1:32:50,  8.08s/it]
 98%|█████████▊| 37275/37963 [84:45:14<1:31:25,  7.97s/it]
 98%|█████████▊| 37276/37963 [84:45:24<1:39:29,  8.69s/it]
 98%|█████████▊| 37277/37963 [84:45:32<1:36:00,  8.40s/it]
 98%|█████████▊| 37278/37963 [84:45:40<1:33:55,  8.23s/it]
 98%|█████████▊| 37279/37963 [84:45:48<1:33:13,  8.18s/it]
 98%|█████████▊| 37280/37963 [84:45:55<1:31:55,  8.07s/it]
                                                          
{'loss': '0.0853', 'grad_norm': '4.223', 'learning_rate': '1.702e-08', 'epoch': '0.982'}
+
 98%|█████████▊| 37280/37963 [84:45:55<1:31:55,  8.07s/it]
 98%|█████████▊| 37281/37963 [84:46:03<1:30:39,  7.98s/it]
 98%|█████████▊| 37282/37963 [84:46:14<1:39:36,  8.78s/it]
 98%|█████████▊| 37283/37963 [84:46:24<1:45:13,  9.28s/it]
 98%|█████████▊| 37284/37963 [84:46:32<1:39:38,  8.81s/it]
 98%|█████████▊| 37285/37963 [84:46:40<1:35:34,  8.46s/it]
 98%|█████████▊| 37286/37963 [84:46:47<1:33:01,  8.24s/it]
 98%|█████████▊| 37287/37963 [84:46:55<1:31:23,  8.11s/it]
 98%|█████████▊| 37288/37963 [84:47:05<1:37:39,  8.68s/it]
 98%|█████████▊| 37289/37963 [84:47:13<1:34:03,  8.37s/it]
 98%|█████████▊| 37290/37963 [84:47:21<1:31:48,  8.18s/it]
                                                          
{'loss': '0.0837', 'grad_norm': '3.633', 'learning_rate': '1.653e-08', 'epoch': '0.9823'}
+
 98%|█████████▊| 37290/37963 [84:47:21<1:31:48,  8.18s/it]
 98%|█████████▊| 37291/37963 [84:47:29<1:30:57,  8.12s/it]
 98%|█████████▊| 37292/37963 [84:47:36<1:28:59,  7.96s/it]
 98%|█████████▊| 37293/37963 [84:47:44<1:27:44,  7.86s/it]
 98%|█████████▊| 37294/37963 [84:47:51<1:27:14,  7.82s/it]
 98%|█████████▊| 37295/37963 [84:47:59<1:27:03,  7.82s/it]
 98%|█████████▊| 37296/37963 [84:48:07<1:26:15,  7.76s/it]
 98%|█████████▊| 37297/37963 [84:48:14<1:24:40,  7.63s/it]
 98%|█████████▊| 37298/37963 [84:48:22<1:24:56,  7.66s/it]
 98%|█████████▊| 37299/37963 [84:48:30<1:25:04,  7.69s/it]
 98%|█████████▊| 37300/37963 [84:48:37<1:24:50,  7.68s/it]
                                                          
{'loss': '0.08783', 'grad_norm': '3.302', 'learning_rate': '1.604e-08', 'epoch': '0.9825'}
+
 98%|█████████▊| 37300/37963 [84:48:37<1:24:50,  7.68s/it]
 98%|█████████▊| 37301/37963 [84:48:45<1:24:45,  7.68s/it]
 98%|█████████▊| 37302/37963 [84:48:53<1:24:00,  7.63s/it]
 98%|█████████▊| 37303/37963 [84:49:00<1:24:28,  7.68s/it]
 98%|█████████▊| 37304/37963 [84:49:08<1:23:47,  7.63s/it]
 98%|█████████▊| 37305/37963 [84:49:16<1:24:02,  7.66s/it]
 98%|█████████▊| 37306/37963 [84:49:23<1:22:47,  7.56s/it]
 98%|█████████▊| 37307/37963 [84:49:33<1:31:12,  8.34s/it]
 98%|█████████▊| 37308/37963 [84:49:41<1:29:57,  8.24s/it]
 98%|█████████▊| 37309/37963 [84:49:49<1:27:01,  7.98s/it]
 98%|█████████▊| 37310/37963 [84:49:56<1:26:05,  7.91s/it]
                                                          
{'loss': '0.08794', 'grad_norm': '4.863', 'learning_rate': '1.556e-08', 'epoch': '0.9828'}
+
 98%|█████████▊| 37310/37963 [84:49:56<1:26:05,  7.91s/it]
 98%|█████████▊| 37311/37963 [84:50:06<1:32:36,  8.52s/it]
 98%|█████████▊| 37312/37963 [84:50:14<1:29:25,  8.24s/it]
 98%|█████████▊| 37313/37963 [84:50:22<1:27:50,  8.11s/it]
 98%|█████████▊| 37314/37963 [84:50:29<1:26:21,  7.98s/it]
 98%|█████████▊| 37315/37963 [84:50:37<1:25:20,  7.90s/it]
 98%|█████████▊| 37316/37963 [84:50:45<1:24:10,  7.81s/it]
 98%|█████████▊| 37317/37963 [84:50:55<1:32:08,  8.56s/it]
 98%|█████████▊| 37318/37963 [84:51:02<1:28:25,  8.23s/it]
 98%|█████████▊| 37319/37963 [84:51:10<1:26:32,  8.06s/it]
 98%|█████████▊| 37320/37963 [84:51:21<1:34:10,  8.79s/it]
                                                          
{'loss': '0.07926', 'grad_norm': '3.289', 'learning_rate': '1.509e-08', 'epoch': '0.9831'}
+
 98%|█████████▊| 37320/37963 [84:51:21<1:34:10,  8.79s/it]
 98%|█████████▊| 37321/37963 [84:51:28<1:30:45,  8.48s/it]
 98%|█████████▊| 37322/37963 [84:51:36<1:28:46,  8.31s/it]
 98%|█████████▊| 37323/37963 [84:51:44<1:27:26,  8.20s/it]
 98%|█████████▊| 37324/37963 [84:51:52<1:25:26,  8.02s/it]
 98%|█████████▊| 37325/37963 [84:51:59<1:24:11,  7.92s/it]
 98%|█████████▊| 37326/37963 [84:52:10<1:31:58,  8.66s/it]
 98%|█████████▊| 37327/37963 [84:52:17<1:28:29,  8.35s/it]
 98%|█████████▊| 37328/37963 [84:52:25<1:26:27,  8.17s/it]
 98%|█████████▊| 37329/37963 [84:52:33<1:25:29,  8.09s/it]
 98%|█████████▊| 37330/37963 [84:52:41<1:23:45,  7.94s/it]
                                                          
{'loss': '0.09114', 'grad_norm': '4.67', 'learning_rate': '1.462e-08', 'epoch': '0.9833'}
+
 98%|█████████▊| 37330/37963 [84:52:41<1:23:45,  7.94s/it]
 98%|█████████▊| 37331/37963 [84:52:51<1:31:48,  8.72s/it]
 98%|█████████▊| 37332/37963 [84:52:59<1:28:12,  8.39s/it]
 98%|█████████▊| 37333/37963 [84:53:06<1:25:38,  8.16s/it]
 98%|█████████▊| 37334/37963 [84:53:14<1:24:15,  8.04s/it]
 98%|█████████▊| 37335/37963 [84:53:22<1:23:52,  8.01s/it]
 98%|█████████▊| 37336/37963 [84:53:35<1:40:24,  9.61s/it]
 98%|█████████▊| 37337/37963 [84:53:44<1:35:30,  9.15s/it]
 98%|█████████▊| 37338/37963 [84:53:51<1:31:14,  8.76s/it]
 98%|█████████▊| 37339/37963 [84:53:59<1:28:15,  8.49s/it]
 98%|█████████▊| 37340/37963 [84:54:07<1:25:28,  8.23s/it]
                                                          
{'loss': '0.06705', 'grad_norm': '2.759', 'learning_rate': '1.417e-08', 'epoch': '0.9836'}
+
 98%|█████████▊| 37340/37963 [84:54:07<1:25:28,  8.23s/it]
 98%|█████████▊| 37341/37963 [84:54:15<1:23:32,  8.06s/it]
 98%|█████████▊| 37342/37963 [84:54:22<1:21:44,  7.90s/it]
 98%|█████████▊| 37343/37963 [84:54:30<1:21:36,  7.90s/it]
 98%|█████████▊| 37344/37963 [84:54:38<1:20:39,  7.82s/it]
 98%|█████████▊| 37345/37963 [84:54:45<1:20:25,  7.81s/it]
 98%|█████████▊| 37346/37963 [84:54:53<1:20:26,  7.82s/it]
 98%|█████████▊| 37347/37963 [84:55:01<1:20:06,  7.80s/it]
 98%|█████████▊| 37348/37963 [84:55:09<1:20:13,  7.83s/it]
 98%|█████████▊| 37349/37963 [84:55:17<1:20:02,  7.82s/it]
 98%|█████████▊| 37350/37963 [84:55:24<1:19:19,  7.76s/it]
                                                          
{'loss': '0.08704', 'grad_norm': '3.278', 'learning_rate': '1.372e-08', 'epoch': '0.9839'}
+
 98%|█████████▊| 37350/37963 [84:55:24<1:19:19,  7.76s/it]
 98%|█████████▊| 37351/37963 [84:55:35<1:27:00,  8.53s/it]
 98%|█████████▊| 37352/37963 [84:55:42<1:24:10,  8.27s/it]
 98%|█████████▊| 37353/37963 [84:55:50<1:22:14,  8.09s/it]
 98%|█████████▊| 37354/37963 [84:55:58<1:20:58,  7.98s/it]
 98%|█████████▊| 37355/37963 [84:56:06<1:20:53,  7.98s/it]
 98%|█████████▊| 37356/37963 [84:56:13<1:20:00,  7.91s/it]
 98%|█████████▊| 37357/37963 [84:56:21<1:19:36,  7.88s/it]
 98%|█████████▊| 37358/37963 [84:56:29<1:18:58,  7.83s/it]
 98%|█████████▊| 37359/37963 [84:56:37<1:18:33,  7.80s/it]
 98%|█████████▊| 37360/37963 [84:56:44<1:17:35,  7.72s/it]
                                                          
{'loss': '0.08394', 'grad_norm': '4.529', 'learning_rate': '1.327e-08', 'epoch': '0.9841'}
+
 98%|█████████▊| 37360/37963 [84:56:44<1:17:35,  7.72s/it]
 98%|█████████▊| 37361/37963 [84:56:55<1:25:26,  8.52s/it]
 98%|█████████▊| 37362/37963 [84:57:02<1:23:25,  8.33s/it]
 98%|█████████▊| 37363/37963 [84:57:10<1:22:13,  8.22s/it]
 98%|█████████▊| 37364/37963 [84:57:21<1:30:04,  9.02s/it]
 98%|█████████▊| 37365/37963 [84:57:32<1:34:54,  9.52s/it]
 98%|█████████▊| 37366/37963 [84:57:40<1:29:28,  8.99s/it]
 98%|█████████▊| 37367/37963 [84:57:48<1:26:05,  8.67s/it]
 98%|█████████▊| 37368/37963 [84:57:55<1:22:56,  8.36s/it]
 98%|█████████▊| 37369/37963 [84:58:03<1:20:53,  8.17s/it]
 98%|█████████▊| 37370/37963 [84:58:11<1:19:22,  8.03s/it]
                                                          
{'loss': '0.07414', 'grad_norm': '3.506', 'learning_rate': '1.284e-08', 'epoch': '0.9844'}
+
 98%|█████████▊| 37370/37963 [84:58:11<1:19:22,  8.03s/it]
 98%|█████████▊| 37371/37963 [84:58:19<1:18:51,  7.99s/it]
 98%|█████████▊| 37372/37963 [84:58:26<1:17:30,  7.87s/it]
 98%|█████████▊| 37373/37963 [84:58:36<1:24:19,  8.58s/it]
 98%|█████████▊| 37374/37963 [84:58:44<1:21:59,  8.35s/it]
 98%|█████████▊| 37375/37963 [84:58:52<1:20:14,  8.19s/it]
 98%|█████████▊| 37376/37963 [84:59:00<1:19:11,  8.10s/it]
 98%|█████████▊| 37377/37963 [84:59:08<1:17:56,  7.98s/it]
 98%|█████████▊| 37378/37963 [84:59:15<1:16:34,  7.85s/it]
 98%|█████████▊| 37379/37963 [84:59:26<1:24:42,  8.70s/it]
 98%|█████████▊| 37380/37963 [84:59:36<1:29:54,  9.25s/it]
                                                          
{'loss': '0.08374', 'grad_norm': '2.663', 'learning_rate': '1.241e-08', 'epoch': '0.9846'}
+
 98%|█████████▊| 37380/37963 [84:59:36<1:29:54,  9.25s/it]
 98%|█████████▊| 37381/37963 [84:59:44<1:25:54,  8.86s/it]
 98%|█████████▊| 37382/37963 [84:59:52<1:22:49,  8.55s/it]
 98%|█████████▊| 37383/37963 [85:00:00<1:19:59,  8.28s/it]
 98%|█████████▊| 37384/37963 [85:00:10<1:26:14,  8.94s/it]
 98%|█████████▊| 37385/37963 [85:00:18<1:22:54,  8.61s/it]
 98%|█████████▊| 37386/37963 [85:00:26<1:19:44,  8.29s/it]
 98%|█████████▊| 37387/37963 [85:00:34<1:18:12,  8.15s/it]
 98%|█████████▊| 37388/37963 [85:00:41<1:16:42,  8.00s/it]
 98%|█████████▊| 37389/37963 [85:00:49<1:16:31,  8.00s/it]
 98%|█████████▊| 37390/37963 [85:00:57<1:14:22,  7.79s/it]
                                                          
{'loss': '0.0851', 'grad_norm': '3.301', 'learning_rate': '1.199e-08', 'epoch': '0.9849'}
+
 98%|█████████▊| 37390/37963 [85:00:57<1:14:22,  7.79s/it]
 98%|█████████▊| 37391/37963 [85:01:05<1:14:49,  7.85s/it]
 98%|█████████▊| 37392/37963 [85:01:12<1:12:44,  7.64s/it]
 98%|█████████▊| 37393/37963 [85:01:19<1:12:47,  7.66s/it]
 99%|█████████▊| 37394/37963 [85:01:27<1:11:58,  7.59s/it]
 99%|█████████▊| 37395/37963 [85:01:35<1:12:33,  7.66s/it]
 99%|█████████▊| 37396/37963 [85:01:42<1:12:28,  7.67s/it]
 99%|█████████▊| 37397/37963 [85:01:50<1:12:54,  7.73s/it]
 99%|█████████▊| 37398/37963 [85:01:58<1:14:13,  7.88s/it]
 99%|█████████▊| 37399/37963 [85:02:08<1:19:51,  8.49s/it]
 99%|█████████▊| 37400/37963 [85:02:16<1:17:16,  8.24s/it]
                                                          
{'loss': '0.09639', 'grad_norm': '4.406', 'learning_rate': '1.157e-08', 'epoch': '0.9852'}
+
 99%|█████████▊| 37400/37963 [85:02:16<1:17:16,  8.24s/it]
 99%|█████████▊| 37401/37963 [85:02:24<1:16:03,  8.12s/it]
 99%|█████████▊| 37402/37963 [85:02:32<1:14:49,  8.00s/it]
 99%|█████████▊| 37403/37963 [85:02:39<1:14:04,  7.94s/it]
 99%|█████████▊| 37404/37963 [85:02:47<1:12:19,  7.76s/it]
 99%|█████████▊| 37405/37963 [85:02:54<1:11:49,  7.72s/it]
 99%|█████████▊| 37406/37963 [85:03:02<1:12:17,  7.79s/it]
 99%|█████████▊| 37407/37963 [85:03:10<1:11:46,  7.74s/it]
 99%|█████████▊| 37408/37963 [85:03:18<1:11:12,  7.70s/it]
 99%|█████████▊| 37409/37963 [85:03:28<1:18:35,  8.51s/it]
 99%|█████████▊| 37410/37963 [85:03:36<1:16:14,  8.27s/it]
                                                          
{'loss': '0.07619', 'grad_norm': '3.893', 'learning_rate': '1.117e-08', 'epoch': '0.9854'}
+
 99%|█████████▊| 37410/37963 [85:03:36<1:16:14,  8.27s/it]
 99%|█████████▊| 37411/37963 [85:03:43<1:14:34,  8.11s/it]
 99%|█████████▊| 37412/37963 [85:03:51<1:12:59,  7.95s/it]
 99%|█████████▊| 37413/37963 [85:03:59<1:12:05,  7.86s/it]
 99%|█████████▊| 37414/37963 [85:04:06<1:11:29,  7.81s/it]
 99%|█████████▊| 37415/37963 [85:04:17<1:18:22,  8.58s/it]
 99%|█████████▊| 37416/37963 [85:04:24<1:15:40,  8.30s/it]
 99%|█████████▊| 37417/37963 [85:04:32<1:14:14,  8.16s/it]
 99%|█████████▊| 37418/37963 [85:04:40<1:13:23,  8.08s/it]
 99%|█████████▊| 37419/37963 [85:04:48<1:12:53,  8.04s/it]
 99%|█████████▊| 37420/37963 [85:04:55<1:10:57,  7.84s/it]
                                                          
{'loss': '0.08564', 'grad_norm': '3.626', 'learning_rate': '1.077e-08', 'epoch': '0.9857'}
+
 99%|█████████▊| 37420/37963 [85:04:55<1:10:57,  7.84s/it]
 99%|█████████▊| 37421/37963 [85:05:06<1:17:56,  8.63s/it]
 99%|█████████▊| 37422/37963 [85:05:14<1:15:37,  8.39s/it]
 99%|█████████▊| 37423/37963 [85:05:24<1:21:33,  9.06s/it]
 99%|█████████▊| 37424/37963 [85:05:32<1:17:39,  8.65s/it]
 99%|█████████▊| 37425/37963 [85:05:40<1:15:13,  8.39s/it]
 99%|█████████▊| 37426/37963 [85:05:47<1:13:06,  8.17s/it]
 99%|█████████▊| 37427/37963 [85:05:58<1:18:15,  8.76s/it]
 99%|█████████▊| 37428/37963 [85:06:08<1:21:39,  9.16s/it]
 99%|█████████▊| 37429/37963 [85:06:15<1:17:21,  8.69s/it]
 99%|█████████▊| 37430/37963 [85:06:23<1:15:35,  8.51s/it]
                                                          
{'loss': '0.0808', 'grad_norm': '3.512', 'learning_rate': '1.038e-08', 'epoch': '0.986'}
+
 99%|█████████▊| 37430/37963 [85:06:23<1:15:35,  8.51s/it]
 99%|█████████▊| 37431/37963 [85:06:31<1:13:44,  8.32s/it]
 99%|█████████▊| 37432/37963 [85:06:39<1:12:39,  8.21s/it]
 99%|█████████▊| 37433/37963 [85:06:47<1:11:00,  8.04s/it]
 99%|█████████▊| 37434/37963 [85:06:54<1:09:51,  7.92s/it]
 99%|█████████▊| 37435/37963 [85:07:02<1:09:41,  7.92s/it]
 99%|█████████▊| 37436/37963 [85:07:10<1:09:05,  7.87s/it]
 99%|█████████▊| 37437/37963 [85:07:18<1:09:02,  7.88s/it]
 99%|█████████▊| 37438/37963 [85:07:26<1:08:49,  7.87s/it]
 99%|█████████▊| 37439/37963 [85:07:34<1:08:33,  7.85s/it]
 99%|█████████▊| 37440/37963 [85:07:41<1:08:20,  7.84s/it]
                                                          
{'loss': '0.08409', 'grad_norm': '5.94', 'learning_rate': '9.991e-09', 'epoch': '0.9862'}
+
 99%|█████████▊| 37440/37963 [85:07:41<1:08:20,  7.84s/it]
 99%|█████████▊| 37441/37963 [85:07:49<1:08:14,  7.84s/it]
 99%|█████████▊| 37442/37963 [85:07:57<1:07:35,  7.78s/it]
 99%|█████████▊| 37443/37963 [85:08:05<1:06:52,  7.72s/it]
 99%|█████████▊| 37444/37963 [85:08:12<1:06:35,  7.70s/it]
 99%|█████████▊| 37445/37963 [85:08:20<1:06:36,  7.71s/it]
 99%|█████████▊| 37446/37963 [85:08:28<1:06:38,  7.73s/it]
 99%|█████████▊| 37447/37963 [85:08:38<1:12:39,  8.45s/it]
 99%|█████████▊| 37448/37963 [85:08:46<1:11:19,  8.31s/it]
 99%|█████████▊| 37449/37963 [85:08:54<1:10:14,  8.20s/it]
 99%|█████████▊| 37450/37963 [85:09:01<1:08:53,  8.06s/it]
                                                          
{'loss': '0.08686', 'grad_norm': '2.997', 'learning_rate': '9.613e-09', 'epoch': '0.9865'}
+
 99%|█████████▊| 37450/37963 [85:09:01<1:08:53,  8.06s/it]
 99%|█████████▊| 37451/37963 [85:09:09<1:07:56,  7.96s/it]
 99%|█████████▊| 37452/37963 [85:09:17<1:06:51,  7.85s/it]
 99%|█████████▊| 37453/37963 [85:09:25<1:06:20,  7.80s/it]
 99%|█████████▊| 37454/37963 [85:09:32<1:05:47,  7.76s/it]
 99%|█████████▊| 37455/37963 [85:09:40<1:04:53,  7.67s/it]
 99%|█████████▊| 37456/37963 [85:09:47<1:04:45,  7.66s/it]
 99%|█████████▊| 37457/37963 [85:09:55<1:04:56,  7.70s/it]
 99%|████��████▊| 37458/37963 [85:10:03<1:04:22,  7.65s/it]
 99%|█████████▊| 37459/37963 [85:10:10<1:04:33,  7.69s/it]
 99%|█████████▊| 37460/37963 [85:10:18<1:04:17,  7.67s/it]
                                                          
{'loss': '0.08395', 'grad_norm': '3.435', 'learning_rate': '9.243e-09', 'epoch': '0.9868'}
+
 99%|█████████▊| 37460/37963 [85:10:18<1:04:17,  7.67s/it]
 99%|█████████▊| 37461/37963 [85:10:26<1:04:12,  7.67s/it]
 99%|█████████▊| 37462/37963 [85:10:36<1:11:50,  8.60s/it]
 99%|█████████▊| 37463/37963 [85:10:50<1:23:11,  9.98s/it]
 99%|█████████▊| 37464/37963 [85:10:57<1:17:11,  9.28s/it]
 99%|█████████▊| 37465/37963 [85:11:05<1:13:30,  8.86s/it]
 99%|█████████▊| 37466/37963 [85:11:13<1:10:40,  8.53s/it]
 99%|█████████▊| 37467/37963 [85:11:26<1:22:03,  9.93s/it]
 99%|█████████▊| 37468/37963 [85:11:34<1:16:44,  9.30s/it]
 99%|█████████▊| 37469/37963 [85:11:42<1:12:42,  8.83s/it]
 99%|█████████▊| 37470/37963 [85:11:49<1:10:01,  8.52s/it]
                                                          
{'loss': '0.08726', 'grad_norm': '3.765', 'learning_rate': '8.88e-09', 'epoch': '0.987'}
+
 99%|█████████▊| 37470/37963 [85:11:49<1:10:01,  8.52s/it]
 99%|█████████▊| 37471/37963 [85:12:00<1:14:54,  9.13s/it]
 99%|█████████▊| 37472/37963 [85:12:08<1:12:03,  8.81s/it]
 99%|█████████▊| 37473/37963 [85:12:16<1:09:07,  8.46s/it]
 99%|█████████▊| 37474/37963 [85:12:24<1:07:19,  8.26s/it]
 99%|█████████▊| 37475/37963 [85:12:31<1:06:07,  8.13s/it]
 99%|█████████▊| 37476/37963 [85:12:39<1:05:04,  8.02s/it]
 99%|█████████▊| 37477/37963 [85:12:47<1:04:59,  8.02s/it]
 99%|█████████▊| 37478/37963 [85:12:55<1:03:56,  7.91s/it]
 99%|█████████▊| 37479/37963 [85:13:03<1:03:36,  7.89s/it]
 99%|█████████▊| 37480/37963 [85:13:10<1:02:20,  7.74s/it]
                                                          
{'loss': '0.08029', 'grad_norm': '2.799', 'learning_rate': '8.524e-09', 'epoch': '0.9873'}
+
 99%|█████████▊| 37480/37963 [85:13:10<1:02:20,  7.74s/it]
 99%|█████████▊| 37481/37963 [85:13:20<1:08:30,  8.53s/it]
 99%|█████████▊| 37482/37963 [85:13:28<1:06:24,  8.28s/it]
 99%|█████████▊| 37483/37963 [85:13:36<1:04:42,  8.09s/it]
 99%|█████████▊| 37484/37963 [85:13:44<1:04:46,  8.11s/it]
 99%|█████████▊| 37485/37963 [85:13:52<1:03:49,  8.01s/it]
 99%|█████████▊| 37486/37963 [85:13:59<1:02:46,  7.90s/it]
 99%|█████████▊| 37487/37963 [85:14:07<1:02:29,  7.88s/it]
 99%|█████████▊| 37488/37963 [85:14:15<1:01:54,  7.82s/it]
 99%|█████████▉| 37489/37963 [85:14:23<1:01:42,  7.81s/it]
 99%|█████████▉| 37490/37963 [85:14:30<1:01:18,  7.78s/it]
                                                          
{'loss': '0.0753', 'grad_norm': '3.26', 'learning_rate': '8.175e-09', 'epoch': '0.9875'}
+
 99%|█████████▉| 37490/37963 [85:14:30<1:01:18,  7.78s/it]
 99%|█████████▉| 37491/37963 [85:14:41<1:07:11,  8.54s/it]
 99%|█████████▉| 37492/37963 [85:14:48<1:04:07,  8.17s/it]
 99%|█████████▉| 37493/37963 [85:14:56<1:02:43,  8.01s/it]
 99%|█████████▉| 37494/37963 [85:15:03<1:01:25,  7.86s/it]
 99%|█████████▉| 37495/37963 [85:15:11<1:00:37,  7.77s/it]
 99%|█████████▉| 37496/37963 [85:15:18<1:00:19,  7.75s/it]
 99%|█████████▉| 37497/37963 [85:15:27<1:01:22,  7.90s/it]
 99%|█████████▉| 37498/37963 [85:15:35<1:01:17,  7.91s/it]
 99%|█████████▉| 37499/37963 [85:15:42<1:00:40,  7.85s/it]
 99%|█████████▉| 37500/37963 [85:15:50<59:11,  7.67s/it]  
                                                        
{'loss': '0.09003', 'grad_norm': '5.039', 'learning_rate': '7.834e-09', 'epoch': '0.9878'}
+
 99%|█████████▉| 37500/37963 [85:15:50<59:11,  7.67s/it]
 99%|█████████▉| 37501/37963 [85:15:57<59:39,  7.75s/it]
 99%|█████████▉| 37502/37963 [85:16:05<59:05,  7.69s/it]
 99%|█████████▉| 37503/37963 [85:16:13<59:15,  7.73s/it]
 99%|█████████▉| 37504/37963 [85:16:20<58:58,  7.71s/it]
 99%|█████████▉| 37505/37963 [85:16:28<59:03,  7.74s/it]
 99%|█████████▉| 37506/37963 [85:16:36<58:50,  7.73s/it]
 99%|█████████▉| 37507/37963 [85:16:49<1:10:55,  9.33s/it]
 99%|█████████▉| 37508/37963 [85:16:57<1:06:49,  8.81s/it]
 99%|█████████▉| 37509/37963 [85:17:04<1:04:23,  8.51s/it]
 99%|█████████▉| 37510/37963 [85:17:12<1:02:47,  8.32s/it]
                                                          
{'loss': '0.09514', 'grad_norm': '3.328', 'learning_rate': '7.5e-09', 'epoch': '0.9881'}
+
 99%|█████████▉| 37510/37963 [85:17:12<1:02:47,  8.32s/it]
 99%|█████████▉| 37511/37963 [85:17:20<1:01:08,  8.12s/it]
 99%|█████████▉| 37512/37963 [85:17:28<59:55,  7.97s/it]  
 99%|█████████▉| 37513/37963 [85:17:35<59:06,  7.88s/it]
 99%|█████████▉| 37514/37963 [85:17:43<58:36,  7.83s/it]
 99%|█████████▉| 37515/37963 [85:17:56<1:10:42,  9.47s/it]
 99%|█████████▉| 37516/37963 [85:18:04<1:05:47,  8.83s/it]
 99%|█████████▉| 37517/37963 [85:18:14<1:08:12,  9.18s/it]
 99%|█████████▉| 37518/37963 [85:18:21<1:05:06,  8.78s/it]
 99%|█████████▉| 37519/37963 [85:18:32<1:08:58,  9.32s/it]
 99%|█████████▉| 37520/37963 [85:18:40<1:05:09,  8.82s/it]
                                                          
{'loss': '0.08176', 'grad_norm': '3.18', 'learning_rate': '7.173e-09', 'epoch': '0.9883'}
+
 99%|█████████▉| 37520/37963 [85:18:40<1:05:09,  8.82s/it]
 99%|█████████▉| 37521/37963 [85:18:48<1:02:54,  8.54s/it]
 99%|█████████▉| 37522/37963 [85:18:55<1:01:13,  8.33s/it]
 99%|█████████▉| 37523/37963 [85:19:03<59:58,  8.18s/it]  
 99%|█████████▉| 37524/37963 [85:19:11<58:28,  7.99s/it]
 99%|█████████▉| 37525/37963 [85:19:21<1:03:56,  8.76s/it]
 99%|█████████▉| 37526/37963 [85:19:29<1:01:23,  8.43s/it]
 99%|█████████▉| 37527/37963 [85:19:37<59:44,  8.22s/it]  
 99%|█████████▉| 37528/37963 [85:19:45<58:40,  8.09s/it]
 99%|█████████▉| 37529/37963 [85:19:52<57:54,  8.00s/it]
 99%|█████████▉| 37530/37963 [85:20:00<56:58,  7.89s/it]
                                                        
{'loss': '0.08046', 'grad_norm': '3.714', 'learning_rate': '6.854e-09', 'epoch': '0.9886'}
+
 99%|█████████▉| 37530/37963 [85:20:00<56:58,  7.89s/it]
 99%|█████████▉| 37531/37963 [85:20:08<56:43,  7.88s/it]
 99%|█████████▉| 37532/37963 [85:20:15<56:08,  7.81s/it]
 99%|█████████▉| 37533/37963 [85:20:23<55:44,  7.78s/it]
 99%|█████████▉| 37534/37963 [85:20:31<55:26,  7.75s/it]
 99%|█████████▉| 37535/37963 [85:20:39<55:10,  7.74s/it]
 99%|█████████▉| 37536/37963 [85:20:46<54:14,  7.62s/it]
 99%|█████████▉| 37537/37963 [85:20:54<54:08,  7.63s/it]
 99%|█████████▉| 37538/37963 [85:21:01<54:29,  7.69s/it]
 99%|█████████▉| 37539/37963 [85:21:09<54:17,  7.68s/it]
 99%|█████████▉| 37540/37963 [85:21:17<53:38,  7.61s/it]
                                                        
{'loss': '0.07879', 'grad_norm': '2.738', 'learning_rate': '6.542e-09', 'epoch': '0.9889'}
+
 99%|█████████▉| 37540/37963 [85:21:17<53:38,  7.61s/it]
 99%|█████████▉| 37541/37963 [85:21:24<53:50,  7.65s/it]
 99%|█████████▉| 37542/37963 [85:21:32<53:49,  7.67s/it]
 99%|█████████▉| 37543/37963 [85:21:40<53:27,  7.64s/it]
 99%|█████████▉| 37544/37963 [85:21:47<53:19,  7.64s/it]
 99%|█████████▉| 37545/37963 [85:21:57<58:27,  8.39s/it]
 99%|█████████▉| 37546/37963 [85:22:05<57:26,  8.26s/it]
 99%|█████████▉| 37547/37963 [85:22:13<56:03,  8.09s/it]
 99%|█████████▉| 37548/37963 [85:22:21<55:43,  8.06s/it]
 99%|█████████▉| 37549/37963 [85:22:28<54:09,  7.85s/it]
 99%|█████████▉| 37550/37963 [85:22:39<59:23,  8.63s/it]
                                                        
{'loss': '0.07444', 'grad_norm': '3.942', 'learning_rate': '6.237e-09', 'epoch': '0.9891'}
+
 99%|█████████▉| 37550/37963 [85:22:39<59:23,  8.63s/it]
 99%|█████████▉| 37551/37963 [85:22:47<57:52,  8.43s/it]
 99%|█████████▉| 37552/37963 [85:22:54<55:37,  8.12s/it]
 99%|█████████▉| 37553/37963 [85:23:02<54:59,  8.05s/it]
 99%|█████████▉| 37554/37963 [85:23:10<54:21,  7.97s/it]
 99%|█████████▉| 37555/37963 [85:23:20<59:23,  8.73s/it]
 99%|█████████▉| 37556/37963 [85:23:28<56:58,  8.40s/it]
 99%|█████████▉| 37557/37963 [85:23:36<55:46,  8.24s/it]
 99%|█████████▉| 37558/37963 [85:23:46<1:00:15,  8.93s/it]
 99%|█████████▉| 37559/37963 [85:23:54<57:43,  8.57s/it]  
 99%|█████████▉| 37560/37963 [85:24:02<56:09,  8.36s/it]
                                                        
{'loss': '0.0768', 'grad_norm': '2.693', 'learning_rate': '5.939e-09', 'epoch': '0.9894'}
+
 99%|█████████▉| 37560/37963 [85:24:02<56:09,  8.36s/it]
 99%|█████████▉| 37561/37963 [85:24:09<53:52,  8.04s/it]
 99%|█████████▉| 37562/37963 [85:24:17<53:30,  8.01s/it]
 99%|█████████▉| 37563/37963 [85:24:25<53:00,  7.95s/it]
 99%|█████████▉| 37564/37963 [85:24:35<57:37,  8.67s/it]
 99%|█████████▉| 37565/37963 [85:24:43<55:30,  8.37s/it]
 99%|█████████▉| 37566/37963 [85:24:50<53:31,  8.09s/it]
 99%|█████████▉| 37567/37963 [85:25:01<58:30,  8.87s/it]
 99%|█████████▉| 37568/37963 [85:25:12<1:01:27,  9.34s/it]
 99%|█████████▉| 37569/37963 [85:25:19<58:24,  8.89s/it]  
 99%|█████████▉| 37570/37963 [85:25:27<56:04,  8.56s/it]
                                                        
{'loss': '0.08763', 'grad_norm': '4.583', 'learning_rate': '5.649e-09', 'epoch': '0.9897'}
+
 99%|█████████▉| 37570/37963 [85:25:27<56:04,  8.56s/it]
 99%|█████████▉| 37571/37963 [85:25:35<54:13,  8.30s/it]
 99%|█████████▉| 37572/37963 [85:25:43<53:07,  8.15s/it]
 99%|█████████▉| 37573/37963 [85:25:50<52:08,  8.02s/it]
 99%|█████████▉| 37574/37963 [85:25:58<51:31,  7.95s/it]
 99%|█████████▉| 37575/37963 [85:26:06<51:22,  7.95s/it]
 99%|█████████▉| 37576/37963 [85:26:14<50:51,  7.88s/it]
 99%|█████████▉| 37577/37963 [85:26:24<55:32,  8.63s/it]
 99%|█████████▉| 37578/37963 [85:26:32<54:05,  8.43s/it]
 99%|█████████▉| 37579/37963 [85:26:40<52:18,  8.17s/it]
 99%|█████████▉| 37580/37963 [85:26:48<51:20,  8.04s/it]
                                                        
{'loss': '0.07867', 'grad_norm': '5.093', 'learning_rate': '5.366e-09', 'epoch': '0.9899'}
+
 99%|█████████▉| 37580/37963 [85:26:48<51:20,  8.04s/it]
 99%|█████████▉| 37581/37963 [85:26:55<50:20,  7.91s/it]
 99%|█████████▉| 37582/37963 [85:27:03<49:59,  7.87s/it]
 99%|█████████▉| 37583/37963 [85:27:11<50:02,  7.90s/it]
 99%|█████████▉| 37584/37963 [85:27:19<49:55,  7.90s/it]
 99%|█████████▉| 37585/37963 [85:27:26<49:19,  7.83s/it]
 99%|█████████▉| 37586/37963 [85:27:34<48:33,  7.73s/it]
 99%|█████████▉| 37587/37963 [85:27:41<47:59,  7.66s/it]
 99%|█████████▉| 37588/37963 [85:27:49<47:46,  7.64s/it]
 99%|█████████▉| 37589/37963 [85:27:57<47:42,  7.65s/it]
 99%|█████████▉| 37590/37963 [85:28:05<47:52,  7.70s/it]
                                                        
{'loss': '0.08653', 'grad_norm': '2.759', 'learning_rate': '5.09e-09', 'epoch': '0.9902'}
+
 99%|█████████▉| 37590/37963 [85:28:05<47:52,  7.70s/it]
 99%|█████████▉| 37591/37963 [85:28:12<47:46,  7.71s/it]
 99%|█████████▉| 37592/37963 [85:28:20<47:19,  7.65s/it]
 99%|█████████▉| 37593/37963 [85:28:30<51:59,  8.43s/it]
 99%|█████████▉| 37594/37963 [85:28:38<50:59,  8.29s/it]
 99%|█████████▉| 37595/37963 [85:28:46<49:54,  8.14s/it]
 99%|█████████▉| 37596/37963 [85:28:54<49:06,  8.03s/it]
 99%|█████████▉| 37597/37963 [85:29:01<48:21,  7.93s/it]
 99%|█████████▉| 37598/37963 [85:29:11<52:30,  8.63s/it]
 99%|█████████▉| 37599/37963 [85:29:19<50:31,  8.33s/it]
 99%|█████████▉| 37600/37963 [85:29:27<49:37,  8.20s/it]
                                                        
{'loss': '0.08739', 'grad_norm': '3.362', 'learning_rate': '4.821e-09', 'epoch': '0.9904'}
+
 99%|█████████▉| 37600/37963 [85:29:27<49:37,  8.20s/it]
 99%|█████████▉| 37601/37963 [85:29:35<48:27,  8.03s/it]
 99%|█████████▉| 37602/37963 [85:29:42<47:35,  7.91s/it]
 99%|█████████▉| 37603/37963 [85:29:53<51:42,  8.62s/it]
 99%|█████████▉| 37604/37963 [85:30:00<49:56,  8.35s/it]
 99%|█████████▉| 37605/37963 [85:30:08<48:46,  8.18s/it]
 99%|█████████▉| 37606/37963 [85:30:16<47:22,  7.96s/it]
 99%|█████████▉| 37607/37963 [85:30:23<46:16,  7.80s/it]
 99%|█████████▉| 37608/37963 [85:30:31<45:51,  7.75s/it]
 99%|█████████▉| 37609/37963 [85:30:38<45:28,  7.71s/it]
 99%|█████████▉| 37610/37963 [85:30:49<50:12,  8.53s/it]
                                                        
{'loss': '0.07972', 'grad_norm': '2.91', 'learning_rate': '4.56e-09', 'epoch': '0.9907'}
+
 99%|█████████▉| 37610/37963 [85:30:49<50:12,  8.53s/it]
 99%|█████████▉| 37611/37963 [85:30:56<48:35,  8.28s/it]
 99%|█████████▉| 37612/37963 [85:31:10<57:19,  9.80s/it]
 99%|█████████▉| 37613/37963 [85:31:20<58:53, 10.10s/it]
 99%|█████████▉| 37614/37963 [85:31:28<54:55,  9.44s/it]
 99%|█████████▉| 37615/37963 [85:31:36<51:40,  8.91s/it]
 99%|█████████▉| 37616/37963 [85:31:44<49:47,  8.61s/it]
 99%|█████████▉| 37617/37963 [85:31:52<48:04,  8.34s/it]
 99%|█████████▉| 37618/37963 [85:31:59<46:53,  8.15s/it]
 99%|█████████▉| 37619/37963 [85:32:07<46:10,  8.05s/it]
 99%|█████████▉| 37620/37963 [85:32:15<45:41,  7.99s/it]
                                                        
{'loss': '0.07073', 'grad_norm': '4.206', 'learning_rate': '4.306e-09', 'epoch': '0.991'}
+
 99%|█████████▉| 37620/37963 [85:32:15<45:41,  7.99s/it]
 99%|█████████▉| 37621/37963 [85:32:23<45:06,  7.91s/it]
 99%|█████████▉| 37622/37963 [85:32:31<44:56,  7.91s/it]
 99%|█████████▉| 37623/37963 [85:32:38<44:34,  7.87s/it]
 99%|█████████▉| 37624/37963 [85:32:46<44:30,  7.88s/it]
 99%|█████████▉| 37625/37963 [85:32:54<44:05,  7.83s/it]
 99%|█████████▉| 37626/37963 [85:33:04<48:12,  8.58s/it]
 99%|█████████▉| 37627/37963 [85:33:12<46:38,  8.33s/it]
 99%|█████████▉| 37628/37963 [85:33:20<45:31,  8.15s/it]
 99%|█████████▉| 37629/37963 [85:33:28<44:58,  8.08s/it]
 99%|█████████▉| 37630/37963 [85:33:35<44:09,  7.96s/it]
                                                        
{'loss': '0.07117', 'grad_norm': '2.936', 'learning_rate': '4.059e-09', 'epoch': '0.9912'}
+
 99%|█████████▉| 37630/37963 [85:33:35<44:09,  7.96s/it]
 99%|█████████▉| 37631/37963 [85:33:43<43:31,  7.87s/it]
 99%|█████████▉| 37632/37963 [85:33:51<42:54,  7.78s/it]
 99%|█████████▉| 37633/37963 [85:33:58<42:35,  7.74s/it]
 99%|█████████▉| 37634/37963 [85:34:06<42:32,  7.76s/it]
 99%|█████████▉| 37635/37963 [85:34:14<41:59,  7.68s/it]
 99%|█████████▉| 37636/37963 [85:34:21<42:00,  7.71s/it]
 99%|█████████▉| 37637/37963 [85:34:29<41:49,  7.70s/it]
 99%|█████████▉| 37638/37963 [85:34:37<41:41,  7.70s/it]
 99%|█████████▉| 37639/37963 [85:34:45<41:59,  7.78s/it]
 99%|█████████▉| 37640/37963 [85:34:52<41:37,  7.73s/it]
                                                        
{'loss': '0.08554', 'grad_norm': '5.943', 'learning_rate': '3.82e-09', 'epoch': '0.9915'}
+
 99%|█████████▉| 37640/37963 [85:34:52<41:37,  7.73s/it]
 99%|█████████▉| 37641/37963 [85:35:03<45:31,  8.48s/it]
 99%|█████████▉| 37642/37963 [85:35:13<48:29,  9.06s/it]
 99%|█████████▉| 37643/37963 [85:35:21<46:05,  8.64s/it]
 99%|█████████▉| 37644/37963 [85:35:28<44:34,  8.38s/it]
 99%|█████████▉| 37645/37963 [85:35:36<42:59,  8.11s/it]
 99%|█████████▉| 37646/37963 [85:35:44<42:25,  8.03s/it]
 99%|█████████▉| 37647/37963 [85:35:51<41:48,  7.94s/it]
 99%|█████████▉| 37648/37963 [85:35:59<40:54,  7.79s/it]
 99%|█████████▉| 37649/37963 [85:36:07<40:53,  7.81s/it]
 99%|█████████▉| 37650/37963 [85:36:14<40:28,  7.76s/it]
                                                        
{'loss': '0.07806', 'grad_norm': '5.336', 'learning_rate': '3.588e-09', 'epoch': '0.9918'}
+
 99%|█████████▉| 37650/37963 [85:36:14<40:28,  7.76s/it]
 99%|█████████▉| 37651/37963 [85:36:25<44:47,  8.61s/it]
 99%|█████████▉| 37652/37963 [85:36:33<43:29,  8.39s/it]
 99%|█████████▉| 37653/37963 [85:36:41<42:20,  8.20s/it]
 99%|█████████▉| 37654/37963 [85:36:51<46:09,  8.96s/it]
 99%|█████████▉| 37655/37963 [85:36:59<43:51,  8.54s/it]
 99%|█████████▉| 37656/37963 [85:37:07<42:36,  8.33s/it]
 99%|█████████▉| 37657/37963 [85:37:14<41:27,  8.13s/it]
 99%|█████████▉| 37658/37963 [85:37:22<40:37,  7.99s/it]
 99%|█████████▉| 37659/37963 [85:37:30<40:06,  7.92s/it]
 99%|█████████▉| 37660/37963 [85:37:38<39:35,  7.84s/it]
                                                        
{'loss': '0.07815', 'grad_norm': '2.513', 'learning_rate': '3.363e-09', 'epoch': '0.992'}
+
 99%|█████████▉| 37660/37963 [85:37:38<39:35,  7.84s/it]
 99%|█████████▉| 37661/37963 [85:37:48<43:21,  8.61s/it]
 99%|█████████▉| 37662/37963 [85:37:58<44:50,  8.94s/it]
 99%|█████████▉| 37663/37963 [85:38:06<43:05,  8.62s/it]
 99%|█████████▉| 37664/37963 [85:38:13<41:12,  8.27s/it]
 99%|█████████▉| 37665/37963 [85:38:23<44:21,  8.93s/it]
 99%|█████████▉| 37666/37963 [85:38:31<42:20,  8.55s/it]
 99%|█████████▉| 37667/37963 [85:38:39<40:55,  8.29s/it]
 99%|█████████▉| 37668/37963 [85:38:46<39:52,  8.11s/it]
 99%|█████████▉| 37669/37963 [85:38:54<39:06,  7.98s/it]
 99%|█████████▉| 37670/37963 [85:39:02<38:35,  7.90s/it]
                                                        
{'loss': '0.0955', 'grad_norm': '3.948', 'learning_rate': '3.145e-09', 'epoch': '0.9923'}
+
 99%|█████████▉| 37670/37963 [85:39:02<38:35,  7.90s/it]
 99%|█████████▉| 37671/37963 [85:39:10<38:12,  7.85s/it]
 99%|█████████▉| 37672/37963 [85:39:17<37:39,  7.76s/it]
 99%|█████████▉| 37673/37963 [85:39:25<37:30,  7.76s/it]
 99%|█████████▉| 37674/37963 [85:39:33<37:22,  7.76s/it]
 99%|█████████▉| 37675/37963 [85:39:40<37:07,  7.73s/it]
 99%|█████████▉| 37676/37963 [85:39:48<36:50,  7.70s/it]
 99%|█████████▉| 37677/37963 [85:39:56<36:30,  7.66s/it]
 99%|█████████▉| 37678/37963 [85:40:06<40:13,  8.47s/it]
 99%|█████████▉| 37679/37963 [85:40:14<38:56,  8.23s/it]
 99%|█████████▉| 37680/37963 [85:40:21<37:38,  7.98s/it]
                                                        
{'loss': '0.08476', 'grad_norm': '3.235', 'learning_rate': '2.935e-09', 'epoch': '0.9925'}
+
 99%|█████████▉| 37680/37963 [85:40:21<37:38,  7.98s/it]
 99%|█████████▉| 37681/37963 [85:40:29<37:21,  7.95s/it]
 99%|█████████▉| 37682/37963 [85:40:37<36:58,  7.90s/it]
 99%|█████████▉| 37683/37963 [85:40:44<36:43,  7.87s/it]
 99%|█████████▉| 37684/37963 [85:40:52<36:38,  7.88s/it]
 99%|█████████▉| 37685/37963 [85:41:03<40:03,  8.65s/it]
 99%|█████████▉| 37686/37963 [85:41:10<38:37,  8.37s/it]
 99%|█████████▉| 37687/37963 [85:41:18<37:34,  8.17s/it]
 99%|█████████▉| 37688/37963 [85:41:26<36:55,  8.06s/it]
 99%|█████████▉| 37689/37963 [85:41:34<36:32,  8.00s/it]
 99%|█████████▉| 37690/37963 [85:41:44<39:33,  8.69s/it]
                                                        
{'loss': '0.07765', 'grad_norm': '2.983', 'learning_rate': '2.732e-09', 'epoch': '0.9928'}
+
 99%|█████████▉| 37690/37963 [85:41:44<39:33,  8.69s/it]
 99%|█████████▉| 37691/37963 [85:41:52<38:05,  8.40s/it]
 99%|█████████▉| 37692/37963 [85:42:00<37:04,  8.21s/it]
 99%|█████████▉| 37693/37963 [85:42:08<36:27,  8.10s/it]
 99%|█████████▉| 37694/37963 [85:42:15<35:32,  7.93s/it]
 99%|█████████▉| 37695/37963 [85:42:23<35:19,  7.91s/it]
 99%|█████████▉| 37696/37963 [85:42:31<35:12,  7.91s/it]
 99%|█████████▉| 37697/37963 [85:42:39<35:12,  7.94s/it]
 99%|█████████▉| 37698/37963 [85:42:49<38:38,  8.75s/it]
 99%|█████████▉| 37699/37963 [85:42:57<37:22,  8.49s/it]
 99%|█████████▉| 37700/37963 [85:43:05<36:14,  8.27s/it]
                                                        
{'loss': '0.08732', 'grad_norm': '3.621', 'learning_rate': '2.536e-09', 'epoch': '0.9931'}
+
 99%|█████████▉| 37700/37963 [85:43:05<36:14,  8.27s/it]
 99%|█████████▉| 37701/37963 [85:43:13<35:04,  8.03s/it]
 99%|█████████▉| 37702/37963 [85:43:20<34:34,  7.95s/it]
 99%|█████████▉| 37703/37963 [85:43:28<34:02,  7.86s/it]
 99%|█████████▉| 37704/37963 [85:43:38<36:56,  8.56s/it]
 99%|█████████▉| 37705/37963 [85:43:46<35:42,  8.31s/it]
 99%|█████████▉| 37706/37963 [85:43:56<38:03,  8.89s/it]
 99%|█████████▉| 37707/37963 [85:44:04<36:31,  8.56s/it]
 99%|█████████▉| 37708/37963 [85:44:12<35:16,  8.30s/it]
 99%|█████████▉| 37709/37963 [85:44:25<41:14,  9.74s/it]
 99%|█████████▉| 37710/37963 [85:44:33<38:51,  9.22s/it]
                                                        
{'loss': '0.078', 'grad_norm': '4.054', 'learning_rate': '2.348e-09', 'epoch': '0.9933'}
+
 99%|█████████▉| 37710/37963 [85:44:33<38:51,  9.22s/it]
 99%|█████████▉| 37711/37963 [85:44:40<36:39,  8.73s/it]
 99%|█████��███▉| 37712/37963 [85:44:48<34:59,  8.37s/it]
 99%|█████████▉| 37713/37963 [85:44:56<34:04,  8.18s/it]
 99%|█████████▉| 37714/37963 [85:45:03<33:26,  8.06s/it]
 99%|█████████▉| 37715/37963 [85:45:11<32:25,  7.84s/it]
 99%|█████████▉| 37716/37963 [85:45:18<32:12,  7.82s/it]
 99%|█████████▉| 37717/37963 [85:45:26<32:18,  7.88s/it]
 99%|█████████▉| 37718/37963 [85:45:34<32:14,  7.90s/it]
 99%|█████████▉| 37719/37963 [85:45:42<31:54,  7.85s/it]
 99%|█████████▉| 37720/37963 [85:45:50<31:31,  7.78s/it]
                                                        
{'loss': '0.0835', 'grad_norm': '3.263', 'learning_rate': '2.167e-09', 'epoch': '0.9936'}
+
 99%|█████████▉| 37720/37963 [85:45:50<31:31,  7.78s/it]
 99%|█████████▉| 37721/37963 [85:45:58<31:24,  7.79s/it]
 99%|█████████▉| 37722/37963 [85:46:06<31:34,  7.86s/it]
 99%|█████████▉| 37723/37963 [85:46:13<30:58,  7.74s/it]
 99%|█████████▉| 37724/37963 [85:46:21<30:38,  7.69s/it]
 99%|█████████▉| 37725/37963 [85:46:28<30:34,  7.71s/it]
 99%|█████████▉| 37726/37963 [85:46:39<33:43,  8.54s/it]
 99%|█████████▉| 37727/37963 [85:46:46<32:28,  8.26s/it]
 99%|█████████▉| 37728/37963 [85:46:54<31:37,  8.07s/it]
 99%|█████████▉| 37729/37963 [85:47:02<31:08,  7.99s/it]
 99%|█████████▉| 37730/37963 [85:47:10<30:50,  7.94s/it]
                                                        
{'loss': '0.0764', 'grad_norm': '3.66', 'learning_rate': '1.993e-09', 'epoch': '0.9939'}
+
 99%|█████████▉| 37730/37963 [85:47:10<30:50,  7.94s/it]
 99%|█████████▉| 37731/37963 [85:47:17<30:24,  7.86s/it]
 99%|█████████▉| 37732/37963 [85:47:25<30:03,  7.81s/it]
 99%|█████████▉| 37733/37963 [85:47:35<32:42,  8.53s/it]
 99%|█████████▉| 37734/37963 [85:47:43<31:33,  8.27s/it]
 99%|█████████▉| 37735/37963 [85:47:51<30:55,  8.14s/it]
 99%|█████████▉| 37736/37963 [85:47:58<30:12,  7.98s/it]
 99%|█████████▉| 37737/37963 [85:48:06<29:46,  7.91s/it]
 99%|█████████▉| 37738/37963 [85:48:16<32:13,  8.59s/it]
 99%|█████████▉| 37739/37963 [85:48:24<31:03,  8.32s/it]
 99%|█████████▉| 37740/37963 [85:48:32<30:10,  8.12s/it]
                                                        
{'loss': '0.08887', 'grad_norm': '4.364', 'learning_rate': '1.826e-09', 'epoch': '0.9941'}
+
 99%|█████████▉| 37740/37963 [85:48:32<30:10,  8.12s/it]
 99%|█████████▉| 37741/37963 [85:48:42<32:57,  8.91s/it]
 99%|█████████▉| 37742/37963 [85:48:50<31:21,  8.51s/it]
 99%|█████████▉| 37743/37963 [85:48:58<30:28,  8.31s/it]
 99%|█████████▉| 37744/37963 [85:49:06<29:36,  8.11s/it]
 99%|█████████▉| 37745/37963 [85:49:13<29:02,  7.99s/it]
 99%|█████████▉| 37746/37963 [85:49:21<28:52,  7.98s/it]
 99%|█████████▉| 37747/37963 [85:49:29<28:38,  7.95s/it]
 99%|█████████▉| 37748/37963 [85:49:37<28:24,  7.93s/it]
 99%|█████████▉| 37749/37963 [85:49:45<28:03,  7.87s/it]
 99%|█████████▉| 37750/37963 [85:49:52<27:38,  7.79s/it]
                                                        
{'loss': '0.08085', 'grad_norm': '3.318', 'learning_rate': '1.667e-09', 'epoch': '0.9944'}
+
 99%|█████████▉| 37750/37963 [85:49:52<27:38,  7.79s/it]
 99%|█████████▉| 37751/37963 [85:50:00<27:19,  7.73s/it]
 99%|█████████▉| 37752/37963 [85:50:10<30:07,  8.57s/it]
 99%|█████████▉| 37753/37963 [85:50:18<29:05,  8.31s/it]
 99%|█████████▉| 37754/37963 [85:50:26<28:15,  8.11s/it]
 99%|█████████▉| 37755/37963 [85:50:33<27:39,  7.98s/it]
 99%|█████████▉| 37756/37963 [85:50:41<27:06,  7.86s/it]
 99%|█████████▉| 37757/37963 [85:50:51<28:57,  8.43s/it]
 99%|█████████▉| 37758/37963 [85:51:01<30:39,  8.97s/it]
 99%|█████████▉| 37759/37963 [85:51:09<29:07,  8.57s/it]
 99%|█████████▉| 37760/37963 [85:51:17<28:18,  8.37s/it]
                                                        
{'loss': '0.08238', 'grad_norm': '4.141', 'learning_rate': '1.514e-09', 'epoch': '0.9947'}
+
 99%|█████████▉| 37760/37963 [85:51:17<28:18,  8.37s/it]
 99%|█████████▉| 37761/37963 [85:51:24<27:27,  8.16s/it]
 99%|█████████▉| 37762/37963 [85:51:32<26:49,  8.01s/it]
 99%|█████████▉| 37763/37963 [85:51:42<29:08,  8.74s/it]
 99%|���████████▉| 37764/37963 [85:51:50<27:51,  8.40s/it]
 99%|█████████▉| 37765/37963 [85:51:58<27:07,  8.22s/it]
 99%|█████████▉| 37766/37963 [85:52:06<26:35,  8.10s/it]
 99%|█████████▉| 37767/37963 [85:52:13<26:15,  8.04s/it]
 99%|█████████▉| 37768/37963 [85:52:21<25:35,  7.88s/it]
 99%|█████████▉| 37769/37963 [85:52:28<25:00,  7.73s/it]
 99%|█████████▉| 37770/37963 [85:52:36<24:36,  7.65s/it]
                                                        
{'loss': '0.09294', 'grad_norm': '2.716', 'learning_rate': '1.37e-09', 'epoch': '0.9949'}
+
 99%|█████████▉| 37770/37963 [85:52:36<24:36,  7.65s/it]
 99%|█████████▉| 37771/37963 [85:52:44<24:46,  7.74s/it]
 99%|█████████▉| 37772/37963 [85:52:52<24:43,  7.77s/it]
 99%|█████████▉| 37773/37963 [85:52:59<24:27,  7.73s/it]
100%|█████████▉| 37774/37963 [85:53:07<24:17,  7.71s/it]
100%|█████████▉| 37775/37963 [85:53:15<24:06,  7.69s/it]
100%|█████████▉| 37776/37963 [85:53:22<24:01,  7.71s/it]
100%|█████████▉| 37777/37963 [85:53:33<26:20,  8.50s/it]
100%|█████████▉| 37778/37963 [85:53:41<25:39,  8.32s/it]
100%|█████████▉| 37779/37963 [85:53:51<27:14,  8.88s/it]
100%|█████████▉| 37780/37963 [85:53:59<26:13,  8.60s/it]
                                                        
{'loss': '0.09357', 'grad_norm': '4.138', 'learning_rate': '1.232e-09', 'epoch': '0.9952'}
+
100%|█████████▉| 37780/37963 [85:53:59<26:13,  8.60s/it]
100%|█████████▉| 37781/37963 [85:54:07<25:27,  8.39s/it]
100%|█████████▉| 37782/37963 [85:54:17<26:52,  8.91s/it]
100%|█████████▉| 37783/37963 [85:54:24<25:41,  8.56s/it]
100%|█████████▉| 37784/37963 [85:54:32<24:59,  8.38s/it]
100%|█████████▉| 37785/37963 [85:54:43<26:37,  8.98s/it]
100%|█████████▉| 37786/37963 [85:54:51<25:25,  8.62s/it]
100%|█████████▉| 37787/37963 [85:54:58<24:27,  8.34s/it]
100%|█████████▉| 37788/37963 [85:55:06<23:48,  8.16s/it]
100%|█████████▉| 37789/37963 [85:55:14<23:20,  8.05s/it]
100%|█████████▉| 37790/37963 [85:55:21<22:47,  7.91s/it]
                                                        
{'loss': '0.08202', 'grad_norm': '3.001', 'learning_rate': '1.102e-09', 'epoch': '0.9954'}
+
100%|█████████▉| 37790/37963 [85:55:21<22:47,  7.91s/it]
100%|█████████▉| 37791/37963 [85:55:29<22:27,  7.84s/it]
100%|█████████▉| 37792/37963 [85:55:37<22:16,  7.81s/it]
100%|█████████▉| 37793/37963 [85:55:45<22:11,  7.84s/it]
100%|█████████▉| 37794/37963 [85:55:52<21:54,  7.78s/it]
100%|█████████▉| 37795/37963 [85:56:00<21:42,  7.75s/it]
100%|█████████▉| 37796/37963 [85:56:08<21:26,  7.70s/it]
100%|█████████▉| 37797/37963 [85:56:15<21:21,  7.72s/it]
100%|█████████▉| 37798/37963 [85:56:23<21:09,  7.69s/it]
100%|█████████▉| 37799/37963 [85:56:31<20:57,  7.67s/it]
100%|█████████▉| 37800/37963 [85:56:41<22:43,  8.36s/it]
                                                        
{'loss': '0.07771', 'grad_norm': '3.565', 'learning_rate': '9.788e-10', 'epoch': '0.9957'}
+
100%|█████████▉| 37800/37963 [85:56:41<22:43,  8.36s/it]
100%|█████████▉| 37801/37963 [85:56:49<22:16,  8.25s/it]
100%|█████████▉| 37802/37963 [85:56:59<23:45,  8.85s/it]
100%|█████████▉| 37803/37963 [85:57:07<22:47,  8.55s/it]
100%|█████████▉| 37804/37963 [85:57:14<22:00,  8.30s/it]
100%|█████████▉| 37805/37963 [85:57:22<21:22,  8.12s/it]
100%|█████████▉| 37806/37963 [85:57:30<20:51,  7.97s/it]
100%|█████████▉| 37807/37963 [85:57:40<22:53,  8.80s/it]
100%|█████████▉| 37808/37963 [85:57:48<21:40,  8.39s/it]
100%|█████████▉| 37809/37963 [85:57:56<21:06,  8.23s/it]
100%|█████████▉| 37810/37963 [85:58:04<20:40,  8.11s/it]
                                                        
{'loss': '0.08484', 'grad_norm': '3.776', 'learning_rate': '8.631e-10', 'epoch': '0.996'}
+
100%|█████████▉| 37810/37963 [85:58:04<20:40,  8.11s/it]
100%|█████████▉| 37811/37963 [85:58:11<20:14,  7.99s/it]
100%|█████████▉| 37812/37963 [85:58:21<21:47,  8.66s/it]
100%|█████████▉| 37813/37963 [85:58:29<20:59,  8.40s/it]
100%|█████████▉| 37814/37963 [85:58:37<20:27,  8.23s/it]
100%|█████████▉| 37815/37963 [85:58:45<19:57,  8.09s/it]
100%|█████████▉| 37816/37963 [85:58:53<19:34,  7.99s/it]
100%|█████████▉| 37817/37963 [85:59:01<19:29,  8.01s/it]
100%|█████████▉| 37818/37963 [85:59:09<19:14,  7.97s/it]
100%|█████████▉| 37819/37963 [85:59:16<18:52,  7.86s/it]
100%|█████████▉| 37820/37963 [85:59:24<18:33,  7.79s/it]
                                                        
{'loss': '0.08563', 'grad_norm': '3.881', 'learning_rate': '7.546e-10', 'epoch': '0.9962'}
+
100%|█████████▉| 37820/37963 [85:59:24<18:33,  7.79s/it]
100%|█████████▉| 37821/37963 [85:59:31<18:08,  7.66s/it]
100%|█████████▉| 37822/37963 [85:59:39<18:16,  7.78s/it]
100%|█████████▉| 37823/37963 [85:59:49<19:43,  8.45s/it]
100%|█████████▉| 37824/37963 [85:59:57<19:16,  8.32s/it]
100%|█████████▉| 37825/37963 [86:00:05<18:40,  8.12s/it]
100%|█████████▉| 37826/37963 [86:00:15<20:01,  8.77s/it]
100%|█████████▉| 37827/37963 [86:00:23<19:27,  8.59s/it]
100%|█████████▉| 37828/37963 [86:00:31<18:48,  8.36s/it]
100%|█████████▉| 37829/37963 [86:00:42<20:10,  9.03s/it]
100%|█████████▉| 37830/37963 [86:00:52<20:58,  9.46s/it]
                                                        
{'loss': '0.08777', 'grad_norm': '3.327', 'learning_rate': '6.535e-10', 'epoch': '0.9965'}
+
100%|█████████▉| 37830/37963 [86:00:52<20:58,  9.46s/it]
100%|█████████▉| 37831/37963 [86:01:00<19:46,  8.99s/it]
100%|█████████▉| 37832/37963 [86:01:08<18:49,  8.62s/it]
100%|█████████▉| 37833/37963 [86:01:15<17:57,  8.29s/it]
100%|█████████▉| 37834/37963 [86:01:23<17:26,  8.11s/it]
100%|█████████▉| 37835/37963 [86:01:31<17:02,  7.99s/it]
100%|█████████▉| 37836/37963 [86:01:38<16:29,  7.79s/it]
100%|█████████▉| 37837/37963 [86:01:46<16:31,  7.87s/it]
100%|█████████▉| 37838/37963 [86:01:54<16:23,  7.87s/it]
100%|█████████▉| 37839/37963 [86:02:02<16:19,  7.90s/it]
100%|█████████▉| 37840/37963 [86:02:10<16:11,  7.89s/it]
                                                        
{'loss': '0.09798', 'grad_norm': '2.958', 'learning_rate': '5.596e-10', 'epoch': '0.9968'}
+
100%|█████████▉| 37840/37963 [86:02:10<16:11,  7.89s/it]
100%|█████████▉| 37841/37963 [86:02:17<15:49,  7.79s/it]
100%|█████████▉| 37842/37963 [86:02:25<15:50,  7.85s/it]
100%|█████████▉| 37843/37963 [86:02:33<15:49,  7.91s/it]
100%|█████████▉| 37844/37963 [86:02:44<17:05,  8.62s/it]
100%|█████████▉| 37845/37963 [86:02:52<16:33,  8.42s/it]
100%|█████████▉| 37846/37963 [86:03:00<16:12,  8.32s/it]
100%|█████████▉| 37847/37963 [86:03:08<15:45,  8.15s/it]
100%|█████████▉| 37848/37963 [86:03:15<15:23,  8.03s/it]
100%|█████████▉| 37849/37963 [86:03:23<15:04,  7.93s/it]
100%|█████████▉| 37850/37963 [86:03:33<16:19,  8.67s/it]
                                                        
{'loss': '0.08431', 'grad_norm': '3.986', 'learning_rate': '4.729e-10', 'epoch': '0.997'}
+
100%|█████████▉| 37850/37963 [86:03:33<16:19,  8.67s/it]
100%|█████████▉| 37851/37963 [86:03:44<17:13,  9.22s/it]
100%|█████████▉| 37852/37963 [86:03:52<16:24,  8.87s/it]
100%|█████████▉| 37853/37963 [86:04:00<15:37,  8.53s/it]
100%|█████████▉| 37854/37963 [86:04:08<15:08,  8.34s/it]
100%|█████████▉| 37855/37963 [86:04:16<14:51,  8.26s/it]
100%|█████████▉| 37856/37963 [86:04:23<14:29,  8.13s/it]
100%|█████████▉| 37857/37963 [86:04:31<14:11,  8.03s/it]
100%|█████████▉| 37858/37963 [86:04:39<13:53,  7.94s/it]
100%|█████████▉| 37859/37963 [86:04:46<13:30,  7.79s/it]
100%|█████████▉| 37860/37963 [86:04:54<13:22,  7.79s/it]
                                                        
{'loss': '0.08913', 'grad_norm': '4.177', 'learning_rate': '3.936e-10', 'epoch': '0.9973'}
+
100%|█████████▉| 37860/37963 [86:04:54<13:22,  7.79s/it]
100%|█████████▉| 37861/37963 [86:05:02<13:21,  7.85s/it]
100%|█████████▉| 37862/37963 [86:05:10<13:14,  7.87s/it]
100%|█████████▉| 37863/37963 [86:05:18<13:07,  7.88s/it]
100%|█████████▉| 37864/37963 [86:05:26<12:58,  7.87s/it]
100%|█████████▉| 37865/37963 [86:05:33<12:42,  7.78s/it]
100%|█████████▉| 37866/37963 [86:05:44<13:47,  8.53s/it]
100%|█████████▉| 37867/37963 [86:05:52<13:17,  8.31s/it]
100%|█████████▉| 37868/37963 [86:05:59<12:54,  8.15s/it]
100%|█████████▉| 37869/37963 [86:06:10<13:44,  8.77s/it]
100%|█████████▉| 37870/37963 [86:06:17<13:08,  8.48s/it]
                                                        
{'loss': '0.08269', 'grad_norm': '3.526', 'learning_rate': '3.216e-10', 'epoch': '0.9976'}
+
100%|█████████▉| 37870/37963 [86:06:17<13:08,  8.48s/it]
100%|█████████▉| 37871/37963 [86:06:25<12:37,  8.23s/it]
100%|█████████▉| 37872/37963 [86:06:33<12:20,  8.14s/it]
100%|█████████▉| 37873/37963 [86:06:46<14:25,  9.61s/it]
100%|█████████▉| 37874/37963 [86:06:54<13:28,  9.08s/it]
100%|█████████▉| 37875/37963 [86:07:04<13:57,  9.51s/it]
100%|█████████▉| 37876/37963 [86:07:12<12:55,  8.91s/it]
100%|█████████▉| 37877/37963 [86:07:20<12:19,  8.60s/it]
100%|█████████▉| 37878/37963 [86:07:27<11:42,  8.27s/it]
100%|█████████▉| 37879/37963 [86:07:35<11:24,  8.15s/it]
100%|█████████▉| 37880/37963 [86:07:43<11:02,  7.98s/it]
                                                        
{'loss': '0.09057', 'grad_norm': '2.72', 'learning_rate': '2.568e-10', 'epoch': '0.9978'}
+
100%|█████████▉| 37880/37963 [86:07:43<11:02,  7.98s/it]
100%|█████████▉| 37881/37963 [86:07:50<10:46,  7.88s/it]
100%|█████████▉| 37882/37963 [86:07:58<10:31,  7.80s/it]
100%|█████████▉| 37883/37963 [86:08:06<10:21,  7.77s/it]
100%|█████████▉| 37884/37963 [86:08:13<10:12,  7.75s/it]
100%|█████████▉| 37885/37963 [86:08:21<10:04,  7.76s/it]
100%|█████████▉| 37886/37963 [86:08:29<10:04,  7.85s/it]
100%|█████████▉| 37887/37963 [86:08:39<10:49,  8.55s/it]
100%|█████████▉| 37888/37963 [86:08:47<10:22,  8.29s/it]
100%|█████████▉| 37889/37963 [86:08:55<09:56,  8.06s/it]
100%|█████████▉| 37890/37963 [86:09:03<09:46,  8.04s/it]
                                                        
{'loss': '0.09141', 'grad_norm': '4.038', 'learning_rate': '1.993e-10', 'epoch': '0.9981'}
+
100%|█████████▉| 37890/37963 [86:09:03<09:46,  8.04s/it]
100%|█████████▉| 37891/37963 [86:09:10<09:32,  7.95s/it]
100%|█████████▉| 37892/37963 [86:09:18<09:21,  7.91s/it]
100%|█████████▉| 37893/37963 [86:09:26<09:08,  7.83s/it]
100%|█████████▉| 37894/37963 [86:09:36<09:59,  8.68s/it]
100%|█████████▉| 37895/37963 [86:09:44<09:31,  8.40s/it]
100%|█████████▉| 37896/37963 [86:09:52<09:09,  8.20s/it]
100%|█████████▉| 37897/37963 [86:09:59<08:44,  7.95s/it]
100%|█████████▉| 37898/37963 [86:10:10<09:28,  8.75s/it]
100%|█████████▉| 37899/37963 [86:10:18<09:05,  8.52s/it]
100%|█████████▉| 37900/37963 [86:10:26<08:44,  8.33s/it]
                                                        
{'loss': '0.08582', 'grad_norm': '3.048', 'learning_rate': '1.491e-10', 'epoch': '0.9983'}
+
100%|█████████▉| 37900/37963 [86:10:26<08:44,  8.33s/it]
100%|█████████▉| 37901/37963 [86:10:34<08:28,  8.20s/it]
100%|█████████▉| 37902/37963 [86:10:42<08:16,  8.13s/it]
100%|█████████▉| 37903/37963 [86:10:49<08:01,  8.02s/it]
100%|█████████▉| 37904/37963 [86:10:57<07:48,  7.94s/it]
100%|█████████▉| 37905/37963 [86:11:05<07:37,  7.89s/it]
100%|█████████▉| 37906/37963 [86:11:12<07:22,  7.76s/it]
100%|█████████▉| 37907/37963 [86:11:20<07:14,  7.76s/it]
100%|█████████▉| 37908/37963 [86:11:28<07:03,  7.69s/it]
100%|█████████▉| 37909/37963 [86:11:35<06:54,  7.68s/it]
100%|█████████▉| 37910/37963 [86:11:43<06:49,  7.72s/it]
                                                        
{'loss': '0.07079', 'grad_norm': '3.958', 'learning_rate': '1.061e-10', 'epoch': '0.9986'}
+
100%|█████████▉| 37910/37963 [86:11:43<06:49,  7.72s/it]
100%|█████████▉| 37911/37963 [86:11:51<06:44,  7.78s/it]
100%|█████████▉| 37912/37963 [86:11:59<06:35,  7.75s/it]
100%|█████████▉| 37913/37963 [86:12:09<07:06,  8.53s/it]
100%|█████████▉| 37914/37963 [86:12:17<06:46,  8.30s/it]
100%|█████████▉| 37915/37963 [86:12:24<06:29,  8.11s/it]
100%|█████████▉| 37916/37963 [86:12:33<06:20,  8.10s/it]
100%|█████████▉| 37917/37963 [86:12:43<06:41,  8.74s/it]
100%|█████████▉| 37918/37963 [86:12:50<06:16,  8.36s/it]
100%|████████���▉| 37919/37963 [86:12:58<05:59,  8.17s/it]
100%|█████████▉| 37920/37963 [86:13:09<06:22,  8.89s/it]
                                                        
{'loss': '0.07637', 'grad_norm': '3.383', 'learning_rate': '7.046e-11', 'epoch': '0.9989'}
+
100%|█████████▉| 37920/37963 [86:13:09<06:22,  8.89s/it]
100%|█████████▉| 37921/37963 [86:13:16<05:57,  8.51s/it]
100%|█████████▉| 37922/37963 [86:13:24<05:43,  8.38s/it]
100%|█████████▉| 37923/37963 [86:13:32<05:29,  8.23s/it]
100%|█████████▉| 37924/37963 [86:13:40<05:15,  8.09s/it]
100%|█████████▉| 37925/37963 [86:13:48<05:03,  7.98s/it]
100%|█████████▉| 37926/37963 [86:13:56<04:55,  8.00s/it]
100%|█████████▉| 37927/37963 [86:14:06<05:17,  8.81s/it]
100%|█████████▉| 37928/37963 [86:14:14<04:59,  8.55s/it]
100%|█████████▉| 37929/37963 [86:14:25<05:10,  9.14s/it]
100%|█████████▉| 37930/37963 [86:14:33<04:49,  8.78s/it]
                                                        
{'loss': '0.07399', 'grad_norm': '3.056', 'learning_rate': '4.207e-11', 'epoch': '0.9991'}
+
100%|█████████▉| 37930/37963 [86:14:33<04:49,  8.78s/it]
100%|█████████▉| 37931/37963 [86:14:43<04:55,  9.22s/it]
100%|█████████▉| 37932/37963 [86:14:51<04:31,  8.77s/it]
100%|█████████▉| 37933/37963 [86:14:58<04:13,  8.46s/it]
100%|█████████▉| 37934/37963 [86:15:06<03:59,  8.25s/it]
100%|█████████▉| 37935/37963 [86:15:14<03:44,  8.01s/it]
100%|█████████▉| 37936/37963 [86:15:21<03:34,  7.95s/it]
100%|█████████▉| 37937/37963 [86:15:29<03:24,  7.88s/it]
100%|█████████▉| 37938/37963 [86:15:37<03:16,  7.84s/it]
100%|█████████▉| 37939/37963 [86:15:48<03:28,  8.71s/it]
100%|█████████▉| 37940/37963 [86:15:55<03:14,  8.44s/it]
                                                        
{'loss': '0.07237', 'grad_norm': '3.414', 'learning_rate': '2.096e-11', 'epoch': '0.9994'}
+
100%|█████████▉| 37940/37963 [86:15:55<03:14,  8.44s/it]
100%|█████████▉| 37941/37963 [86:16:03<02:58,  8.11s/it]
100%|█████████▉| 37942/37963 [86:16:11<02:48,  8.00s/it]
100%|█████████▉| 37943/37963 [86:16:18<02:38,  7.90s/it]
100%|█████████▉| 37944/37963 [86:16:26<02:28,  7.83s/it]
100%|█████████▉| 37945/37963 [86:16:34<02:19,  7.77s/it]
100%|█████████▉| 37946/37963 [86:16:41<02:10,  7.70s/it]
100%|█████████▉| 37947/37963 [86:16:51<02:15,  8.49s/it]
100%|█████████▉| 37948/37963 [86:16:59<02:03,  8.22s/it]
100%|█████████▉| 37949/37963 [86:17:07<01:54,  8.15s/it]
100%|█████████▉| 37950/37963 [86:17:15<01:44,  8.01s/it]
                                                        
{'loss': '0.07894', 'grad_norm': '2.993', 'learning_rate': '7.133e-12', 'epoch': '0.9997'}
+
100%|█████████▉| 37950/37963 [86:17:15<01:44,  8.01s/it]
100%|█████████▉| 37951/37963 [86:17:22<01:34,  7.90s/it]
100%|█████████▉| 37952/37963 [86:17:30<01:26,  7.89s/it]
100%|█████████▉| 37953/37963 [86:17:38<01:18,  7.86s/it]
100%|█████████▉| 37954/37963 [86:17:46<01:10,  7.86s/it]
100%|█████████▉| 37955/37963 [86:17:54<01:03,  7.88s/it]
100%|█████████▉| 37956/37963 [86:18:01<00:54,  7.82s/it]
100%|█████████▉| 37957/37963 [86:18:09<00:46,  7.83s/it]
100%|█████████▉| 37958/37963 [86:18:17<00:38,  7.78s/it]
100%|█████████▉| 37959/37963 [86:18:25<00:30,  7.71s/it]
100%|█████████▉| 37960/37963 [86:18:32<00:23,  7.74s/it]
                                                        
{'loss': '0.07547', 'grad_norm': '3.377', 'learning_rate': '5.823e-13', 'epoch': '0.9999'}
+
100%|█████████▉| 37960/37963 [86:18:32<00:23,  7.74s/it]
100%|█████████▉| 37961/37963 [86:18:42<00:16,  8.47s/it]
100%|█████████▉| 37962/37963 [86:18:53<00:09,  9.03s/it]
100%|██████████| 37963/37963 [86:19:02<00:00,  9.05s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.89s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.89s/it]
+
                                                        
{'train_runtime': '3.108e+05', 'train_samples_per_second': '7.818', 'train_steps_per_second': '0.122', 'train_loss': '0.1479', 'epoch': '1'}
+
100%|██████████| 37963/37963 [86:19:46<00:00,  9.05s/it]
100%|██████��███| 37963/37963 [86:19:46<00:00,  8.19s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.36s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.36s/it]
+[rank0]:[W912 16:45:18.266283522 ProcessGroupNCCL.cpp:1476] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())