BIue-Jay's picture
a6: last two checkpoints + eval/deploy files + training records
f7646d7 verified
Raw History Blame Contribute Delete
387 kB
Thu Nov 12 02:15:18 PM UTC 2026
dlc19te5fv9wtn5t-worker-2
GROOT_SINGLE_FT task=a6 frames=73243 per_gpu=32 global=256 steps=4000 save=2000 full_finetune=1 out=/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-runs-ft4k/a6/production
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/envs/groot-py312/lib/python3.12/site-packages/albumentations/__init__.py:13: UserWarning: A new version of Albumentations is available: 2.0.8 (you have 1.4.18). Upgrade using: pip install -U albumentations. To disable automatic update checks, set the environment variable NO_ALBUMENTATIONS_UPDATE to 1.
check_for_updates()
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/envs/groot-py312/lib/python3.12/site-packages/albumentations/__init__.py:13: UserWarning: A new version of Albumentations is available: 2.0.8 (you have 1.4.18). Upgrade using: pip install -U albumentations. To disable automatic update checks, set the environment variable NO_ALBUMENTATIONS_UPDATE to 1.
check_for_updates()
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/envs/groot-py312/lib/python3.12/site-packages/albumentations/__init__.py:13: UserWarning: A new version of Albumentations is available: 2.0.8 (you have 1.4.18). Upgrade using: pip install -U albumentations. To disable automatic update checks, set the environment variable NO_ALBUMENTATIONS_UPDATE to 1.
check_for_updates()
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/envs/groot-py312/lib/python3.12/site-packages/albumentations/check_version.py:49: UserWarning: Error fetching version info The read operation timed out
data = fetch_version_info()
Loaded modality config: /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/hb_groot/g1_feedback76_h16.py
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/experiment/experiment.py:122: UserWarning: image_crop_size and image_target_size will be deprecated in the future. Please use shortest_image_edge and crop_fraction instead.
warnings.warn(
Loaded modality config: /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/hb_groot/g1_feedback76_h16.py
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/experiment/experiment.py:122: UserWarning: image_crop_size and image_target_size will be deprecated in the future. Please use shortest_image_edge and crop_fraction instead.
warnings.warn(
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/envs/groot-py312/lib/python3.12/site-packages/albumentations/__init__.py:13: UserWarning: A new version of Albumentations is available: 2.0.8 (you have 1.4.18). Upgrade using: pip install -U albumentations. To disable automatic update checks, set the environment variable NO_ALBUMENTATIONS_UPDATE to 1.
check_for_updates()
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/envs/groot-py312/lib/python3.12/site-packages/albumentations/__init__.py:13: UserWarning: A new version of Albumentations is available: 2.0.8 (you have 1.4.18). Upgrade using: pip install -U albumentations. To disable automatic update checks, set the environment variable NO_ALBUMENTATIONS_UPDATE to 1.
check_for_updates()
Loaded modality config: /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/hb_groot/g1_feedback76_h16.py
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/experiment/experiment.py:122: UserWarning: image_crop_size and image_target_size will be deprecated in the future. Please use shortest_image_edge and crop_fraction instead.
warnings.warn(
Loaded modality config: /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/hb_groot/g1_feedback76_h16.py
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/experiment/experiment.py:122: UserWarning: image_crop_size and image_target_size will be deprecated in the future. Please use shortest_image_edge and crop_fraction instead.
warnings.warn(
Loaded modality config: /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/hb_groot/g1_feedback76_h16.py
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/experiment/experiment.py:122: UserWarning: image_crop_size and image_target_size will be deprecated in the future. Please use shortest_image_edge and crop_fraction instead.
warnings.warn(
Loaded modality config: /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/hb_groot/g1_feedback76_h16.py
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/experiment/experiment.py:122: UserWarning: image_crop_size and image_target_size will be deprecated in the future. Please use shortest_image_edge and crop_fraction instead.
warnings.warn(
NCCL version 2.27.5+cuda12.9
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/envs/groot-py312/lib/python3.12/site-packages/albumentations/check_version.py:49: UserWarning: Error fetching version info The read operation timed out
data = fetch_version_info()
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/envs/groot-py312/lib/python3.12/site-packages/albumentations/__init__.py:13: UserWarning: A new version of Albumentations is available: 2.0.8 (you have 1.4.18). Upgrade using: pip install -U albumentations. To disable automatic update checks, set the environment variable NO_ALBUMENTATIONS_UPDATE to 1.
check_for_updates()
Loaded modality config: /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/hb_groot/g1_feedback76_h16.py
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/experiment/experiment.py:122: UserWarning: image_crop_size and image_target_size will be deprecated in the future. Please use shortest_image_edge and crop_fraction instead.
warnings.warn(
Loaded modality config: /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/hb_groot/g1_feedback76_h16.py
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/experiment/experiment.py:122: UserWarning: image_crop_size and image_target_size will be deprecated in the future. Please use shortest_image_edge and crop_fraction instead.
warnings.warn(
11/12/2026 22:16:04 - INFO - Saved config to /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-runs-ft4k/a6/production/experiment_cfg
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLForConditionalGeneration is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLForConditionalGeneration is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLForConditionalGeneration is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLForConditionalGeneration is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLForConditionalGeneration is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLForConditionalGeneration is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLForConditionalGeneration is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLForConditionalGeneration is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLVisionModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLVisionModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLVisionModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLVisionModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLVisionModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLVisionModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLVisionModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLVisionModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLTextModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLTextModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLTextModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLTextModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLTextModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLTextModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLTextModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
Flash Attention 2 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen3VLTextModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", dtype=torch.float16)`
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/model/modules/dit.py:278: FutureWarning: Accessing config attribute `compute_dtype` directly via 'AlternateVLDiT' object attribute is deprecated. Please access 'compute_dtype' over 'AlternateVLDiT's config object instead, e.g. 'unet.config.compute_dtype'.
embedding_dim=self.inner_dim, compute_dtype=self.compute_dtype
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/model/modules/dit.py:309: FutureWarning: Accessing config attribute `output_dim` directly via 'AlternateVLDiT' object attribute is deprecated. Please access 'output_dim' over 'AlternateVLDiT's config object instead, e.g. 'unet.config.output_dim'.
self.proj_out_2 = nn.Linear(self.inner_dim, self.output_dim)
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/model/modules/dit.py:278: FutureWarning: Accessing config attribute `compute_dtype` directly via 'AlternateVLDiT' object attribute is deprecated. Please access 'compute_dtype' over 'AlternateVLDiT's config object instead, e.g. 'unet.config.compute_dtype'.
embedding_dim=self.inner_dim, compute_dtype=self.compute_dtype
Total number of DiT parameters: 1091722240
11/12/2026 22:16:05 - INFO - Using AlternateVLDiT for diffusion model
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/model/modules/dit.py:309: FutureWarning: Accessing config attribute `output_dim` directly via 'AlternateVLDiT' object attribute is deprecated. Please access 'output_dim' over 'AlternateVLDiT's config object instead, e.g. 'unet.config.output_dim'.
self.proj_out_2 = nn.Linear(self.inner_dim, self.output_dim)
Total number of DiT parameters: 1091722240
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/model/modules/dit.py:278: FutureWarning: Accessing config attribute `compute_dtype` directly via 'AlternateVLDiT' object attribute is deprecated. Please access 'compute_dtype' over 'AlternateVLDiT's config object instead, e.g. 'unet.config.compute_dtype'.
embedding_dim=self.inner_dim, compute_dtype=self.compute_dtype
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/model/modules/dit.py:278: FutureWarning: Accessing config attribute `compute_dtype` directly via 'AlternateVLDiT' object attribute is deprecated. Please access 'compute_dtype' over 'AlternateVLDiT's config object instead, e.g. 'unet.config.compute_dtype'.
embedding_dim=self.inner_dim, compute_dtype=self.compute_dtype
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/model/modules/dit.py:309: FutureWarning: Accessing config attribute `output_dim` directly via 'AlternateVLDiT' object attribute is deprecated. Please access 'output_dim' over 'AlternateVLDiT's config object instead, e.g. 'unet.config.output_dim'.
self.proj_out_2 = nn.Linear(self.inner_dim, self.output_dim)
Total number of DiT parameters: 1091722240
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/model/modules/dit.py:278: FutureWarning: Accessing config attribute `compute_dtype` directly via 'AlternateVLDiT' object attribute is deprecated. Please access 'compute_dtype' over 'AlternateVLDiT's config object instead, e.g. 'unet.config.compute_dtype'.
embedding_dim=self.inner_dim, compute_dtype=self.compute_dtype
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/model/modules/dit.py:309: FutureWarning: Accessing config attribute `output_dim` directly via 'AlternateVLDiT' object attribute is deprecated. Please access 'output_dim' over 'AlternateVLDiT's config object instead, e.g. 'unet.config.output_dim'.
self.proj_out_2 = nn.Linear(self.inner_dim, self.output_dim)
Total number of DiT parameters: 1091722240
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/model/modules/dit.py:278: FutureWarning: Accessing config attribute `compute_dtype` directly via 'AlternateVLDiT' object attribute is deprecated. Please access 'compute_dtype' over 'AlternateVLDiT's config object instead, e.g. 'unet.config.compute_dtype'.
embedding_dim=self.inner_dim, compute_dtype=self.compute_dtype
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/model/modules/dit.py:309: FutureWarning: Accessing config attribute `output_dim` directly via 'AlternateVLDiT' object attribute is deprecated. Please access 'output_dim' over 'AlternateVLDiT's config object instead, e.g. 'unet.config.output_dim'.
self.proj_out_2 = nn.Linear(self.inner_dim, self.output_dim)
Total number of DiT parameters: 1091722240
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/model/modules/dit.py:309: FutureWarning: Accessing config attribute `output_dim` directly via 'AlternateVLDiT' object attribute is deprecated. Please access 'output_dim' over 'AlternateVLDiT's config object instead, e.g. 'unet.config.output_dim'.
self.proj_out_2 = nn.Linear(self.inner_dim, self.output_dim)
Total number of DiT parameters: 1091722240
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/model/modules/dit.py:278: FutureWarning: Accessing config attribute `compute_dtype` directly via 'AlternateVLDiT' object attribute is deprecated. Please access 'compute_dtype' over 'AlternateVLDiT's config object instead, e.g. 'unet.config.compute_dtype'.
embedding_dim=self.inner_dim, compute_dtype=self.compute_dtype
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/model/modules/dit.py:278: FutureWarning: Accessing config attribute `compute_dtype` directly via 'AlternateVLDiT' object attribute is deprecated. Please access 'compute_dtype' over 'AlternateVLDiT's config object instead, e.g. 'unet.config.compute_dtype'.
embedding_dim=self.inner_dim, compute_dtype=self.compute_dtype
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/model/modules/dit.py:309: FutureWarning: Accessing config attribute `output_dim` directly via 'AlternateVLDiT' object attribute is deprecated. Please access 'output_dim' over 'AlternateVLDiT's config object instead, e.g. 'unet.config.output_dim'.
self.proj_out_2 = nn.Linear(self.inner_dim, self.output_dim)
Total number of DiT parameters: 1091722240
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/HumanWAM/third_party/Isaac-GR00T/gr00t/model/modules/dit.py:309: FutureWarning: Accessing config attribute `output_dim` directly via 'AlternateVLDiT' object attribute is deprecated. Please access 'output_dim' over 'AlternateVLDiT's config object instead, e.g. 'unet.config.output_dim'.
self.proj_out_2 = nn.Linear(self.inner_dim, self.output_dim)
Total number of DiT parameters: 1091722240
Total number of SelfAttentionTransformer parameters: 201433088
Total number of SelfAttentionTransformer parameters: 201433088
Total number of SelfAttentionTransformer parameters: 201433088
Total number of SelfAttentionTransformer parameters: 201433088
Total number of SelfAttentionTransformer parameters: 201433088
Total number of SelfAttentionTransformer parameters: 201433088
Total number of SelfAttentionTransformer parameters: 201433088
Total number of SelfAttentionTransformer parameters: 201433088
Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 1/2 [00:01<00:01, 1.21s/it] Loading checkpoint shards: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 1/2 [00:01<00:01, 1.27s/it] Loading checkpoint shards: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 1/2 [00:01<00:01, 1.40s/it] Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 2/2 [00:01<00:00, 1.28it/s] Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 2/2 [00:01<00:00, 1.18it/s]
Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 2/2 [00:01<00:00, 1.24it/s] Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 2/2 [00:01<00:00, 1.14it/s]
Loading checkpoint shards: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 1/2 [00:01<00:01, 1.43s/it] Loading checkpoint shards: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 1/2 [00:01<00:01, 1.38s/it] Loading checkpoint shards: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 1/2 [00:01<00:01, 1.52s/it] Loading checkpoint shards: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 1/2 [00:01<00:01, 1.39s/it] Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 2/2 [00:01<00:00, 1.15it/s] Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 2/2 [00:01<00:00, 1.05it/s]
Loading checkpoint shards: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 1/2 [00:01<00:01, 1.54s/it] Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 2/2 [00:01<00:00, 1.21it/s] Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 2/2 [00:01<00:00, 1.10it/s]
Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 2/2 [00:01<00:00, 1.15it/s] Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 2/2 [00:01<00:00, 1.05it/s]
Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 2/2 [00:01<00:00, 1.13it/s] Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 2/2 [00:01<00:00, 1.02it/s]
Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 2/2 [00:01<00:00, 1.20it/s] Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 2/2 [00:01<00:00, 1.09it/s]
Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 2/2 [00:01<00:00, 1.12it/s] Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 2/2 [00:01<00:00, 1.01it/s]
11/12/2026 22:16:10 - INFO - Total parameters: 3,144,016,000
11/12/2026 22:16:10 - INFO - Trainable parameters: 3,144,016,000 (100.00%)
11/12/2026 22:16:10 - INFO - N1.7 letter_box_transform=False
Initializing datasets: 0%| | 0/1 [00:00<?, ?it/s] Initializing datasets: 0%| | 0/1 [00:00<?, ?it/s] Initializing datasets: 0%| | 0/1 [00:00<?, ?it/s] Initializing datasets: 0%| | 0/1 [00:00<?, ?it/s] Initializing datasets: 0%| | 0/1 [00:00<?, ?it/s] Initializing datasets: 0%| | 0/1 [00:00<?, ?it/s] Initializing datasets: 0%| | 0/1 [00:00<?, ?it/s] Initializing datasets: 0%| | 0/1 [00:00<?, ?it/s]Generating stats for /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-data/a6
Generated 71 shards for dataset /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-data/a6Generated 71 shards for dataset /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-data/a6Generated 71 shards for dataset /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-data/a6Generated 71 shards for dataset /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-data/a6
Generated 71 shards for dataset /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-data/a6
Generated 71 shards for dataset /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-data/a6Generated 71 shards for dataset /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-data/a6
Total steps: 71743, average shard length: 1010.4647887323944, shard length std: 25.11429141755885Total steps: 71743, average shard length: 1010.4647887323944, shard length std: 25.11429141755885Total steps: 71743, average shard length: 1010.4647887323944, shard length std: 25.11429141755885Total steps: 71743, average shard length: 1010.4647887323944, shard length std: 25.11429141755885
Total steps: 71743, average shard length: 1010.4647887323944, shard length std: 25.11429141755885Total steps: 71743, average shard length: 1010.4647887323944, shard length std: 25.11429141755885
Total steps: 71743, average shard length: 1010.4647887323944, shard length std: 25.11429141755885
Initializing datasets: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1/1 [00:00<00:00, 18.36it/s] Initializing datasets: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1/1 [00:00<00:00, 18.36it/s] Initializing datasets: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1/1 [00:00<00:00, 18.36it/s]
Initializing datasets: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1/1 [00:00<00:00, 18.36it/s]
Generated 71 shards for dataset /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-data/a6
Initializing datasets: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1/1 [00:00<00:00, 18.34it/s]
Initializing datasets: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1/1 [00:00<00:00, 18.33it/s]
Initializing datasets: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1/1 [00:00<00:00, 18.32it/s]
Total steps: 71743, average shard length: 1010.4647887323944, shard length std: 25.11429141755885
Initializing datasets: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1/1 [00:00<00:00, 18.23it/s]
11/12/2026 22:16:13 - INFO - Overriding statistics for embodiment 'new_embodiment'
11/12/2026 22:16:13 - INFO - Saved dataset statistics for inference
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/envs/groot-py312/lib/python3.12/site-packages/torch/backends/__init__.py:46: UserWarning: Please use the new API settings to control TF32 behavior, such as torch.backends.cudnn.conv.fp32_precision = 'tf32' or torch.backends.cuda.matmul.fp32_precision = 'ieee'. Old settings, e.g, torch.backends.cuda.matmul.allow_tf32 = True, torch.backends.cudnn.allow_tf32 = True, allowTF32CuDNN() and allowTF32CuBLAS() will be deprecated after Pytorch 2.9. Please see https://pytorch.org/docs/main/notes/cuda.html#tensorfloat-32-tf32-on-ampere-and-later-devices (Triggered internally at /pytorch/aten/src/ATen/Context.cpp:80.)
self.setter(val)
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/envs/groot-py312/lib/python3.12/site-packages/torch/backends/__init__.py:46: UserWarning: Please use the new API settings to control TF32 behavior, such as torch.backends.cudnn.conv.fp32_precision = 'tf32' or torch.backends.cuda.matmul.fp32_precision = 'ieee'. Old settings, e.g, torch.backends.cuda.matmul.allow_tf32 = True, torch.backends.cudnn.allow_tf32 = True, allowTF32CuDNN() and allowTF32CuBLAS() will be deprecated after Pytorch 2.9. Please see https://pytorch.org/docs/main/notes/cuda.html#tensorfloat-32-tf32-on-ampere-and-later-devices (Triggered internally at /pytorch/aten/src/ATen/Context.cpp:80.)
self.setter(val)
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/envs/groot-py312/lib/python3.12/site-packages/torch/backends/__init__.py:46: UserWarning: Please use the new API settings to control TF32 behavior, such as torch.backends.cudnn.conv.fp32_precision = 'tf32' or torch.backends.cuda.matmul.fp32_precision = 'ieee'. Old settings, e.g, torch.backends.cuda.matmul.allow_tf32 = True, torch.backends.cudnn.allow_tf32 = True, allowTF32CuDNN() and allowTF32CuBLAS() will be deprecated after Pytorch 2.9. Please see https://pytorch.org/docs/main/notes/cuda.html#tensorfloat-32-tf32-on-ampere-and-later-devices (Triggered internally at /pytorch/aten/src/ATen/Context.cpp:80.)
self.setter(val)
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/envs/groot-py312/lib/python3.12/site-packages/torch/backends/__init__.py:46: UserWarning: Please use the new API settings to control TF32 behavior, such as torch.backends.cudnn.conv.fp32_precision = 'tf32' or torch.backends.cuda.matmul.fp32_precision = 'ieee'. Old settings, e.g, torch.backends.cuda.matmul.allow_tf32 = True, torch.backends.cudnn.allow_tf32 = True, allowTF32CuDNN() and allowTF32CuBLAS() will be deprecated after Pytorch 2.9. Please see https://pytorch.org/docs/main/notes/cuda.html#tensorfloat-32-tf32-on-ampere-and-later-devices (Triggered internally at /pytorch/aten/src/ATen/Context.cpp:80.)
self.setter(val)
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/envs/groot-py312/lib/python3.12/site-packages/torch/backends/__init__.py:46: UserWarning: Please use the new API settings to control TF32 behavior, such as torch.backends.cudnn.conv.fp32_precision = 'tf32' or torch.backends.cuda.matmul.fp32_precision = 'ieee'. Old settings, e.g, torch.backends.cuda.matmul.allow_tf32 = True, torch.backends.cudnn.allow_tf32 = True, allowTF32CuDNN() and allowTF32CuBLAS() will be deprecated after Pytorch 2.9. Please see https://pytorch.org/docs/main/notes/cuda.html#tensorfloat-32-tf32-on-ampere-and-later-devices (Triggered internally at /pytorch/aten/src/ATen/Context.cpp:80.)
self.setter(val)
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/envs/groot-py312/lib/python3.12/site-packages/torch/backends/__init__.py:46: UserWarning: Please use the new API settings to control TF32 behavior, such as torch.backends.cudnn.conv.fp32_precision = 'tf32' or torch.backends.cuda.matmul.fp32_precision = 'ieee'. Old settings, e.g, torch.backends.cuda.matmul.allow_tf32 = True, torch.backends.cudnn.allow_tf32 = True, allowTF32CuDNN() and allowTF32CuBLAS() will be deprecated after Pytorch 2.9. Please see https://pytorch.org/docs/main/notes/cuda.html#tensorfloat-32-tf32-on-ampere-and-later-devices (Triggered internally at /pytorch/aten/src/ATen/Context.cpp:80.)
self.setter(val)
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/envs/groot-py312/lib/python3.12/site-packages/torch/backends/__init__.py:46: UserWarning: Please use the new API settings to control TF32 behavior, such as torch.backends.cudnn.conv.fp32_precision = 'tf32' or torch.backends.cuda.matmul.fp32_precision = 'ieee'. Old settings, e.g, torch.backends.cuda.matmul.allow_tf32 = True, torch.backends.cudnn.allow_tf32 = True, allowTF32CuDNN() and allowTF32CuBLAS() will be deprecated after Pytorch 2.9. Please see https://pytorch.org/docs/main/notes/cuda.html#tensorfloat-32-tf32-on-ampere-and-later-devices (Triggered internally at /pytorch/aten/src/ATen/Context.cpp:80.)
self.setter(val)
/mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/envs/groot-py312/lib/python3.12/site-packages/torch/backends/__init__.py:46: UserWarning: Please use the new API settings to control TF32 behavior, such as torch.backends.cudnn.conv.fp32_precision = 'tf32' or torch.backends.cuda.matmul.fp32_precision = 'ieee'. Old settings, e.g, torch.backends.cuda.matmul.allow_tf32 = True, torch.backends.cudnn.allow_tf32 = True, allowTF32CuDNN() and allowTF32CuBLAS() will be deprecated after Pytorch 2.9. Please see https://pytorch.org/docs/main/notes/cuda.html#tensorfloat-32-tf32-on-ampere-and-later-devices (Triggered internally at /pytorch/aten/src/ATen/Context.cpp:80.)
self.setter(val)
11/12/2026 22:16:16 - INFO - πŸš€ Starting training...
Current global step: 0
Creating custom train dataloader
Current global step: 0
Creating custom train dataloader
Current global step: 0
Creating custom train dataloader
Current global step: 0
Creating custom train dataloader
Current global step: 0
Creating custom train dataloader
Current global step: 0
Creating custom train dataloader
Current global step: 0
Creating custom train dataloader
Current global step: 0
Creating custom train dataloader
0%| | 0/4000 [00:00<?, ?it/s]Could not estimate the number of tokens of the input, floating-point operations will not be computed
Could not estimate the number of tokens of the input, floating-point operations will not be computed
Could not estimate the number of tokens of the input, floating-point operations will not be computed
Could not estimate the number of tokens of the input, floating-point operations will not be computed
Could not estimate the number of tokens of the input, floating-point operations will not be computed
Could not estimate the number of tokens of the input, floating-point operations will not be computed
Could not estimate the number of tokens of the input, floating-point operations will not be computed
Could not estimate the number of tokens of the input, floating-point operations will not be computed
0%| | 1/4000 [00:45<50:39:22, 45.60s/it] 0%| | 2/4000 [00:48<22:28:01, 20.23s/it] 0%| | 3/4000 [00:50<13:18:17, 11.98s/it] 0%| | 4/4000 [00:51<8:48:27, 7.93s/it] 0%| | 5/4000 [00:53<6:14:57, 5.63s/it] 0%| | 6/4000 [00:55<4:42:39, 4.25s/it] 0%| | 7/4000 [00:56<3:40:29, 3.31s/it] 0%| | 8/4000 [00:57<2:59:04, 2.69s/it] 0%| | 9/4000 [00:59<2:32:06, 2.29s/it] 0%| | 10/4000 [01:00<2:12:21, 1.99s/it] {'loss': 1.3067, 'grad_norm': 0.2332051545381546, 'learning_rate': 4.5e-06}
0%| | 10/4000 [01:00<2:12:21, 1.99s/it] 0%| | 11/4000 [01:01<1:59:26, 1.80s/it] 0%| | 12/4000 [01:03<1:49:57, 1.65s/it] 0%| | 13/4000 [01:04<1:42:46, 1.55s/it] 0%| | 14/4000 [01:05<1:37:20, 1.47s/it] 0%| | 15/4000 [01:07<1:33:37, 1.41s/it] 0%| | 16/4000 [01:08<1:30:57, 1.37s/it] 0%| | 17/4000 [01:09<1:30:16, 1.36s/it] 0%| | 18/4000 [01:11<1:29:55, 1.35s/it] 0%| | 19/4000 [01:12<1:28:29, 1.33s/it] 0%| | 20/4000 [01:13<1:28:48, 1.34s/it] {'loss': 1.2826, 'grad_norm': 0.644719123840332, 'learning_rate': 9.5e-06}
0%| | 20/4000 [01:13<1:28:48, 1.34s/it] 1%| | 21/4000 [01:15<1:28:57, 1.34s/it] 1%| | 22/4000 [01:16<1:29:28, 1.35s/it] 1%| | 23/4000 [01:17<1:28:29, 1.34s/it] 1%| | 24/4000 [01:19<1:28:04, 1.33s/it] 1%| | 25/4000 [01:20<1:26:04, 1.30s/it] 1%| | 26/4000 [01:21<1:25:37, 1.29s/it] 1%| | 27/4000 [01:22<1:26:33, 1.31s/it] 1%| | 28/4000 [01:24<1:26:29, 1.31s/it] 1%| | 29/4000 [01:25<1:26:36, 1.31s/it] 1%| | 30/4000 [01:26<1:24:57, 1.28s/it] {'loss': 1.2088, 'grad_norm': 0.3895781934261322, 'learning_rate': 1.45e-05}
1%| | 30/4000 [01:26<1:24:57, 1.28s/it] 1%| | 31/4000 [01:28<1:26:15, 1.30s/it] 1%| | 32/4000 [01:29<1:26:38, 1.31s/it] 1%| | 33/4000 [01:30<1:25:52, 1.30s/it] 1%| | 34/4000 [01:31<1:26:25, 1.31s/it] 1%| | 35/4000 [01:33<1:26:09, 1.30s/it] 1%| | 36/4000 [01:34<1:26:13, 1.31s/it] 1%| | 37/4000 [01:35<1:26:18, 1.31s/it] 1%| | 38/4000 [01:37<1:25:32, 1.30s/it] 1%| | 39/4000 [01:38<1:24:53, 1.29s/it] 1%| | 40/4000 [01:39<1:25:35, 1.30s/it] {'loss': 1.183, 'grad_norm': 0.28091537952423096, 'learning_rate': 1.9500000000000003e-05}
1%| | 40/4000 [01:39<1:25:35, 1.30s/it] 1%| | 41/4000 [01:41<1:26:10, 1.31s/it] 1%| | 42/4000 [01:42<1:27:08, 1.32s/it] 1%| | 43/4000 [01:43<1:25:51, 1.30s/it] 1%| | 44/4000 [01:45<1:26:13, 1.31s/it] 1%| | 45/4000 [01:46<1:27:22, 1.33s/it] 1%| | 46/4000 [01:47<1:25:54, 1.30s/it] 1%| | 47/4000 [01:48<1:25:13, 1.29s/it] 1%| | 48/4000 [01:50<1:24:38, 1.29s/it] 1%| | 49/4000 [01:51<1:24:35, 1.28s/it] 1%|▏ | 50/4000 [01:52<1:25:15, 1.30s/it] {'loss': 1.1426, 'grad_norm': 0.3269309997558594, 'learning_rate': 2.45e-05}
1%|▏ | 50/4000 [01:52<1:25:15, 1.30s/it] 1%|▏ | 51/4000 [01:54<1:25:24, 1.30s/it] 1%|▏ | 52/4000 [01:55<1:25:35, 1.30s/it] 1%|▏ | 53/4000 [01:56<1:25:13, 1.30s/it] 1%|▏ | 54/4000 [01:58<1:26:39, 1.32s/it] 1%|▏ | 55/4000 [01:59<1:26:59, 1.32s/it] 1%|▏ | 56/4000 [02:00<1:27:01, 1.32s/it] 1%|▏ | 57/4000 [02:02<1:27:15, 1.33s/it] 1%|▏ | 58/4000 [02:03<1:27:31, 1.33s/it] 1%|▏ | 59/4000 [02:04<1:27:30, 1.33s/it] 2%|▏ | 60/4000 [02:05<1:26:15, 1.31s/it] {'loss': 1.1041, 'grad_norm': 0.3638102114200592, 'learning_rate': 2.95e-05}
2%|▏ | 60/4000 [02:05<1:26:15, 1.31s/it] 2%|▏ | 61/4000 [02:07<1:25:35, 1.30s/it] 2%|▏ | 62/4000 [02:08<1:26:15, 1.31s/it] 2%|▏ | 63/4000 [02:10<1:30:43, 1.38s/it] 2%|▏ | 64/4000 [02:11<1:27:18, 1.33s/it] 2%|▏ | 65/4000 [02:12<1:26:28, 1.32s/it] 2%|▏ | 66/4000 [02:13<1:26:26, 1.32s/it] 2%|▏ | 67/4000 [02:15<1:26:59, 1.33s/it] 2%|▏ | 68/4000 [02:16<1:25:55, 1.31s/it] 2%|▏ | 69/4000 [02:17<1:24:57, 1.30s/it] 2%|▏ | 70/4000 [02:19<1:25:11, 1.30s/it] {'loss': 1.0913, 'grad_norm': 0.35429996252059937, 'learning_rate': 3.45e-05}
2%|▏ | 70/4000 [02:19<1:25:11, 1.30s/it] 2%|▏ | 71/4000 [02:20<1:24:19, 1.29s/it] 2%|▏ | 72/4000 [02:21<1:24:54, 1.30s/it] 2%|▏ | 73/4000 [02:23<1:24:57, 1.30s/it] 2%|▏ | 74/4000 [02:24<1:24:51, 1.30s/it] 2%|▏ | 75/4000 [02:25<1:25:38, 1.31s/it] 2%|▏ | 76/4000 [02:27<1:26:38, 1.32s/it] 2%|▏ | 77/4000 [02:28<1:25:04, 1.30s/it] 2%|▏ | 78/4000 [02:29<1:25:53, 1.31s/it] 2%|▏ | 79/4000 [02:30<1:24:10, 1.29s/it] 2%|▏ | 80/4000 [02:32<1:23:59, 1.29s/it] {'loss': 1.0879, 'grad_norm': 0.27210167050361633, 'learning_rate': 3.9500000000000005e-05}
2%|▏ | 80/4000 [02:32<1:23:59, 1.29s/it] 2%|▏ | 81/4000 [02:33<1:24:23, 1.29s/it] 2%|▏ | 82/4000 [02:34<1:25:29, 1.31s/it] 2%|▏ | 83/4000 [02:36<1:26:13, 1.32s/it] 2%|▏ | 84/4000 [02:37<1:26:17, 1.32s/it] 2%|▏ | 85/4000 [02:38<1:26:27, 1.32s/it] 2%|▏ | 86/4000 [02:40<1:25:26, 1.31s/it] 2%|▏ | 87/4000 [02:41<1:25:53, 1.32s/it] 2%|▏ | 88/4000 [02:42<1:26:08, 1.32s/it] 2%|▏ | 89/4000 [02:44<1:25:18, 1.31s/it] 2%|▏ | 90/4000 [02:45<1:24:54, 1.30s/it] {'loss': 1.0823, 'grad_norm': 0.3240252137184143, 'learning_rate': 4.4500000000000004e-05}
2%|▏ | 90/4000 [02:45<1:24:54, 1.30s/it] 2%|▏ | 91/4000 [02:46<1:23:57, 1.29s/it] 2%|▏ | 92/4000 [02:47<1:23:05, 1.28s/it] 2%|▏ | 93/4000 [02:49<1:23:45, 1.29s/it] 2%|▏ | 94/4000 [02:50<1:23:12, 1.28s/it] 2%|▏ | 95/4000 [02:51<1:24:32, 1.30s/it] 2%|▏ | 96/4000 [02:52<1:23:44, 1.29s/it] 2%|▏ | 97/4000 [02:54<1:23:23, 1.28s/it] 2%|▏ | 98/4000 [02:55<1:25:28, 1.31s/it] 2%|▏ | 99/4000 [02:56<1:24:56, 1.31s/it] 2%|β–Ž | 100/4000 [02:58<1:25:08, 1.31s/it] {'loss': 1.0642, 'grad_norm': 0.3995043635368347, 'learning_rate': 4.9500000000000004e-05}
2%|β–Ž | 100/4000 [02:58<1:25:08, 1.31s/it] 3%|β–Ž | 101/4000 [02:59<1:23:52, 1.29s/it] 3%|β–Ž | 102/4000 [03:00<1:24:23, 1.30s/it] 3%|β–Ž | 103/4000 [03:02<1:24:14, 1.30s/it] 3%|β–Ž | 104/4000 [03:03<1:25:13, 1.31s/it] 3%|β–Ž | 105/4000 [03:04<1:24:30, 1.30s/it] 3%|β–Ž | 106/4000 [03:05<1:23:39, 1.29s/it] 3%|β–Ž | 107/4000 [03:07<1:23:36, 1.29s/it] 3%|β–Ž | 108/4000 [03:08<1:24:49, 1.31s/it] 3%|β–Ž | 109/4000 [03:09<1:24:56, 1.31s/it] 3%|β–Ž | 110/4000 [03:11<1:24:26, 1.30s/it] {'loss': 1.0191, 'grad_norm': 0.5470584034919739, 'learning_rate': 5.45e-05}
3%|β–Ž | 110/4000 [03:11<1:24:26, 1.30s/it] 3%|β–Ž | 111/4000 [03:12<1:23:21, 1.29s/it] 3%|β–Ž | 112/4000 [03:13<1:22:41, 1.28s/it] 3%|β–Ž | 113/4000 [03:14<1:22:02, 1.27s/it] 3%|β–Ž | 114/4000 [03:16<1:21:07, 1.25s/it] 3%|β–Ž | 115/4000 [03:17<1:22:40, 1.28s/it] 3%|β–Ž | 116/4000 [03:18<1:22:55, 1.28s/it] 3%|β–Ž | 117/4000 [03:20<1:22:48, 1.28s/it] 3%|β–Ž | 118/4000 [03:21<1:23:27, 1.29s/it] 3%|β–Ž | 119/4000 [03:22<1:23:04, 1.28s/it] 3%|β–Ž | 120/4000 [03:23<1:23:17, 1.29s/it] {'loss': 0.9659, 'grad_norm': 0.7391875386238098, 'learning_rate': 5.95e-05}
3%|β–Ž | 120/4000 [03:23<1:23:17, 1.29s/it] 3%|β–Ž | 121/4000 [03:25<1:22:35, 1.28s/it] 3%|β–Ž | 122/4000 [03:26<1:23:21, 1.29s/it] 3%|β–Ž | 123/4000 [03:27<1:23:11, 1.29s/it] 3%|β–Ž | 124/4000 [03:29<1:24:47, 1.31s/it] 3%|β–Ž | 125/4000 [03:30<1:23:50, 1.30s/it] 3%|β–Ž | 126/4000 [03:31<1:23:29, 1.29s/it] 3%|β–Ž | 127/4000 [03:33<1:24:00, 1.30s/it] 3%|β–Ž | 128/4000 [03:34<1:24:30, 1.31s/it] 3%|β–Ž | 129/4000 [03:35<1:24:20, 1.31s/it] 3%|β–Ž | 130/4000 [03:37<1:24:38, 1.31s/it] {'loss': 0.914, 'grad_norm': 0.8040826320648193, 'learning_rate': 6.450000000000001e-05}
3%|β–Ž | 130/4000 [03:37<1:24:38, 1.31s/it] 3%|β–Ž | 131/4000 [03:38<1:25:27, 1.33s/it] 3%|β–Ž | 132/4000 [03:39<1:23:26, 1.29s/it] 3%|β–Ž | 133/4000 [03:40<1:22:56, 1.29s/it] 3%|β–Ž | 134/4000 [03:42<1:22:16, 1.28s/it] 3%|β–Ž | 135/4000 [03:43<1:22:27, 1.28s/it] 3%|β–Ž | 136/4000 [03:44<1:22:54, 1.29s/it] 3%|β–Ž | 137/4000 [03:45<1:22:28, 1.28s/it] 3%|β–Ž | 138/4000 [03:47<1:23:02, 1.29s/it] 3%|β–Ž | 139/4000 [03:48<1:23:29, 1.30s/it] 4%|β–Ž | 140/4000 [03:49<1:23:35, 1.30s/it] {'loss': 0.8675, 'grad_norm': 0.9264456033706665, 'learning_rate': 6.95e-05}
4%|β–Ž | 140/4000 [03:49<1:23:35, 1.30s/it] 4%|β–Ž | 141/4000 [03:51<1:24:37, 1.32s/it] 4%|β–Ž | 142/4000 [03:52<1:23:07, 1.29s/it] 4%|β–Ž | 143/4000 [03:53<1:23:51, 1.30s/it] 4%|β–Ž | 144/4000 [03:55<1:24:21, 1.31s/it] 4%|β–Ž | 145/4000 [03:56<1:25:31, 1.33s/it] 4%|β–Ž | 146/4000 [03:57<1:24:47, 1.32s/it] 4%|β–Ž | 147/4000 [03:59<1:24:04, 1.31s/it] 4%|β–Ž | 148/4000 [04:00<1:22:34, 1.29s/it] 4%|β–Ž | 149/4000 [04:01<1:23:39, 1.30s/it] 4%|▍ | 150/4000 [04:03<1:25:08, 1.33s/it] {'loss': 0.8252, 'grad_norm': 0.7797486782073975, 'learning_rate': 7.450000000000001e-05}
4%|▍ | 150/4000 [04:03<1:25:08, 1.33s/it] 4%|▍ | 151/4000 [04:04<1:26:10, 1.34s/it] 4%|▍ | 152/4000 [04:05<1:25:35, 1.33s/it] 4%|▍ | 153/4000 [04:07<1:24:51, 1.32s/it] 4%|▍ | 154/4000 [04:08<1:24:52, 1.32s/it] 4%|▍ | 155/4000 [04:09<1:24:06, 1.31s/it] 4%|▍ | 156/4000 [04:11<1:24:46, 1.32s/it] 4%|▍ | 157/4000 [04:12<1:23:03, 1.30s/it] 4%|▍ | 158/4000 [04:13<1:23:30, 1.30s/it] 4%|▍ | 159/4000 [04:14<1:22:54, 1.30s/it] 4%|▍ | 160/4000 [04:16<1:24:02, 1.31s/it] {'loss': 0.7986, 'grad_norm': 0.8358756303787231, 'learning_rate': 7.950000000000001e-05}
4%|▍ | 160/4000 [04:16<1:24:02, 1.31s/it] 4%|▍ | 161/4000 [04:17<1:22:30, 1.29s/it] 4%|▍ | 162/4000 [04:18<1:23:13, 1.30s/it] 4%|▍ | 163/4000 [04:20<1:26:16, 1.35s/it] 4%|▍ | 164/4000 [04:21<1:26:46, 1.36s/it] 4%|▍ | 165/4000 [04:22<1:25:12, 1.33s/it] 4%|▍ | 166/4000 [04:24<1:23:01, 1.30s/it] 4%|▍ | 167/4000 [04:25<1:23:29, 1.31s/it] 4%|▍ | 168/4000 [04:26<1:24:32, 1.32s/it] 4%|▍ | 169/4000 [04:28<1:24:45, 1.33s/it] 4%|▍ | 170/4000 [04:29<1:23:12, 1.30s/it] {'loss': 0.7717, 'grad_norm': 0.6743223667144775, 'learning_rate': 8.450000000000001e-05}
4%|▍ | 170/4000 [04:29<1:23:12, 1.30s/it] 4%|▍ | 171/4000 [04:30<1:23:06, 1.30s/it] 4%|▍ | 172/4000 [04:31<1:22:59, 1.30s/it] 4%|▍ | 173/4000 [04:33<1:24:15, 1.32s/it] 4%|▍ | 174/4000 [04:34<1:24:29, 1.33s/it] 4%|▍ | 175/4000 [04:35<1:23:51, 1.32s/it] 4%|▍ | 176/4000 [04:37<1:24:04, 1.32s/it] 4%|▍ | 177/4000 [04:38<1:23:50, 1.32s/it] 4%|▍ | 178/4000 [04:39<1:23:14, 1.31s/it] 4%|▍ | 179/4000 [04:41<1:23:12, 1.31s/it] 4%|▍ | 180/4000 [04:42<1:22:24, 1.29s/it] {'loss': 0.7551, 'grad_norm': 0.7916301488876343, 'learning_rate': 8.950000000000001e-05}
4%|▍ | 180/4000 [04:42<1:22:24, 1.29s/it] 5%|▍ | 181/4000 [04:43<1:22:38, 1.30s/it] 5%|▍ | 182/4000 [04:45<1:22:38, 1.30s/it] 5%|▍ | 183/4000 [04:46<1:22:43, 1.30s/it] 5%|▍ | 184/4000 [04:47<1:23:07, 1.31s/it] 5%|▍ | 185/4000 [04:48<1:22:58, 1.30s/it] 5%|▍ | 186/4000 [04:50<1:22:50, 1.30s/it] 5%|▍ | 187/4000 [04:51<1:22:42, 1.30s/it] 5%|▍ | 188/4000 [04:52<1:21:45, 1.29s/it] 5%|▍ | 189/4000 [04:54<1:21:23, 1.28s/it] 5%|▍ | 190/4000 [04:55<1:21:02, 1.28s/it] {'loss': 0.7326, 'grad_norm': 0.7884929180145264, 'learning_rate': 9.449999999999999e-05}
5%|▍ | 190/4000 [04:55<1:21:02, 1.28s/it] 5%|▍ | 191/4000 [04:56<1:20:58, 1.28s/it] 5%|▍ | 192/4000 [04:57<1:20:28, 1.27s/it] 5%|▍ | 193/4000 [04:59<1:20:35, 1.27s/it] 5%|▍ | 194/4000 [05:00<1:21:22, 1.28s/it] 5%|▍ | 195/4000 [05:01<1:22:05, 1.29s/it] 5%|▍ | 196/4000 [05:03<1:21:31, 1.29s/it] 5%|▍ | 197/4000 [05:04<1:22:51, 1.31s/it] 5%|▍ | 198/4000 [05:05<1:21:34, 1.29s/it] 5%|▍ | 199/4000 [05:06<1:20:50, 1.28s/it] 5%|β–Œ | 200/4000 [05:08<1:19:59, 1.26s/it] {'loss': 0.7295, 'grad_norm': 0.7792584896087646, 'learning_rate': 9.95e-05}
5%|β–Œ | 200/4000 [05:08<1:19:59, 1.26s/it] 5%|β–Œ | 201/4000 [05:09<1:20:55, 1.28s/it] 5%|β–Œ | 202/4000 [05:10<1:20:34, 1.27s/it] 5%|β–Œ | 203/4000 [05:11<1:19:44, 1.26s/it] 5%|β–Œ | 204/4000 [05:13<1:20:12, 1.27s/it] 5%|β–Œ | 205/4000 [05:14<1:20:37, 1.27s/it] 5%|β–Œ | 206/4000 [05:15<1:21:13, 1.28s/it] 5%|β–Œ | 207/4000 [05:17<1:21:27, 1.29s/it] 5%|β–Œ | 208/4000 [05:18<1:20:31, 1.27s/it] 5%|β–Œ | 209/4000 [05:19<1:20:03, 1.27s/it] 5%|β–Œ | 210/4000 [05:20<1:19:32, 1.26s/it] {'loss': 0.729, 'grad_norm': 0.6361876130104065, 'learning_rate': 9.999861593790126e-05}
5%|β–Œ | 210/4000 [05:20<1:19:32, 1.26s/it] 5%|β–Œ | 211/4000 [05:22<1:20:13, 1.27s/it] 5%|β–Œ | 212/4000 [05:23<1:21:02, 1.28s/it] 5%|β–Œ | 213/4000 [05:24<1:21:10, 1.29s/it] 5%|β–Œ | 214/4000 [05:26<1:20:12, 1.27s/it] 5%|β–Œ | 215/4000 [05:27<1:21:05, 1.29s/it] 5%|β–Œ | 216/4000 [05:28<1:21:38, 1.29s/it] 5%|β–Œ | 217/4000 [05:29<1:20:30, 1.28s/it] 5%|β–Œ | 218/4000 [05:31<1:21:08, 1.29s/it] 5%|β–Œ | 219/4000 [05:32<1:21:49, 1.30s/it] 6%|β–Œ | 220/4000 [05:33<1:21:34, 1.29s/it] {'loss': 0.7104, 'grad_norm': 0.8623482584953308, 'learning_rate': 9.999383162408304e-05}
6%|β–Œ | 220/4000 [05:33<1:21:34, 1.29s/it] 6%|β–Œ | 221/4000 [05:35<1:22:03, 1.30s/it] 6%|β–Œ | 222/4000 [05:36<1:20:50, 1.28s/it] 6%|β–Œ | 223/4000 [05:37<1:20:22, 1.28s/it] 6%|β–Œ | 224/4000 [05:38<1:19:18, 1.26s/it] 6%|β–Œ | 225/4000 [05:40<1:19:17, 1.26s/it] 6%|β–Œ | 226/4000 [05:41<1:18:32, 1.25s/it] 6%|β–Œ | 227/4000 [05:42<1:19:38, 1.27s/it] 6%|β–Œ | 228/4000 [05:43<1:19:06, 1.26s/it] 6%|β–Œ | 229/4000 [05:45<1:18:48, 1.25s/it] 6%|β–Œ | 230/4000 [05:46<1:19:36, 1.27s/it] {'loss': 0.6992, 'grad_norm': 0.8815596699714661, 'learning_rate': 9.998563029828259e-05}
6%|β–Œ | 230/4000 [05:46<1:19:36, 1.27s/it] 6%|β–Œ | 231/4000 [05:47<1:19:57, 1.27s/it] 6%|β–Œ | 232/4000 [05:48<1:19:01, 1.26s/it] 6%|β–Œ | 233/4000 [05:50<1:18:59, 1.26s/it] 6%|β–Œ | 234/4000 [05:51<1:19:03, 1.26s/it] 6%|β–Œ | 235/4000 [05:52<1:18:25, 1.25s/it] 6%|β–Œ | 236/4000 [05:53<1:17:41, 1.24s/it] 6%|β–Œ | 237/4000 [05:55<1:18:24, 1.25s/it] 6%|β–Œ | 238/4000 [05:56<1:18:03, 1.24s/it] 6%|β–Œ | 239/4000 [05:57<1:18:30, 1.25s/it] 6%|β–Œ | 240/4000 [05:58<1:19:39, 1.27s/it] {'loss': 0.6817, 'grad_norm': 0.7445842623710632, 'learning_rate': 9.997401252104962e-05}
6%|β–Œ | 240/4000 [05:58<1:19:39, 1.27s/it] 6%|β–Œ | 241/4000 [06:00<1:18:41, 1.26s/it] 6%|β–Œ | 242/4000 [06:01<1:19:30, 1.27s/it] 6%|β–Œ | 243/4000 [06:02<1:20:20, 1.28s/it] 6%|β–Œ | 244/4000 [06:04<1:19:36, 1.27s/it] 6%|β–Œ | 245/4000 [06:05<1:19:22, 1.27s/it] 6%|β–Œ | 246/4000 [06:06<1:18:39, 1.26s/it] 6%|β–Œ | 247/4000 [06:07<1:18:31, 1.26s/it] 6%|β–Œ | 248/4000 [06:09<1:18:17, 1.25s/it] 6%|β–Œ | 249/4000 [06:10<1:18:05, 1.25s/it] 6%|β–‹ | 250/4000 [06:11<1:18:23, 1.25s/it] {'loss': 0.6631, 'grad_norm': 0.8002066612243652, 'learning_rate': 9.995897908644378e-05}
6%|β–‹ | 250/4000 [06:11<1:18:23, 1.25s/it] 6%|β–‹ | 251/4000 [06:12<1:18:59, 1.26s/it] 6%|β–‹ | 252/4000 [06:14<1:18:04, 1.25s/it] 6%|β–‹ | 253/4000 [06:15<1:19:00, 1.27s/it] 6%|β–‹ | 254/4000 [06:16<1:19:29, 1.27s/it] 6%|β–‹ | 255/4000 [06:17<1:20:06, 1.28s/it] 6%|β–‹ | 256/4000 [06:19<1:18:35, 1.26s/it] 6%|β–‹ | 257/4000 [06:20<1:18:51, 1.26s/it] 6%|β–‹ | 258/4000 [06:21<1:18:31, 1.26s/it] 6%|β–‹ | 259/4000 [06:22<1:17:45, 1.25s/it] 6%|β–‹ | 260/4000 [06:24<1:17:26, 1.24s/it] {'loss': 0.6492, 'grad_norm': 0.8326018452644348, 'learning_rate': 9.994053102198034e-05}
6%|β–‹ | 260/4000 [06:24<1:17:26, 1.24s/it] 7%|β–‹ | 261/4000 [06:25<1:17:21, 1.24s/it] 7%|β–‹ | 262/4000 [06:26<1:17:21, 1.24s/it] 7%|β–‹ | 263/4000 [06:27<1:17:41, 1.25s/it] 7%|β–‹ | 264/4000 [06:29<1:19:24, 1.28s/it] 7%|β–‹ | 265/4000 [06:30<1:18:45, 1.27s/it] 7%|β–‹ | 266/4000 [06:31<1:21:00, 1.30s/it] 7%|β–‹ | 267/4000 [06:33<1:20:54, 1.30s/it] 7%|β–‹ | 268/4000 [06:34<1:20:14, 1.29s/it] 7%|β–‹ | 269/4000 [06:35<1:19:54, 1.29s/it] 7%|β–‹ | 270/4000 [06:36<1:20:08, 1.29s/it] {'loss': 0.6399, 'grad_norm': 0.8912252187728882, 'learning_rate': 9.991866958856003e-05}
7%|β–‹ | 270/4000 [06:36<1:20:08, 1.29s/it] 7%|β–‹ | 271/4000 [06:38<1:19:40, 1.28s/it] 7%|β–‹ | 272/4000 [06:39<1:19:53, 1.29s/it] 7%|β–‹ | 273/4000 [06:40<1:19:41, 1.28s/it] 7%|β–‹ | 274/4000 [06:42<1:19:50, 1.29s/it] 7%|β–‹ | 275/4000 [06:43<1:18:55, 1.27s/it] 7%|β–‹ | 276/4000 [06:44<1:18:50, 1.27s/it] 7%|β–‹ | 277/4000 [06:45<1:18:47, 1.27s/it] 7%|β–‹ | 278/4000 [06:47<1:18:29, 1.27s/it] 7%|β–‹ | 279/4000 [06:48<1:18:03, 1.26s/it] 7%|β–‹ | 280/4000 [06:49<1:17:44, 1.25s/it] {'loss': 0.6086, 'grad_norm': 0.7911362648010254, 'learning_rate': 9.989339628038276e-05}
7%|β–‹ | 280/4000 [06:49<1:17:44, 1.25s/it] 7%|β–‹ | 281/4000 [06:50<1:18:37, 1.27s/it] 7%|β–‹ | 282/4000 [06:52<1:18:37, 1.27s/it] 7%|β–‹ | 283/4000 [06:53<1:18:39, 1.27s/it] 7%|β–‹ | 284/4000 [06:54<1:17:47, 1.26s/it] 7%|β–‹ | 285/4000 [06:55<1:17:29, 1.25s/it] 7%|β–‹ | 286/4000 [06:57<1:17:51, 1.26s/it] 7%|β–‹ | 287/4000 [06:58<1:18:11, 1.26s/it] 7%|β–‹ | 288/4000 [06:59<1:17:32, 1.25s/it] 7%|β–‹ | 289/4000 [07:00<1:17:33, 1.25s/it] 7%|β–‹ | 290/4000 [07:02<1:18:07, 1.26s/it] {'loss': 0.6012, 'grad_norm': 0.8583201766014099, 'learning_rate': 9.98647128248456e-05}
7%|β–‹ | 290/4000 [07:02<1:18:07, 1.26s/it] 7%|β–‹ | 291/4000 [07:03<1:17:54, 1.26s/it] 7%|β–‹ | 292/4000 [07:04<1:18:03, 1.26s/it] 7%|β–‹ | 293/4000 [07:06<1:19:25, 1.29s/it] 7%|β–‹ | 294/4000 [07:07<1:19:07, 1.28s/it] 7%|β–‹ | 295/4000 [07:08<1:18:23, 1.27s/it] 7%|β–‹ | 296/4000 [07:09<1:19:18, 1.28s/it] 7%|β–‹ | 297/4000 [07:11<1:18:57, 1.28s/it] 7%|β–‹ | 298/4000 [07:12<1:17:38, 1.26s/it] 7%|β–‹ | 299/4000 [07:13<1:17:54, 1.26s/it] 8%|β–Š | 300/4000 [07:14<1:18:02, 1.27s/it] {'loss': 0.5731, 'grad_norm': 0.9482755064964294, 'learning_rate': 9.98326211824246e-05}
8%|β–Š | 300/4000 [07:14<1:18:02, 1.27s/it] 8%|β–Š | 301/4000 [07:16<1:18:04, 1.27s/it] 8%|β–Š | 302/4000 [07:17<1:18:49, 1.28s/it] 8%|β–Š | 303/4000 [07:18<1:18:04, 1.27s/it] 8%|β–Š | 304/4000 [07:20<1:17:04, 1.25s/it] 8%|β–Š | 305/4000 [07:21<1:18:05, 1.27s/it] 8%|β–Š | 306/4000 [07:22<1:19:06, 1.28s/it] 8%|β–Š | 307/4000 [07:23<1:17:45, 1.26s/it] 8%|β–Š | 308/4000 [07:25<1:17:49, 1.26s/it] 8%|β–Š | 309/4000 [07:26<1:17:11, 1.25s/it] 8%|β–Š | 310/4000 [07:27<1:17:14, 1.26s/it] {'loss': 0.5667, 'grad_norm': 0.826654851436615, 'learning_rate': 9.979712354654091e-05}
8%|β–Š | 310/4000 [07:27<1:17:14, 1.26s/it] 8%|β–Š | 311/4000 [07:28<1:17:05, 1.25s/it] 8%|β–Š | 312/4000 [07:30<1:18:01, 1.27s/it] 8%|β–Š | 313/4000 [07:31<1:16:54, 1.25s/it] 8%|β–Š | 314/4000 [07:32<1:17:23, 1.26s/it] 8%|β–Š | 315/4000 [07:33<1:17:08, 1.26s/it] 8%|β–Š | 316/4000 [07:35<1:18:00, 1.27s/it] 8%|β–Š | 317/4000 [07:36<1:17:30, 1.26s/it] 8%|β–Š | 318/4000 [07:37<1:16:57, 1.25s/it] 8%|β–Š | 319/4000 [07:38<1:17:25, 1.26s/it] 8%|β–Š | 320/4000 [07:40<1:16:30, 1.25s/it] {'loss': 0.5364, 'grad_norm': 0.968084454536438, 'learning_rate': 9.975822234341079e-05}
8%|β–Š | 320/4000 [07:40<1:16:30, 1.25s/it] 8%|β–Š | 321/4000 [07:41<1:16:02, 1.24s/it] 8%|β–Š | 322/4000 [07:42<1:16:02, 1.24s/it] 8%|β–Š | 323/4000 [07:43<1:16:19, 1.25s/it] 8%|β–Š | 324/4000 [07:45<1:16:08, 1.24s/it] 8%|β–Š | 325/4000 [07:46<1:15:53, 1.24s/it] 8%|β–Š | 326/4000 [07:47<1:16:02, 1.24s/it] 8%|β–Š | 327/4000 [07:48<1:16:37, 1.25s/it] 8%|β–Š | 328/4000 [07:50<1:16:04, 1.24s/it] 8%|β–Š | 329/4000 [07:51<1:15:32, 1.23s/it] 8%|β–Š | 330/4000 [07:52<1:14:56, 1.23s/it] {'loss': 0.527, 'grad_norm': 0.9376100897789001, 'learning_rate': 9.97159202318798e-05}
8%|β–Š | 330/4000 [07:52<1:14:56, 1.23s/it] 8%|β–Š | 331/4000 [07:53<1:14:50, 1.22s/it] 8%|β–Š | 332/4000 [07:55<1:15:19, 1.23s/it] 8%|β–Š | 333/4000 [07:56<1:15:13, 1.23s/it] 8%|β–Š | 334/4000 [07:57<1:15:02, 1.23s/it] 8%|β–Š | 335/4000 [07:58<1:15:03, 1.23s/it] 8%|β–Š | 336/4000 [07:59<1:14:44, 1.22s/it] 8%|β–Š | 337/4000 [08:01<1:16:08, 1.25s/it] 8%|β–Š | 338/4000 [08:02<1:16:54, 1.26s/it] 8%|β–Š | 339/4000 [08:03<1:18:27, 1.29s/it] 8%|β–Š | 340/4000 [08:05<1:19:13, 1.30s/it] {'loss': 0.5036, 'grad_norm': 0.9477218389511108, 'learning_rate': 9.967022010324105e-05}
8%|β–Š | 340/4000 [08:05<1:19:13, 1.30s/it] 9%|β–Š | 341/4000 [08:06<1:18:36, 1.29s/it] 9%|β–Š | 342/4000 [08:07<1:17:16, 1.27s/it] 9%|β–Š | 343/4000 [08:08<1:18:17, 1.28s/it] 9%|β–Š | 344/4000 [08:10<1:17:30, 1.27s/it] 9%|β–Š | 345/4000 [08:11<1:17:40, 1.28s/it] 9%|β–Š | 346/4000 [08:12<1:17:24, 1.27s/it] 9%|β–Š | 347/4000 [08:14<1:17:19, 1.27s/it] 9%|β–Š | 348/4000 [08:15<1:17:49, 1.28s/it] 9%|β–Š | 349/4000 [08:16<1:18:28, 1.29s/it] 9%|β–‰ | 350/4000 [08:17<1:17:25, 1.27s/it] {'loss': 0.4794, 'grad_norm': 0.8853602409362793, 'learning_rate': 9.962112508103765e-05}
9%|β–‰ | 350/4000 [08:17<1:17:25, 1.27s/it] 9%|β–‰ | 351/4000 [08:19<1:17:40, 1.28s/it] 9%|β–‰ | 352/4000 [08:20<1:17:05, 1.27s/it] 9%|β–‰ | 353/4000 [08:21<1:16:22, 1.26s/it] 9%|β–‰ | 354/4000 [08:22<1:15:28, 1.24s/it] 9%|β–‰ | 355/4000 [08:24<1:15:56, 1.25s/it] 9%|β–‰ | 356/4000 [08:25<1:15:53, 1.25s/it] 9%|β–‰ | 357/4000 [08:26<1:16:27, 1.26s/it] 9%|β–‰ | 358/4000 [08:27<1:16:01, 1.25s/it] 9%|β–‰ | 359/4000 [08:29<1:16:04, 1.25s/it] 9%|β–‰ | 360/4000 [08:30<1:16:10, 1.26s/it] {'loss': 0.4667, 'grad_norm': 0.914663553237915, 'learning_rate': 9.956863852084914e-05}
9%|β–‰ | 360/4000 [08:30<1:16:10, 1.26s/it] 9%|β–‰ | 361/4000 [08:31<1:16:29, 1.26s/it] 9%|β–‰ | 362/4000 [08:32<1:16:39, 1.26s/it] 9%|β–‰ | 363/4000 [08:34<1:15:36, 1.25s/it] 9%|β–‰ | 364/4000 [08:35<1:15:58, 1.25s/it] 9%|β–‰ | 365/4000 [08:36<1:17:16, 1.28s/it] 9%|β–‰ | 366/4000 [08:38<1:17:58, 1.29s/it] 9%|β–‰ | 367/4000 [08:39<1:18:19, 1.29s/it] 9%|β–‰ | 368/4000 [08:40<1:18:48, 1.30s/it] 9%|β–‰ | 369/4000 [08:42<1:19:00, 1.31s/it] 9%|β–‰ | 370/4000 [08:43<1:19:09, 1.31s/it] {'loss': 0.4549, 'grad_norm': 0.8685607314109802, 'learning_rate': 9.951276401006221e-05}
9%|β–‰ | 370/4000 [08:43<1:19:09, 1.31s/it] 9%|β–‰ | 371/4000 [08:44<1:17:19, 1.28s/it] 9%|β–‰ | 372/4000 [08:45<1:17:11, 1.28s/it] 9%|β–‰ | 373/4000 [08:47<1:16:32, 1.27s/it] 9%|β–‰ | 374/4000 [08:48<1:15:31, 1.25s/it] 9%|β–‰ | 375/4000 [08:49<1:17:10, 1.28s/it] 9%|β–‰ | 376/4000 [08:50<1:16:12, 1.26s/it] 9%|β–‰ | 377/4000 [08:52<1:16:18, 1.26s/it] 9%|β–‰ | 378/4000 [08:53<1:16:36, 1.27s/it] 9%|β–‰ | 379/4000 [08:54<1:15:50, 1.26s/it] 10%|β–‰ | 380/4000 [08:55<1:15:31, 1.25s/it] {'loss': 0.4303, 'grad_norm': 0.9175459742546082, 'learning_rate': 9.945350536762543e-05}
10%|β–‰ | 380/4000 [08:55<1:15:31, 1.25s/it] 10%|β–‰ | 381/4000 [08:57<1:16:38, 1.27s/it] 10%|β–‰ | 382/4000 [08:58<1:16:16, 1.27s/it] 10%|β–‰ | 383/4000 [08:59<1:15:18, 1.25s/it] 10%|β–‰ | 384/4000 [09:00<1:14:48, 1.24s/it] 10%|β–‰ | 385/4000 [09:02<1:14:08, 1.23s/it] 10%|β–‰ | 386/4000 [09:03<1:14:40, 1.24s/it] 10%|β–‰ | 387/4000 [09:04<1:22:05, 1.36s/it] 10%|β–‰ | 388/4000 [09:06<1:19:28, 1.32s/it] 10%|β–‰ | 389/4000 [09:07<1:17:13, 1.28s/it] 10%|β–‰ | 390/4000 [09:08<1:17:19, 1.29s/it] {'loss': 0.4194, 'grad_norm': 1.0305854082107544, 'learning_rate': 9.939086664378829e-05}
10%|β–‰ | 390/4000 [09:08<1:17:19, 1.29s/it] 10%|β–‰ | 391/4000 [09:09<1:16:17, 1.27s/it] 10%|β–‰ | 392/4000 [09:11<1:15:59, 1.26s/it] 10%|β–‰ | 393/4000 [09:12<1:16:58, 1.28s/it] 10%|β–‰ | 394/4000 [09:13<1:16:40, 1.28s/it] 10%|β–‰ | 395/4000 [09:15<1:17:22, 1.29s/it] 10%|β–‰ | 396/4000 [09:16<1:17:14, 1.29s/it] 10%|β–‰ | 397/4000 [09:17<1:15:53, 1.26s/it] 10%|β–‰ | 398/4000 [09:18<1:15:36, 1.26s/it] 10%|β–‰ | 399/4000 [09:20<1:15:33, 1.26s/it] 10%|β–ˆ | 400/4000 [09:21<1:14:23, 1.24s/it] {'loss': 0.4016, 'grad_norm': 0.9399427771568298, 'learning_rate': 9.932485211982437e-05}
10%|β–ˆ | 400/4000 [09:21<1:14:23, 1.24s/it] 10%|β–ˆ | 401/4000 [09:22<1:14:29, 1.24s/it] 10%|β–ˆ | 402/4000 [09:23<1:15:59, 1.27s/it] 10%|β–ˆ | 403/4000 [09:25<1:14:46, 1.25s/it] 10%|β–ˆ | 404/4000 [09:26<1:14:57, 1.25s/it] 10%|β–ˆ | 405/4000 [09:27<1:15:41, 1.26s/it] 10%|β–ˆ | 406/4000 [09:28<1:15:03, 1.25s/it] 10%|β–ˆ | 407/4000 [09:30<1:14:56, 1.25s/it] 10%|β–ˆ | 408/4000 [09:31<1:14:21, 1.24s/it] 10%|β–ˆ | 409/4000 [09:32<1:14:36, 1.25s/it] 10%|β–ˆ | 410/4000 [09:33<1:15:20, 1.26s/it] {'loss': 0.3909, 'grad_norm': 1.0776801109313965, 'learning_rate': 9.92554663077387e-05}
10%|β–ˆ | 410/4000 [09:33<1:15:20, 1.26s/it] 10%|β–ˆ | 411/4000 [09:35<1:16:04, 1.27s/it] 10%|β–ˆ | 412/4000 [09:36<1:15:37, 1.26s/it] 10%|β–ˆ | 413/4000 [09:37<1:15:30, 1.26s/it] 10%|β–ˆ | 414/4000 [09:38<1:16:17, 1.28s/it] 10%|β–ˆ | 415/4000 [09:40<1:15:03, 1.26s/it] 10%|β–ˆ | 416/4000 [09:41<1:15:04, 1.26s/it] 10%|β–ˆ | 417/4000 [09:42<1:14:39, 1.25s/it] 10%|β–ˆ | 418/4000 [09:43<1:14:43, 1.25s/it] 10%|β–ˆ | 419/4000 [09:45<1:14:36, 1.25s/it] 10%|β–ˆ | 420/4000 [09:46<1:14:53, 1.26s/it] {'loss': 0.3783, 'grad_norm': 1.1907553672790527, 'learning_rate': 9.918271394995935e-05}
10%|β–ˆ | 420/4000 [09:46<1:14:53, 1.26s/it] 11%|β–ˆ | 421/4000 [09:47<1:16:43, 1.29s/it] 11%|β–ˆ | 422/4000 [09:49<1:16:11, 1.28s/it] 11%|β–ˆ | 423/4000 [09:50<1:15:37, 1.27s/it] 11%|β–ˆ | 424/4000 [09:51<1:15:31, 1.27s/it] 11%|β–ˆ | 425/4000 [09:52<1:14:50, 1.26s/it] 11%|β–ˆ | 426/4000 [09:54<1:15:16, 1.26s/it] 11%|β–ˆ | 427/4000 [09:55<1:16:04, 1.28s/it] 11%|β–ˆ | 428/4000 [09:56<1:15:24, 1.27s/it] 11%|β–ˆ | 429/4000 [09:57<1:15:19, 1.27s/it] 11%|β–ˆ | 430/4000 [09:59<1:14:14, 1.25s/it] {'loss': 0.3699, 'grad_norm': 1.4140596389770508, 'learning_rate': 9.910660001901335e-05}
11%|β–ˆ | 430/4000 [09:59<1:14:14, 1.25s/it] 11%|β–ˆ | 431/4000 [10:00<1:13:42, 1.24s/it] 11%|β–ˆ | 432/4000 [10:01<1:14:18, 1.25s/it] 11%|β–ˆ | 433/4000 [10:02<1:15:36, 1.27s/it] 11%|β–ˆ | 434/4000 [10:04<1:15:58, 1.28s/it] 11%|β–ˆ | 435/4000 [10:05<1:15:42, 1.27s/it] 11%|β–ˆ | 436/4000 [10:06<1:14:20, 1.25s/it] 11%|β–ˆ | 437/4000 [10:07<1:14:11, 1.25s/it] 11%|β–ˆ | 438/4000 [10:09<1:14:17, 1.25s/it] 11%|β–ˆ | 439/4000 [10:10<1:13:38, 1.24s/it] 11%|β–ˆ | 440/4000 [10:11<1:13:25, 1.24s/it] {'loss': 0.3443, 'grad_norm': 0.9959967732429504, 'learning_rate': 9.902712971718675e-05}
11%|β–ˆ | 440/4000 [10:11<1:13:25, 1.24s/it] 11%|β–ˆ | 441/4000 [10:12<1:13:04, 1.23s/it] 11%|β–ˆ | 442/4000 [10:14<1:13:14, 1.24s/it] 11%|β–ˆ | 443/4000 [10:15<1:14:01, 1.25s/it] 11%|β–ˆ | 444/4000 [10:16<1:14:08, 1.25s/it] 11%|β–ˆ | 445/4000 [10:17<1:13:32, 1.24s/it] 11%|β–ˆ | 446/4000 [10:19<1:13:00, 1.23s/it] 11%|β–ˆ | 447/4000 [10:20<1:12:55, 1.23s/it] 11%|β–ˆ | 448/4000 [10:21<1:13:50, 1.25s/it] 11%|β–ˆ | 449/4000 [10:22<1:14:16, 1.25s/it] 11%|β–ˆβ– | 450/4000 [10:24<1:14:20, 1.26s/it] {'loss': 0.333, 'grad_norm': 1.013885498046875, 'learning_rate': 9.894430847616915e-05}
11%|β–ˆβ– | 450/4000 [10:24<1:14:20, 1.26s/it] 11%|β–ˆβ– | 451/4000 [10:25<1:14:40, 1.26s/it] 11%|β–ˆβ– | 452/4000 [10:26<1:14:40, 1.26s/it] 11%|β–ˆβ– | 453/4000 [10:27<1:14:59, 1.27s/it] 11%|β–ˆβ– | 454/4000 [10:29<1:15:41, 1.28s/it] 11%|β–ˆβ– | 455/4000 [10:30<1:15:04, 1.27s/it] 11%|β–ˆβ– | 456/4000 [10:31<1:13:53, 1.25s/it] 11%|β–ˆβ– | 457/4000 [10:32<1:15:32, 1.28s/it] 11%|β–ˆβ– | 458/4000 [10:34<1:16:18, 1.29s/it] 11%|β–ˆβ– | 459/4000 [10:35<1:16:38, 1.30s/it] 12%|β–ˆβ– | 460/4000 [10:36<1:15:41, 1.28s/it] {'loss': 0.3258, 'grad_norm': 1.034084439277649, 'learning_rate': 9.885814195668232e-05}
12%|β–ˆβ– | 460/4000 [10:36<1:15:41, 1.28s/it] 12%|β–ˆβ– | 461/4000 [10:38<1:15:22, 1.28s/it] 12%|β–ˆβ– | 462/4000 [10:39<1:15:23, 1.28s/it] 12%|β–ˆβ– | 463/4000 [10:40<1:14:39, 1.27s/it] 12%|β–ˆβ– | 464/4000 [10:41<1:14:03, 1.26s/it] 12%|β–ˆβ– | 465/4000 [10:43<1:13:11, 1.24s/it] 12%|β–ˆβ– | 466/4000 [10:44<1:13:00, 1.24s/it] 12%|β–ˆβ– | 467/4000 [10:45<1:12:25, 1.23s/it] 12%|β–ˆβ– | 468/4000 [10:46<1:13:18, 1.25s/it] 12%|β–ˆβ– | 469/4000 [10:48<1:12:48, 1.24s/it] 12%|β–ˆβ– | 470/4000 [10:49<1:12:54, 1.24s/it] {'loss': 0.3211, 'grad_norm': 1.0718014240264893, 'learning_rate': 9.876863604809344e-05}
12%|β–ˆβ– | 470/4000 [10:49<1:12:54, 1.24s/it] 12%|β–ˆβ– | 471/4000 [10:50<1:13:01, 1.24s/it] 12%|β–ˆβ– | 472/4000 [10:51<1:16:18, 1.30s/it] 12%|β–ˆβ– | 473/4000 [10:53<1:15:44, 1.29s/it] 12%|β–ˆβ– | 474/4000 [10:54<1:14:22, 1.27s/it] 12%|β–ˆβ– | 475/4000 [10:55<1:13:16, 1.25s/it] 12%|β–ˆβ– | 476/4000 [10:56<1:12:25, 1.23s/it] 12%|β–ˆβ– | 477/4000 [10:58<1:12:42, 1.24s/it] 12%|β–ˆβ– | 478/4000 [10:59<1:13:59, 1.26s/it] 12%|β–ˆβ– | 479/4000 [11:00<1:14:29, 1.27s/it] 12%|β–ˆβ– | 480/4000 [11:01<1:13:50, 1.26s/it] {'loss': 0.2998, 'grad_norm': 1.1648253202438354, 'learning_rate': 9.867579686801245e-05}
12%|β–ˆβ– | 480/4000 [11:01<1:13:50, 1.26s/it] 12%|β–ˆβ– | 481/4000 [11:03<1:13:42, 1.26s/it] 12%|β–ˆβ– | 482/4000 [11:04<1:13:37, 1.26s/it] 12%|β–ˆβ– | 483/4000 [11:05<1:14:18, 1.27s/it] 12%|β–ˆβ– | 484/4000 [11:06<1:12:56, 1.24s/it] 12%|β–ˆβ– | 485/4000 [11:08<1:12:16, 1.23s/it] 12%|β–ˆβ– | 486/4000 [11:09<1:12:27, 1.24s/it] 12%|β–ˆβ– | 487/4000 [11:10<1:13:04, 1.25s/it] 12%|β–ˆβ– | 488/4000 [11:11<1:13:15, 1.25s/it] 12%|β–ˆβ– | 489/4000 [11:13<1:12:37, 1.24s/it] 12%|β–ˆβ– | 490/4000 [11:14<1:13:06, 1.25s/it] {'loss': 0.2881, 'grad_norm': 1.0875707864761353, 'learning_rate': 9.8579630761874e-05}
12%|β–ˆβ– | 490/4000 [11:14<1:13:06, 1.25s/it] 12%|β–ˆβ– | 491/4000 [11:15<1:13:25, 1.26s/it] 12%|β–ˆβ– | 492/4000 [11:16<1:13:37, 1.26s/it] 12%|β–ˆβ– | 493/4000 [11:18<1:12:56, 1.25s/it] 12%|β–ˆβ– | 494/4000 [11:19<1:13:00, 1.25s/it] 12%|β–ˆβ– | 495/4000 [11:20<1:12:26, 1.24s/it] 12%|β–ˆβ– | 496/4000 [11:21<1:12:40, 1.24s/it] 12%|β–ˆβ– | 497/4000 [11:23<1:12:44, 1.25s/it] 12%|β–ˆβ– | 498/4000 [11:24<1:12:16, 1.24s/it] 12%|β–ˆβ– | 499/4000 [11:25<1:13:32, 1.26s/it] 12%|β–ˆβ–Ž | 500/4000 [11:26<1:12:46, 1.25s/it] {'loss': 0.2697, 'grad_norm': 1.3648531436920166, 'learning_rate': 9.848014430250367e-05}
12%|β–ˆβ–Ž | 500/4000 [11:26<1:12:46, 1.25s/it] 13%|β–ˆβ–Ž | 501/4000 [11:28<1:13:33, 1.26s/it] 13%|β–ˆβ–Ž | 502/4000 [11:29<1:12:30, 1.24s/it] 13%|β–ˆβ–Ž | 503/4000 [11:30<1:12:35, 1.25s/it] 13%|β–ˆβ–Ž | 504/4000 [11:31<1:13:39, 1.26s/it] 13%|β–ˆβ–Ž | 505/4000 [11:33<1:13:17, 1.26s/it] 13%|β–ˆβ–Ž | 506/4000 [11:34<1:12:24, 1.24s/it] 13%|β–ˆβ–Ž | 507/4000 [11:35<1:11:44, 1.23s/it] 13%|β–ˆβ–Ž | 508/4000 [11:36<1:12:03, 1.24s/it] 13%|β–ˆβ–Ž | 509/4000 [11:38<1:12:05, 1.24s/it] 13%|β–ˆβ–Ž | 510/4000 [11:39<1:12:43, 1.25s/it] {'loss': 0.266, 'grad_norm': 1.1572197675704956, 'learning_rate': 9.837734428966885e-05}
13%|β–ˆβ–Ž | 510/4000 [11:39<1:12:43, 1.25s/it] 13%|β–ˆβ–Ž | 511/4000 [11:40<1:13:12, 1.26s/it] 13%|β–ˆβ–Ž | 512/4000 [11:41<1:12:53, 1.25s/it] 13%|β–ˆβ–Ž | 513/4000 [11:43<1:13:21, 1.26s/it] 13%|β–ˆβ–Ž | 514/4000 [11:44<1:13:14, 1.26s/it] 13%|β–ˆβ–Ž | 515/4000 [11:45<1:12:04, 1.24s/it] 13%|β–ˆβ–Ž | 516/4000 [11:46<1:11:24, 1.23s/it] 13%|β–ˆβ–Ž | 517/4000 [11:48<1:11:11, 1.23s/it] 13%|β–ˆβ–Ž | 518/4000 [11:49<1:11:11, 1.23s/it] 13%|β–ˆβ–Ž | 519/4000 [11:50<1:11:22, 1.23s/it] 13%|β–ˆβ–Ž | 520/4000 [11:51<1:11:00, 1.22s/it] {'loss': 0.2504, 'grad_norm': 1.192556619644165, 'learning_rate': 9.827123774961383e-05}
13%|β–ˆβ–Ž | 520/4000 [11:51<1:11:00, 1.22s/it] 13%|β–ˆβ–Ž | 521/4000 [11:53<1:12:17, 1.25s/it] 13%|β–ˆβ–Ž | 522/4000 [11:54<1:12:26, 1.25s/it] 13%|β–ˆβ–Ž | 523/4000 [11:55<1:12:21, 1.25s/it] 13%|β–ˆβ–Ž | 524/4000 [11:56<1:12:06, 1.24s/it] 13%|β–ˆβ–Ž | 525/4000 [11:57<1:11:27, 1.23s/it] 13%|β–ˆβ–Ž | 526/4000 [11:59<1:11:34, 1.24s/it] 13%|β–ˆβ–Ž | 527/4000 [12:00<1:11:21, 1.23s/it] 13%|β–ˆβ–Ž | 528/4000 [12:01<1:10:59, 1.23s/it] 13%|β–ˆβ–Ž | 529/4000 [12:02<1:12:28, 1.25s/it] 13%|β–ˆβ–Ž | 530/4000 [12:04<1:12:29, 1.25s/it] {'loss': 0.2507, 'grad_norm': 1.1278660297393799, 'learning_rate': 9.816183193457968e-05}
13%|β–ˆβ–Ž | 530/4000 [12:04<1:12:29, 1.25s/it] 13%|β–ˆβ–Ž | 531/4000 [12:05<1:12:34, 1.26s/it] 13%|β–ˆβ–Ž | 532/4000 [12:06<1:12:36, 1.26s/it] 13%|β–ˆβ–Ž | 533/4000 [12:07<1:12:21, 1.25s/it] 13%|β–ˆβ–Ž | 534/4000 [12:09<1:11:36, 1.24s/it] 13%|β–ˆβ–Ž | 535/4000 [12:10<1:10:54, 1.23s/it] 13%|β–ˆβ–Ž | 536/4000 [12:11<1:11:40, 1.24s/it] 13%|β–ˆβ–Ž | 537/4000 [12:12<1:11:50, 1.24s/it] 13%|β–ˆβ–Ž | 538/4000 [12:14<1:12:11, 1.25s/it] 13%|β–ˆβ–Ž | 539/4000 [12:15<1:12:51, 1.26s/it] 14%|β–ˆβ–Ž | 540/4000 [12:16<1:12:53, 1.26s/it] {'loss': 0.233, 'grad_norm': 1.112349271774292, 'learning_rate': 9.804913432230856e-05}
14%|β–ˆβ–Ž | 540/4000 [12:16<1:12:53, 1.26s/it] 14%|β–ˆβ–Ž | 541/4000 [12:18<1:13:41, 1.28s/it] 14%|β–ˆβ–Ž | 542/4000 [12:19<1:13:16, 1.27s/it] 14%|β–ˆβ–Ž | 543/4000 [12:20<1:13:08, 1.27s/it] 14%|β–ˆβ–Ž | 544/4000 [12:21<1:12:41, 1.26s/it] 14%|β–ˆβ–Ž | 545/4000 [12:23<1:12:27, 1.26s/it] 14%|β–ˆβ–Ž | 546/4000 [12:24<1:11:31, 1.24s/it] 14%|β–ˆβ–Ž | 547/4000 [12:25<1:10:44, 1.23s/it] 14%|β–ˆβ–Ž | 548/4000 [12:26<1:11:08, 1.24s/it] 14%|β–ˆβ–Ž | 549/4000 [12:27<1:11:38, 1.25s/it] 14%|β–ˆβ– | 550/4000 [12:29<1:11:09, 1.24s/it] {'loss': 0.2245, 'grad_norm': 1.170906901359558, 'learning_rate': 9.793315261553252e-05}
14%|β–ˆβ– | 550/4000 [12:29<1:11:09, 1.24s/it] 14%|β–ˆβ– | 551/4000 [12:30<1:11:32, 1.24s/it] 14%|β–ˆβ– | 552/4000 [12:31<1:10:50, 1.23s/it] 14%|β–ˆβ– | 553/4000 [12:32<1:12:00, 1.25s/it] 14%|β–ˆβ– | 554/4000 [12:34<1:12:07, 1.26s/it] 14%|β–ˆβ– | 555/4000 [12:35<1:12:09, 1.26s/it] 14%|β–ˆβ– | 556/4000 [12:36<1:11:27, 1.24s/it] 14%|β–ˆβ– | 557/4000 [12:37<1:11:50, 1.25s/it] 14%|β–ˆβ– | 558/4000 [12:39<1:11:12, 1.24s/it] 14%|β–ˆβ– | 559/4000 [12:40<1:12:05, 1.26s/it] 14%|β–ˆβ– | 560/4000 [12:41<1:11:45, 1.25s/it] {'loss': 0.2123, 'grad_norm': 1.1776010990142822, 'learning_rate': 9.781389474144717e-05}
14%|β–ˆβ– | 560/4000 [12:41<1:11:45, 1.25s/it] 14%|β–ˆβ– | 561/4000 [12:43<1:12:23, 1.26s/it] 14%|β–ˆβ– | 562/4000 [12:44<1:12:14, 1.26s/it] 14%|β–ˆβ– | 563/4000 [12:45<1:11:39, 1.25s/it] 14%|β–ˆβ– | 564/4000 [12:46<1:10:51, 1.24s/it] 14%|β–ˆβ– | 565/4000 [12:47<1:10:53, 1.24s/it] 14%|β–ˆβ– | 566/4000 [12:49<1:11:21, 1.25s/it] 14%|β–ˆβ– | 567/4000 [12:50<1:10:56, 1.24s/it] 14%|β–ˆβ– | 568/4000 [12:51<1:11:12, 1.24s/it] 14%|β–ˆβ– | 569/4000 [12:52<1:12:03, 1.26s/it] 14%|β–ˆβ– | 570/4000 [12:54<1:11:38, 1.25s/it] {'loss': 0.2005, 'grad_norm': 1.142622470855713, 'learning_rate': 9.76913688511698e-05}
14%|β–ˆβ– | 570/4000 [12:54<1:11:38, 1.25s/it] 14%|β–ˆβ– | 571/4000 [12:55<1:12:34, 1.27s/it] 14%|β–ˆβ– | 572/4000 [12:56<1:12:34, 1.27s/it] 14%|β–ˆβ– | 573/4000 [12:58<1:12:47, 1.27s/it] 14%|β–ˆβ– | 574/4000 [12:59<1:12:28, 1.27s/it] 14%|β–ˆβ– | 575/4000 [13:00<1:11:39, 1.26s/it] 14%|β–ˆβ– | 576/4000 [13:01<1:12:52, 1.28s/it] 14%|β–ˆβ– | 577/4000 [13:03<1:13:34, 1.29s/it] 14%|β–ˆβ– | 578/4000 [13:04<1:13:24, 1.29s/it] 14%|β–ˆβ– | 579/4000 [13:05<1:12:00, 1.26s/it] 14%|β–ˆβ– | 580/4000 [13:06<1:10:56, 1.24s/it] {'loss': 0.1964, 'grad_norm': 1.0554208755493164, 'learning_rate': 9.756558331918227e-05}
14%|β–ˆβ– | 580/4000 [13:06<1:10:56, 1.24s/it] 15%|β–ˆβ– | 581/4000 [13:08<1:11:04, 1.25s/it] 15%|β–ˆβ– | 582/4000 [13:09<1:11:14, 1.25s/it] 15%|β–ˆβ– | 583/4000 [13:10<1:10:36, 1.24s/it] 15%|β–ˆβ– | 584/4000 [13:11<1:11:33, 1.26s/it] 15%|β–ˆβ– | 585/4000 [13:13<1:10:36, 1.24s/it] 15%|β–ˆβ– | 586/4000 [13:14<1:10:05, 1.23s/it] 15%|β–ˆβ– | 587/4000 [13:15<1:10:25, 1.24s/it] 15%|β–ˆβ– | 588/4000 [13:16<1:10:28, 1.24s/it] 15%|β–ˆβ– | 589/4000 [13:18<1:10:29, 1.24s/it] 15%|β–ˆβ– | 590/4000 [13:19<1:10:23, 1.24s/it] {'loss': 0.1986, 'grad_norm': 1.1919890642166138, 'learning_rate': 9.743654674275855e-05}
15%|β–ˆβ– | 590/4000 [13:19<1:10:23, 1.24s/it] 15%|β–ˆβ– | 591/4000 [13:20<1:10:07, 1.23s/it] 15%|β–ˆβ– | 592/4000 [13:21<1:09:53, 1.23s/it] 15%|β–ˆβ– | 593/4000 [13:23<1:10:22, 1.24s/it] 15%|β–ˆβ– | 594/4000 [13:24<1:09:52, 1.23s/it] 15%|β–ˆβ– | 595/4000 [13:25<1:09:56, 1.23s/it] 15%|β–ˆβ– | 596/4000 [13:26<1:09:35, 1.23s/it] 15%|β–ˆβ– | 597/4000 [13:27<1:09:15, 1.22s/it] 15%|β–ˆβ– | 598/4000 [13:29<1:09:53, 1.23s/it] 15%|β–ˆβ– | 599/4000 [13:30<1:09:42, 1.23s/it] 15%|β–ˆβ–Œ | 600/4000 [13:31<1:11:23, 1.26s/it] {'loss': 0.1889, 'grad_norm': 1.1431834697723389, 'learning_rate': 9.730426794137727e-05}
15%|β–ˆβ–Œ | 600/4000 [13:31<1:11:23, 1.26s/it] 15%|β–ˆβ–Œ | 601/4000 [13:32<1:10:24, 1.24s/it] 15%|β–ˆβ–Œ | 602/4000 [13:34<1:10:33, 1.25s/it] 15%|β–ˆβ–Œ | 603/4000 [13:35<1:10:56, 1.25s/it] 15%|β–ˆβ–Œ | 604/4000 [13:36<1:12:02, 1.27s/it] 15%|β–ˆβ–Œ | 605/4000 [13:38<1:12:55, 1.29s/it] 15%|β–ˆβ–Œ | 606/4000 [13:39<1:13:23, 1.30s/it] 15%|β–ˆβ–Œ | 607/4000 [13:40<1:13:07, 1.29s/it] 15%|β–ˆβ–Œ | 608/4000 [13:41<1:13:37, 1.30s/it] 15%|β–ˆβ–Œ | 609/4000 [13:43<1:12:27, 1.28s/it] 15%|β–ˆβ–Œ | 610/4000 [13:44<1:13:17, 1.30s/it] {'loss': 0.1991, 'grad_norm': 1.198391318321228, 'learning_rate': 9.716875595611879e-05}
15%|β–ˆβ–Œ | 610/4000 [13:44<1:13:17, 1.30s/it] 15%|β–ˆβ–Œ | 611/4000 [13:45<1:11:59, 1.27s/it] 15%|β–ˆβ–Œ | 612/4000 [13:47<1:11:40, 1.27s/it] 15%|β–ˆβ–Œ | 613/4000 [13:48<1:10:48, 1.25s/it] 15%|β–ˆβ–Œ | 614/4000 [13:49<1:11:06, 1.26s/it] 15%|β–ˆβ–Œ | 615/4000 [13:50<1:11:13, 1.26s/it] 15%|β–ˆβ–Œ | 616/4000 [13:52<1:11:01, 1.26s/it] 15%|β–ˆβ–Œ | 617/4000 [13:53<1:11:51, 1.27s/it] 15%|β–ˆβ–Œ | 618/4000 [13:54<1:10:41, 1.25s/it] 15%|β–ˆβ–Œ | 619/4000 [13:55<1:11:05, 1.26s/it] 16%|β–ˆβ–Œ | 620/4000 [13:57<1:10:19, 1.25s/it] {'loss': 0.1693, 'grad_norm': 1.087514042854309, 'learning_rate': 9.703002004904729e-05}
16%|β–ˆβ–Œ | 620/4000 [13:57<1:10:19, 1.25s/it] 16%|β–ˆβ–Œ | 621/4000 [13:58<1:10:25, 1.25s/it] 16%|β–ˆβ–Œ | 622/4000 [13:59<1:10:27, 1.25s/it] 16%|β–ˆβ–Œ | 623/4000 [14:00<1:09:56, 1.24s/it] 16%|β–ˆβ–Œ | 624/4000 [14:02<1:10:17, 1.25s/it] 16%|β–ˆβ–Œ | 625/4000 [14:03<1:10:57, 1.26s/it] 16%|β–ˆβ–Œ | 626/4000 [14:04<1:16:37, 1.36s/it] 16%|β–ˆβ–Œ | 627/4000 [14:06<1:14:13, 1.32s/it] 16%|β–ˆβ–Œ | 628/4000 [14:07<1:12:35, 1.29s/it] 16%|β–ˆβ–Œ | 629/4000 [14:08<1:11:05, 1.27s/it] 16%|β–ˆβ–Œ | 630/4000 [14:09<1:10:18, 1.25s/it] {'loss': 0.1515, 'grad_norm': 1.2125685214996338, 'learning_rate': 9.688806970257773e-05}
16%|β–ˆβ–Œ | 630/4000 [14:09<1:10:18, 1.25s/it] 16%|β–ˆβ–Œ | 631/4000 [14:11<1:09:42, 1.24s/it] 16%|β–ˆβ–Œ | 632/4000 [14:12<1:09:21, 1.24s/it] 16%|β–ˆβ–Œ | 633/4000 [14:13<1:15:15, 1.34s/it] 16%|β–ˆβ–Œ | 634/4000 [14:15<1:13:43, 1.31s/it] 16%|β–ˆβ–Œ | 635/4000 [14:16<1:12:48, 1.30s/it] 16%|β–ˆβ–Œ | 636/4000 [14:17<1:12:22, 1.29s/it] 16%|β–ˆβ–Œ | 637/4000 [14:18<1:11:25, 1.27s/it] 16%|β–ˆβ–Œ | 638/4000 [14:20<1:10:21, 1.26s/it] 16%|β–ˆβ–Œ | 639/4000 [14:21<1:09:41, 1.24s/it] 16%|β–ˆβ–Œ | 640/4000 [14:22<1:08:59, 1.23s/it] {'loss': 0.1556, 'grad_norm': 1.2041836977005005, 'learning_rate': 9.674291461882774e-05}
16%|β–ˆβ–Œ | 640/4000 [14:22<1:08:59, 1.23s/it] 16%|β–ˆβ–Œ | 641/4000 [14:23<1:08:48, 1.23s/it] 16%|β–ˆβ–Œ | 642/4000 [14:25<1:10:02, 1.25s/it] 16%|β–ˆβ–Œ | 643/4000 [14:26<1:09:51, 1.25s/it] 16%|β–ˆβ–Œ | 644/4000 [14:27<1:09:59, 1.25s/it] 16%|β–ˆβ–Œ | 645/4000 [14:28<1:10:27, 1.26s/it] 16%|β–ˆβ–Œ | 646/4000 [14:30<1:11:11, 1.27s/it] 16%|β–ˆβ–Œ | 647/4000 [14:31<1:10:37, 1.26s/it] 16%|β–ˆβ–Œ | 648/4000 [14:32<1:10:46, 1.27s/it] 16%|β–ˆβ–Œ | 649/4000 [14:33<1:10:24, 1.26s/it] 16%|β–ˆβ–‹ | 650/4000 [14:35<1:11:43, 1.28s/it] {'loss': 0.1623, 'grad_norm': 1.2465994358062744, 'learning_rate': 9.659456471895445e-05}
16%|β–ˆβ–‹ | 650/4000 [14:35<1:11:43, 1.28s/it] 16%|β–ˆβ–‹ | 651/4000 [14:36<1:11:10, 1.28s/it] 16%|β–ˆβ–‹ | 652/4000 [14:37<1:10:18, 1.26s/it] 16%|β–ˆβ–‹ | 653/4000 [14:38<1:10:26, 1.26s/it] 16%|β–ˆβ–‹ | 654/4000 [14:40<1:09:37, 1.25s/it] 16%|β–ˆβ–‹ | 655/4000 [14:41<1:09:29, 1.25s/it] 16%|β–ˆβ–‹ | 656/4000 [14:42<1:09:36, 1.25s/it] 16%|β–ˆβ–‹ | 657/4000 [14:43<1:09:22, 1.25s/it] 16%|β–ˆβ–‹ | 658/4000 [14:45<1:08:39, 1.23s/it] 16%|β–ˆβ–‹ | 659/4000 [14:46<1:08:31, 1.23s/it] 16%|β–ˆβ–‹ | 660/4000 [14:47<1:08:10, 1.22s/it] {'loss': 0.153, 'grad_norm': 1.1176671981811523, 'learning_rate': 9.644303014247648e-05}
16%|β–ˆβ–‹ | 660/4000 [14:47<1:08:10, 1.22s/it] 17%|β–ˆβ–‹ | 661/4000 [14:48<1:08:32, 1.23s/it] 17%|β–ˆβ–‹ | 662/4000 [14:50<1:08:53, 1.24s/it] 17%|β–ˆβ–‹ | 663/4000 [14:51<1:09:03, 1.24s/it] 17%|β–ˆβ–‹ | 664/4000 [14:52<1:09:00, 1.24s/it] 17%|β–ˆβ–‹ | 665/4000 [14:53<1:08:39, 1.24s/it] 17%|β–ˆβ–‹ | 666/4000 [14:55<1:09:16, 1.25s/it] 17%|β–ˆβ–‹ | 667/4000 [14:56<1:08:52, 1.24s/it] 17%|β–ˆβ–‹ | 668/4000 [14:57<1:08:20, 1.23s/it] 17%|β–ˆβ–‹ | 669/4000 [14:58<1:09:35, 1.25s/it] 17%|β–ˆβ–‹ | 670/4000 [15:00<1:09:17, 1.25s/it] {'loss': 0.1735, 'grad_norm': 0.9368076920509338, 'learning_rate': 9.628832124658085e-05}
17%|β–ˆβ–‹ | 670/4000 [15:00<1:09:17, 1.25s/it] 17%|β–ˆβ–‹ | 671/4000 [15:01<1:09:14, 1.25s/it] 17%|β–ˆβ–‹ | 672/4000 [15:02<1:09:03, 1.25s/it] 17%|β–ˆβ–‹ | 673/4000 [15:03<1:08:19, 1.23s/it] 17%|β–ˆβ–‹ | 674/4000 [15:04<1:07:43, 1.22s/it] 17%|β–ˆβ–‹ | 675/4000 [15:06<1:07:19, 1.21s/it] 17%|β–ˆβ–‹ | 676/4000 [15:07<1:07:04, 1.21s/it] 17%|β–ˆβ–‹ | 677/4000 [15:08<1:07:11, 1.21s/it] 17%|β–ˆβ–‹ | 678/4000 [15:09<1:07:46, 1.22s/it] 17%|β–ˆβ–‹ | 679/4000 [15:11<1:08:08, 1.23s/it] 17%|β–ˆβ–‹ | 680/4000 [15:12<1:09:21, 1.25s/it] {'loss': 0.1563, 'grad_norm': 1.1592144966125488, 'learning_rate': 9.613044860541507e-05}
17%|β–ˆβ–‹ | 680/4000 [15:12<1:09:21, 1.25s/it] 17%|β–ˆβ–‹ | 681/4000 [15:13<1:09:21, 1.25s/it] 17%|β–ˆβ–‹ | 682/4000 [15:14<1:09:39, 1.26s/it] 17%|β–ˆβ–‹ | 683/4000 [15:16<1:09:33, 1.26s/it] 17%|β–ˆβ–‹ | 684/4000 [15:17<1:09:21, 1.26s/it] 17%|β–ˆβ–‹ | 685/4000 [15:18<1:10:06, 1.27s/it] 17%|β–ˆβ–‹ | 686/4000 [15:19<1:10:07, 1.27s/it] 17%|β–ˆβ–‹ | 687/4000 [15:21<1:11:01, 1.29s/it] 17%|β–ˆβ–‹ | 688/4000 [15:22<1:09:37, 1.26s/it] 17%|β–ˆβ–‹ | 689/4000 [15:23<1:13:41, 1.34s/it] 17%|β–ˆβ–‹ | 690/4000 [15:25<1:11:32, 1.30s/it] {'loss': 0.148, 'grad_norm': 0.8826311826705933, 'learning_rate': 9.596942300936445e-05}
17%|β–ˆβ–‹ | 690/4000 [15:25<1:11:32, 1.30s/it] 17%|β–ˆβ–‹ | 691/4000 [15:26<1:10:48, 1.28s/it] 17%|β–ˆβ–‹ | 692/4000 [15:27<1:10:06, 1.27s/it] 17%|β–ˆβ–‹ | 693/4000 [15:28<1:08:59, 1.25s/it] 17%|β–ˆβ–‹ | 694/4000 [15:30<1:08:57, 1.25s/it] 17%|β–ˆβ–‹ | 695/4000 [15:31<1:08:16, 1.24s/it] 17%|β–ˆβ–‹ | 696/4000 [15:32<1:08:00, 1.23s/it] 17%|β–ˆβ–‹ | 697/4000 [15:33<1:08:25, 1.24s/it] 17%|β–ˆβ–‹ | 698/4000 [15:35<1:08:00, 1.24s/it] 17%|β–ˆβ–‹ | 699/4000 [15:36<1:08:22, 1.24s/it] 18%|β–ˆβ–Š | 700/4000 [15:37<1:07:49, 1.23s/it] {'loss': 0.1505, 'grad_norm': 0.9600540399551392, 'learning_rate': 9.580525546431459e-05}
18%|β–ˆβ–Š | 700/4000 [15:37<1:07:49, 1.23s/it] 18%|β–ˆβ–Š | 701/4000 [15:38<1:08:37, 1.25s/it] 18%|β–ˆβ–Š | 702/4000 [15:40<1:08:29, 1.25s/it] 18%|β–ˆβ–Š | 703/4000 [15:41<1:08:27, 1.25s/it] 18%|β–ˆβ–Š | 704/4000 [15:42<1:09:11, 1.26s/it] 18%|β–ˆβ–Š | 705/4000 [15:43<1:08:59, 1.26s/it] 18%|β–ˆβ–Š | 706/4000 [15:45<1:09:18, 1.26s/it] 18%|β–ˆβ–Š | 707/4000 [15:46<1:08:18, 1.24s/it] 18%|β–ˆβ–Š | 708/4000 [15:47<1:08:26, 1.25s/it] 18%|β–ˆβ–Š | 709/4000 [15:48<1:07:33, 1.23s/it] 18%|β–ˆβ–Š | 710/4000 [15:49<1:06:54, 1.22s/it] {'loss': 0.1627, 'grad_norm': 1.038267970085144, 'learning_rate': 9.563795719089911e-05}
18%|β–ˆβ–Š | 710/4000 [15:49<1:06:54, 1.22s/it] 18%|β–ˆβ–Š | 711/4000 [15:51<1:07:24, 1.23s/it] 18%|β–ˆβ–Š | 712/4000 [15:52<1:07:51, 1.24s/it] 18%|β–ˆβ–Š | 713/4000 [15:53<1:08:40, 1.25s/it] 18%|β–ˆβ–Š | 714/4000 [15:55<1:10:01, 1.28s/it] 18%|β–ˆβ–Š | 715/4000 [15:56<1:08:57, 1.26s/it] 18%|β–ˆβ–Š | 716/4000 [15:57<1:07:52, 1.24s/it] 18%|β–ˆβ–Š | 717/4000 [15:58<1:08:59, 1.26s/it] 18%|β–ˆβ–Š | 718/4000 [16:00<1:09:11, 1.26s/it] 18%|β–ˆβ–Š | 719/4000 [16:01<1:08:16, 1.25s/it] 18%|β–ˆβ–Š | 720/4000 [16:02<1:07:49, 1.24s/it] {'loss': 0.1449, 'grad_norm': 1.0938094854354858, 'learning_rate': 9.546753962373281e-05}
18%|β–ˆβ–Š | 720/4000 [16:02<1:07:49, 1.24s/it] 18%|β–ˆβ–Š | 721/4000 [16:03<1:08:02, 1.25s/it] 18%|β–ˆβ–Š | 722/4000 [16:04<1:07:26, 1.23s/it] 18%|β–ˆβ–Š | 723/4000 [16:06<1:08:43, 1.26s/it] 18%|β–ˆβ–Š | 724/4000 [16:07<1:08:30, 1.25s/it] 18%|β–ˆβ–Š | 725/4000 [16:08<1:08:42, 1.26s/it] 18%|β–ˆβ–Š | 726/4000 [16:09<1:07:44, 1.24s/it] 18%|β–ˆβ–Š | 727/4000 [16:11<1:07:58, 1.25s/it] 18%|β–ˆβ–Š | 728/4000 [16:12<1:07:17, 1.23s/it] 18%|β–ˆβ–Š | 729/4000 [16:13<1:08:06, 1.25s/it] 18%|β–ˆβ–Š | 730/4000 [16:15<1:08:34, 1.26s/it] {'loss': 0.1485, 'grad_norm': 0.9400181174278259, 'learning_rate': 9.529401441062997e-05}
18%|β–ˆβ–Š | 730/4000 [16:15<1:08:34, 1.26s/it] 18%|β–ˆβ–Š | 731/4000 [16:16<1:08:22, 1.25s/it] 18%|β–ˆβ–Š | 732/4000 [16:17<1:08:16, 1.25s/it] 18%|β–ˆβ–Š | 733/4000 [16:18<1:08:43, 1.26s/it] 18%|β–ˆβ–Š | 734/4000 [16:20<1:08:02, 1.25s/it] 18%|β–ˆβ–Š | 735/4000 [16:21<1:08:25, 1.26s/it] 18%|β–ˆβ–Š | 736/4000 [16:22<1:08:19, 1.26s/it] 18%|β–ˆβ–Š | 737/4000 [16:23<1:07:31, 1.24s/it] 18%|β–ˆβ–Š | 738/4000 [16:25<1:07:58, 1.25s/it] 18%|β–ˆβ–Š | 739/4000 [16:26<1:08:04, 1.25s/it] 18%|β–ˆβ–Š | 740/4000 [16:27<1:07:41, 1.25s/it] {'loss': 0.1252, 'grad_norm': 1.0983046293258667, 'learning_rate': 9.511739341180842e-05}
18%|β–ˆβ–Š | 740/4000 [16:27<1:07:41, 1.25s/it] 19%|β–ˆβ–Š | 741/4000 [16:28<1:07:40, 1.25s/it] 19%|β–ˆβ–Š | 742/4000 [16:29<1:06:58, 1.23s/it] 19%|β–ˆβ–Š | 743/4000 [16:31<1:06:49, 1.23s/it] 19%|β–ˆβ–Š | 744/4000 [16:32<1:08:12, 1.26s/it] 19%|β–ˆβ–Š | 745/4000 [16:33<1:08:27, 1.26s/it] 19%|β–ˆβ–Š | 746/4000 [16:35<1:08:46, 1.27s/it] 19%|β–ˆβ–Š | 747/4000 [16:36<1:07:51, 1.25s/it] 19%|β–ˆβ–Š | 748/4000 [16:37<1:06:54, 1.23s/it] 19%|β–ˆβ–Š | 749/4000 [16:38<1:07:44, 1.25s/it] 19%|β–ˆβ–‰ | 750/4000 [16:40<1:07:58, 1.25s/it] {'loss': 0.1463, 'grad_norm': 1.0311088562011719, 'learning_rate': 9.493768869907886e-05}
19%|β–ˆβ–‰ | 750/4000 [16:40<1:07:58, 1.25s/it] 19%|β–ˆβ–‰ | 751/4000 [16:41<1:07:53, 1.25s/it] 19%|β–ˆβ–‰ | 752/4000 [16:42<1:08:43, 1.27s/it] 19%|β–ˆβ–‰ | 753/4000 [16:43<1:08:39, 1.27s/it] 19%|β–ˆβ–‰ | 754/4000 [16:45<1:08:57, 1.27s/it] 19%|β–ˆβ–‰ | 755/4000 [16:46<1:07:39, 1.25s/it] 19%|β–ˆβ–‰ | 756/4000 [16:47<1:07:51, 1.26s/it] 19%|β–ˆβ–‰ | 757/4000 [16:48<1:07:50, 1.26s/it] 19%|β–ˆβ–‰ | 758/4000 [16:50<1:07:52, 1.26s/it] 19%|β–ˆβ–‰ | 759/4000 [16:51<1:07:22, 1.25s/it] 19%|β–ˆβ–‰ | 760/4000 [16:52<1:08:39, 1.27s/it] {'loss': 0.1289, 'grad_norm': 1.0369051694869995, 'learning_rate': 9.475491255501968e-05}
19%|β–ˆβ–‰ | 760/4000 [16:52<1:08:39, 1.27s/it] 19%|β–ˆβ–‰ | 761/4000 [16:53<1:09:09, 1.28s/it] 19%|β–ˆβ–‰ | 762/4000 [16:55<1:08:48, 1.28s/it] 19%|β–ˆβ–‰ | 763/4000 [16:56<1:07:55, 1.26s/it] 19%|β–ˆβ–‰ | 764/4000 [16:57<1:08:07, 1.26s/it] 19%|β–ˆβ–‰ | 765/4000 [16:58<1:07:17, 1.25s/it] 19%|β–ˆβ–‰ | 766/4000 [17:00<1:07:16, 1.25s/it] 19%|β–ˆβ–‰ | 767/4000 [17:01<1:08:16, 1.27s/it] 19%|β–ˆβ–‰ | 768/4000 [17:02<1:08:47, 1.28s/it] 19%|β–ˆβ–‰ | 769/4000 [17:04<1:08:26, 1.27s/it] 19%|β–ˆβ–‰ | 770/4000 [17:05<1:07:18, 1.25s/it] {'loss': 0.1362, 'grad_norm': 0.9471954703330994, 'learning_rate': 9.456907747213748e-05}
19%|β–ˆβ–‰ | 770/4000 [17:05<1:07:18, 1.25s/it] 19%|β–ˆβ–‰ | 771/4000 [17:06<1:07:21, 1.25s/it] 19%|β–ˆβ–‰ | 772/4000 [17:07<1:07:47, 1.26s/it] 19%|β–ˆβ–‰ | 773/4000 [17:09<1:07:58, 1.26s/it] 19%|β–ˆβ–‰ | 774/4000 [17:10<1:07:02, 1.25s/it] 19%|β–ˆβ–‰ | 775/4000 [17:11<1:06:46, 1.24s/it] 19%|β–ˆβ–‰ | 776/4000 [17:12<1:07:00, 1.25s/it] 19%|β–ˆβ–‰ | 777/4000 [17:14<1:07:46, 1.26s/it] 19%|β–ˆβ–‰ | 778/4000 [17:15<1:07:43, 1.26s/it] 19%|β–ˆβ–‰ | 779/4000 [17:16<1:07:09, 1.25s/it] 20%|β–ˆβ–‰ | 780/4000 [17:17<1:06:26, 1.24s/it] {'loss': 0.1378, 'grad_norm': 1.0875346660614014, 'learning_rate': 9.438019615201336e-05}
20%|β–ˆβ–‰ | 780/4000 [17:17<1:06:26, 1.24s/it] 20%|β–ˆβ–‰ | 781/4000 [17:19<1:06:49, 1.25s/it] 20%|β–ˆβ–‰ | 782/4000 [17:20<1:06:05, 1.23s/it] 20%|β–ˆβ–‰ | 783/4000 [17:21<1:09:45, 1.30s/it] 20%|β–ˆβ–‰ | 784/4000 [17:22<1:08:26, 1.28s/it] 20%|β–ˆβ–‰ | 785/4000 [17:24<1:08:02, 1.27s/it] 20%|β–ˆβ–‰ | 786/4000 [17:25<1:06:57, 1.25s/it] 20%|β–ˆβ–‰ | 787/4000 [17:26<1:06:04, 1.23s/it] 20%|β–ˆβ–‰ | 788/4000 [17:27<1:06:09, 1.24s/it] 20%|β–ˆβ–‰ | 789/4000 [17:29<1:07:12, 1.26s/it] 20%|β–ˆβ–‰ | 790/4000 [17:30<1:06:33, 1.24s/it] {'loss': 0.1304, 'grad_norm': 0.9970756769180298, 'learning_rate': 9.418828150443469e-05}
20%|β–ˆβ–‰ | 790/4000 [17:30<1:06:33, 1.24s/it] 20%|β–ˆβ–‰ | 791/4000 [17:31<1:06:38, 1.25s/it] 20%|β–ˆβ–‰ | 792/4000 [17:32<1:07:11, 1.26s/it] 20%|β–ˆβ–‰ | 793/4000 [17:34<1:07:15, 1.26s/it] 20%|β–ˆβ–‰ | 794/4000 [17:35<1:06:56, 1.25s/it] 20%|β–ˆβ–‰ | 795/4000 [17:36<1:06:00, 1.24s/it] 20%|β–ˆβ–‰ | 796/4000 [17:37<1:05:37, 1.23s/it] 20%|β–ˆβ–‰ | 797/4000 [17:38<1:05:36, 1.23s/it] 20%|β–ˆβ–‰ | 798/4000 [17:40<1:05:07, 1.22s/it] 20%|β–ˆβ–‰ | 799/4000 [17:41<1:04:46, 1.21s/it] 20%|β–ˆβ–ˆ | 800/4000 [17:42<1:05:27, 1.23s/it] {'loss': 0.1374, 'grad_norm': 1.0720736980438232, 'learning_rate': 9.399334664651262e-05}
20%|β–ˆβ–ˆ | 800/4000 [17:42<1:05:27, 1.23s/it] 20%|β–ˆβ–ˆ | 801/4000 [17:43<1:05:44, 1.23s/it] 20%|β–ˆβ–ˆ | 802/4000 [17:45<1:06:18, 1.24s/it] 20%|β–ˆβ–ˆ | 803/4000 [17:46<1:05:36, 1.23s/it] 20%|β–ˆβ–ˆ | 804/4000 [17:47<1:05:41, 1.23s/it] 20%|β–ˆβ–ˆ | 805/4000 [17:48<1:06:01, 1.24s/it] 20%|β–ˆβ–ˆ | 806/4000 [17:50<1:06:21, 1.25s/it] 20%|β–ˆβ–ˆ | 807/4000 [17:51<1:06:25, 1.25s/it] 20%|β–ˆβ–ˆ | 808/4000 [17:52<1:06:36, 1.25s/it] 20%|β–ˆβ–ˆ | 809/4000 [17:53<1:06:34, 1.25s/it] 20%|β–ˆβ–ˆ | 810/4000 [17:55<1:06:15, 1.25s/it] {'loss': 0.1441, 'grad_norm': 1.096125602722168, 'learning_rate': 9.379540490178581e-05}
20%|β–ˆβ–ˆ | 810/4000 [17:55<1:06:15, 1.25s/it] 20%|β–ˆβ–ˆ | 811/4000 [17:56<1:06:04, 1.24s/it] 20%|β–ˆβ–ˆ | 812/4000 [17:57<1:07:09, 1.26s/it] 20%|β–ˆβ–ˆ | 813/4000 [17:58<1:06:53, 1.26s/it] 20%|β–ˆβ–ˆ | 814/4000 [18:00<1:06:32, 1.25s/it] 20%|β–ˆβ–ˆ | 815/4000 [18:01<1:05:46, 1.24s/it] 20%|β–ˆβ–ˆ | 816/4000 [18:02<1:05:51, 1.24s/it] 20%|β–ˆβ–ˆ | 817/4000 [18:03<1:06:21, 1.25s/it] 20%|β–ˆβ–ˆ | 818/4000 [18:05<1:05:34, 1.24s/it] 20%|β–ˆβ–ˆ | 819/4000 [18:06<1:05:41, 1.24s/it] 20%|β–ˆβ–ˆ | 820/4000 [18:07<1:05:14, 1.23s/it] {'loss': 0.1368, 'grad_norm': 0.9433715343475342, 'learning_rate': 9.359446979930955e-05}
20%|β–ˆβ–ˆ | 820/4000 [18:07<1:05:14, 1.23s/it] 21%|β–ˆβ–ˆ | 821/4000 [18:08<1:06:46, 1.26s/it] 21%|β–ˆβ–ˆ | 822/4000 [18:10<1:06:01, 1.25s/it] 21%|β–ˆβ–ˆ | 823/4000 [18:11<1:06:02, 1.25s/it] 21%|β–ˆβ–ˆ | 824/4000 [18:12<1:05:45, 1.24s/it] 21%|β–ˆβ–ˆ | 825/4000 [18:13<1:05:45, 1.24s/it] 21%|β–ˆβ–ˆ | 826/4000 [18:15<1:06:19, 1.25s/it] 21%|β–ˆβ–ˆ | 827/4000 [18:16<1:05:35, 1.24s/it] 21%|β–ˆβ–ˆ | 828/4000 [18:17<1:06:01, 1.25s/it] 21%|β–ˆβ–ˆ | 829/4000 [18:18<1:06:09, 1.25s/it] 21%|β–ˆβ–ˆ | 830/4000 [18:20<1:05:41, 1.24s/it] {'loss': 0.1379, 'grad_norm': 0.9445521235466003, 'learning_rate': 9.33905550727312e-05}
21%|β–ˆβ–ˆ | 830/4000 [18:20<1:05:41, 1.24s/it] 21%|β–ˆβ–ˆ | 831/4000 [18:21<1:05:21, 1.24s/it] 21%|β–ˆβ–ˆ | 832/4000 [18:22<1:05:04, 1.23s/it] 21%|β–ˆβ–ˆ | 833/4000 [18:23<1:05:17, 1.24s/it] 21%|β–ˆβ–ˆ | 834/4000 [18:24<1:05:45, 1.25s/it] 21%|β–ˆβ–ˆ | 835/4000 [18:26<1:05:52, 1.25s/it] 21%|β–ˆβ–ˆ | 836/4000 [18:27<1:05:24, 1.24s/it] 21%|β–ˆβ–ˆ | 837/4000 [18:28<1:04:52, 1.23s/it] 21%|β–ˆβ–ˆ | 838/4000 [18:29<1:05:42, 1.25s/it] 21%|β–ˆβ–ˆ | 839/4000 [18:31<1:04:51, 1.23s/it] 21%|β–ˆβ–ˆ | 840/4000 [18:32<1:04:37, 1.23s/it] {'loss': 0.1293, 'grad_norm': 1.0980839729309082, 'learning_rate': 9.318367465935142e-05}
21%|β–ˆβ–ˆ | 840/4000 [18:32<1:04:37, 1.23s/it] 21%|β–ˆβ–ˆ | 841/4000 [18:33<1:04:22, 1.22s/it] 21%|β–ˆβ–ˆ | 842/4000 [18:34<1:05:54, 1.25s/it] 21%|β–ˆβ–ˆ | 843/4000 [18:36<1:05:47, 1.25s/it] 21%|β–ˆβ–ˆ | 844/4000 [18:37<1:04:59, 1.24s/it] 21%|β–ˆβ–ˆ | 845/4000 [18:38<1:04:19, 1.22s/it] 21%|β–ˆβ–ˆ | 846/4000 [18:39<1:04:09, 1.22s/it] 21%|β–ˆβ–ˆ | 847/4000 [18:41<1:04:44, 1.23s/it] 21%|β–ˆβ–ˆ | 848/4000 [18:42<1:04:45, 1.23s/it] 21%|β–ˆβ–ˆ | 849/4000 [18:43<1:04:41, 1.23s/it] 21%|β–ˆβ–ˆβ– | 850/4000 [18:44<1:05:10, 1.24s/it] {'loss': 0.1464, 'grad_norm': 0.807638943195343, 'learning_rate': 9.29738426991717e-05}
21%|β–ˆβ–ˆβ– | 850/4000 [18:44<1:05:10, 1.24s/it] 21%|β–ˆβ–ˆβ– | 851/4000 [18:46<1:06:06, 1.26s/it] 21%|β–ˆβ–ˆβ– | 852/4000 [18:47<1:05:27, 1.25s/it] 21%|β–ˆβ–ˆβ– | 853/4000 [18:48<1:05:22, 1.25s/it] 21%|β–ˆβ–ˆβ– | 854/4000 [18:49<1:05:25, 1.25s/it] 21%|β–ˆβ–ˆβ– | 855/4000 [18:50<1:04:32, 1.23s/it] 21%|β–ˆβ–ˆβ– | 856/4000 [18:52<1:04:24, 1.23s/it] 21%|β–ˆβ–ˆβ– | 857/4000 [18:53<1:04:58, 1.24s/it] 21%|β–ˆβ–ˆβ– | 858/4000 [18:54<1:04:40, 1.24s/it] 21%|β–ˆβ–ˆβ– | 859/4000 [18:55<1:04:59, 1.24s/it] 22%|β–ˆβ–ˆβ– | 860/4000 [18:57<1:04:20, 1.23s/it] {'loss': 0.135, 'grad_norm': 1.0502347946166992, 'learning_rate': 9.276107353392774e-05}
22%|β–ˆβ–ˆβ– | 860/4000 [18:57<1:04:20, 1.23s/it] 22%|β–ˆβ–ˆβ– | 861/4000 [18:58<1:04:08, 1.23s/it] 22%|β–ˆβ–ˆβ– | 862/4000 [18:59<1:05:07, 1.25s/it] 22%|β–ˆβ–ˆβ– | 863/4000 [19:00<1:06:04, 1.26s/it] 22%|β–ˆβ–ˆβ– | 864/4000 [19:02<1:05:26, 1.25s/it] 22%|β–ˆβ–ˆβ– | 865/4000 [19:03<1:06:23, 1.27s/it] 22%|β–ˆβ–ˆβ– | 866/4000 [19:04<1:06:36, 1.28s/it] 22%|β–ˆβ–ˆβ– | 867/4000 [19:06<1:06:19, 1.27s/it] 22%|β–ˆβ–ˆβ– | 868/4000 [19:07<1:05:34, 1.26s/it] 22%|β–ˆβ–ˆβ– | 869/4000 [19:08<1:04:55, 1.24s/it] 22%|β–ˆβ–ˆβ– | 870/4000 [19:09<1:05:20, 1.25s/it] {'loss': 0.131, 'grad_norm': 0.9446631669998169, 'learning_rate': 9.254538170610938e-05}
22%|β–ˆβ–ˆβ– | 870/4000 [19:09<1:05:20, 1.25s/it] 22%|β–ˆβ–ˆβ– | 871/4000 [19:10<1:05:08, 1.25s/it] 22%|β–ˆβ–ˆβ– | 872/4000 [19:12<1:05:43, 1.26s/it] 22%|β–ˆβ–ˆβ– | 873/4000 [19:13<1:05:04, 1.25s/it] 22%|β–ˆβ–ˆβ– | 874/4000 [19:14<1:04:24, 1.24s/it] 22%|β–ˆβ–ˆβ– | 875/4000 [19:15<1:04:40, 1.24s/it] 22%|β–ˆβ–ˆβ– | 876/4000 [19:17<1:04:45, 1.24s/it] 22%|β–ˆβ–ˆβ– | 877/4000 [19:18<1:05:14, 1.25s/it] 22%|β–ˆβ–ˆβ– | 878/4000 [19:19<1:04:29, 1.24s/it] 22%|β–ˆβ–ˆβ– | 879/4000 [19:20<1:03:55, 1.23s/it] 22%|β–ˆβ–ˆβ– | 880/4000 [19:22<1:04:26, 1.24s/it] {'loss': 0.1218, 'grad_norm': 1.0615981817245483, 'learning_rate': 9.232678195796654e-05}
22%|β–ˆβ–ˆβ– | 880/4000 [19:22<1:04:26, 1.24s/it] 22%|β–ˆβ–ˆβ– | 881/4000 [19:23<1:03:58, 1.23s/it] 22%|β–ˆβ–ˆβ– | 882/4000 [19:24<1:04:13, 1.24s/it] 22%|β–ˆβ–ˆβ– | 883/4000 [19:25<1:03:38, 1.23s/it] 22%|β–ˆβ–ˆβ– | 884/4000 [19:27<1:04:49, 1.25s/it] 22%|β–ˆβ–ˆβ– | 885/4000 [19:28<1:04:52, 1.25s/it] 22%|β–ˆβ–ˆβ– | 886/4000 [19:29<1:04:31, 1.24s/it] 22%|β–ˆβ–ˆβ– | 887/4000 [19:30<1:04:36, 1.25s/it] 22%|β–ˆβ–ˆβ– | 888/4000 [19:32<1:03:57, 1.23s/it] 22%|β–ˆβ–ˆβ– | 889/4000 [19:33<1:05:14, 1.26s/it] 22%|β–ˆβ–ˆβ– | 890/4000 [19:34<1:06:20, 1.28s/it] {'loss': 0.1202, 'grad_norm': 0.9516430497169495, 'learning_rate': 9.210528923050164e-05}
22%|β–ˆβ–ˆβ– | 890/4000 [19:34<1:06:20, 1.28s/it] 22%|β–ˆβ–ˆβ– | 891/4000 [19:35<1:05:33, 1.27s/it] 22%|β–ˆβ–ˆβ– | 892/4000 [19:37<1:04:40, 1.25s/it] 22%|β–ˆβ–ˆβ– | 893/4000 [19:38<1:04:02, 1.24s/it] 22%|β–ˆβ–ˆβ– | 894/4000 [19:39<1:04:20, 1.24s/it] 22%|β–ˆβ–ˆβ– | 895/4000 [19:40<1:03:57, 1.24s/it] 22%|β–ˆβ–ˆβ– | 896/4000 [19:42<1:03:50, 1.23s/it] 22%|β–ˆβ–ˆβ– | 897/4000 [19:43<1:04:28, 1.25s/it] 22%|β–ˆβ–ˆβ– | 898/4000 [19:44<1:04:52, 1.25s/it] 22%|β–ˆβ–ˆβ– | 899/4000 [19:45<1:04:26, 1.25s/it] 22%|β–ˆβ–ˆβ–Ž | 900/4000 [19:47<1:03:45, 1.23s/it] {'loss': 0.1424, 'grad_norm': 0.9400070905685425, 'learning_rate': 9.188091866244834e-05}
22%|β–ˆβ–ˆβ–Ž | 900/4000 [19:47<1:03:45, 1.23s/it] 23%|β–ˆβ–ˆβ–Ž | 901/4000 [19:48<1:03:27, 1.23s/it] 23%|β–ˆβ–ˆβ–Ž | 902/4000 [19:49<1:03:09, 1.22s/it] 23%|β–ˆβ–ˆβ–Ž | 903/4000 [19:50<1:03:11, 1.22s/it] 23%|β–ˆβ–ˆβ–Ž | 904/4000 [19:51<1:02:39, 1.21s/it] 23%|β–ˆβ–ˆβ–Ž | 905/4000 [19:53<1:02:31, 1.21s/it] 23%|β–ˆβ–ˆβ–Ž | 906/4000 [19:54<1:02:48, 1.22s/it] 23%|β–ˆβ–ˆβ–Ž | 907/4000 [19:55<1:04:05, 1.24s/it] 23%|β–ˆβ–ˆβ–Ž | 908/4000 [19:56<1:04:31, 1.25s/it] 23%|β–ˆβ–ˆβ–Ž | 909/4000 [19:58<1:04:40, 1.26s/it] 23%|β–ˆβ–ˆβ–Ž | 910/4000 [19:59<1:04:32, 1.25s/it] {'loss': 0.117, 'grad_norm': 1.0795716047286987, 'learning_rate': 9.165368558923695e-05}
23%|β–ˆβ–ˆβ–Ž | 910/4000 [19:59<1:04:32, 1.25s/it] 23%|β–ˆβ–ˆβ–Ž | 911/4000 [20:00<1:04:23, 1.25s/it] 23%|β–ˆβ–ˆβ–Ž | 912/4000 [20:01<1:04:47, 1.26s/it] 23%|β–ˆβ–ˆβ–Ž | 913/4000 [20:03<1:05:09, 1.27s/it] 23%|β–ˆβ–ˆβ–Ž | 914/4000 [20:04<1:04:17, 1.25s/it] 23%|β–ˆβ–ˆβ–Ž | 915/4000 [20:05<1:03:28, 1.23s/it] 23%|β–ˆβ–ˆβ–Ž | 916/4000 [20:06<1:02:58, 1.23s/it] 23%|β–ˆβ–ˆβ–Ž | 917/4000 [20:08<1:03:03, 1.23s/it] 23%|β–ˆβ–ˆβ–Ž | 918/4000 [20:09<1:03:04, 1.23s/it] 23%|β–ˆβ–ˆβ–Ž | 919/4000 [20:10<1:04:04, 1.25s/it] 23%|β–ˆβ–ˆβ–Ž | 920/4000 [20:11<1:04:19, 1.25s/it] {'loss': 0.1368, 'grad_norm': 0.8076651692390442, 'learning_rate': 9.142360554194618e-05}
23%|β–ˆβ–ˆβ–Ž | 920/4000 [20:11<1:04:19, 1.25s/it] 23%|β–ˆβ–ˆβ–Ž | 921/4000 [20:13<1:04:27, 1.26s/it] 23%|β–ˆβ–ˆβ–Ž | 922/4000 [20:14<1:05:38, 1.28s/it] 23%|β–ˆβ–ˆβ–Ž | 923/4000 [20:15<1:05:31, 1.28s/it] 23%|β–ˆβ–ˆβ–Ž | 924/4000 [20:16<1:04:52, 1.27s/it] 23%|β–ˆβ–ˆβ–Ž | 925/4000 [20:18<1:03:58, 1.25s/it] 23%|β–ˆβ–ˆβ–Ž | 926/4000 [20:19<1:04:20, 1.26s/it] 23%|β–ˆβ–ˆβ–Ž | 927/4000 [20:20<1:05:06, 1.27s/it] 23%|β–ˆβ–ˆβ–Ž | 928/4000 [20:22<1:05:40, 1.28s/it] 23%|β–ˆβ–ˆβ–Ž | 929/4000 [20:23<1:04:17, 1.26s/it] 23%|β–ˆβ–ˆβ–Ž | 930/4000 [20:24<1:03:30, 1.24s/it] {'loss': 0.1246, 'grad_norm': 1.1119225025177002, 'learning_rate': 9.119069424624163e-05}
23%|β–ˆβ–ˆβ–Ž | 930/4000 [20:24<1:03:30, 1.24s/it] 23%|β–ˆβ–ˆβ–Ž | 931/4000 [20:25<1:03:57, 1.25s/it] 23%|β–ˆβ–ˆβ–Ž | 932/4000 [20:27<1:04:25, 1.26s/it] 23%|β–ˆβ–ˆβ–Ž | 933/4000 [20:28<1:03:57, 1.25s/it] 23%|β–ˆβ–ˆβ–Ž | 934/4000 [20:29<1:03:50, 1.25s/it] 23%|β–ˆβ–ˆβ–Ž | 935/4000 [20:30<1:04:46, 1.27s/it] 23%|β–ˆβ–ˆβ–Ž | 936/4000 [20:32<1:04:47, 1.27s/it] 23%|β–ˆβ–ˆβ–Ž | 937/4000 [20:33<1:04:22, 1.26s/it] 23%|β–ˆβ–ˆβ–Ž | 938/4000 [20:34<1:03:48, 1.25s/it] 23%|β–ˆβ–ˆβ–Ž | 939/4000 [20:35<1:03:49, 1.25s/it] 24%|β–ˆβ–ˆβ–Ž | 940/4000 [20:37<1:03:42, 1.25s/it] {'loss': 0.1149, 'grad_norm': 1.008325457572937, 'learning_rate': 9.0954967621301e-05}
24%|β–ˆβ–ˆβ–Ž | 940/4000 [20:37<1:03:42, 1.25s/it] 24%|β–ˆβ–ˆβ–Ž | 941/4000 [20:38<1:03:17, 1.24s/it] 24%|β–ˆβ–ˆβ–Ž | 942/4000 [20:39<1:04:14, 1.26s/it] 24%|β–ˆβ–ˆβ–Ž | 943/4000 [20:40<1:04:05, 1.26s/it] 24%|β–ˆβ–ˆβ–Ž | 944/4000 [20:42<1:03:52, 1.25s/it] 24%|β–ˆβ–ˆβ–Ž | 945/4000 [20:43<1:04:35, 1.27s/it] 24%|β–ˆβ–ˆβ–Ž | 946/4000 [20:44<1:04:39, 1.27s/it] 24%|β–ˆβ–ˆβ–Ž | 947/4000 [20:45<1:03:54, 1.26s/it] 24%|β–ˆβ–ˆβ–Ž | 948/4000 [20:47<1:04:09, 1.26s/it] 24%|β–ˆβ–ˆβ–Ž | 949/4000 [20:48<1:03:45, 1.25s/it] 24%|β–ˆβ–ˆβ– | 950/4000 [20:49<1:04:05, 1.26s/it] {'loss': 0.1359, 'grad_norm': 0.9076796174049377, 'learning_rate': 9.071644177872594e-05}
24%|β–ˆβ–ˆβ– | 950/4000 [20:49<1:04:05, 1.26s/it] 24%|β–ˆβ–ˆβ– | 951/4000 [20:50<1:04:55, 1.28s/it] 24%|β–ˆβ–ˆβ– | 952/4000 [20:52<1:04:22, 1.27s/it] 24%|β–ˆβ–ˆβ– | 953/4000 [20:53<1:04:38, 1.27s/it] 24%|β–ˆβ–ˆβ– | 954/4000 [20:54<1:04:52, 1.28s/it] 24%|β–ˆβ–ˆβ– | 955/4000 [20:56<1:04:17, 1.27s/it] 24%|β–ˆβ–ˆβ– | 956/4000 [20:57<1:04:42, 1.28s/it] 24%|β–ˆβ–ˆβ– | 957/4000 [20:58<1:04:12, 1.27s/it] 24%|β–ˆβ–ˆβ– | 958/4000 [20:59<1:03:03, 1.24s/it] 24%|β–ˆβ–ˆβ– | 959/4000 [21:00<1:03:03, 1.24s/it] 24%|β–ˆβ–ˆβ– | 960/4000 [21:02<1:04:16, 1.27s/it] {'loss': 0.1127, 'grad_norm': 1.0055447816848755, 'learning_rate': 9.047513302144095e-05}
24%|β–ˆβ–ˆβ– | 960/4000 [21:02<1:04:16, 1.27s/it] 24%|β–ˆβ–ˆβ– | 961/4000 [21:03<1:04:24, 1.27s/it] 24%|β–ˆβ–ˆβ– | 962/4000 [21:04<1:03:25, 1.25s/it] 24%|β–ˆβ–ˆβ– | 963/4000 [21:06<1:03:46, 1.26s/it] 24%|β–ˆβ–ˆβ– | 964/4000 [21:07<1:03:27, 1.25s/it] 24%|β–ˆβ–ˆβ– | 965/4000 [21:08<1:03:38, 1.26s/it] 24%|β–ˆβ–ˆβ– | 966/4000 [21:09<1:03:20, 1.25s/it] 24%|β–ˆβ–ˆβ– | 967/4000 [21:11<1:03:34, 1.26s/it] 24%|β–ˆβ–ˆβ– | 968/4000 [21:12<1:03:09, 1.25s/it] 24%|β–ˆβ–ˆβ– | 969/4000 [21:13<1:02:55, 1.25s/it] 24%|β–ˆβ–ˆβ– | 970/4000 [21:14<1:03:54, 1.27s/it] {'loss': 0.1149, 'grad_norm': 0.809727132320404, 'learning_rate': 9.023105784257906e-05}
24%|β–ˆβ–ˆβ– | 970/4000 [21:14<1:03:54, 1.27s/it] 24%|β–ˆβ–ˆβ– | 971/4000 [21:16<1:03:19, 1.25s/it] 24%|β–ˆβ–ˆβ– | 972/4000 [21:17<1:04:04, 1.27s/it] 24%|β–ˆβ–ˆβ– | 973/4000 [21:18<1:03:24, 1.26s/it] 24%|β–ˆβ–ˆβ– | 974/4000 [21:19<1:02:54, 1.25s/it] 24%|β–ˆβ–ˆβ– | 975/4000 [21:21<1:02:53, 1.25s/it] 24%|β–ˆβ–ˆβ– | 976/4000 [21:22<1:03:46, 1.27s/it] 24%|β–ˆβ–ˆβ– | 977/4000 [21:23<1:02:50, 1.25s/it] 24%|β–ˆβ–ˆβ– | 978/4000 [21:24<1:02:47, 1.25s/it] 24%|β–ˆβ–ˆβ– | 979/4000 [21:26<1:03:03, 1.25s/it] 24%|β–ˆβ–ˆβ– | 980/4000 [21:27<1:02:59, 1.25s/it] {'loss': 0.1287, 'grad_norm': 1.0216758251190186, 'learning_rate': 8.998423292435454e-05}
24%|β–ˆβ–ˆβ– | 980/4000 [21:27<1:02:59, 1.25s/it] 25%|β–ˆβ–ˆβ– | 981/4000 [21:28<1:03:05, 1.25s/it] 25%|β–ˆβ–ˆβ– | 982/4000 [21:29<1:03:01, 1.25s/it] 25%|β–ˆβ–ˆβ– | 983/4000 [21:31<1:02:34, 1.24s/it] 25%|β–ˆβ–ˆβ– | 984/4000 [21:32<1:02:47, 1.25s/it] 25%|β–ˆβ–ˆβ– | 985/4000 [21:33<1:02:45, 1.25s/it] 25%|β–ˆβ–ˆβ– | 986/4000 [21:34<1:03:45, 1.27s/it] 25%|β–ˆβ–ˆβ– | 987/4000 [21:36<1:03:24, 1.26s/it] 25%|β–ˆβ–ˆβ– | 988/4000 [21:37<1:02:21, 1.24s/it] 25%|β–ˆβ–ˆβ– | 989/4000 [21:38<1:01:52, 1.23s/it] 25%|β–ˆβ–ˆβ– | 990/4000 [21:39<1:02:27, 1.25s/it] {'loss': 0.1254, 'grad_norm': 0.9214051365852356, 'learning_rate': 8.973467513692265e-05}
25%|β–ˆβ–ˆβ– | 990/4000 [21:39<1:02:27, 1.25s/it] 25%|β–ˆβ–ˆβ– | 991/4000 [21:41<1:05:56, 1.31s/it] 25%|β–ˆβ–ˆβ– | 992/4000 [21:42<1:05:01, 1.30s/it] 25%|β–ˆβ–ˆβ– | 993/4000 [21:43<1:04:33, 1.29s/it] 25%|β–ˆβ–ˆβ– | 994/4000 [21:45<1:04:57, 1.30s/it] 25%|β–ˆβ–ˆβ– | 995/4000 [21:46<1:03:26, 1.27s/it] 25%|β–ˆβ–ˆβ– | 996/4000 [21:47<1:02:45, 1.25s/it] 25%|β–ˆβ–ˆβ– | 997/4000 [21:48<1:02:37, 1.25s/it] 25%|β–ˆβ–ˆβ– | 998/4000 [21:50<1:02:08, 1.24s/it] 25%|β–ˆβ–ˆβ– | 999/4000 [21:51<1:02:12, 1.24s/it] 25%|β–ˆβ–ˆβ–Œ | 1000/4000 [21:52<1:01:48, 1.24s/it] {'loss': 0.1197, 'grad_norm': 0.8512207865715027, 'learning_rate': 8.94824015372267e-05}
25%|β–ˆβ–ˆβ–Œ | 1000/4000 [21:52<1:01:48, 1.24s/it] 25%|β–ˆβ–ˆβ–Œ | 1001/4000 [21:53<1:02:24, 1.25s/it] 25%|β–ˆβ–ˆβ–Œ | 1002/4000 [21:55<1:03:04, 1.26s/it] 25%|β–ˆβ–ˆβ–Œ | 1003/4000 [21:56<1:02:49, 1.26s/it] 25%|β–ˆβ–ˆβ–Œ | 1004/4000 [21:57<1:02:13, 1.25s/it] 25%|β–ˆβ–ˆβ–Œ | 1005/4000 [21:58<1:02:20, 1.25s/it] 25%|β–ˆβ–ˆβ–Œ | 1006/4000 [22:00<1:01:43, 1.24s/it] 25%|β–ˆβ–ˆβ–Œ | 1007/4000 [22:01<1:02:03, 1.24s/it] 25%|β–ˆβ–ˆβ–Œ | 1008/4000 [22:02<1:03:03, 1.26s/it] 25%|β–ˆβ–ˆβ–Œ | 1009/4000 [22:03<1:03:43, 1.28s/it] 25%|β–ˆβ–ˆβ–Œ | 1010/4000 [22:05<1:03:49, 1.28s/it] {'loss': 0.1103, 'grad_norm': 0.874568521976471, 'learning_rate': 8.922742936783207e-05}
25%|β–ˆβ–ˆβ–Œ | 1010/4000 [22:05<1:03:49, 1.28s/it] 25%|β–ˆβ–ˆβ–Œ | 1011/4000 [22:06<1:02:43, 1.26s/it] 25%|β–ˆβ–ˆβ–Œ | 1012/4000 [22:07<1:02:49, 1.26s/it] 25%|β–ˆβ–ˆβ–Œ | 1013/4000 [22:08<1:02:08, 1.25s/it] 25%|β–ˆβ–ˆβ–Œ | 1014/4000 [22:10<1:01:53, 1.24s/it] 25%|β–ˆβ–ˆβ–Œ | 1015/4000 [22:11<1:01:36, 1.24s/it] 25%|β–ˆβ–ˆβ–Œ | 1016/4000 [22:12<1:02:06, 1.25s/it] 25%|β–ˆβ–ˆβ–Œ | 1017/4000 [22:13<1:01:34, 1.24s/it] 25%|β–ˆβ–ˆβ–Œ | 1018/4000 [22:15<1:01:52, 1.25s/it] 25%|β–ˆβ–ˆβ–Œ | 1019/4000 [22:16<1:02:12, 1.25s/it] 26%|β–ˆβ–ˆβ–Œ | 1020/4000 [22:17<1:02:16, 1.25s/it] {'loss': 0.1197, 'grad_norm': 1.005102276802063, 'learning_rate': 8.896977605574788e-05}
26%|β–ˆβ–ˆβ–Œ | 1020/4000 [22:17<1:02:16, 1.25s/it] 26%|β–ˆβ–ˆβ–Œ | 1021/4000 [22:18<1:01:35, 1.24s/it] 26%|β–ˆβ–ˆβ–Œ | 1022/4000 [22:20<1:01:06, 1.23s/it] 26%|β–ˆβ–ˆβ–Œ | 1023/4000 [22:21<1:00:57, 1.23s/it] 26%|β–ˆβ–ˆβ–Œ | 1024/4000 [22:22<1:01:56, 1.25s/it] 26%|β–ˆβ–ˆβ–Œ | 1025/4000 [22:23<1:01:17, 1.24s/it] 26%|β–ˆβ–ˆβ–Œ | 1026/4000 [22:25<1:01:34, 1.24s/it] 26%|β–ˆβ–ˆβ–Œ | 1027/4000 [22:26<1:01:02, 1.23s/it] 26%|β–ˆβ–ˆβ–Œ | 1028/4000 [22:27<1:01:43, 1.25s/it] 26%|β–ˆβ–ˆβ–Œ | 1029/4000 [22:28<1:02:01, 1.25s/it] 26%|β–ˆβ–ˆβ–Œ | 1030/4000 [22:30<1:02:07, 1.25s/it] {'loss': 0.1187, 'grad_norm': 0.987156331539154, 'learning_rate': 8.870945921123576e-05}
26%|β–ˆβ–ˆβ–Œ | 1030/4000 [22:30<1:02:07, 1.25s/it] 26%|β–ˆβ–ˆβ–Œ | 1031/4000 [22:31<1:01:30, 1.24s/it] 26%|β–ˆβ–ˆβ–Œ | 1032/4000 [22:32<1:01:11, 1.24s/it] 26%|β–ˆβ–ˆβ–Œ | 1033/4000 [22:33<1:01:36, 1.25s/it] 26%|β–ˆβ–ˆβ–Œ | 1034/4000 [22:34<1:01:21, 1.24s/it] 26%|β–ˆβ–ˆβ–Œ | 1035/4000 [22:36<1:01:40, 1.25s/it] 26%|β–ˆβ–ˆβ–Œ | 1036/4000 [22:37<1:01:09, 1.24s/it] 26%|β–ˆβ–ˆβ–Œ | 1037/4000 [22:38<1:01:23, 1.24s/it] 26%|β–ˆβ–ˆβ–Œ | 1038/4000 [22:39<1:01:40, 1.25s/it] 26%|β–ˆβ–ˆβ–Œ | 1039/4000 [22:41<1:01:01, 1.24s/it] 26%|β–ˆβ–ˆβ–Œ | 1040/4000 [22:42<1:00:36, 1.23s/it] {'loss': 0.1258, 'grad_norm': 0.925915539264679, 'learning_rate': 8.844649662660624e-05}
26%|β–ˆβ–ˆβ–Œ | 1040/4000 [22:42<1:00:36, 1.23s/it] 26%|β–ˆβ–ˆβ–Œ | 1041/4000 [22:43<1:00:34, 1.23s/it] 26%|β–ˆβ–ˆβ–Œ | 1042/4000 [22:44<1:01:50, 1.25s/it] 26%|β–ˆβ–ˆβ–Œ | 1043/4000 [22:46<1:02:05, 1.26s/it] 26%|β–ˆβ–ˆβ–Œ | 1044/4000 [22:47<1:01:46, 1.25s/it] 26%|β–ˆβ–ˆβ–Œ | 1045/4000 [22:48<1:01:15, 1.24s/it] 26%|β–ˆβ–ˆβ–Œ | 1046/4000 [22:49<1:00:41, 1.23s/it] 26%|β–ˆβ–ˆβ–Œ | 1047/4000 [22:51<1:01:44, 1.25s/it] 26%|β–ˆβ–ˆβ–Œ | 1048/4000 [22:52<1:00:54, 1.24s/it] 26%|β–ˆβ–ˆβ–Œ | 1049/4000 [22:53<1:01:47, 1.26s/it] 26%|β–ˆβ–ˆβ–‹ | 1050/4000 [22:54<1:00:57, 1.24s/it] {'loss': 0.1106, 'grad_norm': 1.0045526027679443, 'learning_rate': 8.818090627500266e-05}
26%|β–ˆβ–ˆβ–‹ | 1050/4000 [22:54<1:00:57, 1.24s/it] 26%|β–ˆβ–ˆβ–‹ | 1051/4000 [22:56<1:00:25, 1.23s/it] 26%|β–ˆβ–ˆβ–‹ | 1052/4000 [22:57<1:01:13, 1.25s/it] 26%|β–ˆβ–ˆβ–‹ | 1053/4000 [22:58<1:00:37, 1.23s/it] 26%|β–ˆβ–ˆβ–‹ | 1054/4000 [22:59<1:01:02, 1.24s/it] 26%|β–ˆβ–ˆβ–‹ | 1055/4000 [23:01<1:02:12, 1.27s/it] 26%|β–ˆβ–ˆβ–‹ | 1056/4000 [23:02<1:02:47, 1.28s/it] 26%|β–ˆβ–ˆβ–‹ | 1057/4000 [23:03<1:02:08, 1.27s/it] 26%|β–ˆβ–ˆβ–‹ | 1058/4000 [23:04<1:01:55, 1.26s/it] 26%|β–ˆβ–ˆβ–‹ | 1059/4000 [23:06<1:01:14, 1.25s/it] 26%|β–ˆβ–ˆβ–‹ | 1060/4000 [23:07<1:00:59, 1.24s/it] {'loss': 0.1349, 'grad_norm': 0.8387489914894104, 'learning_rate': 8.791270630917275e-05}
26%|β–ˆβ–ˆβ–‹ | 1060/4000 [23:07<1:00:59, 1.24s/it] 27%|β–ˆβ–ˆβ–‹ | 1061/4000 [23:08<1:01:20, 1.25s/it] 27%|β–ˆβ–ˆβ–‹ | 1062/4000 [23:09<1:01:40, 1.26s/it] 27%|β–ˆβ–ˆβ–‹ | 1063/4000 [23:11<1:01:53, 1.26s/it] 27%|β–ˆβ–ˆβ–‹ | 1064/4000 [23:12<1:01:42, 1.26s/it] 27%|β–ˆβ–ˆβ–‹ | 1065/4000 [23:13<1:01:48, 1.26s/it] 27%|β–ˆβ–ˆβ–‹ | 1066/4000 [23:15<1:01:42, 1.26s/it] 27%|β–ˆβ–ˆβ–‹ | 1067/4000 [23:16<1:00:57, 1.25s/it] 27%|β–ˆβ–ˆβ–‹ | 1068/4000 [23:17<1:01:05, 1.25s/it] 27%|β–ˆβ–ˆβ–‹ | 1069/4000 [23:18<1:00:38, 1.24s/it] 27%|β–ˆβ–ˆβ–‹ | 1070/4000 [23:19<1:00:17, 1.23s/it] {'loss': 0.1244, 'grad_norm': 0.8228302001953125, 'learning_rate': 8.764191506022795e-05}
27%|β–ˆβ–ˆβ–‹ | 1070/4000 [23:19<1:00:17, 1.23s/it] 27%|β–ˆβ–ˆβ–‹ | 1071/4000 [23:21<1:00:39, 1.24s/it] 27%|β–ˆβ–ˆβ–‹ | 1072/4000 [23:22<1:00:04, 1.23s/it] 27%|β–ˆβ–ˆβ–‹ | 1073/4000 [23:23<1:00:14, 1.23s/it] 27%|β–ˆβ–ˆβ–‹ | 1074/4000 [23:24<1:01:11, 1.25s/it] 27%|β–ˆβ–ˆβ–‹ | 1075/4000 [23:26<1:01:17, 1.26s/it] 27%|β–ˆβ–ˆβ–‹ | 1076/4000 [23:27<1:00:32, 1.24s/it] 27%|β–ˆβ–ˆβ–‹ | 1077/4000 [23:28<1:00:04, 1.23s/it] 27%|β–ˆβ–ˆβ–‹ | 1078/4000 [23:29<59:41, 1.23s/it] 27%|β–ˆβ–ˆβ–‹ | 1079/4000 [23:31<59:20, 1.22s/it] 27%|β–ˆβ–ˆβ–‹ | 1080/4000 [23:32<1:00:08, 1.24s/it] {'loss': 0.1191, 'grad_norm': 0.8722813725471497, 'learning_rate': 8.736855103639037e-05}
27%|β–ˆβ–ˆβ–‹ | 1080/4000 [23:32<1:00:08, 1.24s/it] 27%|β–ˆβ–ˆβ–‹ | 1081/4000 [23:33<1:00:28, 1.24s/it] 27%|β–ˆβ–ˆβ–‹ | 1082/4000 [23:34<1:01:22, 1.26s/it] 27%|β–ˆβ–ˆβ–‹ | 1083/4000 [23:36<1:01:33, 1.27s/it] 27%|β–ˆβ–ˆβ–‹ | 1084/4000 [23:37<1:01:16, 1.26s/it] 27%|β–ˆβ–ˆβ–‹ | 1085/4000 [23:38<1:00:39, 1.25s/it] 27%|β–ˆβ–ˆβ–‹ | 1086/4000 [23:39<1:01:09, 1.26s/it] 27%|β–ˆβ–ˆβ–‹ | 1087/4000 [23:41<1:00:26, 1.24s/it] 27%|β–ˆβ–ˆβ–‹ | 1088/4000 [23:42<59:52, 1.23s/it] 27%|β–ˆβ–ˆβ–‹ | 1089/4000 [23:43<1:02:54, 1.30s/it] 27%|β–ˆβ–ˆβ–‹ | 1090/4000 [23:45<1:02:34, 1.29s/it] {'loss': 0.0956, 'grad_norm': 0.9251738786697388, 'learning_rate': 8.709263292172794e-05}
27%|β–ˆβ–ˆβ–‹ | 1090/4000 [23:45<1:02:34, 1.29s/it] 27%|β–ˆβ–ˆβ–‹ | 1091/4000 [23:46<1:01:24, 1.27s/it] 27%|β–ˆβ–ˆβ–‹ | 1092/4000 [23:47<1:01:45, 1.27s/it] 27%|β–ˆβ–ˆβ–‹ | 1093/4000 [23:48<1:02:08, 1.28s/it] 27%|β–ˆβ–ˆβ–‹ | 1094/4000 [23:50<1:01:07, 1.26s/it] 27%|β–ˆβ–ˆβ–‹ | 1095/4000 [23:51<1:04:54, 1.34s/it] 27%|β–ˆβ–ˆβ–‹ | 1096/4000 [23:52<1:03:36, 1.31s/it] 27%|β–ˆβ–ˆβ–‹ | 1097/4000 [23:54<1:02:45, 1.30s/it] 27%|β–ˆβ–ˆβ–‹ | 1098/4000 [23:55<1:02:40, 1.30s/it] 27%|β–ˆβ–ˆβ–‹ | 1099/4000 [23:56<1:02:01, 1.28s/it] 28%|β–ˆβ–ˆβ–Š | 1100/4000 [23:57<1:01:04, 1.26s/it] {'loss': 0.1117, 'grad_norm': 1.039755940437317, 'learning_rate': 8.681417957487729e-05}
28%|β–ˆβ–ˆβ–Š | 1100/4000 [23:57<1:01:04, 1.26s/it] 28%|β–ˆβ–ˆβ–Š | 1101/4000 [23:59<1:00:28, 1.25s/it] 28%|β–ˆβ–ˆβ–Š | 1102/4000 [24:00<1:04:17, 1.33s/it] 28%|β–ˆβ–ˆβ–Š | 1103/4000 [24:01<1:03:47, 1.32s/it] 28%|β–ˆβ–ˆβ–Š | 1104/4000 [24:03<1:03:50, 1.32s/it] 28%|β–ˆβ–ˆβ–Š | 1105/4000 [24:04<1:03:19, 1.31s/it] 28%|β–ˆβ–ˆβ–Š | 1106/4000 [24:05<1:02:42, 1.30s/it] 28%|β–ˆβ–ˆβ–Š | 1107/4000 [24:07<1:01:46, 1.28s/it] 28%|β–ˆβ–ˆβ–Š | 1108/4000 [24:08<1:00:31, 1.26s/it] 28%|β–ˆβ–ˆβ–Š | 1109/4000 [24:09<59:48, 1.24s/it] 28%|β–ˆβ–ˆβ–Š | 1110/4000 [24:10<59:41, 1.24s/it] {'loss': 0.1222, 'grad_norm': 0.7974300980567932, 'learning_rate': 8.653321002775478e-05}
28%|β–ˆβ–ˆβ–Š | 1110/4000 [24:10<59:41, 1.24s/it] 28%|β–ˆβ–ˆβ–Š | 1111/4000 [24:11<59:38, 1.24s/it] 28%|β–ˆβ–ˆβ–Š | 1112/4000 [24:13<59:07, 1.23s/it] 28%|β–ˆβ–ˆβ–Š | 1113/4000 [24:14<58:43, 1.22s/it] 28%|β–ˆβ–ˆβ–Š | 1114/4000 [24:15<59:36, 1.24s/it] 28%|β–ˆβ–ˆβ–Š | 1115/4000 [24:16<59:55, 1.25s/it] 28%|β–ˆβ–ˆβ–Š | 1116/4000 [24:18<1:00:43, 1.26s/it] 28%|β–ˆβ–ˆβ–Š | 1117/4000 [24:19<59:38, 1.24s/it] 28%|β–ˆβ–ˆβ–Š | 1118/4000 [24:20<58:54, 1.23s/it] 28%|β–ˆβ–ˆβ–Š | 1119/4000 [24:21<59:16, 1.23s/it] 28%|β–ˆβ–ˆβ–Š | 1120/4000 [24:22<58:46, 1.22s/it] {'loss': 0.116, 'grad_norm': 0.7956416010856628, 'learning_rate': 8.624974348425574e-05}
28%|β–ˆβ–ˆβ–Š | 1120/4000 [24:22<58:46, 1.22s/it] 28%|β–ˆβ–ˆβ–Š | 1121/4000 [24:24<58:51, 1.23s/it] 28%|β–ˆβ–ˆβ–Š | 1122/4000 [24:25<59:21, 1.24s/it] 28%|β–ˆβ–ˆβ–Š | 1123/4000 [24:26<59:10, 1.23s/it] 28%|β–ˆβ–ˆβ–Š | 1124/4000 [24:27<59:13, 1.24s/it] 28%|β–ˆβ–ˆβ–Š | 1125/4000 [24:29<59:34, 1.24s/it] 28%|β–ˆβ–ˆβ–Š | 1126/4000 [24:30<59:59, 1.25s/it] 28%|β–ˆβ–ˆβ–Š | 1127/4000 [24:31<59:43, 1.25s/it] 28%|β–ˆβ–ˆβ–Š | 1128/4000 [24:33<1:00:42, 1.27s/it] 28%|β–ˆβ–ˆβ–Š | 1129/4000 [24:34<59:50, 1.25s/it] 28%|β–ˆβ–ˆβ–Š | 1130/4000 [24:35<1:00:02, 1.26s/it] {'loss': 0.1262, 'grad_norm': 0.9204975366592407, 'learning_rate': 8.596379931894188e-05}
28%|β–ˆβ–ˆβ–Š | 1130/4000 [24:35<1:00:02, 1.26s/it] 28%|β–ˆβ–ˆβ–Š | 1131/4000 [24:36<1:00:26, 1.26s/it] 28%|β–ˆβ–ˆβ–Š | 1132/4000 [24:38<1:00:12, 1.26s/it] 28%|β–ˆβ–ˆβ–Š | 1133/4000 [24:39<1:00:10, 1.26s/it] 28%|β–ˆβ–ˆβ–Š | 1134/4000 [24:40<59:43, 1.25s/it] 28%|β–ˆβ–ˆβ–Š | 1135/4000 [24:41<1:00:32, 1.27s/it] 28%|β–ˆβ–ˆβ–Š | 1136/4000 [24:43<1:00:22, 1.26s/it] 28%|β–ˆβ–ˆβ–Š | 1137/4000 [24:44<1:03:02, 1.32s/it] 28%|β–ˆβ–ˆβ–Š | 1138/4000 [24:45<1:02:08, 1.30s/it] 28%|β–ˆβ–ˆβ–Š | 1139/4000 [24:47<1:02:14, 1.31s/it] 28%|β–ˆβ–ˆβ–Š | 1140/4000 [24:48<1:01:41, 1.29s/it] {'loss': 0.121, 'grad_norm': 0.8820106983184814, 'learning_rate': 8.567539707571703e-05}
28%|β–ˆβ–ˆβ–Š | 1140/4000 [24:48<1:01:41, 1.29s/it] 29%|β–ˆβ–ˆβ–Š | 1141/4000 [24:49<1:01:22, 1.29s/it] 29%|β–ˆβ–ˆβ–Š | 1142/4000 [24:50<1:00:41, 1.27s/it] 29%|β–ˆβ–ˆβ–Š | 1143/4000 [24:52<1:03:28, 1.33s/it] 29%|β–ˆβ–ˆβ–Š | 1144/4000 [24:53<1:02:26, 1.31s/it] 29%|β–ˆβ–ˆβ–Š | 1145/4000 [24:54<1:02:08, 1.31s/it] 29%|β–ˆβ–ˆβ–Š | 1146/4000 [24:56<1:01:40, 1.30s/it] 29%|β–ˆβ–ˆβ–Š | 1147/4000 [24:57<1:01:17, 1.29s/it] 29%|β–ˆβ–ˆβ–Š | 1148/4000 [24:58<1:00:32, 1.27s/it] 29%|β–ˆβ–ˆβ–Š | 1149/4000 [24:59<1:00:08, 1.27s/it] 29%|β–ˆβ–ˆβ–‰ | 1150/4000 [25:01<59:22, 1.25s/it] {'loss': 0.1233, 'grad_norm': 1.0583659410476685, 'learning_rate': 8.538455646649146e-05}
29%|β–ˆβ–ˆβ–‰ | 1150/4000 [25:01<59:22, 1.25s/it] 29%|β–ˆβ–ˆβ–‰ | 1151/4000 [25:02<59:23, 1.25s/it] 29%|β–ˆβ–ˆβ–‰ | 1152/4000 [25:03<59:56, 1.26s/it] 29%|β–ˆβ–ˆβ–‰ | 1153/4000 [25:05<1:00:33, 1.28s/it] 29%|β–ˆβ–ˆβ–‰ | 1154/4000 [25:06<59:30, 1.25s/it] 29%|β–ˆβ–ˆβ–‰ | 1155/4000 [25:07<59:29, 1.25s/it] 29%|β–ˆβ–ˆβ–‰ | 1156/4000 [25:08<59:15, 1.25s/it] 29%|β–ˆβ–ˆβ–‰ | 1157/4000 [25:09<58:43, 1.24s/it] 29%|β–ˆβ–ˆβ–‰ | 1158/4000 [25:11<1:01:55, 1.31s/it] 29%|β–ˆβ–ˆβ–‰ | 1159/4000 [25:12<1:01:12, 1.29s/it] 29%|β–ˆβ–ˆβ–‰ | 1160/4000 [25:13<1:01:01, 1.29s/it] {'loss': 0.116, 'grad_norm': 0.9437763094902039, 'learning_rate': 8.509129736983446e-05}
29%|β–ˆβ–ˆβ–‰ | 1160/4000 [25:13<1:01:01, 1.29s/it] 29%|β–ˆβ–ˆβ–‰ | 1161/4000 [25:15<1:00:24, 1.28s/it] 29%|β–ˆβ–ˆβ–‰ | 1162/4000 [25:16<1:00:01, 1.27s/it] 29%|β–ˆβ–ˆβ–‰ | 1163/4000 [25:17<1:00:04, 1.27s/it] 29%|β–ˆβ–ˆβ–‰ | 1164/4000 [25:19<1:00:39, 1.28s/it] 29%|β–ˆβ–ˆβ–‰ | 1165/4000 [25:20<1:00:38, 1.28s/it] 29%|β–ˆβ–ˆβ–‰ | 1166/4000 [25:21<59:39, 1.26s/it] 29%|β–ˆβ–ˆβ–‰ | 1167/4000 [25:22<59:03, 1.25s/it] 29%|β–ˆβ–ˆβ–‰ | 1168/4000 [25:23<58:33, 1.24s/it] 29%|β–ˆβ–ˆβ–‰ | 1169/4000 [25:25<58:47, 1.25s/it] 29%|β–ˆβ–ˆβ–‰ | 1170/4000 [25:26<58:21, 1.24s/it] {'loss': 0.1168, 'grad_norm': 0.879292368888855, 'learning_rate': 8.479563982961571e-05}
29%|β–ˆβ–ˆβ–‰ | 1170/4000 [25:26<58:21, 1.24s/it] 29%|β–ˆβ–ˆβ–‰ | 1171/4000 [25:27<58:17, 1.24s/it] 29%|β–ˆβ–ˆβ–‰ | 1172/4000 [25:28<58:41, 1.25s/it] 29%|β–ˆβ–ˆβ–‰ | 1173/4000 [25:30<59:21, 1.26s/it] 29%|β–ˆβ–ˆβ–‰ | 1174/4000 [25:31<58:38, 1.25s/it] 29%|β–ˆβ–ˆβ–‰ | 1175/4000 [25:32<59:17, 1.26s/it] 29%|β–ˆβ–ˆβ–‰ | 1176/4000 [25:34<59:26, 1.26s/it] 29%|β–ˆβ–ˆβ–‰ | 1177/4000 [25:35<59:25, 1.26s/it] 29%|β–ˆβ–ˆβ–‰ | 1178/4000 [25:36<58:28, 1.24s/it] 29%|β–ˆβ–ˆβ–‰ | 1179/4000 [25:37<57:59, 1.23s/it] 30%|β–ˆβ–ˆβ–‰ | 1180/4000 [25:38<58:27, 1.24s/it] {'loss': 0.111, 'grad_norm': 0.8250635266304016, 'learning_rate': 8.449760405363539e-05}
30%|β–ˆβ–ˆβ–‰ | 1180/4000 [25:38<58:27, 1.24s/it] 30%|β–ˆβ–ˆβ–‰ | 1181/4000 [25:40<57:45, 1.23s/it] 30%|β–ˆβ–ˆβ–‰ | 1182/4000 [25:41<57:24, 1.22s/it] 30%|β–ˆβ–ˆβ–‰ | 1183/4000 [25:42<57:15, 1.22s/it] 30%|β–ˆβ–ˆβ–‰ | 1184/4000 [25:43<57:19, 1.22s/it] 30%|β–ˆβ–ˆβ–‰ | 1185/4000 [25:45<58:08, 1.24s/it] 30%|β–ˆβ–ˆβ–‰ | 1186/4000 [25:46<58:30, 1.25s/it] 30%|β–ˆβ–ˆβ–‰ | 1187/4000 [25:47<59:09, 1.26s/it] 30%|β–ˆβ–ˆβ–‰ | 1188/4000 [25:48<58:41, 1.25s/it] 30%|β–ˆβ–ˆβ–‰ | 1189/4000 [25:50<58:35, 1.25s/it] 30%|β–ˆβ–ˆβ–‰ | 1190/4000 [25:51<58:29, 1.25s/it] {'loss': 0.1153, 'grad_norm': 0.874671459197998, 'learning_rate': 8.419721041224287e-05}
30%|β–ˆβ–ˆβ–‰ | 1190/4000 [25:51<58:29, 1.25s/it] 30%|β–ˆβ–ˆβ–‰ | 1191/4000 [25:52<58:14, 1.24s/it] 30%|β–ˆβ–ˆβ–‰ | 1192/4000 [25:53<58:25, 1.25s/it] 30%|β–ˆβ–ˆβ–‰ | 1193/4000 [25:55<58:17, 1.25s/it] 30%|β–ˆβ–ˆβ–‰ | 1194/4000 [25:56<59:06, 1.26s/it] 30%|β–ˆβ–ˆβ–‰ | 1195/4000 [25:57<59:07, 1.26s/it] 30%|β–ˆβ–ˆβ–‰ | 1196/4000 [25:58<58:09, 1.24s/it] 30%|β–ˆβ–ˆβ–‰ | 1197/4000 [26:00<57:39, 1.23s/it] 30%|β–ˆβ–ˆβ–‰ | 1198/4000 [26:01<58:16, 1.25s/it] 30%|β–ˆβ–ˆβ–‰ | 1199/4000 [26:02<59:01, 1.26s/it] 30%|β–ˆβ–ˆβ–ˆ | 1200/4000 [26:03<58:46, 1.26s/it] {'loss': 0.1173, 'grad_norm': 0.763785719871521, 'learning_rate': 8.389447943694451e-05}
30%|β–ˆβ–ˆβ–ˆ | 1200/4000 [26:03<58:46, 1.26s/it] 30%|β–ˆβ–ˆβ–ˆ | 1201/4000 [26:05<58:06, 1.25s/it] 30%|β–ˆβ–ˆβ–ˆ | 1202/4000 [26:06<58:47, 1.26s/it] 30%|β–ˆβ–ˆβ–ˆ | 1203/4000 [26:07<58:41, 1.26s/it] 30%|β–ˆβ–ˆβ–ˆ | 1204/4000 [26:08<58:43, 1.26s/it] 30%|β–ˆβ–ˆβ–ˆ | 1205/4000 [26:10<58:44, 1.26s/it] 30%|β–ˆβ–ˆβ–ˆ | 1206/4000 [26:11<58:51, 1.26s/it] 30%|β–ˆβ–ˆβ–ˆ | 1207/4000 [26:12<58:23, 1.25s/it] 30%|β–ˆβ–ˆβ–ˆ | 1208/4000 [26:13<57:40, 1.24s/it] 30%|β–ˆβ–ˆβ–ˆ | 1209/4000 [26:15<56:59, 1.23s/it] 30%|β–ˆβ–ˆβ–ˆ | 1210/4000 [26:16<57:24, 1.23s/it] {'loss': 0.115, 'grad_norm': 0.9694574475288391, 'learning_rate': 8.358943181900032e-05}
30%|β–ˆβ–ˆβ–ˆ | 1210/4000 [26:16<57:24, 1.23s/it] 30%|β–ˆβ–ˆβ–ˆ | 1211/4000 [26:17<57:02, 1.23s/it] 30%|β–ˆβ–ˆβ–ˆ | 1212/4000 [26:18<56:46, 1.22s/it] 30%|β–ˆβ–ˆβ–ˆ | 1213/4000 [26:20<57:04, 1.23s/it] 30%|β–ˆβ–ˆβ–ˆ | 1214/4000 [26:21<56:43, 1.22s/it] 30%|β–ˆβ–ˆβ–ˆ | 1215/4000 [26:22<56:39, 1.22s/it] 30%|β–ˆβ–ˆβ–ˆ | 1216/4000 [26:23<57:00, 1.23s/it] 30%|β–ˆβ–ˆβ–ˆ | 1217/4000 [26:24<56:54, 1.23s/it] 30%|β–ˆβ–ˆβ–ˆ | 1218/4000 [26:26<56:39, 1.22s/it] 30%|β–ˆβ–ˆβ–ˆ | 1219/4000 [26:27<56:25, 1.22s/it] 30%|β–ˆβ–ˆβ–ˆ | 1220/4000 [26:28<56:58, 1.23s/it] {'loss': 0.1051, 'grad_norm': 0.9185903072357178, 'learning_rate': 8.328208840800981e-05}
30%|β–ˆβ–ˆβ–ˆ | 1220/4000 [26:28<56:58, 1.23s/it] 31%|β–ˆβ–ˆβ–ˆ | 1221/4000 [26:29<56:57, 1.23s/it] 31%|β–ˆβ–ˆβ–ˆ | 1222/4000 [26:31<57:18, 1.24s/it] 31%|β–ˆβ–ˆβ–ˆ | 1223/4000 [26:32<57:31, 1.24s/it] 31%|β–ˆβ–ˆβ–ˆ | 1224/4000 [26:33<57:22, 1.24s/it] 31%|β–ˆβ–ˆβ–ˆ | 1225/4000 [26:34<58:16, 1.26s/it] 31%|β–ˆβ–ˆβ–ˆ | 1226/4000 [26:36<57:58, 1.25s/it] 31%|β–ˆβ–ˆβ–ˆ | 1227/4000 [26:37<57:59, 1.25s/it] 31%|β–ˆβ–ˆβ–ˆ | 1228/4000 [26:38<57:20, 1.24s/it] 31%|β–ˆβ–ˆβ–ˆ | 1229/4000 [26:39<57:43, 1.25s/it] 31%|β–ˆβ–ˆβ–ˆ | 1230/4000 [26:41<57:27, 1.24s/it] {'loss': 0.1143, 'grad_norm': 0.9442175626754761, 'learning_rate': 8.297247021048686e-05}
31%|β–ˆβ–ˆβ–ˆ | 1230/4000 [26:41<57:27, 1.24s/it] 31%|β–ˆβ–ˆβ–ˆ | 1231/4000 [26:42<58:24, 1.27s/it] 31%|β–ˆβ–ˆβ–ˆ | 1232/4000 [26:43<58:21, 1.27s/it] 31%|β–ˆβ–ˆβ–ˆ | 1233/4000 [26:44<57:34, 1.25s/it] 31%|β–ˆβ–ˆβ–ˆ | 1234/4000 [26:46<57:45, 1.25s/it] 31%|β–ˆβ–ˆβ–ˆ | 1235/4000 [26:47<57:19, 1.24s/it] 31%|β–ˆβ–ˆβ–ˆ | 1236/4000 [26:48<57:23, 1.25s/it] 31%|β–ˆβ–ˆβ–ˆ | 1237/4000 [26:49<57:47, 1.25s/it] 31%|β–ˆβ–ˆβ–ˆ | 1238/4000 [26:51<56:58, 1.24s/it] 31%|β–ˆβ–ˆβ–ˆ | 1239/4000 [26:52<58:04, 1.26s/it] 31%|β–ˆβ–ˆβ–ˆ | 1240/4000 [26:53<58:44, 1.28s/it] {'loss': 0.1068, 'grad_norm': 0.7252053618431091, 'learning_rate': 8.266059838842396e-05}
31%|β–ˆβ–ˆβ–ˆ | 1240/4000 [26:53<58:44, 1.28s/it] 31%|β–ˆβ–ˆβ–ˆ | 1241/4000 [26:54<58:32, 1.27s/it] 31%|β–ˆβ–ˆβ–ˆ | 1242/4000 [26:56<58:08, 1.26s/it] 31%|β–ˆβ–ˆβ–ˆ | 1243/4000 [26:57<57:31, 1.25s/it] 31%|β–ˆβ–ˆβ–ˆ | 1244/4000 [26:58<57:15, 1.25s/it] 31%|β–ˆβ–ˆβ–ˆ | 1245/4000 [26:59<56:56, 1.24s/it] 31%|β–ˆβ–ˆβ–ˆ | 1246/4000 [27:01<56:37, 1.23s/it] 31%|β–ˆβ–ˆβ–ˆ | 1247/4000 [27:02<56:23, 1.23s/it] 31%|β–ˆβ–ˆβ–ˆ | 1248/4000 [27:03<57:05, 1.24s/it] 31%|β–ˆβ–ˆβ–ˆ | 1249/4000 [27:04<57:16, 1.25s/it] 31%|β–ˆβ–ˆβ–ˆβ– | 1250/4000 [27:06<57:27, 1.25s/it] {'loss': 0.1166, 'grad_norm': 0.8751177787780762, 'learning_rate': 8.23464942578459e-05}
31%|β–ˆβ–ˆβ–ˆβ– | 1250/4000 [27:06<57:27, 1.25s/it] 31%|β–ˆβ–ˆβ–ˆβ– | 1251/4000 [27:07<56:59, 1.24s/it] 31%|β–ˆβ–ˆβ–ˆβ– | 1252/4000 [27:08<57:17, 1.25s/it] 31%|β–ˆβ–ˆβ–ˆβ– | 1253/4000 [27:09<57:00, 1.25s/it] 31%|β–ˆβ–ˆβ–ˆβ– | 1254/4000 [27:11<57:04, 1.25s/it] 31%|β–ˆβ–ˆβ–ˆβ– | 1255/4000 [27:12<57:52, 1.27s/it] 31%|β–ˆβ–ˆβ–ˆβ– | 1256/4000 [27:13<57:45, 1.26s/it] 31%|β–ˆβ–ˆβ–ˆβ– | 1257/4000 [27:14<57:12, 1.25s/it] 31%|β–ˆβ–ˆβ–ˆβ– | 1258/4000 [27:16<57:20, 1.25s/it] 31%|β–ˆβ–ˆβ–ˆβ– | 1259/4000 [27:17<57:01, 1.25s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1260/4000 [27:18<56:48, 1.24s/it] {'loss': 0.1075, 'grad_norm': 0.9381397366523743, 'learning_rate': 8.203017928735277e-05}
32%|β–ˆβ–ˆβ–ˆβ– | 1260/4000 [27:18<56:48, 1.24s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1261/4000 [27:19<56:31, 1.24s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1262/4000 [27:21<56:39, 1.24s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1263/4000 [27:22<56:14, 1.23s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1264/4000 [27:23<57:03, 1.25s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1265/4000 [27:24<57:17, 1.26s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1266/4000 [27:26<57:24, 1.26s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1267/4000 [27:27<56:51, 1.25s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1268/4000 [27:28<57:05, 1.25s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1269/4000 [27:29<57:38, 1.27s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1270/4000 [27:31<57:24, 1.26s/it] {'loss': 0.1207, 'grad_norm': 0.8018847703933716, 'learning_rate': 8.17116750966526e-05}
32%|β–ˆβ–ˆβ–ˆβ– | 1270/4000 [27:31<57:24, 1.26s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1271/4000 [27:32<57:24, 1.26s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1272/4000 [27:33<57:24, 1.26s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1273/4000 [27:34<57:05, 1.26s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1274/4000 [27:36<56:34, 1.25s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1275/4000 [27:37<56:18, 1.24s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1276/4000 [27:38<56:56, 1.25s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1277/4000 [27:39<57:29, 1.27s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1278/4000 [27:41<56:38, 1.25s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1279/4000 [27:42<56:07, 1.24s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1280/4000 [27:43<56:30, 1.25s/it] {'loss': 0.1134, 'grad_norm': 0.7783591151237488, 'learning_rate': 8.139100345508377e-05}
32%|β–ˆβ–ˆβ–ˆβ– | 1280/4000 [27:43<56:30, 1.25s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1281/4000 [27:44<56:04, 1.24s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1282/4000 [27:46<56:12, 1.24s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1283/4000 [27:47<55:43, 1.23s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1284/4000 [27:48<55:32, 1.23s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1285/4000 [27:49<55:47, 1.23s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1286/4000 [27:51<55:21, 1.22s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1287/4000 [27:52<55:26, 1.23s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1288/4000 [27:53<55:32, 1.23s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1289/4000 [27:54<55:14, 1.22s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1290/4000 [27:55<55:15, 1.22s/it] {'loss': 0.1168, 'grad_norm': 0.9916091561317444, 'learning_rate': 8.106818628012697e-05}
32%|β–ˆβ–ˆβ–ˆβ– | 1290/4000 [27:55<55:15, 1.22s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1291/4000 [27:57<55:55, 1.24s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1292/4000 [27:58<55:46, 1.24s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1293/4000 [27:59<56:43, 1.26s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1294/4000 [28:01<57:24, 1.27s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1295/4000 [28:02<57:26, 1.27s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1296/4000 [28:03<57:01, 1.27s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1297/4000 [28:04<56:23, 1.25s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1298/4000 [28:06<56:20, 1.25s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 1299/4000 [28:07<56:04, 1.25s/it] 32%|β–ˆβ–ˆβ–ˆβ–Ž | 1300/4000 [28:08<56:03, 1.25s/it] {'loss': 0.1055, 'grad_norm': 0.8313547968864441, 'learning_rate': 8.074324563590736e-05}
32%|β–ˆβ–ˆβ–ˆβ–Ž | 1300/4000 [28:08<56:03, 1.25s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1301/4000 [28:09<56:06, 1.25s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1302/4000 [28:10<55:49, 1.24s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1303/4000 [28:12<56:58, 1.27s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1304/4000 [28:13<56:04, 1.25s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1305/4000 [28:14<56:13, 1.25s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1306/4000 [28:15<55:35, 1.24s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1307/4000 [28:17<55:12, 1.23s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1308/4000 [28:18<54:43, 1.22s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1309/4000 [28:19<54:39, 1.22s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1310/4000 [28:20<54:50, 1.22s/it] {'loss': 0.1089, 'grad_norm': 0.8843469619750977, 'learning_rate': 8.041620373168628e-05}
33%|β–ˆβ–ˆβ–ˆβ–Ž | 1310/4000 [28:20<54:50, 1.22s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1311/4000 [28:22<55:25, 1.24s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1312/4000 [28:23<55:23, 1.24s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1313/4000 [28:24<55:05, 1.23s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1314/4000 [28:25<55:15, 1.23s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1315/4000 [28:27<55:53, 1.25s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1316/4000 [28:28<55:48, 1.25s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1317/4000 [28:29<56:26, 1.26s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1318/4000 [28:30<55:54, 1.25s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1319/4000 [28:32<55:57, 1.25s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1320/4000 [28:33<56:19, 1.26s/it] {'loss': 0.1183, 'grad_norm': 0.8450259566307068, 'learning_rate': 8.008708292034349e-05}
33%|β–ˆβ–ˆβ–ˆβ–Ž | 1320/4000 [28:33<56:19, 1.26s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1321/4000 [28:34<56:08, 1.26s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1322/4000 [28:35<55:55, 1.25s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1323/4000 [28:37<56:12, 1.26s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1324/4000 [28:38<55:54, 1.25s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1325/4000 [28:39<55:54, 1.25s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1326/4000 [28:40<56:06, 1.26s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1327/4000 [28:42<55:53, 1.25s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1328/4000 [28:43<56:22, 1.27s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1329/4000 [28:44<56:20, 1.27s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1330/4000 [28:45<55:41, 1.25s/it] {'loss': 0.0976, 'grad_norm': 0.8640848994255066, 'learning_rate': 7.975590569684925e-05}
33%|β–ˆβ–ˆβ–ˆβ–Ž | 1330/4000 [28:45<55:41, 1.25s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1331/4000 [28:47<55:17, 1.24s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1332/4000 [28:48<54:49, 1.23s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1333/4000 [28:49<54:52, 1.23s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1334/4000 [28:50<55:18, 1.24s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1335/4000 [28:52<55:21, 1.25s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1336/4000 [28:53<55:20, 1.25s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1337/4000 [28:54<54:45, 1.23s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1338/4000 [28:55<54:19, 1.22s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 1339/4000 [28:56<54:05, 1.22s/it] 34%|β–ˆβ–ˆβ–ˆβ–Ž | 1340/4000 [28:58<55:39, 1.26s/it] {'loss': 0.1094, 'grad_norm': 0.9852693676948547, 'learning_rate': 7.942269469672687e-05}
34%|β–ˆβ–ˆβ–ˆβ–Ž | 1340/4000 [28:58<55:39, 1.26s/it] 34%|β–ˆβ–ˆβ–ˆβ–Ž | 1341/4000 [28:59<55:36, 1.25s/it] 34%|β–ˆβ–ˆβ–ˆβ–Ž | 1342/4000 [29:00<55:28, 1.25s/it] 34%|β–ˆβ–ˆβ–ˆβ–Ž | 1343/4000 [29:02<56:11, 1.27s/it] 34%|β–ˆβ–ˆβ–ˆβ–Ž | 1344/4000 [29:03<56:49, 1.28s/it] 34%|β–ˆβ–ˆβ–ˆβ–Ž | 1345/4000 [29:04<56:17, 1.27s/it] 34%|β–ˆβ–ˆβ–ˆβ–Ž | 1346/4000 [29:05<55:29, 1.25s/it] 34%|β–ˆβ–ˆβ–ˆβ–Ž | 1347/4000 [29:07<55:04, 1.25s/it] 34%|β–ˆβ–ˆβ–ˆβ–Ž | 1348/4000 [29:08<55:40, 1.26s/it] 34%|β–ˆβ–ˆβ–ˆβ–Ž | 1349/4000 [29:09<56:21, 1.28s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1350/4000 [29:10<55:38, 1.26s/it] {'loss': 0.0991, 'grad_norm': 0.8313981890678406, 'learning_rate': 7.908747269450558e-05}
34%|β–ˆβ–ˆβ–ˆβ– | 1350/4000 [29:10<55:38, 1.26s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1351/4000 [29:12<54:58, 1.25s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1352/4000 [29:13<55:20, 1.25s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1353/4000 [29:14<55:22, 1.26s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1354/4000 [29:15<54:58, 1.25s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1355/4000 [29:17<54:57, 1.25s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1356/4000 [29:18<54:54, 1.25s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1357/4000 [29:19<54:17, 1.23s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1358/4000 [29:20<54:24, 1.24s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1359/4000 [29:22<54:41, 1.24s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1360/4000 [29:23<54:58, 1.25s/it] {'loss': 0.1048, 'grad_norm': 0.8584260940551758, 'learning_rate': 7.875026260216393e-05}
34%|β–ˆβ–ˆβ–ˆβ– | 1360/4000 [29:23<54:58, 1.25s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1361/4000 [29:24<54:56, 1.25s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1362/4000 [29:25<54:36, 1.24s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1363/4000 [29:27<54:24, 1.24s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1364/4000 [29:28<53:53, 1.23s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1365/4000 [29:29<54:06, 1.23s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1366/4000 [29:30<53:37, 1.22s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1367/4000 [29:32<54:26, 1.24s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1368/4000 [29:33<55:03, 1.26s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1369/4000 [29:34<55:11, 1.26s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1370/4000 [29:35<54:44, 1.25s/it] {'loss': 0.0897, 'grad_norm': 0.9206819534301758, 'learning_rate': 7.841108746756382e-05}
34%|β–ˆβ–ˆβ–ˆβ– | 1370/4000 [29:35<54:44, 1.25s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1371/4000 [29:37<55:05, 1.26s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1372/4000 [29:38<54:21, 1.24s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1373/4000 [29:39<53:51, 1.23s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1374/4000 [29:40<53:50, 1.23s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1375/4000 [29:41<54:04, 1.24s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1376/4000 [29:43<53:52, 1.23s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1377/4000 [29:44<55:01, 1.26s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1378/4000 [29:45<54:36, 1.25s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1379/4000 [29:46<54:00, 1.24s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 1380/4000 [29:48<54:27, 1.25s/it] {'loss': 0.1066, 'grad_norm': 0.9224130511283875, 'learning_rate': 7.806997047287516e-05}
34%|β–ˆβ–ˆβ–ˆβ– | 1380/4000 [29:48<54:27, 1.25s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 1381/4000 [29:49<54:41, 1.25s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 1382/4000 [29:50<54:15, 1.24s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 1383/4000 [29:51<53:50, 1.23s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 1384/4000 [29:53<54:08, 1.24s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 1385/4000 [29:54<54:15, 1.24s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 1386/4000 [29:55<54:43, 1.26s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 1387/4000 [29:56<54:21, 1.25s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 1388/4000 [29:58<54:59, 1.26s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 1389/4000 [29:59<55:26, 1.27s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 1390/4000 [30:00<54:51, 1.26s/it] {'loss': 0.0979, 'grad_norm': 0.8540201783180237, 'learning_rate': 7.772693493299138e-05}
35%|β–ˆβ–ˆβ–ˆβ– | 1390/4000 [30:00<54:51, 1.26s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 1391/4000 [30:02<55:42, 1.28s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 1392/4000 [30:03<55:01, 1.27s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 1393/4000 [30:04<54:35, 1.26s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 1394/4000 [30:05<54:13, 1.25s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 1395/4000 [30:07<54:10, 1.25s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 1396/4000 [30:08<53:39, 1.24s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 1397/4000 [30:09<53:38, 1.24s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 1398/4000 [30:10<53:05, 1.22s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 1399/4000 [30:11<53:14, 1.23s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 1400/4000 [30:13<53:15, 1.23s/it] {'loss': 0.1116, 'grad_norm': 0.7645388841629028, 'learning_rate': 7.7382004293936e-05}
35%|β–ˆβ–ˆβ–ˆβ–Œ | 1400/4000 [30:13<53:15, 1.23s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 1401/4000 [30:14<53:28, 1.23s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 1402/4000 [30:15<54:31, 1.26s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 1403/4000 [30:16<54:21, 1.26s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 1404/4000 [30:18<54:38, 1.26s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 1405/4000 [30:19<54:30, 1.26s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 1406/4000 [30:20<54:15, 1.25s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 1407/4000 [30:22<54:50, 1.27s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 1408/4000 [30:23<53:58, 1.25s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 1409/4000 [30:24<53:19, 1.23s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 1410/4000 [30:25<53:09, 1.23s/it] {'loss': 0.0927, 'grad_norm': 0.8393447399139404, 'learning_rate': 7.703520213126e-05}
35%|β–ˆβ–ˆβ–ˆβ–Œ | 1410/4000 [30:25<53:09, 1.23s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 1411/4000 [30:26<53:37, 1.24s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 1412/4000 [30:28<52:59, 1.23s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 1413/4000 [30:29<53:14, 1.23s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 1414/4000 [30:30<52:59, 1.23s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 1415/4000 [30:31<53:12, 1.23s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 1416/4000 [30:33<54:21, 1.26s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 1417/4000 [30:34<54:15, 1.26s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 1418/4000 [30:35<53:36, 1.25s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 1419/4000 [30:36<54:34, 1.27s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1420/4000 [30:38<54:22, 1.26s/it] {'loss': 0.1098, 'grad_norm': 0.7384396195411682, 'learning_rate': 7.66865521484305e-05}
36%|β–ˆβ–ˆβ–ˆβ–Œ | 1420/4000 [30:38<54:22, 1.26s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1421/4000 [30:39<54:26, 1.27s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1422/4000 [30:40<54:12, 1.26s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1423/4000 [30:42<54:25, 1.27s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1424/4000 [30:43<54:32, 1.27s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1425/4000 [30:44<54:35, 1.27s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1426/4000 [30:45<54:20, 1.27s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1427/4000 [30:47<54:40, 1.28s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1428/4000 [30:48<54:20, 1.27s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1429/4000 [30:49<53:56, 1.26s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1430/4000 [30:50<54:10, 1.26s/it] {'loss': 0.1001, 'grad_norm': 0.7480459809303284, 'learning_rate': 7.633607817521074e-05}
36%|β–ˆβ–ˆβ–ˆβ–Œ | 1430/4000 [30:50<54:10, 1.26s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1431/4000 [30:52<54:21, 1.27s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1432/4000 [30:53<54:18, 1.27s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1433/4000 [30:54<54:21, 1.27s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1434/4000 [30:55<54:05, 1.26s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1435/4000 [30:57<54:21, 1.27s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1436/4000 [30:58<54:14, 1.27s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1437/4000 [30:59<54:08, 1.27s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1438/4000 [31:01<54:31, 1.28s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1439/4000 [31:02<54:17, 1.27s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1440/4000 [31:03<53:37, 1.26s/it] {'loss': 0.1041, 'grad_norm': 0.6709452271461487, 'learning_rate': 7.598380416603119e-05}
36%|β–ˆβ–ˆβ–ˆβ–Œ | 1440/4000 [31:03<53:37, 1.26s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1441/4000 [31:04<53:01, 1.24s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1442/4000 [31:06<52:59, 1.24s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1443/4000 [31:07<52:55, 1.24s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1444/4000 [31:08<53:00, 1.24s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1445/4000 [31:09<52:33, 1.23s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1446/4000 [31:10<52:17, 1.23s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1447/4000 [31:12<52:43, 1.24s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1448/4000 [31:13<52:42, 1.24s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 1449/4000 [31:14<53:04, 1.25s/it] 36%|β–ˆβ–ˆβ–ˆβ–‹ | 1450/4000 [31:15<53:29, 1.26s/it] {'loss': 0.107, 'grad_norm': 0.8840230107307434, 'learning_rate': 7.562975419835247e-05}
36%|β–ˆβ–ˆβ–ˆβ–‹ | 1450/4000 [31:15<53:29, 1.26s/it] 36%|β–ˆβ–ˆβ–ˆβ–‹ | 1451/4000 [31:17<52:44, 1.24s/it] 36%|β–ˆβ–ˆβ–ˆβ–‹ | 1452/4000 [31:18<52:46, 1.24s/it] 36%|β–ˆβ–ˆβ–ˆβ–‹ | 1453/4000 [31:19<52:37, 1.24s/it] 36%|β–ˆβ–ˆβ–ˆβ–‹ | 1454/4000 [31:20<52:43, 1.24s/it] 36%|β–ˆβ–ˆβ–ˆβ–‹ | 1455/4000 [31:22<52:20, 1.23s/it] 36%|β–ˆβ–ˆβ–ˆβ–‹ | 1456/4000 [31:23<52:15, 1.23s/it] 36%|β–ˆβ–ˆβ–ˆβ–‹ | 1457/4000 [31:24<52:26, 1.24s/it] 36%|β–ˆβ–ˆβ–ˆβ–‹ | 1458/4000 [31:25<53:11, 1.26s/it] 36%|β–ˆβ–ˆβ–ˆβ–‹ | 1459/4000 [31:27<53:22, 1.26s/it] 36%|β–ˆβ–ˆβ–ˆβ–‹ | 1460/4000 [31:28<52:51, 1.25s/it] {'loss': 0.0984, 'grad_norm': 0.6924894452095032, 'learning_rate': 7.527395247101956e-05}
36%|β–ˆβ–ˆβ–ˆβ–‹ | 1460/4000 [31:28<52:51, 1.25s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1461/4000 [31:29<52:07, 1.23s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1462/4000 [31:30<52:16, 1.24s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1463/4000 [31:32<52:33, 1.24s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1464/4000 [31:33<53:08, 1.26s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1465/4000 [31:34<53:04, 1.26s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1466/4000 [31:35<52:24, 1.24s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1467/4000 [31:37<52:27, 1.24s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1468/4000 [31:38<52:36, 1.25s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1469/4000 [31:39<52:07, 1.24s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1470/4000 [31:40<51:54, 1.23s/it] {'loss': 0.1057, 'grad_norm': 0.8894215822219849, 'learning_rate': 7.491642330260789e-05}
37%|β–ˆβ–ˆβ–ˆβ–‹ | 1470/4000 [31:40<51:54, 1.23s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1471/4000 [31:42<52:02, 1.23s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1472/4000 [31:43<52:07, 1.24s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1473/4000 [31:44<52:08, 1.24s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1474/4000 [31:45<52:24, 1.24s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1475/4000 [31:46<52:19, 1.24s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1476/4000 [31:48<51:59, 1.24s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1477/4000 [31:49<52:47, 1.26s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1478/4000 [31:50<52:48, 1.26s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1479/4000 [31:51<52:11, 1.24s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1480/4000 [31:53<51:45, 1.23s/it] {'loss': 0.1109, 'grad_norm': 0.885202169418335, 'learning_rate': 7.45571911297612e-05}
37%|β–ˆβ–ˆβ–ˆβ–‹ | 1480/4000 [31:53<51:45, 1.23s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1481/4000 [31:54<51:50, 1.23s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1482/4000 [31:55<52:13, 1.24s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1483/4000 [31:56<51:45, 1.23s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1484/4000 [31:58<52:11, 1.24s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1485/4000 [31:59<52:24, 1.25s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1486/4000 [32:00<52:45, 1.26s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1487/4000 [32:01<52:10, 1.25s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1488/4000 [32:03<52:14, 1.25s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1489/4000 [32:04<52:09, 1.25s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1490/4000 [32:05<52:16, 1.25s/it] {'loss': 0.0978, 'grad_norm': 0.8137795329093933, 'learning_rate': 7.419628050552131e-05}
37%|β–ˆβ–ˆβ–ˆβ–‹ | 1490/4000 [32:05<52:16, 1.25s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1491/4000 [32:07<53:09, 1.27s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1492/4000 [32:08<52:49, 1.26s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1493/4000 [32:09<52:17, 1.25s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1494/4000 [32:10<52:28, 1.26s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1495/4000 [32:12<53:23, 1.28s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1496/4000 [32:13<53:17, 1.28s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1497/4000 [32:14<52:19, 1.25s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1498/4000 [32:15<51:51, 1.24s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 1499/4000 [32:16<51:17, 1.23s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1500/4000 [32:18<51:44, 1.24s/it] {'loss': 0.1188, 'grad_norm': 0.7522609829902649, 'learning_rate': 7.383371609764999e-05}
38%|β–ˆβ–ˆβ–ˆβ–Š | 1500/4000 [32:18<51:44, 1.24s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1501/4000 [32:19<52:04, 1.25s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1502/4000 [32:20<51:28, 1.24s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1503/4000 [32:21<51:09, 1.23s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1504/4000 [32:23<50:55, 1.22s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1505/4000 [32:24<51:08, 1.23s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1506/4000 [32:25<51:23, 1.24s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1507/4000 [32:26<51:36, 1.24s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1508/4000 [32:28<51:36, 1.24s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1509/4000 [32:29<51:46, 1.25s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1510/4000 [32:30<52:11, 1.26s/it] {'loss': 0.1032, 'grad_norm': 0.7614437937736511, 'learning_rate': 7.346952268694288e-05}
38%|β–ˆβ–ˆβ–ˆβ–Š | 1510/4000 [32:30<52:11, 1.26s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1511/4000 [32:31<53:00, 1.28s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1512/4000 [32:33<53:04, 1.28s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1513/4000 [32:34<52:20, 1.26s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1514/4000 [32:35<52:24, 1.26s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1515/4000 [32:37<51:57, 1.25s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1516/4000 [32:38<51:47, 1.25s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1517/4000 [32:39<51:42, 1.25s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1518/4000 [32:40<51:41, 1.25s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1519/4000 [32:41<51:13, 1.24s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1520/4000 [32:43<51:03, 1.24s/it] {'loss': 0.1061, 'grad_norm': 0.8275572657585144, 'learning_rate': 7.310372516553585e-05}
38%|β–ˆβ–ˆβ–ˆβ–Š | 1520/4000 [32:43<51:03, 1.24s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1521/4000 [32:44<50:42, 1.23s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1522/4000 [32:45<51:09, 1.24s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1523/4000 [32:46<51:58, 1.26s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1524/4000 [32:48<52:00, 1.26s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1525/4000 [32:49<52:32, 1.27s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1526/4000 [32:50<53:00, 1.29s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1527/4000 [32:52<53:18, 1.29s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1528/4000 [32:53<52:56, 1.28s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1529/4000 [32:54<52:23, 1.27s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1530/4000 [32:55<52:35, 1.28s/it] {'loss': 0.1048, 'grad_norm': 0.8231189846992493, 'learning_rate': 7.273634853520356e-05}
38%|β–ˆβ–ˆβ–ˆβ–Š | 1530/4000 [32:55<52:35, 1.28s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1531/4000 [32:57<52:48, 1.28s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1532/4000 [32:58<52:10, 1.27s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1533/4000 [32:59<52:26, 1.28s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1534/4000 [33:01<51:57, 1.26s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1535/4000 [33:02<51:49, 1.26s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1536/4000 [33:03<51:11, 1.25s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1537/4000 [33:04<51:18, 1.25s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1538/4000 [33:05<50:54, 1.24s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1539/4000 [33:07<51:14, 1.25s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 1540/4000 [33:08<51:20, 1.25s/it] {'loss': 0.1106, 'grad_norm': 0.7540761232376099, 'learning_rate': 7.236741790565072e-05}
38%|β–ˆβ–ˆβ–ˆβ–Š | 1540/4000 [33:08<51:20, 1.25s/it] 39%|β–ˆβ–ˆβ–ˆβ–Š | 1541/4000 [33:09<51:30, 1.26s/it] 39%|β–ˆβ–ˆβ–ˆβ–Š | 1542/4000 [33:10<51:16, 1.25s/it] 39%|β–ˆβ–ˆβ–ˆβ–Š | 1543/4000 [33:12<50:52, 1.24s/it] 39%|β–ˆβ–ˆβ–ˆβ–Š | 1544/4000 [33:13<50:50, 1.24s/it] 39%|β–ˆβ–ˆβ–ˆβ–Š | 1545/4000 [33:14<50:50, 1.24s/it] 39%|β–ˆβ–ˆβ–ˆβ–Š | 1546/4000 [33:15<50:45, 1.24s/it] 39%|β–ˆβ–ˆβ–ˆβ–Š | 1547/4000 [33:17<51:02, 1.25s/it] 39%|β–ˆβ–ˆβ–ˆβ–Š | 1548/4000 [33:18<50:48, 1.24s/it] 39%|β–ˆβ–ˆβ–ˆβ–Š | 1549/4000 [33:19<51:21, 1.26s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1550/4000 [33:20<51:18, 1.26s/it] {'loss': 0.1017, 'grad_norm': 0.7535039782524109, 'learning_rate': 7.199695849279576e-05}
39%|β–ˆβ–ˆβ–ˆβ–‰ | 1550/4000 [33:20<51:18, 1.26s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1551/4000 [33:22<50:52, 1.25s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1552/4000 [33:23<51:09, 1.25s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1553/4000 [33:24<51:17, 1.26s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1554/4000 [33:25<51:05, 1.25s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1555/4000 [33:27<51:09, 1.26s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1556/4000 [33:28<51:20, 1.26s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1557/4000 [33:29<51:15, 1.26s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1558/4000 [33:30<50:43, 1.25s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1559/4000 [33:32<50:38, 1.24s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1560/4000 [33:33<51:17, 1.26s/it] {'loss': 0.0998, 'grad_norm': 0.7004891037940979, 'learning_rate': 7.162499561704747e-05}
39%|β–ˆβ–ˆβ–ˆβ–‰ | 1560/4000 [33:33<51:17, 1.26s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1561/4000 [33:34<51:40, 1.27s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1562/4000 [33:36<52:04, 1.28s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1563/4000 [33:37<51:23, 1.27s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1564/4000 [33:38<51:37, 1.27s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1565/4000 [33:39<51:11, 1.26s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1566/4000 [33:41<50:45, 1.25s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1567/4000 [33:42<51:46, 1.28s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1568/4000 [33:43<50:50, 1.25s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1569/4000 [33:44<50:14, 1.24s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1570/4000 [33:46<50:28, 1.25s/it] {'loss': 0.0944, 'grad_norm': 0.7144633531570435, 'learning_rate': 7.125155470157429e-05}
39%|β–ˆβ–ˆβ–ˆβ–‰ | 1570/4000 [33:46<50:28, 1.25s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1571/4000 [33:47<49:49, 1.23s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1572/4000 [33:48<50:11, 1.24s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1573/4000 [33:49<49:54, 1.23s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1574/4000 [33:51<50:26, 1.25s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1575/4000 [33:52<50:47, 1.26s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1576/4000 [33:53<50:12, 1.24s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1577/4000 [33:54<50:42, 1.26s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1578/4000 [33:56<50:36, 1.25s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 1579/4000 [33:57<50:16, 1.25s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 1580/4000 [33:58<50:36, 1.25s/it] {'loss': 0.0912, 'grad_norm': 0.793429970741272, 'learning_rate': 7.087666127056675e-05}
40%|β–ˆβ–ˆβ–ˆβ–‰ | 1580/4000 [33:58<50:36, 1.25s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 1581/4000 [33:59<51:12, 1.27s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 1582/4000 [34:01<50:56, 1.26s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 1583/4000 [34:02<50:17, 1.25s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 1584/4000 [34:03<49:54, 1.24s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 1585/4000 [34:04<50:09, 1.25s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 1586/4000 [34:06<50:16, 1.25s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 1587/4000 [34:07<50:13, 1.25s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 1588/4000 [34:08<50:31, 1.26s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 1589/4000 [34:09<50:23, 1.25s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 1590/4000 [34:11<50:07, 1.25s/it] {'loss': 0.0995, 'grad_norm': 0.8257138133049011, 'learning_rate': 7.050034094749286e-05}
40%|β–ˆβ–ˆβ–ˆβ–‰ | 1590/4000 [34:11<50:07, 1.25s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 1591/4000 [34:12<50:26, 1.26s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 1592/4000 [34:13<50:09, 1.25s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 1593/4000 [34:14<50:59, 1.27s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 1594/4000 [34:16<50:16, 1.25s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 1595/4000 [34:17<50:34, 1.26s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 1596/4000 [34:18<49:55, 1.25s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 1597/4000 [34:19<49:50, 1.24s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 1598/4000 [34:21<50:31, 1.26s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 1599/4000 [34:22<50:27, 1.26s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1600/4000 [34:23<50:20, 1.26s/it] {'loss': 0.1001, 'grad_norm': 0.7498629689216614, 'learning_rate': 7.012261945334683e-05}
40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1600/4000 [34:23<50:20, 1.26s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1601/4000 [34:24<50:29, 1.26s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1602/4000 [34:26<50:25, 1.26s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1603/4000 [34:27<49:55, 1.25s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1604/4000 [34:28<49:48, 1.25s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1605/4000 [34:29<49:13, 1.23s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1606/4000 [34:31<52:13, 1.31s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1607/4000 [34:32<51:26, 1.29s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1608/4000 [34:33<52:02, 1.31s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1609/4000 [34:35<52:30, 1.32s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1610/4000 [34:36<51:50, 1.30s/it] {'loss': 0.0882, 'grad_norm': 0.7398989796638489, 'learning_rate': 6.974352260489103e-05}
40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1610/4000 [34:36<51:50, 1.30s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1611/4000 [34:37<51:08, 1.28s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1612/4000 [34:39<53:29, 1.34s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1613/4000 [34:40<51:45, 1.30s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1614/4000 [34:41<51:33, 1.30s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1615/4000 [34:43<51:05, 1.29s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1616/4000 [34:44<50:05, 1.26s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1617/4000 [34:45<50:07, 1.26s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1618/4000 [34:46<49:36, 1.25s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1619/4000 [34:48<49:48, 1.26s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1620/4000 [34:49<49:45, 1.25s/it] {'loss': 0.087, 'grad_norm': 0.6956419348716736, 'learning_rate': 6.936307631289148e-05}
40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1620/4000 [34:49<49:45, 1.25s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1621/4000 [34:50<49:26, 1.25s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1622/4000 [34:51<50:17, 1.27s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1623/4000 [34:53<49:56, 1.26s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1624/4000 [34:54<49:45, 1.26s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1625/4000 [34:55<49:24, 1.25s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1626/4000 [34:56<49:20, 1.25s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1627/4000 [34:58<49:46, 1.26s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1628/4000 [34:59<48:59, 1.24s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1629/4000 [35:00<49:58, 1.26s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1630/4000 [35:01<50:27, 1.28s/it] {'loss': 0.0911, 'grad_norm': 0.7167057394981384, 'learning_rate': 6.898130658034685e-05}
41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1630/4000 [35:01<50:27, 1.28s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1631/4000 [35:03<50:27, 1.28s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1632/4000 [35:04<50:26, 1.28s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1633/4000 [35:05<50:15, 1.27s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1634/4000 [35:06<49:35, 1.26s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1635/4000 [35:08<49:00, 1.24s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1636/4000 [35:09<48:38, 1.23s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1637/4000 [35:10<49:30, 1.26s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1638/4000 [35:11<50:03, 1.27s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1639/4000 [35:13<50:05, 1.27s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1640/4000 [35:14<49:22, 1.26s/it] {'loss': 0.0981, 'grad_norm': 0.8481744527816772, 'learning_rate': 6.859823950071127e-05}
41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1640/4000 [35:14<49:22, 1.26s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1641/4000 [35:15<48:45, 1.24s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1642/4000 [35:16<49:11, 1.25s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1643/4000 [35:18<49:14, 1.25s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1644/4000 [35:19<48:45, 1.24s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1645/4000 [35:20<49:20, 1.26s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1646/4000 [35:21<49:08, 1.25s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1647/4000 [35:23<49:20, 1.26s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1648/4000 [35:24<48:46, 1.24s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 1649/4000 [35:25<48:47, 1.25s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1650/4000 [35:26<48:33, 1.24s/it] {'loss': 0.1081, 'grad_norm': 0.8338947296142578, 'learning_rate': 6.821390125611078e-05}
41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1650/4000 [35:26<48:33, 1.24s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1651/4000 [35:28<49:00, 1.25s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1652/4000 [35:29<48:37, 1.24s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1653/4000 [35:30<48:25, 1.24s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1654/4000 [35:31<48:29, 1.24s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1655/4000 [35:33<49:10, 1.26s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1656/4000 [35:34<48:48, 1.25s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1657/4000 [35:35<48:48, 1.25s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1658/4000 [35:36<48:05, 1.23s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1659/4000 [35:38<48:25, 1.24s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1660/4000 [35:39<48:04, 1.23s/it] {'loss': 0.0808, 'grad_norm': 0.747245192527771, 'learning_rate': 6.782831811555385e-05}
42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1660/4000 [35:39<48:04, 1.23s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1661/4000 [35:40<48:06, 1.23s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1662/4000 [35:41<48:49, 1.25s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1663/4000 [35:43<48:31, 1.25s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1664/4000 [35:44<48:05, 1.24s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1665/4000 [35:45<48:04, 1.24s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1666/4000 [35:46<48:35, 1.25s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1667/4000 [35:48<48:04, 1.24s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1668/4000 [35:49<47:51, 1.23s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1669/4000 [35:50<48:19, 1.24s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1670/4000 [35:51<48:18, 1.24s/it] {'loss': 0.0961, 'grad_norm': 0.8679952025413513, 'learning_rate': 6.744151643313597e-05}
42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1670/4000 [35:51<48:18, 1.24s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1671/4000 [35:52<47:46, 1.23s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1672/4000 [35:54<48:00, 1.24s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1673/4000 [35:55<48:22, 1.25s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1674/4000 [35:56<47:59, 1.24s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1675/4000 [35:57<47:39, 1.23s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1676/4000 [35:59<47:35, 1.23s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1677/4000 [36:00<48:21, 1.25s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1678/4000 [36:01<48:03, 1.24s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1679/4000 [36:02<48:56, 1.27s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1680/4000 [36:04<48:29, 1.25s/it] {'loss': 0.1012, 'grad_norm': 0.7295148968696594, 'learning_rate': 6.705352264623828e-05}
42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1680/4000 [36:04<48:29, 1.25s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1681/4000 [36:05<48:02, 1.24s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1682/4000 [36:06<47:34, 1.23s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1683/4000 [36:07<47:49, 1.24s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1684/4000 [36:09<47:52, 1.24s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1685/4000 [36:10<47:40, 1.24s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1686/4000 [36:11<47:44, 1.24s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1687/4000 [36:12<47:18, 1.23s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1688/4000 [36:14<48:03, 1.25s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1689/4000 [36:15<48:07, 1.25s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1690/4000 [36:16<48:47, 1.27s/it] {'loss': 0.0993, 'grad_norm': 0.8597823977470398, 'learning_rate': 6.666436327372078e-05}
42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1690/4000 [36:16<48:47, 1.27s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1691/4000 [36:17<48:39, 1.26s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1692/4000 [36:19<48:51, 1.27s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1693/4000 [36:20<48:48, 1.27s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1694/4000 [36:21<48:37, 1.27s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1695/4000 [36:22<48:27, 1.26s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1696/4000 [36:24<48:14, 1.26s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1697/4000 [36:25<48:08, 1.25s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1698/4000 [36:26<48:05, 1.25s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1699/4000 [36:27<48:01, 1.25s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1700/4000 [36:29<47:45, 1.25s/it] {'loss': 0.0924, 'grad_norm': 0.7090704441070557, 'learning_rate': 6.62740649141096e-05}
42%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1700/4000 [36:29<47:45, 1.25s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1701/4000 [36:30<47:23, 1.24s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1702/4000 [36:31<47:24, 1.24s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1703/4000 [36:32<48:24, 1.26s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1704/4000 [36:34<47:46, 1.25s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1705/4000 [36:35<47:34, 1.24s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1706/4000 [36:36<47:32, 1.24s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1707/4000 [36:37<47:46, 1.25s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1708/4000 [36:39<47:31, 1.24s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1709/4000 [36:40<47:33, 1.25s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1710/4000 [36:41<47:30, 1.24s/it] {'loss': 0.0954, 'grad_norm': 0.7590832114219666, 'learning_rate': 6.588265424377919e-05}
43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1710/4000 [36:41<47:30, 1.24s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1711/4000 [36:42<47:26, 1.24s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1712/4000 [36:44<47:32, 1.25s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1713/4000 [36:45<47:54, 1.26s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1714/4000 [36:46<47:27, 1.25s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1715/4000 [36:47<47:59, 1.26s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1716/4000 [36:49<48:59, 1.29s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1717/4000 [36:50<49:10, 1.29s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1718/4000 [36:51<48:21, 1.27s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1719/4000 [36:53<47:58, 1.26s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1720/4000 [36:54<47:21, 1.25s/it] {'loss': 0.1021, 'grad_norm': 0.7457488179206848, 'learning_rate': 6.549015801512895e-05}
43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1720/4000 [36:54<47:21, 1.25s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1721/4000 [36:55<47:22, 1.25s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1722/4000 [36:56<47:28, 1.25s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1723/4000 [36:58<47:51, 1.26s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1724/4000 [36:59<47:46, 1.26s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1725/4000 [37:00<47:39, 1.26s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1726/4000 [37:01<48:28, 1.28s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1727/4000 [37:03<48:12, 1.27s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1728/4000 [37:04<48:10, 1.27s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1729/4000 [37:05<47:16, 1.25s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1730/4000 [37:06<47:12, 1.25s/it] {'loss': 0.0986, 'grad_norm': 0.7123929858207703, 'learning_rate': 6.509660305475468e-05}
43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1730/4000 [37:06<47:12, 1.25s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1731/4000 [37:08<46:42, 1.24s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1732/4000 [37:09<46:18, 1.23s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1733/4000 [37:10<46:38, 1.23s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1734/4000 [37:11<46:11, 1.22s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1735/4000 [37:12<46:38, 1.24s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1736/4000 [37:14<46:51, 1.24s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1737/4000 [37:15<46:31, 1.23s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1738/4000 [37:16<46:20, 1.23s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1739/4000 [37:17<46:15, 1.23s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1740/4000 [37:19<46:35, 1.24s/it] {'loss': 0.0906, 'grad_norm': 0.6542084813117981, 'learning_rate': 6.47020162616152e-05}
44%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1740/4000 [37:19<46:35, 1.24s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1741/4000 [37:20<46:33, 1.24s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1742/4000 [37:21<46:59, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1743/4000 [37:22<47:27, 1.26s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1744/4000 [37:24<47:16, 1.26s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1745/4000 [37:25<46:58, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1746/4000 [37:26<47:09, 1.26s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1747/4000 [37:27<46:30, 1.24s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1748/4000 [37:29<46:49, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1749/4000 [37:30<46:43, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1750/4000 [37:31<46:30, 1.24s/it] {'loss': 0.0953, 'grad_norm': 0.7449278831481934, 'learning_rate': 6.430642460519365e-05}
44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1750/4000 [37:31<46:30, 1.24s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1751/4000 [37:32<46:43, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1752/4000 [37:34<46:49, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1753/4000 [37:35<47:15, 1.26s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1754/4000 [37:36<47:05, 1.26s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1755/4000 [37:37<46:55, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1756/4000 [37:39<46:55, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1757/4000 [37:40<46:43, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1758/4000 [37:41<46:47, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1759/4000 [37:42<46:48, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1760/4000 [37:44<46:53, 1.26s/it] {'loss': 0.1001, 'grad_norm': 0.7652945518493652, 'learning_rate': 6.390985512365426e-05}
44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1760/4000 [37:44<46:53, 1.26s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1761/4000 [37:45<47:07, 1.26s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1762/4000 [37:46<47:05, 1.26s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1763/4000 [37:47<46:33, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1764/4000 [37:49<46:33, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1765/4000 [37:50<46:36, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1766/4000 [37:51<46:58, 1.26s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1767/4000 [37:52<46:15, 1.24s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1768/4000 [37:54<46:29, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1769/4000 [37:55<47:11, 1.27s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1770/4000 [37:56<46:36, 1.25s/it] {'loss': 0.096, 'grad_norm': 0.6740763187408447, 'learning_rate': 6.351233492199431e-05}
44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1770/4000 [37:56<46:36, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1771/4000 [37:58<46:36, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1772/4000 [37:59<46:31, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1773/4000 [38:00<46:28, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1774/4000 [38:01<46:46, 1.26s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1775/4000 [38:03<46:42, 1.26s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1776/4000 [38:04<46:28, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1777/4000 [38:05<46:12, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1778/4000 [38:06<46:29, 1.26s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1779/4000 [38:08<46:11, 1.25s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1780/4000 [38:09<45:49, 1.24s/it] {'loss': 0.093, 'grad_norm': 0.778555154800415, 'learning_rate': 6.311389117019155e-05}
44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1780/4000 [38:09<45:49, 1.24s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1781/4000 [38:10<45:44, 1.24s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1782/4000 [38:11<45:38, 1.23s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1783/4000 [38:12<45:36, 1.23s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1784/4000 [38:14<46:08, 1.25s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1785/4000 [38:15<45:47, 1.24s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1786/4000 [38:16<45:38, 1.24s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1787/4000 [38:17<45:48, 1.24s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1788/4000 [38:19<46:11, 1.25s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1789/4000 [38:20<45:49, 1.24s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1790/4000 [38:21<45:50, 1.24s/it] {'loss': 0.0992, 'grad_norm': 0.7417019605636597, 'learning_rate': 6.271455110134713e-05}
45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1790/4000 [38:21<45:50, 1.24s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1791/4000 [38:22<45:45, 1.24s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1792/4000 [38:24<45:28, 1.24s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1793/4000 [38:25<46:11, 1.26s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1794/4000 [38:26<45:58, 1.25s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1795/4000 [38:28<46:47, 1.27s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1796/4000 [38:29<46:22, 1.26s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1797/4000 [38:30<46:03, 1.25s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1798/4000 [38:31<46:13, 1.26s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 1799/4000 [38:33<46:34, 1.27s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1800/4000 [38:34<46:29, 1.27s/it] {'loss': 0.0946, 'grad_norm': 0.7238601446151733, 'learning_rate': 6.231434200982428e-05}
45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1800/4000 [38:34<46:29, 1.27s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1801/4000 [38:35<46:11, 1.26s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1802/4000 [38:36<46:09, 1.26s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1803/4000 [38:38<47:03, 1.28s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1804/4000 [38:39<47:18, 1.29s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1805/4000 [38:40<47:38, 1.30s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1806/4000 [38:42<47:52, 1.31s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1807/4000 [38:43<47:50, 1.31s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1808/4000 [38:44<46:51, 1.28s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1809/4000 [38:45<46:41, 1.28s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1810/4000 [38:47<46:40, 1.28s/it] {'loss': 0.0933, 'grad_norm': 0.7164081335067749, 'learning_rate': 6.191329124938285e-05}
45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1810/4000 [38:47<46:40, 1.28s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1811/4000 [38:48<46:35, 1.28s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1812/4000 [38:49<46:33, 1.28s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1813/4000 [38:50<45:53, 1.26s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1814/4000 [38:52<46:39, 1.28s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1815/4000 [38:53<46:40, 1.28s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1816/4000 [38:54<45:56, 1.26s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1817/4000 [38:56<45:51, 1.26s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1818/4000 [38:57<46:16, 1.27s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1819/4000 [38:58<46:05, 1.27s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1820/4000 [38:59<45:26, 1.25s/it] {'loss': 0.0852, 'grad_norm': 0.7380068302154541, 'learning_rate': 6.15114262313095e-05}
46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1820/4000 [38:59<45:26, 1.25s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1821/4000 [39:01<45:15, 1.25s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1822/4000 [39:02<45:38, 1.26s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1823/4000 [39:03<45:52, 1.26s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1824/4000 [39:04<45:29, 1.25s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1825/4000 [39:06<46:05, 1.27s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1826/4000 [39:07<46:30, 1.28s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1827/4000 [39:08<46:15, 1.28s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1828/4000 [39:09<45:30, 1.26s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1829/4000 [39:11<45:05, 1.25s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1830/4000 [39:12<45:23, 1.26s/it] {'loss': 0.0903, 'grad_norm': 0.7099688053131104, 'learning_rate': 6.110877442254444e-05}
46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1830/4000 [39:12<45:23, 1.26s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1831/4000 [39:13<45:19, 1.25s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1832/4000 [39:14<45:31, 1.26s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1833/4000 [39:16<45:03, 1.25s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1834/4000 [39:17<44:59, 1.25s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1835/4000 [39:18<45:42, 1.27s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1836/4000 [39:20<46:13, 1.28s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1837/4000 [39:21<45:36, 1.27s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1838/4000 [39:22<45:03, 1.25s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1839/4000 [39:23<44:56, 1.25s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1840/4000 [39:25<45:12, 1.26s/it] {'loss': 0.0882, 'grad_norm': 0.8132402300834656, 'learning_rate': 6.0705363343803946e-05}
46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1840/4000 [39:25<45:12, 1.26s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1841/4000 [39:26<45:31, 1.27s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1842/4000 [39:27<45:56, 1.28s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1843/4000 [39:28<46:01, 1.28s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1844/4000 [39:30<45:44, 1.27s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1845/4000 [39:31<47:26, 1.32s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1846/4000 [39:32<46:26, 1.29s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1847/4000 [39:34<46:02, 1.28s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1848/4000 [39:35<46:19, 1.29s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1849/4000 [39:36<45:34, 1.27s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1850/4000 [39:37<45:13, 1.26s/it] {'loss': 0.0922, 'grad_norm': 0.6146010160446167, 'learning_rate': 6.030122056769934e-05}
46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1850/4000 [39:37<45:13, 1.26s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1851/4000 [39:39<44:38, 1.25s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1852/4000 [39:40<46:55, 1.31s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1853/4000 [39:41<45:40, 1.28s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1854/4000 [39:43<45:40, 1.28s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1855/4000 [39:44<44:56, 1.26s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1856/4000 [39:45<44:41, 1.25s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1857/4000 [39:46<44:57, 1.26s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1858/4000 [39:47<44:48, 1.26s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1859/4000 [39:49<44:50, 1.26s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1860/4000 [39:50<44:23, 1.24s/it] {'loss': 0.1024, 'grad_norm': 0.8359696865081787, 'learning_rate': 5.989637371685257e-05}
46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1860/4000 [39:50<44:23, 1.24s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1861/4000 [39:51<44:39, 1.25s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1862/4000 [39:52<44:48, 1.26s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1863/4000 [39:54<44:42, 1.26s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1864/4000 [39:55<44:29, 1.25s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1865/4000 [39:56<44:42, 1.26s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1866/4000 [39:58<45:15, 1.27s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1867/4000 [39:59<44:56, 1.26s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1868/4000 [40:00<44:54, 1.26s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1869/4000 [40:01<45:38, 1.29s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1870/4000 [40:03<45:39, 1.29s/it] {'loss': 0.0987, 'grad_norm': 0.6660375595092773, 'learning_rate': 5.949085046200808e-05}
47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1870/4000 [40:03<45:39, 1.29s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1871/4000 [40:04<44:54, 1.27s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1872/4000 [40:05<44:17, 1.25s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1873/4000 [40:06<44:15, 1.25s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1874/4000 [40:08<43:55, 1.24s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1875/4000 [40:09<43:37, 1.23s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1876/4000 [40:10<44:22, 1.25s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1877/4000 [40:11<44:20, 1.25s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1878/4000 [40:13<44:19, 1.25s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1879/4000 [40:14<44:17, 1.25s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1880/4000 [40:15<44:10, 1.25s/it] {'loss': 0.0823, 'grad_norm': 0.8178691267967224, 'learning_rate': 5.908467852014169e-05}
47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1880/4000 [40:15<44:10, 1.25s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1881/4000 [40:16<44:08, 1.25s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1882/4000 [40:18<43:37, 1.24s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1883/4000 [40:19<43:22, 1.23s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1884/4000 [40:20<43:28, 1.23s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1885/4000 [40:21<43:05, 1.22s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1886/4000 [40:22<43:12, 1.23s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1887/4000 [40:24<42:56, 1.22s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1888/4000 [40:25<43:22, 1.23s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1889/4000 [40:26<43:08, 1.23s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1890/4000 [40:27<43:20, 1.23s/it] {'loss': 0.0775, 'grad_norm': 0.6395033597946167, 'learning_rate': 5.867788565256607e-05}
47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1890/4000 [40:27<43:20, 1.23s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1891/4000 [40:29<43:39, 1.24s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1892/4000 [40:30<43:47, 1.25s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1893/4000 [40:31<43:47, 1.25s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1894/4000 [40:32<44:06, 1.26s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1895/4000 [40:34<43:46, 1.25s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1896/4000 [40:35<43:54, 1.25s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1897/4000 [40:36<43:34, 1.24s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1898/4000 [40:37<43:18, 1.24s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1899/4000 [40:39<43:23, 1.24s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1900/4000 [40:40<43:33, 1.24s/it] {'loss': 0.102, 'grad_norm': 0.7695762515068054, 'learning_rate': 5.827049966303335e-05}
48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1900/4000 [40:40<43:33, 1.24s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1901/4000 [40:41<43:40, 1.25s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1902/4000 [40:42<43:40, 1.25s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1903/4000 [40:44<43:44, 1.25s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1904/4000 [40:45<43:49, 1.25s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1905/4000 [40:46<43:49, 1.26s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1906/4000 [40:47<43:28, 1.25s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1907/4000 [40:49<43:28, 1.25s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1908/4000 [40:50<45:04, 1.29s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1909/4000 [40:51<44:27, 1.28s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1910/4000 [40:52<44:01, 1.26s/it] {'loss': 0.095, 'grad_norm': 0.6618279218673706, 'learning_rate': 5.786254839583478e-05}
48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1910/4000 [40:52<44:01, 1.26s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1911/4000 [40:54<44:11, 1.27s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1912/4000 [40:55<44:13, 1.27s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1913/4000 [40:56<43:24, 1.25s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1914/4000 [40:57<43:25, 1.25s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1915/4000 [40:59<42:56, 1.24s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1916/4000 [41:00<42:42, 1.23s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1917/4000 [41:01<43:06, 1.24s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1918/4000 [41:02<43:44, 1.26s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1919/4000 [41:04<43:32, 1.26s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1920/4000 [41:05<43:30, 1.25s/it] {'loss': 0.0915, 'grad_norm': 0.915067732334137, 'learning_rate': 5.745405973389757e-05}
48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1920/4000 [41:05<43:30, 1.25s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1921/4000 [41:06<43:07, 1.24s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1922/4000 [41:07<43:19, 1.25s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1923/4000 [41:09<42:50, 1.24s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1924/4000 [41:10<42:42, 1.23s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1925/4000 [41:11<43:16, 1.25s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1926/4000 [41:12<43:04, 1.25s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1927/4000 [41:14<43:26, 1.26s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1928/4000 [41:15<43:27, 1.26s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1929/4000 [41:16<43:20, 1.26s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1930/4000 [41:17<42:56, 1.24s/it] {'loss': 0.0914, 'grad_norm': 0.6684195399284363, 'learning_rate': 5.7045061596879134e-05}
48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1930/4000 [41:17<42:56, 1.24s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1931/4000 [41:19<42:34, 1.23s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1932/4000 [41:20<43:22, 1.26s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1933/4000 [41:21<43:08, 1.25s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1934/4000 [41:22<43:07, 1.25s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1935/4000 [41:24<43:07, 1.25s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1936/4000 [41:25<43:06, 1.25s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1937/4000 [41:26<43:12, 1.26s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1938/4000 [41:27<43:10, 1.26s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1939/4000 [41:29<43:05, 1.25s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1940/4000 [41:30<42:54, 1.25s/it] {'loss': 0.0943, 'grad_norm': 0.8046242594718933, 'learning_rate': 5.6635581939258855e-05}
48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1940/4000 [41:30<42:54, 1.25s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1941/4000 [41:31<42:58, 1.25s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1942/4000 [41:32<43:04, 1.26s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1943/4000 [41:34<43:02, 1.26s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1944/4000 [41:35<43:48, 1.28s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1945/4000 [41:36<43:27, 1.27s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1946/4000 [41:38<43:16, 1.26s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1947/4000 [41:39<43:02, 1.26s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1948/4000 [41:40<42:26, 1.24s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1949/4000 [41:41<42:07, 1.23s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1950/4000 [41:42<41:42, 1.22s/it] {'loss': 0.0939, 'grad_norm': 0.6853575706481934, 'learning_rate': 5.622564874842742e-05}
49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1950/4000 [41:42<41:42, 1.22s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1951/4000 [41:44<42:14, 1.24s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1952/4000 [41:45<43:04, 1.26s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1953/4000 [41:46<42:39, 1.25s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1954/4000 [41:47<42:24, 1.24s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1955/4000 [41:49<42:29, 1.25s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1956/4000 [41:50<42:17, 1.24s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1957/4000 [41:51<42:51, 1.26s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1958/4000 [41:52<42:28, 1.25s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1959/4000 [41:54<42:04, 1.24s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1960/4000 [41:55<41:47, 1.23s/it] {'loss': 0.0772, 'grad_norm': 0.6912455558776855, 'learning_rate': 5.5815290042773836e-05}
49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1960/4000 [41:55<41:47, 1.23s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1961/4000 [41:56<41:55, 1.23s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1962/4000 [41:57<42:03, 1.24s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1963/4000 [41:59<41:49, 1.23s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1964/4000 [42:00<42:22, 1.25s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1965/4000 [42:01<42:38, 1.26s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1966/4000 [42:02<43:04, 1.27s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1967/4000 [42:04<42:29, 1.25s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1968/4000 [42:05<42:11, 1.25s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1969/4000 [42:06<42:19, 1.25s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1970/4000 [42:07<42:18, 1.25s/it] {'loss': 0.1015, 'grad_norm': 0.7216386198997498, 'learning_rate': 5.540453386977058e-05}
49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1970/4000 [42:07<42:18, 1.25s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1971/4000 [42:09<41:41, 1.23s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1972/4000 [42:10<41:19, 1.22s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1973/4000 [42:11<41:35, 1.23s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1974/4000 [42:12<41:27, 1.23s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1975/4000 [42:14<41:25, 1.23s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1976/4000 [42:15<42:13, 1.25s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1977/4000 [42:16<42:34, 1.26s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1978/4000 [42:17<42:05, 1.25s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1979/4000 [42:19<42:21, 1.26s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1980/4000 [42:20<42:28, 1.26s/it] {'loss': 0.1022, 'grad_norm': 0.6252928376197815, 'learning_rate': 5.4993408304056425e-05}
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1980/4000 [42:20<42:28, 1.26s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1981/4000 [42:21<42:32, 1.26s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1982/4000 [42:22<41:59, 1.25s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1983/4000 [42:24<42:05, 1.25s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1984/4000 [42:25<42:21, 1.26s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1985/4000 [42:26<41:58, 1.25s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1986/4000 [42:27<42:04, 1.25s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1987/4000 [42:29<42:03, 1.25s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1988/4000 [42:30<41:31, 1.24s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1989/4000 [42:31<41:48, 1.25s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1990/4000 [42:32<42:13, 1.26s/it] {'loss': 0.0879, 'grad_norm': 0.7628422379493713, 'learning_rate': 5.458194144551768e-05}
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1990/4000 [42:32<42:13, 1.26s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1991/4000 [42:34<42:22, 1.27s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1992/4000 [42:35<42:15, 1.26s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1993/4000 [42:36<41:55, 1.25s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1994/4000 [42:37<41:50, 1.25s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1995/4000 [42:39<41:44, 1.25s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1996/4000 [42:40<41:39, 1.25s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1997/4000 [42:41<41:55, 1.26s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1998/4000 [42:42<41:18, 1.24s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 1999/4000 [42:44<41:06, 1.23s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2000/4000 [42:45<40:55, 1.23s/it] {'loss': 0.0802, 'grad_norm': 0.7885144352912903, 'learning_rate': 5.417016141736756e-05}
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2000/4000 [42:45<40:55, 1.23s/it]Copying experiment config directory /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-runs-ft4k/a6/production/experiment_cfg to /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-runs-ft4k/a6/production/checkpoint-2000/experiment_cfg
Copying processor directory /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-runs-ft4k/a6/production/processor to /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-runs-ft4k/a6/production/checkpoint-2000
Copying wandb_config.json from /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-runs-ft4k/a6/production/wandb_config.json to /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-runs-ft4k/a6/production/checkpoint-2000/wandb_config.json
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2001/4000 [44:32<18:22:56, 33.10s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2002/4000 [44:34<13:04:19, 23.55s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2003/4000 [44:35<9:21:18, 16.86s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2004/4000 [44:36<6:44:44, 12.17s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2005/4000 [44:37<4:55:11, 8.88s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2006/4000 [44:38<3:38:33, 6.58s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2007/4000 [44:40<2:45:19, 4.98s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2008/4000 [44:41<2:08:00, 3.86s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2009/4000 [44:42<1:42:09, 3.08s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2010/4000 [44:43<1:24:06, 2.54s/it] {'loss': 0.0814, 'grad_norm': 0.7288223505020142, 'learning_rate': 5.375809636422399e-05}
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2010/4000 [44:43<1:24:06, 2.54s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2011/4000 [44:45<1:11:13, 2.15s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2012/4000 [44:46<1:01:52, 1.87s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2013/4000 [44:47<55:43, 1.68s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2014/4000 [44:48<51:27, 1.55s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2015/4000 [44:50<48:04, 1.45s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2016/4000 [44:51<45:55, 1.39s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2017/4000 [44:52<44:41, 1.35s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2018/4000 [44:53<43:49, 1.33s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2019/4000 [44:55<43:09, 1.31s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2020/4000 [44:56<42:28, 1.29s/it] {'loss': 0.09, 'grad_norm': 0.7611737251281738, 'learning_rate': 5.334577445018599e-05}
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2020/4000 [44:56<42:28, 1.29s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2021/4000 [44:57<42:26, 1.29s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2022/4000 [44:58<42:15, 1.28s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2023/4000 [45:00<41:41, 1.27s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2024/4000 [45:01<41:39, 1.26s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2025/4000 [45:02<42:08, 1.28s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2026/4000 [45:04<42:25, 1.29s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2027/4000 [45:05<42:15, 1.29s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2028/4000 [45:06<41:25, 1.26s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2029/4000 [45:07<41:12, 1.25s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2030/4000 [45:09<40:53, 1.25s/it] {'loss': 0.0913, 'grad_norm': 0.6226151585578918, 'learning_rate': 5.293322385690867e-05}
51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2030/4000 [45:09<40:53, 1.25s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2031/4000 [45:10<40:56, 1.25s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2032/4000 [45:11<40:29, 1.23s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2033/4000 [45:12<40:57, 1.25s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2034/4000 [45:14<41:00, 1.25s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2035/4000 [45:15<40:34, 1.24s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2036/4000 [45:16<40:30, 1.24s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2037/4000 [45:17<40:24, 1.23s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2038/4000 [45:18<40:21, 1.23s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2039/4000 [45:20<40:25, 1.24s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2040/4000 [45:21<40:40, 1.25s/it] {'loss': 0.0983, 'grad_norm': 0.6801372170448303, 'learning_rate': 5.252047278167709e-05}
51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2040/4000 [45:21<40:40, 1.25s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2041/4000 [45:22<41:01, 1.26s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2042/4000 [45:23<40:58, 1.26s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2043/4000 [45:25<40:34, 1.24s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2044/4000 [45:26<42:11, 1.29s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2045/4000 [45:27<41:31, 1.27s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2046/4000 [45:29<41:42, 1.28s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2047/4000 [45:30<40:50, 1.25s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2048/4000 [45:31<40:50, 1.26s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2049/4000 [45:32<41:28, 1.28s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2050/4000 [45:34<41:18, 1.27s/it] {'loss': 0.0904, 'grad_norm': 0.6311099529266357, 'learning_rate': 5.210754943547893e-05}
51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2050/4000 [45:34<41:18, 1.27s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2051/4000 [45:35<40:40, 1.25s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2052/4000 [45:36<40:33, 1.25s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2053/4000 [45:37<40:30, 1.25s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2054/4000 [45:39<40:16, 1.24s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2055/4000 [45:40<40:01, 1.23s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2056/4000 [45:41<39:59, 1.23s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2057/4000 [45:42<40:20, 1.25s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2058/4000 [45:44<40:29, 1.25s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2059/4000 [45:45<40:22, 1.25s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2060/4000 [45:46<39:51, 1.23s/it] {'loss': 0.0786, 'grad_norm': 0.642413318157196, 'learning_rate': 5.169448204107643e-05}
52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2060/4000 [45:46<39:51, 1.23s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2061/4000 [45:47<39:40, 1.23s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2062/4000 [45:48<39:50, 1.23s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2063/4000 [45:50<39:54, 1.24s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2064/4000 [45:51<40:32, 1.26s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2065/4000 [45:52<40:44, 1.26s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2066/4000 [45:54<40:44, 1.26s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2067/4000 [45:55<40:30, 1.26s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2068/4000 [45:56<39:54, 1.24s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2069/4000 [45:57<39:41, 1.23s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2070/4000 [45:58<39:43, 1.23s/it] {'loss': 0.0777, 'grad_norm': 0.5415939688682556, 'learning_rate': 5.128129883107729e-05}
52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2070/4000 [45:58<39:43, 1.23s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2071/4000 [46:00<40:09, 1.25s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2072/4000 [46:01<40:11, 1.25s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2073/4000 [46:02<40:08, 1.25s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2074/4000 [46:04<40:17, 1.25s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2075/4000 [46:05<40:43, 1.27s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2076/4000 [46:06<40:14, 1.26s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2077/4000 [46:07<40:17, 1.26s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2078/4000 [46:09<40:07, 1.25s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2079/4000 [46:10<40:46, 1.27s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2080/4000 [46:11<40:43, 1.27s/it] {'loss': 0.0785, 'grad_norm': 0.7036475539207458, 'learning_rate': 5.086802804600505e-05}
52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2080/4000 [46:11<40:43, 1.27s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2081/4000 [46:12<40:19, 1.26s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2082/4000 [46:14<40:37, 1.27s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2083/4000 [46:15<40:58, 1.28s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2084/4000 [46:16<40:08, 1.26s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2085/4000 [46:17<39:44, 1.25s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2086/4000 [46:19<39:20, 1.23s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2087/4000 [46:20<39:19, 1.23s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2088/4000 [46:21<39:29, 1.24s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2089/4000 [46:22<39:09, 1.23s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2090/4000 [46:24<39:30, 1.24s/it] {'loss': 0.0811, 'grad_norm': 0.5921804308891296, 'learning_rate': 5.045469793236892e-05}
52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2090/4000 [46:24<39:30, 1.24s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2091/4000 [46:25<39:50, 1.25s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2092/4000 [46:26<39:31, 1.24s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2093/4000 [46:27<39:40, 1.25s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2094/4000 [46:29<39:20, 1.24s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2095/4000 [46:30<39:16, 1.24s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2096/4000 [46:31<39:34, 1.25s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2097/4000 [46:32<39:58, 1.26s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2098/4000 [46:34<39:51, 1.26s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2099/4000 [46:35<39:57, 1.26s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2100/4000 [46:36<39:35, 1.25s/it] {'loss': 0.0773, 'grad_norm': 0.6081008315086365, 'learning_rate': 5.00413367407331e-05}
52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2100/4000 [46:36<39:35, 1.25s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2101/4000 [46:37<39:12, 1.24s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2102/4000 [46:39<39:03, 1.23s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2103/4000 [46:40<39:07, 1.24s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2104/4000 [46:41<39:16, 1.24s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2105/4000 [46:42<39:26, 1.25s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2106/4000 [46:44<39:35, 1.25s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2107/4000 [46:45<39:50, 1.26s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2108/4000 [46:46<39:34, 1.26s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2109/4000 [46:47<39:37, 1.26s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2110/4000 [46:49<39:29, 1.25s/it] {'loss': 0.0783, 'grad_norm': 0.6432275176048279, 'learning_rate': 4.9627972723785964e-05}
53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2110/4000 [46:49<39:29, 1.25s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2111/4000 [46:50<39:44, 1.26s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2112/4000 [46:51<39:50, 1.27s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2113/4000 [46:52<39:31, 1.26s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2114/4000 [46:54<39:12, 1.25s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2115/4000 [46:55<39:22, 1.25s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2116/4000 [46:56<39:01, 1.24s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2117/4000 [46:57<39:04, 1.25s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2118/4000 [46:59<38:34, 1.23s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2119/4000 [47:00<38:19, 1.22s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2120/4000 [47:01<39:03, 1.25s/it] {'loss': 0.0759, 'grad_norm': 0.7086749076843262, 'learning_rate': 4.921463413440898e-05}
53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2120/4000 [47:01<39:03, 1.25s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2121/4000 [47:02<39:12, 1.25s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2122/4000 [47:04<39:05, 1.25s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2123/4000 [47:05<39:15, 1.25s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2124/4000 [47:06<38:53, 1.24s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2125/4000 [47:07<38:32, 1.23s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2126/4000 [47:08<38:24, 1.23s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2127/4000 [47:10<38:36, 1.24s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2128/4000 [47:11<38:24, 1.23s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2129/4000 [47:12<38:33, 1.24s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2130/4000 [47:13<38:23, 1.23s/it] {'loss': 0.0867, 'grad_norm': 0.5938372015953064, 'learning_rate': 4.8801349223745654e-05}
53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2130/4000 [47:13<38:23, 1.23s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2131/4000 [47:15<38:55, 1.25s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2132/4000 [47:16<38:34, 1.24s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2133/4000 [47:17<38:28, 1.24s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2134/4000 [47:18<38:31, 1.24s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2135/4000 [47:20<38:36, 1.24s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2136/4000 [47:21<38:19, 1.23s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2137/4000 [47:22<38:51, 1.25s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2138/4000 [47:23<38:42, 1.25s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2139/4000 [47:25<38:19, 1.24s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2140/4000 [47:26<37:58, 1.23s/it] {'loss': 0.0873, 'grad_norm': 0.7382327914237976, 'learning_rate': 4.838814623927067e-05}
54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2140/4000 [47:26<37:58, 1.23s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2141/4000 [47:27<38:17, 1.24s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2142/4000 [47:28<38:28, 1.24s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2143/4000 [47:30<39:06, 1.26s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2144/4000 [47:31<38:46, 1.25s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2145/4000 [47:32<39:34, 1.28s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2146/4000 [47:33<39:30, 1.28s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2147/4000 [47:35<39:17, 1.27s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2148/4000 [47:36<39:06, 1.27s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2149/4000 [47:37<38:34, 1.25s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2150/4000 [47:38<38:53, 1.26s/it] {'loss': 0.0973, 'grad_norm': 0.7236987352371216, 'learning_rate': 4.797505342285912e-05}
54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2150/4000 [47:38<38:53, 1.26s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2151/4000 [47:40<38:47, 1.26s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2152/4000 [47:41<38:55, 1.26s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2153/4000 [47:42<38:30, 1.25s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2154/4000 [47:43<38:03, 1.24s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2155/4000 [47:45<37:53, 1.23s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2156/4000 [47:46<37:55, 1.23s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2157/4000 [47:47<38:05, 1.24s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2158/4000 [47:48<38:25, 1.25s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2159/4000 [47:50<38:33, 1.26s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2160/4000 [47:51<38:40, 1.26s/it] {'loss': 0.0839, 'grad_norm': 0.6351351737976074, 'learning_rate': 4.756209900885628e-05}
54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2160/4000 [47:51<38:40, 1.26s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2161/4000 [47:52<38:45, 1.26s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2162/4000 [47:53<38:33, 1.26s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2163/4000 [47:55<38:42, 1.26s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2164/4000 [47:56<38:20, 1.25s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2165/4000 [47:57<38:04, 1.25s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2166/4000 [47:58<38:35, 1.26s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2167/4000 [48:00<39:03, 1.28s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2168/4000 [48:01<39:08, 1.28s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2169/4000 [48:02<39:38, 1.30s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2170/4000 [48:04<39:05, 1.28s/it] {'loss': 0.0729, 'grad_norm': 0.6128687262535095, 'learning_rate': 4.714931122214781e-05}
54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2170/4000 [48:04<39:05, 1.28s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2171/4000 [48:05<38:46, 1.27s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2172/4000 [48:06<38:09, 1.25s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2173/4000 [48:07<37:53, 1.24s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2174/4000 [48:09<38:06, 1.25s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2175/4000 [48:10<37:34, 1.24s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2176/4000 [48:11<37:41, 1.24s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2177/4000 [48:12<37:30, 1.23s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2178/4000 [48:14<37:38, 1.24s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2179/4000 [48:15<37:23, 1.23s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2180/4000 [48:16<37:22, 1.23s/it] {'loss': 0.09, 'grad_norm': 0.5777937769889832, 'learning_rate': 4.673671827623058e-05}
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2180/4000 [48:16<37:22, 1.23s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2181/4000 [48:17<37:43, 1.24s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2182/4000 [48:19<38:12, 1.26s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2183/4000 [48:20<37:48, 1.25s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2184/4000 [48:21<37:38, 1.24s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2185/4000 [48:22<37:48, 1.25s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2186/4000 [48:24<38:14, 1.27s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2187/4000 [48:25<38:12, 1.26s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2188/4000 [48:26<38:05, 1.26s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2189/4000 [48:27<38:19, 1.27s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2190/4000 [48:29<38:28, 1.28s/it] {'loss': 0.0745, 'grad_norm': 0.6544922590255737, 'learning_rate': 4.632434837128443e-05}
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2190/4000 [48:29<38:28, 1.28s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2191/4000 [48:30<38:29, 1.28s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2192/4000 [48:31<38:49, 1.29s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2193/4000 [48:33<39:12, 1.30s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2194/4000 [48:34<38:26, 1.28s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2195/4000 [48:35<38:15, 1.27s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2196/4000 [48:36<37:54, 1.26s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2197/4000 [48:38<38:03, 1.27s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2198/4000 [48:39<38:00, 1.27s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2199/4000 [48:40<37:49, 1.26s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2200/4000 [48:41<37:18, 1.24s/it] {'loss': 0.0749, 'grad_norm': 0.6199691295623779, 'learning_rate': 4.591222969224453e-05}
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2200/4000 [48:41<37:18, 1.24s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2201/4000 [48:43<37:31, 1.25s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2202/4000 [48:44<37:36, 1.25s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2203/4000 [48:45<37:20, 1.25s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2204/4000 [48:46<37:04, 1.24s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2205/4000 [48:48<37:08, 1.24s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2206/4000 [48:49<37:32, 1.26s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2207/4000 [48:50<37:16, 1.25s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2208/4000 [48:51<37:12, 1.25s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2209/4000 [48:53<37:25, 1.25s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2210/4000 [48:54<36:54, 1.24s/it] {'loss': 0.0759, 'grad_norm': 0.6172326803207397, 'learning_rate': 4.550039040687518e-05}
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2210/4000 [48:54<36:54, 1.24s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2211/4000 [48:55<36:46, 1.23s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2212/4000 [48:56<37:18, 1.25s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2213/4000 [48:58<39:05, 1.31s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2214/4000 [48:59<38:25, 1.29s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2215/4000 [49:00<38:17, 1.29s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2216/4000 [49:02<38:19, 1.29s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2217/4000 [49:03<38:12, 1.29s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2218/4000 [49:04<38:19, 1.29s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2219/4000 [49:06<39:43, 1.34s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2220/4000 [49:07<38:53, 1.31s/it] {'loss': 0.0751, 'grad_norm': 0.6845077872276306, 'learning_rate': 4.508885866384446e-05}
56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2220/4000 [49:07<38:53, 1.31s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2221/4000 [49:08<38:03, 1.28s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2222/4000 [49:09<37:36, 1.27s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2223/4000 [49:11<37:42, 1.27s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2224/4000 [49:12<37:44, 1.27s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2225/4000 [49:13<37:29, 1.27s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2226/4000 [49:14<37:22, 1.26s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2227/4000 [49:16<37:29, 1.27s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2228/4000 [49:17<37:21, 1.26s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2229/4000 [49:18<36:56, 1.25s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2230/4000 [49:19<36:49, 1.25s/it] {'loss': 0.0855, 'grad_norm': 0.7979119420051575, 'learning_rate': 4.4677662590800355e-05}
56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2230/4000 [49:19<36:49, 1.25s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2231/4000 [49:21<37:00, 1.26s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2232/4000 [49:22<36:46, 1.25s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2233/4000 [49:23<37:36, 1.28s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2234/4000 [49:25<37:43, 1.28s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2235/4000 [49:26<37:01, 1.26s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2236/4000 [49:27<36:59, 1.26s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2237/4000 [49:28<37:17, 1.27s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2238/4000 [49:30<37:13, 1.27s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2239/4000 [49:31<36:57, 1.26s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2240/4000 [49:32<36:58, 1.26s/it] {'loss': 0.0737, 'grad_norm': 0.6994562149047852, 'learning_rate': 4.426683029244825e-05}
56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2240/4000 [49:32<36:58, 1.26s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2241/4000 [49:33<36:37, 1.25s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2242/4000 [49:35<37:05, 1.27s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2243/4000 [49:36<36:32, 1.25s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2244/4000 [49:37<36:20, 1.24s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2245/4000 [49:38<36:14, 1.24s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2246/4000 [49:39<36:03, 1.23s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2247/4000 [49:41<36:28, 1.25s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2248/4000 [49:42<36:54, 1.26s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2249/4000 [49:43<36:25, 1.25s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2250/4000 [49:44<36:14, 1.24s/it] {'loss': 0.087, 'grad_norm': 0.6050620675086975, 'learning_rate': 4.385638984863e-05}
56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2250/4000 [49:44<36:14, 1.24s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2251/4000 [49:46<36:09, 1.24s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2252/4000 [49:47<35:54, 1.23s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2253/4000 [49:48<36:04, 1.24s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2254/4000 [49:49<36:20, 1.25s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2255/4000 [49:51<36:47, 1.26s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2256/4000 [49:52<36:55, 1.27s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2257/4000 [49:53<37:04, 1.28s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2258/4000 [49:55<37:18, 1.28s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2259/4000 [49:56<36:50, 1.27s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2260/4000 [49:57<36:19, 1.25s/it] {'loss': 0.0876, 'grad_norm': 0.6457384824752808, 'learning_rate': 4.3446369312404745e-05}
56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2260/4000 [49:57<36:19, 1.25s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2261/4000 [49:58<36:06, 1.25s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2262/4000 [50:00<36:29, 1.26s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2263/4000 [50:01<36:56, 1.28s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2264/4000 [50:02<37:38, 1.30s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2265/4000 [50:04<37:16, 1.29s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2266/4000 [50:05<36:34, 1.27s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2267/4000 [50:06<37:19, 1.29s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2268/4000 [50:07<37:16, 1.29s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2269/4000 [50:09<36:49, 1.28s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2270/4000 [50:10<37:20, 1.30s/it] {'loss': 0.0727, 'grad_norm': 0.5946557521820068, 'learning_rate': 4.3036796708131474e-05}
57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2270/4000 [50:10<37:20, 1.30s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2271/4000 [50:11<37:19, 1.30s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2272/4000 [50:13<36:53, 1.28s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2273/4000 [50:14<36:22, 1.26s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2274/4000 [50:15<36:08, 1.26s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2275/4000 [50:16<36:03, 1.25s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2276/4000 [50:17<35:44, 1.24s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2277/4000 [50:19<35:45, 1.25s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2278/4000 [50:20<35:45, 1.25s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2279/4000 [50:21<36:29, 1.27s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2280/4000 [50:23<36:09, 1.26s/it] {'loss': 0.0874, 'grad_norm': 0.6468791365623474, 'learning_rate': 4.262770002955363e-05}
57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2280/4000 [50:23<36:09, 1.26s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2281/4000 [50:24<35:53, 1.25s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2282/4000 [50:25<35:51, 1.25s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2283/4000 [50:26<35:57, 1.26s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2284/4000 [50:27<35:47, 1.25s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2285/4000 [50:29<35:44, 1.25s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2286/4000 [50:30<36:06, 1.26s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2287/4000 [50:31<35:44, 1.25s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2288/4000 [50:33<35:54, 1.26s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2289/4000 [50:34<35:36, 1.25s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2290/4000 [50:35<35:19, 1.24s/it] {'loss': 0.0762, 'grad_norm': 0.6109489798545837, 'learning_rate': 4.221910723788578e-05}
57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2290/4000 [50:35<35:19, 1.24s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2291/4000 [50:36<35:12, 1.24s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2292/4000 [50:37<35:13, 1.24s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2293/4000 [50:39<35:02, 1.23s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2294/4000 [50:40<34:51, 1.23s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2295/4000 [50:41<35:06, 1.24s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2296/4000 [50:42<35:41, 1.26s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2297/4000 [50:44<35:31, 1.25s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2298/4000 [50:45<35:29, 1.25s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2299/4000 [50:46<35:14, 1.24s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2300/4000 [50:47<35:15, 1.24s/it] {'loss': 0.0723, 'grad_norm': 0.6604476571083069, 'learning_rate': 4.1811046259902474e-05}
57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2300/4000 [50:47<35:15, 1.24s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2301/4000 [50:49<35:18, 1.25s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2302/4000 [50:50<36:00, 1.27s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2303/4000 [50:51<35:29, 1.25s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2304/4000 [50:52<35:35, 1.26s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2305/4000 [50:54<35:39, 1.26s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2306/4000 [50:55<35:36, 1.26s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2307/4000 [50:56<35:06, 1.24s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2308/4000 [50:57<35:04, 1.24s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2309/4000 [50:59<35:18, 1.25s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2310/4000 [51:00<35:37, 1.26s/it] {'loss': 0.088, 'grad_norm': 0.5930984616279602, 'learning_rate': 4.140354498602952e-05}
58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2310/4000 [51:00<35:37, 1.26s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2311/4000 [51:01<36:16, 1.29s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2312/4000 [51:03<36:12, 1.29s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2313/4000 [51:04<35:47, 1.27s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2314/4000 [51:05<35:37, 1.27s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2315/4000 [51:06<35:07, 1.25s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2316/4000 [51:08<35:36, 1.27s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2317/4000 [51:09<35:17, 1.26s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2318/4000 [51:10<35:14, 1.26s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2319/4000 [51:11<35:01, 1.25s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2320/4000 [51:13<34:51, 1.24s/it] {'loss': 0.0714, 'grad_norm': 0.6223902702331543, 'learning_rate': 4.099663126843769e-05}
58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2320/4000 [51:13<34:51, 1.24s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2321/4000 [51:14<34:42, 1.24s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2322/4000 [51:15<34:38, 1.24s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2323/4000 [51:16<35:20, 1.26s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2324/4000 [51:18<34:53, 1.25s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2325/4000 [51:19<34:43, 1.24s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2326/4000 [51:20<34:45, 1.25s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2327/4000 [51:21<34:49, 1.25s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2328/4000 [51:23<34:47, 1.25s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2329/4000 [51:24<34:46, 1.25s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2330/4000 [51:25<34:25, 1.24s/it] {'loss': 0.0874, 'grad_norm': 0.5395963191986084, 'learning_rate': 4.059033291913902e-05}
58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2330/4000 [51:25<34:25, 1.24s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2331/4000 [51:26<34:22, 1.24s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2332/4000 [51:28<34:10, 1.23s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2333/4000 [51:29<34:15, 1.23s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2334/4000 [51:30<34:03, 1.23s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2335/4000 [51:31<34:05, 1.23s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2336/4000 [51:32<34:08, 1.23s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2337/4000 [51:34<34:18, 1.24s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2338/4000 [51:35<34:50, 1.26s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2339/4000 [51:36<34:27, 1.24s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2340/4000 [51:37<34:26, 1.24s/it] {'loss': 0.0775, 'grad_norm': 0.6223180890083313, 'learning_rate': 4.0184677708086014e-05}
58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2340/4000 [51:37<34:26, 1.24s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2341/4000 [51:39<36:01, 1.30s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2342/4000 [51:40<35:30, 1.29s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2343/4000 [51:41<35:12, 1.27s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2344/4000 [51:43<34:59, 1.27s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2345/4000 [51:44<34:33, 1.25s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2346/4000 [51:45<34:41, 1.26s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2347/4000 [51:46<34:31, 1.25s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2348/4000 [51:48<34:12, 1.24s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2349/4000 [51:49<33:49, 1.23s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2350/4000 [51:50<34:14, 1.25s/it] {'loss': 0.0847, 'grad_norm': 0.6492939591407776, 'learning_rate': 3.977969336127348e-05}
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2350/4000 [51:50<34:14, 1.25s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2351/4000 [51:51<34:32, 1.26s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2352/4000 [51:53<34:17, 1.25s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2353/4000 [51:54<34:14, 1.25s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2354/4000 [51:55<34:01, 1.24s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2355/4000 [51:56<33:46, 1.23s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2356/4000 [51:58<34:27, 1.26s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2357/4000 [51:59<34:51, 1.27s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2358/4000 [52:00<35:01, 1.28s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2359/4000 [52:02<36:04, 1.32s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2360/4000 [52:03<35:34, 1.30s/it] {'loss': 0.0749, 'grad_norm': 0.617656409740448, 'learning_rate': 3.937540755884357e-05}
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2360/4000 [52:03<35:34, 1.30s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2361/4000 [52:04<34:55, 1.28s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2362/4000 [52:05<34:50, 1.28s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2363/4000 [52:07<34:56, 1.28s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2364/4000 [52:08<34:45, 1.27s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2365/4000 [52:09<34:24, 1.26s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2366/4000 [52:10<34:14, 1.26s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2367/4000 [52:12<34:24, 1.26s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2368/4000 [52:13<34:10, 1.26s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2369/4000 [52:14<34:21, 1.26s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2370/4000 [52:15<34:41, 1.28s/it] {'loss': 0.0754, 'grad_norm': 0.6069186925888062, 'learning_rate': 3.897184793319384e-05}
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2370/4000 [52:15<34:41, 1.28s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2371/4000 [52:17<34:52, 1.28s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2372/4000 [52:18<34:36, 1.28s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2373/4000 [52:19<34:22, 1.27s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2374/4000 [52:21<34:14, 1.26s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2375/4000 [52:22<34:05, 1.26s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2376/4000 [52:23<33:58, 1.26s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2377/4000 [52:24<33:42, 1.25s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2378/4000 [52:25<33:32, 1.24s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2379/4000 [52:27<33:19, 1.23s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2380/4000 [52:28<33:05, 1.23s/it] {'loss': 0.0699, 'grad_norm': 0.5194122791290283, 'learning_rate': 3.856904206708863e-05}
60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2380/4000 [52:28<33:05, 1.23s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2381/4000 [52:29<33:12, 1.23s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2382/4000 [52:30<33:03, 1.23s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2383/4000 [52:32<33:22, 1.24s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2384/4000 [52:33<33:31, 1.24s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2385/4000 [52:34<33:30, 1.25s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2386/4000 [52:35<33:32, 1.25s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2387/4000 [52:37<33:44, 1.25s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2388/4000 [52:38<33:29, 1.25s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2389/4000 [52:39<33:10, 1.24s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2390/4000 [52:40<33:00, 1.23s/it] {'loss': 0.0868, 'grad_norm': 0.7310845851898193, 'learning_rate': 3.8167017491773847e-05}
60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2390/4000 [52:40<33:00, 1.23s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2391/4000 [52:42<33:02, 1.23s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2392/4000 [52:43<32:53, 1.23s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2393/4000 [52:44<33:10, 1.24s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2394/4000 [52:45<33:06, 1.24s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2395/4000 [52:46<32:49, 1.23s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2396/4000 [52:48<32:56, 1.23s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2397/4000 [52:49<33:08, 1.24s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2398/4000 [52:50<32:58, 1.24s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2399/4000 [52:51<32:58, 1.24s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2400/4000 [52:53<33:12, 1.25s/it] {'loss': 0.0846, 'grad_norm': 0.5881897211074829, 'learning_rate': 3.776580168509516e-05}
60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2400/4000 [52:53<33:12, 1.25s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2401/4000 [52:54<33:01, 1.24s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2402/4000 [52:55<33:37, 1.26s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2403/4000 [52:57<34:13, 1.29s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2404/4000 [52:58<33:55, 1.28s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2405/4000 [52:59<33:39, 1.27s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2406/4000 [53:00<33:33, 1.26s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2407/4000 [53:02<33:56, 1.28s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2408/4000 [53:03<33:46, 1.27s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2409/4000 [53:04<33:39, 1.27s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2410/4000 [53:05<33:56, 1.28s/it] {'loss': 0.0711, 'grad_norm': 0.5394375920295715, 'learning_rate': 3.736542206962e-05}
60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2410/4000 [53:05<33:56, 1.28s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2411/4000 [53:07<33:25, 1.26s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2412/4000 [53:08<33:22, 1.26s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2413/4000 [53:09<33:44, 1.28s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2414/4000 [53:11<33:29, 1.27s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2415/4000 [53:12<33:55, 1.28s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2416/4000 [53:13<33:23, 1.26s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2417/4000 [53:14<33:01, 1.25s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2418/4000 [53:16<32:45, 1.24s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2419/4000 [53:17<32:42, 1.24s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2420/4000 [53:18<32:38, 1.24s/it] {'loss': 0.0763, 'grad_norm': 0.6703559756278992, 'learning_rate': 3.696590601076326e-05}
60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2420/4000 [53:18<32:38, 1.24s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2421/4000 [53:19<32:39, 1.24s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2422/4000 [53:20<32:16, 1.23s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2423/4000 [53:22<33:12, 1.26s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2424/4000 [53:23<32:45, 1.25s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2425/4000 [53:24<32:27, 1.24s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2426/4000 [53:25<32:09, 1.23s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2427/4000 [53:27<32:39, 1.25s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2428/4000 [53:28<32:52, 1.26s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2429/4000 [53:29<33:12, 1.27s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2430/4000 [53:31<33:11, 1.27s/it] {'loss': 0.0743, 'grad_norm': 0.6254237294197083, 'learning_rate': 3.656728081491686e-05}
61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2430/4000 [53:31<33:11, 1.27s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2431/4000 [53:32<32:51, 1.26s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2432/4000 [53:33<32:52, 1.26s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2433/4000 [53:34<33:01, 1.26s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2434/4000 [53:36<33:07, 1.27s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2435/4000 [53:37<32:41, 1.25s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2436/4000 [53:38<33:06, 1.27s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2437/4000 [53:39<32:56, 1.26s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2438/4000 [53:41<32:40, 1.26s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2439/4000 [53:42<32:26, 1.25s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2440/4000 [53:43<32:55, 1.27s/it] {'loss': 0.0855, 'grad_norm': 0.6200141310691833, 'learning_rate': 3.6169573727583405e-05}
61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2440/4000 [53:43<32:55, 1.27s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2441/4000 [53:44<32:53, 1.27s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2442/4000 [53:46<32:55, 1.27s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2443/4000 [53:47<32:52, 1.27s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2444/4000 [53:48<33:07, 1.28s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2445/4000 [53:49<32:29, 1.25s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2446/4000 [53:51<31:58, 1.23s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2447/4000 [53:52<32:13, 1.24s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2448/4000 [53:53<32:30, 1.26s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2449/4000 [53:54<32:42, 1.27s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2450/4000 [53:56<32:19, 1.25s/it] {'loss': 0.0777, 'grad_norm': 0.5861798524856567, 'learning_rate': 3.5772811931514036e-05}
61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2450/4000 [53:56<32:19, 1.25s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2451/4000 [53:57<32:00, 1.24s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2452/4000 [53:58<32:36, 1.26s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2453/4000 [53:59<32:22, 1.26s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2454/4000 [54:01<32:19, 1.25s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2455/4000 [54:02<32:31, 1.26s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2456/4000 [54:03<32:50, 1.28s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2457/4000 [54:05<33:02, 1.28s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2458/4000 [54:06<32:48, 1.28s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2459/4000 [54:07<32:13, 1.25s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2460/4000 [54:08<31:53, 1.24s/it] {'loss': 0.0861, 'grad_norm': 0.589230477809906, 'learning_rate': 3.5377022544850505e-05}
62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2460/4000 [54:08<31:53, 1.24s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2461/4000 [54:09<31:30, 1.23s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2462/4000 [54:11<31:33, 1.23s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2463/4000 [54:12<31:47, 1.24s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2464/4000 [54:13<31:40, 1.24s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2465/4000 [54:15<32:20, 1.26s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2466/4000 [54:16<32:10, 1.26s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2467/4000 [54:17<32:02, 1.25s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2468/4000 [54:18<31:42, 1.24s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2469/4000 [54:19<31:42, 1.24s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2470/4000 [54:21<31:45, 1.25s/it] {'loss': 0.0754, 'grad_norm': 0.6147307753562927, 'learning_rate': 3.498223261927158e-05}
62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2470/4000 [54:21<31:45, 1.25s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2471/4000 [54:22<31:42, 1.24s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2472/4000 [54:23<31:35, 1.24s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2473/4000 [54:24<31:55, 1.25s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2474/4000 [54:26<31:30, 1.24s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2475/4000 [54:27<31:44, 1.25s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2476/4000 [54:28<32:05, 1.26s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2477/4000 [54:30<32:01, 1.26s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2478/4000 [54:31<31:27, 1.24s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2479/4000 [54:32<31:15, 1.23s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2480/4000 [54:33<31:43, 1.25s/it] {'loss': 0.0773, 'grad_norm': 0.5697932839393616, 'learning_rate': 3.4588469138144295e-05}
62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2480/4000 [54:33<31:43, 1.25s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2481/4000 [54:34<31:48, 1.26s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2482/4000 [54:36<31:43, 1.25s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2483/4000 [54:37<31:20, 1.24s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2484/4000 [54:38<31:36, 1.25s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2485/4000 [54:39<31:28, 1.25s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2486/4000 [54:41<31:22, 1.24s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2487/4000 [54:42<31:39, 1.26s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2488/4000 [54:43<32:05, 1.27s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2489/4000 [54:44<31:33, 1.25s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2490/4000 [54:46<31:16, 1.24s/it] {'loss': 0.0641, 'grad_norm': 0.5715707540512085, 'learning_rate': 3.419575901467952e-05}
62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2490/4000 [54:46<31:16, 1.24s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2491/4000 [54:47<31:17, 1.24s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2492/4000 [54:48<31:27, 1.25s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2493/4000 [54:49<31:25, 1.25s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2494/4000 [54:51<33:17, 1.33s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2495/4000 [54:52<32:34, 1.30s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2496/4000 [54:54<32:32, 1.30s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2497/4000 [54:55<32:12, 1.29s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2498/4000 [54:56<31:31, 1.26s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2499/4000 [54:57<31:15, 1.25s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2500/4000 [54:58<31:18, 1.25s/it] {'loss': 0.0793, 'grad_norm': 0.48251983523368835, 'learning_rate': 3.380412909009254e-05}
62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2500/4000 [54:58<31:18, 1.25s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2501/4000 [55:00<31:40, 1.27s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2502/4000 [55:01<31:21, 1.26s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2503/4000 [55:02<32:04, 1.29s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2504/4000 [55:04<31:52, 1.28s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2505/4000 [55:05<32:06, 1.29s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2506/4000 [55:06<31:37, 1.27s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2507/4000 [55:08<32:59, 1.33s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2508/4000 [55:09<32:03, 1.29s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2509/4000 [55:10<31:45, 1.28s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2510/4000 [55:11<31:42, 1.28s/it] {'loss': 0.0785, 'grad_norm': 0.4791833758354187, 'learning_rate': 3.3413606131768475e-05}
63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2510/4000 [55:11<31:42, 1.28s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2511/4000 [55:13<31:28, 1.27s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2512/4000 [55:14<31:18, 1.26s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2513/4000 [55:15<30:53, 1.25s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2514/4000 [55:16<30:55, 1.25s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2515/4000 [55:17<30:41, 1.24s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2516/4000 [55:19<30:21, 1.23s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2517/4000 [55:20<30:21, 1.23s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2518/4000 [55:21<30:33, 1.24s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2519/4000 [55:22<30:41, 1.24s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2520/4000 [55:24<30:27, 1.23s/it] {'loss': 0.0705, 'grad_norm': 0.5626543164253235, 'learning_rate': 3.302421683143279e-05}
63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2520/4000 [55:24<30:27, 1.23s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2521/4000 [55:25<30:32, 1.24s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2522/4000 [55:26<30:30, 1.24s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2523/4000 [55:27<30:25, 1.24s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2524/4000 [55:29<30:30, 1.24s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2525/4000 [55:30<30:25, 1.24s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2526/4000 [55:31<30:30, 1.24s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2527/4000 [55:32<30:46, 1.25s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2528/4000 [55:34<30:57, 1.26s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2529/4000 [55:35<30:36, 1.25s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2530/4000 [55:36<30:31, 1.25s/it] {'loss': 0.0675, 'grad_norm': 0.6067371368408203, 'learning_rate': 3.2635987803326896e-05}
63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2530/4000 [55:36<30:31, 1.25s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2531/4000 [55:37<30:35, 1.25s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2532/4000 [55:39<30:29, 1.25s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2533/4000 [55:40<30:05, 1.23s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2534/4000 [55:41<29:53, 1.22s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2535/4000 [55:42<30:37, 1.25s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2536/4000 [55:44<30:25, 1.25s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2537/4000 [55:45<30:22, 1.25s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2538/4000 [55:46<30:41, 1.26s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2539/4000 [55:47<30:24, 1.25s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2540/4000 [55:49<30:51, 1.27s/it] {'loss': 0.0818, 'grad_norm': 0.611870527267456, 'learning_rate': 3.224894558238918e-05}
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2540/4000 [55:49<30:51, 1.27s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2541/4000 [55:50<31:24, 1.29s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2542/4000 [55:51<30:54, 1.27s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2543/4000 [55:53<31:07, 1.28s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2544/4000 [55:54<31:08, 1.28s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2545/4000 [55:55<30:47, 1.27s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2546/4000 [55:56<30:17, 1.25s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2547/4000 [55:58<30:19, 1.25s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2548/4000 [55:59<30:04, 1.24s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2549/4000 [56:00<30:09, 1.25s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2550/4000 [56:01<30:26, 1.26s/it] {'loss': 0.09, 'grad_norm': 0.505176305770874, 'learning_rate': 3.18631166224413e-05}
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2550/4000 [56:01<30:26, 1.26s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2551/4000 [56:03<30:17, 1.25s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2552/4000 [56:04<30:18, 1.26s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2553/4000 [56:05<29:58, 1.24s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2554/4000 [56:06<29:55, 1.24s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2555/4000 [56:07<29:55, 1.24s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2556/4000 [56:09<30:09, 1.25s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2557/4000 [56:10<29:57, 1.25s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2558/4000 [56:11<29:44, 1.24s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2559/4000 [56:13<30:14, 1.26s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2560/4000 [56:14<30:07, 1.26s/it] {'loss': 0.0764, 'grad_norm': 0.4995978772640228, 'learning_rate': 3.147852729438017e-05}
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2560/4000 [56:14<30:07, 1.26s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2561/4000 [56:15<30:11, 1.26s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2562/4000 [56:16<30:12, 1.26s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2563/4000 [56:18<30:11, 1.26s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2564/4000 [56:19<30:14, 1.26s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2565/4000 [56:20<30:16, 1.27s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2566/4000 [56:21<29:59, 1.26s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2567/4000 [56:23<29:58, 1.25s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2568/4000 [56:24<29:40, 1.24s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2569/4000 [56:25<29:46, 1.25s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2570/4000 [56:26<29:29, 1.24s/it] {'loss': 0.0773, 'grad_norm': 0.5026569366455078, 'learning_rate': 3.109520388437548e-05}
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2570/4000 [56:26<29:29, 1.24s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2571/4000 [56:28<29:26, 1.24s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2572/4000 [56:29<29:33, 1.24s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2573/4000 [56:30<29:31, 1.24s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2574/4000 [56:31<29:38, 1.25s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2575/4000 [56:33<29:39, 1.25s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2576/4000 [56:34<29:38, 1.25s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2577/4000 [56:35<29:12, 1.23s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2578/4000 [56:36<29:01, 1.22s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2579/4000 [56:37<29:24, 1.24s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2580/4000 [56:39<29:07, 1.23s/it] {'loss': 0.0754, 'grad_norm': 0.5156867504119873, 'learning_rate': 3.0713172592073116e-05}
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2580/4000 [56:39<29:07, 1.23s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2581/4000 [56:40<29:10, 1.23s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2582/4000 [56:41<29:13, 1.24s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2583/4000 [56:42<29:21, 1.24s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2584/4000 [56:44<29:12, 1.24s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2585/4000 [56:45<29:32, 1.25s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2586/4000 [56:46<29:38, 1.26s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2587/4000 [56:47<29:32, 1.25s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2588/4000 [56:49<29:13, 1.24s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2589/4000 [56:50<29:10, 1.24s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2590/4000 [56:51<29:01, 1.24s/it] {'loss': 0.0811, 'grad_norm': 0.516937792301178, 'learning_rate': 3.0332459528804457e-05}
65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2590/4000 [56:51<29:01, 1.24s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2591/4000 [56:52<29:43, 1.27s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2592/4000 [56:54<29:24, 1.25s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2593/4000 [56:55<29:40, 1.27s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2594/4000 [56:56<30:02, 1.28s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2595/4000 [56:57<29:36, 1.26s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2596/4000 [56:59<29:12, 1.25s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2597/4000 [57:00<29:42, 1.27s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2598/4000 [57:01<30:01, 1.28s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2599/4000 [57:03<30:16, 1.30s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2600/4000 [57:04<29:34, 1.27s/it] {'loss': 0.0739, 'grad_norm': 0.6908169984817505, 'learning_rate': 2.9953090715801634e-05}
65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2600/4000 [57:04<29:34, 1.27s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2601/4000 [57:05<29:13, 1.25s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2602/4000 [57:06<29:07, 1.25s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2603/4000 [57:08<28:59, 1.25s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2604/4000 [57:09<28:59, 1.25s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2605/4000 [57:10<28:43, 1.24s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2606/4000 [57:11<28:53, 1.24s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2607/4000 [57:13<28:47, 1.24s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2608/4000 [57:14<28:40, 1.24s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2609/4000 [57:15<28:48, 1.24s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2610/4000 [57:16<28:35, 1.23s/it] {'loss': 0.0664, 'grad_norm': 0.5054716467857361, 'learning_rate': 2.9575092082419086e-05}
65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2610/4000 [57:16<28:35, 1.23s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2611/4000 [57:17<28:46, 1.24s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2612/4000 [57:19<28:44, 1.24s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2613/4000 [57:20<28:51, 1.25s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2614/4000 [57:21<29:14, 1.27s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2615/4000 [57:23<29:32, 1.28s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2616/4000 [57:24<29:16, 1.27s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2617/4000 [57:25<28:47, 1.25s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2618/4000 [57:26<28:59, 1.26s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2619/4000 [57:28<28:50, 1.25s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2620/4000 [57:29<29:00, 1.26s/it] {'loss': 0.073, 'grad_norm': 0.5159503221511841, 'learning_rate': 2.9198489464361288e-05}
66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2620/4000 [57:29<29:00, 1.26s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2621/4000 [57:30<28:36, 1.24s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2622/4000 [57:31<28:39, 1.25s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2623/4000 [57:33<29:09, 1.27s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2624/4000 [57:34<29:35, 1.29s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2625/4000 [57:35<29:15, 1.28s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2626/4000 [57:36<28:59, 1.27s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2627/4000 [57:38<28:59, 1.27s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2628/4000 [57:39<28:39, 1.25s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2629/4000 [57:40<28:36, 1.25s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2630/4000 [57:41<28:41, 1.26s/it] {'loss': 0.0663, 'grad_norm': 0.5740625858306885, 'learning_rate': 2.8823308601916948e-05}
66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2630/4000 [57:41<28:41, 1.26s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2631/4000 [57:43<28:47, 1.26s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2632/4000 [57:44<29:01, 1.27s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2633/4000 [57:45<29:15, 1.28s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2634/4000 [57:47<29:14, 1.28s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2635/4000 [57:48<29:00, 1.28s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2636/4000 [57:49<28:31, 1.25s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2637/4000 [57:50<28:10, 1.24s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2638/4000 [57:51<27:53, 1.23s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2639/4000 [57:53<27:49, 1.23s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2640/4000 [57:54<27:55, 1.23s/it] {'loss': 0.0625, 'grad_norm': 0.5468942523002625, 'learning_rate': 2.8449575138199613e-05}
66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2640/4000 [57:54<27:55, 1.23s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2641/4000 [57:55<27:45, 1.23s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2642/4000 [57:56<27:35, 1.22s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2643/4000 [57:58<27:32, 1.22s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2644/4000 [57:59<27:43, 1.23s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2645/4000 [58:00<27:45, 1.23s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2646/4000 [58:01<27:59, 1.24s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2647/4000 [58:03<28:07, 1.25s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2648/4000 [58:04<27:57, 1.24s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 2649/4000 [58:05<27:55, 1.24s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2650/4000 [58:06<28:12, 1.25s/it] {'loss': 0.0775, 'grad_norm': 0.5565462112426758, 'learning_rate': 2.807731461739509e-05}
66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2650/4000 [58:06<28:12, 1.25s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2651/4000 [58:08<28:05, 1.25s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2652/4000 [58:09<28:06, 1.25s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2653/4000 [58:10<27:53, 1.24s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2654/4000 [58:11<28:12, 1.26s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2655/4000 [58:13<28:00, 1.25s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2656/4000 [58:14<27:48, 1.24s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2657/4000 [58:15<27:47, 1.24s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2658/4000 [58:16<27:34, 1.23s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2659/4000 [58:17<27:23, 1.23s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2660/4000 [58:19<27:19, 1.22s/it] {'loss': 0.0863, 'grad_norm': 0.5088033080101013, 'learning_rate': 2.7706552483015485e-05}
66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2660/4000 [58:19<27:19, 1.22s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2661/4000 [58:20<27:18, 1.22s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2662/4000 [58:21<27:44, 1.24s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2663/4000 [58:22<27:48, 1.25s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2664/4000 [58:24<27:46, 1.25s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2665/4000 [58:25<27:54, 1.25s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2666/4000 [58:26<27:54, 1.26s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2667/4000 [58:28<28:07, 1.27s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2668/4000 [58:29<27:43, 1.25s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2669/4000 [58:30<27:27, 1.24s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2670/4000 [58:31<28:06, 1.27s/it] {'loss': 0.0766, 'grad_norm': 0.47167086601257324, 'learning_rate': 2.733731407616018e-05}
67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2670/4000 [58:31<28:06, 1.27s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2671/4000 [58:33<28:14, 1.28s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2672/4000 [58:34<28:04, 1.27s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2673/4000 [58:35<27:36, 1.25s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2674/4000 [58:36<27:20, 1.24s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2675/4000 [58:37<27:03, 1.23s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2676/4000 [58:39<26:55, 1.22s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2677/4000 [58:40<26:54, 1.22s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2678/4000 [58:41<26:49, 1.22s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2679/4000 [58:42<26:54, 1.22s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2680/4000 [58:44<27:12, 1.24s/it] {'loss': 0.0745, 'grad_norm': 0.42085927724838257, 'learning_rate': 2.6969624633783806e-05}
67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2680/4000 [58:44<27:12, 1.24s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2681/4000 [58:45<27:32, 1.25s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2682/4000 [58:46<27:55, 1.27s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2683/4000 [58:47<27:37, 1.26s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2684/4000 [58:49<27:19, 1.25s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2685/4000 [58:50<27:04, 1.24s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2686/4000 [58:51<26:49, 1.22s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2687/4000 [58:52<26:54, 1.23s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2688/4000 [58:54<26:59, 1.23s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2689/4000 [58:55<26:54, 1.23s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2690/4000 [58:56<26:52, 1.23s/it] {'loss': 0.07, 'grad_norm': 0.4478076100349426, 'learning_rate': 2.660350928697134e-05}
67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2690/4000 [58:56<26:52, 1.23s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2691/4000 [58:57<27:00, 1.24s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2692/4000 [58:59<27:17, 1.25s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2693/4000 [59:00<27:06, 1.24s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2694/4000 [59:01<27:05, 1.24s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2695/4000 [59:02<26:59, 1.24s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2696/4000 [59:03<27:01, 1.24s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2697/4000 [59:05<27:18, 1.26s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2698/4000 [59:06<27:11, 1.25s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2699/4000 [59:07<27:10, 1.25s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2700/4000 [59:09<27:13, 1.26s/it] {'loss': 0.0813, 'grad_norm': 0.544213593006134, 'learning_rate': 2.6238993059220395e-05}
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2700/4000 [59:09<27:13, 1.26s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2701/4000 [59:10<26:51, 1.24s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2702/4000 [59:11<27:01, 1.25s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2703/4000 [59:12<27:12, 1.26s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2704/4000 [59:14<27:14, 1.26s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2705/4000 [59:15<27:27, 1.27s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2706/4000 [59:16<27:42, 1.28s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2707/4000 [59:17<27:53, 1.29s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2708/4000 [59:19<27:40, 1.29s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2709/4000 [59:20<27:45, 1.29s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2710/4000 [59:21<27:45, 1.29s/it] {'loss': 0.0735, 'grad_norm': 0.5159136652946472, 'learning_rate': 2.5876100864730933e-05}
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2710/4000 [59:21<27:45, 1.29s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2711/4000 [59:23<27:42, 1.29s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2712/4000 [59:24<27:14, 1.27s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2713/4000 [59:25<26:45, 1.25s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2714/4000 [59:26<26:28, 1.24s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2715/4000 [59:27<26:21, 1.23s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2716/4000 [59:29<26:13, 1.23s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2717/4000 [59:30<26:13, 1.23s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2718/4000 [59:31<26:07, 1.22s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2719/4000 [59:32<26:17, 1.23s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2720/4000 [59:34<26:45, 1.25s/it] {'loss': 0.0733, 'grad_norm': 0.47056737542152405, 'learning_rate': 2.5514857506702405e-05}
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2720/4000 [59:34<26:45, 1.25s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2721/4000 [59:35<26:49, 1.26s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2722/4000 [59:36<26:46, 1.26s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2723/4000 [59:37<26:56, 1.27s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2724/4000 [59:39<26:48, 1.26s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2725/4000 [59:40<26:28, 1.25s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2726/4000 [59:41<26:31, 1.25s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2727/4000 [59:42<26:15, 1.24s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2728/4000 [59:44<26:07, 1.23s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2729/4000 [59:45<26:23, 1.25s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2730/4000 [59:46<26:49, 1.27s/it] {'loss': 0.075, 'grad_norm': 0.5399307608604431, 'learning_rate': 2.5155287675638474e-05}
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2730/4000 [59:46<26:49, 1.27s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2731/4000 [59:48<26:45, 1.27s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2732/4000 [59:49<26:29, 1.25s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2733/4000 [59:50<26:43, 1.27s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2734/4000 [59:51<26:22, 1.25s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2735/4000 [59:52<26:02, 1.24s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2736/4000 [59:54<26:27, 1.26s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2737/4000 [59:55<26:52, 1.28s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2738/4000 [59:56<27:19, 1.30s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2739/4000 [59:58<26:46, 1.27s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2740/4000 [59:59<26:38, 1.27s/it] {'loss': 0.0729, 'grad_norm': 0.5417560935020447, 'learning_rate': 2.4797415947659457e-05}
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2740/4000 [59:59<26:38, 1.27s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2741/4000 [1:00:00<26:17, 1.25s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2742/4000 [1:00:01<26:04, 1.24s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2743/4000 [1:00:03<26:29, 1.26s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2744/4000 [1:00:04<26:24, 1.26s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2745/4000 [1:00:05<26:15, 1.26s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2746/4000 [1:00:06<26:14, 1.26s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2747/4000 [1:00:08<25:56, 1.24s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2748/4000 [1:00:09<25:41, 1.23s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 2749/4000 [1:00:10<25:41, 1.23s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2750/4000 [1:00:11<25:38, 1.23s/it] {'loss': 0.063, 'grad_norm': 0.4528529644012451, 'learning_rate': 2.4441266782822588e-05}
69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2750/4000 [1:00:11<25:38, 1.23s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2751/4000 [1:00:13<26:03, 1.25s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2752/4000 [1:00:14<26:01, 1.25s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2753/4000 [1:00:15<25:39, 1.23s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2754/4000 [1:00:16<25:23, 1.22s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2755/4000 [1:00:17<25:28, 1.23s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2756/4000 [1:00:19<25:22, 1.22s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2757/4000 [1:00:20<25:24, 1.23s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2758/4000 [1:00:21<25:36, 1.24s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2759/4000 [1:00:22<25:52, 1.25s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2760/4000 [1:00:24<25:53, 1.25s/it] {'loss': 0.0686, 'grad_norm': 0.45764830708503723, 'learning_rate': 2.4086864523450183e-05}
69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2760/4000 [1:00:24<25:53, 1.25s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2761/4000 [1:00:25<25:36, 1.24s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2762/4000 [1:00:26<25:38, 1.24s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2763/4000 [1:00:27<25:26, 1.23s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2764/4000 [1:00:29<25:30, 1.24s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2765/4000 [1:00:30<25:35, 1.24s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2766/4000 [1:00:31<25:39, 1.25s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2767/4000 [1:00:32<26:03, 1.27s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2768/4000 [1:00:34<25:47, 1.26s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2769/4000 [1:00:35<25:31, 1.24s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2770/4000 [1:00:36<25:23, 1.24s/it] {'loss': 0.0684, 'grad_norm': 0.4432704448699951, 'learning_rate': 2.3734233392465903e-05}
69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2770/4000 [1:00:36<25:23, 1.24s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2771/4000 [1:00:37<25:29, 1.24s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2772/4000 [1:00:39<25:30, 1.25s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2773/4000 [1:00:40<25:28, 1.25s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2774/4000 [1:00:41<25:17, 1.24s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2775/4000 [1:00:42<25:24, 1.24s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2776/4000 [1:00:44<25:25, 1.25s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2777/4000 [1:00:45<25:25, 1.25s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2778/4000 [1:00:46<25:48, 1.27s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2779/4000 [1:00:47<25:46, 1.27s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2780/4000 [1:00:49<25:38, 1.26s/it] {'loss': 0.0717, 'grad_norm': 0.48835164308547974, 'learning_rate': 2.3383397491739145e-05}
70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2780/4000 [1:00:49<25:38, 1.26s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2781/4000 [1:00:50<25:20, 1.25s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2782/4000 [1:00:51<25:34, 1.26s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2783/4000 [1:00:52<25:26, 1.25s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2784/4000 [1:00:54<25:25, 1.25s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2785/4000 [1:00:55<25:35, 1.26s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2786/4000 [1:00:56<25:28, 1.26s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2787/4000 [1:00:57<25:27, 1.26s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2788/4000 [1:00:59<25:26, 1.26s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2789/4000 [1:01:00<25:28, 1.26s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2790/4000 [1:01:01<25:36, 1.27s/it] {'loss': 0.0636, 'grad_norm': 0.48863375186920166, 'learning_rate': 2.3034380800437678e-05}
70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2790/4000 [1:01:01<25:36, 1.27s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2791/4000 [1:01:03<25:52, 1.28s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2792/4000 [1:01:04<25:46, 1.28s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2793/4000 [1:01:05<25:39, 1.28s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2794/4000 [1:01:06<25:16, 1.26s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2795/4000 [1:01:08<25:00, 1.24s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2796/4000 [1:01:09<24:58, 1.24s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2797/4000 [1:01:10<24:41, 1.23s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2798/4000 [1:01:11<24:57, 1.25s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2799/4000 [1:01:13<24:56, 1.25s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2800/4000 [1:01:14<24:50, 1.24s/it] {'loss': 0.0739, 'grad_norm': 0.5366970896720886, 'learning_rate': 2.2687207173388743e-05}
70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2800/4000 [1:01:14<24:50, 1.24s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2801/4000 [1:01:15<24:57, 1.25s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2802/4000 [1:01:16<24:34, 1.23s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2803/4000 [1:01:17<24:42, 1.24s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2804/4000 [1:01:19<24:44, 1.24s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2805/4000 [1:01:20<24:45, 1.24s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2806/4000 [1:01:21<24:45, 1.24s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2807/4000 [1:01:22<24:54, 1.25s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2808/4000 [1:01:24<24:41, 1.24s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2809/4000 [1:01:25<24:57, 1.26s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2810/4000 [1:01:26<24:53, 1.25s/it] {'loss': 0.0712, 'grad_norm': 0.5428600907325745, 'learning_rate': 2.234190033944858e-05}
70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2810/4000 [1:01:26<24:53, 1.25s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2811/4000 [1:01:27<24:43, 1.25s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2812/4000 [1:01:29<24:36, 1.24s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2813/4000 [1:01:30<24:28, 1.24s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2814/4000 [1:01:31<24:22, 1.23s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2815/4000 [1:01:32<24:31, 1.24s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2816/4000 [1:01:34<24:23, 1.24s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2817/4000 [1:01:35<24:12, 1.23s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2818/4000 [1:01:36<24:09, 1.23s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2819/4000 [1:01:37<24:18, 1.24s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2820/4000 [1:01:39<24:22, 1.24s/it] {'loss': 0.0628, 'grad_norm': 0.5496647953987122, 'learning_rate': 2.1998483899880596e-05}
70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2820/4000 [1:01:39<24:22, 1.24s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2821/4000 [1:01:40<24:12, 1.23s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2822/4000 [1:01:41<24:24, 1.24s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2823/4000 [1:01:42<24:42, 1.26s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2824/4000 [1:01:44<24:49, 1.27s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2825/4000 [1:01:45<24:26, 1.25s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2826/4000 [1:01:46<24:21, 1.24s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2827/4000 [1:01:47<24:07, 1.23s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2828/4000 [1:01:49<24:17, 1.24s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2829/4000 [1:01:50<24:24, 1.25s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2830/4000 [1:01:51<24:07, 1.24s/it] {'loss': 0.071, 'grad_norm': 0.4688411056995392, 'learning_rate': 2.1656981326742266e-05}
71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2830/4000 [1:01:51<24:07, 1.24s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2831/4000 [1:01:52<24:02, 1.23s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2832/4000 [1:01:53<23:50, 1.22s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2833/4000 [1:01:55<24:02, 1.24s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2834/4000 [1:01:56<24:08, 1.24s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2835/4000 [1:01:57<24:13, 1.25s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2836/4000 [1:01:59<24:23, 1.26s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2837/4000 [1:02:00<24:25, 1.26s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2838/4000 [1:02:01<24:34, 1.27s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2839/4000 [1:02:02<24:48, 1.28s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2840/4000 [1:02:04<24:54, 1.29s/it] {'loss': 0.0668, 'grad_norm': 0.4862898290157318, 'learning_rate': 2.1317415961280824e-05}
71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2840/4000 [1:02:04<24:54, 1.29s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2841/4000 [1:02:05<24:47, 1.28s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2842/4000 [1:02:06<24:34, 1.27s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2843/4000 [1:02:07<24:29, 1.27s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2844/4000 [1:02:09<24:09, 1.25s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2845/4000 [1:02:10<23:50, 1.24s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2846/4000 [1:02:11<23:56, 1.24s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2847/4000 [1:02:12<24:03, 1.25s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2848/4000 [1:02:14<23:55, 1.25s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2849/4000 [1:02:15<23:57, 1.25s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2850/4000 [1:02:16<24:04, 1.26s/it] {'loss': 0.0691, 'grad_norm': 0.4756677448749542, 'learning_rate': 2.097981101233794e-05}
71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2850/4000 [1:02:16<24:04, 1.26s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2851/4000 [1:02:17<24:00, 1.25s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2852/4000 [1:02:19<23:42, 1.24s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2853/4000 [1:02:20<23:51, 1.25s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2854/4000 [1:02:21<24:00, 1.26s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2855/4000 [1:02:22<24:03, 1.26s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2856/4000 [1:02:24<24:02, 1.26s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2857/4000 [1:02:25<23:57, 1.26s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2858/4000 [1:02:26<23:42, 1.25s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2859/4000 [1:02:27<23:48, 1.25s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2860/4000 [1:02:29<23:47, 1.25s/it] {'loss': 0.0664, 'grad_norm': 0.4609115719795227, 'learning_rate': 2.0644189554763417e-05}
72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2860/4000 [1:02:29<23:47, 1.25s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2861/4000 [1:02:30<23:44, 1.25s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2862/4000 [1:02:31<23:38, 1.25s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2863/4000 [1:02:32<23:49, 1.26s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2864/4000 [1:02:34<23:54, 1.26s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2865/4000 [1:02:35<23:42, 1.25s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2866/4000 [1:02:36<23:25, 1.24s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2867/4000 [1:02:37<23:30, 1.24s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2868/4000 [1:02:39<23:35, 1.25s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2869/4000 [1:02:40<23:32, 1.25s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2870/4000 [1:02:41<23:31, 1.25s/it] {'loss': 0.0645, 'grad_norm': 0.5549404621124268, 'learning_rate': 2.0310574527838072e-05}
72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2870/4000 [1:02:41<23:31, 1.25s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2871/4000 [1:02:42<23:31, 1.25s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2872/4000 [1:02:44<23:23, 1.24s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2873/4000 [1:02:45<23:28, 1.25s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2874/4000 [1:02:46<23:22, 1.25s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2875/4000 [1:02:47<23:08, 1.23s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2876/4000 [1:02:49<23:07, 1.23s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2877/4000 [1:02:50<23:22, 1.25s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2878/4000 [1:02:51<23:23, 1.25s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2879/4000 [1:02:52<23:34, 1.26s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2880/4000 [1:02:54<23:20, 1.25s/it] {'loss': 0.0659, 'grad_norm': 0.46697044372558594, 'learning_rate': 1.9978988733705807e-05}
72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2880/4000 [1:02:54<23:20, 1.25s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2881/4000 [1:02:55<23:37, 1.27s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2882/4000 [1:02:56<23:53, 1.28s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2883/4000 [1:02:58<24:01, 1.29s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2884/4000 [1:02:59<23:46, 1.28s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2885/4000 [1:03:00<23:43, 1.28s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2886/4000 [1:03:01<23:44, 1.28s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2887/4000 [1:03:03<23:37, 1.27s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2888/4000 [1:03:04<23:45, 1.28s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2889/4000 [1:03:05<23:52, 1.29s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2890/4000 [1:03:07<23:41, 1.28s/it] {'loss': 0.0667, 'grad_norm': 0.45307600498199463, 'learning_rate': 1.9649454835815202e-05}
72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2890/4000 [1:03:07<23:41, 1.28s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2891/4000 [1:03:08<23:20, 1.26s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2892/4000 [1:03:09<23:13, 1.26s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2893/4000 [1:03:10<23:10, 1.26s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2894/4000 [1:03:12<23:01, 1.25s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2895/4000 [1:03:13<23:23, 1.27s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2896/4000 [1:03:14<23:33, 1.28s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2897/4000 [1:03:15<23:40, 1.29s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2898/4000 [1:03:17<23:13, 1.26s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2899/4000 [1:03:18<23:11, 1.26s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2900/4000 [1:03:19<22:57, 1.25s/it] {'loss': 0.0712, 'grad_norm': 0.4589666724205017, 'learning_rate': 1.932199535737045e-05}
72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2900/4000 [1:03:19<22:57, 1.25s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2901/4000 [1:03:20<22:40, 1.24s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2902/4000 [1:03:22<22:32, 1.23s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2903/4000 [1:03:23<22:34, 1.23s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2904/4000 [1:03:24<22:50, 1.25s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2905/4000 [1:03:25<22:57, 1.26s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2906/4000 [1:03:27<22:36, 1.24s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2907/4000 [1:03:28<22:23, 1.23s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2908/4000 [1:03:29<22:14, 1.22s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2909/4000 [1:03:30<22:30, 1.24s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2910/4000 [1:03:31<22:19, 1.23s/it] {'loss': 0.0935, 'grad_norm': 0.3701469898223877, 'learning_rate': 1.8996632679791914e-05}
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2910/4000 [1:03:31<22:19, 1.23s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2911/4000 [1:03:33<22:28, 1.24s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2912/4000 [1:03:34<22:25, 1.24s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2913/4000 [1:03:35<22:10, 1.22s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2914/4000 [1:03:36<22:04, 1.22s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2915/4000 [1:03:38<22:00, 1.22s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2916/4000 [1:03:39<22:10, 1.23s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2917/4000 [1:03:40<22:05, 1.22s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2918/4000 [1:03:41<22:22, 1.24s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2919/4000 [1:03:43<22:17, 1.24s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2920/4000 [1:03:44<22:06, 1.23s/it] {'loss': 0.0685, 'grad_norm': 0.40570753812789917, 'learning_rate': 1.8673389041186418e-05}
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2920/4000 [1:03:44<22:06, 1.23s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2921/4000 [1:03:45<22:20, 1.24s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2922/4000 [1:03:46<22:17, 1.24s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2923/4000 [1:03:48<22:31, 1.26s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2924/4000 [1:03:49<22:32, 1.26s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2925/4000 [1:03:50<22:34, 1.26s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2926/4000 [1:03:51<22:26, 1.25s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2927/4000 [1:03:53<22:24, 1.25s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2928/4000 [1:03:54<22:32, 1.26s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2929/4000 [1:03:55<22:22, 1.25s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2930/4000 [1:03:56<22:24, 1.26s/it] {'loss': 0.0665, 'grad_norm': 0.3727874457836151, 'learning_rate': 1.8352286534827274e-05}
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2930/4000 [1:03:56<22:24, 1.26s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2931/4000 [1:03:58<22:19, 1.25s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2932/4000 [1:03:59<22:20, 1.26s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2933/4000 [1:04:00<22:13, 1.25s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2934/4000 [1:04:01<22:08, 1.25s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2935/4000 [1:04:03<22:25, 1.26s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2936/4000 [1:04:04<22:03, 1.24s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2937/4000 [1:04:05<21:58, 1.24s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2938/4000 [1:04:06<22:08, 1.25s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2939/4000 [1:04:08<21:59, 1.24s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2940/4000 [1:04:09<21:48, 1.23s/it] {'loss': 0.0646, 'grad_norm': 0.3262968957424164, 'learning_rate': 1.803334710764426e-05}
74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2940/4000 [1:04:09<21:48, 1.23s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2941/4000 [1:04:10<21:43, 1.23s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2942/4000 [1:04:11<21:46, 1.23s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2943/4000 [1:04:12<21:43, 1.23s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2944/4000 [1:04:14<21:51, 1.24s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2945/4000 [1:04:15<21:59, 1.25s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2946/4000 [1:04:16<22:09, 1.26s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2947/4000 [1:04:18<22:11, 1.26s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2948/4000 [1:04:19<22:04, 1.26s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 2949/4000 [1:04:20<22:07, 1.26s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2950/4000 [1:04:21<21:49, 1.25s/it] {'loss': 0.064, 'grad_norm': 0.4193762540817261, 'learning_rate': 1.7716592558723556e-05}
74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2950/4000 [1:04:21<21:49, 1.25s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2951/4000 [1:04:23<21:53, 1.25s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2952/4000 [1:04:24<21:40, 1.24s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2953/4000 [1:04:25<21:49, 1.25s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2954/4000 [1:04:26<21:36, 1.24s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2955/4000 [1:04:28<21:41, 1.25s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2956/4000 [1:04:29<21:49, 1.25s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2957/4000 [1:04:30<22:46, 1.31s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2958/4000 [1:04:31<22:22, 1.29s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2959/4000 [1:04:33<21:55, 1.26s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2960/4000 [1:04:34<21:49, 1.26s/it] {'loss': 0.0817, 'grad_norm': 0.39443841576576233, 'learning_rate': 1.7402044537817824e-05}
74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2960/4000 [1:04:34<21:49, 1.26s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2961/4000 [1:04:35<21:42, 1.25s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2962/4000 [1:04:36<21:40, 1.25s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2963/4000 [1:04:38<22:30, 1.30s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2964/4000 [1:04:39<22:18, 1.29s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2965/4000 [1:04:40<22:02, 1.28s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2966/4000 [1:04:42<21:36, 1.25s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2967/4000 [1:04:43<21:39, 1.26s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2968/4000 [1:04:44<21:36, 1.26s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2969/4000 [1:04:45<22:23, 1.30s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2970/4000 [1:04:47<22:06, 1.29s/it] {'loss': 0.0709, 'grad_norm': 0.4937986135482788, 'learning_rate': 1.7089724543866465e-05}
74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2970/4000 [1:04:47<22:06, 1.29s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2971/4000 [1:04:48<21:45, 1.27s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2972/4000 [1:04:49<21:47, 1.27s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2973/4000 [1:04:50<21:43, 1.27s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2974/4000 [1:04:52<21:35, 1.26s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2975/4000 [1:04:53<22:32, 1.32s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2976/4000 [1:04:55<23:17, 1.36s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2977/4000 [1:04:56<22:48, 1.34s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2978/4000 [1:04:57<22:34, 1.33s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2979/4000 [1:04:58<22:10, 1.30s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2980/4000 [1:05:00<21:51, 1.29s/it] {'loss': 0.0652, 'grad_norm': 0.5134919881820679, 'learning_rate': 1.6779653923526188e-05}
74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2980/4000 [1:05:00<21:51, 1.29s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2981/4000 [1:05:01<21:26, 1.26s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2982/4000 [1:05:02<21:12, 1.25s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2983/4000 [1:05:03<21:02, 1.24s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2984/4000 [1:05:05<21:04, 1.24s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2985/4000 [1:05:06<20:57, 1.24s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2986/4000 [1:05:07<21:01, 1.24s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2987/4000 [1:05:08<20:54, 1.24s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2988/4000 [1:05:10<20:44, 1.23s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2989/4000 [1:05:11<20:42, 1.23s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2990/4000 [1:05:12<21:06, 1.25s/it] {'loss': 0.0583, 'grad_norm': 0.42637699842453003, 'learning_rate': 1.6471853869712023e-05}
75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2990/4000 [1:05:12<21:06, 1.25s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2991/4000 [1:05:13<21:20, 1.27s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2992/4000 [1:05:15<21:02, 1.25s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2993/4000 [1:05:16<21:25, 1.28s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2994/4000 [1:05:17<21:18, 1.27s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2995/4000 [1:05:18<20:54, 1.25s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2996/4000 [1:05:20<21:03, 1.26s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2997/4000 [1:05:21<21:31, 1.29s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2998/4000 [1:05:22<21:28, 1.29s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 2999/4000 [1:05:24<21:06, 1.27s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3000/4000 [1:05:25<21:09, 1.27s/it] {'loss': 0.0749, 'grad_norm': 0.41232460737228394, 'learning_rate': 1.6166345420148787e-05}
75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3000/4000 [1:05:25<21:09, 1.27s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3001/4000 [1:05:26<21:05, 1.27s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3002/4000 [1:05:27<20:48, 1.25s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3003/4000 [1:05:29<20:43, 1.25s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3004/4000 [1:05:30<20:30, 1.24s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3005/4000 [1:05:31<20:25, 1.23s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3006/4000 [1:05:32<20:40, 1.25s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3007/4000 [1:05:33<20:30, 1.24s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3008/4000 [1:05:35<20:31, 1.24s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3009/4000 [1:05:36<20:33, 1.24s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3010/4000 [1:05:37<20:32, 1.25s/it] {'loss': 0.0664, 'grad_norm': 0.44901329278945923, 'learning_rate': 1.5863149455933158e-05}
75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3010/4000 [1:05:37<20:32, 1.25s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3011/4000 [1:05:38<20:34, 1.25s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3012/4000 [1:05:40<20:49, 1.26s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3013/4000 [1:05:41<20:27, 1.24s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3014/4000 [1:05:42<20:38, 1.26s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3015/4000 [1:05:44<20:46, 1.27s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3016/4000 [1:05:45<20:47, 1.27s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3017/4000 [1:05:46<20:35, 1.26s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3018/4000 [1:05:47<20:36, 1.26s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3019/4000 [1:05:49<20:24, 1.25s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3020/4000 [1:05:50<20:35, 1.26s/it] {'loss': 0.0799, 'grad_norm': 0.41246625781059265, 'learning_rate': 1.5562286700106558e-05}
76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3020/4000 [1:05:50<20:35, 1.26s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3021/4000 [1:05:51<20:38, 1.26s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3022/4000 [1:05:52<20:23, 1.25s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3023/4000 [1:05:54<20:22, 1.25s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3024/4000 [1:05:55<20:34, 1.26s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3025/4000 [1:05:56<20:31, 1.26s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3026/4000 [1:05:57<20:26, 1.26s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3027/4000 [1:05:59<20:08, 1.24s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3028/4000 [1:06:00<20:20, 1.26s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3029/4000 [1:06:01<20:23, 1.26s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3030/4000 [1:06:02<20:40, 1.28s/it] {'loss': 0.0646, 'grad_norm': 0.46509429812431335, 'learning_rate': 1.526377771623869e-05}
76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3030/4000 [1:06:02<20:40, 1.28s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3031/4000 [1:06:04<20:37, 1.28s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3032/4000 [1:06:05<20:35, 1.28s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3033/4000 [1:06:06<20:18, 1.26s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3034/4000 [1:06:07<20:11, 1.25s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3035/4000 [1:06:09<20:14, 1.26s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3036/4000 [1:06:10<19:59, 1.24s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3037/4000 [1:06:11<19:57, 1.24s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3038/4000 [1:06:12<20:15, 1.26s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3039/4000 [1:06:14<20:00, 1.25s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3040/4000 [1:06:15<19:58, 1.25s/it] {'loss': 0.0587, 'grad_norm': 0.39172083139419556, 'learning_rate': 1.496764290702209e-05}
76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3040/4000 [1:06:15<19:58, 1.25s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3041/4000 [1:06:16<20:01, 1.25s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3042/4000 [1:06:17<19:57, 1.25s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3043/4000 [1:06:19<19:48, 1.24s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3044/4000 [1:06:20<20:07, 1.26s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3045/4000 [1:06:21<20:06, 1.26s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3046/4000 [1:06:22<19:54, 1.25s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3047/4000 [1:06:24<19:46, 1.24s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3048/4000 [1:06:25<19:56, 1.26s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3049/4000 [1:06:26<19:44, 1.25s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3050/4000 [1:06:27<19:42, 1.24s/it] {'loss': 0.0709, 'grad_norm': 0.4157451391220093, 'learning_rate': 1.4673902512877585e-05}
76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3050/4000 [1:06:27<19:42, 1.24s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3051/4000 [1:06:29<19:45, 1.25s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3052/4000 [1:06:30<19:35, 1.24s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3053/4000 [1:06:31<20:00, 1.27s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3054/4000 [1:06:33<20:10, 1.28s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3055/4000 [1:06:34<20:12, 1.28s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3056/4000 [1:06:35<20:07, 1.28s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3057/4000 [1:06:36<19:46, 1.26s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3058/4000 [1:06:38<19:52, 1.27s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3059/4000 [1:06:39<19:36, 1.25s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3060/4000 [1:06:40<19:27, 1.24s/it] {'loss': 0.0725, 'grad_norm': 0.4103890657424927, 'learning_rate': 1.438257661057093e-05}
76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3060/4000 [1:06:40<19:27, 1.24s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3061/4000 [1:06:41<19:29, 1.25s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3062/4000 [1:06:43<19:19, 1.24s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3063/4000 [1:06:44<19:31, 1.25s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3064/4000 [1:06:45<19:44, 1.27s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3065/4000 [1:06:46<19:39, 1.26s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3066/4000 [1:06:48<19:20, 1.24s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3067/4000 [1:06:49<19:13, 1.24s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3068/4000 [1:06:50<19:35, 1.26s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3069/4000 [1:06:51<19:25, 1.25s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3070/4000 [1:06:53<19:13, 1.24s/it] {'loss': 0.0772, 'grad_norm': 0.44847020506858826, 'learning_rate': 1.4093685111840566e-05}
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3070/4000 [1:06:53<19:13, 1.24s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3071/4000 [1:06:54<19:01, 1.23s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3072/4000 [1:06:55<18:54, 1.22s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3073/4000 [1:06:56<19:08, 1.24s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3074/4000 [1:06:58<19:14, 1.25s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3075/4000 [1:06:59<19:26, 1.26s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3076/4000 [1:07:00<19:08, 1.24s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3077/4000 [1:07:01<19:12, 1.25s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3078/4000 [1:07:03<19:17, 1.26s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3079/4000 [1:07:04<19:11, 1.25s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3080/4000 [1:07:05<19:04, 1.24s/it] {'loss': 0.0701, 'grad_norm': 0.4212464392185211, 'learning_rate': 1.380724776203668e-05}
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3080/4000 [1:07:05<19:04, 1.24s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3081/4000 [1:07:06<19:20, 1.26s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3082/4000 [1:07:08<19:17, 1.26s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3083/4000 [1:07:09<19:24, 1.27s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3084/4000 [1:07:10<19:14, 1.26s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3085/4000 [1:07:11<19:21, 1.27s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3086/4000 [1:07:13<19:30, 1.28s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3087/4000 [1:07:14<19:25, 1.28s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3088/4000 [1:07:15<19:26, 1.28s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3089/4000 [1:07:16<19:06, 1.26s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3090/4000 [1:07:18<19:01, 1.25s/it] {'loss': 0.0712, 'grad_norm': 0.39393168687820435, 'learning_rate': 1.3523284138771642e-05}
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3090/4000 [1:07:18<19:01, 1.25s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3091/4000 [1:07:19<18:55, 1.25s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3092/4000 [1:07:20<18:47, 1.24s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3093/4000 [1:07:21<18:57, 1.25s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3094/4000 [1:07:23<18:49, 1.25s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3095/4000 [1:07:24<18:51, 1.25s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3096/4000 [1:07:25<18:39, 1.24s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3097/4000 [1:07:27<19:23, 1.29s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3098/4000 [1:07:28<19:17, 1.28s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3099/4000 [1:07:29<19:13, 1.28s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3100/4000 [1:07:30<19:01, 1.27s/it] {'loss': 0.0723, 'grad_norm': 0.4276193380355835, 'learning_rate': 1.3241813650581902e-05}
78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3100/4000 [1:07:30<19:01, 1.27s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3101/4000 [1:07:32<18:59, 1.27s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3102/4000 [1:07:33<18:57, 1.27s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3103/4000 [1:07:34<18:42, 1.25s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3104/4000 [1:07:35<18:31, 1.24s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3105/4000 [1:07:37<18:32, 1.24s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3106/4000 [1:07:38<18:51, 1.27s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3107/4000 [1:07:39<18:44, 1.26s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3108/4000 [1:07:40<18:49, 1.27s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3109/4000 [1:07:42<18:52, 1.27s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3110/4000 [1:07:43<18:32, 1.25s/it] {'loss': 0.0805, 'grad_norm': 0.4562000334262848, 'learning_rate': 1.2962855535601438e-05}
78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3110/4000 [1:07:43<18:32, 1.25s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3111/4000 [1:07:44<18:48, 1.27s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3112/4000 [1:07:45<18:56, 1.28s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3113/4000 [1:07:47<19:03, 1.29s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3114/4000 [1:07:48<18:46, 1.27s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3115/4000 [1:07:49<18:52, 1.28s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3116/4000 [1:07:51<18:51, 1.28s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3117/4000 [1:07:52<18:28, 1.26s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3118/4000 [1:07:53<18:30, 1.26s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3119/4000 [1:07:54<18:42, 1.27s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3120/4000 [1:07:56<18:35, 1.27s/it] {'loss': 0.062, 'grad_norm': 0.4107629954814911, 'learning_rate': 1.2686428860246852e-05}
78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3120/4000 [1:07:56<18:35, 1.27s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3121/4000 [1:07:57<18:42, 1.28s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3122/4000 [1:07:58<18:18, 1.25s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3123/4000 [1:07:59<18:16, 1.25s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3124/4000 [1:08:01<18:03, 1.24s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3125/4000 [1:08:02<18:14, 1.25s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3126/4000 [1:08:03<18:09, 1.25s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3127/4000 [1:08:04<18:21, 1.26s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3128/4000 [1:08:06<18:14, 1.25s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3129/4000 [1:08:07<18:14, 1.26s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3130/4000 [1:08:08<18:00, 1.24s/it] {'loss': 0.0726, 'grad_norm': 0.5431340932846069, 'learning_rate': 1.241255251791421e-05}
78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3130/4000 [1:08:08<18:00, 1.24s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3131/4000 [1:08:09<17:54, 1.24s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3132/4000 [1:08:11<17:56, 1.24s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3133/4000 [1:08:12<18:07, 1.25s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3134/4000 [1:08:13<17:54, 1.24s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3135/4000 [1:08:14<18:05, 1.26s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3136/4000 [1:08:16<17:53, 1.24s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3137/4000 [1:08:17<17:49, 1.24s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3138/4000 [1:08:18<17:38, 1.23s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3139/4000 [1:08:19<17:34, 1.22s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3140/4000 [1:08:20<17:26, 1.22s/it] {'loss': 0.0717, 'grad_norm': 0.35672733187675476, 'learning_rate': 1.2141245227687731e-05}
78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3140/4000 [1:08:20<17:26, 1.22s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3141/4000 [1:08:22<17:23, 1.22s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3142/4000 [1:08:23<17:26, 1.22s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3143/4000 [1:08:24<17:32, 1.23s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3144/4000 [1:08:25<17:25, 1.22s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3145/4000 [1:08:27<17:36, 1.24s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3146/4000 [1:08:28<17:46, 1.25s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3147/4000 [1:08:29<17:36, 1.24s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3148/4000 [1:08:30<17:52, 1.26s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3149/4000 [1:08:32<17:51, 1.26s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3150/4000 [1:08:33<17:54, 1.26s/it] {'loss': 0.0687, 'grad_norm': 0.46156755089759827, 'learning_rate': 1.1872525533060269e-05}
79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3150/4000 [1:08:33<17:54, 1.26s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3151/4000 [1:08:34<18:04, 1.28s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3152/4000 [1:08:35<17:53, 1.27s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3153/4000 [1:08:37<18:06, 1.28s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3154/4000 [1:08:38<18:19, 1.30s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3155/4000 [1:08:39<17:53, 1.27s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3156/4000 [1:08:41<18:00, 1.28s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3157/4000 [1:08:42<18:16, 1.30s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3158/4000 [1:08:43<18:25, 1.31s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3159/4000 [1:08:45<17:59, 1.28s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3160/4000 [1:08:46<17:44, 1.27s/it] {'loss': 0.0642, 'grad_norm': 0.419677197933197, 'learning_rate': 1.1606411800666028e-05}
79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3160/4000 [1:08:46<17:44, 1.27s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3161/4000 [1:08:47<17:38, 1.26s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3162/4000 [1:08:48<17:22, 1.24s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3163/4000 [1:08:50<17:30, 1.25s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3164/4000 [1:08:51<17:27, 1.25s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3165/4000 [1:08:52<17:33, 1.26s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3166/4000 [1:08:53<17:41, 1.27s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3167/4000 [1:08:55<17:26, 1.26s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3168/4000 [1:08:56<17:22, 1.25s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3169/4000 [1:08:57<17:26, 1.26s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3170/4000 [1:08:58<17:30, 1.27s/it] {'loss': 0.07, 'grad_norm': 0.3510105013847351, 'learning_rate': 1.134292221902511e-05}
79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3170/4000 [1:08:58<17:30, 1.27s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3171/4000 [1:09:00<17:25, 1.26s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3172/4000 [1:09:01<17:35, 1.27s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3173/4000 [1:09:02<17:46, 1.29s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3174/4000 [1:09:03<17:39, 1.28s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3175/4000 [1:09:05<17:33, 1.28s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3176/4000 [1:09:06<17:28, 1.27s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3177/4000 [1:09:07<17:20, 1.26s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3178/4000 [1:09:08<17:03, 1.25s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3179/4000 [1:09:10<17:00, 1.24s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3180/4000 [1:09:11<16:52, 1.23s/it] {'loss': 0.0649, 'grad_norm': 0.37449365854263306, 'learning_rate': 1.1082074797300413e-05}
80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3180/4000 [1:09:11<16:52, 1.23s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3181/4000 [1:09:12<17:13, 1.26s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3182/4000 [1:09:13<16:58, 1.25s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3183/4000 [1:09:15<16:54, 1.24s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3184/4000 [1:09:16<16:57, 1.25s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3185/4000 [1:09:17<16:52, 1.24s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3186/4000 [1:09:18<16:53, 1.24s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3187/4000 [1:09:20<16:55, 1.25s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3188/4000 [1:09:21<16:57, 1.25s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3189/4000 [1:09:22<16:47, 1.24s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3190/4000 [1:09:23<16:46, 1.24s/it] {'loss': 0.0703, 'grad_norm': 0.43132704496383667, 'learning_rate': 1.0823887364066737e-05}
80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3190/4000 [1:09:23<16:46, 1.24s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3191/4000 [1:09:25<16:52, 1.25s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3192/4000 [1:09:26<16:48, 1.25s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3193/4000 [1:09:27<16:46, 1.25s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3194/4000 [1:09:28<16:42, 1.24s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3195/4000 [1:09:30<16:33, 1.23s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3196/4000 [1:09:31<16:39, 1.24s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3197/4000 [1:09:32<16:54, 1.26s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3198/4000 [1:09:33<16:58, 1.27s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3199/4000 [1:09:35<16:46, 1.26s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3200/4000 [1:09:36<16:34, 1.24s/it] {'loss': 0.0773, 'grad_norm': 0.4139363467693329, 'learning_rate': 1.0568377566092164e-05}
80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3200/4000 [1:09:36<16:34, 1.24s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3201/4000 [1:09:37<16:24, 1.23s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3202/4000 [1:09:38<16:19, 1.23s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3203/4000 [1:09:40<16:12, 1.22s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3204/4000 [1:09:41<16:18, 1.23s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3205/4000 [1:09:42<16:28, 1.24s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3206/4000 [1:09:43<16:41, 1.26s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3207/4000 [1:09:45<16:44, 1.27s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3208/4000 [1:09:46<16:51, 1.28s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3209/4000 [1:09:47<16:42, 1.27s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3210/4000 [1:09:48<16:28, 1.25s/it] {'loss': 0.0684, 'grad_norm': 0.38517189025878906, 'learning_rate': 1.0315562867131983e-05}
80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3210/4000 [1:09:48<16:28, 1.25s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3211/4000 [1:09:50<16:29, 1.25s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3212/4000 [1:09:51<16:17, 1.24s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3213/4000 [1:09:52<16:35, 1.26s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3214/4000 [1:09:53<16:30, 1.26s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3215/4000 [1:09:55<16:35, 1.27s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3216/4000 [1:09:56<16:27, 1.26s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3217/4000 [1:09:57<16:15, 1.25s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3218/4000 [1:09:58<16:26, 1.26s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3219/4000 [1:10:00<16:15, 1.25s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3220/4000 [1:10:01<16:15, 1.25s/it] {'loss': 0.0614, 'grad_norm': 0.38649749755859375, 'learning_rate': 1.0065460546735045e-05}
80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3220/4000 [1:10:01<16:15, 1.25s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3221/4000 [1:10:02<16:21, 1.26s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3222/4000 [1:10:04<16:20, 1.26s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3223/4000 [1:10:05<16:18, 1.26s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3224/4000 [1:10:06<16:05, 1.24s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3225/4000 [1:10:07<16:10, 1.25s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3226/4000 [1:10:08<16:03, 1.24s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3227/4000 [1:10:10<16:08, 1.25s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3228/4000 [1:10:11<16:03, 1.25s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3229/4000 [1:10:12<15:56, 1.24s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3230/4000 [1:10:14<16:11, 1.26s/it] {'loss': 0.0655, 'grad_norm': 0.3905535638332367, 'learning_rate': 9.818087699062716e-06}
81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3230/4000 [1:10:14<16:11, 1.26s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3231/4000 [1:10:15<16:00, 1.25s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3232/4000 [1:10:16<16:12, 1.27s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3233/4000 [1:10:17<16:20, 1.28s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3234/4000 [1:10:19<16:05, 1.26s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3235/4000 [1:10:20<15:52, 1.25s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3236/4000 [1:10:21<15:40, 1.23s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3237/4000 [1:10:22<15:44, 1.24s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3238/4000 [1:10:23<15:49, 1.25s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3239/4000 [1:10:25<15:56, 1.26s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3240/4000 [1:10:26<15:52, 1.25s/it] {'loss': 0.0549, 'grad_norm': 0.36156898736953735, 'learning_rate': 9.57346123172055e-06}
81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3240/4000 [1:10:26<15:52, 1.25s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3241/4000 [1:10:27<15:58, 1.26s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3242/4000 [1:10:29<16:00, 1.27s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3243/4000 [1:10:30<15:48, 1.25s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3244/4000 [1:10:31<15:48, 1.25s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3245/4000 [1:10:32<15:45, 1.25s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3246/4000 [1:10:34<15:56, 1.27s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3247/4000 [1:10:35<15:55, 1.27s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3248/4000 [1:10:36<15:42, 1.25s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3249/4000 [1:10:37<15:41, 1.25s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3250/4000 [1:10:39<15:31, 1.24s/it] {'loss': 0.0559, 'grad_norm': 0.38421037793159485, 'learning_rate': 9.331597864602632e-06}
81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3250/4000 [1:10:39<15:31, 1.24s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3251/4000 [1:10:40<15:34, 1.25s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3252/4000 [1:10:41<15:23, 1.23s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3253/4000 [1:10:42<15:25, 1.24s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3254/4000 [1:10:43<15:12, 1.22s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3255/4000 [1:10:45<15:06, 1.22s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3256/4000 [1:10:46<15:10, 1.22s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3257/4000 [1:10:47<15:20, 1.24s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3258/4000 [1:10:48<15:23, 1.24s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3259/4000 [1:10:50<15:27, 1.25s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3260/4000 [1:10:51<15:13, 1.24s/it] {'loss': 0.0801, 'grad_norm': 0.3418523967266083, 'learning_rate': 9.09251412874882e-06}
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3260/4000 [1:10:51<15:13, 1.24s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3261/4000 [1:10:52<15:10, 1.23s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3262/4000 [1:10:53<15:09, 1.23s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3263/4000 [1:10:55<15:08, 1.23s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3264/4000 [1:10:56<15:14, 1.24s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3265/4000 [1:10:57<15:10, 1.24s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3266/4000 [1:10:58<15:21, 1.26s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3267/4000 [1:11:00<15:19, 1.25s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3268/4000 [1:11:01<15:10, 1.24s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3269/4000 [1:11:02<15:21, 1.26s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3270/4000 [1:11:03<15:27, 1.27s/it] {'loss': 0.0643, 'grad_norm': 0.32337552309036255, 'learning_rate': 8.856226365214897e-06}
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3270/4000 [1:11:03<15:27, 1.27s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3271/4000 [1:11:05<15:40, 1.29s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3272/4000 [1:11:06<15:31, 1.28s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3273/4000 [1:11:07<15:14, 1.26s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3274/4000 [1:11:08<14:59, 1.24s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3275/4000 [1:11:10<15:14, 1.26s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3276/4000 [1:11:11<15:19, 1.27s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3277/4000 [1:11:12<15:27, 1.28s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3278/4000 [1:11:14<15:17, 1.27s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3279/4000 [1:11:15<15:19, 1.27s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3280/4000 [1:11:16<15:18, 1.28s/it] {'loss': 0.0579, 'grad_norm': 0.36987099051475525, 'learning_rate': 8.622750723955597e-06}
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3280/4000 [1:11:16<15:18, 1.28s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3281/4000 [1:11:17<15:05, 1.26s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3282/4000 [1:11:19<15:14, 1.27s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3283/4000 [1:11:20<15:17, 1.28s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3284/4000 [1:11:21<15:02, 1.26s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3285/4000 [1:11:22<15:09, 1.27s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3286/4000 [1:11:24<15:01, 1.26s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3287/4000 [1:11:25<15:01, 1.26s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3288/4000 [1:11:26<15:01, 1.27s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3289/4000 [1:11:27<14:45, 1.25s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3290/4000 [1:11:29<14:46, 1.25s/it] {'loss': 0.0664, 'grad_norm': 0.3728644549846649, 'learning_rate': 8.392103162720883e-06}
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3290/4000 [1:11:29<14:46, 1.25s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3291/4000 [1:11:30<14:38, 1.24s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3292/4000 [1:11:31<14:35, 1.24s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3293/4000 [1:11:32<14:43, 1.25s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3294/4000 [1:11:34<14:51, 1.26s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3295/4000 [1:11:35<14:48, 1.26s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3296/4000 [1:11:36<14:37, 1.25s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3297/4000 [1:11:37<14:28, 1.24s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3298/4000 [1:11:39<14:21, 1.23s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3299/4000 [1:11:40<14:25, 1.23s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3300/4000 [1:11:41<14:29, 1.24s/it] {'loss': 0.0593, 'grad_norm': 0.33690232038497925, 'learning_rate': 8.164299445965167e-06}
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3300/4000 [1:11:41<14:29, 1.24s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3301/4000 [1:11:42<14:28, 1.24s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3302/4000 [1:11:44<14:31, 1.25s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3303/4000 [1:11:45<14:37, 1.26s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3304/4000 [1:11:46<14:35, 1.26s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3305/4000 [1:11:47<14:34, 1.26s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3306/4000 [1:11:49<14:19, 1.24s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3307/4000 [1:11:50<14:27, 1.25s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3308/4000 [1:11:51<14:29, 1.26s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3309/4000 [1:11:52<14:23, 1.25s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3310/4000 [1:11:54<14:17, 1.24s/it] {'loss': 0.0574, 'grad_norm': 0.3213918209075928, 'learning_rate': 7.939355143769905e-06}
83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3310/4000 [1:11:54<14:17, 1.24s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3311/4000 [1:11:55<14:14, 1.24s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3312/4000 [1:11:56<14:16, 1.25s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3313/4000 [1:11:57<14:08, 1.24s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3314/4000 [1:11:59<14:16, 1.25s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3315/4000 [1:12:00<14:32, 1.27s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3316/4000 [1:12:01<14:32, 1.28s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3317/4000 [1:12:03<14:42, 1.29s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3318/4000 [1:12:04<14:29, 1.27s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3319/4000 [1:12:05<14:18, 1.26s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3320/4000 [1:12:06<14:25, 1.27s/it] {'loss': 0.0593, 'grad_norm': 0.3636602759361267, 'learning_rate': 7.717285630779341e-06}
83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3320/4000 [1:12:06<14:25, 1.27s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3321/4000 [1:12:08<14:14, 1.26s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3322/4000 [1:12:09<14:01, 1.24s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3323/4000 [1:12:10<13:53, 1.23s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3324/4000 [1:12:11<14:02, 1.25s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3325/4000 [1:12:13<14:01, 1.25s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3326/4000 [1:12:14<14:01, 1.25s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3327/4000 [1:12:15<13:52, 1.24s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3328/4000 [1:12:16<13:54, 1.24s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3329/4000 [1:12:17<13:52, 1.24s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3330/4000 [1:12:19<13:48, 1.24s/it] {'loss': 0.0677, 'grad_norm': 0.3551225960254669, 'learning_rate': 7.498106085149697e-06}
83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3330/4000 [1:12:19<13:48, 1.24s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3331/4000 [1:12:20<13:44, 1.23s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3332/4000 [1:12:21<13:37, 1.22s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3333/4000 [1:12:22<14:01, 1.26s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3334/4000 [1:12:24<13:58, 1.26s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3335/4000 [1:12:25<13:51, 1.25s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3336/4000 [1:12:26<13:54, 1.26s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3337/4000 [1:12:27<13:41, 1.24s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3338/4000 [1:12:29<13:39, 1.24s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3339/4000 [1:12:30<13:38, 1.24s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3340/4000 [1:12:31<13:38, 1.24s/it] {'loss': 0.0619, 'grad_norm': 0.34419408440589905, 'learning_rate': 7.2818314875117755e-06}
84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3340/4000 [1:12:31<13:38, 1.24s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3341/4000 [1:12:32<13:44, 1.25s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3342/4000 [1:12:34<13:38, 1.24s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3343/4000 [1:12:35<13:40, 1.25s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3344/4000 [1:12:36<13:40, 1.25s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3345/4000 [1:12:37<13:44, 1.26s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3346/4000 [1:12:39<13:38, 1.25s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3347/4000 [1:12:40<13:34, 1.25s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3348/4000 [1:12:41<13:39, 1.26s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3349/4000 [1:12:42<13:45, 1.27s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3350/4000 [1:12:44<13:59, 1.29s/it] {'loss': 0.0691, 'grad_norm': 0.37677714228630066, 'learning_rate': 7.06847661994704e-06}
84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3350/4000 [1:12:44<13:59, 1.29s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3351/4000 [1:12:45<13:44, 1.27s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3352/4000 [1:12:46<13:35, 1.26s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3353/4000 [1:12:48<13:31, 1.25s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3354/4000 [1:12:49<13:30, 1.26s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3355/4000 [1:12:50<13:30, 1.26s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3356/4000 [1:12:51<13:29, 1.26s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3357/4000 [1:12:53<13:21, 1.25s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3358/4000 [1:12:54<13:19, 1.25s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3359/4000 [1:12:55<13:27, 1.26s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3360/4000 [1:12:56<13:36, 1.28s/it] {'loss': 0.0609, 'grad_norm': 0.32373642921447754, 'learning_rate': 6.85805606497727e-06}
84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3360/4000 [1:12:56<13:36, 1.28s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3361/4000 [1:12:58<13:36, 1.28s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3362/4000 [1:12:59<13:27, 1.27s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3363/4000 [1:13:00<13:24, 1.26s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3364/4000 [1:13:01<13:26, 1.27s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3365/4000 [1:13:03<13:14, 1.25s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3366/4000 [1:13:04<13:10, 1.25s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3367/4000 [1:13:05<13:04, 1.24s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3368/4000 [1:13:06<12:56, 1.23s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3369/4000 [1:13:08<12:53, 1.23s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3370/4000 [1:13:09<12:56, 1.23s/it] {'loss': 0.0787, 'grad_norm': 0.32138288021087646, 'learning_rate': 6.650584204567889e-06}
84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3370/4000 [1:13:09<12:56, 1.23s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3371/4000 [1:13:10<13:06, 1.25s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3372/4000 [1:13:11<13:00, 1.24s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3373/4000 [1:13:13<13:06, 1.25s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3374/4000 [1:13:14<13:08, 1.26s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3375/4000 [1:13:15<13:01, 1.25s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3376/4000 [1:13:16<12:53, 1.24s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3377/4000 [1:13:18<12:50, 1.24s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3378/4000 [1:13:19<12:53, 1.24s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3379/4000 [1:13:20<12:44, 1.23s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3380/4000 [1:13:21<12:59, 1.26s/it] {'loss': 0.0697, 'grad_norm': 0.3132818043231964, 'learning_rate': 6.446075219144965e-06}
84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3380/4000 [1:13:21<12:59, 1.26s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3381/4000 [1:13:23<13:10, 1.28s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3382/4000 [1:13:24<13:09, 1.28s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3383/4000 [1:13:25<13:06, 1.27s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3384/4000 [1:13:26<12:59, 1.27s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3385/4000 [1:13:28<12:45, 1.24s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3386/4000 [1:13:29<12:37, 1.23s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3387/4000 [1:13:30<12:41, 1.24s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3388/4000 [1:13:31<12:45, 1.25s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3389/4000 [1:13:33<12:44, 1.25s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3390/4000 [1:13:34<12:48, 1.26s/it] {'loss': 0.0703, 'grad_norm': 0.2986792325973511, 'learning_rate': 6.244543086625987e-06}
85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3390/4000 [1:13:34<12:48, 1.26s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3391/4000 [1:13:35<12:40, 1.25s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3392/4000 [1:13:36<12:50, 1.27s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3393/4000 [1:13:38<12:53, 1.27s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3394/4000 [1:13:39<12:57, 1.28s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3395/4000 [1:13:40<13:04, 1.30s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3396/4000 [1:13:42<13:09, 1.31s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3397/4000 [1:13:43<13:05, 1.30s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3398/4000 [1:13:44<12:55, 1.29s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3399/4000 [1:13:45<12:41, 1.27s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3400/4000 [1:13:47<12:38, 1.26s/it] {'loss': 0.075, 'grad_norm': 0.3631608486175537, 'learning_rate': 6.046001581464505e-06}
85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3400/4000 [1:13:47<12:38, 1.26s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3401/4000 [1:13:48<12:32, 1.26s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3402/4000 [1:13:49<12:30, 1.26s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3403/4000 [1:13:50<12:28, 1.25s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3404/4000 [1:13:52<12:24, 1.25s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3405/4000 [1:13:53<12:30, 1.26s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3406/4000 [1:13:54<12:27, 1.26s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3407/4000 [1:13:55<12:25, 1.26s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3408/4000 [1:13:57<12:31, 1.27s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3409/4000 [1:13:58<12:27, 1.27s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3410/4000 [1:13:59<12:17, 1.25s/it] {'loss': 0.0663, 'grad_norm': 0.3030674457550049, 'learning_rate': 5.850464273708689e-06}
85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3410/4000 [1:13:59<12:17, 1.25s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3411/4000 [1:14:01<12:28, 1.27s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3412/4000 [1:14:02<12:22, 1.26s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3413/4000 [1:14:03<12:31, 1.28s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3414/4000 [1:14:04<12:28, 1.28s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3415/4000 [1:14:06<12:16, 1.26s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3416/4000 [1:14:07<12:16, 1.26s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3417/4000 [1:14:08<12:06, 1.25s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3418/4000 [1:14:09<12:06, 1.25s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3419/4000 [1:14:11<12:06, 1.25s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3420/4000 [1:14:12<12:00, 1.24s/it] {'loss': 0.0706, 'grad_norm': 0.27953702211380005, 'learning_rate': 5.657944528073745e-06}
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3420/4000 [1:14:12<12:00, 1.24s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3421/4000 [1:14:13<12:14, 1.27s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3422/4000 [1:14:14<12:20, 1.28s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3423/4000 [1:14:16<12:18, 1.28s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3424/4000 [1:14:17<12:11, 1.27s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3425/4000 [1:14:18<12:07, 1.27s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3426/4000 [1:14:20<12:08, 1.27s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3427/4000 [1:14:21<12:07, 1.27s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3428/4000 [1:14:22<12:11, 1.28s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3429/4000 [1:14:23<11:58, 1.26s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3430/4000 [1:14:25<11:59, 1.26s/it] {'loss': 0.0594, 'grad_norm': 0.25248539447784424, 'learning_rate': 5.468455503028574e-06}
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3430/4000 [1:14:25<11:59, 1.26s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3431/4000 [1:14:26<11:47, 1.24s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3432/4000 [1:14:27<12:40, 1.34s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3433/4000 [1:14:29<12:23, 1.31s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3434/4000 [1:14:30<12:10, 1.29s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3435/4000 [1:14:31<12:04, 1.28s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3436/4000 [1:14:32<11:59, 1.28s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3437/4000 [1:14:34<11:56, 1.27s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3438/4000 [1:14:35<12:24, 1.33s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3439/4000 [1:14:36<12:11, 1.30s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3440/4000 [1:14:38<12:03, 1.29s/it] {'loss': 0.064, 'grad_norm': 0.3186379373073578, 'learning_rate': 5.282010149896327e-06}
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3440/4000 [1:14:38<12:03, 1.29s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3441/4000 [1:14:39<11:58, 1.28s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3442/4000 [1:14:40<11:50, 1.27s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3443/4000 [1:14:41<11:37, 1.25s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3444/4000 [1:14:43<12:09, 1.31s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3445/4000 [1:14:44<11:58, 1.29s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3446/4000 [1:14:45<11:48, 1.28s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3447/4000 [1:14:46<11:43, 1.27s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3448/4000 [1:14:48<11:37, 1.26s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3449/4000 [1:14:49<11:31, 1.26s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3450/4000 [1:14:50<11:39, 1.27s/it] {'loss': 0.0593, 'grad_norm': 0.27150672674179077, 'learning_rate': 5.098621211969223e-06}
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3450/4000 [1:14:50<11:39, 1.27s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3451/4000 [1:14:52<11:29, 1.26s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3452/4000 [1:14:53<11:25, 1.25s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3453/4000 [1:14:54<11:23, 1.25s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3454/4000 [1:14:55<11:15, 1.24s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3455/4000 [1:14:56<11:15, 1.24s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3456/4000 [1:14:58<11:13, 1.24s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3457/4000 [1:14:59<11:10, 1.23s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3458/4000 [1:15:00<11:08, 1.23s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3459/4000 [1:15:01<11:18, 1.25s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3460/4000 [1:15:03<11:28, 1.28s/it] {'loss': 0.0694, 'grad_norm': 0.32688212394714355, 'learning_rate': 4.918301223637573e-06}
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3460/4000 [1:15:03<11:28, 1.28s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3461/4000 [1:15:04<11:21, 1.26s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3462/4000 [1:15:05<11:17, 1.26s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3463/4000 [1:15:06<11:10, 1.25s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3464/4000 [1:15:08<11:10, 1.25s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3465/4000 [1:15:09<11:02, 1.24s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3466/4000 [1:15:10<11:05, 1.25s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3467/4000 [1:15:11<10:59, 1.24s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3468/4000 [1:15:13<10:55, 1.23s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3469/4000 [1:15:14<10:54, 1.23s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3470/4000 [1:15:15<10:55, 1.24s/it] {'loss': 0.0556, 'grad_norm': 0.2902648448944092, 'learning_rate': 4.74106250953304e-06}
87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3470/4000 [1:15:15<10:55, 1.24s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3471/4000 [1:15:16<10:58, 1.24s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3472/4000 [1:15:18<10:53, 1.24s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3473/4000 [1:15:19<10:51, 1.24s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3474/4000 [1:15:20<11:00, 1.26s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3475/4000 [1:15:21<10:56, 1.25s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3476/4000 [1:15:23<10:51, 1.24s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3477/4000 [1:15:24<10:47, 1.24s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3478/4000 [1:15:25<10:42, 1.23s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3479/4000 [1:15:26<10:38, 1.22s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3480/4000 [1:15:28<10:45, 1.24s/it] {'loss': 0.0644, 'grad_norm': 0.26173198223114014, 'learning_rate': 4.566917183686309e-06}
87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3480/4000 [1:15:28<10:45, 1.24s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3481/4000 [1:15:29<10:56, 1.26s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3482/4000 [1:15:30<11:04, 1.28s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3483/4000 [1:15:31<11:07, 1.29s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3484/4000 [1:15:33<11:07, 1.29s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3485/4000 [1:15:34<11:00, 1.28s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3486/4000 [1:15:35<10:55, 1.28s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3487/4000 [1:15:36<10:41, 1.25s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3488/4000 [1:15:38<10:35, 1.24s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3489/4000 [1:15:39<10:31, 1.24s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3490/4000 [1:15:40<10:23, 1.22s/it] {'loss': 0.0643, 'grad_norm': 0.24044495820999146, 'learning_rate': 4.3958771486990735e-06}
87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3490/4000 [1:15:40<10:23, 1.22s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3491/4000 [1:15:41<10:19, 1.22s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3492/4000 [1:15:43<10:28, 1.24s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3493/4000 [1:15:44<10:31, 1.25s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3494/4000 [1:15:45<10:38, 1.26s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3495/4000 [1:15:46<10:45, 1.28s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3496/4000 [1:15:48<10:42, 1.27s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3497/4000 [1:15:49<10:31, 1.26s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3498/4000 [1:15:50<10:32, 1.26s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 3499/4000 [1:15:51<10:24, 1.25s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3500/4000 [1:15:53<10:32, 1.27s/it] {'loss': 0.0754, 'grad_norm': 0.2874322533607483, 'learning_rate': 4.22795409493052e-06}
88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3500/4000 [1:15:53<10:32, 1.27s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3501/4000 [1:15:54<10:29, 1.26s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3502/4000 [1:15:55<10:20, 1.25s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3503/4000 [1:15:57<10:22, 1.25s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3504/4000 [1:15:58<10:18, 1.25s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3505/4000 [1:15:59<10:14, 1.24s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3506/4000 [1:16:00<10:18, 1.25s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3507/4000 [1:16:01<10:15, 1.25s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3508/4000 [1:16:03<10:20, 1.26s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3509/4000 [1:16:04<10:11, 1.24s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3510/4000 [1:16:05<10:03, 1.23s/it] {'loss': 0.0704, 'grad_norm': 0.27393701672554016, 'learning_rate': 4.06315949969831e-06}
88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3510/4000 [1:16:05<10:03, 1.23s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3511/4000 [1:16:06<10:05, 1.24s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3512/4000 [1:16:08<10:03, 1.24s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3513/4000 [1:16:09<09:58, 1.23s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3514/4000 [1:16:10<09:53, 1.22s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3515/4000 [1:16:11<09:55, 1.23s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3516/4000 [1:16:13<10:00, 1.24s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3517/4000 [1:16:14<10:01, 1.24s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3518/4000 [1:16:15<09:53, 1.23s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3519/4000 [1:16:16<09:53, 1.23s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3520/4000 [1:16:18<09:51, 1.23s/it] {'loss': 0.059, 'grad_norm': 0.23371145129203796, 'learning_rate': 3.901504626494135e-06}
88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3520/4000 [1:16:18<09:51, 1.23s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3521/4000 [1:16:19<09:55, 1.24s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3522/4000 [1:16:20<09:51, 1.24s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3523/4000 [1:16:21<09:51, 1.24s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3524/4000 [1:16:23<09:53, 1.25s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3525/4000 [1:16:24<09:52, 1.25s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3526/4000 [1:16:25<09:45, 1.24s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3527/4000 [1:16:26<09:40, 1.23s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3528/4000 [1:16:27<09:40, 1.23s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3529/4000 [1:16:29<09:41, 1.23s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3530/4000 [1:16:30<09:42, 1.24s/it] {'loss': 0.0591, 'grad_norm': 0.25134360790252686, 'learning_rate': 3.7430005242138354e-06}
88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3530/4000 [1:16:30<09:42, 1.24s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3531/4000 [1:16:31<09:41, 1.24s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3532/4000 [1:16:32<09:38, 1.24s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3533/4000 [1:16:34<09:36, 1.23s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3534/4000 [1:16:35<09:39, 1.24s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3535/4000 [1:16:36<09:47, 1.26s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3536/4000 [1:16:37<09:42, 1.26s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3537/4000 [1:16:39<09:38, 1.25s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3538/4000 [1:16:40<09:41, 1.26s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3539/4000 [1:16:41<09:48, 1.28s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3540/4000 [1:16:43<09:45, 1.27s/it] {'loss': 0.0703, 'grad_norm': 0.251863569021225, 'learning_rate': 3.587658026402263e-06}
88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3540/4000 [1:16:43<09:45, 1.27s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3541/4000 [1:16:44<09:43, 1.27s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3542/4000 [1:16:45<09:32, 1.25s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3543/4000 [1:16:46<09:37, 1.26s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3544/4000 [1:16:48<09:32, 1.26s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3545/4000 [1:16:49<09:30, 1.25s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3546/4000 [1:16:50<09:25, 1.25s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3547/4000 [1:16:51<09:33, 1.27s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3548/4000 [1:16:53<09:33, 1.27s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 3549/4000 [1:16:54<09:22, 1.25s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3550/4000 [1:16:55<09:18, 1.24s/it] {'loss': 0.0704, 'grad_norm': 0.3032943904399872, 'learning_rate': 3.435487750512778e-06}
89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3550/4000 [1:16:55<09:18, 1.24s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3551/4000 [1:16:56<09:12, 1.23s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3552/4000 [1:16:57<09:10, 1.23s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3553/4000 [1:16:59<09:09, 1.23s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3554/4000 [1:17:00<09:16, 1.25s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3555/4000 [1:17:01<09:15, 1.25s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3556/4000 [1:17:02<09:10, 1.24s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3557/4000 [1:17:04<09:08, 1.24s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3558/4000 [1:17:05<09:14, 1.25s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3559/4000 [1:17:06<09:06, 1.24s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3560/4000 [1:17:07<09:11, 1.25s/it] {'loss': 0.0661, 'grad_norm': 0.2996753454208374, 'learning_rate': 3.2865000971816107e-06}
89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3560/4000 [1:17:07<09:11, 1.25s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3561/4000 [1:17:09<09:05, 1.24s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3562/4000 [1:17:10<09:03, 1.24s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3563/4000 [1:17:11<09:03, 1.24s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3564/4000 [1:17:12<09:12, 1.27s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3565/4000 [1:17:14<09:05, 1.25s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3566/4000 [1:17:15<09:29, 1.31s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3567/4000 [1:17:16<09:18, 1.29s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3568/4000 [1:17:18<09:05, 1.26s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3569/4000 [1:17:19<08:57, 1.25s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3570/4000 [1:17:20<08:58, 1.25s/it] {'loss': 0.0773, 'grad_norm': 0.25743064284324646, 'learning_rate': 3.1407052495169566e-06}
89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3570/4000 [1:17:20<08:58, 1.25s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3571/4000 [1:17:21<09:02, 1.26s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3572/4000 [1:17:23<08:58, 1.26s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3573/4000 [1:17:24<08:53, 1.25s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3574/4000 [1:17:25<08:51, 1.25s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3575/4000 [1:17:26<08:50, 1.25s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3576/4000 [1:17:28<08:51, 1.25s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3577/4000 [1:17:29<08:49, 1.25s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3578/4000 [1:17:30<08:49, 1.25s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3579/4000 [1:17:31<08:42, 1.24s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3580/4000 [1:17:33<08:46, 1.25s/it] {'loss': 0.0652, 'grad_norm': 0.25196996331214905, 'learning_rate': 2.9981131724029887e-06}
90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3580/4000 [1:17:33<08:46, 1.25s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3581/4000 [1:17:34<08:46, 1.26s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3582/4000 [1:17:35<08:38, 1.24s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3583/4000 [1:17:36<08:33, 1.23s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3584/4000 [1:17:37<08:28, 1.22s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3585/4000 [1:17:39<08:24, 1.22s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3586/4000 [1:17:40<08:23, 1.22s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3587/4000 [1:17:41<08:27, 1.23s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3588/4000 [1:17:42<08:31, 1.24s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3589/4000 [1:17:44<08:29, 1.24s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3590/4000 [1:17:45<08:25, 1.23s/it] {'loss': 0.0616, 'grad_norm': 0.23218315839767456, 'learning_rate': 2.858733611818765e-06}
90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3590/4000 [1:17:45<08:25, 1.23s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3591/4000 [1:17:46<08:27, 1.24s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3592/4000 [1:17:47<08:25, 1.24s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3593/4000 [1:17:49<08:28, 1.25s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3594/4000 [1:17:50<08:25, 1.24s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3595/4000 [1:17:51<08:19, 1.23s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3596/4000 [1:17:52<08:16, 1.23s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3597/4000 [1:17:54<08:22, 1.25s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3598/4000 [1:17:55<08:17, 1.24s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 3599/4000 [1:17:56<08:18, 1.24s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3600/4000 [1:17:57<08:28, 1.27s/it] {'loss': 0.0711, 'grad_norm': 0.26110437512397766, 'learning_rate': 2.7225760941721136e-06}
90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3600/4000 [1:17:57<08:28, 1.27s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3601/4000 [1:17:59<08:22, 1.26s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3602/4000 [1:18:00<08:20, 1.26s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3603/4000 [1:18:01<08:17, 1.25s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3604/4000 [1:18:02<08:13, 1.25s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3605/4000 [1:18:04<08:16, 1.26s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3606/4000 [1:18:05<08:15, 1.26s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3607/4000 [1:18:06<08:08, 1.24s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3608/4000 [1:18:07<08:11, 1.25s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3609/4000 [1:18:09<08:09, 1.25s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3610/4000 [1:18:10<08:03, 1.24s/it] {'loss': 0.0571, 'grad_norm': 0.24128496646881104, 'learning_rate': 2.589649925648491e-06}
90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3610/4000 [1:18:10<08:03, 1.24s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3611/4000 [1:18:11<07:58, 1.23s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3612/4000 [1:18:12<07:57, 1.23s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3613/4000 [1:18:14<08:06, 1.26s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3614/4000 [1:18:15<08:05, 1.26s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3615/4000 [1:18:16<07:58, 1.24s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3616/4000 [1:18:17<07:55, 1.24s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3617/4000 [1:18:19<07:54, 1.24s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3618/4000 [1:18:20<07:49, 1.23s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3619/4000 [1:18:21<07:45, 1.22s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3620/4000 [1:18:22<07:43, 1.22s/it] {'loss': 0.0614, 'grad_norm': 0.2503470182418823, 'learning_rate': 2.459964191574948e-06}
90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3620/4000 [1:18:22<07:43, 1.22s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3621/4000 [1:18:23<07:48, 1.24s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3622/4000 [1:18:25<07:53, 1.25s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3623/4000 [1:18:26<07:48, 1.24s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3624/4000 [1:18:27<07:46, 1.24s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3625/4000 [1:18:28<07:52, 1.26s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3626/4000 [1:18:30<07:49, 1.26s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3627/4000 [1:18:31<07:48, 1.25s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3628/4000 [1:18:32<07:47, 1.26s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3629/4000 [1:18:33<07:42, 1.25s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3630/4000 [1:18:35<07:43, 1.25s/it] {'loss': 0.0667, 'grad_norm': 0.22119544446468353, 'learning_rate': 2.3335277557991364e-06}
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3630/4000 [1:18:35<07:43, 1.25s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3631/4000 [1:18:36<07:40, 1.25s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3632/4000 [1:18:37<07:43, 1.26s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3633/4000 [1:18:38<07:37, 1.25s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3634/4000 [1:18:40<07:38, 1.25s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3635/4000 [1:18:41<07:38, 1.26s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3636/4000 [1:18:42<07:39, 1.26s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3637/4000 [1:18:44<07:37, 1.26s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3638/4000 [1:18:45<07:44, 1.28s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3639/4000 [1:18:46<07:36, 1.26s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3640/4000 [1:18:47<07:33, 1.26s/it] {'loss': 0.0668, 'grad_norm': 0.23388156294822693, 'learning_rate': 2.210349260083494e-06}
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3640/4000 [1:18:47<07:33, 1.26s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3641/4000 [1:18:49<07:32, 1.26s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3642/4000 [1:18:50<07:24, 1.24s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3643/4000 [1:18:51<07:19, 1.23s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3644/4000 [1:18:52<07:21, 1.24s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3645/4000 [1:18:53<07:18, 1.24s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3646/4000 [1:18:55<07:14, 1.23s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3647/4000 [1:18:56<07:15, 1.23s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3648/4000 [1:18:57<07:21, 1.25s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3649/4000 [1:18:59<07:20, 1.25s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3650/4000 [1:19:00<07:17, 1.25s/it] {'loss': 0.0661, 'grad_norm': 0.2183106690645218, 'learning_rate': 2.0904371235145827e-06}
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3650/4000 [1:19:00<07:17, 1.25s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3651/4000 [1:19:01<07:18, 1.26s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3652/4000 [1:19:02<07:12, 1.24s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3653/4000 [1:19:03<07:10, 1.24s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3654/4000 [1:19:05<07:13, 1.25s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3655/4000 [1:19:06<07:09, 1.24s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3656/4000 [1:19:07<07:08, 1.25s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3657/4000 [1:19:08<07:07, 1.25s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3658/4000 [1:19:10<07:05, 1.24s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3659/4000 [1:19:11<07:03, 1.24s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3660/4000 [1:19:12<07:03, 1.25s/it] {'loss': 0.054, 'grad_norm': 0.21500389277935028, 'learning_rate': 1.9737995419276455e-06}
92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3660/4000 [1:19:12<07:03, 1.25s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3661/4000 [1:19:13<07:03, 1.25s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3662/4000 [1:19:15<07:03, 1.25s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3663/4000 [1:19:16<07:01, 1.25s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3664/4000 [1:19:17<07:00, 1.25s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3665/4000 [1:19:18<06:59, 1.25s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3666/4000 [1:19:20<06:56, 1.25s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3667/4000 [1:19:21<06:55, 1.25s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3668/4000 [1:19:22<06:56, 1.26s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3669/4000 [1:19:23<06:50, 1.24s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3670/4000 [1:19:25<06:57, 1.27s/it] {'loss': 0.0669, 'grad_norm': 0.2281367927789688, 'learning_rate': 1.8604444873464466e-06}
92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3670/4000 [1:19:25<06:57, 1.27s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3671/4000 [1:19:26<06:55, 1.26s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3672/4000 [1:19:27<06:49, 1.25s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3673/4000 [1:19:28<06:46, 1.24s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3674/4000 [1:19:30<06:46, 1.25s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3675/4000 [1:19:31<06:42, 1.24s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3676/4000 [1:19:32<06:51, 1.27s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3677/4000 [1:19:34<06:49, 1.27s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3678/4000 [1:19:35<06:42, 1.25s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3679/4000 [1:19:36<06:43, 1.26s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3680/4000 [1:19:37<06:37, 1.24s/it] {'loss': 0.0704, 'grad_norm': 0.23009249567985535, 'learning_rate': 1.7503797074383988e-06}
92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3680/4000 [1:19:37<06:37, 1.24s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3681/4000 [1:19:38<06:35, 1.24s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3682/4000 [1:19:40<06:32, 1.24s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3683/4000 [1:19:41<06:29, 1.23s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3684/4000 [1:19:42<06:28, 1.23s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3685/4000 [1:19:43<06:27, 1.23s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3686/4000 [1:19:45<06:25, 1.23s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3687/4000 [1:19:46<06:27, 1.24s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3688/4000 [1:19:47<06:30, 1.25s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3689/4000 [1:19:48<06:25, 1.24s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3690/4000 [1:19:50<06:23, 1.24s/it] {'loss': 0.0713, 'grad_norm': 0.2270803302526474, 'learning_rate': 1.6436127249849998e-06}
92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3690/4000 [1:19:50<06:23, 1.24s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3691/4000 [1:19:51<06:23, 1.24s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3692/4000 [1:19:52<06:21, 1.24s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3693/4000 [1:19:53<06:23, 1.25s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3694/4000 [1:19:55<06:27, 1.27s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3695/4000 [1:19:56<06:20, 1.25s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3696/4000 [1:19:57<06:25, 1.27s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3697/4000 [1:19:58<06:24, 1.27s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3698/4000 [1:20:00<06:28, 1.29s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3699/4000 [1:20:01<06:24, 1.28s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3700/4000 [1:20:02<06:24, 1.28s/it] {'loss': 0.0607, 'grad_norm': 0.293386846780777, 'learning_rate': 1.5401508373676764e-06}
92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3700/4000 [1:20:02<06:24, 1.28s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3701/4000 [1:20:04<06:20, 1.27s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3702/4000 [1:20:05<06:20, 1.28s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3703/4000 [1:20:06<06:18, 1.27s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3704/4000 [1:20:07<06:16, 1.27s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3705/4000 [1:20:09<06:14, 1.27s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3706/4000 [1:20:10<06:09, 1.26s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3707/4000 [1:20:11<06:12, 1.27s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3708/4000 [1:20:12<06:13, 1.28s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3709/4000 [1:20:14<06:11, 1.28s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3710/4000 [1:20:15<06:05, 1.26s/it] {'loss': 0.0683, 'grad_norm': 0.16279859840869904, 'learning_rate': 1.4400011160690175e-06}
93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3710/4000 [1:20:15<06:05, 1.26s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3711/4000 [1:20:16<06:09, 1.28s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3712/4000 [1:20:18<06:03, 1.26s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3713/4000 [1:20:19<06:14, 1.31s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3714/4000 [1:20:20<06:10, 1.30s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3715/4000 [1:20:22<06:11, 1.30s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3716/4000 [1:20:23<06:01, 1.27s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3717/4000 [1:20:24<05:56, 1.26s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3718/4000 [1:20:25<05:50, 1.24s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3719/4000 [1:20:26<05:48, 1.24s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3720/4000 [1:20:28<05:48, 1.24s/it] {'loss': 0.0633, 'grad_norm': 0.27661141753196716, 'learning_rate': 1.3431704061894312e-06}
93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3720/4000 [1:20:28<05:48, 1.24s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3721/4000 [1:20:29<05:50, 1.26s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3722/4000 [1:20:30<05:49, 1.26s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3723/4000 [1:20:31<05:42, 1.24s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3724/4000 [1:20:33<05:46, 1.26s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3725/4000 [1:20:34<05:41, 1.24s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3726/4000 [1:20:35<05:53, 1.29s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3727/4000 [1:20:36<05:46, 1.27s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3728/4000 [1:20:38<05:40, 1.25s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3729/4000 [1:20:39<05:34, 1.23s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3730/4000 [1:20:40<05:32, 1.23s/it] {'loss': 0.0559, 'grad_norm': 0.25667819380760193, 'learning_rate': 1.2496653259793268e-06}
93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3730/4000 [1:20:40<05:32, 1.23s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3731/4000 [1:20:41<05:32, 1.24s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3732/4000 [1:20:43<05:36, 1.25s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3733/4000 [1:20:44<05:34, 1.25s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3734/4000 [1:20:45<05:30, 1.24s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3735/4000 [1:20:46<05:29, 1.24s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3736/4000 [1:20:48<05:27, 1.24s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3737/4000 [1:20:49<05:24, 1.23s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3738/4000 [1:20:50<05:20, 1.22s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3739/4000 [1:20:51<05:21, 1.23s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3740/4000 [1:20:53<05:26, 1.26s/it] {'loss': 0.0639, 'grad_norm': 0.19870716333389282, 'learning_rate': 1.1594922663867135e-06}
94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3740/4000 [1:20:53<05:26, 1.26s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3741/4000 [1:20:54<05:25, 1.26s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3742/4000 [1:20:55<05:22, 1.25s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3743/4000 [1:20:56<05:24, 1.26s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3744/4000 [1:20:58<05:23, 1.27s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3745/4000 [1:20:59<05:21, 1.26s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3746/4000 [1:21:00<05:19, 1.26s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3747/4000 [1:21:01<05:18, 1.26s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3748/4000 [1:21:03<05:18, 1.26s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 3749/4000 [1:21:04<05:14, 1.25s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3750/4000 [1:21:05<05:14, 1.26s/it] {'loss': 0.0649, 'grad_norm': 0.2166091799736023, 'learning_rate': 1.0726573906204463e-06}
94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3750/4000 [1:21:05<05:14, 1.26s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3751/4000 [1:21:06<05:13, 1.26s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3752/4000 [1:21:08<05:11, 1.26s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3753/4000 [1:21:09<05:08, 1.25s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3754/4000 [1:21:10<05:03, 1.23s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3755/4000 [1:21:11<05:06, 1.25s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3756/4000 [1:21:13<05:07, 1.26s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3757/4000 [1:21:14<05:04, 1.25s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3758/4000 [1:21:15<05:04, 1.26s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3759/4000 [1:21:16<04:59, 1.24s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3760/4000 [1:21:18<04:57, 1.24s/it] {'loss': 0.06, 'grad_norm': 0.15209949016571045, 'learning_rate': 9.891666337289273e-07}
94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3760/4000 [1:21:18<04:57, 1.24s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3761/4000 [1:21:19<04:56, 1.24s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3762/4000 [1:21:20<04:53, 1.23s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3763/4000 [1:21:21<04:51, 1.23s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3764/4000 [1:21:23<04:53, 1.24s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3765/4000 [1:21:24<04:51, 1.24s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3766/4000 [1:21:25<04:48, 1.23s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3767/4000 [1:21:26<04:52, 1.25s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3768/4000 [1:21:28<04:48, 1.24s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3769/4000 [1:21:29<04:47, 1.25s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3770/4000 [1:21:30<04:48, 1.26s/it] {'loss': 0.0756, 'grad_norm': 0.2050933539867401, 'learning_rate': 9.090257021944881e-07}
94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3770/4000 [1:21:30<04:48, 1.26s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3771/4000 [1:21:31<04:44, 1.24s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3772/4000 [1:21:33<04:44, 1.25s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3773/4000 [1:21:34<04:41, 1.24s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3774/4000 [1:21:35<04:39, 1.24s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3775/4000 [1:21:36<04:40, 1.25s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3776/4000 [1:21:38<04:40, 1.25s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3777/4000 [1:21:39<04:37, 1.24s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3778/4000 [1:21:40<04:33, 1.23s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3779/4000 [1:21:41<04:33, 1.24s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3780/4000 [1:21:42<04:30, 1.23s/it] {'loss': 0.0644, 'grad_norm': 0.16244404017925262, 'learning_rate': 8.3224007354335e-07}
94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3780/4000 [1:21:42<04:30, 1.23s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3781/4000 [1:21:44<04:30, 1.24s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3782/4000 [1:21:45<04:30, 1.24s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3783/4000 [1:21:46<04:27, 1.23s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3784/4000 [1:21:47<04:28, 1.24s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3785/4000 [1:21:49<04:24, 1.23s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3786/4000 [1:21:50<04:22, 1.23s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3787/4000 [1:21:51<04:25, 1.25s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3788/4000 [1:21:52<04:23, 1.24s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3789/4000 [1:21:54<04:22, 1.25s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3790/4000 [1:21:55<04:20, 1.24s/it] {'loss': 0.057, 'grad_norm': 0.21403126418590546, 'learning_rate': 7.588149959712243e-07}
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3790/4000 [1:21:55<04:20, 1.24s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3791/4000 [1:21:56<04:20, 1.24s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3792/4000 [1:21:57<04:17, 1.24s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3793/4000 [1:21:59<04:14, 1.23s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3794/4000 [1:22:00<04:14, 1.24s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3795/4000 [1:22:01<04:16, 1.25s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3796/4000 [1:22:02<04:17, 1.26s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3797/4000 [1:22:04<04:18, 1.27s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3798/4000 [1:22:05<04:16, 1.27s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3799/4000 [1:22:06<04:12, 1.26s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3800/4000 [1:22:07<04:11, 1.26s/it] {'loss': 0.062, 'grad_norm': 0.2043486088514328, 'learning_rate': 6.887554879846326e-07}
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3800/4000 [1:22:07<04:11, 1.26s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3801/4000 [1:22:09<04:10, 1.26s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3802/4000 [1:22:10<04:09, 1.26s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3803/4000 [1:22:11<04:05, 1.25s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3804/4000 [1:22:12<04:04, 1.25s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3805/4000 [1:22:14<04:07, 1.27s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3806/4000 [1:22:15<04:04, 1.26s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3807/4000 [1:22:16<04:05, 1.27s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3808/4000 [1:22:18<04:02, 1.27s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3809/4000 [1:22:19<04:03, 1.28s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3810/4000 [1:22:20<04:03, 1.28s/it] {'loss': 0.055, 'grad_norm': 0.20549970865249634, 'learning_rate': 6.220663380578861e-07}
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3810/4000 [1:22:20<04:03, 1.28s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3811/4000 [1:22:21<04:04, 1.29s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3812/4000 [1:22:23<04:04, 1.30s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3813/4000 [1:22:24<04:04, 1.31s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3814/4000 [1:22:25<03:59, 1.29s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3815/4000 [1:22:27<03:57, 1.28s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3816/4000 [1:22:28<03:54, 1.27s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3817/4000 [1:22:29<03:53, 1.28s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3818/4000 [1:22:30<03:50, 1.27s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3819/4000 [1:22:32<03:48, 1.26s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3820/4000 [1:22:33<03:46, 1.26s/it] {'loss': 0.0678, 'grad_norm': 0.14029736816883087, 'learning_rate': 5.58752104305793e-07}
96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3820/4000 [1:22:33<03:46, 1.26s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3821/4000 [1:22:34<03:42, 1.25s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3822/4000 [1:22:35<03:39, 1.23s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3823/4000 [1:22:37<03:41, 1.25s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3824/4000 [1:22:38<03:39, 1.25s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3825/4000 [1:22:39<03:37, 1.24s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3826/4000 [1:22:40<03:34, 1.23s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3827/4000 [1:22:42<03:33, 1.23s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3828/4000 [1:22:43<03:33, 1.24s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3829/4000 [1:22:44<03:32, 1.24s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3830/4000 [1:22:45<03:30, 1.24s/it] {'loss': 0.0691, 'grad_norm': 0.17063820362091064, 'learning_rate': 4.988171141721232e-07}
96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3830/4000 [1:22:45<03:30, 1.24s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3831/4000 [1:22:46<03:29, 1.24s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3832/4000 [1:22:48<03:26, 1.23s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3833/4000 [1:22:49<03:25, 1.23s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3834/4000 [1:22:50<03:24, 1.23s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3835/4000 [1:22:51<03:24, 1.24s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3836/4000 [1:22:53<03:24, 1.25s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3837/4000 [1:22:54<03:23, 1.25s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3838/4000 [1:22:55<03:20, 1.24s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3839/4000 [1:22:56<03:19, 1.24s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3840/4000 [1:22:58<03:19, 1.24s/it] {'loss': 0.0609, 'grad_norm': 0.16294695436954498, 'learning_rate': 4.4226546413383974e-07}
96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3840/4000 [1:22:58<03:19, 1.24s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3841/4000 [1:22:59<03:16, 1.24s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3842/4000 [1:23:00<03:14, 1.23s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3843/4000 [1:23:01<03:13, 1.24s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3844/4000 [1:23:03<03:12, 1.23s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3845/4000 [1:23:04<03:09, 1.23s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3846/4000 [1:23:05<03:12, 1.25s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3847/4000 [1:23:06<03:12, 1.26s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3848/4000 [1:23:08<03:09, 1.25s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 3849/4000 [1:23:09<03:08, 1.25s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3850/4000 [1:23:10<03:09, 1.26s/it] {'loss': 0.0594, 'grad_norm': 0.20066611468791962, 'learning_rate': 3.891010194211009e-07}
96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3850/4000 [1:23:10<03:09, 1.26s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3851/4000 [1:23:11<03:10, 1.28s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3852/4000 [1:23:13<03:09, 1.28s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3853/4000 [1:23:14<03:09, 1.29s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3854/4000 [1:23:15<03:08, 1.29s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3855/4000 [1:23:17<03:06, 1.29s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3856/4000 [1:23:18<03:03, 1.27s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3857/4000 [1:23:19<03:00, 1.26s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3858/4000 [1:23:20<02:56, 1.25s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3859/4000 [1:23:22<02:55, 1.25s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3860/4000 [1:23:23<02:54, 1.25s/it] {'loss': 0.0681, 'grad_norm': 0.23991842567920685, 'learning_rate': 3.393274137530877e-07}
96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3860/4000 [1:23:23<02:54, 1.25s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3861/4000 [1:23:24<02:54, 1.25s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3862/4000 [1:23:25<02:53, 1.26s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3863/4000 [1:23:27<02:51, 1.25s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3864/4000 [1:23:28<02:50, 1.25s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3865/4000 [1:23:29<02:48, 1.25s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3866/4000 [1:23:30<02:48, 1.26s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3867/4000 [1:23:32<02:45, 1.24s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3868/4000 [1:23:33<02:46, 1.26s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3869/4000 [1:23:34<02:44, 1.26s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3870/4000 [1:23:35<02:41, 1.24s/it] {'loss': 0.0707, 'grad_norm': 0.3238789737224579, 'learning_rate': 2.9294804908962525e-07}
97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3870/4000 [1:23:35<02:41, 1.24s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3871/4000 [1:23:37<02:39, 1.24s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3872/4000 [1:23:38<02:37, 1.23s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3873/4000 [1:23:39<02:35, 1.23s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3874/4000 [1:23:40<02:33, 1.22s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3875/4000 [1:23:41<02:34, 1.23s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3876/4000 [1:23:43<02:33, 1.24s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3877/4000 [1:23:44<02:32, 1.24s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3878/4000 [1:23:45<02:31, 1.25s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3879/4000 [1:23:46<02:31, 1.25s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3880/4000 [1:23:48<02:28, 1.24s/it] {'loss': 0.0635, 'grad_norm': 0.1583530306816101, 'learning_rate': 2.499660953986849e-07}
97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3880/4000 [1:23:48<02:28, 1.24s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3881/4000 [1:23:49<02:28, 1.25s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3882/4000 [1:23:50<02:29, 1.26s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3883/4000 [1:23:52<02:29, 1.28s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3884/4000 [1:23:53<02:27, 1.27s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3885/4000 [1:23:54<02:25, 1.26s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3886/4000 [1:23:55<02:22, 1.25s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3887/4000 [1:23:56<02:19, 1.23s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3888/4000 [1:23:58<02:16, 1.22s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3889/4000 [1:23:59<02:19, 1.25s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3890/4000 [1:24:00<02:17, 1.25s/it] {'loss': 0.059, 'grad_norm': 0.16639728844165802, 'learning_rate': 2.103844904397023e-07}
97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3890/4000 [1:24:00<02:17, 1.25s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3891/4000 [1:24:02<02:18, 1.27s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3892/4000 [1:24:03<02:18, 1.28s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3893/4000 [1:24:04<02:17, 1.28s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3894/4000 [1:24:05<02:14, 1.27s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3895/4000 [1:24:07<02:12, 1.26s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3896/4000 [1:24:08<02:10, 1.25s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3897/4000 [1:24:09<02:09, 1.25s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3898/4000 [1:24:10<02:07, 1.25s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 3899/4000 [1:24:12<02:07, 1.26s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3900/4000 [1:24:13<02:07, 1.28s/it] {'loss': 0.0688, 'grad_norm': 0.18838155269622803, 'learning_rate': 1.742059395627993e-07}
98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3900/4000 [1:24:13<02:07, 1.28s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3901/4000 [1:24:14<02:07, 1.28s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3902/4000 [1:24:15<02:04, 1.27s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3903/4000 [1:24:17<02:03, 1.27s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3904/4000 [1:24:18<02:00, 1.25s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3905/4000 [1:24:19<01:57, 1.24s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3906/4000 [1:24:20<01:56, 1.24s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3907/4000 [1:24:22<01:55, 1.24s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3908/4000 [1:24:23<01:53, 1.24s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3909/4000 [1:24:24<01:53, 1.24s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3910/4000 [1:24:25<01:52, 1.25s/it] {'loss': 0.0663, 'grad_norm': 0.18355156481266022, 'learning_rate': 1.414329155238703e-07}
98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3910/4000 [1:24:25<01:52, 1.25s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3911/4000 [1:24:27<01:52, 1.27s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3912/4000 [1:24:28<01:52, 1.28s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3913/4000 [1:24:29<01:49, 1.26s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3914/4000 [1:24:31<01:48, 1.27s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3915/4000 [1:24:32<01:49, 1.29s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3916/4000 [1:24:33<01:46, 1.27s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3917/4000 [1:24:34<01:45, 1.27s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3918/4000 [1:24:36<01:43, 1.27s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3919/4000 [1:24:37<01:41, 1.25s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3920/4000 [1:24:38<01:40, 1.26s/it] {'loss': 0.0628, 'grad_norm': 0.18482854962348938, 'learning_rate': 1.1206765831557886e-07}
98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3920/4000 [1:24:38<01:40, 1.26s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3921/4000 [1:24:39<01:39, 1.26s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3922/4000 [1:24:41<01:38, 1.26s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3923/4000 [1:24:42<01:36, 1.26s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3924/4000 [1:24:43<01:36, 1.26s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3925/4000 [1:24:44<01:34, 1.26s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3926/4000 [1:24:46<01:31, 1.24s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3927/4000 [1:24:47<01:30, 1.24s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3928/4000 [1:24:48<01:29, 1.25s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3929/4000 [1:24:49<01:28, 1.24s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3930/4000 [1:24:51<01:27, 1.25s/it] {'loss': 0.0678, 'grad_norm': 0.19996316730976105, 'learning_rate': 8.611217501423574e-08}
98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3930/4000 [1:24:51<01:27, 1.25s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3931/4000 [1:24:52<01:26, 1.26s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3932/4000 [1:24:53<01:25, 1.26s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3933/4000 [1:24:54<01:24, 1.27s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3934/4000 [1:24:56<01:23, 1.26s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3935/4000 [1:24:57<01:21, 1.26s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3936/4000 [1:24:58<01:20, 1.27s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3937/4000 [1:24:59<01:19, 1.26s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3938/4000 [1:25:01<01:17, 1.26s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3939/4000 [1:25:02<01:16, 1.25s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3940/4000 [1:25:03<01:15, 1.25s/it] {'loss': 0.0706, 'grad_norm': 0.26839616894721985, 'learning_rate': 6.356823964266401e-08}
98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3940/4000 [1:25:03<01:15, 1.25s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3941/4000 [1:25:04<01:14, 1.26s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3942/4000 [1:25:06<01:12, 1.25s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3943/4000 [1:25:07<01:11, 1.25s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3944/4000 [1:25:08<01:09, 1.24s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3945/4000 [1:25:09<01:07, 1.23s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3946/4000 [1:25:11<01:06, 1.22s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3947/4000 [1:25:12<01:05, 1.24s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3948/4000 [1:25:13<01:05, 1.26s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 3949/4000 [1:25:14<01:05, 1.28s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3950/4000 [1:25:16<01:03, 1.27s/it] {'loss': 0.0708, 'grad_norm': 0.187456876039505, 'learning_rate': 4.4437393048885056e-08}
99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3950/4000 [1:25:16<01:03, 1.27s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3951/4000 [1:25:17<01:02, 1.28s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3952/4000 [1:25:18<01:00, 1.26s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3953/4000 [1:25:19<00:58, 1.24s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3954/4000 [1:25:21<00:57, 1.25s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3955/4000 [1:25:22<00:55, 1.23s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3956/4000 [1:25:23<00:54, 1.23s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3957/4000 [1:25:24<00:53, 1.25s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3958/4000 [1:25:26<00:51, 1.24s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3959/4000 [1:25:27<00:50, 1.23s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3960/4000 [1:25:28<00:49, 1.24s/it] {'loss': 0.0627, 'grad_norm': 0.23117177188396454, 'learning_rate': 2.8720942800858353e-08}
99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3960/4000 [1:25:28<00:49, 1.24s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3961/4000 [1:25:29<00:49, 1.26s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3962/4000 [1:25:31<00:48, 1.26s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3963/4000 [1:25:32<00:46, 1.25s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3964/4000 [1:25:33<00:45, 1.25s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3965/4000 [1:25:34<00:43, 1.24s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3966/4000 [1:25:36<00:42, 1.24s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3967/4000 [1:25:37<00:40, 1.23s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3968/4000 [1:25:38<00:39, 1.23s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3969/4000 [1:25:39<00:38, 1.24s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3970/4000 [1:25:41<00:36, 1.23s/it] {'loss': 0.0716, 'grad_norm': 0.1766495555639267, 'learning_rate': 1.6419963097080715e-08}
99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3970/4000 [1:25:41<00:36, 1.23s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3971/4000 [1:25:42<00:35, 1.23s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3972/4000 [1:25:43<00:34, 1.23s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3973/4000 [1:25:44<00:33, 1.24s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3974/4000 [1:25:45<00:32, 1.23s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3975/4000 [1:25:47<00:31, 1.24s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3976/4000 [1:25:48<00:30, 1.26s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3977/4000 [1:25:49<00:29, 1.27s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3978/4000 [1:25:51<00:27, 1.26s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3979/4000 [1:25:52<00:26, 1.26s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3980/4000 [1:25:53<00:25, 1.25s/it] {'loss': 0.0613, 'grad_norm': 0.1897292584180832, 'learning_rate': 7.535294693172822e-09}
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3980/4000 [1:25:53<00:25, 1.25s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3981/4000 [1:25:54<00:23, 1.25s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3982/4000 [1:25:56<00:22, 1.24s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3983/4000 [1:25:57<00:21, 1.25s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3984/4000 [1:25:58<00:19, 1.24s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3985/4000 [1:25:59<00:18, 1.24s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3986/4000 [1:26:01<00:17, 1.26s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3987/4000 [1:26:02<00:16, 1.28s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3988/4000 [1:26:03<00:15, 1.29s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3989/4000 [1:26:04<00:14, 1.29s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3990/4000 [1:26:06<00:12, 1.28s/it] {'loss': 0.0614, 'grad_norm': 0.14756347239017487, 'learning_rate': 2.0675448444251732e-09}
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3990/4000 [1:26:06<00:12, 1.28s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3991/4000 [1:26:07<00:11, 1.27s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3992/4000 [1:26:08<00:10, 1.25s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3993/4000 [1:26:09<00:08, 1.26s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3994/4000 [1:26:11<00:07, 1.25s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3995/4000 [1:26:12<00:06, 1.25s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3996/4000 [1:26:13<00:04, 1.23s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3997/4000 [1:26:14<00:03, 1.24s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3998/4000 [1:26:16<00:02, 1.24s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3999/4000 [1:26:17<00:01, 1.24s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 4000/4000 [1:26:18<00:00, 1.24s/it] {'loss': 0.0707, 'grad_norm': 0.19088687002658844, 'learning_rate': 1.7087264264636914e-11}
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 4000/4000 [1:26:18<00:00, 1.24s/it]Copying experiment config directory /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-runs-ft4k/a6/production/experiment_cfg to /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-runs-ft4k/a6/production/checkpoint-4000/experiment_cfg
Copying processor directory /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-runs-ft4k/a6/production/processor to /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-runs-ft4k/a6/production/checkpoint-4000
Copying wandb_config.json from /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-runs-ft4k/a6/production/wandb_config.json to /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-runs-ft4k/a6/production/checkpoint-4000/wandb_config.json
{'train_runtime': 5284.9201, 'train_samples_per_second': 193.759, 'train_steps_per_second': 0.757, 'train_loss': 0.16739583969116212}
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 4000/4000 [1:28:04<00:00, 1.24s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 4000/4000 [1:28:04<00:00, 1.32s/it]
[rank4]:[W1112 23:44:34.575663732 AllocatorConfig.cpp:28] Warning: PYTORCH_CUDA_ALLOC_CONF is deprecated, use PYTORCH_ALLOC_CONF instead (function operator())
[rank5]:[W1112 23:44:34.705123396 AllocatorConfig.cpp:28] Warning: PYTORCH_CUDA_ALLOC_CONF is deprecated, use PYTORCH_ALLOC_CONF instead (function operator())
[rank7]:[W1112 23:44:34.750199033 AllocatorConfig.cpp:28] Warning: PYTORCH_CUDA_ALLOC_CONF is deprecated, use PYTORCH_ALLOC_CONF instead (function operator())
[rank3]:[W1112 23:44:34.771381069 AllocatorConfig.cpp:28] Warning: PYTORCH_CUDA_ALLOC_CONF is deprecated, use PYTORCH_ALLOC_CONF instead (function operator())
[rank6]:[W1112 23:44:34.849491030 AllocatorConfig.cpp:28] Warning: PYTORCH_CUDA_ALLOC_CONF is deprecated, use PYTORCH_ALLOC_CONF instead (function operator())
[rank2]:[W1112 23:44:34.867527993 AllocatorConfig.cpp:28] Warning: PYTORCH_CUDA_ALLOC_CONF is deprecated, use PYTORCH_ALLOC_CONF instead (function operator())
[rank1]:[W1112 23:44:34.883335702 AllocatorConfig.cpp:28] Warning: PYTORCH_CUDA_ALLOC_CONF is deprecated, use PYTORCH_ALLOC_CONF instead (function operator())
11/12/2026 23:44:48 - INFO - Model saved to /mnt/nas/cross/Team/RobotAgent/Personal/baijiaqi/humanoid-benchmark-work/preflight-20261104T1648Z/policies-20261109/groot-runs-ft4k/a6/production
11/12/2026 23:44:48 - INFO - Training completed!
[rank0]:[W1112 23:44:50.307647532 AllocatorConfig.cpp:28] Warning: PYTORCH_CUDA_ALLOC_CONF is deprecated, use PYTORCH_ALLOC_CONF instead (function operator())
[W1112 23:44:51.381628865 AllocatorConfig.cpp:28] Warning: PYTORCH_CUDA_ALLOC_CONF is deprecated, use PYTORCH_ALLOC_CONF instead (function operator())
resume state dropped: checkpoint-2000
EXIT 0