miner_8092.log

2026-03-06 01:42:49,774 - __main__ - INFO - ============================================================
2026-03-06 01:42:49,774 - __main__ - INFO - Starting Babelbit Miner Server
2026-03-06 01:42:49,774 - __main__ - INFO - Backend: Hugging Face
2026-03-06 01:42:49,774 - __main__ - INFO - ============================================================
2026-03-06 01:42:49,774 - __main__ - INFO - 
2026-03-06 01:42:49,774 - __main__ - WARNING - 🔓 DEV MODE ENABLED - Bittensor verification DISABLED
2026-03-06 01:42:49,774 - __main__ - WARNING -    This should ONLY be used for local testing!
2026-03-06 01:42:49,774 - __main__ - WARNING -    Set MINER_DEV_MODE=0 for production use.
2026-03-06 01:42:49,774 - __main__ - INFO - 
2026-03-06 01:42:49,774 - __main__ - INFO - ⚠️  Make sure you've registered your axon first:
2026-03-06 01:42:49,774 - __main__ - INFO -    uv run python babelbit/miner/register_axon.py
2026-03-06 01:42:49,774 - __main__ - INFO - 
2026-03-06 01:42:49,774 - __main__ - INFO - 🌐 Production mode: MINER_EXTERNAL_IP=216.81.245.239
2026-03-06 01:42:49,774 - __main__ - INFO -    Server accessible at: http://216.81.245.239:8092
2026-03-06 01:42:49,775 - __main__ - INFO - 🚀 Miner serving predictions on port 8092
2026-03-06 01:42:49,775 - __main__ - INFO -    Press Ctrl+C to stop.
2026-03-06 01:42:49,775 - __main__ - INFO - 
INFO:     Started server process [311701]
INFO:     Waiting for application startup.
2026-03-06 01:42:49,782 - __main__ - INFO - Model: /root/workspace/babelbit_subnet/fine_tuning/fine_tuned_model/merged
2026-03-06 01:42:49,782 - __main__ - INFO - Revision: main
2026-03-06 01:42:49,782 - __main__ - INFO - Cache dir: /root/.babelbit/models
2026-03-06 01:42:49,782 - __main__ - INFO - Quantization: 8bit=False, 4bit=False
2026-03-06 01:42:49,782 - __main__ - INFO - Device: cuda
2026-03-06 01:42:49,782 - __main__ - INFO - 
2026-03-06 01:42:49,782 - __main__ - INFO - Initialized BabelbitMiner with model: /root/workspace/babelbit_subnet/fine_tuning/fine_tuned_model/merged
2026-03-06 01:42:49,782 - __main__ - INFO - Target device: cuda, dtype: torch.float16
2026-03-06 01:42:49,782 - __main__ - INFO - Loading model...
2026-03-06 01:42:49,782 - __main__ - INFO - Loading model /root/workspace/babelbit_subnet/fine_tuning/fine_tuned_model/merged...
2026-03-06 01:42:49,783 - babelbit.miner.model_loader - INFO - Loading tokenizer for /root/workspace/babelbit_subnet/fine_tuning/fine_tuned_model/merged...
2026-03-06 01:42:50,252 - babelbit.miner.model_loader - INFO - Loading model /root/workspace/babelbit_subnet/fine_tuning/fine_tuned_model/merged...

Loading weights:   0%|          | 0/291 [00:00<?, ?it/s]
Loading weights:   0%|          | 1/291 [00:00<00:00, 14364.05it/s, Materializing param=lm_head.weight]
Loading weights:   0%|          | 1/291 [00:00<00:00, 7781.64it/s, Materializing param=lm_head.weight] 
Loading weights:   1%|          | 2/291 [00:00<00:38,  7.58it/s, Materializing param=lm_head.weight]  
Loading weights:   1%|          | 2/291 [00:00<00:38,  7.58it/s, Materializing param=model.embed_tokens.weight]
Loading weights:   1%|          | 2/291 [00:00<00:38,  7.58it/s, Materializing param=model.embed_tokens.weight]
Loading weights:   1%|          | 3/291 [00:00<00:38,  7.58it/s, Materializing param=model.layers.0.input_layernorm.weight]
Loading weights:   1%|          | 3/291 [00:00<00:38,  7.58it/s, Materializing param=model.layers.0.input_layernorm.weight]
Loading weights:   1%|▏         | 4/291 [00:00<00:37,  7.58it/s, Materializing param=model.layers.0.mlp.down_proj.weight]  
Loading weights:   1%|▏         | 4/291 [00:00<00:37,  7.58it/s, Materializing param=model.layers.0.mlp.down_proj.weight]
Loading weights:   2%|▏         | 5/291 [00:00<00:37,  7.58it/s, Materializing param=model.layers.0.mlp.gate_proj.weight]
Loading weights:   2%|▏         | 5/291 [00:00<00:37,  7.58it/s, Materializing param=model.layers.0.mlp.gate_proj.weight]
Loading weights:   2%|▏         | 6/291 [00:00<00:37,  7.58it/s, Materializing param=model.layers.0.mlp.up_proj.weight]  
Loading weights:   2%|▏         | 6/291 [00:00<00:37,  7.58it/s, Materializing param=model.layers.0.mlp.up_proj.weight]
Loading weights:   2%|▏         | 7/291 [00:00<00:37,  7.58it/s, Materializing param=model.layers.0.post_attention_layernorm.weight]
Loading weights:   2%|▏         | 7/291 [00:00<00:37,  7.58it/s, Materializing param=model.layers.0.post_attention_layernorm.weight]
Loading weights:   3%|▎         | 8/291 [00:00<00:37,  7.58it/s, Materializing param=model.layers.0.self_attn.k_proj.weight]        
Loading weights:   3%|▎         | 8/291 [00:00<00:37,  7.58it/s, Materializing param=model.layers.0.self_attn.k_proj.weight]
Loading weights:   3%|▎         | 9/291 [00:00<00:37,  7.58it/s, Materializing param=model.layers.0.self_attn.o_proj.weight]
Loading weights:   3%|▎         | 9/291 [00:00<00:37,  7.58it/s, Materializing param=model.layers.0.self_attn.o_proj.weight]
Loading weights:   3%|▎         | 10/291 [00:00<00:08, 32.68it/s, Materializing param=model.layers.0.self_attn.o_proj.weight]
Loading weights:   3%|▎         | 10/291 [00:00<00:08, 32.68it/s, Materializing param=model.layers.0.self_attn.q_proj.weight]
Loading weights:   3%|▎         | 10/291 [00:00<00:08, 32.68it/s, Materializing param=model.layers.0.self_attn.q_proj.weight]
Loading weights:   4%|▍         | 11/291 [00:00<00:08, 32.68it/s, Materializing param=model.layers.0.self_attn.v_proj.weight]
Loading weights:   4%|▍         | 11/291 [00:00<00:08, 32.68it/s, Materializing param=model.layers.0.self_attn.v_proj.weight]
Loading weights:   4%|▍         | 12/291 [00:00<00:08, 32.68it/s, Materializing param=model.layers.1.input_layernorm.weight] 
Loading weights:   4%|▍         | 12/291 [00:00<00:08, 32.68it/s, Materializing param=model.layers.1.input_layernorm.weight]
Loading weights:   4%|▍         | 13/291 [00:00<00:08, 32.68it/s, Materializing param=model.layers.1.mlp.down_proj.weight]  
Loading weights:   4%|▍         | 13/291 [00:00<00:08, 32.68it/s, Materializing param=model.layers.1.mlp.down_proj.weight]
Loading weights:   5%|▍         | 14/291 [00:00<00:08, 32.68it/s, Materializing param=model.layers.1.mlp.gate_proj.weight]
Loading weights:   5%|▍         | 14/291 [00:00<00:08, 32.68it/s, Materializing param=model.layers.1.mlp.gate_proj.weight]
Loading weights:   5%|▌         | 15/291 [00:00<00:09, 28.24it/s, Materializing param=model.layers.1.mlp.gate_proj.weight]
Loading weights:   5%|▌         | 15/291 [00:00<00:09, 28.24it/s, Materializing param=model.layers.1.mlp.up_proj.weight]  
Loading weights:   5%|▌         | 15/291 [00:00<00:09, 28.24it/s, Materializing param=model.layers.1.mlp.up_proj.weight]
Loading weights:   5%|▌         | 16/291 [00:00<00:09, 28.24it/s, Materializing param=model.layers.1.post_attention_layernorm.weight]
Loading weights:   5%|▌         | 16/291 [00:00<00:09, 28.24it/s, Materializing param=model.layers.1.post_attention_layernorm.weight]
Loading weights:   6%|▌         | 17/291 [00:00<00:09, 28.24it/s, Materializing param=model.layers.1.self_attn.k_proj.weight]        
Loading weights:   6%|▌         | 17/291 [00:00<00:09, 28.24it/s, Materializing param=model.layers.1.self_attn.k_proj.weight]
Loading weights:   6%|▌         | 18/291 [00:00<00:09, 28.24it/s, Materializing param=model.layers.1.self_attn.o_proj.weight]
Loading weights:   6%|▌         | 18/291 [00:00<00:09, 28.24it/s, Materializing param=model.layers.1.self_attn.o_proj.weight]
Loading weights:   7%|▋         | 19/291 [00:00<00:09, 28.24it/s, Materializing param=model.layers.1.self_attn.q_proj.weight]
Loading weights:   7%|▋         | 19/291 [00:00<00:09, 28.24it/s, Materializing param=model.layers.1.self_attn.q_proj.weight]
Loading weights:   7%|▋         | 20/291 [00:00<00:09, 27.30it/s, Materializing param=model.layers.1.self_attn.q_proj.weight]
Loading weights:   7%|▋         | 20/291 [00:00<00:09, 27.30it/s, Materializing param=model.layers.1.self_attn.v_proj.weight]
Loading weights:   7%|▋         | 20/291 [00:00<00:09, 27.30it/s, Materializing param=model.layers.1.self_attn.v_proj.weight]
Loading weights:   7%|▋         | 21/291 [00:00<00:09, 27.30it/s, Materializing param=model.layers.2.input_layernorm.weight] 
Loading weights:   7%|▋         | 21/291 [00:00<00:09, 27.30it/s, Materializing param=model.layers.2.input_layernorm.weight]
Loading weights:   8%|▊         | 22/291 [00:00<00:09, 27.30it/s, Materializing param=model.layers.2.mlp.down_proj.weight]  
Loading weights:   8%|▊         | 22/291 [00:00<00:09, 27.30it/s, Materializing param=model.layers.2.mlp.down_proj.weight]
Loading weights:   8%|▊         | 23/291 [00:00<00:09, 27.30it/s, Materializing param=model.layers.2.mlp.gate_proj.weight]
Loading weights:   8%|▊         | 23/291 [00:00<00:09, 27.30it/s, Materializing param=model.layers.2.mlp.gate_proj.weight]
Loading weights:   8%|▊         | 24/291 [00:00<00:10, 24.73it/s, Materializing param=model.layers.2.mlp.gate_proj.weight]
Loading weights:   8%|▊         | 24/291 [00:00<00:10, 24.73it/s, Materializing param=model.layers.2.mlp.up_proj.weight]  
Loading weights:   8%|▊         | 24/291 [00:00<00:10, 24.73it/s, Materializing param=model.layers.2.mlp.up_proj.weight]
Loading weights:   9%|▊         | 25/291 [00:00<00:10, 24.73it/s, Materializing param=model.layers.2.post_attention_layernorm.weight]
Loading weights:   9%|▊         | 25/291 [00:00<00:10, 24.73it/s, Materializing param=model.layers.2.post_attention_layernorm.weight]
Loading weights:   9%|▉         | 26/291 [00:00<00:10, 24.73it/s, Materializing param=model.layers.2.self_attn.k_proj.weight]        
Loading weights:   9%|▉         | 26/291 [00:00<00:10, 24.73it/s, Materializing param=model.layers.2.self_attn.k_proj.weight]
Loading weights:   9%|▉         | 27/291 [00:00<00:10, 24.73it/s, Materializing param=model.layers.2.self_attn.o_proj.weight]
Loading weights:   9%|▉         | 27/291 [00:00<00:10, 24.73it/s, Materializing param=model.layers.2.self_attn.o_proj.weight]
Loading weights:  10%|▉         | 28/291 [00:00<00:10, 24.73it/s, Materializing param=model.layers.2.self_attn.q_proj.weight]
Loading weights:  10%|▉         | 28/291 [00:00<00:10, 24.73it/s, Materializing param=model.layers.2.self_attn.q_proj.weight]
Loading weights:  10%|▉         | 29/291 [00:01<00:08, 29.82it/s, Materializing param=model.layers.2.self_attn.q_proj.weight]
Loading weights:  10%|▉         | 29/291 [00:01<00:08, 29.82it/s, Materializing param=model.layers.2.self_attn.v_proj.weight]
Loading weights:  10%|▉         | 29/291 [00:01<00:08, 29.82it/s, Materializing param=model.layers.2.self_attn.v_proj.weight]
Loading weights:  10%|█         | 30/291 [00:01<00:08, 29.82it/s, Materializing param=model.layers.3.input_layernorm.weight] 
Loading weights:  10%|█         | 30/291 [00:01<00:08, 29.82it/s, Materializing param=model.layers.3.input_layernorm.weight]
Loading weights:  11%|█         | 31/291 [00:01<00:08, 29.82it/s, Materializing param=model.layers.3.mlp.down_proj.weight]  
Loading weights:  11%|█         | 31/291 [00:01<00:08, 29.82it/s, Materializing param=model.layers.3.mlp.down_proj.weight]
Loading weights:  11%|█         | 32/291 [00:01<00:08, 29.82it/s, Materializing param=model.layers.3.mlp.gate_proj.weight]
Loading weights:  11%|█         | 32/291 [00:01<00:08, 29.82it/s, Materializing param=model.layers.3.mlp.gate_proj.weight]
Loading weights:  11%|█▏        | 33/291 [00:01<00:08, 29.82it/s, Materializing param=model.layers.3.mlp.up_proj.weight]  
Loading weights:  11%|█▏        | 33/291 [00:01<00:08, 29.82it/s, Materializing param=model.layers.3.mlp.up_proj.weight]
Loading weights:  12%|█▏        | 34/291 [00:01<00:07, 34.42it/s, Materializing param=model.layers.3.mlp.up_proj.weight]
Loading weights:  12%|█▏        | 34/291 [00:01<00:07, 34.42it/s, Materializing param=model.layers.3.post_attention_layernorm.weight]
Loading weights:  12%|█▏        | 34/291 [00:01<00:07, 34.42it/s, Materializing param=model.layers.3.post_attention_layernorm.weight]
Loading weights:  12%|█▏        | 35/291 [00:01<00:07, 34.42it/s, Materializing param=model.layers.3.self_attn.k_proj.weight]        
Loading weights:  12%|█▏        | 35/291 [00:01<00:07, 34.42it/s, Materializing param=model.layers.3.self_attn.k_proj.weight]
Loading weights:  12%|█▏        | 36/291 [00:01<00:07, 34.42it/s, Materializing param=model.layers.3.self_attn.o_proj.weight]
Loading weights:  12%|█▏        | 36/291 [00:01<00:07, 34.42it/s, Materializing param=model.layers.3.self_attn.o_proj.weight]
Loading weights:  13%|█▎        | 37/291 [00:01<00:07, 34.42it/s, Materializing param=model.layers.3.self_attn.q_proj.weight]
Loading weights:  13%|█▎        | 37/291 [00:01<00:07, 34.42it/s, Materializing param=model.layers.3.self_attn.q_proj.weight]
Loading weights:  13%|█▎        | 38/291 [00:01<00:07, 34.42it/s, Materializing param=model.layers.3.self_attn.v_proj.weight]
Loading weights:  13%|█▎        | 38/291 [00:01<00:07, 34.42it/s, Materializing param=model.layers.3.self_attn.v_proj.weight]
Loading weights:  13%|█▎        | 39/291 [00:01<00:07, 34.42it/s, Materializing param=model.layers.4.input_layernorm.weight] 
Loading weights:  13%|█▎        | 39/291 [00:01<00:07, 34.42it/s, Materializing param=model.layers.4.input_layernorm.weight]
Loading weights:  14%|█▎        | 40/291 [00:01<00:07, 34.42it/s, Materializing param=model.layers.4.mlp.down_proj.weight]  
Loading weights:  14%|█▎        | 40/291 [00:01<00:07, 34.42it/s, Materializing param=model.layers.4.mlp.down_proj.weight]
Loading weights:  14%|█▍        | 41/291 [00:01<00:07, 34.86it/s, Materializing param=model.layers.4.mlp.down_proj.weight]
Loading weights:  14%|█▍        | 41/291 [00:01<00:07, 34.86it/s, Materializing param=model.layers.4.mlp.gate_proj.weight]
Loading weights:  14%|█▍        | 41/291 [00:01<00:07, 34.86it/s, Materializing param=model.layers.4.mlp.gate_proj.weight]
Loading weights:  14%|█▍        | 42/291 [00:01<00:07, 34.86it/s, Materializing param=model.layers.4.mlp.up_proj.weight]  
Loading weights:  14%|█▍        | 42/291 [00:01<00:07, 34.86it/s, Materializing param=model.layers.4.mlp.up_proj.weight]
Loading weights:  15%|█▍        | 43/291 [00:01<00:07, 34.86it/s, Materializing param=model.layers.4.post_attention_layernorm.weight]
Loading weights:  15%|█▍        | 43/291 [00:01<00:07, 34.86it/s, Materializing param=model.layers.4.post_attention_layernorm.weight]
Loading weights:  15%|█▌        | 44/291 [00:01<00:07, 34.86it/s, Materializing param=model.layers.4.self_attn.k_proj.weight]        
Loading weights:  15%|█▌        | 44/291 [00:01<00:07, 34.86it/s, Materializing param=model.layers.4.self_attn.k_proj.weight]
Loading weights:  15%|█▌        | 45/291 [00:01<00:07, 34.86it/s, Materializing param=model.layers.4.self_attn.o_proj.weight]
Loading weights:  15%|█▌        | 45/291 [00:01<00:07, 34.86it/s, Materializing param=model.layers.4.self_attn.o_proj.weight]
Loading weights:  16%|█▌        | 46/291 [00:01<00:07, 34.86it/s, Materializing param=model.layers.4.self_attn.q_proj.weight]
Loading weights:  16%|█▌        | 46/291 [00:01<00:07, 34.86it/s, Materializing param=model.layers.4.self_attn.q_proj.weight]
Loading weights:  16%|█▌        | 47/291 [00:01<00:06, 34.86it/s, Materializing param=model.layers.4.self_attn.v_proj.weight]
Loading weights:  16%|█▌        | 47/291 [00:01<00:06, 34.86it/s, Materializing param=model.layers.4.self_attn.v_proj.weight]
Loading weights:  16%|█▋        | 48/291 [00:01<00:06, 34.86it/s, Materializing param=model.layers.5.input_layernorm.weight] 
Loading weights:  16%|█▋        | 48/291 [00:01<00:06, 34.86it/s, Materializing param=model.layers.5.input_layernorm.weight]
Loading weights:  17%|█▋        | 49/291 [00:01<00:06, 34.86it/s, Materializing param=model.layers.5.mlp.down_proj.weight]  
Loading weights:  17%|█▋        | 49/291 [00:01<00:06, 34.86it/s, Materializing param=model.layers.5.mlp.down_proj.weight]
Loading weights:  17%|█▋        | 50/291 [00:01<00:06, 38.66it/s, Materializing param=model.layers.5.mlp.down_proj.weight]
Loading weights:  17%|█▋        | 50/291 [00:01<00:06, 38.66it/s, Materializing param=model.layers.5.mlp.gate_proj.weight]
Loading weights:  17%|█▋        | 50/291 [00:01<00:06, 38.66it/s, Materializing param=model.layers.5.mlp.gate_proj.weight]
Loading weights:  18%|█▊        | 51/291 [00:01<00:06, 38.66it/s, Materializing param=model.layers.5.mlp.up_proj.weight]  
Loading weights:  18%|█▊        | 51/291 [00:01<00:06, 38.66it/s, Materializing param=model.layers.5.mlp.up_proj.weight]
Loading weights:  18%|█▊        | 52/291 [00:01<00:06, 38.66it/s, Materializing param=model.layers.5.post_attention_layernorm.weight]
Loading weights:  18%|█▊        | 52/291 [00:01<00:06, 38.66it/s, Materializing param=model.layers.5.post_attention_layernorm.weight]
Loading weights:  18%|█▊        | 53/291 [00:01<00:06, 38.66it/s, Materializing param=model.layers.5.self_attn.k_proj.weight]        
Loading weights:  18%|█▊        | 53/291 [00:01<00:06, 38.66it/s, Materializing param=model.layers.5.self_attn.k_proj.weight]
Loading weights:  19%|█▊        | 54/291 [00:01<00:06, 38.66it/s, Materializing param=model.layers.5.self_attn.o_proj.weight]
Loading weights:  19%|█▊        | 54/291 [00:01<00:06, 38.66it/s, Materializing param=model.layers.5.self_attn.o_proj.weight]
Loading weights:  19%|█▉        | 55/291 [00:01<00:06, 38.66it/s, Materializing param=model.layers.5.self_attn.q_proj.weight]
Loading weights:  19%|█▉        | 55/291 [00:01<00:06, 38.66it/s, Materializing param=model.layers.5.self_attn.q_proj.weight]
Loading weights:  19%|█▉        | 56/291 [00:01<00:06, 38.66it/s, Materializing param=model.layers.5.self_attn.v_proj.weight]
Loading weights:  19%|█▉        | 56/291 [00:01<00:06, 38.66it/s, Materializing param=model.layers.5.self_attn.v_proj.weight]
Loading weights:  20%|█▉        | 57/291 [00:01<00:06, 38.66it/s, Materializing param=model.layers.6.input_layernorm.weight] 
Loading weights:  20%|█▉        | 57/291 [00:01<00:06, 38.66it/s, Materializing param=model.layers.6.input_layernorm.weight]
Loading weights:  20%|█▉        | 58/291 [00:01<00:06, 38.66it/s, Materializing param=model.layers.6.mlp.down_proj.weight]  
Loading weights:  20%|█▉        | 58/291 [00:01<00:06, 38.66it/s, Materializing param=model.layers.6.mlp.down_proj.weight]
Loading weights:  20%|██        | 59/291 [00:01<00:05, 40.63it/s, Materializing param=model.layers.6.mlp.down_proj.weight]
Loading weights:  20%|██        | 59/291 [00:01<00:05, 40.63it/s, Materializing param=model.layers.6.mlp.gate_proj.weight]
Loading weights:  20%|██        | 59/291 [00:01<00:05, 40.63it/s, Materializing param=model.layers.6.mlp.gate_proj.weight]
Loading weights:  21%|██        | 60/291 [00:01<00:05, 40.63it/s, Materializing param=model.layers.6.mlp.up_proj.weight]  
Loading weights:  21%|██        | 60/291 [00:01<00:05, 40.63it/s, Materializing param=model.layers.6.mlp.up_proj.weight]
Loading weights:  21%|██        | 61/291 [00:01<00:05, 40.63it/s, Materializing param=model.layers.6.post_attention_layernorm.weight]
Loading weights:  21%|██        | 61/291 [00:01<00:05, 40.63it/s, Materializing param=model.layers.6.post_attention_layernorm.weight]
Loading weights:  21%|██▏       | 62/291 [00:01<00:05, 40.63it/s, Materializing param=model.layers.6.self_attn.k_proj.weight]        
Loading weights:  21%|██▏       | 62/291 [00:01<00:05, 40.63it/s, Materializing param=model.layers.6.self_attn.k_proj.weight]
Loading weights:  22%|██▏       | 63/291 [00:01<00:05, 40.63it/s, Materializing param=model.layers.6.self_attn.o_proj.weight]
Loading weights:  22%|██▏       | 63/291 [00:01<00:05, 40.63it/s, Materializing param=model.layers.6.self_attn.o_proj.weight]
Loading weights:  22%|██▏       | 64/291 [00:01<00:05, 40.63it/s, Materializing param=model.layers.6.self_attn.q_proj.weight]
Loading weights:  22%|██▏       | 64/291 [00:01<00:05, 40.63it/s, Materializing param=model.layers.6.self_attn.q_proj.weight]
Loading weights:  22%|██▏       | 65/291 [00:01<00:05, 40.63it/s, Materializing param=model.layers.6.self_attn.v_proj.weight]
Loading weights:  22%|██▏       | 65/291 [00:01<00:05, 40.63it/s, Materializing param=model.layers.6.self_attn.v_proj.weight]
Loading weights:  23%|██▎       | 66/291 [00:01<00:05, 40.63it/s, Materializing param=model.layers.7.input_layernorm.weight] 
Loading weights:  23%|██▎       | 66/291 [00:01<00:05, 40.63it/s, Materializing param=model.layers.7.input_layernorm.weight]
Loading weights:  23%|██▎       | 67/291 [00:01<00:05, 40.63it/s, Materializing param=model.layers.7.mlp.down_proj.weight]  
Loading weights:  23%|██▎       | 67/291 [00:01<00:05, 40.63it/s, Materializing param=model.layers.7.mlp.down_proj.weight]
Loading weights:  23%|██▎       | 68/291 [00:01<00:05, 42.17it/s, Materializing param=model.layers.7.mlp.down_proj.weight]
Loading weights:  23%|██▎       | 68/291 [00:01<00:05, 42.17it/s, Materializing param=model.layers.7.mlp.gate_proj.weight]
Loading weights:  23%|██▎       | 68/291 [00:01<00:05, 42.17it/s, Materializing param=model.layers.7.mlp.gate_proj.weight]
Loading weights:  24%|██▎       | 69/291 [00:01<00:05, 42.17it/s, Materializing param=model.layers.7.mlp.up_proj.weight]  
Loading weights:  24%|██▎       | 69/291 [00:01<00:05, 42.17it/s, Materializing param=model.layers.7.mlp.up_proj.weight]
Loading weights:  24%|██▍       | 70/291 [00:01<00:05, 42.17it/s, Materializing param=model.layers.7.post_attention_layernorm.weight]
Loading weights:  24%|██▍       | 70/291 [00:01<00:05, 42.17it/s, Materializing param=model.layers.7.post_attention_layernorm.weight]
Loading weights:  24%|██▍       | 71/291 [00:01<00:05, 42.17it/s, Materializing param=model.layers.7.self_attn.k_proj.weight]        
Loading weights:  24%|██▍       | 71/291 [00:01<00:05, 42.17it/s, Materializing param=model.layers.7.self_attn.k_proj.weight]
Loading weights:  25%|██▍       | 72/291 [00:01<00:05, 42.17it/s, Materializing param=model.layers.7.self_attn.o_proj.weight]
Loading weights:  25%|██▍       | 72/291 [00:01<00:05, 42.17it/s, Materializing param=model.layers.7.self_attn.o_proj.weight]
Loading weights:  25%|██▌       | 73/291 [00:01<00:05, 42.17it/s, Materializing param=model.layers.7.self_attn.q_proj.weight]
Loading weights:  25%|██▌       | 73/291 [00:01<00:05, 42.17it/s, Materializing param=model.layers.7.self_attn.q_proj.weight]
Loading weights:  25%|██▌       | 74/291 [00:01<00:05, 42.17it/s, Materializing param=model.layers.7.self_attn.v_proj.weight]
Loading weights:  25%|██▌       | 74/291 [00:01<00:05, 42.17it/s, Materializing param=model.layers.7.self_attn.v_proj.weight]
Loading weights:  26%|██▌       | 75/291 [00:01<00:05, 42.17it/s, Materializing param=model.layers.8.input_layernorm.weight] 
Loading weights:  26%|██▌       | 75/291 [00:01<00:05, 42.17it/s, Materializing param=model.layers.8.input_layernorm.weight]
Loading weights:  26%|██▌       | 76/291 [00:01<00:05, 42.17it/s, Materializing param=model.layers.8.mlp.down_proj.weight]  
Loading weights:  26%|██▌       | 76/291 [00:01<00:05, 42.17it/s, Materializing param=model.layers.8.mlp.down_proj.weight]
Loading weights:  26%|██▋       | 77/291 [00:02<00:04, 43.00it/s, Materializing param=model.layers.8.mlp.down_proj.weight]
Loading weights:  26%|██▋       | 77/291 [00:02<00:04, 43.00it/s, Materializing param=model.layers.8.mlp.gate_proj.weight]
Loading weights:  26%|██▋       | 77/291 [00:02<00:04, 43.00it/s, Materializing param=model.layers.8.mlp.gate_proj.weight]
Loading weights:  27%|██▋       | 78/291 [00:02<00:04, 43.00it/s, Materializing param=model.layers.8.mlp.up_proj.weight]  
Loading weights:  27%|██▋       | 78/291 [00:02<00:04, 43.00it/s, Materializing param=model.layers.8.mlp.up_proj.weight]
Loading weights:  27%|██▋       | 79/291 [00:02<00:04, 43.00it/s, Materializing param=model.layers.8.post_attention_layernorm.weight]
Loading weights:  27%|██▋       | 79/291 [00:02<00:04, 43.00it/s, Materializing param=model.layers.8.post_attention_layernorm.weight]
Loading weights:  27%|██▋       | 80/291 [00:02<00:04, 43.00it/s, Materializing param=model.layers.8.self_attn.k_proj.weight]        
Loading weights:  27%|██▋       | 80/291 [00:02<00:04, 43.00it/s, Materializing param=model.layers.8.self_attn.k_proj.weight]
Loading weights:  28%|██▊       | 81/291 [00:02<00:04, 43.00it/s, Materializing param=model.layers.8.self_attn.o_proj.weight]
Loading weights:  28%|██▊       | 81/291 [00:02<00:04, 43.00it/s, Materializing param=model.layers.8.self_attn.o_proj.weight]
Loading weights:  28%|██▊       | 82/291 [00:02<00:04, 43.00it/s, Materializing param=model.layers.8.self_attn.q_proj.weight]
Loading weights:  28%|██▊       | 82/291 [00:02<00:04, 43.00it/s, Materializing param=model.layers.8.self_attn.q_proj.weight]
Loading weights:  29%|██▊       | 83/291 [00:02<00:04, 43.00it/s, Materializing param=model.layers.8.self_attn.v_proj.weight]
Loading weights:  29%|██▊       | 83/291 [00:02<00:04, 43.00it/s, Materializing param=model.layers.8.self_attn.v_proj.weight]
Loading weights:  29%|██▉       | 84/291 [00:02<00:04, 43.00it/s, Materializing param=model.layers.9.input_layernorm.weight] 
Loading weights:  29%|██▉       | 84/291 [00:02<00:04, 43.00it/s, Materializing param=model.layers.9.input_layernorm.weight]
Loading weights:  29%|██▉       | 85/291 [00:02<00:04, 43.00it/s, Materializing param=model.layers.9.mlp.down_proj.weight]  
Loading weights:  29%|██▉       | 85/291 [00:02<00:04, 43.00it/s, Materializing param=model.layers.9.mlp.down_proj.weight]
Loading weights:  30%|██▉       | 86/291 [00:02<00:04, 43.79it/s, Materializing param=model.layers.9.mlp.down_proj.weight]
Loading weights:  30%|██▉       | 86/291 [00:02<00:04, 43.79it/s, Materializing param=model.layers.9.mlp.gate_proj.weight]
Loading weights:  30%|██▉       | 86/291 [00:02<00:04, 43.79it/s, Materializing param=model.layers.9.mlp.gate_proj.weight]
Loading weights:  30%|██▉       | 87/291 [00:02<00:04, 43.79it/s, Materializing param=model.layers.9.mlp.up_proj.weight]  
Loading weights:  30%|██▉       | 87/291 [00:02<00:04, 43.79it/s, Materializing param=model.layers.9.mlp.up_proj.weight]
Loading weights:  30%|███       | 88/291 [00:02<00:04, 43.79it/s, Materializing param=model.layers.9.post_attention_layernorm.weight]
Loading weights:  30%|███       | 88/291 [00:02<00:04, 43.79it/s, Materializing param=model.layers.9.post_attention_layernorm.weight]
Loading weights:  31%|███       | 89/291 [00:02<00:04, 43.79it/s, Materializing param=model.layers.9.self_attn.k_proj.weight]        
Loading weights:  31%|███       | 89/291 [00:02<00:04, 43.79it/s, Materializing param=model.layers.9.self_attn.k_proj.weight]
Loading weights:  31%|███       | 90/291 [00:02<00:04, 43.79it/s, Materializing param=model.layers.9.self_attn.o_proj.weight]
Loading weights:  31%|███       | 90/291 [00:02<00:04, 43.79it/s, Materializing param=model.layers.9.self_attn.o_proj.weight]
Loading weights:  31%|███▏      | 91/291 [00:02<00:04, 43.79it/s, Materializing param=model.layers.9.self_attn.q_proj.weight]
Loading weights:  31%|███▏      | 91/291 [00:02<00:04, 43.79it/s, Materializing param=model.layers.9.self_attn.q_proj.weight]
Loading weights:  32%|███▏      | 92/291 [00:02<00:04, 43.79it/s, Materializing param=model.layers.9.self_attn.v_proj.weight]
Loading weights:  32%|███▏      | 92/291 [00:02<00:04, 43.79it/s, Materializing param=model.layers.9.self_attn.v_proj.weight]
Loading weights:  32%|███▏      | 93/291 [00:02<00:04, 43.79it/s, Materializing param=model.layers.10.input_layernorm.weight]
Loading weights:  32%|███▏      | 93/291 [00:02<00:04, 43.79it/s, Materializing param=model.layers.10.input_layernorm.weight]
Loading weights:  32%|███▏      | 94/291 [00:02<00:04, 43.79it/s, Materializing param=model.layers.10.mlp.down_proj.weight]  
Loading weights:  32%|███▏      | 94/291 [00:02<00:04, 43.79it/s, Materializing param=model.layers.10.mlp.down_proj.weight]
Loading weights:  33%|███▎      | 95/291 [00:02<00:03, 51.26it/s, Materializing param=model.layers.10.mlp.down_proj.weight]
Loading weights:  33%|███▎      | 95/291 [00:02<00:03, 51.26it/s, Materializing param=model.layers.10.mlp.gate_proj.weight]
Loading weights:  33%|███▎      | 95/291 [00:02<00:03, 51.26it/s, Materializing param=model.layers.10.mlp.gate_proj.weight]
Loading weights:  33%|███▎      | 96/291 [00:02<00:03, 51.26it/s, Materializing param=model.layers.10.mlp.up_proj.weight]  
Loading weights:  33%|███▎      | 96/291 [00:02<00:03, 51.26it/s, Materializing param=model.layers.10.mlp.up_proj.weight]
Loading weights:  33%|███▎      | 97/291 [00:02<00:03, 51.26it/s, Materializing param=model.layers.10.post_attention_layernorm.weight]
Loading weights:  33%|███▎      | 97/291 [00:02<00:03, 51.26it/s, Materializing param=model.layers.10.post_attention_layernorm.weight]
Loading weights:  34%|███▎      | 98/291 [00:02<00:03, 51.26it/s, Materializing param=model.layers.10.self_attn.k_proj.weight]        
Loading weights:  34%|███▎      | 98/291 [00:02<00:03, 51.26it/s, Materializing param=model.layers.10.self_attn.k_proj.weight]
Loading weights:  34%|███▍      | 99/291 [00:02<00:03, 51.26it/s, Materializing param=model.layers.10.self_attn.o_proj.weight]
Loading weights:  34%|███▍      | 99/291 [00:02<00:03, 51.26it/s, Materializing param=model.layers.10.self_attn.o_proj.weight]
Loading weights:  34%|███▍      | 100/291 [00:02<00:03, 51.26it/s, Materializing param=model.layers.10.self_attn.q_proj.weight]
Loading weights:  34%|███▍      | 100/291 [00:02<00:03, 51.26it/s, Materializing param=model.layers.10.self_attn.q_proj.weight]
Loading weights:  35%|███▍      | 101/291 [00:02<00:04, 45.03it/s, Materializing param=model.layers.10.self_attn.q_proj.weight]
Loading weights:  35%|███▍      | 101/291 [00:02<00:04, 45.03it/s, Materializing param=model.layers.10.self_attn.v_proj.weight]
Loading weights:  35%|███▍      | 101/291 [00:02<00:04, 45.03it/s, Materializing param=model.layers.10.self_attn.v_proj.weight]
Loading weights:  35%|███▌      | 102/291 [00:02<00:04, 45.03it/s, Materializing param=model.layers.11.input_layernorm.weight] 
Loading weights:  35%|███▌      | 102/291 [00:02<00:04, 45.03it/s, Materializing param=model.layers.11.input_layernorm.weight]
Loading weights:  35%|███▌      | 103/291 [00:02<00:04, 45.03it/s, Materializing param=model.layers.11.mlp.down_proj.weight]  
Loading weights:  35%|███▌      | 103/291 [00:02<00:04, 45.03it/s, Materializing param=model.layers.11.mlp.down_proj.weight]
Loading weights:  36%|███▌      | 104/291 [00:02<00:04, 45.03it/s, Materializing param=model.layers.11.mlp.gate_proj.weight]
Loading weights:  36%|███▌      | 104/291 [00:02<00:04, 45.03it/s, Materializing param=model.layers.11.mlp.gate_proj.weight]
Loading weights:  36%|███▌      | 105/291 [00:02<00:04, 45.03it/s, Materializing param=model.layers.11.mlp.up_proj.weight]  
Loading weights:  36%|███▌      | 105/291 [00:02<00:04, 45.03it/s, Materializing param=model.layers.11.mlp.up_proj.weight]
Loading weights:  36%|███▋      | 106/291 [00:02<00:05, 31.69it/s, Materializing param=model.layers.11.mlp.up_proj.weight]
Loading weights:  36%|███▋      | 106/291 [00:03<00:05, 31.69it/s, Materializing param=model.layers.11.post_attention_layernorm.weight]
Loading weights:  36%|███▋      | 106/291 [00:03<00:05, 31.69it/s, Materializing param=model.layers.11.post_attention_layernorm.weight]
Loading weights:  37%|███▋      | 107/291 [00:03<00:05, 31.69it/s, Materializing param=model.layers.11.self_attn.k_proj.weight]        
Loading weights:  37%|███▋      | 107/291 [00:03<00:05, 31.69it/s, Materializing param=model.layers.11.self_attn.k_proj.weight]
Loading weights:  37%|███▋      | 108/291 [00:03<00:05, 31.69it/s, Materializing param=model.layers.11.self_attn.o_proj.weight]
Loading weights:  37%|███▋      | 108/291 [00:03<00:05, 31.69it/s, Materializing param=model.layers.11.self_attn.o_proj.weight]
Loading weights:  37%|███▋      | 109/291 [00:03<00:05, 31.69it/s, Materializing param=model.layers.11.self_attn.q_proj.weight]
Loading weights:  37%|███▋      | 109/291 [00:03<00:05, 31.69it/s, Materializing param=model.layers.11.self_attn.q_proj.weight]
Loading weights:  38%|███▊      | 110/291 [00:03<00:05, 31.69it/s, Materializing param=model.layers.11.self_attn.v_proj.weight]
Loading weights:  38%|███▊      | 110/291 [00:03<00:05, 31.69it/s, Materializing param=model.layers.11.self_attn.v_proj.weight]
Loading weights:  38%|███▊      | 111/291 [00:03<00:05, 31.69it/s, Materializing param=model.layers.12.input_layernorm.weight] 
Loading weights:  38%|███▊      | 111/291 [00:03<00:05, 31.69it/s, Materializing param=model.layers.12.input_layernorm.weight]
Loading weights:  38%|███▊      | 112/291 [00:03<00:05, 31.69it/s, Materializing param=model.layers.12.mlp.down_proj.weight]  
Loading weights:  38%|███▊      | 112/291 [00:03<00:05, 31.69it/s, Materializing param=model.layers.12.mlp.down_proj.weight]
Loading weights:  39%|███▉      | 113/291 [00:03<00:05, 33.31it/s, Materializing param=model.layers.12.mlp.down_proj.weight]
Loading weights:  39%|███▉      | 113/291 [00:03<00:05, 33.31it/s, Materializing param=model.layers.12.mlp.gate_proj.weight]
Loading weights:  39%|███▉      | 113/291 [00:03<00:05, 33.31it/s, Materializing param=model.layers.12.mlp.gate_proj.weight]
Loading weights:  39%|███▉      | 114/291 [00:03<00:05, 33.31it/s, Materializing param=model.layers.12.mlp.up_proj.weight]  
Loading weights:  39%|███▉      | 114/291 [00:03<00:05, 33.31it/s, Materializing param=model.layers.12.mlp.up_proj.weight]
Loading weights:  40%|███▉      | 115/291 [00:03<00:05, 33.31it/s, Materializing param=model.layers.12.post_attention_layernorm.weight]
Loading weights:  40%|███▉      | 115/291 [00:03<00:05, 33.31it/s, Materializing param=model.layers.12.post_attention_layernorm.weight]
Loading weights:  40%|███▉      | 116/291 [00:03<00:05, 33.31it/s, Materializing param=model.layers.12.self_attn.k_proj.weight]        
Loading weights:  40%|███▉      | 116/291 [00:03<00:05, 33.31it/s, Materializing param=model.layers.12.self_attn.k_proj.weight]
Loading weights:  40%|████      | 117/291 [00:03<00:05, 32.91it/s, Materializing param=model.layers.12.self_attn.k_proj.weight]
Loading weights:  40%|████      | 117/291 [00:03<00:05, 32.91it/s, Materializing param=model.layers.12.self_attn.o_proj.weight]
Loading weights:  40%|████      | 117/291 [00:03<00:05, 32.91it/s, Materializing param=model.layers.12.self_attn.o_proj.weight]
Loading weights:  41%|████      | 118/291 [00:03<00:05, 32.91it/s, Materializing param=model.layers.12.self_attn.q_proj.weight]
Loading weights:  41%|████      | 118/291 [00:03<00:05, 32.91it/s, Materializing param=model.layers.12.self_attn.q_proj.weight]
Loading weights:  41%|████      | 119/291 [00:03<00:05, 32.91it/s, Materializing param=model.layers.12.self_attn.v_proj.weight]
Loading weights:  41%|████      | 119/291 [00:03<00:05, 32.91it/s, Materializing param=model.layers.12.self_attn.v_proj.weight]
Loading weights:  41%|████      | 120/291 [00:03<00:05, 32.91it/s, Materializing param=model.layers.13.input_layernorm.weight] 
Loading weights:  41%|████      | 120/291 [00:03<00:05, 32.91it/s, Materializing param=model.layers.13.input_layernorm.weight]
Loading weights:  42%|████▏     | 121/291 [00:03<00:05, 32.91it/s, Materializing param=model.layers.13.mlp.down_proj.weight]  
Loading weights:  42%|████▏     | 121/291 [00:03<00:05, 32.91it/s, Materializing param=model.layers.13.mlp.down_proj.weight]
Loading weights:  42%|████▏     | 122/291 [00:03<00:05, 32.91it/s, Materializing param=model.layers.13.mlp.gate_proj.weight]
Loading weights:  42%|████▏     | 122/291 [00:03<00:05, 32.91it/s, Materializing param=model.layers.13.mlp.gate_proj.weight]
Loading weights:  42%|████▏     | 123/291 [00:03<00:05, 29.13it/s, Materializing param=model.layers.13.mlp.gate_proj.weight]
Loading weights:  42%|████▏     | 123/291 [00:03<00:05, 29.13it/s, Materializing param=model.layers.13.mlp.up_proj.weight]  
Loading weights:  42%|████▏     | 123/291 [00:03<00:05, 29.13it/s, Materializing param=model.layers.13.mlp.up_proj.weight]
Loading weights:  43%|████▎     | 124/291 [00:03<00:05, 29.13it/s, Materializing param=model.layers.13.post_attention_layernorm.weight]
Loading weights:  43%|████▎     | 124/291 [00:03<00:05, 29.13it/s, Materializing param=model.layers.13.post_attention_layernorm.weight]
Loading weights:  43%|████▎     | 125/291 [00:03<00:05, 29.13it/s, Materializing param=model.layers.13.self_attn.k_proj.weight]        
Loading weights:  43%|████▎     | 125/291 [00:03<00:05, 29.13it/s, Materializing param=model.layers.13.self_attn.k_proj.weight]
Loading weights:  43%|████▎     | 126/291 [00:03<00:05, 29.13it/s, Materializing param=model.layers.13.self_attn.o_proj.weight]
Loading weights:  43%|████▎     | 126/291 [00:03<00:05, 29.13it/s, Materializing param=model.layers.13.self_attn.o_proj.weight]
Loading weights:  44%|████▎     | 127/291 [00:03<00:05, 29.13it/s, Materializing param=model.layers.13.self_attn.q_proj.weight]
Loading weights:  44%|████▎     | 127/291 [00:03<00:05, 29.13it/s, Materializing param=model.layers.13.self_attn.q_proj.weight]
Loading weights:  44%|████▍     | 128/291 [00:03<00:05, 29.13it/s, Materializing param=model.layers.13.self_attn.v_proj.weight]
Loading weights:  44%|████▍     | 128/291 [00:03<00:05, 29.13it/s, Materializing param=model.layers.13.self_attn.v_proj.weight]
Loading weights:  44%|████▍     | 129/291 [00:03<00:05, 29.13it/s, Materializing param=model.layers.14.input_layernorm.weight] 
Loading weights:  44%|████▍     | 129/291 [00:03<00:05, 29.13it/s, Materializing param=model.layers.14.input_layernorm.weight]
Loading weights:  45%|████▍     | 130/291 [00:03<00:05, 29.13it/s, Materializing param=model.layers.14.mlp.down_proj.weight]  
Loading weights:  45%|████▍     | 130/291 [00:03<00:05, 29.13it/s, Materializing param=model.layers.14.mlp.down_proj.weight]
Loading weights:  45%|████▌     | 131/291 [00:04<00:12, 13.03it/s, Materializing param=model.layers.14.mlp.down_proj.weight]
Loading weights:  45%|████▌     | 131/291 [00:04<00:12, 13.03it/s, Materializing param=model.layers.14.mlp.gate_proj.weight]
Loading weights:  45%|████▌     | 131/291 [00:04<00:12, 13.03it/s, Materializing param=model.layers.14.mlp.gate_proj.weight]
Loading weights:  45%|████▌     | 132/291 [00:04<00:12, 13.03it/s, Materializing param=model.layers.14.mlp.up_proj.weight]  
Loading weights:  45%|████▌     | 132/291 [00:04<00:12, 13.03it/s, Materializing param=model.layers.14.mlp.up_proj.weight]
Loading weights:  46%|████▌     | 133/291 [00:04<00:12, 13.03it/s, Materializing param=model.layers.14.post_attention_layernorm.weight]
Loading weights:  46%|████▌     | 133/291 [00:04<00:12, 13.03it/s, Materializing param=model.layers.14.post_attention_layernorm.weight]
Loading weights:  46%|████▌     | 134/291 [00:04<00:12, 13.03it/s, Materializing param=model.layers.14.self_attn.k_proj.weight]        
Loading weights:  46%|████▌     | 134/291 [00:04<00:12, 13.03it/s, Materializing param=model.layers.14.self_attn.k_proj.weight]
Loading weights:  46%|████▋     | 135/291 [00:04<00:11, 13.03it/s, Materializing param=model.layers.14.self_attn.o_proj.weight]
Loading weights:  46%|████▋     | 135/291 [00:04<00:11, 13.03it/s, Materializing param=model.layers.14.self_attn.o_proj.weight]
Loading weights:  47%|████▋     | 136/291 [00:04<00:11, 13.03it/s, Materializing param=model.layers.14.self_attn.q_proj.weight]
Loading weights:  47%|████▋     | 136/291 [00:04<00:11, 13.03it/s, Materializing param=model.layers.14.self_attn.q_proj.weight]
Loading weights:  47%|████▋     | 137/291 [00:04<00:11, 13.03it/s, Materializing param=model.layers.14.self_attn.v_proj.weight]
Loading weights:  47%|████▋     | 137/291 [00:04<00:11, 13.03it/s, Materializing param=model.layers.14.self_attn.v_proj.weight]
Loading weights:  47%|████▋     | 138/291 [00:04<00:09, 16.38it/s, Materializing param=model.layers.14.self_attn.v_proj.weight]
Loading weights:  47%|████▋     | 138/291 [00:04<00:09, 16.38it/s, Materializing param=model.layers.15.input_layernorm.weight] 
Loading weights:  47%|████▋     | 138/291 [00:04<00:09, 16.38it/s, Materializing param=model.layers.15.input_layernorm.weight]
Loading weights:  48%|████▊     | 139/291 [00:04<00:09, 16.38it/s, Materializing param=model.layers.15.mlp.down_proj.weight]  
Loading weights:  48%|████▊     | 139/291 [00:04<00:09, 16.38it/s, Materializing param=model.layers.15.mlp.down_proj.weight]
Loading weights:  48%|████▊     | 140/291 [00:04<00:09, 16.38it/s, Materializing param=model.layers.15.mlp.gate_proj.weight]
Loading weights:  48%|████▊     | 140/291 [00:04<00:09, 16.38it/s, Materializing param=model.layers.15.mlp.gate_proj.weight]
Loading weights:  48%|████▊     | 141/291 [00:04<00:09, 16.38it/s, Materializing param=model.layers.15.mlp.up_proj.weight]  
Loading weights:  48%|████▊     | 141/291 [00:04<00:09, 16.38it/s, Materializing param=model.layers.15.mlp.up_proj.weight]
Loading weights:  49%|████▉     | 142/291 [00:05<00:08, 16.59it/s, Materializing param=model.layers.15.mlp.up_proj.weight]
Loading weights:  49%|████▉     | 142/291 [00:05<00:08, 16.59it/s, Materializing param=model.layers.15.post_attention_layernorm.weight]
Loading weights:  49%|████▉     | 142/291 [00:05<00:08, 16.59it/s, Materializing param=model.layers.15.post_attention_layernorm.weight]
Loading weights:  49%|████▉     | 143/291 [00:05<00:08, 16.59it/s, Materializing param=model.layers.15.self_attn.k_proj.weight]        
Loading weights:  49%|████▉     | 143/291 [00:05<00:08, 16.59it/s, Materializing param=model.layers.15.self_attn.k_proj.weight]
Loading weights:  49%|████▉     | 144/291 [00:05<00:08, 16.59it/s, Materializing param=model.layers.15.self_attn.o_proj.weight]
Loading weights:  49%|████▉     | 144/291 [00:05<00:08, 16.59it/s, Materializing param=model.layers.15.self_attn.o_proj.weight]
Loading weights:  50%|████▉     | 145/291 [00:05<00:08, 16.59it/s, Materializing param=model.layers.15.self_attn.q_proj.weight]
Loading weights:  50%|████▉     | 145/291 [00:05<00:08, 16.59it/s, Materializing param=model.layers.15.self_attn.q_proj.weight]
Loading weights:  50%|█████     | 146/291 [00:05<00:08, 16.59it/s, Materializing param=model.layers.15.self_attn.v_proj.weight]
Loading weights:  50%|█████     | 146/291 [00:05<00:08, 16.59it/s, Materializing param=model.layers.15.self_attn.v_proj.weight]
Loading weights:  51%|█████     | 147/291 [00:05<00:08, 16.59it/s, Materializing param=model.layers.16.input_layernorm.weight] 
Loading weights:  51%|█████     | 147/291 [00:05<00:08, 16.59it/s, Materializing param=model.layers.16.input_layernorm.weight]
Loading weights:  51%|█████     | 148/291 [00:05<00:08, 16.59it/s, Materializing param=model.layers.16.mlp.down_proj.weight]  
Loading weights:  51%|█████     | 148/291 [00:05<00:08, 16.59it/s, Materializing param=model.layers.16.mlp.down_proj.weight]
Loading weights:  51%|█████     | 149/291 [00:05<00:06, 20.69it/s, Materializing param=model.layers.16.mlp.down_proj.weight]
Loading weights:  51%|█████     | 149/291 [00:05<00:06, 20.69it/s, Materializing param=model.layers.16.mlp.gate_proj.weight]
Loading weights:  51%|█████     | 149/291 [00:05<00:06, 20.69it/s, Materializing param=model.layers.16.mlp.gate_proj.weight]
Loading weights:  52%|█████▏    | 150/291 [00:05<00:06, 20.69it/s, Materializing param=model.layers.16.mlp.up_proj.weight]  
Loading weights:  52%|█████▏    | 150/291 [00:05<00:06, 20.69it/s, Materializing param=model.layers.16.mlp.up_proj.weight]
Loading weights:  52%|█████▏    | 151/291 [00:05<00:06, 20.69it/s, Materializing param=model.layers.16.post_attention_layernorm.weight]
Loading weights:  52%|█████▏    | 151/291 [00:05<00:06, 20.69it/s, Materializing param=model.layers.16.post_attention_layernorm.weight]
Loading weights:  52%|█████▏    | 152/291 [00:05<00:07, 18.85it/s, Materializing param=model.layers.16.post_attention_layernorm.weight]
Loading weights:  52%|█████▏    | 152/291 [00:05<00:07, 18.85it/s, Materializing param=model.layers.16.self_attn.k_proj.weight]        
Loading weights:  52%|█████▏    | 152/291 [00:05<00:07, 18.85it/s, Materializing param=model.layers.16.self_attn.k_proj.weight]
Loading weights:  53%|█████▎    | 153/291 [00:05<00:07, 18.85it/s, Materializing param=model.layers.16.self_attn.o_proj.weight]
Loading weights:  53%|█████▎    | 153/291 [00:05<00:07, 18.85it/s, Materializing param=model.layers.16.self_attn.o_proj.weight]
Loading weights:  53%|█████▎    | 154/291 [00:05<00:07, 18.85it/s, Materializing param=model.layers.16.self_attn.q_proj.weight]
Loading weights:  53%|█████▎    | 154/291 [00:05<00:07, 18.85it/s, Materializing param=model.layers.16.self_attn.q_proj.weight]
Loading weights:  53%|█████▎    | 155/291 [00:05<00:07, 18.85it/s, Materializing param=model.layers.16.self_attn.v_proj.weight]
Loading weights:  53%|█████▎    | 155/291 [00:05<00:07, 18.85it/s, Materializing param=model.layers.16.self_attn.v_proj.weight]
Loading weights:  54%|█████▎    | 156/291 [00:05<00:07, 18.85it/s, Materializing param=model.layers.17.input_layernorm.weight] 
Loading weights:  54%|█████▎    | 156/291 [00:05<00:07, 18.85it/s, Materializing param=model.layers.17.input_layernorm.weight]
Loading weights:  54%|█████▍    | 157/291 [00:05<00:07, 18.85it/s, Materializing param=model.layers.17.mlp.down_proj.weight]  
Loading weights:  54%|█████▍    | 157/291 [00:05<00:07, 18.85it/s, Materializing param=model.layers.17.mlp.down_proj.weight]
Loading weights:  54%|█████▍    | 158/291 [00:05<00:06, 19.86it/s, Materializing param=model.layers.17.mlp.down_proj.weight]
Loading weights:  54%|█████▍    | 158/291 [00:05<00:06, 19.86it/s, Materializing param=model.layers.17.mlp.gate_proj.weight]
Loading weights:  54%|█████▍    | 158/291 [00:05<00:06, 19.86it/s, Materializing param=model.layers.17.mlp.gate_proj.weight]
Loading weights:  55%|█████▍    | 159/291 [00:05<00:06, 19.86it/s, Materializing param=model.layers.17.mlp.up_proj.weight]  
Loading weights:  55%|█████▍    | 159/291 [00:05<00:06, 19.86it/s, Materializing param=model.layers.17.mlp.up_proj.weight]
Loading weights:  55%|█████▍    | 160/291 [00:05<00:06, 19.86it/s, Materializing param=model.layers.17.post_attention_layernorm.weight]
Loading weights:  55%|█████▍    | 160/291 [00:06<00:06, 19.86it/s, Materializing param=model.layers.17.post_attention_layernorm.weight]
Loading weights:  55%|█████▌    | 161/291 [00:06<00:06, 20.06it/s, Materializing param=model.layers.17.post_attention_layernorm.weight]
Loading weights:  55%|█████▌    | 161/291 [00:06<00:06, 20.06it/s, Materializing param=model.layers.17.self_attn.k_proj.weight]        
Loading weights:  55%|█████▌    | 161/291 [00:06<00:06, 20.06it/s, Materializing param=model.layers.17.self_attn.k_proj.weight]
Loading weights:  56%|█████▌    | 162/291 [00:06<00:06, 20.06it/s, Materializing param=model.layers.17.self_attn.o_proj.weight]
Loading weights:  56%|█████▌    | 162/291 [00:06<00:06, 20.06it/s, Materializing param=model.layers.17.self_attn.o_proj.weight]
Loading weights:  56%|█████▌    | 163/291 [00:06<00:06, 20.06it/s, Materializing param=model.layers.17.self_attn.q_proj.weight]
Loading weights:  56%|█████▌    | 163/291 [00:06<00:06, 20.06it/s, Materializing param=model.layers.17.self_attn.q_proj.weight]
Loading weights:  56%|█████▋    | 164/291 [00:06<00:06, 20.06it/s, Materializing param=model.layers.17.self_attn.v_proj.weight]
Loading weights:  56%|█████▋    | 164/291 [00:06<00:06, 20.06it/s, Materializing param=model.layers.17.self_attn.v_proj.weight]
Loading weights:  57%|█████▋    | 165/291 [00:06<00:06, 20.06it/s, Materializing param=model.layers.18.input_layernorm.weight] 
Loading weights:  57%|█████▋    | 165/291 [00:06<00:06, 20.06it/s, Materializing param=model.layers.18.input_layernorm.weight]
Loading weights:  57%|█████▋    | 166/291 [00:06<00:06, 20.06it/s, Materializing param=model.layers.18.mlp.down_proj.weight]  
Loading weights:  57%|█████▋    | 166/291 [00:06<00:06, 20.06it/s, Materializing param=model.layers.18.mlp.down_proj.weight]
Loading weights:  57%|█████▋    | 167/291 [00:06<00:06, 20.06it/s, Materializing param=model.layers.18.mlp.gate_proj.weight]
Loading weights:  57%|█████▋    | 167/291 [00:06<00:06, 20.06it/s, Materializing param=model.layers.18.mlp.gate_proj.weight]
Loading weights:  58%|█████▊    | 168/291 [00:06<00:09, 12.68it/s, Materializing param=model.layers.18.mlp.gate_proj.weight]
Loading weights:  58%|█████▊    | 168/291 [00:06<00:09, 12.68it/s, Materializing param=model.layers.18.mlp.up_proj.weight]  
Loading weights:  58%|█████▊    | 168/291 [00:06<00:09, 12.68it/s, Materializing param=model.layers.18.mlp.up_proj.weight]
Loading weights:  58%|█████▊    | 169/291 [00:06<00:09, 12.68it/s, Materializing param=model.layers.18.post_attention_layernorm.weight]
Loading weights:  58%|█████▊    | 169/291 [00:06<00:09, 12.68it/s, Materializing param=model.layers.18.post_attention_layernorm.weight]
Loading weights:  58%|█████▊    | 170/291 [00:06<00:09, 12.68it/s, Materializing param=model.layers.18.self_attn.k_proj.weight]        
Loading weights:  58%|█████▊    | 170/291 [00:06<00:09, 12.68it/s, Materializing param=model.layers.18.self_attn.k_proj.weight]
Loading weights:  59%|█████▉    | 171/291 [00:06<00:09, 12.68it/s, Materializing param=model.layers.18.self_attn.o_proj.weight]
Loading weights:  59%|█████▉    | 171/291 [00:06<00:09, 12.68it/s, Materializing param=model.layers.18.self_attn.o_proj.weight]
Loading weights:  59%|█████▉    | 172/291 [00:06<00:09, 12.68it/s, Materializing param=model.layers.18.self_attn.q_proj.weight]
Loading weights:  59%|█████▉    | 172/291 [00:06<00:09, 12.68it/s, Materializing param=model.layers.18.self_attn.q_proj.weight]
Loading weights:  59%|█████▉    | 173/291 [00:06<00:09, 12.68it/s, Materializing param=model.layers.18.self_attn.v_proj.weight]
Loading weights:  59%|█████▉    | 173/291 [00:06<00:09, 12.68it/s, Materializing param=model.layers.18.self_attn.v_proj.weight]
Loading weights:  60%|█████▉    | 174/291 [00:06<00:09, 12.68it/s, Materializing param=model.layers.19.input_layernorm.weight] 
Loading weights:  60%|█████▉    | 174/291 [00:06<00:09, 12.68it/s, Materializing param=model.layers.19.input_layernorm.weight]
Loading weights:  60%|██████    | 175/291 [00:06<00:09, 12.68it/s, Materializing param=model.layers.19.mlp.down_proj.weight]  
Loading weights:  60%|██████    | 175/291 [00:06<00:09, 12.68it/s, Materializing param=model.layers.19.mlp.down_proj.weight]
Loading weights:  60%|██████    | 176/291 [00:07<00:10, 11.48it/s, Materializing param=model.layers.19.mlp.down_proj.weight]
Loading weights:  60%|██████    | 176/291 [00:07<00:10, 11.48it/s, Materializing param=model.layers.19.mlp.gate_proj.weight]
Loading weights:  60%|██████    | 176/291 [00:07<00:10, 11.48it/s, Materializing param=model.layers.19.mlp.gate_proj.weight]
Loading weights:  61%|██████    | 177/291 [00:07<00:09, 11.48it/s, Materializing param=model.layers.19.mlp.up_proj.weight]  
Loading weights:  61%|██████    | 177/291 [00:07<00:09, 11.48it/s, Materializing param=model.layers.19.mlp.up_proj.weight]
Loading weights:  61%|██████    | 178/291 [00:07<00:09, 11.48it/s, Materializing param=model.layers.19.post_attention_layernorm.weight]
Loading weights:  61%|██████    | 178/291 [00:07<00:09, 11.48it/s, Materializing param=model.layers.19.post_attention_layernorm.weight]
Loading weights:  62%|██████▏   | 179/291 [00:07<00:09, 11.48it/s, Materializing param=model.layers.19.self_attn.k_proj.weight]        
Loading weights:  62%|██████▏   | 179/291 [00:07<00:09, 11.48it/s, Materializing param=model.layers.19.self_attn.k_proj.weight]
Loading weights:  62%|██████▏   | 180/291 [00:07<00:09, 11.48it/s, Materializing param=model.layers.19.self_attn.o_proj.weight]
Loading weights:  62%|██████▏   | 180/291 [00:07<00:09, 11.48it/s, Materializing param=model.layers.19.self_attn.o_proj.weight]
Loading weights:  62%|██████▏   | 181/291 [00:07<00:09, 11.48it/s, Materializing param=model.layers.19.self_attn.q_proj.weight]
Loading weights:  62%|██████▏   | 181/291 [00:07<00:09, 11.48it/s, Materializing param=model.layers.19.self_attn.q_proj.weight]
Loading weights:  63%|██████▎   | 182/291 [00:07<00:07, 15.04it/s, Materializing param=model.layers.19.self_attn.q_proj.weight]
Loading weights:  63%|██████▎   | 182/291 [00:07<00:07, 15.04it/s, Materializing param=model.layers.19.self_attn.v_proj.weight]
Loading weights:  63%|██████▎   | 182/291 [00:07<00:07, 15.04it/s, Materializing param=model.layers.19.self_attn.v_proj.weight]
Loading weights:  63%|██████▎   | 183/291 [00:07<00:07, 15.04it/s, Materializing param=model.layers.20.input_layernorm.weight] 
Loading weights:  63%|██████▎   | 183/291 [00:07<00:07, 15.04it/s, Materializing param=model.layers.20.input_layernorm.weight]
Loading weights:  63%|██████▎   | 184/291 [00:07<00:07, 15.04it/s, Materializing param=model.layers.20.mlp.down_proj.weight]  
Loading weights:  63%|██████▎   | 184/291 [00:07<00:07, 15.04it/s, Materializing param=model.layers.20.mlp.down_proj.weight]
Loading weights:  64%|██████▎   | 185/291 [00:07<00:06, 15.15it/s, Materializing param=model.layers.20.mlp.down_proj.weight]
Loading weights:  64%|██████▎   | 185/291 [00:07<00:06, 15.15it/s, Materializing param=model.layers.20.mlp.gate_proj.weight]
Loading weights:  64%|██████▎   | 185/291 [00:07<00:06, 15.15it/s, Materializing param=model.layers.20.mlp.gate_proj.weight]
Loading weights:  64%|██████▍   | 186/291 [00:07<00:06, 15.15it/s, Materializing param=model.layers.20.mlp.up_proj.weight]  
Loading weights:  64%|██████▍   | 186/291 [00:07<00:06, 15.15it/s, Materializing param=model.layers.20.mlp.up_proj.weight]
Loading weights:  64%|██████▍   | 187/291 [00:07<00:06, 15.15it/s, Materializing param=model.layers.20.post_attention_layernorm.weight]
Loading weights:  64%|██████▍   | 187/291 [00:07<00:06, 15.15it/s, Materializing param=model.layers.20.post_attention_layernorm.weight]
Loading weights:  65%|██████▍   | 188/291 [00:07<00:06, 15.15it/s, Materializing param=model.layers.20.self_attn.k_proj.weight]        
Loading weights:  65%|██████▍   | 188/291 [00:07<00:06, 15.15it/s, Materializing param=model.layers.20.self_attn.k_proj.weight]
Loading weights:  65%|██████▍   | 189/291 [00:07<00:06, 15.15it/s, Materializing param=model.layers.20.self_attn.o_proj.weight]
Loading weights:  65%|██████▍   | 189/291 [00:07<00:06, 15.15it/s, Materializing param=model.layers.20.self_attn.o_proj.weight]
Loading weights:  65%|██████▌   | 190/291 [00:07<00:06, 15.15it/s, Materializing param=model.layers.20.self_attn.q_proj.weight]
Loading weights:  65%|██████▌   | 190/291 [00:07<00:06, 15.15it/s, Materializing param=model.layers.20.self_attn.q_proj.weight]
Loading weights:  66%|██████▌   | 191/291 [00:07<00:06, 15.15it/s, Materializing param=model.layers.20.self_attn.v_proj.weight]
Loading weights:  66%|██████▌   | 191/291 [00:07<00:06, 15.15it/s, Materializing param=model.layers.20.self_attn.v_proj.weight]
Loading weights:  66%|██████▌   | 192/291 [00:07<00:06, 15.15it/s, Materializing param=model.layers.21.input_layernorm.weight] 
Loading weights:  66%|██████▌   | 192/291 [00:07<00:06, 15.15it/s, Materializing param=model.layers.21.input_layernorm.weight]
Loading weights:  66%|██████▋   | 193/291 [00:07<00:06, 15.15it/s, Materializing param=model.layers.21.mlp.down_proj.weight]  
Loading weights:  66%|██████▋   | 193/291 [00:07<00:06, 15.15it/s, Materializing param=model.layers.21.mlp.down_proj.weight]
Loading weights:  67%|██████▋   | 194/291 [00:08<00:04, 21.32it/s, Materializing param=model.layers.21.mlp.down_proj.weight]
Loading weights:  67%|██████▋   | 194/291 [00:08<00:04, 21.32it/s, Materializing param=model.layers.21.mlp.gate_proj.weight]
Loading weights:  67%|██████▋   | 194/291 [00:08<00:04, 21.32it/s, Materializing param=model.layers.21.mlp.gate_proj.weight]
Loading weights:  67%|██████▋   | 195/291 [00:08<00:04, 21.32it/s, Materializing param=model.layers.21.mlp.up_proj.weight]  
Loading weights:  67%|██████▋   | 195/291 [00:08<00:04, 21.32it/s, Materializing param=model.layers.21.mlp.up_proj.weight]
Loading weights:  67%|██████▋   | 196/291 [00:08<00:04, 21.32it/s, Materializing param=model.layers.21.post_attention_layernorm.weight]
Loading weights:  67%|██████▋   | 196/291 [00:08<00:04, 21.32it/s, Materializing param=model.layers.21.post_attention_layernorm.weight]
Loading weights:  68%|██████▊   | 197/291 [00:08<00:04, 21.32it/s, Materializing param=model.layers.21.self_attn.k_proj.weight]        
Loading weights:  68%|██████▊   | 197/291 [00:08<00:04, 21.32it/s, Materializing param=model.layers.21.self_attn.k_proj.weight]
Loading weights:  68%|██████▊   | 198/291 [00:08<00:05, 17.04it/s, Materializing param=model.layers.21.self_attn.k_proj.weight]
Loading weights:  68%|██████▊   | 198/291 [00:08<00:05, 17.04it/s, Materializing param=model.layers.21.self_attn.o_proj.weight]
Loading weights:  68%|██████▊   | 198/291 [00:08<00:05, 17.04it/s, Materializing param=model.layers.21.self_attn.o_proj.weight]
Loading weights:  68%|██████▊   | 199/291 [00:08<00:05, 17.04it/s, Materializing param=model.layers.21.self_attn.q_proj.weight]
Loading weights:  68%|██████▊   | 199/291 [00:08<00:05, 17.04it/s, Materializing param=model.layers.21.self_attn.q_proj.weight]
Loading weights:  69%|██████▊   | 200/291 [00:08<00:05, 17.04it/s, Materializing param=model.layers.21.self_attn.v_proj.weight]
Loading weights:  69%|██████▊   | 200/291 [00:08<00:05, 17.04it/s, Materializing param=model.layers.21.self_attn.v_proj.weight]
Loading weights:  69%|██████▉   | 201/291 [00:08<00:05, 17.04it/s, Materializing param=model.layers.22.input_layernorm.weight] 
Loading weights:  69%|██████▉   | 201/291 [00:08<00:05, 17.04it/s, Materializing param=model.layers.22.input_layernorm.weight]
Loading weights:  69%|██████▉   | 202/291 [00:08<00:05, 17.04it/s, Materializing param=model.layers.22.mlp.down_proj.weight]  
Loading weights:  69%|██████▉   | 202/291 [00:08<00:05, 17.04it/s, Materializing param=model.layers.22.mlp.down_proj.weight]
Loading weights:  70%|██████▉   | 203/291 [00:08<00:05, 17.04it/s, Materializing param=model.layers.22.mlp.gate_proj.weight]
Loading weights:  70%|██████▉   | 203/291 [00:08<00:05, 17.04it/s, Materializing param=model.layers.22.mlp.gate_proj.weight]
Loading weights:  70%|███████   | 204/291 [00:08<00:05, 17.04it/s, Materializing param=model.layers.22.mlp.up_proj.weight]  
Loading weights:  70%|███████   | 204/291 [00:08<00:05, 17.04it/s, Materializing param=model.layers.22.mlp.up_proj.weight]
Loading weights:  70%|███████   | 205/291 [00:08<00:05, 17.04it/s, Materializing param=model.layers.22.post_attention_layernorm.weight]
Loading weights:  70%|███████   | 205/291 [00:08<00:05, 17.04it/s, Materializing param=model.layers.22.post_attention_layernorm.weight]
Loading weights:  71%|███████   | 206/291 [00:08<00:03, 23.92it/s, Materializing param=model.layers.22.post_attention_layernorm.weight]
Loading weights:  71%|███████   | 206/291 [00:08<00:03, 23.92it/s, Materializing param=model.layers.22.self_attn.k_proj.weight]        
Loading weights:  71%|███████   | 206/291 [00:08<00:03, 23.92it/s, Materializing param=model.layers.22.self_attn.k_proj.weight]
Loading weights:  71%|███████   | 207/291 [00:08<00:03, 23.92it/s, Materializing param=model.layers.22.self_attn.o_proj.weight]
Loading weights:  71%|███████   | 207/291 [00:08<00:03, 23.92it/s, Materializing param=model.layers.22.self_attn.o_proj.weight]
Loading weights:  71%|███████▏  | 208/291 [00:08<00:03, 23.92it/s, Materializing param=model.layers.22.self_attn.q_proj.weight]
Loading weights:  71%|███████▏  | 208/291 [00:08<00:03, 23.92it/s, Materializing param=model.layers.22.self_attn.q_proj.weight]
Loading weights:  72%|███████▏  | 209/291 [00:08<00:03, 23.92it/s, Materializing param=model.layers.22.self_attn.v_proj.weight]
Loading weights:  72%|███████▏  | 209/291 [00:08<00:03, 23.92it/s, Materializing param=model.layers.22.self_attn.v_proj.weight]
Loading weights:  72%|███████▏  | 210/291 [00:08<00:03, 23.92it/s, Materializing param=model.layers.23.input_layernorm.weight] 
Loading weights:  72%|███████▏  | 210/291 [00:08<00:03, 23.92it/s, Materializing param=model.layers.23.input_layernorm.weight]
Loading weights:  73%|███████▎  | 211/291 [00:08<00:03, 23.92it/s, Materializing param=model.layers.23.mlp.down_proj.weight]  
Loading weights:  73%|███████▎  | 211/291 [00:08<00:03, 23.92it/s, Materializing param=model.layers.23.mlp.down_proj.weight]
Loading weights:  73%|███████▎  | 212/291 [00:09<00:04, 18.79it/s, Materializing param=model.layers.23.mlp.down_proj.weight]
Loading weights:  73%|███████▎  | 212/291 [00:09<00:04, 18.79it/s, Materializing param=model.layers.23.mlp.gate_proj.weight]
Loading weights:  73%|███████▎  | 212/291 [00:09<00:04, 18.79it/s, Materializing param=model.layers.23.mlp.gate_proj.weight]
Loading weights:  73%|███████▎  | 213/291 [00:09<00:04, 18.79it/s, Materializing param=model.layers.23.mlp.up_proj.weight]  
Loading weights:  73%|███████▎  | 213/291 [00:09<00:04, 18.79it/s, Materializing param=model.layers.23.mlp.up_proj.weight]
Loading weights:  74%|███████▎  | 214/291 [00:09<00:04, 18.79it/s, Materializing param=model.layers.23.post_attention_layernorm.weight]
Loading weights:  74%|███████▎  | 214/291 [00:09<00:04, 18.79it/s, Materializing param=model.layers.23.post_attention_layernorm.weight]
Loading weights:  74%|███████▍  | 215/291 [00:09<00:04, 18.79it/s, Materializing param=model.layers.23.self_attn.k_proj.weight]        
Loading weights:  74%|███████▍  | 215/291 [00:09<00:04, 18.79it/s, Materializing param=model.layers.23.self_attn.k_proj.weight]
Loading weights:  74%|███████▍  | 216/291 [00:09<00:05, 13.58it/s, Materializing param=model.layers.23.self_attn.k_proj.weight]
Loading weights:  74%|███████▍  | 216/291 [00:09<00:05, 13.58it/s, Materializing param=model.layers.23.self_attn.o_proj.weight]
Loading weights:  74%|███████▍  | 216/291 [00:09<00:05, 13.58it/s, Materializing param=model.layers.23.self_attn.o_proj.weight]
Loading weights:  75%|███████▍  | 217/291 [00:09<00:05, 13.58it/s, Materializing param=model.layers.23.self_attn.q_proj.weight]
Loading weights:  75%|███████▍  | 217/291 [00:09<00:05, 13.58it/s, Materializing param=model.layers.23.self_attn.q_proj.weight]
Loading weights:  75%|███████▍  | 218/291 [00:09<00:05, 13.58it/s, Materializing param=model.layers.23.self_attn.v_proj.weight]
Loading weights:  75%|███████▍  | 218/291 [00:09<00:05, 13.58it/s, Materializing param=model.layers.23.self_attn.v_proj.weight]
Loading weights:  75%|███████▌  | 219/291 [00:10<00:05, 12.64it/s, Materializing param=model.layers.23.self_attn.v_proj.weight]
Loading weights:  75%|███████▌  | 219/291 [00:10<00:05, 12.64it/s, Materializing param=model.layers.24.input_layernorm.weight] 
Loading weights:  75%|███████▌  | 219/291 [00:10<00:05, 12.64it/s, Materializing param=model.layers.24.input_layernorm.weight]
Loading weights:  76%|███████▌  | 220/291 [00:10<00:05, 12.64it/s, Materializing param=model.layers.24.mlp.down_proj.weight]  
Loading weights:  76%|███████▌  | 220/291 [00:10<00:05, 12.64it/s, Materializing param=model.layers.24.mlp.down_proj.weight]
Loading weights:  76%|███████▌  | 221/291 [00:10<00:08,  8.36it/s, Materializing param=model.layers.24.mlp.down_proj.weight]
Loading weights:  76%|███████▌  | 221/291 [00:10<00:08,  8.36it/s, Materializing param=model.layers.24.mlp.gate_proj.weight]
Loading weights:  76%|███████▌  | 221/291 [00:10<00:08,  8.36it/s, Materializing param=model.layers.24.mlp.gate_proj.weight]
Loading weights:  76%|███████▋  | 222/291 [00:10<00:08,  8.36it/s, Materializing param=model.layers.24.mlp.up_proj.weight]  
Loading weights:  76%|███████▋  | 222/291 [00:10<00:08,  8.36it/s, Materializing param=model.layers.24.mlp.up_proj.weight]
Loading weights:  77%|███████▋  | 223/291 [00:10<00:08,  8.36it/s, Materializing param=model.layers.24.post_attention_layernorm.weight]
Loading weights:  77%|███████▋  | 223/291 [00:10<00:08,  8.36it/s, Materializing param=model.layers.24.post_attention_layernorm.weight]
Loading weights:  77%|███████▋  | 224/291 [00:10<00:08,  8.36it/s, Materializing param=model.layers.24.self_attn.k_proj.weight]        
Loading weights:  77%|███████▋  | 224/291 [00:10<00:08,  8.36it/s, Materializing param=model.layers.24.self_attn.k_proj.weight]
Loading weights:  77%|███████▋  | 225/291 [00:10<00:07,  8.36it/s, Materializing param=model.layers.24.self_attn.o_proj.weight]
Loading weights:  77%|███████▋  | 225/291 [00:10<00:07,  8.36it/s, Materializing param=model.layers.24.self_attn.o_proj.weight]
Loading weights:  78%|███████▊  | 226/291 [00:10<00:07,  8.36it/s, Materializing param=model.layers.24.self_attn.q_proj.weight]
Loading weights:  78%|███████▊  | 226/291 [00:10<00:07,  8.36it/s, Materializing param=model.layers.24.self_attn.q_proj.weight]
Loading weights:  78%|███████▊  | 227/291 [00:11<00:07,  8.00it/s, Materializing param=model.layers.24.self_attn.q_proj.weight]
Loading weights:  78%|███████▊  | 227/291 [00:11<00:07,  8.00it/s, Materializing param=model.layers.24.self_attn.v_proj.weight]
Loading weights:  78%|███████▊  | 227/291 [00:11<00:07,  8.00it/s, Materializing param=model.layers.24.self_attn.v_proj.weight]
Loading weights:  78%|███████▊  | 228/291 [00:11<00:07,  8.00it/s, Materializing param=model.layers.25.input_layernorm.weight] 
Loading weights:  78%|███████▊  | 228/291 [00:11<00:07,  8.00it/s, Materializing param=model.layers.25.input_layernorm.weight]
Loading weights:  79%|███████▊  | 229/291 [00:11<00:07,  8.00it/s, Materializing param=model.layers.25.mlp.down_proj.weight]  
Loading weights:  79%|███████▊  | 229/291 [00:11<00:07,  8.00it/s, Materializing param=model.layers.25.mlp.down_proj.weight]
Loading weights:  79%|███████▉  | 230/291 [00:11<00:06,  9.51it/s, Materializing param=model.layers.25.mlp.down_proj.weight]
Loading weights:  79%|███████▉  | 230/291 [00:11<00:06,  9.51it/s, Materializing param=model.layers.25.mlp.gate_proj.weight]
Loading weights:  79%|███████▉  | 230/291 [00:11<00:06,  9.51it/s, Materializing param=model.layers.25.mlp.gate_proj.weight]
Loading weights:  79%|███████▉  | 231/291 [00:11<00:06,  9.51it/s, Materializing param=model.layers.25.mlp.up_proj.weight]  
Loading weights:  79%|███████▉  | 231/291 [00:11<00:06,  9.51it/s, Materializing param=model.layers.25.mlp.up_proj.weight]
Loading weights:  80%|███████▉  | 232/291 [00:11<00:06,  9.51it/s, Materializing param=model.layers.25.post_attention_layernorm.weight]
Loading weights:  80%|███████▉  | 232/291 [00:11<00:06,  9.51it/s, Materializing param=model.layers.25.post_attention_layernorm.weight]
Loading weights:  80%|████████  | 233/291 [00:11<00:06,  9.51it/s, Materializing param=model.layers.25.self_attn.k_proj.weight]        
Loading weights:  80%|████████  | 233/291 [00:11<00:06,  9.51it/s, Materializing param=model.layers.25.self_attn.k_proj.weight]
Loading weights:  80%|████████  | 234/291 [00:11<00:05,  9.51it/s, Materializing param=model.layers.25.self_attn.o_proj.weight]
Loading weights:  80%|████████  | 234/291 [00:11<00:05,  9.51it/s, Materializing param=model.layers.25.self_attn.o_proj.weight]
Loading weights:  81%|████████  | 235/291 [00:11<00:05, 11.11it/s, Materializing param=model.layers.25.self_attn.o_proj.weight]
Loading weights:  81%|████████  | 235/291 [00:11<00:05, 11.11it/s, Materializing param=model.layers.25.self_attn.q_proj.weight]
Loading weights:  81%|████████  | 235/291 [00:11<00:05, 11.11it/s, Materializing param=model.layers.25.self_attn.q_proj.weight]
Loading weights:  81%|████████  | 236/291 [00:12<00:04, 11.11it/s, Materializing param=model.layers.25.self_attn.v_proj.weight]
Loading weights:  81%|████████  | 236/291 [00:12<00:04, 11.11it/s, Materializing param=model.layers.25.self_attn.v_proj.weight]
Loading weights:  81%|████████▏ | 237/291 [00:12<00:04, 10.99it/s, Materializing param=model.layers.25.self_attn.v_proj.weight]
Loading weights:  81%|████████▏ | 237/291 [00:12<00:04, 10.99it/s, Materializing param=model.layers.26.input_layernorm.weight] 
Loading weights:  81%|████████▏ | 237/291 [00:12<00:04, 10.99it/s, Materializing param=model.layers.26.input_layernorm.weight]
Loading weights:  82%|████████▏ | 238/291 [00:12<00:04, 10.99it/s, Materializing param=model.layers.26.mlp.down_proj.weight]  
Loading weights:  82%|████████▏ | 238/291 [00:12<00:04, 10.99it/s, Materializing param=model.layers.26.mlp.down_proj.weight]
Loading weights:  82%|████████▏ | 239/291 [00:12<00:05,  9.81it/s, Materializing param=model.layers.26.mlp.down_proj.weight]
Loading weights:  82%|████████▏ | 239/291 [00:12<00:05,  9.81it/s, Materializing param=model.layers.26.mlp.gate_proj.weight]
Loading weights:  82%|████████▏ | 239/291 [00:12<00:05,  9.81it/s, Materializing param=model.layers.26.mlp.gate_proj.weight]
Loading weights:  82%|████████▏ | 240/291 [00:12<00:05,  9.81it/s, Materializing param=model.layers.26.mlp.up_proj.weight]  
Loading weights:  82%|████████▏ | 240/291 [00:12<00:05,  9.81it/s, Materializing param=model.layers.26.mlp.up_proj.weight]
Loading weights:  83%|████████▎ | 241/291 [00:12<00:04, 10.99it/s, Materializing param=model.layers.26.mlp.up_proj.weight]
Loading weights:  83%|████████▎ | 241/291 [00:12<00:04, 10.99it/s, Materializing param=model.layers.26.post_attention_layernorm.weight]
Loading weights:  83%|████████▎ | 241/291 [00:12<00:04, 10.99it/s, Materializing param=model.layers.26.post_attention_layernorm.weight]
Loading weights:  83%|████████▎ | 242/291 [00:12<00:04, 10.99it/s, Materializing param=model.layers.26.self_attn.k_proj.weight]        
Loading weights:  83%|████████▎ | 242/291 [00:12<00:04, 10.99it/s, Materializing param=model.layers.26.self_attn.k_proj.weight]
Loading weights:  84%|████████▎ | 243/291 [00:12<00:04, 10.77it/s, Materializing param=model.layers.26.self_attn.k_proj.weight]
Loading weights:  84%|████████▎ | 243/291 [00:12<00:04, 10.77it/s, Materializing param=model.layers.26.self_attn.o_proj.weight]
Loading weights:  84%|████████▎ | 243/291 [00:12<00:04, 10.77it/s, Materializing param=model.layers.26.self_attn.o_proj.weight]
Loading weights:  84%|████████▍ | 244/291 [00:12<00:04, 10.77it/s, Materializing param=model.layers.26.self_attn.q_proj.weight]
Loading weights:  84%|████████▍ | 244/291 [00:12<00:04, 10.77it/s, Materializing param=model.layers.26.self_attn.q_proj.weight]
Loading weights:  84%|████████▍ | 245/291 [00:12<00:04, 10.77it/s, Materializing param=model.layers.26.self_attn.v_proj.weight]
Loading weights:  84%|████████▍ | 245/291 [00:12<00:04, 10.77it/s, Materializing param=model.layers.26.self_attn.v_proj.weight]
Loading weights:  85%|████████▍ | 246/291 [00:12<00:04, 10.77it/s, Materializing param=model.layers.27.input_layernorm.weight] 
Loading weights:  85%|████████▍ | 246/291 [00:12<00:04, 10.77it/s, Materializing param=model.layers.27.input_layernorm.weight]
Loading weights:  85%|████████▍ | 247/291 [00:12<00:04, 10.77it/s, Materializing param=model.layers.27.mlp.down_proj.weight]  
Loading weights:  85%|████████▍ | 247/291 [00:12<00:04, 10.77it/s, Materializing param=model.layers.27.mlp.down_proj.weight]
Loading weights:  85%|████████▌ | 248/291 [00:13<00:04,  9.38it/s, Materializing param=model.layers.27.mlp.down_proj.weight]
Loading weights:  85%|████████▌ | 248/291 [00:13<00:04,  9.38it/s, Materializing param=model.layers.27.mlp.gate_proj.weight]
Loading weights:  85%|████████▌ | 248/291 [00:13<00:04,  9.38it/s, Materializing param=model.layers.27.mlp.gate_proj.weight]
Loading weights:  86%|████████▌ | 249/291 [00:13<00:04,  9.38it/s, Materializing param=model.layers.27.mlp.up_proj.weight]  
Loading weights:  86%|████████▌ | 249/291 [00:13<00:04,  9.38it/s, Materializing param=model.layers.27.mlp.up_proj.weight]
Loading weights:  86%|████████▌ | 250/291 [00:13<00:04,  9.38it/s, Materializing param=model.layers.27.post_attention_layernorm.weight]
Loading weights:  86%|████████▌ | 250/291 [00:13<00:04,  9.38it/s, Materializing param=model.layers.27.post_attention_layernorm.weight]
Loading weights:  86%|████████▋ | 251/291 [00:13<00:04,  9.38it/s, Materializing param=model.layers.27.self_attn.k_proj.weight]        
Loading weights:  86%|████████▋ | 251/291 [00:13<00:04,  9.38it/s, Materializing param=model.layers.27.self_attn.k_proj.weight]
Loading weights:  87%|████████▋ | 252/291 [00:13<00:04,  9.38it/s, Materializing param=model.layers.27.self_attn.o_proj.weight]
Loading weights:  87%|████████▋ | 252/291 [00:13<00:04,  9.38it/s, Materializing param=model.layers.27.self_attn.o_proj.weight]
Loading weights:  87%|████████▋ | 253/291 [00:13<00:04,  9.38it/s, Materializing param=model.layers.27.self_attn.q_proj.weight]
Loading weights:  87%|████████▋ | 253/291 [00:13<00:04,  9.38it/s, Materializing param=model.layers.27.self_attn.q_proj.weight]
Loading weights:  87%|████████▋ | 254/291 [00:13<00:03, 11.34it/s, Materializing param=model.layers.27.self_attn.q_proj.weight]
Loading weights:  87%|████████▋ | 254/291 [00:13<00:03, 11.34it/s, Materializing param=model.layers.27.self_attn.v_proj.weight]
Loading weights:  87%|████████▋ | 254/291 [00:13<00:03, 11.34it/s, Materializing param=model.layers.27.self_attn.v_proj.weight]
Loading weights:  88%|████████▊ | 255/291 [00:13<00:03, 11.34it/s, Materializing param=model.layers.28.input_layernorm.weight] 
Loading weights:  88%|████████▊ | 255/291 [00:13<00:03, 11.34it/s, Materializing param=model.layers.28.input_layernorm.weight]
Loading weights:  88%|████████▊ | 256/291 [00:13<00:03, 11.34it/s, Materializing param=model.layers.28.mlp.down_proj.weight]  
Loading weights:  88%|████████▊ | 256/291 [00:13<00:03, 11.34it/s, Materializing param=model.layers.28.mlp.down_proj.weight]
Loading weights:  88%|████████▊ | 257/291 [00:14<00:03,  8.57it/s, Materializing param=model.layers.28.mlp.down_proj.weight]
Loading weights:  88%|████████▊ | 257/291 [00:14<00:03,  8.57it/s, Materializing param=model.layers.28.mlp.gate_proj.weight]
Loading weights:  88%|████████▊ | 257/291 [00:14<00:03,  8.57it/s, Materializing param=model.layers.28.mlp.gate_proj.weight]
Loading weights:  89%|████████▊ | 258/291 [00:14<00:03,  8.57it/s, Materializing param=model.layers.28.mlp.up_proj.weight]  
Loading weights:  89%|████████▊ | 258/291 [00:14<00:03,  8.57it/s, Materializing param=model.layers.28.mlp.up_proj.weight]
Loading weights:  89%|████████▉ | 259/291 [00:14<00:03,  8.57it/s, Materializing param=model.layers.28.post_attention_layernorm.weight]
Loading weights:  89%|████████▉ | 259/291 [00:14<00:03,  8.57it/s, Materializing param=model.layers.28.post_attention_layernorm.weight]
Loading weights:  89%|████████▉ | 260/291 [00:14<00:03,  8.57it/s, Materializing param=model.layers.28.self_attn.k_proj.weight]        
Loading weights:  89%|████████▉ | 260/291 [00:14<00:03,  8.57it/s, Materializing param=model.layers.28.self_attn.k_proj.weight]
Loading weights:  90%|████████▉ | 261/291 [00:14<00:03,  8.57it/s, Materializing param=model.layers.28.self_attn.o_proj.weight]
Loading weights:  90%|████████▉ | 261/291 [00:14<00:03,  8.57it/s, Materializing param=model.layers.28.self_attn.o_proj.weight]
Loading weights:  90%|█████████ | 262/291 [00:14<00:03,  8.57it/s, Materializing param=model.layers.28.self_attn.q_proj.weight]
Loading weights:  90%|█████████ | 262/291 [00:14<00:03,  8.57it/s, Materializing param=model.layers.28.self_attn.q_proj.weight]
Loading weights:  90%|█████████ | 263/291 [00:14<00:03,  9.16it/s, Materializing param=model.layers.28.self_attn.q_proj.weight]
Loading weights:  90%|█████████ | 263/291 [00:14<00:03,  9.16it/s, Materializing param=model.layers.28.self_attn.v_proj.weight]
Loading weights:  90%|█████████ | 263/291 [00:14<00:03,  9.16it/s, Materializing param=model.layers.28.self_attn.v_proj.weight]
Loading weights:  91%|█████████ | 264/291 [00:14<00:02,  9.16it/s, Materializing param=model.layers.29.input_layernorm.weight] 
Loading weights:  91%|█████████ | 264/291 [00:14<00:02,  9.16it/s, Materializing param=model.layers.29.input_layernorm.weight]
Loading weights:  91%|█████████ | 265/291 [00:14<00:02,  9.16it/s, Materializing param=model.layers.29.mlp.down_proj.weight]  
Loading weights:  91%|█████████ | 265/291 [00:14<00:02,  9.16it/s, Materializing param=model.layers.29.mlp.down_proj.weight]
Loading weights:  91%|█████████▏| 266/291 [00:15<00:02,  9.16it/s, Materializing param=model.layers.29.mlp.gate_proj.weight]
Loading weights:  91%|█████████▏| 266/291 [00:15<00:02,  9.16it/s, Materializing param=model.layers.29.mlp.gate_proj.weight]
Loading weights:  92%|█████████▏| 267/291 [00:15<00:02,  9.16it/s, Materializing param=model.layers.29.mlp.up_proj.weight]  
Loading weights:  92%|█████████▏| 267/291 [00:15<00:02,  9.16it/s, Materializing param=model.layers.29.mlp.up_proj.weight]
Loading weights:  92%|█████████▏| 268/291 [00:15<00:01, 12.40it/s, Materializing param=model.layers.29.mlp.up_proj.weight]
Loading weights:  92%|█████████▏| 268/291 [00:15<00:01, 12.40it/s, Materializing param=model.layers.29.post_attention_layernorm.weight]
Loading weights:  92%|█████████▏| 268/291 [00:15<00:01, 12.40it/s, Materializing param=model.layers.29.post_attention_layernorm.weight]
Loading weights:  92%|█████████▏| 269/291 [00:15<00:01, 12.40it/s, Materializing param=model.layers.29.self_attn.k_proj.weight]        
Loading weights:  92%|█████████▏| 269/291 [00:15<00:01, 12.40it/s, Materializing param=model.layers.29.self_attn.k_proj.weight]
Loading weights:  93%|█████████▎| 270/291 [00:15<00:01, 12.40it/s, Materializing param=model.layers.29.self_attn.o_proj.weight]
Loading weights:  93%|█████████▎| 270/291 [00:15<00:01, 12.40it/s, Materializing param=model.layers.29.self_attn.o_proj.weight]
Loading weights:  93%|█████████▎| 271/291 [00:15<00:01, 12.40it/s, Materializing param=model.layers.29.self_attn.q_proj.weight]
Loading weights:  93%|█████████▎| 271/291 [00:15<00:01, 12.40it/s, Materializing param=model.layers.29.self_attn.q_proj.weight]
Loading weights:  93%|█████████▎| 272/291 [00:15<00:01, 15.23it/s, Materializing param=model.layers.29.self_attn.q_proj.weight]
Loading weights:  93%|█████████▎| 272/291 [00:15<00:01, 15.23it/s, Materializing param=model.layers.29.self_attn.v_proj.weight]
Loading weights:  93%|█████████▎| 272/291 [00:15<00:01, 15.23it/s, Materializing param=model.layers.29.self_attn.v_proj.weight]
Loading weights:  94%|█████████▍| 273/291 [00:15<00:01, 15.23it/s, Materializing param=model.layers.30.input_layernorm.weight] 
Loading weights:  94%|█████████▍| 273/291 [00:15<00:01, 15.23it/s, Materializing param=model.layers.30.input_layernorm.weight]
Loading weights:  94%|█████████▍| 274/291 [00:15<00:01, 15.23it/s, Materializing param=model.layers.30.mlp.down_proj.weight]  
Loading weights:  94%|█████████▍| 274/291 [00:15<00:01, 15.23it/s, Materializing param=model.layers.30.mlp.down_proj.weight]
Loading weights:  95%|█████████▍| 275/291 [00:16<00:01,  8.51it/s, Materializing param=model.layers.30.mlp.down_proj.weight]
Loading weights:  95%|█████████▍| 275/291 [00:16<00:01,  8.51it/s, Materializing param=model.layers.30.mlp.gate_proj.weight]
Loading weights:  95%|█████████▍| 275/291 [00:16<00:01,  8.51it/s, Materializing param=model.layers.30.mlp.gate_proj.weight]
Loading weights:  95%|█████████▍| 276/291 [00:16<00:01,  8.51it/s, Materializing param=model.layers.30.mlp.up_proj.weight]  
Loading weights:  95%|█████████▍| 276/291 [00:16<00:01,  8.51it/s, Materializing param=model.layers.30.mlp.up_proj.weight]
Loading weights:  95%|█████████▌| 277/291 [00:16<00:01,  8.51it/s, Materializing param=model.layers.30.post_attention_layernorm.weight]
Loading weights:  95%|█████████▌| 277/291 [00:16<00:01,  8.51it/s, Materializing param=model.layers.30.post_attention_layernorm.weight]
Loading weights:  96%|█████████▌| 278/291 [00:16<00:01,  8.51it/s, Materializing param=model.layers.30.self_attn.k_proj.weight]        
Loading weights:  96%|█████████▌| 278/291 [00:16<00:01,  8.51it/s, Materializing param=model.layers.30.self_attn.k_proj.weight]
Loading weights:  96%|█████████▌| 279/291 [00:16<00:01,  9.58it/s, Materializing param=model.layers.30.self_attn.k_proj.weight]
Loading weights:  96%|█████████▌| 279/291 [00:16<00:01,  9.58it/s, Materializing param=model.layers.30.self_attn.o_proj.weight]
Loading weights:  96%|█████████▌| 279/291 [00:16<00:01,  9.58it/s, Materializing param=model.layers.30.self_attn.o_proj.weight]
Loading weights:  96%|█████████▌| 280/291 [00:16<00:01,  9.58it/s, Materializing param=model.layers.30.self_attn.q_proj.weight]
Loading weights:  96%|█████████▌| 280/291 [00:16<00:01,  9.58it/s, Materializing param=model.layers.30.self_attn.q_proj.weight]
Loading weights:  97%|█████████▋| 281/291 [00:16<00:01,  9.58it/s, Materializing param=model.layers.30.self_attn.v_proj.weight]
Loading weights:  97%|█████████▋| 281/291 [00:16<00:01,  9.58it/s, Materializing param=model.layers.30.self_attn.v_proj.weight]
Loading weights:  97%|█████████▋| 282/291 [00:16<00:00,  9.58it/s, Materializing param=model.layers.31.input_layernorm.weight] 
Loading weights:  97%|█████████▋| 282/291 [00:16<00:00,  9.58it/s, Materializing param=model.layers.31.input_layernorm.weight]
Loading weights:  97%|█████████▋| 283/291 [00:16<00:00,  9.58it/s, Materializing param=model.layers.31.mlp.down_proj.weight]  
Loading weights:  97%|█████████▋| 283/291 [00:16<00:00,  9.58it/s, Materializing param=model.layers.31.mlp.down_proj.weight]
Loading weights:  98%|█████████▊| 284/291 [00:16<00:00,  9.77it/s, Materializing param=model.layers.31.mlp.down_proj.weight]
Loading weights:  98%|█████████▊| 284/291 [00:16<00:00,  9.77it/s, Materializing param=model.layers.31.mlp.gate_proj.weight]
Loading weights:  98%|█████████▊| 284/291 [00:16<00:00,  9.77it/s, Materializing param=model.layers.31.mlp.gate_proj.weight]
Loading weights:  98%|█████████▊| 285/291 [00:16<00:00,  9.77it/s, Materializing param=model.layers.31.mlp.up_proj.weight]  
Loading weights:  98%|█████████▊| 285/291 [00:16<00:00,  9.77it/s, Materializing param=model.layers.31.mlp.up_proj.weight]
Loading weights:  98%|█████████▊| 286/291 [00:16<00:00,  9.77it/s, Materializing param=model.layers.31.post_attention_layernorm.weight]
Loading weights:  98%|█████████▊| 286/291 [00:16<00:00,  9.77it/s, Materializing param=model.layers.31.post_attention_layernorm.weight]
Loading weights:  99%|█████████▊| 287/291 [00:16<00:00,  9.77it/s, Materializing param=model.layers.31.self_attn.k_proj.weight]        
Loading weights:  99%|█████████▊| 287/291 [00:16<00:00,  9.77it/s, Materializing param=model.layers.31.self_attn.k_proj.weight]
Loading weights:  99%|█████████▉| 288/291 [00:16<00:00,  9.77it/s, Materializing param=model.layers.31.self_attn.o_proj.weight]
Loading weights:  99%|█████████▉| 288/291 [00:16<00:00,  9.77it/s, Materializing param=model.layers.31.self_attn.o_proj.weight]
Loading weights:  99%|█████████▉| 289/291 [00:16<00:00,  9.77it/s, Materializing param=model.layers.31.self_attn.q_proj.weight]
Loading weights:  99%|█████████▉| 289/291 [00:16<00:00,  9.77it/s, Materializing param=model.layers.31.self_attn.q_proj.weight]
Loading weights: 100%|█████████▉| 290/291 [00:16<00:00,  9.77it/s, Materializing param=model.layers.31.self_attn.v_proj.weight]
Loading weights: 100%|█████████▉| 290/291 [00:16<00:00,  9.77it/s, Materializing param=model.layers.31.self_attn.v_proj.weight]
Loading weights: 100%|██████████| 291/291 [00:16<00:00,  9.77it/s, Materializing param=model.norm.weight]                      
Loading weights: 100%|██████████| 291/291 [00:16<00:00,  9.77it/s, Materializing param=model.norm.weight]
Loading weights: 100%|██████████| 291/291 [00:16<00:00, 17.25it/s, Materializing param=model.norm.weight]
2026-03-06 01:43:07,759 - babelbit.miner.model_loader - INFO - Model loaded successfully on cuda
2026-03-06 01:43:07,760 - babelbit.miner.model_loader - INFO - Model memory footprint: 28.99 GB
2026-03-06 01:43:07,761 - __main__ - INFO - Model loaded successfully on cuda
2026-03-06 01:43:07,761 - __main__ - INFO - ✅ Model loaded successfully
2026-03-06 01:43:07,761 - __main__ - INFO - 
INFO:     Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:8092 (Press CTRL+C to quit)
INFO:     127.0.0.1:45000 - "GET /healthz HTTP/1.1" 200 OK
2026-03-06 01:43:14,128 - __main__ - INFO - 🔓 Dev mode enabled - bypassing Bittensor verification
2026-03-06 01:43:14,128 - __main__ - INFO - Generating prediction for prefix: 'Clarity'
2026-03-06 01:43:14,128 - __main__ - INFO - Using context: ''
2026-03-06 01:43:21,332 - __main__ - ERROR - Error moving model to device: CUDA out of memory. Tried to allocate 224.00 MiB. GPU 0 has a total capacity of 23.53 GiB of which 112.62 MiB is free. Including non-PyTorch memory, this process has 23.41 GiB memory in use. Of the allocated memory 23.03 GiB is allocated by PyTorch, and 1.16 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting PYTORCH_ALLOC_CONF=expandable_segments:True to avoid fragmentation.  See documentation for Memory Management  (https://pytorch.org/docs/stable/notes/cuda.html#environment-variables)
2026-03-06 01:43:33,940 - __main__ - INFO - Fell back to CPU device
2026-03-06 01:43:33,941 - __main__ - WARNING - Prediction timed out in dev mode; returning empty prediction
INFO:     127.0.0.1:43426 - "POST /predict HTTP/1.1" 200 OK
2026-03-06 01:43:33,946 - __main__ - INFO - 🔓 Dev mode enabled - bypassing Bittensor verification
2026-03-06 01:43:33,946 - __main__ - INFO - Generating prediction for prefix: 'Clarity and'
2026-03-06 01:43:33,946 - __main__ - INFO - Using context: ''
The attention mask is not set and cannot be inferred from input because pad token is same as eos token. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results.
2026-03-06 01:43:43,946 - __main__ - WARNING - Prediction timed out in dev mode; returning empty prediction
INFO:     127.0.0.1:43426 - "POST /predict HTTP/1.1" 200 OK
2026-03-06 01:43:44,014 - __main__ - INFO - 🔓 Dev mode enabled - bypassing Bittensor verification
2026-03-06 01:43:44,014 - __main__ - INFO - Generating prediction for prefix: 'Clarity and empathy,'
2026-03-06 01:43:44,014 - __main__ - INFO - Using context: ''
2026-03-06 01:43:54,014 - __main__ - WARNING - Prediction timed out in dev mode; returning empty prediction
INFO:     127.0.0.1:43426 - "POST /predict HTTP/1.1" 200 OK
2026-03-06 01:43:54,019 - __main__ - INFO - 🔓 Dev mode enabled - bypassing Bittensor verification
2026-03-06 01:43:54,020 - __main__ - INFO - Generating prediction for prefix: 'Clarity and empathy, yes,'
2026-03-06 01:43:54,020 - __main__ - INFO - Using context: ''
2026-03-06 01:44:04,021 - __main__ - WARNING - Prediction timed out in dev mode; returning empty prediction
INFO:     127.0.0.1:43426 - "POST /predict HTTP/1.1" 200 OK
2026-03-06 01:44:04,030 - __main__ - INFO - 🔓 Dev mode enabled - bypassing Bittensor verification
2026-03-06 01:44:04,031 - __main__ - INFO - Generating prediction for prefix: 'Clarity and empathy, yes, but'
2026-03-06 01:44:04,031 - __main__ - INFO - Using context: ''
INFO:     Shutting down
INFO:     Finished server process [311701]