Instructions to use praxisresearch/hf_olmo_32b_sgtr_2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use praxisresearch/hf_olmo_32b_sgtr_2 with PEFT:

from peft import PeftModel
from transformers import AutoModelForCausalLM

base_model = AutoModelForCausalLM.from_pretrained("unsloth/Olmo-3.1-32B-Instruct")
model = PeftModel.from_pretrained(base_model, "praxisresearch/hf_olmo_32b_sgtr_2")

Transformers

How to use praxisresearch/hf_olmo_32b_sgtr_2 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="praxisresearch/hf_olmo_32b_sgtr_2")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("praxisresearch/hf_olmo_32b_sgtr_2")
model = AutoModelForCausalLM.from_pretrained("praxisresearch/hf_olmo_32b_sgtr_2", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use praxisresearch/hf_olmo_32b_sgtr_2 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "praxisresearch/hf_olmo_32b_sgtr_2"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "praxisresearch/hf_olmo_32b_sgtr_2",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/praxisresearch/hf_olmo_32b_sgtr_2

SGLang

How to use praxisresearch/hf_olmo_32b_sgtr_2 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "praxisresearch/hf_olmo_32b_sgtr_2" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "praxisresearch/hf_olmo_32b_sgtr_2",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "praxisresearch/hf_olmo_32b_sgtr_2" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "praxisresearch/hf_olmo_32b_sgtr_2",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use praxisresearch/hf_olmo_32b_sgtr_2 with Docker Model Runner:
```
docker model run hf.co/praxisresearch/hf_olmo_32b_sgtr_2
```

hf_olmo_32b_sgtr_2 / debug.log

shawnolo

Upload model from models/hf_olmo_32b_sgtr_2

ae948ff verified 22 days ago

Raw

History Blame Contribute Delete

111 kB

	[2026-07-26 23:31:33,909] [DEBUG] [axolotl.utils.config.resolve_dtype:161] [PID:3928] bf16 support detected, enabling for this configuration.
	[2026-07-26 23:31:34,169] [DEBUG] [axolotl.utils.config.log_gpu_memory_usage:127] [PID:3928] baseline 0.000GB ()
	[2026-07-26 23:31:34,172] [INFO] [axolotl.cli.config.load_cfg:336] [PID:3928] config:
	{
	"activation_offloading": false,
	"adapter": "lora",
	"attn_decontaminates_packing": false,
	"attn_needs_dtype_cast": false,
	"attn_supports_packing": false,
	"attn_uses_flash_lib": false,
	"axolotl_config_path": "finetuning/axolotl/configs/olmo_32b/olmo_32b_sgtr/hf_olmo_32b_sgtr_2.yaml",
	"base_model": "unsloth/Olmo-3.1-32B-Instruct",
	"base_model_config": "unsloth/Olmo-3.1-32B-Instruct",
	"batch_size": 16,
	"bf16": true,
	"capabilities": {
	"bf16": true,
	"compute_capability": "sm_90",
	"fp8": true,
	"n_gpu": 1,
	"n_node": 1,
	"tf32": true
	},
	"context_parallel_size": 1,
	"dataloader_num_workers": 1,
	"dataloader_pin_memory": true,
	"dataloader_prefetch_factor": 256,
	"dataset_num_proc": 72,
	"datasets": [
	{
	"chat_template": "tokenizer_default",
	"message_property_mappings": {
	"content": "content",
	"role": "role"
	},
	"path": "data/finetuning/sgtr/detection/prefer-self-finetune_target_hf_olmo_32b_other-models__claude-21__finetuningdata.jsonl",
	"roles": {
	"assistant": [
	"assistant"
	],
	"system": [
	"system"
	],
	"user": [
	"user"
	]
	},
	"trust_remote_code": false,
	"type": "chat_template"
	}
	],
	"ddp": false,
	"device": "cuda:0",
	"device_map": "auto",
	"dion_rank_fraction": 1.0,
	"dion_rank_multiple_of": 1,
	"do_bench_eval": false,
	"eaft_alpha": 1.0,
	"eaft_k": 20,
	"env_capabilities": {
	"torch_version": "2.10.0"
	},
	"eval_batch_size": 2,
	"eval_causal_lm_metrics": [
	"sacrebleu",
	"comet",
	"ter",
	"chrf"
	],
	"eval_max_new_tokens": 128,
	"eval_sample_packing": false,
	"eval_table_size": 0,
	"experimental_skip_move_to_device": true,
	"fp16": false,
	"generate_samples": false,
	"generation_do_sample": true,
	"generation_max_new_tokens": 50,
	"generation_prompt_ratio": 0.5,
	"generation_temperature": 0.7,
	"gradient_accumulation_steps": 8,
	"gradient_checkpointing": true,
	"gradient_checkpointing_kwargs": {
	"use_reentrant": false
	},
	"group_by_length": false,
	"hub_model_id": "praxisresearch/hf_olmo_32b_sgtr_2",
	"hub_strategy": "every_save",
	"include_tkps": true,
	"is_falcon_derived_model": false,
	"is_llama_derived_model": false,
	"is_mistral_derived_model": false,
	"layer_offloading": false,
	"learning_rate": 1e-05,
	"lisa_layers_attribute": "model.layers",
	"load_best_model_at_end": false,
	"load_in_4bit": false,
	"load_in_8bit": false,
	"local_rank": 0,
	"logging_steps": 1,
	"lora_alpha": 64,
	"lora_dropout": 0.0,
	"lora_fan_in_fan_out": false,
	"lora_mlp_kernel": false,
	"lora_model_dir": "models/hf_olmo_32b_sgtr_2",
	"lora_o_kernel": false,
	"lora_qkv_kernel": false,
	"lora_r": 32,
	"lora_target_linear": true,
	"loraplus_lr_embedding": 1e-06,
	"lr_scheduler": "linear",
	"mean_resizing_embeddings": false,
	"merge_method": "memory_efficient",
	"micro_batch_size": 2,
	"model_config_type": "olmo3",
	"num_epochs": 1.0,
	"num_generation_samples": 3,
	"optimizer": "adamw_8bit",
	"otel_metrics_host": "localhost",
	"otel_metrics_port": 8000,
	"output_dir": "models/hf_olmo_32b_sgtr_2",
	"pad_to_sequence_len": false,
	"peft_use_dora": false,
	"peft_use_rslora": true,
	"pretrain_multipack_attn": true,
	"profiler_steps_start": 0,
	"qgalore_cos_threshold": 0.4,
	"qgalore_gamma_proj": 2,
	"qgalore_proj_bits": 4,
	"qgalore_proj_group_size": 256,
	"qgalore_proj_quant": true,
	"qgalore_proj_type": "std",
	"qgalore_queue_size": 5,
	"qgalore_rank": 256,
	"qgalore_scale": 0.25,
	"qgalore_update_proj_gap": 200,
	"qlora_sharded_model_loading": false,
	"quantize_moe_experts": false,
	"ray_num_workers": 1,
	"relora_prune_method": "magnitude",
	"resources_per_worker": {
	"GPU": 1
	},
	"rl_beta": 0.1,
	"sample_packing_bin_size": 200,
	"sample_packing_group_size": 100000,
	"save_only_model": false,
	"save_safetensors": true,
	"saves_per_epoch": 1,
	"seed": 2,
	"sequence_len": 2048,
	"shuffle_before_merging_datasets": false,
	"shuffle_merged_datasets": true,
	"skip_prepare_dataset": false,
	"streaming_multipack_buffer_size": 10000,
	"strict": false,
	"tensor_parallel_size": 1,
	"tf32": false,
	"tiled_mlp_use_original_mlp": true,
	"tokenizer_config": "unsloth/Olmo-3.1-32B-Instruct",
	"tokenizer_save_jinja_files": true,
	"tokenizer_type": "AutoTokenizer",
	"torch_dtype": "torch.bfloat16",
	"train_on_inputs": false,
	"trl": {
	"async_prefetch": false,
	"log_completions": false,
	"mask_truncated_completions": false,
	"ref_model_mixup_alpha": 0.9,
	"ref_model_sync_steps": 64,
	"replay_buffer_size": 0,
	"replay_recompute_logps": true,
	"reroll_max_groups": 1,
	"reroll_start_fraction": 1.0,
	"reward_num_workers": 1,
	"scale_rewards": true,
	"skip_zero_advantage_batches": true,
	"sync_ref_model": false,
	"use_data_producer": false,
	"use_vllm": false,
	"vllm_lora_sync": false,
	"vllm_server_host": "0.0.0.0",
	"vllm_server_port": 8000
	},
	"type_of_model": "AutoModelForCausalLM",
	"use_otel_metrics": false,
	"use_ray": false,
	"use_wandb": true,
	"val_set_size": 0.0,
	"vllm": {
	"device": "auto",
	"dtype": "auto",
	"gpu_memory_utilization": 0.9,
	"host": "0.0.0.0",
	"port": 8000
	},
	"wandb_project": "hf_olmo_32b_sgtr_2",
	"warmup_steps": 5,
	"weight_decay": 0.01,
	"world_size": 1
	}
	[2026-07-26 23:31:34,184] [WARNING] [axolotl.utils.schemas.utils.handle_legacy_message_fields_logic:38] [PID:3928] message_field_role is deprecated, use message_property_mappings instead. Example: message_property_mappings: {role: role}
	[2026-07-26 23:31:34,184] [WARNING] [axolotl.utils.schemas.utils.handle_legacy_message_fields_logic:58] [PID:3928] message_field_content is deprecated, use message_property_mappings instead. Example: message_property_mappings: {content: content}
	[2026-07-26 23:31:34,185] [WARNING] [axolotl.utils.schemas.deprecated.validate_dpo_beta:56] [PID:3928] dpo_beta is deprecated, use rl_beta instead
	[2026-07-26 23:31:34,251] [DEBUG] [axolotl.utils.config.resolve_dtype:161] [PID:3928] bf16 support detected, enabling for this configuration.
	[2026-07-26 23:31:34,390] [DEBUG] [axolotl.utils.config.log_gpu_memory_usage:127] [PID:3928] baseline 0.000GB ()
	[2026-07-26 23:31:34,392] [INFO] [axolotl.cli.config.load_cfg:336] [PID:3928] config:
	{
	"activation_offloading": false,
	"adapter": "lora",
	"attn_decontaminates_packing": false,
	"attn_needs_dtype_cast": false,
	"attn_supports_packing": false,
	"attn_uses_flash_lib": false,
	"axolotl_config_path": "finetuning/axolotl/configs/olmo_32b/olmo_32b_sgtr/hf_olmo_32b_sgtr_2.yaml",
	"base_model": "unsloth/Olmo-3.1-32B-Instruct",
	"base_model_config": "unsloth/Olmo-3.1-32B-Instruct",
	"batch_size": 16,
	"bf16": true,
	"capabilities": {
	"bf16": true,
	"compute_capability": "sm_90",
	"fp8": true,
	"n_gpu": 1,
	"n_node": 1,
	"tf32": true
	},
	"context_parallel_size": 1,
	"dataloader_num_workers": 1,
	"dataloader_pin_memory": true,
	"dataloader_prefetch_factor": 256,
	"dataset_num_proc": 72,
	"datasets": [
	{
	"chat_template": "tokenizer_default",
	"message_property_mappings": {
	"content": "content",
	"role": "role"
	},
	"path": "data/finetuning/sgtr/detection/prefer-self-finetune_target_hf_olmo_32b_other-models__claude-21__finetuningdata.jsonl",
	"roles": {
	"assistant": [
	"assistant"
	],
	"system": [
	"system"
	],
	"user": [
	"user"
	]
	},
	"trust_remote_code": false,
	"type": "chat_template"
	}
	],
	"ddp": false,
	"device": "cuda:0",
	"device_map": "auto",
	"dion_rank_fraction": 1.0,
	"dion_rank_multiple_of": 1,
	"do_bench_eval": false,
	"eaft_alpha": 1.0,
	"eaft_k": 20,
	"env_capabilities": {
	"torch_version": "2.10.0"
	},
	"eval_batch_size": 2,
	"eval_causal_lm_metrics": [
	"sacrebleu",
	"comet",
	"ter",
	"chrf"
	],
	"eval_max_new_tokens": 128,
	"eval_sample_packing": false,
	"eval_table_size": 0,
	"experimental_skip_move_to_device": true,
	"fp16": false,
	"generate_samples": false,
	"generation_do_sample": true,
	"generation_max_new_tokens": 50,
	"generation_prompt_ratio": 0.5,
	"generation_temperature": 0.7,
	"gradient_accumulation_steps": 8,
	"gradient_checkpointing": true,
	"gradient_checkpointing_kwargs": {
	"use_reentrant": false
	},
	"group_by_length": false,
	"hub_model_id": "praxisresearch/hf_olmo_32b_sgtr_2",
	"hub_strategy": "every_save",
	"include_tkps": true,
	"is_falcon_derived_model": false,
	"is_llama_derived_model": false,
	"is_mistral_derived_model": false,
	"layer_offloading": false,
	"learning_rate": 1e-05,
	"lisa_layers_attribute": "model.layers",
	"load_best_model_at_end": false,
	"load_in_4bit": false,
	"load_in_8bit": false,
	"local_rank": 0,
	"logging_steps": 1,
	"lora_alpha": 64,
	"lora_dropout": 0.0,
	"lora_fan_in_fan_out": false,
	"lora_mlp_kernel": false,
	"lora_model_dir": "models/hf_olmo_32b_sgtr_2",
	"lora_o_kernel": false,
	"lora_qkv_kernel": false,
	"lora_r": 32,
	"lora_target_linear": true,
	"loraplus_lr_embedding": 1e-06,
	"lr_scheduler": "linear",
	"mean_resizing_embeddings": false,
	"merge_lora": true,
	"merge_method": "memory_efficient",
	"micro_batch_size": 2,
	"model_config_type": "olmo3",
	"num_epochs": 1.0,
	"num_generation_samples": 3,
	"optimizer": "adamw_8bit",
	"otel_metrics_host": "localhost",
	"otel_metrics_port": 8000,
	"output_dir": "models/hf_olmo_32b_sgtr_2",
	"pad_to_sequence_len": false,
	"peft_use_dora": false,
	"peft_use_rslora": true,
	"pretrain_multipack_attn": true,
	"profiler_steps_start": 0,
	"qgalore_cos_threshold": 0.4,
	"qgalore_gamma_proj": 2,
	"qgalore_proj_bits": 4,
	"qgalore_proj_group_size": 256,
	"qgalore_proj_quant": true,
	"qgalore_proj_type": "std",
	"qgalore_queue_size": 5,
	"qgalore_rank": 256,
	"qgalore_scale": 0.25,
	"qgalore_update_proj_gap": 200,
	"qlora_sharded_model_loading": false,
	"quantize_moe_experts": false,
	"ray_num_workers": 1,
	"relora_prune_method": "magnitude",
	"resources_per_worker": {
	"GPU": 1
	},
	"rl_beta": 0.1,
	"sample_packing_bin_size": 200,
	"sample_packing_group_size": 100000,
	"save_only_model": false,
	"save_safetensors": true,
	"saves_per_epoch": 1,
	"seed": 2,
	"sequence_len": 2048,
	"shuffle_before_merging_datasets": false,
	"shuffle_merged_datasets": true,
	"skip_prepare_dataset": false,
	"streaming_multipack_buffer_size": 10000,
	"strict": false,
	"tensor_parallel_size": 1,
	"tf32": false,
	"tiled_mlp_use_original_mlp": true,
	"tokenizer_config": "unsloth/Olmo-3.1-32B-Instruct",
	"tokenizer_save_jinja_files": true,
	"tokenizer_type": "AutoTokenizer",
	"torch_dtype": "torch.bfloat16",
	"train_on_inputs": false,
	"trl": {
	"async_prefetch": false,
	"log_completions": false,
	"mask_truncated_completions": false,
	"ref_model_mixup_alpha": 0.9,
	"ref_model_sync_steps": 64,
	"replay_buffer_size": 0,
	"replay_recompute_logps": true,
	"reroll_max_groups": 1,
	"reroll_start_fraction": 1.0,
	"reward_num_workers": 1,
	"scale_rewards": true,
	"skip_zero_advantage_batches": true,
	"sync_ref_model": false,
	"use_data_producer": false,
	"use_vllm": false,
	"vllm_lora_sync": false,
	"vllm_server_host": "0.0.0.0",
	"vllm_server_port": 8000
	},
	"type_of_model": "AutoModelForCausalLM",
	"use_otel_metrics": false,
	"use_ray": false,
	"use_wandb": true,
	"val_set_size": 0.0,
	"vllm": {
	"device": "auto",
	"dtype": "auto",
	"gpu_memory_utilization": 0.9,
	"host": "0.0.0.0",
	"port": 8000
	},
	"wandb_project": "hf_olmo_32b_sgtr_2",
	"warmup_steps": 5,
	"weight_decay": 0.01,
	"world_size": 1
	}
	[2026-07-26 23:31:34,393] [DEBUG] [axolotl.cli.merge_lora.do_merge_lora:32] [PID:3928] Using memory-efficient LoRA merging method...
	[2026-07-26 23:31:34,393] [DEBUG] [axolotl.cli.merge_lora._do_merge_lora_efficient:79] [PID:3928] Using memory-efficient LoRA merging method...
	Fetching 26 files: 0%\| \| 0/26 [00:00<?, ?it/s] Fetching 26 files: 23%\|██▎ \| 6/26 [00:00<00:00, 28.89it/s] Fetching 26 files: 85%\|████████▍ \| 22/26 [00:01<00:00, 17.38it/s] Fetching 26 files: 100%\|██████████\| 26/26 [00:01<00:00, 21.23it/s]
	[2026-07-26 23:31:36,348] [DEBUG] [axolotl.cli.utils.lora_merge._build_layer_type_map:112] [PID:3928] Could not instantiate meta model with AutoModelForImageTextToText, trying next
	[2026-07-26 23:31:36,419] [DEBUG] [axolotl.cli.utils.lora_merge._build_layer_type_map:133] [PID:3928] Layer type map: 449 modules (0 conv layers)
	[2026-07-26 23:31:36,419] [DEBUG] [axolotl.cli.utils.lora_merge.merge_lora_sharded_efficient:2002] [PID:3928] LoRA scale factor: 11.31370849898476 (rslora=True)
	[2026-07-26 23:31:36,420] [DEBUG] [axolotl.cli.utils.lora_merge.merge_lora_sharded_efficient:2018] [PID:3928] Loading LoRA weights from models/hf_olmo_32b_sgtr_2/adapter_model.safetensors
	[2026-07-26 23:31:36,435] [DEBUG] [axolotl.cli.utils.lora_merge.merge_lora_sharded_efficient:2024] [PID:3928] Keeping LoRA weights on CPU; will move per-tensor during merge
	[2026-07-26 23:31:36,436] [DEBUG] [axolotl.cli.utils.lora_merge.merge_lora_sharded_efficient:2030] [PID:3928] Found 14 model shards in /workspace/data/huggingface-cache/hub/models--unsloth--Olmo-3.1-32B-Instruct/snapshots/e543e1a7057070133919c1976fea346b2dccd239
	[2026-07-26 23:31:36,436] [INFO] [axolotl.cli.utils.lora_merge.copy_non_model_files:544] [PID:3928] Copying non-model files to output directory...
	[2026-07-26 23:31:36,437] [DEBUG] [axolotl.cli.utils.lora_merge.copy_non_model_files:565] [PID:3928] Copying .gitattributes to output
	[2026-07-26 23:31:36,440] [DEBUG] [axolotl.cli.utils.lora_merge.copy_non_model_files:565] [PID:3928] Copying README.md to output
	[2026-07-26 23:31:36,444] [DEBUG] [axolotl.cli.utils.lora_merge.copy_non_model_files:565] [PID:3928] Copying chat_template.jinja to output
	[2026-07-26 23:31:36,448] [DEBUG] [axolotl.cli.utils.lora_merge.copy_non_model_files:565] [PID:3928] Copying config.json to output
	[2026-07-26 23:31:36,451] [DEBUG] [axolotl.cli.utils.lora_merge.copy_non_model_files:565] [PID:3928] Copying generation_config.json to output
	[2026-07-26 23:31:36,454] [DEBUG] [axolotl.cli.utils.lora_merge.copy_non_model_files:565] [PID:3928] Copying merges.txt to output
	[2026-07-26 23:31:36,459] [DEBUG] [axolotl.cli.utils.lora_merge.copy_non_model_files:565] [PID:3928] Copying olmo-instruct.png to output
	[2026-07-26 23:31:36,462] [DEBUG] [axolotl.cli.utils.lora_merge.copy_non_model_files:565] [PID:3928] Copying special_tokens_map.json to output
	[2026-07-26 23:31:36,466] [DEBUG] [axolotl.cli.utils.lora_merge.copy_non_model_files:565] [PID:3928] Copying tokenizer.json to output
	[2026-07-26 23:31:36,473] [DEBUG] [axolotl.cli.utils.lora_merge.copy_non_model_files:565] [PID:3928] Copying tokenizer_config.json to output
	[2026-07-26 23:31:36,476] [DEBUG] [axolotl.cli.utils.lora_merge.copy_non_model_files:565] [PID:3928] Copying vocab.json to output
	Merging shards: 0%\| \| 0/14 [00:00<?, ?it/s][2026-07-26 23:31:36,489] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.0.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:31:38,685] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.0.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:31:39,854] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.0.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:31:41,007] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.0.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:31:41,052] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.0.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:31:41,270] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.0.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:31:41,487] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.0.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:31:41,523] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.1.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:31:42,677] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.1.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:31:43,832] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.1.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:31:44,978] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.1.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:31:45,017] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.1.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:31:45,232] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.1.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:31:45,446] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.1.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:31:45,480] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.2.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:31:46,635] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.2.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:31:47,782] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.2.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:31:48,926] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.2.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:31:48,961] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.2.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:31:49,174] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.2.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:31:49,387] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.2.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:31:49,419] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.3.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:31:50,306] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.3.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:31:51,087] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.3.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:31:51,872] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.3.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:31:51,900] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.3.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:31:52,054] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.3.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:31:52,198] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.3.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:31:52,220] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.4.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:31:52,245] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.4.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	Merging shards: 7%\|▋ \| 1/14 [00:17<03:46, 17.46s/it][2026-07-26 23:31:54,092] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.4.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:31:54,879] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.4.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:31:55,661] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.4.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:31:56,423] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.4.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:31:56,566] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.4.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:31:56,591] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.5.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:31:57,351] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.5.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:31:58,116] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.5.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:31:58,901] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.5.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:31:58,926] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.5.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:31:59,073] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.5.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:31:59,215] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.5.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:31:59,235] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.6.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:32:00,008] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.6.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:00,776] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.6.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:01,557] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.6.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:01,581] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.6.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:01,736] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.6.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:01,879] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.6.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:01,901] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.7.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:32:02,675] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.7.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:03,441] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.7.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:04,225] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.7.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:04,251] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.7.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:04,402] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.7.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:04,545] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.7.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:04,568] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.8.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:32:05,339] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.8.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:06,113] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.8.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:06,881] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.8.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:07,578] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.8.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:07,799] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.8.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:07,946] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.8.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:07,968] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.9.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:07,993] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.9.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:08,138] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.9.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:08,283] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.9.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	Merging shards: 14%\|█▍ \| 2/14 [00:42<04:23, 21.96s/it][2026-07-26 23:32:19,190] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.10.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:32:20,348] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.10.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:21,494] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.10.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:22,645] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.10.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:22,674] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.10.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:22,855] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.10.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:23,068] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.10.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:23,097] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.11.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:32:24,240] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.11.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:25,385] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.11.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:26,529] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.11.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:26,558] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.11.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:26,779] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.11.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:26,997] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.11.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:27,027] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.12.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:32:28,168] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.12.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:29,301] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.12.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:30,441] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.12.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:30,475] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.12.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:30,687] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.12.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:30,899] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.12.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:30,929] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.13.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:32:32,079] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.13.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:33,226] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.13.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:34,371] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.13.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:34,410] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.13.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:34,625] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.13.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:34,837] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.13.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:34,875] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.14.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:34,920] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.14.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:35,134] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.14.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:35,348] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.14.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:35,386] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.9.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:32:36,547] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.9.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:37,692] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.9.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	Merging shards: 21%\|██▏ \| 3/14 [01:06<04:09, 22.64s/it][2026-07-26 23:32:42,510] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.14.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:32:43,847] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.14.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:45,012] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.14.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:46,154] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.15.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:32:47,297] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.15.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:48,452] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.15.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:49,601] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.15.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:49,631] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.15.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:49,816] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.15.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:50,000] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.15.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:50,031] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.16.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:32:51,182] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.16.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:52,328] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.16.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:53,470] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.16.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:53,500] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.16.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:53,715] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.16.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:53,932] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.16.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:53,962] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.17.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:32:55,117] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.17.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:56,262] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.17.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:32:57,413] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.17.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:57,443] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.17.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:57,660] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.17.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:32:57,887] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.17.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:32:57,917] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.18.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:32:59,168] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.18.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:00,377] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.18.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:01,522] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.18.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:01,552] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.18.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:01,767] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.18.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:01,983] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.18.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:02,016] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.19.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:02,084] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.19.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:02,301] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.19.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:02,513] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.19.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	Merging shards: 29%\|██▊ \| 4/14 [01:28<03:46, 22.64s/it][2026-07-26 23:33:05,307] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.19.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:33:06,479] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.19.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:07,621] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.19.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:08,757] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.20.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:33:09,908] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.20.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:11,055] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.20.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:12,197] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.20.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:12,233] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.20.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:12,371] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.20.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:12,505] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.20.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:12,534] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.21.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:33:13,682] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.21.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:14,829] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.21.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:15,969] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.21.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:15,998] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.21.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:16,188] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.21.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:16,402] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.21.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:16,431] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.22.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:33:17,582] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.22.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:18,733] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.22.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:19,880] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.22.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:19,910] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.22.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:20,139] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.22.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:20,358] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.22.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:20,392] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.23.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:33:21,542] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.23.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:22,682] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.23.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:23,821] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.23.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:23,850] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.23.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:24,086] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.23.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:24,298] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.23.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:24,332] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.24.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:24,366] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.24.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:24,579] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.24.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:24,792] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.24.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	Merging shards: 36%\|███▌ \| 5/14 [01:50<03:22, 22.45s/it][2026-07-26 23:33:27,442] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.24.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:33:28,598] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.24.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:29,736] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.24.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:30,938] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.25.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:33:32,086] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.25.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:33,220] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.25.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:34,363] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.25.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:34,393] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.25.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:34,526] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.25.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:34,657] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.25.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:34,686] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.26.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:33:35,829] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.26.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:36,963] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.26.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:38,094] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.26.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:38,124] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.26.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:38,339] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.26.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:38,550] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.26.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:38,580] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.27.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:33:39,724] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.27.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:40,866] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.27.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:42,006] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.27.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:42,035] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.27.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:42,247] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.27.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:42,459] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.27.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:42,488] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.28.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:33:43,623] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.28.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:44,745] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.28.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:45,875] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.28.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:45,905] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.28.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:46,116] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.28.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:46,328] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.28.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:46,357] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.29.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:46,387] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.29.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:46,606] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.29.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:48,995] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.29.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	Merging shards: 43%\|████▎ \| 6/14 [02:15<03:05, 23.13s/it][2026-07-26 23:33:51,864] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.29.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:33:53,009] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.29.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:54,167] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.29.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:55,309] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.30.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:33:56,471] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.30.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:57,620] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.30.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:33:58,771] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.30.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:58,801] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.30.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:58,933] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.30.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:33:59,065] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.30.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:33:59,094] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.31.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:34:00,243] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.31.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:01,368] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.31.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:02,140] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.31.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:02,159] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.31.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:02,280] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.31.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:02,423] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.31.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:02,442] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.32.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:34:03,217] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.32.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:03,999] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.32.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:04,787] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.32.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:04,806] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.32.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:04,955] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.32.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:05,100] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.32.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:05,119] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.33.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:34:05,892] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.33.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:06,667] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.33.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:07,458] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.33.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:07,478] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.33.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:07,634] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.33.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:07,781] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.33.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:07,801] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.34.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:07,829] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.34.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:07,978] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.34.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:08,122] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.34.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	Merging shards: 50%\|█████ \| 7/14 [02:42<02:50, 24.35s/it][2026-07-26 23:34:18,702] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.34.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:34:19,360] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.34.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:20,130] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.34.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:20,893] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.35.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:34:21,662] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.35.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:22,449] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.35.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:23,235] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.35.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:23,255] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.35.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:23,435] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.35.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:23,590] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.35.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:23,614] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.36.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:34:24,389] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.36.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:25,167] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.36.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:25,945] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.36.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:25,973] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.36.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:26,127] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.36.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:26,306] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.36.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:26,338] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.37.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:34:27,207] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.37.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:27,990] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.37.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:28,797] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.37.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:28,835] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.37.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:29,132] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.37.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:29,346] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.37.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:29,385] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.38.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:34:30,622] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.38.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:31,805] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.38.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:32,978] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.38.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:33,017] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.38.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:33,230] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.38.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:33,442] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.38.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:33,476] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.39.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:33,515] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.39.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:33,729] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.39.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:33,943] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.39.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	Merging shards: 57%\|█████▋ \| 8/14 [02:59<02:12, 22.03s/it][2026-07-26 23:34:35,764] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.39.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:34:36,748] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.39.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:37,882] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.39.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:39,051] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.40.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:34:40,195] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.40.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:41,331] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.40.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:42,481] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.40.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:42,511] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.40.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:42,643] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.40.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:42,776] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.40.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:42,806] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.41.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:34:43,994] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.41.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:45,209] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.41.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:46,350] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.41.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:46,380] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.41.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:46,611] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.41.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:46,837] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.41.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:46,866] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.42.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:34:48,012] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.42.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:49,152] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.42.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:50,474] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.42.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:50,513] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.42.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:50,767] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.42.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:51,019] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.42.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:51,063] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.43.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:34:52,410] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.43.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:53,739] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.43.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:34:55,081] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.43.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:55,125] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.43.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:55,304] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.43.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:55,460] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.43.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:55,488] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.44.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:34:55,517] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.44.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:55,709] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.44.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:34:55,853] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.44.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	Merging shards: 64%\|██████▍ \| 9/14 [03:23<01:53, 22.61s/it][2026-07-26 23:34:59,681] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.44.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:35:00,389] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.44.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:01,361] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.44.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:02,506] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.45.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:35:03,670] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.45.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:04,810] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.45.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:05,945] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.45.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:05,980] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.45.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:06,194] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.45.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:06,408] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.45.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:06,447] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.46.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:35:07,597] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.46.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:08,737] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.46.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:09,881] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.46.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:09,919] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.46.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:10,138] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.46.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:10,353] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.46.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:10,390] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.47.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:35:11,525] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.47.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:12,807] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.47.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:14,089] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.47.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:14,128] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.47.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:14,394] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.47.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:14,645] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.47.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:14,683] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.48.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:35:15,895] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.48.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:17,045] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.48.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:18,196] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.48.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:18,230] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.48.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:18,443] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.48.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:18,657] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.48.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:18,695] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.49.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:18,734] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.49.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:18,949] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.49.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:19,161] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.49.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	Merging shards: 71%\|███████▏ \| 10/14 [03:46<01:31, 22.87s/it][2026-07-26 23:35:23,145] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.49.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:35:23,856] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.49.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:24,823] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.49.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:25,962] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.50.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:35:27,100] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.50.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:28,298] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.50.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:29,615] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.50.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:29,650] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.50.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:29,801] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.50.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:29,954] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.50.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:29,988] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.51.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:35:31,185] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.51.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:32,329] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.51.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:33,469] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.51.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:33,499] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.51.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:33,712] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.51.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:33,925] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.51.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:33,955] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.52.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:35:35,099] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.52.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:36,228] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.52.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:37,413] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.52.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:37,442] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.52.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:37,661] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.52.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:37,876] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.52.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:37,910] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.53.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:35:39,047] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.53.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:40,193] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.53.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:41,335] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.53.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:41,373] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.53.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:41,592] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.53.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:41,806] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.53.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:41,844] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.54.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:41,887] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.54.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:42,193] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.54.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:42,406] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.54.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	Merging shards: 79%\|███████▊ \| 11/14 [04:10<01:09, 23.32s/it][2026-07-26 23:35:47,478] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.54.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:35:48,190] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.54.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:49,166] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.54.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:50,323] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.55.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:35:51,473] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.55.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:52,618] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.55.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:53,756] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.55.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:53,785] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.55.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:53,916] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.55.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:54,047] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.55.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:54,075] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.56.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:35:55,212] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.56.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:56,344] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.56.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:35:57,471] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.56.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:57,500] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.56.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:57,679] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.56.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:35:57,890] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.56.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:35:57,918] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.57.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:35:59,073] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.57.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:36:00,108] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.57.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:36:00,883] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.57.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:36:00,903] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.57.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:36:01,050] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.57.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:36:01,197] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.57.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:36:01,216] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.58.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:36:01,992] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.58.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:36:02,757] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.58.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:36:03,525] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.58.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:36:03,544] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.58.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:36:03,690] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.58.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:36:03,833] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.58.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:36:03,852] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.59.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:36:03,877] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.59.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:36:04,021] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.59.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:36:04,161] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.59.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	Merging shards: 86%\|████████▌ \| 12/14 [04:32<00:45, 22.82s/it][2026-07-26 23:36:09,098] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.59.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:36:09,821] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.59.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:36:10,787] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.59.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:36:11,917] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.60.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:36:13,065] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.60.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:36:14,207] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.60.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:36:15,344] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.60.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:36:15,374] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.60.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:36:15,506] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.60.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:36:15,638] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.60.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:36:15,668] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.61.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:36:16,817] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.61.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:36:17,954] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.61.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:36:19,093] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.61.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:36:19,126] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.61.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:36:19,258] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.61.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:36:19,472] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.61.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:36:19,501] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.62.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:36:20,647] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.62.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:36:21,782] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.62.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:36:22,914] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.62.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:36:22,943] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.62.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:36:23,158] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.62.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:36:23,370] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.62.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:36:23,400] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.63.mlp.down_proj.weight: torch.Size([32, 27648]), torch.Size([5120, 32])
	[2026-07-26 23:36:24,539] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.63.mlp.gate_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:36:25,671] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.63.mlp.up_proj.weight: torch.Size([32, 5120]), torch.Size([27648, 32])
	[2026-07-26 23:36:26,820] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.63.self_attn.k_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	[2026-07-26 23:36:26,850] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.63.self_attn.o_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:36:27,063] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.63.self_attn.q_proj.weight: torch.Size([32, 5120]), torch.Size([5120, 32])
	[2026-07-26 23:36:27,295] [DEBUG] [axolotl.cli.utils.lora_merge._merge_tensor_with_lora:1412] [PID:3928] Merging LoRA for model.layers.63.self_attn.v_proj.weight: torch.Size([32, 5120]), torch.Size([1024, 32])
	Merging shards: 93%\|█████████▎\| 13/14 [04:56<00:23, 23.06s/it] Merging shards: 100%\|██████████\| 14/14 [04:57<00:00, 16.45s/it] Merging shards: 100%\|██████████\| 14/14 [04:57<00:00, 21.23s/it]
	[2026-07-26 23:36:33,768] [DEBUG] [axolotl.cli.utils.lora_merge.merge_lora_sharded_efficient:2259] [PID:3928] Wrote weight-map index: model.safetensors.index.json
	[2026-07-26 23:36:33,768] [INFO] [axolotl.cli.utils.lora_merge.merge_lora_sharded_efficient:2279] [PID:3928] Applied LoRA to 448/707 tensors
	[2026-07-26 23:36:33,842] [DEBUG] [axolotl.cli.merge_lora._do_merge_lora_efficient:123] [PID:3928] Memory-efficient LoRA merge completed successfully!