config.json: 0%| | 0.00/727 [00:00
[2025-12-23 14:23:16,346] [DEBUG] [axolotl.loaders.tokenizer.load_tokenizer:279] [PID:5064] BOS: None / None
[2025-12-23 14:23:16,346] [DEBUG] [axolotl.loaders.tokenizer.load_tokenizer:280] [PID:5064] PAD: 151643 / <|endoftext|>
[2025-12-23 14:23:16,346] [DEBUG] [axolotl.loaders.tokenizer.load_tokenizer:281] [PID:5064] UNK: None / None
[2025-12-23 14:23:16,347] [INFO] [axolotl.utils.data.shared.load_preprocessed_dataset:476] [PID:5064] Unable to find prepared dataset in last_run_prepared/b1fab737da515ce3143dcd64b15cef47
[2025-12-23 14:23:16,348] [INFO] [axolotl.utils.data.sft._load_raw_datasets:320] [PID:5064] Loading raw datasets...
[2025-12-23 14:23:16,348] [WARNING] [axolotl.utils.data.sft._load_raw_datasets:322] [PID:5064] Processing datasets during training can lead to VRAM instability. Please pre-process your dataset using `axolotl preprocess path/to/config.yml`.
Generating train split: 0 examples [00:00, ? examples/s]
Generating train split: 19344 examples [00:00, 136525.22 examples/s]
Generating train split: 22912 examples [00:00, 104106.07 examples/s]
[2025-12-23 14:23:16,731] [INFO] [axolotl.utils.data.wrappers.get_dataset_wrapper:87] [PID:5064] Loading dataset: ./dataset/abd_full_train.jsonl with base_type: chat_template and prompt_style: None
[2025-12-23 14:23:16,746] [INFO] [axolotl.prompt_strategies.chat_template.__call__:969] [PID:5064] Using chat template:
---
{%- if tools %}
{{- '<|im_start|>system\n' }}
{%- if messages[0].role == 'system' %}
{{- messages[0].content + '\n\n' }}
{%- endif %}
{{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n" }}
{%- for tool in tools %}
{{- "\n" }}
{{- tool | tojson }}
{%- endfor %}
{{- "\n\n\nFor each function call, return a json object with function name and arguments within XML tags:\n\n{\"name\": , \"arguments\": }\n<|im_end|>\n" }}
{%- else %}
{%- if messages[0].role == 'system' %}
{{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
{%- endif %}
{%- endif %}
{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
{%- for message in messages[::-1] %}
{%- set index = (messages|length - 1) - loop.index0 %}
{%- if ns.multi_step_tool and message.role == "user" and not(message.content.startswith('') and message.content.endswith('')) %}
{%- set ns.multi_step_tool = false %}
{%- set ns.last_query_index = index %}
{%- endif %}
{%- endfor %}
{%- for message in messages %}
{%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
{{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
{%- elif message.role == "assistant" %}
{%- set content = message.content %}
{%- set reasoning_content = '' %}
{%- if message.reasoning_content is defined and message.reasoning_content is not none %}
{%- set reasoning_content = message.reasoning_content %}
{%- else %}
{%- if '' in message.content %}
{%- set content = message.content.split('')[-1].lstrip('\n') %}
{%- set reasoning_content = message.content.split('')[0].rstrip('\n').split('')[-1].lstrip('\n') %}
{%- endif %}
{%- endif %}
{%- if loop.index0 > ns.last_query_index %}
{%- if loop.last or (not loop.last and reasoning_content) %}
{{- '<|im_start|>' + message.role + '\n\n' + reasoning_content.strip('\n') + '\n\n\n' + content.lstrip('\n') }}
{%- else %}
{{- '<|im_start|>' + message.role + '\n' + content }}
{%- endif %}
{%- else %}
{{- '<|im_start|>' + message.role + '\n' + content }}
{%- endif %}
{%- if message.tool_calls %}
{%- for tool_call in message.tool_calls %}
{%- if (loop.first and content) or (not loop.first) %}
{{- '\n' }}
{%- endif %}
{%- if tool_call.function %}
{%- set tool_call = tool_call.function %}
{%- endif %}
{{- '\n{"name": "' }}
{{- tool_call.name }}
{{- '", "arguments": ' }}
{%- if tool_call.arguments is string %}
{{- tool_call.arguments }}
{%- else %}
{{- tool_call.arguments | tojson }}
{%- endif %}
{{- '}\n' }}
{%- endfor %}
{%- endif %}
{{- '<|im_end|>\n' }}
{%- elif message.role == "tool" %}
{%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
{{- '<|im_start|>user' }}
{%- endif %}
{{- '\n\n' }}
{{- message.content }}
{{- '\n' }}
{%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
{{- '<|im_end|>\n' }}
{%- endif %}
{%- endif %}
{%- endfor %}
{%- if add_generation_prompt %}
{{- '<|im_start|>assistant\n' }}
{%- if enable_thinking is defined and enable_thinking is false %}
{{- '\n\n\n\n' }}
{%- else %}
{{- '\n\n' }}
{%- endif %}
{%- endif %}
---
Tokenizing Prompts (num_proc=18): 0%| | 0/22912 [00:004096) (num_proc=18): 0%| | 0/22912 [00:004096) (num_proc=18): 4%|█▉ | 1000/22912 [00:00<00:10, 2118.66 examples/s]
Dropping Long Sequences (>4096) (num_proc=18): 81%|██████████████████████████████████▊ | 18548/22912 [00:00<00:00, 41203.48 examples/s]
Dropping Long Sequences (>4096) (num_proc=18): 100%|███████████████████████████████████████████| 22912/22912 [00:00<00:00, 26903.42 examples/s]
[2025-12-23 14:23:24,416] [WARNING] [axolotl.utils.data.utils.handle_long_seq_in_dataset:260] [PID:5064] Dropped 82 samples from dataset
Saving the dataset (0/18 shards): 0%| | 0/22830 [00:00
[2025-12-23 14:23:25,789] [DEBUG] [axolotl.loaders.tokenizer.load_tokenizer:279] [PID:5064] BOS: None / None
[2025-12-23 14:23:25,789] [DEBUG] [axolotl.loaders.tokenizer.load_tokenizer:280] [PID:5064] PAD: 151643 / <|endoftext|>
[2025-12-23 14:23:25,790] [DEBUG] [axolotl.loaders.tokenizer.load_tokenizer:281] [PID:5064] UNK: None / None
[2025-12-23 14:23:25,790] [DEBUG] [axolotl.train.setup_model_and_tokenizer:74] [PID:5064] Loading model
[2025-12-23 14:23:25,846] [DEBUG] [axolotl.monkeypatch.transformers.trainer_loss_calc.patch_evaluation_loop:87] [PID:5064] Patched Trainer.evaluation_loop with nanmean loss calculation
[2025-12-23 14:23:25,847] [DEBUG] [axolotl.monkeypatch.transformers.trainer_loss_calc.patch_maybe_log_save_evaluate:138] [PID:5064] Patched Trainer._maybe_log_save_evaluate with nanmean loss calculation
model.safetensors.index.json: 0.00B [00:00, ?B/s]
model.safetensors.index.json: 32.8kB [00:00, 102MB/s]
model-00001-of-00003.safetensors: 0%| | 0.00/3.96G [00:00