| 2026-06-18 02:22:15,834 INFO MainThread:34340 [wandb_setup.py:_flush():81] Current SDK version is 0.27.2 |
| 2026-06-18 02:22:15,834 INFO MainThread:34340 [wandb_setup.py:_flush():81] Configure stats pid to 34340 |
| 2026-06-18 02:22:15,834 INFO MainThread:34340 [wandb_setup.py:_flush():81] Loading settings from environment variables |
| 2026-06-18 02:22:15,834 INFO MainThread:34340 [wandb_init.py:setup_run_log_directory():723] Logging user logs to adapters/wandb/run-20260618_022215-qw5esbec/logs/debug.log |
| 2026-06-18 02:22:15,834 INFO MainThread:34340 [wandb_init.py:setup_run_log_directory():724] Logging internal logs to adapters/wandb/run-20260618_022215-qw5esbec/logs/debug-internal.log |
| 2026-06-18 02:22:15,835 INFO MainThread:34340 [wandb_init.py:init():766] calling init triggers |
| 2026-06-18 02:22:15,835 INFO MainThread:34340 [wandb_init.py:init():771] wandb.init called with sweep_config: {} |
| config: {'model': 'mlx-community/Llama-3.2-1B-Instruct-bf16', 'train': True, 'data': 'data/mlx', 'fine_tune_type': 'lora', 'optimizer': 'adam', 'mask_prompt': True, 'num_layers': 16, 'batch_size': 2, 'iters': 1500, 'val_batches': 25, 'learning_rate': 0.0001, 'steps_per_report': 25, 'steps_per_eval': 200, 'grad_accumulation_steps': 1, 'resume_adapter_file': None, 'adapter_path': 'adapters', 'save_every': 300, 'test': False, 'test_batches': 500, 'max_seq_length': 2048, 'config': None, 'grad_checkpoint': True, 'clear_cache_threshold': 0, 'report_to': 'wandb', 'project_name': 'text2sql-qwen-coder', 'seed': 0, 'optimizer_config': {'adam': {}, 'adamw': {}, 'muon': {}, 'sgd': {}, 'adafactor': {}}, 'lr_schedule': None, 'lora_parameters': {'rank': 8, 'dropout': 0.0, 'scale': 20.0}, '_wandb': {}} |
| 2026-06-18 02:22:15,835 INFO MainThread:34340 [wandb_init.py:init():814] starting backend |
| 2026-06-18 02:22:15,835 INFO MainThread:34340 [wandb_init.py:init():829] sending inform_init request |
| 2026-06-18 02:22:16,391 INFO MainThread:34340 [wandb_init.py:init():834] backend started and connected |
| 2026-06-18 02:22:16,393 INFO MainThread:34340 [wandb_init.py:init():904] updated telemetry |
| 2026-06-18 02:22:16,411 INFO MainThread:34340 [wandb_init.py:init():927] communicating run to backend with 90.0 second timeout |
| 2026-06-18 02:22:16,887 INFO MainThread:34340 [wandb_init.py:init():972] starting run threads in backend |
| 2026-06-18 02:22:16,998 INFO MainThread:34340 [wandb_run.py:_console_start():2523] atexit reg |
| 2026-06-18 02:22:16,998 INFO MainThread:34340 [wandb_run.py:_redirect():2373] redirect: wrap_raw |
| 2026-06-18 02:22:16,998 INFO MainThread:34340 [wandb_run.py:_redirect():2442] Wrapping output streams. |
| 2026-06-18 02:22:16,999 INFO MainThread:34340 [wandb_run.py:_redirect():2465] Redirects installed. |
| 2026-06-18 02:22:17,000 INFO MainThread:34340 [wandb_init.py:init():1010] run started, returning control to user process |
| 2026-06-18 04:32:21,536 INFO wandb-AsyncioManager-main:34340 [service_client.py:_forward_responses():122] [no run ID] Reached EOF. |
| 2026-06-18 04:32:21,544 INFO wandb-AsyncioManager-main:34340 [mailbox.py:close():154] [no run ID] Closing mailbox, abandoning 2 handles. |
| 2026-06-18 04:32:21,545 ERROR wandb-AsyncioManager-main:34340 [asyncio_manager.py:fn_wrap_exceptions():184] Uncaught exception in run_soon callback. |
| Traceback (most recent call last): |
| File "/Users/apple/Documents/work/Kd-project/Insufficient_Tokens/W5_Fine_Tune/.venv/lib/python3.11/site-packages/wandb/sdk/lib/asyncio_manager.py", line 182, in fn_wrap_exceptions |
| await fn() |
| File "/Users/apple/Documents/work/Kd-project/Insufficient_Tokens/W5_Fine_Tune/.venv/lib/python3.11/site-packages/wandb/sdk/lib/run_messages.py", line 90, in loop |
| await asyncio_compat.race( |
| File "/Users/apple/Documents/work/Kd-project/Insufficient_Tokens/W5_Fine_Tune/.venv/lib/python3.11/site-packages/wandb/sdk/lib/asyncio_compat.py", line 278, in race |
| async with open_task_group(race=True) as tg: |
| File "/opt/homebrew/Cellar/python@3.11/3.11.15/Frameworks/Python.framework/Versions/3.11/lib/python3.11/contextlib.py", line 217, in __aexit__ |
| await anext(self.gen) |
| File "/Users/apple/Documents/work/Kd-project/Insufficient_Tokens/W5_Fine_Tune/.venv/lib/python3.11/site-packages/wandb/sdk/lib/asyncio_compat.py", line 240, in open_task_group |
| await task_group._wait_all(race=race, timeout=exit_timeout) |
| File "/Users/apple/Documents/work/Kd-project/Insufficient_Tokens/W5_Fine_Tune/.venv/lib/python3.11/site-packages/wandb/sdk/lib/asyncio_compat.py", line 180, in _wait_all |
| raise exc |
| File "/Users/apple/Documents/work/Kd-project/Insufficient_Tokens/W5_Fine_Tune/.venv/lib/python3.11/site-packages/wandb/sdk/lib/run_messages.py", line 113, in _print_all |
| result = await handle.wait_async(timeout=None) |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ |
| File "/Users/apple/Documents/work/Kd-project/Insufficient_Tokens/W5_Fine_Tune/.venv/lib/python3.11/site-packages/wandb/sdk/mailbox/mailbox_handle.py", line 127, in wait_async |
| response = await self._handle.wait_async(timeout=timeout) |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ |
| File "/Users/apple/Documents/work/Kd-project/Insufficient_Tokens/W5_Fine_Tune/.venv/lib/python3.11/site-packages/wandb/sdk/mailbox/response_handle.py", line 123, in wait_async |
| raise HandleAbandonedError() |
| wandb.sdk.mailbox.mailbox_handle.HandleAbandonedError |
|
|
