runtime error

Exit code: 1. Reason: line 426, in dispatch_model attach_align_device_hook_on_blocks( File "/usr/local/lib/python3.10/site-packages/accelerate/hooks.py", line 676, in attach_align_device_hook_on_blocks attach_align_device_hook_on_blocks( File "/usr/local/lib/python3.10/site-packages/accelerate/hooks.py", line 676, in attach_align_device_hook_on_blocks attach_align_device_hook_on_blocks( File "/usr/local/lib/python3.10/site-packages/accelerate/hooks.py", line 676, in attach_align_device_hook_on_blocks attach_align_device_hook_on_blocks( [Previous line repeated 2 more times] File "/usr/local/lib/python3.10/site-packages/accelerate/hooks.py", line 658, in attach_align_device_hook_on_blocks attach_execution_device_hook( File "/usr/local/lib/python3.10/site-packages/accelerate/hooks.py", line 451, in attach_execution_device_hook attach_execution_device_hook( File "/usr/local/lib/python3.10/site-packages/accelerate/hooks.py", line 440, in attach_execution_device_hook if not hasattr(module, "_hf_hook") and len(module.state_dict()) > 0: File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2265, in state_dict module.state_dict( File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2265, in state_dict module.state_dict( File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2262, in state_dict self._save_to_state_dict(destination, prefix, keep_vars) File "/usr/local/lib/python3.10/site-packages/bitsandbytes/nn/modules.py", line 524, in _save_to_state_dict for k, v in self.weight.quant_state.as_dict(packed=True).items(): File "/usr/local/lib/python3.10/site-packages/bitsandbytes/functional.py", line 525, in as_dict "nested_offset": self.offset.item(), File "/usr/local/lib/python3.10/site-packages/torch/_meta_registrations.py", line 7341, in meta_local_scalar_dense raise RuntimeError("Tensor.item() cannot be called on meta tensors") RuntimeError: Tensor.item() cannot be called on meta tensors

Container logs:

Fetching error logs...