runtime error

Exit code: 1. Reason: ngine_args.create_engine_config(usage_context) ERROR 02-09 03:06:57 engine.py:366] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ERROR 02-09 03:06:57 engine.py:366] File "/usr/local/lib/python3.12/dist-packages/vllm/engine/arg_utils.py", line 1043, in create_engine_config ERROR 02-09 03:06:57 engine.py:366] device_config = DeviceConfig(device=self.device) ERROR 02-09 03:06:57 engine.py:366] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ERROR 02-09 03:06:57 engine.py:366] File "/usr/local/lib/python3.12/dist-packages/vllm/config.py", line 1527, in __init__ ERROR 02-09 03:06:57 engine.py:366] raise RuntimeError("Failed to infer device type") ERROR 02-09 03:06:57 engine.py:366] RuntimeError: Failed to infer device type Traceback (most recent call last): File "/usr/lib/python3.12/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/usr/lib/python3.12/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/usr/local/lib/python3.12/dist-packages/vllm/engine/multiprocessing/engine.py", line 368, in run_mp_engine raise e File "/usr/local/lib/python3.12/dist-packages/vllm/engine/multiprocessing/engine.py", line 357, in run_mp_engine engine = MQLLMEngine.from_engine_args(engine_args=engine_args, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/dist-packages/vllm/engine/multiprocessing/engine.py", line 114, in from_engine_args engine_config = engine_args.create_engine_config(usage_context) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/dist-packages/vllm/engine/arg_utils.py", line 1043, in create_engine_config device_config = DeviceConfig(device=self.device) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/dist-packages/vllm/config.py", line 1527, in __init__ raise RuntimeError("Failed to infer device type") RuntimeError: Failed to infer device type

Container logs: