runtime error
Exit code: 1. Reason: The NVIDIA Driver was not detected. GPU functionality will not be available. Use the NVIDIA Container Toolkit to start this container with GPU support; see https://docs.nvidia.com/datacenter/cloud-native/ . === Starting NuMarkdown-8B-Thinking Space === Starting vLLM server with optimized settings... vLLM started with PID: 27 Waiting for vLLM server to start (this may take 5-10 minutes)... Still waiting... (10/180) - checking vLLM process ❌ vLLM process died! Checking logs: return _run_code(code, main_globals, None, File "/usr/lib/python3.10/runpy.py", line 86, in _run_code exec(code, run_globals) File "/home/user/.local/lib/python3.10/site-packages/vllm/entrypoints/openai/api_server.py", line 987, in <module> parser = make_arg_parser(parser) File "/home/user/.local/lib/python3.10/site-packages/vllm/entrypoints/openai/cli_args.py", line 300, in make_arg_parser parser = AsyncEngineArgs.add_cli_args(parser) File "/home/user/.local/lib/python3.10/site-packages/vllm/engine/arg_utils.py", line 2040, in add_cli_args parser = EngineArgs.add_cli_args(parser) File "/home/user/.local/lib/python3.10/site-packages/vllm/engine/arg_utils.py", line 1153, in add_cli_args vllm_kwargs = get_kwargs(VllmConfig) File "/home/user/.local/lib/python3.10/site-packages/vllm/engine/arg_utils.py", line 346, in get_kwargs return copy.deepcopy(_compute_kwargs(cls)) File "/home/user/.local/lib/python3.10/site-packages/vllm/engine/arg_utils.py", line 258, in _compute_kwargs default = default.default_factory() File "/home/user/.local/lib/python3.10/site-packages/pydantic/_internal/_dataclasses.py", line 121, in __init__ s.__pydantic_validator__.validate_python(ArgsKwargs(args, kwargs), self_instance=s) File "/home/user/.local/lib/python3.10/site-packages/vllm/config/device.py", line 58, in __post_init__ raise RuntimeError( RuntimeError: Failed to infer device type, please set the environment variable `VLLM_LOGGING_LEVEL=DEBUG` to turn on verbose logging to help debug the issue.
Container logs:
Fetching error logs...