runtime error
Exit code: 1. Reason: INFO 05-23 23:46:08 [__init__.py:243] No platform detected, vLLM is running on UnspecifiedPlatform WARNING 05-23 23:46:10 [_custom_ops.py:21] Failed to import from vllm._C with ImportError('libcuda.so.1: cannot open shared object file: No such file or directory') Traceback (most recent call last): File "/home/user/app/app.py", line 52, in <module> model = VLLMModel(model_id="HuggingFaceTB/SmolLM-135M-Instruct") File "/usr/local/lib/python3.10/site-packages/smolagents/models.py", line 412, in __init__ self.model = LLM(model=model_id) File "/usr/local/lib/python3.10/site-packages/vllm/utils.py", line 1161, in inner return fn(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/vllm/entrypoints/llm.py", line 247, in __init__ self.llm_engine = LLMEngine.from_engine_args( File "/usr/local/lib/python3.10/site-packages/vllm/engine/llm_engine.py", line 503, in from_engine_args vllm_config = engine_args.create_engine_config(usage_context) File "/usr/local/lib/python3.10/site-packages/vllm/engine/arg_utils.py", line 1098, in create_engine_config device_config = DeviceConfig(device=self.device) File "<string>", line 4, in __init__ File "/usr/local/lib/python3.10/site-packages/vllm/config.py", line 2119, in __post_init__ raise RuntimeError( RuntimeError: Failed to infer device type, please set the environment variable `VLLM_LOGGING_LEVEL=DEBUG` to turn on verbose logging to help debug the issue.
Container logs:
Fetching error logs...