runtime error

Exit code: 1. Reason: /models--nvidia--audio-flamingo-3-chat/snapshots/f5101f44de138aed8527791212be2e070224fb86/sound_mm_projector'] /usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py:716: UserWarning: Can't initialize NVML warnings.warn("Can't initialize NVML") Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s] Loading checkpoint shards: 50%|█████ | 2/4 [00:01<00:01, 1.20it/s] Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00, 1.37it/s] Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00, 1.34it/s] You are using a model of type whisper to instantiate a model of type qwen2_audio_encoder. This is not supported for all configurations of models and can yield errors. /home/user/.cache/huggingface/hub/models--nvidia--audio-flamingo-3-chat/snapshots/f5101f44de138aed8527791212be2e070224fb86 Traceback (most recent call last): File "/home/user/app/app.py", line 14, in <module> model_multi = model_multi.to("cuda") File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3156, in to return super().to(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1340, in to return self._apply(convert) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 900, in _apply module._apply(fn) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 900, in _apply module._apply(fn) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 900, in _apply module._apply(fn) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 927, in _apply param_applied = fn(param) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1326, in convert return t.to( File "/usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 319, in _lazy_init torch._C._cuda_init() RuntimeError: No CUDA GPUs are available

Container logs:

Fetching error logs...