runtime error
Exit code: 1. Reason: ███▉ | 1.58G/1.98G [00:06<00:01, 328MB/s][A model-00007-of-00008.safetensors: 100%|██████████| 1.98G/1.98G [00:07<00:00, 279MB/s] model-00008-of-00008.safetensors: 0%| | 0.00/816M [00:00<?, ?B/s][A model-00008-of-00008.safetensors: 1%|▏ | 11.0M/816M [00:01<01:13, 11.0MB/s][A model-00008-of-00008.safetensors: 26%|██▌ | 212M/816M [00:02<00:05, 102MB/s] [A model-00008-of-00008.safetensors: 100%|██████████| 816M/816M [00:03<00:00, 256MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 29, in <module> model = AutoModelForCausalLM.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 600, in from_pretrained return model_class.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 317, in _wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 5069, in from_pretrained ) = cls._load_pretrained_model( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 5490, in _load_pretrained_model caching_allocator_warmup(model_to_load, expanded_device_map, hf_quantizer) File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 6109, in caching_allocator_warmup device_memory = torch_accelerator_module.mem_get_info(index)[0] File "/usr/local/lib/python3.10/site-packages/torch/cuda/memory.py", line 838, in mem_get_info return torch.cuda.cudart().cudaMemGetInfo(device) File "/usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 489, in cudart _lazy_init() File "/usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 412, in _lazy_init torch._C._cuda_init() RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx
Container logs:
Fetching error logs...