runtime error
Exit code: 1. Reason: import torch.nn.functional as F File "/usr/local/lib/python3.10/site-packages/torch/nn/__init__.py", line 1, in <module> from .modules import * # noqa: F403 File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/__init__.py", line 35, in <module> from .transformer import TransformerEncoder, TransformerDecoder, \ File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/transformer.py", line 20, in <module> device: torch.device = torch.device(torch._C._get_default_device()), # torch.device('cpu'), /usr/local/lib/python3.10/site-packages/torch/nn/modules/transformer.py:20: UserWarning: Failed to initialize NumPy: _ARRAY_API not found (Triggered internally at ../torch/csrc/utils/tensor_numpy.cpp:84.) device: torch.device = torch.device(torch._C._get_default_device()), # torch.device('cpu'), Downloading shards: 0%| | 0/4 [00:00<?, ?it/s][A Downloading shards: 25%|βββ | 1/4 [00:07<00:22, 7.58s/it][A Downloading shards: 50%|βββββ | 2/4 [00:15<00:15, 7.87s/it][A Downloading shards: 75%|ββββββββ | 3/4 [00:24<00:08, 8.24s/it][A Downloading shards: 100%|ββββββββββ| 4/4 [00:28<00:00, 6.67s/it][A Downloading shards: 100%|ββββββββββ| 4/4 [00:28<00:00, 7.15s/it] Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s][A Loading checkpoint shards: 100%|ββββββββββ| 4/4 [00:00<00:00, 9.36it/s] Some parameters are on the meta device because they were offloaded to the cpu and disk. Using CPU You shouldn't move a model that is dispatched using accelerate hooks. Traceback (most recent call last): File "/home/user/app/app.py", line 58, in <module> model = model.to(device) File "/usr/local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 468, in wrapper raise RuntimeError("You can't move a model that has some modules offloaded to cpu or disk.") RuntimeError: You can't move a model that has some modules offloaded to cpu or disk.
Container logs:
Fetching error logs...