runtime error

Exit code: 1. Reason: File "/root/.pyenv/versions/3.13.11/lib/python3.13/site-packages/transformers/modeling_utils.py", line 3555, in to return super().to(*args, **kwargs) ~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/root/.pyenv/versions/3.13.11/lib/python3.13/site-packages/torch/nn/modules/module.py", line 1371, in to return self._apply(convert) ~~~~~~~~~~~^^^^^^^^^ File "/root/.pyenv/versions/3.13.11/lib/python3.13/site-packages/torch/nn/modules/module.py", line 930, in _apply module._apply(fn) ~~~~~~~~~~~~~^^^^ File "/root/.pyenv/versions/3.13.11/lib/python3.13/site-packages/torch/nn/modules/module.py", line 930, in _apply module._apply(fn) ~~~~~~~~~~~~~^^^^ File "/root/.pyenv/versions/3.13.11/lib/python3.13/site-packages/torch/nn/modules/module.py", line 930, in _apply module._apply(fn) ~~~~~~~~~~~~~^^^^ [Previous line repeated 3 more times] File "/root/.pyenv/versions/3.13.11/lib/python3.13/site-packages/torch/nn/modules/module.py", line 957, in _apply param_applied = fn(param) File "/root/.pyenv/versions/3.13.11/lib/python3.13/site-packages/torch/nn/modules/module.py", line 1357, in convert return t.to( ~~~~^ device, ^^^^^^^ dtype if t.is_floating_point() or t.is_complex() else None, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ non_blocking, ^^^^^^^^^^^^^ ) ^ torch.OutOfMemoryError: CUDA out of memory. Tried to allocate 214.00 MiB. GPU 0 has a total capacity of 22.30 GiB of which 88.69 MiB is free. Process 3412109 has 22.21 GiB memory in use. Of the allocated memory 21.91 GiB is allocated by PyTorch, and 55.57 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True to avoid fragmentation. See documentation for Memory Management (https://pytorch.org/docs/stable/notes/cuda.html#environment-variables) Download complete: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 35.8G/35.8G [00:37<00:00, 951MB/s]

Container logs:

Fetching error logs...