runtime error

Exit code: 1. Reason: A model-00002-of-00002.safetensors: 100%|██████████| 2.31G/2.31G [00:07<00:00, 328MB/s] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 50%|█████ | 1/2 [00:15<00:15, 15.86s/it] Loading checkpoint shards: 100%|██████████| 2/2 [00:20<00:00, 9.35s/it] Loading checkpoint shards: 100%|██████████| 2/2 [00:20<00:00, 10.33s/it] generation_config.json: 0%| | 0.00/116 [00:00<?, ?B/s] generation_config.json: 100%|██████████| 116/116 [00:00<00:00, 707kB/s] adapter_config.json: 0%| | 0.00/852 [00:00<?, ?B/s] adapter_config.json: 100%|██████████| 852/852 [00:00<00:00, 5.39MB/s] adapter_model.safetensors: 0%| | 0.00/102M [00:00<?, ?B/s] adapter_model.safetensors: 34%|███▍ | 34.7M/102M [00:01<00:02, 23.2MB/s] adapter_model.safetensors: 100%|██████████| 102M/102M [00:02<00:00, 42.7MB/s]  adapter_model.safetensors: 100%|██████████| 102M/102M [00:02<00:00, 39.3MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 18, in <module> model = PeftModel.from_pretrained( File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 541, in from_pretrained load_result = model.load_adapter( File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 1330, in load_adapter dispatch_model( File "/usr/local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 383, in dispatch_model raise ValueError( ValueError: We need an `offload_dir` to dispatch this model according to this `device_map`, the following submodules need to be offloaded: base_model.model.model.layers.21, base_model.model.model.layers.22, base_model.model.model.layers.23, base_model.model.model.layers.24, base_model.model.model.layers.25, base_model.model.model.norm, base_model.model.model.rotary_emb, base_model.model.lm_head.

Container logs:

Fetching error logs...