runtime error
Exit code: 1. Reason: ?B/s][A Fetching 2 files: 0%| | 0/2 [00:00<?, ?it/s][A Downloading (incomplete total...): 0%| | 0.00/1.21G [00:00<?, ?B/s][A Downloading (incomplete total...): 0%| | 0.00/6.17G [00:00<?, ?B/s][A Downloading (incomplete total...): 0%| | 0.00/6.17G [00:01<?, ?B/s][A Downloading (incomplete total...): 0%| | 0.00/6.17G [00:02<?, ?B/s][A Downloading (incomplete total...): 0%| | 0.00/6.17G [00:03<?, ?B/s][A Downloading (incomplete total...): 0%| | 0.00/6.17G [00:04<?, ?B/s][A Downloading (incomplete total...): 0%| | 0.00/6.17G [00:06<?, ?B/s][A Downloading (incomplete total...): 0%| | 0.00/6.17G [00:14<?, ?B/s][A Downloading (incomplete total...): 1%| | 66.9M/6.17G [00:17<04:43, 21.6MB/s][A Fetching 2 files: 50%|█████ | 1/2 [00:18<00:18, 18.62s/it][A Fetching 2 files: 100%|██████████| 2/2 [00:18<00:00, 9.31s/it] Download complete: 100%|██████████| 6.17G/6.17G [00:18<00:00, 21.6MB/s] [ATraceback (most recent call last): File "/app/app.py", line 14, in <module> model = AutoModelForCausalLM.from_pretrained( base_model_id, ...<2 lines>... torch_dtype=torch.float16 ) File "/usr/local/lib/python3.13/site-packages/transformers/models/auto/auto_factory.py", line 394, in from_pretrained return model_class.from_pretrained( ~~~~~~~~~~~~~~~~~~~~~~~~~~~^ pretrained_model_name_or_path, *model_args, config=config, **hub_kwargs, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/local/lib/python3.13/site-packages/transformers/modeling_utils.py", line 4201, in from_pretrained model = cls(config, *model_args, **model_kwargs) TypeError: Qwen2ForCausalLM.__init__() got an unexpected keyword argument 'load_in_4bit' Download complete: 100%|██████████| 6.17G/6.17G [00:18<00:00, 327MB/s]
Container logs:
Fetching error logs...