runtime error
Exit code: 1. Reason: Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads. adapter_config.json: 0%| | 0.00/414 [00:00<?, ?B/s][A adapter_config.json: 100%|██████████| 414/414 [00:00<00:00, 1.60MB/s] config.json: 0%| | 0.00/715 [00:00<?, ?B/s][A config.json: 100%|██████████| 715/715 [00:00<00:00, 3.13MB/s] model.safetensors: 0%| | 0.00/3.44G [00:00<?, ?B/s][A model.safetensors: 0%| | 0.00/3.44G [00:01<?, ?B/s][A model.safetensors: 0%| | 0.00/3.44G [00:02<?, ?B/s][A model.safetensors: 4%|▍ | 134M/3.44G [00:03<00:29, 112MB/s][A model.safetensors: 18%|█▊ | 604M/3.44G [00:04<00:09, 306MB/s][A model.safetensors: 30%|██▉ | 1.02G/3.44G [00:05<00:07, 328MB/s][A model.safetensors: 51%|█████ | 1.74G/3.44G [00:07<00:04, 345MB/s][A model.safetensors: 72%|███████▏ | 2.48G/3.44G [00:09<00:02, 389MB/s][A model.safetensors: 100%|██████████| 3.44G/3.44G [00:13<00:00, 272MB/s][A model.safetensors: 100%|██████████| 3.44G/3.44G [00:13<00:00, 249MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 7, in <module> model = AutoModelForCausalLM.from_pretrained( File "/home/user/.pyenv/versions/3.10.20/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 402, in from_pretrained return model_class.from_pretrained( File "/home/user/.pyenv/versions/3.10.20/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4412, in from_pretrained model = cls(config, *model_args, **model_kwargs) TypeError: BloomForCausalLM.__init__() got an unexpected keyword argument 'load_in_8bit'
Container logs:
Fetching error logs...