runtime error
Exit code: 1. Reason: nizer_config.json: 0%| | 0.00/694 [00:00<?, ?B/s][A tokenizer_config.json: 100%|██████████| 694/694 [00:00<00:00, 3.35MB/s] tokenizer.json: 0%| | 0.00/11.4M [00:00<?, ?B/s][A tokenizer.json: 100%|██████████| 11.4M/11.4M [00:00<00:00, 15.8MB/s] chat_template.jinja: 0%| | 0.00/2.56k [00:00<?, ?B/s][A chat_template.jinja: 100%|██████████| 2.56k/2.56k [00:00<00:00, 13.9MB/s] Traceback (most recent call last): File "/app/app.py", line 18, in <module> model = AutoModelForCausalLM.from_pretrained( model_name, ...<3 lines>... dtype=torch.float32 ) File "/usr/local/lib/python3.13/site-packages/transformers/models/auto/auto_factory.py", line 374, in from_pretrained return model_class.from_pretrained( ~~~~~~~~~~~~~~~~~~~~~~~~~~~^ pretrained_model_name_or_path, *model_args, config=config, **hub_kwargs, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/local/lib/python3.13/site-packages/transformers/modeling_utils.py", line 4037, in from_pretrained hf_quantizer, config, device_map = get_hf_quantizer( ~~~~~~~~~~~~~~~~^ config, quantization_config, device_map, weights_only, user_agent ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/local/lib/python3.13/site-packages/transformers/quantizers/auto.py", line 320, in get_hf_quantizer if pre_quantized and not AutoHfQuantizer.supports_quant_method(config.quantization_config): ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.13/site-packages/transformers/quantizers/auto.py", line 267, in supports_quant_method quant_method = quantization_config_dict.get("quant_method", None) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get'
Container logs:
Fetching error logs...