runtime error
Exit code: 1. Reason: MB/s] Using `disable_exllama` is deprecated and will be removed in version 4.37. Use `use_exllama` instead and specify the version with `exllama_config`.The value of `use_exllama` will be overwritten by `disable_exllama` passed in `GPTQConfig` or stored in your config file. adapter_config.json: 0%| | 0.00/664 [00:00<?, ?B/s][A adapter_config.json: 100%|██████████| 664/664 [00:00<00:00, 4.79MB/s] config.json: 0%| | 0.00/963 [00:00<?, ?B/s][A config.json: 100%|██████████| 963/963 [00:00<00:00, 7.26MB/s] /usr/local/lib/python3.10/site-packages/transformers/quantizers/auto.py:186: UserWarning: You passed `quantization_config` or equivalent parameters to `from_pretrained` but the model you're loading already has a `quantization_config` attribute. The `quantization_config` from the model will be used.However, loading attributes (e.g. ['use_cuda_fp16', 'use_exllama', 'max_input_length', 'exllama_config', 'disable_exllama']) will be overwritten with the one you passed to `from_pretrained`. The rest will be ignored. warnings.warn(warning_msg) Traceback (most recent call last): File "/home/user/app/app.py", line 11, in <module> model = AutoModelForCausalLM.from_pretrained(model_repo, quantization_config=quantization_config) File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 564, in from_pretrained return model_class.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3664, in from_pretrained hf_quantizer = AutoHfQuantizer.from_config(config.quantization_config, pre_quantized=pre_quantized) File "/usr/local/lib/python3.10/site-packages/transformers/quantizers/auto.py", line 148, in from_config return target_cls(quantization_config, **kwargs) File "/usr/local/lib/python3.10/site-packages/transformers/quantizers/quantizer_gptq.py", line 47, in __init__ from optimum.gptq import GPTQQuantizer ModuleNotFoundError: No module named 'optimum'
Container logs:
Fetching error logs...