empero-ai/Qwythos-9B-Claude-Mythos-5-1M | INT4 (W4A16)
#21
by INC4AI - opened
Pipeline Failure Report
Model: empero-ai/Qwythos-9B-Claude-Mythos-5-1M
Quantization Scheme: INT4 (W4A16)
Failed Phase: quantize
Run ID: Qwythos-9B-Claude-Mythos-5-1M-AutoRound-W4A16-Tuning
Error Category: model_data_missing
Full Error Log
12:01:46 [INFO] HTTP Request: HEAD https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/resolve/main/custom_generate/generate.py "HTTP/1.1 404 Not Found"
12:01:47 [INFO] HTTP Request: HEAD https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
12:01:47 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/383e0aed805d1b6cc60d27ff5beec782b46ff110/config.json "HTTP/1.1 200 OK"
12:01:47 [INFO] HTTP Request: HEAD https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/resolve/main/tokenizer_config.json "HTTP/1.1 307 Temporary Redirect"
12:01:47 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/383e0aed805d1b6cc60d27ff5beec782b46ff110/tokenizer_config.json "HTTP/1.1 200 OK"
12:01:47 [INFO] HTTP Request: HEAD https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/resolve/main/tokenizer_config.json "HTTP/1.1 307 Temporary Redirect"
12:01:47 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/383e0aed805d1b6cc60d27ff5beec782b46ff110/tokenizer_config.json "HTTP/1.1 200 OK"
12:01:47 [INFO] HTTP Request: GET https://huggingface.co/api/models/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/tree/main/additional_chat_templates?recursive=false&expand=false "HTTP/1.1 404 Not Found"
12:01:47 [INFO] HTTP Request: GET https://huggingface.co/api/models/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/tree/main?recursive=true&expand=false "HTTP/1.1 200 OK"
12:01:48 [INFO] HTTP Request: GET https://huggingface.co/api/models/empero-ai/Qwythos-9B-Claude-Mythos-5-1M "HTTP/1.1 200 OK"
12:01:49 [INFO] HTTP Request: HEAD https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/resolve/main/processor_config.json "HTTP/1.1 404 Not Found"
12:01:49 [INFO] HTTP Request: HEAD https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/resolve/main/preprocessor_config.json "HTTP/1.1 404 Not Found"
12:01:49 [INFO] HTTP Request: HEAD https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/resolve/main/video_preprocessor_config.json "HTTP/1.1 404 Not Found"
12:01:49 [INFO] HTTP Request: HEAD https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/resolve/main/preprocessor_config.json "HTTP/1.1 404 Not Found"
12:01:49 [INFO] HTTP Request: HEAD https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/resolve/main/tokenizer_config.json "HTTP/1.1 307 Temporary Redirect"
12:01:49 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/383e0aed805d1b6cc60d27ff5beec782b46ff110/tokenizer_config.json "HTTP/1.1 200 OK"
12:01:49 [INFO] HTTP Request: HEAD https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
12:01:49 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/383e0aed805d1b6cc60d27ff5beec782b46ff110/config.json "HTTP/1.1 200 OK"
12:01:49 [INFO] HTTP Request: GET https://huggingface.co/api/models/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/tree/main/additional_chat_templates?recursive=false&expand=false "HTTP/1.1 404 Not Found"
12:01:49 [INFO] HTTP Request: HEAD https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/resolve/main/processor_config.json "HTTP/1.1 404 Not Found"
12:01:49 [INFO] HTTP Request: HEAD https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/resolve/main/chat_template.json "HTTP/1.1 404 Not Found"
12:01:49 [INFO] HTTP Request: HEAD https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/resolve/main/chat_template.jinja "HTTP/1.1 307 Temporary Redirect"
12:01:49 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/383e0aed805d1b6cc60d27ff5beec782b46ff110/chat_template.jinja "HTTP/1.1 200 OK"
12:01:50 [INFO] HTTP Request: HEAD https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/resolve/main/audio_tokenizer_config.json "HTTP/1.1 404 Not Found"
12:01:50 [INFO] HTTP Request: HEAD https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/resolve/main/processor_config.json "HTTP/1.1 404 Not Found"
12:01:50 [INFO] HTTP Request: HEAD https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/resolve/main/preprocessor_config.json "HTTP/1.1 404 Not Found"
12:01:50 [INFO] HTTP Request: HEAD https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/resolve/main/processor_config.json "HTTP/1.1 404 Not Found"
12:01:50 [INFO] HTTP Request: HEAD https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
12:01:50 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/383e0aed805d1b6cc60d27ff5beec782b46ff110/config.json "HTTP/1.1 200 OK"
12:01:50 [ERROR] Quantization failed: Can't load image processor for 'empero-ai/Qwythos-9B-Claude-Mythos-5-1M'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'empero-ai/Qwythos-9B-Claude-Mythos-5-1M' is the correct path to a directory containing a preprocessor_config.json file
Traceback (most recent call last):
File "/root/_work/1/s/auto_quant/phases/quantize.py", line 282, in <module>
quantize(args)
File "/root/_work/1/s/auto_quant/phases/quantize.py", line 178, in quantize
autoround = AutoRound(**ar_kwargs)
^^^^^^^^^^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/auto_round/autoround.py", line 165, in __new__
return AutoRoundCompatible(**local_args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/auto_round/compressors/entry.py", line 594, in __new__
compressor = AutoRound(
^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/auto_round/compressors/entry.py", line 252, in __new__
return _get_compressor_class(model_type, DataDrivenCompressor)(alg_configs, **local_args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/auto_round/compressors/mllm_mixin.py", line 87, in __init__
super().__init__(*args, **kwargs)
File "/root/.venv/lib/python3.12/site-packages/auto_round/compressors/data_driven.py", line 93, in __init__
super().__init__(
File "/root/.venv/lib/python3.12/site-packages/auto_round/compressors/base.py", line 300, in __init__
self.model_context = ModelContext(
^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/auto_round/context/base.py", line 39, in __call__
instance.__init__(*args, **kwargs)
File "/root/.venv/lib/python3.12/site-packages/auto_round/context/base.py", line 27, in wrapped_init
original_init(self, *args, **kwargs)
File "/root/.venv/lib/python3.12/site-packages/auto_round/context/model.py", line 106, in __init__
self._load_model()
File "/root/.venv/lib/python3.12/site-packages/auto_round/context/model.py", line 138, in _load_model
self.model, self.processor, self.tokenizer, self.image_processor = mllm_load_model(
^^^^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/auto_round/utils/model.py", line 757, in mllm_load_model
processor = AutoProcessor.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/transformers/models/auto/processing_auto.py", line 332, in from_pretrained
return PROCESSOR_MAPPING[type(config)].from_pretrained(pretrained_model_name_or_path, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/transformers/processing_utils.py", line 1715, in from_pretrained
args = cls._get_arguments_from_pretrained(pretrained_model_name_or_path, processor_dict, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/transformers/processing_utils.py", line 1844, in _get_arguments_from_pretrained
sub_processor = auto_processor_class.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/transformers/models/auto/image_processing_auto.py", line 580, in from_pretrained
raise initial_exception
File "/root/.venv/lib/python3.12/site-packages/transformers/models/auto/image_processing_auto.py", line 567, in from_pretrained
config_dict, _ = ImageProcessingMixin.get_image_processor_dict(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/transformers/image_processing_base.py", line 334, in get_image_processor_dict
raise OSError(
OSError: Can't load image processor for 'empero-ai/Qwythos-9B-Claude-Mythos-5-1M'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'empero-ai/Qwythos-9B-Claude-Mythos-5-1M' is the correct path to a directory containing a preprocessor_config.json file
Auto-generated by error_analysis pipeline. cc @lvkaokao
lvkaokao changed discussion status to closed