Spaces:

---

Intel

/

low_bit_open_llm_leaderboard

like 222

Running

Pipeline Failure Report

Model: tencent/HiLS-Attention-7B
Quantization Scheme: INT4 (W4A16)
Failed Phase: quantize
Run ID: HiLS-Attention-7B-AutoRound-W4A16-RTN
Error Category: unsupported_model_architecture

Full Error Log

07:41:15 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/tencent/HiLS-Attention-7B/837293e2aa5ae551439ebbd05783bddb92401853/vocab.json "HTTP/1.1 200 OK"
07:41:15 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/tencent/HiLS-Attention-7B/837293e2aa5ae551439ebbd05783bddb92401853/vocab.json "HTTP/1.1 200 OK"
07:41:16 [INFO] HTTP Request: HEAD https://huggingface.co/tencent/HiLS-Attention-7B/resolve/main/merges.txt "HTTP/1.1 307 Temporary Redirect"
07:41:16 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/tencent/HiLS-Attention-7B/837293e2aa5ae551439ebbd05783bddb92401853/merges.txt "HTTP/1.1 200 OK"
07:41:16 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/tencent/HiLS-Attention-7B/837293e2aa5ae551439ebbd05783bddb92401853/merges.txt "HTTP/1.1 200 OK"
07:41:16 [INFO] HTTP Request: HEAD https://huggingface.co/tencent/HiLS-Attention-7B/resolve/main/added_tokens.json "HTTP/1.1 404 Not Found"
07:41:16 [INFO] HTTP Request: HEAD https://huggingface.co/tencent/HiLS-Attention-7B/resolve/main/special_tokens_map.json "HTTP/1.1 307 Temporary Redirect"
07:41:16 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/tencent/HiLS-Attention-7B/837293e2aa5ae551439ebbd05783bddb92401853/special_tokens_map.json "HTTP/1.1 200 OK"
07:41:16 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/tencent/HiLS-Attention-7B/837293e2aa5ae551439ebbd05783bddb92401853/special_tokens_map.json "HTTP/1.1 200 OK"
07:41:16 [INFO] HTTP Request: HEAD https://huggingface.co/tencent/HiLS-Attention-7B/resolve/main/tokenizer.json "HTTP/1.1 307 Temporary Redirect"
07:41:16 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/tencent/HiLS-Attention-7B/837293e2aa5ae551439ebbd05783bddb92401853/tokenizer.json "HTTP/1.1 200 OK"
07:41:16 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/tencent/HiLS-Attention-7B/837293e2aa5ae551439ebbd05783bddb92401853/tokenizer.json "HTTP/1.1 200 OK"
07:41:17 [INFO] HTTP Request: HEAD https://huggingface.co/tencent/HiLS-Attention-7B/resolve/main/chat_template.jinja "HTTP/1.1 404 Not Found"
07:41:17 [INFO] HTTP Request: GET https://huggingface.co/api/models/tencent/HiLS-Attention-7B "HTTP/1.1 200 OK"
07:41:17 [INFO] Loading model...
07:41:17 [INFO] HTTP Request: HEAD https://huggingface.co/tencent/HiLS-Attention-7B/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
07:41:17 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/tencent/HiLS-Attention-7B/837293e2aa5ae551439ebbd05783bddb92401853/config.json "HTTP/1.1 200 OK"
07:41:17 [ERROR] Quantization failed: The checkpoint you are trying to load has model type `olmo_hils` but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.

You can update Transformers with the command `pip install --upgrade transformers`. If this does not work, and the checkpoint is very new, then there may not be a release version that supports this model yet. In this case, you can get the most up-to-date code by installing Transformers from source with the command `pip install git+https://github.com/huggingface/transformers.git`
Traceback (most recent call last):
  File "/root/.venv/lib/python3.12/site-packages/transformers/models/auto/configuration_auto.py", line 407, in from_pretrained
    config_class = CONFIG_MAPPING[config_dict["model_type"]]
                   ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/.venv/lib/python3.12/site-packages/transformers/models/auto/configuration_auto.py", line 107, in __getitem__
    raise KeyError(key)
KeyError: 'olmo_hils'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/root/_work/1/s/auto_quant/phases/quantize.py", line 479, in <module>
    quantize(args)
  File "/root/_work/1/s/auto_quant/phases/quantize.py", line 293, in quantize
    model = AutoModelForCausalLM.from_pretrained(
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/.venv/lib/python3.12/site-packages/auto_round/utils/common.py", line 140, in patched
    return underlying_func(klass, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/.venv/lib/python3.12/site-packages/transformers/models/auto/auto_factory.py", line 336, in from_pretrained
    config, kwargs = AutoConfig.from_pretrained(
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/.venv/lib/python3.12/site-packages/transformers/models/auto/configuration_auto.py", line 409, in from_pretrained
    raise ValueError(
ValueError: The checkpoint you are trying to load has model type `olmo_hils` but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.

You can update Transformers with the command `pip install --upgrade transformers`. If this does not work, and the checkpoint is very new, then there may not be a release version that supports this model yet. In this case, you can get the most up-to-date code by installing Transformers from source with the command `pip install git+https://github.com/huggingface/transformers.git`

Auto-generated by error_analysis pipeline. cc @lvkaokao