Spaces:

---

Intel

/

low_bit_open_llm_leaderboard

like 219

Running

Pipeline Failure Report

Model: PaddlePaddle/PaddleOCR-VL-1.6
Quantization Scheme: INT4 (W4A16)
Failed Phase: quantize
Run ID: PaddleOCR-VL-1.6-AutoRound-W4A16-Tuning
Error Category: missing_dependency

Full Error Log

[transformers] Model config: vision_start_token_id must be `None` or an integer within the vocabulary (between 0 and 31999), got 101306. This may result in unexpected behavior.
07:11:01 [INFO] HTTP Request: HEAD https://huggingface.co/PaddlePaddle/PaddleOCR-VL-1.6/resolve/main/tokenizer_config.json "HTTP/1.1 307 Temporary Redirect"
07:11:01 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/PaddlePaddle/PaddleOCR-VL-1.6/66317acc4c9fc17bd154591ce650735cd2855f3e/tokenizer_config.json "HTTP/1.1 200 OK"
07:11:01 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/PaddlePaddle/PaddleOCR-VL-1.6/66317acc4c9fc17bd154591ce650735cd2855f3e/tokenizer_config.json "HTTP/1.1 200 OK"
07:11:02 [INFO] HTTP Request: GET https://huggingface.co/api/models/PaddlePaddle/PaddleOCR-VL-1.6/tree/main/additional_chat_templates?recursive=false&expand=false "HTTP/1.1 404 Not Found"
07:11:02 [INFO] HTTP Request: GET https://huggingface.co/api/models/PaddlePaddle/PaddleOCR-VL-1.6/tree/main?recursive=true&expand=false "HTTP/1.1 200 OK"
07:11:02 [INFO] HTTP Request: HEAD https://huggingface.co/PaddlePaddle/PaddleOCR-VL-1.6/resolve/main/tokenizer.model "HTTP/1.1 302 Found"
07:11:03 [INFO] HTTP Request: HEAD https://huggingface.co/PaddlePaddle/PaddleOCR-VL-1.6/resolve/main/tokenizer.json "HTTP/1.1 302 Found"
07:11:04 [INFO] HTTP Request: HEAD https://huggingface.co/PaddlePaddle/PaddleOCR-VL-1.6/resolve/main/added_tokens.json "HTTP/1.1 307 Temporary Redirect"
07:11:05 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/PaddlePaddle/PaddleOCR-VL-1.6/66317acc4c9fc17bd154591ce650735cd2855f3e/added_tokens.json "HTTP/1.1 200 OK"
07:11:05 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/PaddlePaddle/PaddleOCR-VL-1.6/66317acc4c9fc17bd154591ce650735cd2855f3e/added_tokens.json "HTTP/1.1 200 OK"
07:11:05 [INFO] HTTP Request: HEAD https://huggingface.co/PaddlePaddle/PaddleOCR-VL-1.6/resolve/main/special_tokens_map.json "HTTP/1.1 307 Temporary Redirect"
07:11:05 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/PaddlePaddle/PaddleOCR-VL-1.6/66317acc4c9fc17bd154591ce650735cd2855f3e/special_tokens_map.json "HTTP/1.1 200 OK"
07:11:05 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/PaddlePaddle/PaddleOCR-VL-1.6/66317acc4c9fc17bd154591ce650735cd2855f3e/special_tokens_map.json "HTTP/1.1 200 OK"
07:11:06 [INFO] HTTP Request: HEAD https://huggingface.co/PaddlePaddle/PaddleOCR-VL-1.6/resolve/main/chat_template.jinja "HTTP/1.1 307 Temporary Redirect"
07:11:06 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/PaddlePaddle/PaddleOCR-VL-1.6/66317acc4c9fc17bd154591ce650735cd2855f3e/chat_template.jinja "HTTP/1.1 200 OK"
07:11:06 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/PaddlePaddle/PaddleOCR-VL-1.6/66317acc4c9fc17bd154591ce650735cd2855f3e/chat_template.jinja "HTTP/1.1 200 OK"
07:11:07 [INFO] HTTP Request: GET https://huggingface.co/api/models/PaddlePaddle/PaddleOCR-VL-1.6 "HTTP/1.1 200 OK"
07:11:07 [INFO] Loading model...
07:11:07 [INFO] HTTP Request: HEAD https://huggingface.co/PaddlePaddle/PaddleOCR-VL-1.6/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
07:11:07 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/PaddlePaddle/PaddleOCR-VL-1.6/66317acc4c9fc17bd154591ce650735cd2855f3e/config.json "HTTP/1.1 200 OK"
07:11:07 [INFO] HTTP Request: HEAD https://huggingface.co/PaddlePaddle/PaddleOCR-VL-1.6/resolve/main/configuration_paddleocr_vl.py "HTTP/1.1 307 Temporary Redirect"
07:11:07 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/PaddlePaddle/PaddleOCR-VL-1.6/66317acc4c9fc17bd154591ce650735cd2855f3e/configuration_paddleocr_vl.py "HTTP/1.1 200 OK"
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'mrope_section'}
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'mrope_section'}
07:11:07 [INFO] HTTP Request: HEAD https://huggingface.co/PaddlePaddle/PaddleOCR-VL-1.6/resolve/main/modeling_paddleocr_vl.py "HTTP/1.1 307 Temporary Redirect"
07:11:07 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/PaddlePaddle/PaddleOCR-VL-1.6/66317acc4c9fc17bd154591ce650735cd2855f3e/modeling_paddleocr_vl.py "HTTP/1.1 200 OK"
07:11:07 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/PaddlePaddle/PaddleOCR-VL-1.6/66317acc4c9fc17bd154591ce650735cd2855f3e/modeling_paddleocr_vl.py "HTTP/1.1 200 OK"
[transformers] Encountered exception while importing einops: No module named 'einops'
07:11:07 [ERROR] Quantization failed: This modeling file requires the following packages that were not found in your environment: einops. Run `pip install einops`
Traceback (most recent call last):
  File "/root/_work/1/s/auto_quant/phases/quantize.py", line 282, in <module>
    quantize(args)
  File "/root/_work/1/s/auto_quant/phases/quantize.py", line 137, in quantize
    model = AutoModelForCausalLM.from_pretrained(
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/.venv/lib/python3.12/site-packages/auto_round/utils/common.py", line 140, in patched
    return underlying_func(klass, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/.venv/lib/python3.12/site-packages/transformers/models/auto/auto_factory.py", line 380, in from_pretrained
    model_class = get_class_from_dynamic_module(
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/.venv/lib/python3.12/site-packages/transformers/dynamic_module_utils.py", line 612, in get_class_from_dynamic_module
    final_module = get_cached_module_file(
                   ^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/.venv/lib/python3.12/site-packages/transformers/dynamic_module_utils.py", line 441, in get_cached_module_file
    modules_needed = check_imports(resolved_module_file)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/.venv/lib/python3.12/site-packages/transformers/dynamic_module_utils.py", line 258, in check_imports
    raise ImportError(
ImportError: This modeling file requires the following packages that were not found in your environment: einops. Run `pip install einops`

Auto-generated by error_analysis pipeline. cc @lvkaokao