Spaces:

---

Intel

/

low_bit_open_llm_leaderboard

like 219

Running

Pipeline Failure Report

Model: groxaxo/Qwen3-14B-8K-Reasoning-v2-interim
Quantization Scheme: INT4 (W4A16)
Failed Phase: quantize
Run ID: Qwen3-14B-8K-Reasoning-v2-interim-AutoRound-W4A16-RTN
Error Category: sharded_checkpoint_cache_incomplete

Full Error Log

01:00:29 [INFO] Iters: 0 (RTN)
01:00:29 [INFO] Export format: auto_round
01:00:29 [INFO] Output: /root/_work/1/s/auto_quant/output/runs/Qwen3-14B-8K-Reasoning-v2-interim-AutoRound-W4A16-RTN/quantized_model
01:00:29 [INFO] Device map: auto
01:00:29 [INFO] Loading tokenizer...
01:00:30 [INFO] HTTP Request: HEAD https://huggingface.co/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
01:00:30 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/5bedfd096acd665c6d49c3d6cbe5065b18cc573d/config.json "HTTP/1.1 200 OK"
01:00:30 [INFO] HTTP Request: HEAD https://huggingface.co/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/resolve/main/tokenizer_config.json "HTTP/1.1 307 Temporary Redirect"
01:00:30 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/5bedfd096acd665c6d49c3d6cbe5065b18cc573d/tokenizer_config.json "HTTP/1.1 200 OK"
01:00:30 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/5bedfd096acd665c6d49c3d6cbe5065b18cc573d/tokenizer_config.json "HTTP/1.1 200 OK"
01:00:30 [INFO] HTTP Request: GET https://huggingface.co/api/models/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/tree/main/additional_chat_templates?recursive=false&expand=false "HTTP/1.1 404 Not Found"
01:00:30 [INFO] HTTP Request: GET https://huggingface.co/api/models/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/tree/main?recursive=true&expand=false "HTTP/1.1 200 OK"
01:00:31 [INFO] HTTP Request: HEAD https://huggingface.co/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/resolve/main/vocab.json "HTTP/1.1 404 Not Found"
01:00:31 [INFO] HTTP Request: HEAD https://huggingface.co/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/resolve/main/merges.txt "HTTP/1.1 404 Not Found"
01:00:31 [INFO] HTTP Request: HEAD https://huggingface.co/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/resolve/main/tokenizer.json "HTTP/1.1 302 Found"
01:00:32 [INFO] HTTP Request: HEAD https://huggingface.co/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/resolve/main/added_tokens.json "HTTP/1.1 404 Not Found"
01:00:33 [INFO] HTTP Request: HEAD https://huggingface.co/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/resolve/main/special_tokens_map.json "HTTP/1.1 404 Not Found"
01:00:33 [INFO] HTTP Request: HEAD https://huggingface.co/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/resolve/main/chat_template.jinja "HTTP/1.1 307 Temporary Redirect"
01:00:33 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/5bedfd096acd665c6d49c3d6cbe5065b18cc573d/chat_template.jinja "HTTP/1.1 200 OK"
01:00:33 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/5bedfd096acd665c6d49c3d6cbe5065b18cc573d/chat_template.jinja "HTTP/1.1 200 OK"
01:00:34 [INFO] HTTP Request: GET https://huggingface.co/api/models/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim "HTTP/1.1 200 OK"
01:00:34 [INFO] Loading model...
01:00:34 [INFO] HTTP Request: HEAD https://huggingface.co/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
01:00:34 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/5bedfd096acd665c6d49c3d6cbe5065b18cc573d/config.json "HTTP/1.1 200 OK"
01:00:34 [INFO] HTTP Request: HEAD https://huggingface.co/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/resolve/main/model.safetensors "HTTP/1.1 404 Not Found"
01:00:34 [INFO] HTTP Request: HEAD https://huggingface.co/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/resolve/main/model.safetensors.index.json "HTTP/1.1 307 Temporary Redirect"
01:00:34 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/5bedfd096acd665c6d49c3d6cbe5065b18cc573d/model.safetensors.index.json "HTTP/1.1 200 OK"
01:00:35 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/5bedfd096acd665c6d49c3d6cbe5065b18cc573d/model.safetensors.index.json "HTTP/1.1 200 OK"
01:00:35 [INFO] HTTP Request: GET https://huggingface.co/api/models/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/revision/main "HTTP/1.1 200 OK"
01:00:35 [ERROR] Quantization failed: groxaxo/Qwen3-14B-8K-Reasoning-v2-interim does not appear to have files named ('model-00001-of-00006.safetensors', 'model-00002-of-00006.safetensors', 'model-00003-of-00006.safetensors', 'model-00004-of-00006.safetensors', 'model-00005-of-00006.safetensors', 'model-00006-of-00006.safetensors'). Checkout 'https://huggingface.co/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/tree/main' for available files.
Traceback (most recent call last):
  File "/root/_work/1/s/auto_quant/phases/quantize.py", line 282, in <module>
    quantize(args)
  File "/root/_work/1/s/auto_quant/phases/quantize.py", line 137, in quantize
    model = AutoModelForCausalLM.from_pretrained(
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/.venv/lib/python3.12/site-packages/auto_round/utils/common.py", line 140, in patched
    return underlying_func(klass, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/.venv/lib/python3.12/site-packages/transformers/models/auto/auto_factory.py", line 406, in from_pretrained
    return model_class.from_pretrained(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/.venv/lib/python3.12/site-packages/transformers/modeling_utils.py", line 4229, in from_pretrained
    checkpoint_files, sharded_metadata = _get_resolved_checkpoint_files(
                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/.venv/lib/python3.12/site-packages/transformers/modeling_utils.py", line 797, in _get_resolved_checkpoint_files
    checkpoint_files, sharded_metadata = get_checkpoint_shard_files(
                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/.venv/lib/python3.12/site-packages/transformers/utils/hub.py", line 894, in get_checkpoint_shard_files
    cached_filenames = cached_files(
                       ^^^^^^^^^^^^^
  File "/root/.venv/lib/python3.12/site-packages/transformers/utils/hub.py", line 543, in cached_files
    raise OSError(
OSError: groxaxo/Qwen3-14B-8K-Reasoning-v2-interim does not appear to have files named ('model-00001-of-00006.safetensors', 'model-00002-of-00006.safetensors', 'model-00003-of-00006.safetensors', 'model-00004-of-00006.safetensors', 'model-00005-of-00006.safetensors', 'model-00006-of-00006.safetensors'). Checkout 'https://huggingface.co/groxaxo/Qwen3-14B-8K-Reasoning-v2-interim/tree/main' for available files.

Auto-generated by error_analysis pipeline. cc @lvkaokao