safetensors_rust.SafetensorError: Error while deserializing header: header too large

#8
by ahwxz123 - opened

to run offical example, pop error
"
Traceback (most recent call last):
File "/data/wxz_dataland/code_space/qwen_test/qwen_3_vl_test.py", line 8, in
model = Qwen3VLForConditionalGeneration.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/wxz/.conda/envs/qwen/lib/python3.12/site-packages/transformers/modeling_utils.py", line 277, in _wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/home/wxz/.conda/envs/qwen/lib/python3.12/site-packages/transformers/modeling_utils.py", line 4965, in from_pretrained
config, dtype, dtype_orig = _get_dtype(
^^^^^^^^^^^
File "/home/wxz/.conda/envs/qwen/lib/python3.12/site-packages/transformers/modeling_utils.py", line 1254, in _get_dtype
state_dict = load_state_dict(
^^^^^^^^^^^^^^^^
File "/home/wxz/.conda/envs/qwen/lib/python3.12/site-packages/transformers/modeling_utils.py", line 484, in load_state_dict
with safe_open(checkpoint_file, framework="pt") as f:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
safetensors_rust.SafetensorError: Error while deserializing header: header too large

"

Sign up or log in to comment