vLLM is not working

#4
by wei01 - opened

(EngineCore_DP0 pid=3160168) ERROR 01-16 14:39:15 [core.py:842] File "/mnt/data/minconda/envs/hunyuan/lib/python3.12/site-packages/vllm/model_executor/models/transformers/multimodal.py", line 68, in get_max_image_tokens
(EngineCore_DP0 pid=3160168) ERROR 01-16 14:39:15 [core.py:842] mm_tokens = processor._get_num_multimodal_tokens(
(EngineCore_DP0 pid=3160168) ERROR 01-16 14:39:15 [core.py:842] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(EngineCore_DP0 pid=3160168) ERROR 01-16 14:39:15 [core.py:842] AttributeError: 'Step3VLProcessor' object has no attribute '_get_num_multimodal_tokens'

Could you please provide the vllm serve command?

Sign up or log in to comment