The error occurred when I executed it.
#1
by
BrianWang1108 - opened
When I run the following command:
python -m mlx_vlm.generate --model mlx-community/InternVL3-38B-bf16 --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image
I encounter the error:
AttributeError: 'Attention' object has no attribute 'embed_dim'
Additionally, I encounter the same issue when trying to load the model in LM Studio.
May I ask how to resolve this problem?
This also happens when I run the InternVL3-38B-4bit.