ValueError: Trying to set a tensor of shape torch.Size([131072, 1280]) in "weight" (which has shape torch.Size([131072, 5120]))
#2
by
treehugg3
- opened
I can't seem to run this using the inference examples found in https://huggingface.co/mistral-community/pixtral-12b, due to this error:
ValueError: Trying to set a tensor of shape torch.Size([131072, 1280]) in "weight" (which has shape torch.Size([131072, 5120])), this looks incorrect.