ValueError
#2
by ceoofcapybaras - opened
Expected shape (5120, 640) but received shape (4096, 640) for parameter model.layers.0.self_attn.q_proj.weight
after manually editing hidden state in config.json:
Expected shape (131072, 512) but received shape (131072, 640) for parameter model.embed_tokens.weight
same here : ValueError: Expected shape (5120, 640) but received shape (4096, 640) for parameter model.layers.0.self_attn.q_proj.weight
Please install mlx-lm from source, the PR is not merged yet: