Cannot load Q4_K_M

#1
by pa0los - opened

Using quite recent llama build, I cannot load the Q4_K_M gguf:
lama_model_load: error loading model: check_tensor_dims: tensor 'blk.0.exp_probs_b.bias' has wrong shape; expected 180, got 256,

Anyone has such issue?

Sign up or log in to comment