GLM DSA architecture not recognized on TQ1_0

#8
by InfernalDread - opened

Hello,

I am trying to run this quant on the latest llamacpp repo that has the new GLM model pull request, but I still get the error that it is not supported. Is there something wrong with this quant?

This is the error:

llama_model_load: error loading model: error loading model architecture: unknown model architecture: 'glm-dsa'

Thank you.

Alright, after building the project myself, it seemed to have worked out

InfernalDread changed discussion status to closed

Sign up or log in to comment