Training or applying Loras to this model?
#2
by CicadaKing - opened
Hi, the default Lora target modules of q_proj and v_proj don't seem to work with the GGML version of this model. What should these values be set to? Thanks!
Hi, the default Lora target modules of q_proj and v_proj don't seem to work with the GGML version of this model. What should these values be set to? Thanks!