Q3_K_M runs great on 16 GB VRAM

#7
by petercunha - opened

The Q3_K_M runs super efficiently on 16 GB of VRAM. Doesn't need to overflow into system RAM at all. Super fast and efficient on my 4090 laptop GPU. Thank you very much sir.

petercunha changed discussion status to closed
petercunha changed discussion status to open
petercunha changed discussion status to closed

Sign up or log in to comment