GGUF please?

#1
by NovNovikov - opened

Can somebody please make gguf quants? This model would ideally fit in q4 to 24 vram + 128 gb ram.

Sign up or log in to comment