Can somebody please make gguf quants? This model would ideally fit in q4 to 24 vram + 128 gb ram.
· Sign up or log in to comment