GGUF please?
#1
by
NovNovikov
- opened
Can somebody please make gguf quants? This model would ideally fit in q4 to 24 vram + 128 gb ram.
Can somebody please make gguf quants? This model would ideally fit in q4 to 24 vram + 128 gb ram.