GGUF?

by akiratoya13 - opened Jan 15, 2025

Hi! Is it possible to have the quantized 4 with gguf version? It seems amazing, but I only have 8GB VRAM.

Thankss!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment