GGUF Model VRAM Calculator
📈
13
Calculate VRAM requirements for LLM models
LLM
-
-
matchaaaaa/Honey-Yuzu-13B
Text Generation • 12B • Updated • 27 • 7 -
QuantFactory/Mistral-Nemo-Instruct-2407-GGUF
12B • Updated • 53.5k • 50 -
Lewdiculous/MN-12B-Lyra-v4-GGUF-IQ-Imatrix
12B • Updated • 7.22k • 39 -
knifeayumu/Cydonia-v1.3-Magnum-v4-22B-GGUF
22B • Updated • 1.57k • 23 -
bartowski/NemoMix-Unleashed-12B-GGUF
Text Generation • 12B • Updated • 16.6k • 115