GGUFs measured in Abyss on an RTX 5090 (32 GB) with 64-128 GB RAM: GLM-5.3-Flash, DeepSeek V4 / V4.1, Ornith-1.5-397B.
-
zephel01/DeepSeek-V4-Flash-0731-IQ2_XXS-32G64G-GGUF
Text Generation • 284B • Updated • 207 -
zephel01/DeepSeek-V4-Flash-0731-IQ2_M-32G96G-GGUF
Text Generation • 284B • Updated • 214 -
zephel01/GLM-5.3-Flash-IQ2_XS-32G96G-GGUF
Text Generation • 321B • Updated • 778 • 1 -
zephel01/DeepSeek-V4.1-Flash-1017-IQ2_XXS-32G96G-GGUF
Text Generation • 748B • Updated • 654