hellork/LongWriter-llama3.1-8b-IQ3_M-GGUF
8B • Updated • 19 • 1
Henry Kroll III
hellork
AI & ML interests
The best models that work for my setup are any of Qwen/Qwen3.6-35B-A3B GGUF with APEX quants.
Consumer-grade (8GB GPU) text generation, image manipulation recognition, 3D model generation, language preservation and translation, and business use cases.
Recent Activity
new activity about 4 hours ago
unsloth/Qwen3.6-27B-MTP-GGUF:IQ3XXS giving garbage output new activity about 7 hours ago
unsloth/Qwen3.6-27B-MTP-GGUF:Official llama.cpp now has '--spec-type draft-mtp' new activity about 22 hours ago
unsloth/Qwen3.6-27B-MTP-GGUF:Low VRAM<=8GB best result (40t/s WITHOUT MTP)Organizations
hellork/Phi-3-mini-4k-geminified-IQ4_NL-GGUF
Text Generation • 4B • Updated • 67
hellork/Starling-LM-7B-beta-IQ4_NL-GGUF
7B • Updated • 18
hellork/fastchat-t5-3b-v1.0-Q8_0-GGUF
3B • Updated • 19
hellork/Configurable-Llama-3.1-8B-Instruct-IQ4_NL-GGUF
8B • Updated • 17
hellork/calme-2.1-qwen2-7b-IQ4_NL-GGUF
Text Generation • 8B • Updated • 25
hellork/deepseek-coder-6.7b-instruct-IQ4_NL-GGUF
7B • Updated • 33