itlwas/Qwen2.5-Coder-0.5B-Q4_K_M-GGUF
Text Generation • 0.5B • Updated
• 13
itlwas
itlwas
AI & ML interests
👋 Here you’ll find GGUF models 🗂️ with Q4_K_M quantization ⚙️, optimized for low-resource devices 💻. These models balance size 📏 and performance 🚀. Notice any issues? Message me on Telegram: @itlwas
Recent Activity
liked
a model about 2 months ago
nvidia/parakeet-tdt-0.6b-v3 liked
a model 3 months ago
zai-org/GLM-4.7 liked
a model 3 months ago
ServiceNow-AI/Apriel-1.6-15b-Thinker Organizations
itlwas/Qwen2.5-Coder-0.5B-Instruct-Q4_K_M-GGUF
Text Generation • 0.5B • Updated
• 23
itlwas/QwQ-32B-Preview-Q4_K_M-GGUF
33B • Updated
• 7
itlwas/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation • 8B • Updated
• 20
itlwas/gemma-2-27b-Q4_K_M-GGUF
Text Generation • 27B • Updated
• 18
itlwas/gemma-2-9b-Q4_K_M-GGUF
Text Generation • 9B • Updated
• 15
itlwas/gemma-2-27b-it-Q4_K_M-GGUF
Text Generation • 27B • Updated
• 2
itlwas/gemma-2-9b-it-Q4_K_M-GGUF
Text Generation • 9B • Updated
• 11
itlwas/codegemma-7b-Q4_K_M-GGUF
9B • Updated
• 16
itlwas/codegemma-2b-Q4_K_M-GGUF
3B • Updated
• 42
itlwas/gemma-2-2b-it-Q4_K_M-GGUF
Text Generation • 3B • Updated
• 7
itlwas/shieldgemma-27b-Q4_K_M-GGUF
Text Generation • 27B • Updated
• 8
itlwas/shieldgemma-9b-Q4_K_M-GGUF
Text Generation • 9B • Updated
• 4
itlwas/shieldgemma-2b-Q4_K_M-GGUF
Text Generation • 3B • Updated
• 11
itlwas/Nous-Hermes-2-SOLAR-10.7B-Q4_K_M-GGUF
11B • Updated
• 61
itlwas/Hermes-2-Pro-Mistral-7B-Q4_K_M-GGUF
7B • Updated
• 22
itlwas/Hermes-2-Pro-Llama-3-8B-Q4_K_M-GGUF
8B • Updated
• 13
itlwas/Nous-Hermes-llama-2-7b-Q4_K_M-GGUF
7B • Updated
• 31
itlwas/ChatWaifu_v2.0_22B-Q4_K_M-GGUF
Text Generation • 22B • Updated
• 93 • 1
itlwas/ChatWaifu_v1.2.1-Q4_K_M-GGUF
Text Generation • 12B • Updated
• 5 • 1
itlwas/ChatWaifu_12B_v2.0-Q4_K_M-GGUF
Text Generation • 12B • Updated
• 14 • 1
itlwas/ChatWaifu_v1.0-Q4_K_M-GGUF
Text Generation • 7B • Updated
• 9 • 1
itlwas/Llama-Guard-3-8B-Q4_K_M-GGUF
Text Generation • 8B • Updated
• 20
itlwas/Llama-Guard-3-1B-Q4_K_M-GGUF
Text Generation • 1B • Updated
• 23
itlwas/Mistral-7B-v0.3-Q4_K_M-GGUF
7B • Updated
• 8
itlwas/Mixtral-8x7B-Instruct-v0.1-Q4_K_M-GGUF
47B • Updated
• 14
itlwas/Mistral-7B-v0.1-Q4_K_M-GGUF
Text Generation • 7B • Updated
• 3
itlwas/Mistral-7B-Instruct-v0.1-Q4_K_M-GGUF
Text Generation • 7B • Updated
• 208 • 4
itlwas/Hermes-3-Llama-3.2-3B-Q4_K_M-GGUF
3B • Updated
• 48 • 1
itlwas/Ministral-8B-Instruct-2410-Q4_K_M-GGUF
8B • Updated
• 8