itlwas/Aura-4B-Q4_K_M-GGUF
5B • Updated
• 6
itlwas
itlwas
AI & ML interests
👋 Here you’ll find GGUF models 🗂️ with Q4_K_M quantization ⚙️, optimized for low-resource devices 💻. These models balance size 📏 and performance 🚀. Notice any issues? Message me on Telegram: @itlwas
Recent Activity
liked
a model about 2 months ago
nvidia/parakeet-tdt-0.6b-v3 liked
a model 3 months ago
zai-org/GLM-4.7 liked
a model 3 months ago
ServiceNow-AI/Apriel-1.6-15b-Thinker Organizations
itlwas/Mistral-7B-Instruct-v0.2-Q4_K_M-GGUF
Text Generation • 7B • Updated
• 29
itlwas/Mixtral-8x7B-v0.1-Q4_K_M-GGUF
47B • Updated
• 11
itlwas/Mistral-Small-Instruct-2409-Q4_K_M-GGUF
22B • Updated
• 10
itlwas/Codestral-22B-v0.1-Q4_K_M-GGUF
22B • Updated
• 47
itlwas/Marco-o1-Q4_K_M-GGUF
8B • Updated
• 24
itlwas/granite-3b-code-instruct-128k-Q4_K_M-GGUF
Text Generation • 3B • Updated
• 9
itlwas/granite-3b-code-instruct-2k-Q4_K_M-GGUF
Text Generation • 3B • Updated
• 12
itlwas/granite-3b-code-base-2k-Q4_K_M-GGUF
Text Generation • 3B • Updated
• 12
itlwas/granite-3b-code-base-128k-Q4_K_M-GGUF
Text Generation • 3B • Updated
• 11
itlwas/granite-3.0-1b-a400m-base-Q4_K_M-GGUF
Text Generation • 1B • Updated
• 5
itlwas/granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF
Text Generation • 1B • Updated
• 13
itlwas/granite-3.1-8b-base-Q4_K_M-GGUF
8B • Updated
• 5
itlwas/granite-3.1-8b-instruct-Q4_K_M-GGUF
Text Generation • 8B • Updated
• 44
itlwas/granite-3.1-1b-a400m-base-Q4_K_M-GGUF
Text Generation • 1B • Updated
• 12
itlwas/granite-3.1-1b-a400m-instruct-Q4_K_M-GGUF
Text Generation • 1B • Updated
• 10
itlwas/granite-3.1-3b-a800m-base-Q4_K_M-GGUF
Text Generation • 3B • Updated
• 11
itlwas/granite-3.1-3b-a800m-instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated
• 6
itlwas/granite-3.1-2b-base-Q4_K_M-GGUF
3B • Updated
• 11
itlwas/granite-3.1-2b-instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated
• 10
itlwas/Sailor2-20B-Chat-Q4_K_M-GGUF
19B • Updated
• 9
itlwas/Sailor2-20B-Q4_K_M-GGUF
19B • Updated
• 6
itlwas/Sailor2-8B-Chat-Q4_K_M-GGUF
9B • Updated
• 15
itlwas/Sailor2-8B-Q4_K_M-GGUF
9B • Updated
• 20
itlwas/Sailor2-1B-Chat-Q4_K_M-GGUF
1.0B • Updated
• 33
itlwas/Sailor2-1B-Q4_K_M-GGUF
1.0B • Updated
• 6
itlwas/Sailor-14B-Chat-Q4_K_M-GGUF
14B • Updated
• 8
itlwas/Sailor-14B-Q4_K_M-GGUF
14B • Updated
• 4
itlwas/Sailor-7B-Chat-Q4_K_M-GGUF
8B • Updated
• 14
itlwas/Sailor-7B-Q4_K_M-GGUF
8B • Updated
• 17