itlwas/Sailor-4B-Chat-Q4_K_M-GGUF
4B • Updated
• 13
itlwas
itlwas
AI & ML interests
👋 Here you’ll find GGUF models 🗂️ with Q4_K_M quantization ⚙️, optimized for low-resource devices 💻. These models balance size 📏 and performance 🚀. Notice any issues? Message me on Telegram: @itlwas
Recent Activity
liked
a model about 2 months ago
nvidia/parakeet-tdt-0.6b-v3 liked
a model 3 months ago
zai-org/GLM-4.7 liked
a model 3 months ago
ServiceNow-AI/Apriel-1.6-15b-Thinker Organizations
itlwas/Sailor-4B-Q4_K_M-GGUF
4B • Updated
• 7
itlwas/Sailor-1.8B-Chat-Q4_K_M-GGUF
2B • Updated
• 15
itlwas/Sailor-1.8B-Q4_K_M-GGUF
2B • Updated
• 6
itlwas/Sailor-0.5B-Chat-Q4_K_M-GGUF
0.6B • Updated
• 8
itlwas/Sailor-0.5B-Q4_K_M-GGUF
0.6B • Updated
• 8
itlwas/aya-23-35B-Q4_K_M-GGUF
35B • Updated
• 6
itlwas/aya-23-8B-Q4_K_M-GGUF
8B • Updated
• 72
itlwas/Redmond-Hermes-Coder-Q4_K_M-GGUF
16B • Updated
• 7
itlwas/Nous-Hermes-Llama2-13b-Q4_K_M-GGUF
13B • Updated
• 40 • 1
itlwas/Nous-Hermes-2-Yi-34B-Q4_K_M-GGUF
34B • Updated
• 73
itlwas/Yi-1.5-34B-Chat-Q4_K_M-GGUF
34B • Updated
• 19 • 1
itlwas/Yi-1.5-34B-Q4_K_M-GGUF
34B • Updated
• 9
itlwas/Yi-1.5-9B-Chat-Q4_K_M-GGUF
9B • Updated
• 11
itlwas/Yi-1.5-9B-Q4_K_M-GGUF
9B • Updated
• 12
itlwas/Yi-1.5-6B-Chat-Q4_K_M-GGUF
6B • Updated
• 29
itlwas/Yi-1.5-6B-Q4_K_M-GGUF
6B • Updated
• 7
itlwas/Yi-Coder-9B-Chat-Q4_K_M-GGUF
Text Generation • 9B • Updated
• 20
itlwas/Yi-Coder-9B-Q4_K_M-GGUF
Text Generation • 9B • Updated
• 6
itlwas/Yi-Coder-1.5B-Chat-Q4_K_M-GGUF
1B • Updated
• 6
itlwas/Yi-Coder-1.5B-Q4_K_M-GGUF
1B • Updated
• 11
itlwas/Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF
Text Generation • 33B • Updated
• 10
itlwas/Qwen2.5-Coder-32B-Q4_K_M-GGUF
Text Generation • 33B • Updated
• 85
itlwas/Qwen2.5-Coder-14B-Instruct-Q4_K_M-GGUF
Text Generation • 15B • Updated
• 148 • 1
itlwas/Qwen2.5-Coder-14B-Q4_K_M-GGUF
Text Generation • 15B • Updated
• 68
itlwas/Qwen2.5-Coder-7B-Q4_K_M-GGUF
Text Generation • 8B • Updated
• 6.26k • 3
itlwas/Qwen2.5-Coder-3B-Q4_K_M-GGUF
Text Generation • 3B • Updated
• 26
itlwas/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated
• 18
itlwas/Qwen2.5-Coder-1.5B-Q4_K_M-GGUF
Text Generation • 2B • Updated
• 40
itlwas/Qwen2.5-Coder-1.5B-Instruct-Q4_K_M-GGUF
Text Generation • 2B • Updated
• 16