itlwas/Mistral-7B-Instruct-v0.3-Q4_K_M-GGUF
7B • Updated
• 27
itlwas
itlwas
AI & ML interests
👋 Here you’ll find GGUF models 🗂️ with Q4_K_M quantization ⚙️, optimized for low-resource devices 💻. These models balance size 📏 and performance 🚀. Notice any issues? Message me on Telegram: @itlwas
Recent Activity
liked
a model about 2 months ago
nvidia/parakeet-tdt-0.6b-v3 liked
a model 3 months ago
zai-org/GLM-4.7 liked
a model 3 months ago
ServiceNow-AI/Apriel-1.6-15b-Thinker Organizations
itlwas/ghost-8b-beta-1608-Q4_K_M-GGUF
Text Generation • 8B • Updated
• 2
itlwas/ChatWaifu_v1.4-Q4_K_M-GGUF
Text Generation • 12B • Updated
• 79 • 3
itlwas/Maral-Q4_K_M-GGUF
Text Generation • 8B • Updated
• 1
itlwas/Lusca-33B-Q4_K_M-GGUF
33B • Updated
itlwas/LDAI-1.5-ANIU-Q4_K_M-GGUF
2B • Updated
itlwas/T-lite-0.1-Q4_K_M-GGUF
8B • Updated
• 1
itlwas/mini-magnum-12b-v1.1-Q4_K_M-GGUF
12B • Updated
• 16
itlwas/Azure_Dusk-v0.1-Q4_K_M-GGUF
Text Generation • 12B • Updated
• 1
itlwas/ChatWaifu_v1.3.1-Q4_K_M-GGUF
Text Generation • 12B • Updated
• 18 • 2
itlwas/MMed-Llama-3-8B-EnIns-Q4_K_M-GGUF
8B • Updated
• 10
itlwas/Crimson_Dawn-v0.2-Q4_K_M-GGUF
Text Generation • 12B • Updated
• 3
itlwas/OmniLing-V1-8b-experimental-Q4_K_M-GGUF
Text Generation • 8B • Updated
itlwas/OmniLing-V1-12b-experimental-Q4_K_M-GGUF
Text Generation • 12B • Updated
• 1
itlwas/magnum-v2-12b-Q4_K_M-GGUF
Text Generation • 12B • Updated
• 45
itlwas/kurage-ru-Q4_K_M-GGUF
Text Generation • 8B • Updated
• 1
itlwas/Violet_Twilight-v0.2-Q4_K_M-GGUF
Text Generation • 12B • Updated
• 7 • 1
itlwas/SmolLM2-360M-Instruct-FT-Q4_K_M-GGUF
Text Generation • 0.4B • Updated
• 20
itlwas/Mistral-Nemo-Instruct-2407-Q4_K_M-GGUF
12B • Updated
• 19 • 1
itlwas/Mistral-Nemo-Base-2407-Q4_K_M-GGUF
12B • Updated
• 14
itlwas/poemma-12B-Q4_K_M-GGUF
12B • Updated
• 16
itlwas/Devple-8B-Q4_K_M-GGUF
Text Generation • 8B • Updated
• 2 • 1
itlwas/llama-600M-rus-Q4_K_M-GGUF
0.5B • Updated
• 8 • 1
itlwas/AbominationScience-12B-v4-Q4_K_M-GGUF
12B • Updated
• 1 • 1
itlwas/CursedMatrix-8B-v9-Q4_K_M-GGUF
8B • Updated
• 2 • 1
itlwas/Llama-3.2-Kapusta-JapanChibi-3B-v1-Q4_K_M-GGUF
4B • Updated
• 12 • 1
itlwas/Llama-3.2-Kapusta-3B-v8-Q4_K_M-GGUF
4B • Updated
• 18 • 1
itlwas/DarkAtom-12B-v3-Q4_K_M-GGUF
12B • Updated
• 1 • 1
itlwas/Kosmos-8B-v1-Q4_K_M-GGUF
8B • Updated
• 1 • 1
itlwas/Vikhr-tiny-0.1-Q4_K_M-GGUF
3B • Updated
• 10