Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32

Base only

Active filters: iq4_nl

vmlinux/Qwen3.8-Flash-Next-Uncensored-Gufo-Q4Mix-GGUF

Image-Text-to-Text • 177B • Updated 8 days ago • 42.5k • 8

kataguru/Qwen3.8-27B-Titan-v3.2-GGUF

Text Generation • 27B • Updated 3 days ago • 1.58k • 2

FadedRedStar/Qwen3.5-2B-heretic-imatrix-GGUF

Image-Text-to-Text • 0.3B • Updated Jul 10 • 503 • 2

Solstice-AI/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-GGUF-UltraOptimised-DSpark-MTP

Image-Text-to-Text • 27B • Updated 29 days ago • 12.5k • 15

ebircak/gemma-4-31B-it-GGUF

Text Generation • 31B • Updated Apr 9 • 146 • 2

jackasda211233/Gemma-4-E4B-Deckard-AttnQ8-IQ4_NL-storyMaker

8B • Updated Apr 29 • 107 • 3

andreribeiro87/telco-troubleshooting-agentic-challenge-gguf

Text Generation • 35B • Updated May 3 • 58

jorge-erdb/GLM-4.7-Flash-D-IQ4NL-GGUF

Text Generation • 30B • Updated May 5 • 42

jackasda211233/Qwen3.6-27B-AEON-RYS-SignalLatch-GGUF

29B • Updated Jun 30 • 523 • 3

Nic22Of2003/Qwen3.5-2B-Uncensored-HauhauCS-Aggressive-IQ4_NL

Text Generation • 2B • Updated May 10 • 1.02k • 3

jairo/Llama-3.1-70B-LatamGPT-SFT-1.0-GGUF

Text Generation • 71B • Updated Jun 7 • 327 • 1

djdeniro/MiniMax-M2.7-MXFP416

Text Generation • 130B • Updated Jun 9 • 68

h4rm0n1c/qwen3.5-24b-a10b-IQ4_NL-GGUF

24B • Updated Jun 19 • 194 • 1

h4rm0n1c/qwen3.5-24b-a3b-reap-0.32-iq4_nl-GGUF

24B • Updated Jun 19 • 44

Deviad/GLM-5.2-mixed-IQ2S-experts-IQ4NL-rest

754B • Updated Jun 21 • 71 • 1

Deviad/GLM-5.2-shortgpt-pruned-IQ2S-experts-IQ4NL-rest

625B • Updated Jun 21 • 34 • 1

FadedRedStar/Anubis-Mini-8B-v1-heretic-imatrix-GGUF

Text Generation • 8B • Updated Jul 10 • 369 • 1

FadedRedStar/LFM2.5-8B-A1B-heretic-imatrix-GGUF

Text Generation • 8B • Updated Jul 10 • 190 • 1

FadedRedStar/Qwen3.5-9B-heretic-imatrix-GGUF

Image-Text-to-Text • 0.5B • Updated Jul 10 • 2.58k • 1

FadedRedStar/Ministral-3-8B-Reasoning-2512-heretic-imatrix-GGUF

Image-Text-to-Text • 8B • Updated Jul 10 • 258 • 2

FadedRedStar/QwenPaw-Flash-9B-heretic-imatrix-GGUF

Image-Text-to-Text • 0.5B • Updated Jul 10 • 444 • 1

jackasda211233/Qwen3.6-27B-AEON-RYS-Agentic-Coder-PatchCode-GGUF

29B • Updated Jul 25 • 390

FadedRedStar/LFM2.5-350M-heretic-imatrix-GGUF

Text Generation • 0.4B • Updated Jul 10 • 104

FadedRedStar/LFM2.5-VL-450M-heretic-imatrix-GGUF

Image-Text-to-Text • 0.4B • Updated Jul 10 • 185

FadedRedStar/LFM2.5-VL-1.6B-heretic-imatrix-GGUF

Image-Text-to-Text • 1B • Updated Jul 10 • 113 • 2

FadedRedStar/Qwen3.5-0.8B-heretic-imatrix-GGUF

Image-Text-to-Text • 0.1B • Updated Jul 10 • 777 • 1

FadedRedStar/Qwen3.5-4B-heretic-imatrix-GGUF

Image-Text-to-Text • 0.3B • Updated Jul 10 • 794 • 1

jackasda211233/Agents-A1-IQ4_NL

Text Generation • 35B • Updated Jul 6 • 60 • 1

Naypa/OpenThai-2.0-Legal-ThaiLLM-Nemotron-3-Nano-30B-A3B-IQ4_NL-GGUF

Text Generation • 32B • Updated Jul 25 • 56 • 1

Koshkasa/Vortex5_Phoenix-X-26B-A4B-IQ4_NL-GGUF

Text Generation • 14.2M • Updated Aug 13 • 92