Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

26

Base only

Active filters: iq4_nl

FadedRedStar/LFM2.5-8B-A1B-heretic-imatrix-GGUF

Text Generation • 8B • Updated Jul 10 • 425 • 1

FadedRedStar/Qwen3.5-9B-heretic-imatrix-GGUF

Image-Text-to-Text • 0.5B • Updated Jul 10 • 331 • 1

FadedRedStar/QwenPaw-Flash-9B-heretic-imatrix-GGUF

Image-Text-to-Text • 0.5B • Updated Jul 10 • 432 • 1

FadedRedStar/LFM2.5-VL-1.6B-heretic-imatrix-GGUF

Image-Text-to-Text • 1B • Updated Jul 10 • 317 • 1

FadedRedStar/Qwen3.5-0.8B-heretic-imatrix-GGUF

Image-Text-to-Text • 0.1B • Updated Jul 10 • 244 • 1

FadedRedStar/Qwen3.5-4B-heretic-imatrix-GGUF

Image-Text-to-Text • 0.3B • Updated Jul 10 • 366 • 1

ebircak/gemma-4-31B-it-GGUF

Text Generation • 31B • Updated Apr 9 • 333 • 2

jackasda211233/Gemma-4-E4B-Deckard-AttnQ8-IQ4_NL-storyMaker

8B • Updated Apr 29 • 116 • 3

andreribeiro87/telco-troubleshooting-agentic-challenge-gguf

Text Generation • 35B • Updated May 3 • 17

jorge-erdb/GLM-4.7-Flash-D-IQ4NL-GGUF

Text Generation • 30B • Updated May 5 • 10

jackasda211233/Qwen3.6-27B-AEON-RYS-SignalLatch-GGUF

29B • Updated Jun 30 • 570 • 3

Nic22Of2003/Qwen3.5-2B-Uncensored-HauhauCS-Aggressive-IQ4_NL

Text Generation • 2B • Updated May 10 • 708 • 2

jairo/Llama-3.1-70B-LatamGPT-SFT-1.0-GGUF

Text Generation • 71B • Updated Jun 7 • 657 • 1

djdeniro/MiniMax-M2.7-MXFP416

Text Generation • 130B • Updated Jun 9 • 31

h4rm0n1c/qwen3.5-24b-a10b-IQ4_NL-GGUF

24B • Updated Jun 19 • 107

h4rm0n1c/qwen3.5-24b-a3b-reap-0.32-iq4_nl-GGUF

24B • Updated Jun 19 • 40

Deviad/GLM-5.2-mixed-IQ2S-experts-IQ4NL-rest

754B • Updated Jun 21 • 19 • 1

Deviad/GLM-5.2-shortgpt-pruned-IQ2S-experts-IQ4NL-rest

625B • Updated Jun 21 • 35 • 1

FadedRedStar/Anubis-Mini-8B-v1-heretic-imatrix-GGUF

Text Generation • 8B • Updated Jul 10 • 288

FadedRedStar/Ministral-3-8B-Reasoning-2512-heretic-imatrix-GGUF

Image-Text-to-Text • 8B • Updated Jul 10 • 254 • 1

jackasda211233/Qwen3.6-27B-AEON-RYS-Agentic-Coder-PatchCode-GGUF

29B • Updated 18 days ago • 1.29k

FadedRedStar/LFM2.5-350M-heretic-imatrix-GGUF

Text Generation • 0.4B • Updated Jul 10 • 87

FadedRedStar/LFM2.5-VL-450M-heretic-imatrix-GGUF

Image-Text-to-Text • 0.4B • Updated Jul 10 • 219

FadedRedStar/Qwen3.5-2B-heretic-imatrix-GGUF

Image-Text-to-Text • 0.3B • Updated Jul 10 • 575 • 1

jackasda211233/Agents-A1-IQ4_NL

Text Generation • 35B • Updated Jul 6 • 72 • 1

Naypa/OpenThai-2.0-Legal-ThaiLLM-Nemotron-3-Nano-30B-A3B-IQ4_NL-GGUF

Text Generation • 32B • Updated 18 days ago • 306 • 1