Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

79

Base only

Active filters: q4_0

xbill9/gemma-4-E4B-it-qat-q4_0-exact-gguf

Text Generation • 7B • Updated 7 days ago • 342 • 2

AlicanKiraz0/Titus-CybersecurityLLM-v1.0-Q4_K_M-No-MTP-GGUF

Text Generation • 35B • Updated Jun 1 • 505 • 39

Joakimpalm-Zen/gemma-4-31B-it-attn48-removed-Q4_0-GGUF

Text Generation • 31B • Updated about 21 hours ago • 244 • 1

0x795E2795/Obsidian-Alpha-26B-A4B-it-qat-q4_0

Text Generation • 25B • Updated 27 days ago • 528 • 1

nitinpanj/Swift-Qwen3.8-Flash-Next-Q4_0-Q8out-v3-GGUF

Text Generation • 177B • Updated 9 days ago • 213 • 1

ikerion/mistral-7b-magyar-q4-gguf

7B • Updated May 29, 2025 • 24

idle-intelligence/stt-1b-en_fr-q4_0-webgpu

1.0B • Updated Mar 4 • 118 • 2

hectorruiz9/HECTRON

Token Classification • 8B • Updated May 29 • 1

Shoozes/lfm2.5-450m-vl-orbit-satellite

0.4B • Updated May 8 • 28

hectorruiz9/Llama-abadalabs-hectron

Token Classification • Updated May 17 • 17

bombdefuser-124/Qwen3.6-35BA3B-MTP-Q4_0-GGUF

36B • Updated May 4 • 33 • 2

phate334/Breeze-ASR-26-GGML

Automatic Speech Recognition • Updated May 24 • 1

felipecmarins/gemma3-4b-algebra4-gguf

Text Generation • 4B • Updated May 25 • 23

ji-farthing/gemma-4-qat-q4_0-MTP-assistants-ik-llama-GGUF

0.4B • Updated Jun 8 • 661 • 6

NeoRoth/gemma-4-e2b-it-qat-q4_0-mlx

Image-Text-to-Text • 5B • Updated Jun 6 • 18

NeoRoth/gemma-4-e4b-it-qat-q4_0-mlx

Image-Text-to-Text • Updated Jun 6 • 68

NeoRoth/gemma-4-26b-a4b-it-qat-q4_0-mlx

Image-Text-to-Text • Updated Jun 6 • 27

NeoRoth/gemma-4-31b-it-qat-q4_0-mlx

Image-Text-to-Text • Updated Jun 6 • 23

prithivMLmods/gemma-4-12B-it-qat-GGUF

Image-Text-to-Text • 12B • Updated Jun 7 • 2.13k • 5

prithivMLmods/gemma-4-E2B-it-qat-GGUF

Image-Text-to-Text • 5B • Updated Jun 7 • 1.8k • 1

prithivMLmods/gemma-4-E4B-it-qat-GGUF

Image-Text-to-Text • 7B • Updated Jun 7 • 1.34k • 2

prithivMLmods/gemma-4-26B-A4B-it-qat-GGUF

Image-Text-to-Text • 25B • Updated Jun 7 • 2.65k • 2

Vegss/Titus-CybersecurityLLM-v1.0-Q4_K_M-No-MTP-GGUF

Text Generation • 35B • Updated Jun 8 • 53

idkwhattoputherenow/gemma-4-31B-it-qat-q4_0-maxerr

31B • Updated Jun 15 • 95 • 1

idkwhattoputherenow/gemma-4-12B-it-qat-q4_0-maxerr

12B • Updated Jun 15 • 120 • 3

idkwhattoputherenow/gemma-4-E2B-it-qat-q4_0-maxerr

5B • Updated Jun 15 • 65 • 1

idkwhattoputherenow/gemma-4-E4B-it-qat-q4_0-maxerr

7B • Updated Jun 15 • 116

hung2903/gemma-4-E4B-vaccine-xai-merged-qat

Text Generation • 7B • Updated Jun 18 • 282 • 1

hung2903/gemma-4-E2B-vaccine-xai-merged-qat

Text Generation • 5B • Updated Jun 18 • 197

darkmaniac7/TokForge-DreamShaper-LCM-GGUF-q4

Text-to-Image • 1B • Updated 2 days ago • 1.8k • 1