Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,592

Base only

Active filters: quantized

phaseonx11/GLM-5.2-Uncensored-GGUF

Text Generation • 753B • Updated 3 days ago • 1.64k • 12

mudler/Ornith-1.0-35B-APEX-GGUF

35B • Updated 10 days ago • 19.9k • 16

CodeFault/Nvidia-Qwen3.6-27B-NVFP4-GGUF

Text Generation • 27B • Updated about 17 hours ago • 16.3k • 15

nvidia/Gemma-4-31B-IT-NVFP4

Text Generation • 21B • Updated May 8 • 2.02M • 530

nvidia/DeepSeek-V4-Flash-NVFP4

Text Generation • 167B • Updated 26 days ago • 693k • 65

Alittlehammmer/Qwen3.6-27B-DFlash-GGUF-llama.cpp

Text Generation • 2B • Updated 11 days ago • 7.46k • 7

InternScience/Agents-A1-FP8

Text Generation • 35B • Updated 8 days ago • 13.2k • 14

Jundot/Qwen3.6-35B-A3B-oQ4e-mtp

6B • Updated 1 day ago • 663 • 7

mudler/Qwen-AgentWorld-35B-A3B-APEX-GGUF

35B • Updated 8 days ago • 24.8k • 10

AtomicChat/Laguna-XS-2.1-GGUF

Text Generation • 33B • Updated 8 days ago • 7.73k • 10

mlx-community/Qwen3.5-9B-MLX-4bit

Image-Text-to-Text • 2B • Updated Mar 23 • 21k • 143

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated 21 days ago • 12.5k • 76

Granddyser/flux-klein-9b-Biglove-Collection

Text-to-Image • 9B • Updated 7 days ago • 19.5k • 33

nvidia/Gemma-4-26B-A4B-NVFP4

Text Generation • 14B • Updated May 11 • 1.82M • 114

mlx-community/Ornith-1.0-35B-6bit

Image-Text-to-Text • 8B • Updated 13 days ago • 2.62k • 6

wang-yang/Agents-A1-MTPLX-Q4

Text Generation • 35B • Updated 6 days ago • 1.66k • 7

utautako/Qwen3.6-27B-NVIDIA-NVFP4-MTP-GGUF

Image-Text-to-Text • 0.5B • Updated 8 days ago • 13.4k • 9

kai-os/Grug-12B-GGUF

Text Generation • 12B • Updated 9 days ago • 3.17k • 10

empero-ai/Qwythos-9B-v2-GGUF

Image-Text-to-Text • 9B • Updated about 7 hours ago • 5

unsloth/Qwen-Image-Edit-2511-GGUF

Image-to-Image • 20B • Updated Jan 8 • 238k • 528

mudler/Qwen3.6-35B-A3B-APEX-GGUF

35B • Updated Apr 27 • 49.6k • 183

mlx-community/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated 21 days ago • 13.3k • 60

OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destilled-abliterated-NVFP4

Image-Text-to-Text • 74B • Updated 24 days ago • 8.43k • 10

LordNeel/Agents-A1-GGUF

Text Generation • 35B • Updated 10 days ago • 35k • 11

nvidia/Mistral-Medium-3.5-128B-NVFP4

Text Generation • 84B • Updated 9 days ago • 16.6k • 22

SEBK4C/Ornith-1.0-397B-Featherweight

Text Generation • 396B • Updated 4 days ago • 1.35k • 4

jarrelscy/GLM-5.2-NVFP4-AQLM-hybrid

Text Generation • 208B • Updated about 12 hours ago • 1.04k • 4

olka-fi/Hy3-MXFP4

Text Generation • 163B • Updated 4 days ago • 2.26k • 4

mudler/Qwen3.5-122B-A10B-APEX-GGUF

122B • Updated Apr 27 • 2.02k • 26

mudler/LFM2-24B-A2B-APEX-GGUF

24B • Updated Apr 27 • 710 • 7