Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

15,951

Base only

Active filters: quantized

Jundot/Qwen3.6-35B-A3B-oQ6-mtp

8B • Updated May 12 • 555 • 6

nvidia/Wan2.2-T2V-A14B-Diffusers-NVFP4

Text-to-Video • Updated 1 day ago • 11

nvidia/DeepSeek-V4-Pro-NVFP4

Text Generation • 910B • Updated Jun 14 • 149k • 77

mudler/Qwen3.6-35B-A3B-APEX-MTP-GGUF

36B • Updated 16 days ago • 28.1k • 71

mudler/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-APEX-MTP-GGUF

36B • Updated 16 days ago • 19.2k • 70

mudler/Qwopus3.6-35B-A3B-v1-APEX-MTP-GGUF

36B • Updated 16 days ago • 5.38k • 22

ilukashin/Qwen3-Coder-30B-A3B-Instruct-oQ4-fp16

5B • Updated May 20 • 154 • 1

bahadirakdemir/Z-Image-Turbo-tensorrt-onnx-fp8

Text-to-Image • Updated May 26 • 160 • 2

MLXCreator/Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated-hermes-oQ4-fp16-mtp

6B • Updated May 27 • 1.23k • 6

mudler/LFM2.5-8B-A1B-APEX-GGUF

8B • Updated Jun 30 • 4.87k • 31

blockblockblock/Huihui-Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated-exl3-5.0bpw

Text Generation • 12B • Updated 22 days ago • 163 • 1

solphor/Flux2-Dev-INT8-W8A8-Convrot-Model

Text-to-Image • Updated Jun 5 • 9 • 2

BricksDisplay/chatterbox-multilingual-ONNX-q4

Text-to-Speech • Updated May 31 • 65 • 2

JetBrains/Mellum2-12B-A2.5B-Thinking-GGUF-Q4_K_M

Text Generation • 12B • Updated Jun 4 • 3.95k • 43

ggml-org/gemma-4-12B-it-GGUF

Any-to-Any • 12B • Updated 10 days ago • 47k • 85

DuoNeural/Gemma4-12B-IT-Abliterated-GGUF

Text Generation • 12B • Updated Jun 6 • 10.9k • 22

JetBrains/Mellum2-12B-A2.5B-Instruct-GGUF-Q4_K_M

Text Generation • 12B • Updated Jun 4 • 97.4k • 14

JetBrains/Mellum2-12B-A2.5B-Instruct-GGUF-MXFP4_MOE

Text Generation • 12B • Updated Jun 4 • 406 • 10

RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-quantized.w4a16

Text Generation • 561B • Updated 20 days ago • 1.63k • 5

sakamakismile/Huihui-gemma-4-31B-it-qat-abliterated-MTP-NVFP4

Image-Text-to-Text • 18B • Updated Jun 12 • 468 • 2

appautomaton/gemma-3-12b-it-backbone-4bit-mlx

Feature Extraction • 2B • Updated 28 days ago • 100 • 1

DhruvalLabs/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Jun 15 • 224 • 1

AtomicChat/LFM2.5-8B-A1B-GGUF

Text Generation • 8B • Updated Jul 22 • 586 • 5

Soofi-Project/Soofi-S-Rhine-Preview-GGUF

Text Generation • 32B • Updated Jul 17 • 35 • 11

mlx-community/Qwen3.5-122B-A10B-OptiQ-2bit

Image-Text-to-Text • 122B • Updated Jul 14 • 612 • 5

gabfssilva/lift-MLX-oQ4

Image-Text-to-Text • 2B • Updated Jun 19 • 34 • 1

sahilchachra/Unlimited-OCR-GGUF

Image-Text-to-Text • 3B • Updated Jul 1 • 20.2k • 139

sahilchachra/Unlimited-OCR-AWQ

Image-Text-to-Text • 3B • Updated Jun 23 • 1.35M • 2

nvidia/MiniMax-M3-NVFP4

Text Generation • 220B • Updated Jun 26 • 191k • 83

dispatchAI/Qwen2.5-1.5B-Instruct-mobile-int4

Text Generation • 2B • Updated Jun 27 • 64 • 1