Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,591

Base only

Active filters: quantized

saricles/MiniMax-M2.7-REAP-172B-A10B-NVFP4-GB10

Text Generation • 87B • Updated Apr 19 • 4.93k • 33

DuoNeural/Qwen3.6-35B-A3B-Code-imatrix-GGUF

Text Generation • 35B • Updated Apr 29 • 7.24k • 11

Brooooooklyn/Qwen3.6-35B-A3B-UD-Q8_K_XL-mlx

Text Generation • 10B • Updated May 15 • 745 • 8

majentik/fishaudio-s2-pro-MLX-8bit

Text-to-Speech • 1B • Updated Apr 17 • 29 • 1

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 22.2k • 53

hesamation/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Text Generation • 35B • Updated Apr 19 • 38k • 285

varjosoft/Qwen3.6-35B-A3B-TQ-apex3

Text Generation • 16B • Updated Apr 20 • 347 • 4

Jackrong/Qwen3.6-27B-GGUF

Image-Text-to-Text • 27B • Updated 2 days ago • 2.11k • 57

TheHouseOfTheDude/Qwen3.6-27B-INT8

Image-Text-to-Text • 28B • Updated Jun 1 • 6.06k • 9

dealignai/Qwen3.6-27B-JANG_4M-CRACK

Image-Text-to-Text • 5B • Updated Apr 23 • 1.74k • 24

Abiray/Qwen3.6-27B-NVFP4

Image-Text-to-Text • 17B • Updated Apr 23 • 5.63k • 12

batiai/Qwen3.6-27B-GGUF

Text Generation • 27B • Updated Jun 6 • 159k • 7

nameistoken/Gemma-4-31B-it-Quark-W8A8-INT8

Image-Text-to-Text • 31B • Updated Apr 23 • 1.44k • 4

Tinman-Lab/Tinman-gemma4-companion-gguf

Any-to-Any • 7B • Updated Apr 23 • 5.08k • 2

Code4me2/bu-30b-a3b-preview-NVFP4

Image-Text-to-Text • 16B • Updated Apr 24 • 14 • 1

nameistoken/Qwen3.6-27B-Quark-W8A8-INT8

Image-Text-to-Text • 27B • Updated May 13 • 2.25k • 8

vrfai/Qwen3.6-27B-FP8

Image-Text-to-Text • 27B • Updated Jun 6 • 4.57k • 3

sakamakismile/Qwen3.6-27B-Text-NVFP4-MTP

Text Generation • 17B • Updated Apr 29 • 394k • 80

kai-os/Carnice-V2-27b-GGUF

27B • Updated Apr 25 • 34.8k • 108

mudler/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-APEX-GGUF

35B • Updated Apr 27 • 12.2k • 80

inferencerlabs/DeepSeek-V4-Flash-MLX-Q9

Text Generation • 284B • Updated May 28 • 1.75k • 4

bearzi/Qwen3.6-27B-oQ3

Text Generation • 4B • Updated Apr 27 • 53 • 1

Preyazz/DeepSeek-V4-Flash-GGUF

284B • Updated Apr 28 • 4.38k • 4

cHunter789/Qwen3.6-27B-i1-IQ4_XS-GGUF

Text Generation • 27B • Updated May 2 • 2.29k • 31

mudler/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-APEX-GGUF

32B • Updated Apr 29 • 1.15k • 10

ucbye/Qwen3-Coder-Next-NVFP4-GB10

Text Generation • Updated Apr 29 • 31.9k • 3

ManniX-ITA/Qwen3.6-27B-Omnimerge-v4-GGUF

Image-Text-to-Text • 27B • Updated May 22 • 4.71k • 34

inferencerlabs/MiMo-V2.5-MLX-Q5.8-INF

Text Generation • Updated 14 days ago • 336 • 2

plezan/Mistral-Medium-3.5-128B-W4A16

Image-Text-to-Text • 22B • Updated May 4 • 253 • 4

inferencerlabs/Ling-2.6-flash-MLX-Q9

Text Generation • Updated 14 days ago • 84 • 3