Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

31,286

Base only

Active filters: 8-bit

mlx-community/gemma-4-e4b-it-8bit

Image-Text-to-Text • 3B • Updated 9 days ago • 3.86k • 25

mlx-community/gemma-4-31b-8bit

Image-Text-to-Text • 9B • Updated Apr 2 • 1.47k • 24

mlx-community/gemma-4-e2b-mxfp8

Any-to-Any • 2B • Updated Apr 3 • 43 • 1

inferencerlabs/gemma-4-31B-MLX-Q9

Image-Text-to-Text • 10B • Updated 18 days ago • 785 • 7

inferencerlabs/gemma-4-E4B-MLX-Q9

Any-to-Any • 3B • Updated 18 days ago • 155 • 1

RedHatAI/gemma-4-31B-it-NVFP4

Image-Text-to-Text • 20B • Updated 4 days ago • 1.41M • 53

unsloth/gemma-4-31b-it-MLX-8bit

Image-Text-to-Text • 9B • Updated Apr 13 • 1.05k • 13

RedHatAI/gemma-4-26B-A4B-it-NVFP4

Image-Text-to-Text • 15B • Updated 4 days ago • 1.15M • 38

lukealonso/GLM-5.1-NVFP4

437B • Updated May 6 • 3.95k • 23

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4

Text Generation • 18B • Updated 24 days ago • 2.54k • 11

majentik/gemma-4-31B-RotorQuant-MLX-8bit

Image-Text-to-Text • 9B • Updated about 4 hours ago • 107 • 1

nvidia/NVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-NVFP4

Text Generation • 18B • Updated May 8 • 1.11k • 17

RedHatAI/Qwen3.5-9B-quantized.w8a8

Image-Text-to-Text • 9B • Updated Apr 16 • 13.5k • 1

bearzi/Qwen3.6-35B-A3B-oQ8

Text Generation • 10B • Updated Apr 16 • 311 • 5

mlx-community/Qwen3.6-35B-A3B-8bit

Image-Text-to-Text • 10B • Updated Apr 16 • 17.2k • 21

TheCluster/Qwen3.6-35B-A3B-Heretic-MLX-mixed-9bit

Image-Text-to-Text • 35B • Updated Apr 25 • 492 • 2

saricles/MiniMax-M2.7-REAP-172B-A10B-NVFP4-GB10

Text Generation • 87B • Updated Apr 19 • 4.01k • 33

majentik/fishaudio-s2-pro-MLX-8bit

Text-to-Speech • 1B • Updated Apr 17 • 41 • 1

jedisct1/Qwen3.6-35B-rust.mlx

Text Generation • 35B • Updated Apr 19 • 503 • 10

amd/Kimi-K2.6-MXFP4

550B • Updated 21 days ago • 37.9k • 3

unsloth/Qwen3.6-27B-MLX-8bit

Image-Text-to-Text • 12B • Updated Apr 22 • 8.52k • 46

nameistoken/Gemma-4-31B-it-Quark-W8A8-INT8

Image-Text-to-Text • 31B • Updated Apr 23 • 1.69k • 4

unsloth/DeepSeek-V4-Pro

Text Generation • 862B • Updated Apr 24 • 180 • 61

sakamakismile/Huihui-Qwen3.6-27B-abliterated-NVFP4-MTP

Text Generation • 17B • Updated May 31 • 34.2k • 63

rdtand/MiniMax-M2.7-PrismaQuant-3.20bit-vllm

Text Generation • 94B • Updated Apr 28 • 1.51k • 11

lukealonso/MiMo-V2.5-NVFP4

179B • Updated 11 days ago • 36.9k • 26

Peutlefaire/Qwen3.6-27B-NVFP4

17B • Updated May 1 • 6.48k • 5

llmfan46/Qwen3.6-27B-uncensored-heretic-v2-GPTQ-Int8

Image-Text-to-Text • 27B • Updated May 1 • 3.69k • 5

cyburn/Qwopus3.6-35B-A3B-v1-PrismaSCOUT-Blackwell-NVFP4-BF16-vllm-4.75bits

Image-Text-to-Text • 21B • Updated May 7 • 20.6k • 10

Jundot/Qwen3.6-27B-oQ8-mtp

8B • Updated May 12 • 3.19k • 11