Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

45,272

Base only

Active filters: 4-bit

hhhhy888/Qwen3-TTS-12Hz-1.7B-Base-BNB-NF4

Text-to-Speech • 2B • Updated Mar 23 • 66 • 1

groxaxo/Huihui-Qwen3.5-9B-abliterated-GPTQ-Pro-4bit-g64

Text Generation • 9B • Updated Mar 28 • 190 • 2

groxaxo/Huihui-Qwen3.5-9B-abliterated-gptq-pro-w4g128

9B • Updated Mar 29 • 10 • 1

cloudyu/GPT-OSS-120B-2experts-MLX-q4-Claude-4.6-Opus-Reasoning-Distilled

Text Generation • 117B • Updated Apr 26 • 1.6k • 4

MarkChen1214/cohere-transcribe-03-2026-MLX-Mixed-3bit4bit

Automatic Speech Recognition • 0.3B • Updated Apr 1 • 92 • 4

unsloth/gemma-4-E2B-it-UD-MLX-4bit

Image-Text-to-Text • 1B • Updated Apr 13 • 1.69k • 22

mlx-community/gemma-4-e4b-it-mxfp4

Any-to-Any • 2B • Updated 11 days ago • 898 • 3

unsloth/gemma-4-E4B-it-unsloth-bnb-4bit

Image-Text-to-Text • 8B • Updated 25 days ago • 262k • 21

z-lab/gemma-4-31B-it-PARO

Image-Text-to-Text • 6B • Updated 14 days ago • 5.81k • 21

caiovicentino1/Qwopus3.5-27B-v3-HLWQ-v7-GPTQ

Text Generation • 27B • Updated Apr 13 • 5 • 6

mlx-community/gemma-4-e2b-it-OptiQ-4bit

Text Generation • 1B • Updated 4 days ago • 2.93k • 3

lyf/Huihui-gemma-4-31B-it-abliterated-v2-NVFP4

Image-Text-to-Text • 18B • Updated Apr 12 • 92.1k • 1

YuYu1015/Huihui-Qwen3.5-27B-abliterated-int4-AutoRound

Text Generation • 11B • Updated Apr 12 • 729 • 4

YuYu1015/Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated-int4-AutoRound

Text Generation • 11B • Updated Apr 12 • 135 • 1

AEON-7/DFlash-Qwen3.5-27B-Uncensored-NVFP4

Text Generation • 17B • Updated 29 days ago • 445 • 2

sbs-warren/Gemma-4-E4B-Claude-Opus-Reasoning-MLX-4bit

Text Generation • 1B • Updated Apr 13 • 1.31k • 2

YuYu1015/Huihui-Qwopus3.5-27B-v3-abliterated-int4-AutoRound

Text Generation • 11B • Updated Apr 20 • 6 • 2

Jiunsong/SuperGemma4-31b-abliterated-mlx-4bit

Text Generation • 31B • Updated Apr 15 • 2.61k • 39

0xSero/Qwen3.5-264B-REAP-W4A16

Text Generation • 37B • Updated Apr 17 • 387 • 11

saricles/MiniMax-M2.7-NVFP4-GB10

Text Generation • 115B • Updated Apr 19 • 2.19k • 11

spicyneuron/Qwen3.6-35B-A3B-MLX-5.4bit

Text Generation • 35B • Updated 7 days ago • 1.74k • 6

gdubicki/Qwen3-Coder-Next-NVFP4-GB10

Text Generation • Updated Apr 17 • 982 • 1

unsloth/Qwen3.6-35B-A3B-UD-MLX-4bit

Image-Text-to-Text • 6B • Updated Apr 20 • 130k • 81

Jiunsong/supergemma4-e4b-abliterated-mlx

Text Generation • 1B • Updated Apr 17 • 4.03k • 37

prism-ml/Bonsai-8B-AWQ-4-bit

Text Generation • 8B • Updated 26 days ago • 428 • 1

ykarout/Qwen3.6-35B-A3B-NVFP4

Image-Text-to-Text • 36B • Updated Apr 19 • 43.5k • 1

mlx-community/translategemma-4b-it-4bit_immersive-translate

Text Generation • 0.6B • Updated Apr 19 • 874 • 9

zecanard/gemma-4-E4B-it-ultra-uncensored-heretic-MLX-4bit-mixed_4_6

Any-to-Any • 2B • Updated 7 days ago • 4.45k • 5

kanarena/supergemma4-e4b-abliterated-multimodal-gguf-4bit

Image-Text-to-Text • 8B • Updated Apr 19 • 958 • 2

splats/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-oQ4e

6B • Updated Apr 29 • 3.05k • 4