Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

942

Base only

Active filters: 4bit

TheCluster/Qwen3.6-35B-A3B-Heretic-MLX-mixed-3.9bit

Image-Text-to-Text • 35B • Updated Apr 29 • 73

groxaxo/Qwen3.6-27B-abliterated-v2-GPTQ-Pro-FOEM-4bit-g128

Image-Text-to-Text • 27B • Updated Apr 29 • 14 • 1

groxaxo/Qwen3.6-27B-abliterated-v2-GPTQ-Pro-FOEM-4bit-g128-preserve-vl

Image-Text-to-Text • 27B • Updated Apr 30 • 13 • 1

Outlier-Ai/Outlier-Nano-4B-MLX-4bit

Text Generation • 0.7B • Updated May 27 • 19

Outlier-Ai/Outlier-Lite-9B-MLX-4bit

Text Generation • 1B • Updated May 26 • 26

Outlier-Ai/Outlier-Core-27B-MLX-4bit

Text Generation • 4B • Updated May 26 • 40

Outlier-Ai/Outlier-Code-27B-MLX-4bit

Text Generation • 4B • Updated May 26 • 17

Outlier-Ai/Outlier-Vision-35B-A3B-MLX-4bit

Image-Text-to-Text • 6B • Updated May 26 • 31

fredchu/breeze-asr-26-mlx-4bit

Automatic Speech Recognition • Updated Apr 30 • 10

xprilion/Qwen3.5-0.8b-browser-agent-lora

Updated Apr 30 • 1 • 1

Outlier-Ai/Outlier-Quick-26B-MLX-4bit

Text Generation • 5B • Updated May 26 • 17

vystartasv/Qwen3.5-9B-oQ4

2B • Updated May 1 • 8

sjoe1244/gemma-4-26B-A4B-it-ultra-uncensored-heretic-exl3-4.00bpw-h6

Image-Text-to-Text • 8B • Updated May 1 • 26

jorge-erdb/GLM-4.7-Flash-D-IQ4NL-GGUF

Text Generation • 30B • Updated May 5 • 31

Xerv-AI/MAXWELL

Text Generation • 2B • Updated May 23 • 37 • 5

zaydiscold/gemma-4-E4B-it-OBLITERATED-MLX-4bit

Text Generation • 1B • Updated May 5 • 187

gratex/Mistral-Small-3.2-24B-Instruct-2506-W4A16-AutoRound

Image-Text-to-Text • 4B • Updated May 9 • 177

Shrikanth19/roste-stage2-adapter

Shrikanth19/roste-stage2-merged

3B • Updated May 6 • 4

jorge-erdb/Qwen3.5-9B-DeepSeek-V4-Flash-4bit-GGUF

Image-Text-to-Text • 9B • Updated May 6 • 361

XxxxYyyy/MAXWELL-Q8_0-GGUF

Text Generation • 2B • Updated May 7 • 17 • 1

ltpla/gemma-4-e4b-it-noaudio-4bit

Any-to-Any • 1B • Updated May 7 • 17

samajlouis/Qwen3.6-27B-bnb-nf4

Image-Text-to-Text • 28B • Updated May 7 • 184 • 1

codeShare/Zeta-SDNQ-4bit

Updated May 8 • 1

gratex/mistral-small-3.2-24b-Instruct-2506-NVFP4A16

Image-Text-to-Text • 14B • Updated May 8 • 11

emanubiz/super-gemopus-4-e4b-trimera-mlx-4bit

1B • Updated May 9 • 16 • 1

derkar00/gemma-4-E2B-it-4bit-nf4

5B • Updated May 8 • 1

derkar00/gemma-4-E2B-it-4bit-nf4-v2

4B • Updated May 8 • 1

doggy8088/Qwen3-ASR-1.7B-MLX-4bit

Automatic Speech Recognition • 0.4B • Updated May 8 • 12

yaanfpv/Vayaan-Qwen3.5-9B-OmniClaw-VL-MLX-4bit

Image-Text-to-Text • 2B • Updated May 9 • 89