Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

943

Base only

Active filters: 4bit

majentik/Nemotron-3-Nano-4B-RotorQuant-MLX-4bit

Text Generation • 0.6B • Updated May 6 • 78

ping98k/open-llama-7b-openthought-mid-4bit

Text Generation • 7B • Updated Apr 14 • 1

BRlin/LFM2.5-350M-4bit

Text Generation • 55.4M • Updated Apr 14 • 12

majentik/gpt-oss-20b-TurboQuant-MLX-4bit

Text Generation • 21B • Updated May 6 • 177 • 1

fernandovdmrq/supergemma4-26b-uncensored-mlx-4bit-v2

Text Generation • 25B • Updated Apr 14 • 140

majentik/gpt-oss-20b-RotorQuant-MLX-4bit

Text Generation • 21B • Updated May 6 • 186 • 1

majentik/gpt-oss-120b-TurboQuant-MLX-4bit

Text Generation • 117B • Updated May 6 • 134

majentik/gpt-oss-120b-RotorQuant-MLX-4bit

Text Generation • 117B • Updated May 6 • 95

Jiunsong/SuperGemma4-31b-abliterated-mlx-4bit

Text Generation • 31B • Updated Apr 15 • 8.59k • 44

ping98k/open-llama-7b-openthought-sft-4bit

Text Generation • 7B • Updated Apr 15 • 2

groxaxo/Gemma-4-Abliterated-GPTQ-4bit-Pro-v1

Text Generation • 31B • Updated Apr 22 • 13 • 1

Koutouzov1973/Qwen3.5-4B-4bit-Wargame

Text Generation • 0.7B • Updated Apr 15 • 12

lhca521/Gemma-4-E4B-Claude-Abliterated-GGUF

8B • Updated Apr 15 • 66

ogpvibes/paisa-llama31-8b-v1

Text Generation • 8B • Updated Apr 15 • 6

weiren119/Breeze-ASR-26-coreml-4bit-palette

Automatic Speech Recognition • Updated Apr 16 • 47

ckurasek/Yume-1.5-5B-720P-MLX-4bit

Image-to-Video • 0.9B • Updated Apr 16 • 92 • 3

decompute/Nebula-S-v1-4bit

Text Generation • 4B • Updated Apr 16 • 2

PhysShell/SuperGemma4-31b-abliterated-mlx-4bit

Text Generation • 31B • Updated Apr 16 • 114

TheCluster/Qwen3.6-35B-A3B-Heretic-MLX-4bit

Image-Text-to-Text • 35B • Updated Apr 25 • 236 • 3

majentik/Qwen3.6-35B-A3B-TurboQuant-MLX-4bit

Text Generation • 6B • Updated about 13 hours ago • 2.14k • 14

majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-3bit

Text Generation • 5B • Updated about 13 hours ago • 505 • 3

majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-6bit

Text Generation • 8B • Updated about 13 hours ago • 268

majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-5bit

Text Generation • 7B • Updated about 13 hours ago • 271

majentik/Qwen3.6-35B-A3B-TurboQuant-MLX-5bit

Text Generation • 7B • Updated about 13 hours ago • 317

majentik/Qwen3.6-35B-A3B-TurboQuant-MLX-6bit

Text Generation • 8B • Updated about 13 hours ago • 392 • 1

majentik/Qwen3.6-35B-A3B-TurboQuant-MLX-3bit

Text Generation • 5B • Updated about 13 hours ago • 903 • 6

lthn/lemer-lite

Text Generation • 0.7B • Updated Apr 17 • 13

sensix-zo/Gemma-4-31B-Paite-Uncensored-4bit

Text Generation • Updated Apr 18

JANGQ-AI/MiniMax-M2.7-JANGTQ4

Text Generation • 29B • Updated Apr 25 • 57 • 2

OsaurusAI/MiniMax-M2.7-JANGTQ4

Text Generation • 29B • Updated May 1 • 57 • 1