Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

954

Base only

Active filters: 4bit

CptShaggy/CodeAiley-14B

15B • Updated Apr 7 • 3

youngouk/seastar-medium-ko-4bit-mlx

Automatic Speech Recognition • Updated Apr 7 • 3

jorge-erdb/Qwen3.5-35B-A3B-heretic-4bit-GGUF

Image-Text-to-Text • 35B • Updated Apr 8 • 24

youngouk/ghost613-turbo-korean-4bit-mlx

Automatic Speech Recognition • Updated Apr 7 • 17

mconcat/Qwopus3.5-27B-v3-AWQ-4bit

Text Generation • 29B • Updated Apr 8 • 71 • 2

ebircak/gemma-4-31B-it-4bit-W4A16-AWQ

Text Generation • 32B • Updated Apr 7 • 4.6k • 3

OsaurusAI/gemma-4-26B-A4B-it-4bit

Image-Text-to-Text • 5B • Updated Apr 7 • 28 • 2

IvanSmit05/gemma-4-31B-it-heretic-MLX-4bit

Image-Text-to-Text • 5B • Updated Apr 7 • 113 • 1

DuoNeural/Gemma-4-E2B-GGUF

5B • Updated Apr 29 • 118

jorge-erdb/gpt-oss-20b-Derestricted-4bit-GGUF

Text Generation • 21B • Updated Apr 8 • 117

DuoNeural/Qwen-3.5-9B-GGUF

9B • Updated Apr 29 • 1.43k

DuoNeural/Qwen-3.5-9B-Abliterated-GGUF

9B • Updated Apr 29 • 309 • 2

DuoNeural/Gemma-4-E4B-Abliterated-GGUF

8B • Updated Apr 29 • 995 • 11

jorge-erdb/Qwen3.5-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-4bit-GGUF

Image-Text-to-Text • 35B • Updated Apr 8 • 1.17k

jorge-erdb/Qwen3.5-35B-A3B-heretic-Opus-4.6-Distilled-4bit-GGUF

Image-Text-to-Text • 35B • Updated Apr 8 • 93 • 1

DuoNeural/Gemma-4-E2B-Abliterated-GGUF

5B • Updated Apr 29 • 244 • 4

DuoNeural/Gemma-4-E4B-Claude-Abliterated-GGUF

8B • Updated Apr 29 • 468 • 8

lthn/lemmy-mlx

Image-Text-to-Text • 25B • Updated Apr 17 • 2

lthn/lemer-mlx

Image-Text-to-Text • 1B • Updated Apr 17 • 2 • 1

lthn/lemma-mlx

Image-Text-to-Text • 2B • Updated Apr 17 • 15

lthn/lemrd-mlx

Image-Text-to-Text • 8B • Updated Apr 17 • 4

tanjx1/MiniMax-M2.5-REAP-172B-4bit-MLX-CRACK

Text Generation • 173B • Updated Apr 9 • 57

aa221241/supergemma4-26b-uncensored-4bit-mlx

Text Generation • 25B • Updated Apr 11 • 285 • 3

ping98k/open_llama_3b_v2_4bit

Text Generation • 4B • Updated Apr 11 • 3

ping98k/open-llama-3b-opus-reasoning-sft-2k-4bit

Text Generation • 4B • Updated Apr 12 • 3

mlx-community/gemma-4-e2b-it-OptiQ-4bit

Text Generation • 1B • Updated about 4 hours ago • 2.17k • 4

LetheanNetwork/lemer-mlx

Image-Text-to-Text • 0.7B • Updated Apr 11 • 1

mlx-community/gemma-4-e4b-it-OptiQ-4bit

Text Generation • 7B • Updated about 4 hours ago • 4.76k • 28

LetheanNetwork/lemma-mlx

Image-Text-to-Text • 1B • Updated Apr 11 • 1

LetheanNetwork/lemmy-mlx

Image-Text-to-Text • 25B • Updated Apr 11 • 4