Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

417

Base only

Active filters: 8bit

shdennlin/gemma-4-26B-A4B-it-8bit

Image-Text-to-Text • 8B • Updated May 13 • 11

shdennlin/gemma-4-26B-A4B-it-assistant-8bit

Image-Text-to-Text • 0.1B • Updated May 13 • 19

Reza2kn/mega-asr-coreml

Automatic Speech Recognition • Updated May 22 • 11

carlesonielfa/MinerU2.5-Pro-2604-1.2B-mlx-8bit

0.8B • Updated May 24 • 32

v102ss/Alice-Qwen3.5-9B-Code-v0-MLX-8bit

Text Generation • 9B • Updated May 24 • 30

Meguriai/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated May 25 • 58

Mininglamp-2718/Mano-CUA-2.0-4B-MLX-8bit

Image-Text-to-Text • 2B • Updated Jun 24 • 143 • 2

mlx-community/NVIDIA-Nemotron-3-Nano-4B-OptiQ-4bit

Text Generation • 0.8B • Updated 29 days ago • 657 • 3

mlx-community/NVIDIA-Nemotron-3-Nano-30B-A3B-OptiQ-4bit

Text Generation • 32B • Updated 28 days ago • 600 • 2

SLLLC/canary-qwen-2.5b-quanto-8bit-safetensors-stt

Automatic Speech Recognition • Updated Jun 5

mlx-community/gemma-4-E2B-it-qat-assistant-8bit

Text Generation • 22.1M • Updated Jun 5 • 41

mlx-community/gemma-4-E4B-it-qat-assistant-8bit

Text Generation • 22.3M • Updated Jun 5 • 77

mlx-community/gemma-4-12B-it-qat-assistant-8bit

Text Generation • 0.1B • Updated Jun 5 • 112

mlx-community/gemma-4-26B-A4B-it-qat-assistant-8bit

Text Generation • 0.1B • Updated Jun 5 • 149

mlx-community/gemma-4-31B-it-qat-assistant-8bit

Text Generation • 0.1B • Updated Jun 5 • 168

MLXBits/10eros-experimental-mlx-q8

Image-Text-to-Video • Updated Jun 6 • 143 • 2

marcusnogueira/llama-guard-3-8b-gptq-8bit

Text Generation • 8B • Updated Jun 19 • 13

mlx-community/gemma-4-e2b-it-qat-OptiQ-4bit

Text Generation • 1B • Updated 23 days ago • 1.48k • 6

mlx-community/gemma-4-e4b-it-qat-OptiQ-4bit

Text Generation • 7B • Updated 23 days ago • 3.95k • 16

DJLougen/Harmonic-Hermes-9B-MLX-8bit

Text Generation • 9B • Updated Jun 14 • 295

shamsghi/Mistral-Le-Chaton-Fat

Text Generation • 0.3B • Updated Jun 20 • 195 • 2

mlx-community/gemma-4-26B-A4B-it-qat-OptiQ-4bit

Text Generation • 25B • Updated 23 days ago • 2.51k • 4

mlx-community/gemma-4-31B-it-qat-OptiQ-4bit

Text Generation • 31B • Updated 23 days ago • 4.8k • 5

LLYYZZSS/gemma-4-12B-it-OptiQ-4bit

Text Generation • 12B • Updated Jun 19 • 44

shamsghi/Qwen-9B-Claude-Fable-5-1M-MLX-8bit

Text Generation • 9B • Updated Jul 11 • 449 • 1

petergilani/Qwen3.6-27B-MTP-8bit

Text Generation • 27B • Updated Jun 22 • 74

EdgeAIMed/privacy-filter-nemotron-mlx-8bit

Token Classification • Updated Jun 22 • 14

appautomaton/qwen3-asr-1.7b-int8-mlx

Automatic Speech Recognition • 0.7B • Updated 6 days ago • 45

iamthecage/Qwen3.6-27B-4.2Bit-OptiQ-MTP

Text Generation • 27B • Updated Jun 24 • 127 • 1

mlx-community/VibeThinker-3B-OptiQ-4bit

Text Generation • 0.6B • Updated 28 days ago • 518 • 3