Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

gemma4_unified_assistant

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

31

Base only

Active filters: gemma4_unified_assistant

mlx-community/gemma-4-12B-it-qat-assistant-4bit

Text Generation • 66.1M • Updated Jun 5 • 1.76k • 3

google/gemma-4-12B-it-assistant

Any-to-Any • 0.4B • Updated 10 days ago • 127k • 102

mlx-community/gemma-4-12B-it-assistant-bf16

Any-to-Any • 0.4B • Updated Jun 3 • 972 • 5

mlx-community/gemma-4-12B-it-assistant-4bit

Any-to-Any • 66.1M • Updated Jun 3 • 525 • 2

mlx-community/gemma-4-12B-it-assistant-5bit

Any-to-Any • 79.3M • Updated Jun 3 • 39

mlx-community/gemma-4-12B-it-assistant-6bit

Any-to-Any • 92.5M • Updated Jun 3 • 90 • 1

mlx-community/gemma-4-12B-it-assistant-8bit

Any-to-Any • 0.1B • Updated Jun 3 • 286 • 1

mlx-community/gemma-4-12B-it-assistant-nvfp4

Any-to-Any • 0.1B • Updated Jun 3 • 97 • 1

mlx-community/gemma-4-12B-it-assistant-mxfp4

Any-to-Any • 79.3M • Updated Jun 3 • 128 • 1

mlx-community/gemma-4-12B-it-assistant-mxfp8

Any-to-Any • 0.1B • Updated Jun 3 • 121 • 1

agentmish/gemma-4-12B-it-assistant-mlx-bf16

0.4B • Updated Jun 3 • 68

ekryski/gemma-4-12B-it-assistant-mlx-4bit

0.3B • Updated Jun 3 • 33

bahadirakdemir/gemma-4-12B-it-assistant-fp8

Text Generation • 0.4B • Updated Jun 3 • 108 • 2

YuCollection/gemma-4-12B-it-assistant-bf16

Any-to-Any • 0.4B • Updated Jun 4 • 2

google/gemma-4-12B-it-qat-q4_0-unquantized-assistant

Any-to-Any • 0.4B • Updated 5 days ago • 102k • 20

senapati484/gemma-4-12B-it-assistant

Any-to-Any • 0.4B • Updated Jun 5 • 9

mlx-community/gemma-4-12B-it-qat-assistant-5bit

Text Generation • 79.3M • Updated Jun 5 • 108

mlx-community/gemma-4-12B-it-qat-assistant-8bit

Text Generation • 0.1B • Updated Jun 5 • 280

mlx-community/gemma-4-12B-it-qat-assistant-6bit

Text Generation • 92.5M • Updated Jun 5 • 89

mlx-community/gemma-4-12B-it-qat-assistant-bf16

Text Generation • 0.4B • Updated Jun 5 • 289

mlx-community/gemma-4-12B-it-qat-assistant-mxfp4

Text Generation • 79.3M • Updated Jun 5 • 221

mlx-community/gemma-4-12B-it-qat-assistant-nvfp4

Text Generation • 0.1B • Updated Jun 5 • 123

mlx-community/gemma-4-12B-it-qat-assistant-mxfp8

Text Generation • 0.1B • Updated Jun 5 • 229

Frniez/gemma-4-12B-it-assistant

Any-to-Any • 0.4B • Updated Jun 6 • 7 • 1

brainworkup/gemma-4-12B-it-assistant-oQ8

0.1B • Updated Jun 6 • 140 • 2

cwfgpt/gemma-4-12B-it-qat-q4_0-unquantized-assistant

Any-to-Any • 0.4B • Updated Jun 7 • 5

kunhunjon/gemma-4-12B-it-qat-assistant-w4a16-ct

Text Generation • 0.4B • Updated Jun 7 • 261 • 1

skilledu/gemma-4-12B-it-assistant-base

Any-to-Any • 0.4B • Updated Jun 8 • 7

tepirale/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-assistant-safetensors-yuxinlu1

Image-Text-to-Text • 0.4B • Updated Jun 23 • 65 • 3

tepirale/gemma-4-12B-coder-fable5-composer2.5-v1-assistant-safetensors-yuxinlu1

Image-Text-to-Text • 0.4B • Updated Jun 23 • 12