Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

gemma4_assistant

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

115

Base only

Active filters: gemma4_assistant

mlx-community/gemma-4-E4B-it-qat-assistant-mxfp4

Text Generation • 15M • Updated Jun 5 • 102 • 1

mlx-community/gemma-4-E4B-it-qat-assistant-nvfp4

Text Generation • 19.9M • Updated Jun 5 • 60

mlx-community/gemma-4-E4B-it-qat-assistant-mxfp8

Text Generation • 22.3M • Updated Jun 5 • 91

mlx-community/gemma-4-26B-A4B-it-qat-assistant-4bit

Text Generation • 65.6M • Updated Jun 5 • 1.02k • 1

mlx-community/gemma-4-26B-A4B-it-qat-assistant-5bit

Text Generation • 78.7M • Updated Jun 5 • 66

mlx-community/gemma-4-26B-A4B-it-qat-assistant-6bit

Text Generation • 91.8M • Updated Jun 5 • 118

mlx-community/gemma-4-26B-A4B-it-qat-assistant-8bit

Text Generation • 0.1B • Updated Jun 5 • 171

mlx-community/gemma-4-26B-A4B-it-qat-assistant-bf16

Text Generation • 0.4B • Updated Jun 5 • 393 • 1

mlx-community/gemma-4-26B-A4B-it-qat-assistant-mxfp4

Text Generation • 78.7M • Updated Jun 5 • 320 • 1

mlx-community/gemma-4-26B-A4B-it-qat-assistant-nvfp4

Text Generation • 0.1B • Updated Jun 5 • 116

mlx-community/gemma-4-26B-A4B-it-qat-assistant-mxfp8

Text Generation • 0.1B • Updated Jun 5 • 303 • 1

mlx-community/gemma-4-31B-it-qat-assistant-4bit

Text Generation • 73.4M • Updated Jun 5 • 515

mlx-community/gemma-4-31B-it-qat-assistant-5bit

Text Generation • 88M • Updated Jun 5 • 44

mlx-community/gemma-4-31B-it-qat-assistant-6bit

Text Generation • 0.1B • Updated Jun 5 • 104

mlx-community/gemma-4-31B-it-qat-assistant-8bit

Text Generation • 0.1B • Updated Jun 5 • 214

mlx-community/gemma-4-31B-it-qat-assistant-bf16

Text Generation • 0.5B • Updated Jun 5 • 658 • 1

mlx-community/gemma-4-31B-it-qat-assistant-mxfp4

Text Generation • 88M • Updated Jun 5 • 122

mlx-community/gemma-4-31B-it-qat-assistant-nvfp4

Text Generation • 0.1B • Updated Jun 5 • 73

mlx-community/gemma-4-31B-it-qat-assistant-mxfp8

Text Generation • 0.1B • Updated Jun 5 • 380 • 1

Simplepotat/gemma-4-31b-it-qat-q4_0-assistant-gguf

Image-Text-to-Text • 0.5B • Updated Jun 9 • 450 • 9

NeoRoth/gemma-4-e4b-it-assistant-mlx

78.8M • Updated Jun 6 • 23

NeoRoth/gemma-4-26b-a4b-it-assistant-mlx

0.4B • Updated Jun 6 • 63

NeoRoth/gemma-4-31b-it-assistant-mlx

0.5B • Updated Jun 6 • 46

brainworkup/gemma-4-E4B-it-assistant-oQ4

13M • Updated Jun 6 • 21

kunhunjon/gemma-4-26B-A4B-it-qat-assistant-w4a16-ct

Text Generation • 0.4B • Updated Jun 8 • 267

back3-1/gemma-4-26b-a4b-it-q4-assistant-modchallenge-wrapper

Image-Text-to-Text • 0.4B • Updated Jun 9 • 3

nico-martin/gemma-4-E2B-it-assistant-ONNX

Any-to-Any • Updated Jun 11 • 5

nico-martin/gemma-4-E4B-it-assistant-ONNX

Updated Jun 11 • 7

nico-martin/gemma-4-E2B-it-assistant-q4-ONNX

Updated Jun 11 • 6

yassaalfy/gemma-4-E4B-it-qat-q4_0-unquantized-assistant

Any-to-Any • 78.8M • Updated Jun 12 • 8