Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

520

Base only

Active filters: mtp

mlx-community/gemma-4-31B-it-qat-assistant-4bit

Text Generation • 73.4M • Updated about 9 hours ago • 49

mlx-community/gemma-4-31B-it-qat-assistant-5bit

Text Generation • 88M • Updated about 9 hours ago • 32

mlx-community/gemma-4-31B-it-qat-assistant-6bit

Text Generation • 0.1B • Updated about 9 hours ago • 33

mlx-community/gemma-4-31B-it-qat-assistant-8bit

Text Generation • 0.1B • Updated about 9 hours ago • 49

mlx-community/gemma-4-31B-it-qat-assistant-bf16

Text Generation • 0.5B • Updated about 9 hours ago • 45

mlx-community/gemma-4-31B-it-qat-assistant-mxfp4

Text Generation • 88M • Updated about 9 hours ago • 37

mlx-community/gemma-4-31B-it-qat-assistant-nvfp4

Text Generation • 0.1B • Updated about 9 hours ago • 38

mlx-community/gemma-4-31B-it-qat-assistant-mxfp8

Text Generation • 0.1B • Updated about 9 hours ago • 71

vladimir94/Huihui-Qwen3.6-35B-A3B-abliterated-NVFP4-GGUF

Text Generation • 35B • Updated about 7 hours ago • 19

mradermacher/OYM-Qimi-122B-A10B-K2.6-GGUF

0.5B • Updated about 3 hours ago