Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

228

Base only

Active filters: vLLM

xxxSHADOWxxx/Qwen3-VL-30B-A3B-Instruct-AWQ

Text Generation • 31B • Updated Mar 20 • 27

mradermacher/Mistral-Small-4-119B-2603-GGUF

119B • Updated Mar 22 • 176 • 1

vaishudeva/Mistral-Small-4-119B-2603

119B • Updated Mar 21 • 4

mradermacher/Mistral-Small-4-119B-2603-i1-GGUF

119B • Updated Jun 6 • 1.03k • 3

Simsema/Simsema_Small-4-119B-32226

119B • Updated Mar 23 • 9 • 1

mradermacher/Simsema_Small-4-119B-32226-GGUF

119B • Updated Mar 26 • 78

Jhooper1973/Mistral-Small-4-119B-2603

119B • Updated Mar 26 • 5

mradermacher/Simsema_Small-4-119B-32226-i1-GGUF

119B • Updated Mar 28 • 449 • 1

Explyt/GLM-5-AWQ

Text Generation • 754B • Updated Mar 26 • 10

RedHatAI/Mistral-Small-4-119B-2603-NVFP4

Updated Apr 28 • 191 • 1

RedHatAI/Mistral-Small-4-119B-2603

119B • Updated Jun 30 • 75 • 1

AkashKakad/Mistral-Small-4-119B-2603

119B • Updated Mar 27 • 4

Armen355/Mistral-Small-4-119B-2603

119B • Updated Mar 29 • 5

mr-zhlj/Mistral-Small-4-119B-2603

119B • Updated Mar 30 • 5

QuantTrio/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-v2-AWQ

Image-Text-to-Text • 28B • Updated Mar 30 • 120k • 14

stefan-terdell-cleura/Mistral-Small-4-119B-2603-GGUF

119B • Updated Apr 2 • 70

Xingyu-Zheng/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-INT4-FOEM

Image-Text-to-Text • 27B • Updated Apr 16 • 6 • 1

Xingyu-Zheng/gemma-4-31B-it-int4-foem

Image-Text-to-Text • 31B • Updated Apr 4 • 25

Xingyu-Zheng/Qwopus3.5-27B-v3-INT4-FOEM

Image-Text-to-Text • 27B • Updated Apr 3 • 6

Xingyu-Zheng/Qwopus3.5-9B-v3-INT4-FOEM

Image-Text-to-Text • 9B • Updated Apr 17 • 4

QuantTrio/Qwopus3.5-27B-v3-AWQ-6Bit

Image-Text-to-Text • 27B • Updated Apr 3 • 17 • 3

QuantTrio/Qwopus3.5-27B-v3-AWQ

Image-Text-to-Text • 27B • Updated Apr 3 • 727 • 10

QuantTrio/gemma-4-31B-it-AWQ-6Bit

Image-Text-to-Text • 31B • Updated Apr 17 • 1.12k • 11

QuantTrio/gemma-4-31B-it-AWQ

Image-Text-to-Text • 31B • Updated 25 days ago • 195k • 14

Xingyu-Zheng/gemma-4-31B-it-int8-foem

Image-Text-to-Text • 31B • Updated Apr 4 • 11

Xingyu-Zheng/Qwopus3.5-9B-v3-INT8-FOEM

Image-Text-to-Text • 9B • Updated Apr 17 • 8

Xingyu-Zheng/Qwopus3.5-27B-v3-INT8-FOEM

Image-Text-to-Text • 27B • Updated Apr 4 • 8

autospare/Mistral-Small-4-119B-2603

119B • Updated Apr 7 • 4

Xingyu-Zheng/Gemopus-4-E4B-it-INT4-FOEM

Image-Text-to-Text • 8B • Updated Apr 9 • 6

Xingyu-Zheng/Gemopus-4-E4B-it-INT8-FOEM

Image-Text-to-Text • 8B • Updated Apr 9 • 9