Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

226

Base only

Active filters: vLLM

Xingyu-Zheng/Qwen3.5-9B-GLM5.1-Distill-v1-INT4-FOEM

Image-Text-to-Text • 9B • Updated Apr 16 • 7 • 1

Xingyu-Zheng/Qwen3.5-9B-GLM5.1-Distill-v1-INT8-FOEM

Image-Text-to-Text • 9B • Updated Apr 16 • 7

QuantTrio/Qwen3.6-35B-A3B-AWQ

Image-Text-to-Text • 36B • Updated Apr 17 • 971k • 33

Xingyu-Zheng/Qwopus3.5-27B-v3.5-INT4-FOEM

Image-Text-to-Text • 27B • Updated Apr 17 • 7 • 1

Xingyu-Zheng/Qwopus3.5-27B-v3.5-INT8-FOEM

Image-Text-to-Text • 27B • Updated Apr 17 • 17

Xingyu-Zheng/Qwopus3.5-9B-v3.5-INT4-FOEM

Image-Text-to-Text • 9B • Updated Apr 17 • 12 • 1

Xingyu-Zheng/Qwopus3.5-9B-v3.5-INT8-FOEM

Image-Text-to-Text • 9B • Updated Apr 17 • 10

Explyt/GLM-5-AWQ-pruned-20

Text Generation • 609B • Updated Apr 17 • 11

QuantTrio/MiniMax-M2.7-AWQ

Text Generation • 229B • Updated Apr 20 • 7.41k • 8

ClaudioItaly/Qwopus3.5-9B-v3-INT8-FOEM-Q4_K_M-GGUF

Image-Text-to-Text • 9B • Updated Apr 20 • 8

QuantTrio/GLM-5.1-AWQ

Text Generation • 754B • Updated Apr 21 • 757 • 9

selode-ai/Qwen-3.6-35B-A3B-VRAP-4-bit-AWQ-21.2GB

Image-Text-to-Text • 29B • Updated Jun 16 • 40k • 15

Explyt/GLM-5.1-AWQ

Text Generation • 754B • Updated Jun 24 • 11 • 1

QuantTrio/Qwen3.6-27B-AWQ

Image-Text-to-Text • 28B • Updated Apr 23 • 845k • 24

QuantTrio/Qwen3.6-27B-AWQ-6Bit

Image-Text-to-Text • 28B • Updated Apr 23 • 88.4k • 17

Xingyu-Zheng/Qwen3.6-27B-INT8-FOEM

Image-Text-to-Text • 27B • Updated Apr 24 • 16

Xingyu-Zheng/Qwen3.6-27B-INT4-FOEM

Image-Text-to-Text • 27B • Updated Apr 24 • 17

axolotl-ai-co/Mistral-Medium-3.5-128B-BF16

128B • Updated Apr 24 • 374

Xingyu-Zheng/Qwopus3.6-27B-v1-preview-INT4-FOEM

Image-Text-to-Text • 27B • Updated May 15 • 6 • 1

Xingyu-Zheng/Qwopus3.6-27B-v1-preview-INT8-FOEM

Image-Text-to-Text • 27B • Updated Apr 27 • 7 • 1

mistralai/Mistral-Medium-3.5-128B-EAGLE

Updated Apr 30 • 179 • 57

bartowski/mistralai_Mistral-Medium-3.5-128B-GGUF

Image-Text-to-Text • 125B • Updated May 4 • 4.76k • 10

NeuralNotwerk/Mistral-Medium-3.5-128B-NVFP4

74B • Updated May 9 • 689 • 10

olka-fi/Mistral-Medium-3.5-128B-MXFP4

Text Generation • 128B • Updated May 2 • 332 • 2

naruonenime/Mistral-Medium-3.5-128B

128B • Updated May 4 • 5

mradermacher/Mistral-Medium-3.5-128B-GGUF

125B • Updated May 9 • 435 • 1

Sav868767876-9999999876654346/Mistral-Medium-3.5-128B

128B • Updated May 8 • 4

mradermacher/Mistral-Medium-3.5-128B-i1-GGUF

125B • Updated May 9 • 355

clemsail/qwen3.5-27b-opus-awq

Image-Text-to-Text • 28B • Updated May 11 • 5

gsting/Qwen3-VL-235B-A22B-Instruct-AWQ

Text Generation • 236B • Updated May 12 • 11