Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,336

Base only

Active filters: quantization

JongYeop/Qwen2.5-14B-Instruct-FP4-W4A4

Text Generation • 9B • Updated Feb 6 • 148

JongYeop/Qwen2.5-14B-Instruct-FP8-W8A8

Text Generation • 15B • Updated Feb 6 • 21

ghostai1/Egypt_Historical7b

Text Generation • 7B • Updated Feb 6 • 70 • 4

Geodd/GLM-4.7-Flash-FP8

Text Generation • 30B • Updated Feb 6 • 22

Geodd/GLM-4.7-Flash-W8A16

Text Generation • 0.7B • Updated Feb 7 • 27 • 1

Shifusen/Maginum-Cydoms-24B-NVFP4

Text Generation • 14B • Updated Feb 7 • 17

Silan10/flux-quanto-int8

Text-to-Image • 12B • Updated Feb 8 • 22

Vishva007/Qwen3-VL-2B-Instruct-W4A16-AutoRound

Image-Text-to-Text • 0.9B • Updated 25 days ago • 27

Vishva007/Qwen3-VL-2B-Instruct-W4A16-AutoRound-GPTQ

Image-Text-to-Text • 2B • Updated 25 days ago • 37

Vishva007/Qwen3-VL-2B-Instruct-W4A16-AutoRound-AWQ

Image-Text-to-Text • 2B • Updated 25 days ago • 75 • 1

Vishva007/Qwen3-VL-4B-Instruct-W4A16-AutoRound

Image-Text-to-Text • 1B • Updated 25 days ago • 32

Vishva007/Qwen3-VL-4B-Instruct-W4A16-AutoRound-GPTQ

Image-Text-to-Text • 4B • Updated 25 days ago • 35

Vishva007/Qwen3-VL-4B-Instruct-W4A16-AutoRound-AWQ

Image-Text-to-Text • 4B • Updated 25 days ago • 94 • 1

Vishva007/Qwen3-VL-8B-Instruct-W4A16-AutoRound-GPTQ

Image-Text-to-Text • 2B • Updated 25 days ago • 67

Vishva007/Qwen3-VL-8B-Instruct-W4A16-AutoRound-AWQ

Image-Text-to-Text • 2B • Updated 25 days ago • 4.96k • 1

Akicou/glm-edge-v-5b-GGUF

4B • Updated Feb 7 • 170 • 2

petergilani/Qwen3-Coder-Next-8bit-g128

Text Generation • 80B • Updated Feb 13 • 29 • 1

CesarFavero/rpt-bitnet-2b-pruned

Text Generation • 2B • Updated Feb 8 • 22 • 1

EricRollei/HunyuanImage-3.0-Instruct-INT8

Text-to-Image • 83B • Updated Feb 9 • 24 • 1

EricRollei/HunyuanImage-3.0-Instruct-NF4

Text-to-Image • 83B • Updated Feb 9 • 31 • 3

Silicone-Moss/TheDrummer-Skyfall-31B-v4.1-Heretic-Absolute-GGUF

Text Generation • 31B • Updated Feb 9 • 218

Silicone-Moss/TheDrummer-Skyfall-31B-v4.1-Heretic-Clear-GGUF

Text Generation • 31B • Updated Feb 10 • 156

EricRollei/HunyuanImage-3.0-Instruct-Distil-INT8

Text-to-Image • 83B • Updated Feb 9 • 17 • 2

aravula7/qwen-sql-finetuning

Text Generation • Updated Feb 9

Silan10/flux-torchao-int8

Text-to-Image • Updated Feb 9 • 4

EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4

Text-to-Image • 83B • Updated Feb 9 • 22 • 2

namgyu-youn/exaone-1.2b-qqq-w4a8

0.4B • Updated Feb 9 • 14

petergilani/Qwen3-Coder-Next-4bit-g128

Text Generation • 80B • Updated Feb 13 • 41

petergilani/Qwen3-Coder-Next-6bit-g128

Text Generation • 80B • Updated Feb 11 • 41

sarathi-balakrishnan/Qwen2.5-VL-7B-Medical-LoRA

Image-Text-to-Text • Updated Feb 10 • 14