Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

839

Full-text search

Active filters: quantization

JEILDLWLRMA/Qwen3-VL-8B-Instruct-NVFP4

Image-to-Text • 6B • Updated 27 days ago • 596

cloud19/sainemo-12b-fp4-blackwell

12B • Updated 26 days ago • 27

Habibur2/Llama-3.2-1B-Instruct-GGUF

Text Generation • 1B • Updated 26 days ago • 146

Heehobino/nihao-zhenzhen-kws

Audio Classification • Updated 25 days ago • 36

ghostai1/NewYears1.5b

Text Generation • 2B • Updated 25 days ago • 294

rtj1/Qwen2.5-0.5B-AWQ-FP8-Dynamic

Text Generation • 0.6B • Updated 18 days ago • 21

rtj1/Qwen2.5-0.5B-AWQ-FP8-Block

Text Generation • 0.6B • Updated 18 days ago • 21

JongYeop/Qwen2.5-14B-Instruct-FP4-W4A4

Text Generation • 9B • Updated 23 days ago • 116

JongYeop/Qwen2.5-14B-Instruct-FP8-W8A8

Text Generation • 15B • Updated 23 days ago • 23

ghostai1/Egypt_Historical7b

Text Generation • 7B • Updated 23 days ago • 344 • 3

Geodd/GLM-4.7-Flash-FP8

Text Generation • 30B • Updated 23 days ago • 52

Geodd/GLM-4.7-Flash-W8A16

Text Generation • 0.7B • Updated 22 days ago • 135 • 1

Shifusen/Maginum-Cydoms-24B-NVFP4

Text Generation • 14B • Updated 22 days ago • 32

Silan10/flux-quanto-int8

Text-to-Image • Updated 20 days ago • 34

Vishva007/Qwen3-VL-2B-Instruct-W4A16-AutoRound

Image-Text-to-Text • 0.9B • Updated 21 days ago • 28

Vishva007/Qwen3-VL-2B-Instruct-W4A16-AutoRound-GPTQ

Image-Text-to-Text • 2B • Updated 21 days ago • 31

Vishva007/Qwen3-VL-2B-Instruct-W4A16-AutoRound-AWQ

Image-Text-to-Text • 2B • Updated 21 days ago • 121

Vishva007/Qwen3-VL-4B-Instruct-W4A16-AutoRound

Image-Text-to-Text • 1B • Updated 21 days ago • 22

Vishva007/Qwen3-VL-4B-Instruct-W4A16-AutoRound-GPTQ

Image-Text-to-Text • 4B • Updated 21 days ago • 28

Vishva007/Qwen3-VL-4B-Instruct-W4A16-AutoRound-AWQ

Image-Text-to-Text • 4B • Updated 21 days ago • 53 • 1

Vishva007/Qwen3-VL-8B-Instruct-W4A16-AutoRound-GPTQ

Image-Text-to-Text • 2B • Updated 19 days ago • 1.78k

Vishva007/Qwen3-VL-8B-Instruct-W4A16-AutoRound-AWQ

Image-Text-to-Text • 2B • Updated 19 days ago • 1.48k

petergilani/Qwen3-Coder-Next-8bit-g128

Text Generation • 80B • Updated 15 days ago • 115 • 1

CesarFavero/rpt-bitnet-2b-pruned

Text Generation • 2B • Updated 20 days ago • 22 • 1

EricRollei/HunyuanImage-3.0-Instruct-INT8

Text-to-Image • 83B • Updated 20 days ago • 16

Akicou/Qwen3-Coder-Next-GGUF

80B • Updated 20 days ago • 732

EricRollei/HunyuanImage-3.0-Instruct-NF4

Text-to-Image • 83B • Updated 20 days ago • 154 • 2

Silicone-Moss/TheDrummer-Skyfall-31B-v4.1-Heretic-Absolute-GGUF

Text Generation • 31B • Updated 20 days ago • 328

Silicone-Moss/TheDrummer-Skyfall-31B-v4.1-Heretic-Clear-GGUF

Text Generation • 31B • Updated 19 days ago • 376

EricRollei/HunyuanImage-3.0-Instruct-Distil-INT8

Text-to-Image • 83B • Updated 20 days ago • 60