Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,439

Base only

Active filters: quantization

rdtand/Laguna-S-2.1-prismaquant-gridbook-6bit-vllm

Text Generation • 85B • Updated 15 days ago • 592 • 6

weili-0234/Qwen3.5-27B-MXFP4-QAD-W4A4-LR1e-5-s1000

Text Generation • 16B • Updated 20 days ago • 36

mncai/nf4moe

Updated 20 days ago

weili-0234/Qwen3.5-27B-MXFP4-GPTQ

Text Generation • 16B • Updated 20 days ago • 40

weili-0234/Qwen3.5-27B-NVFP4-GPTQ

Text Generation • 17B • Updated 20 days ago • 36

0xSero/GLM-5.2-MXFP8-NVFP4-NF3-Hybrid-Vision

Image-Text-to-Text • 348B • Updated 18 days ago • 198 • 7

ajh-code/Mage-Flow-NVFP4-AJH

Text-to-Image • 3B • Updated 19 days ago • 73 • 1

Thox-ai/ThoxSpeech-ASR-BitNet

Automatic Speech Recognition • 2B • Updated 1 day ago • 34

weili-0234/Qwen3.5-27B-MXFP4-QAD-W4A4-LR1e-5-s2640

Text Generation • 16B • Updated 19 days ago • 31

koryl/bge-m3-quantized-int8

Feature Extraction • Updated 19 days ago • 78

felipesztutman/krea-realtime-video-14b-w4a4

Text-to-Video • Updated 19 days ago

ajh-code/Mage-Flow-NVFP4-Balanced-AJH

Text-to-Image • 3B • Updated 19 days ago • 31 • 1

ajh-code/Mage-Flow-NVFP4-Quality-AJH

Text-to-Image • 4B • Updated 19 days ago • 20 • 1

ajh-code/Mage-Flow-Turbo-NVFP4-Balanced-AJH

Text-to-Image • 3B • Updated 19 days ago • 64

tooltd/Qwen3.6-27B-Architect-Polaris2-Fable-B-F451-Tess-GGUF

27B • Updated 13 days ago • 178

FartingBackwards/wan2.1-vace-14b-int8-convrot

Updated 19 days ago

suryatmodulus/VibeVoice-ASR-BitNet

Automatic Speech Recognition • 0.3B • Updated 19 days ago • 88

FartingBackwards/wan2.2-fun-vace-14B-int8-convrot

Updated 19 days ago

ajh-code/Mage-Flow-Turbo-XPO3-NVFP4

Text-to-Image • Updated 14 days ago • 3.79k

weili-0234/Qwen3.5-27B-NVFP4-QAD-W4A16-LR1e-5-s2640

17B • Updated 19 days ago • 24

AtesiT/bge-m3-int8-dynamic-quantized

Feature Extraction • Updated 19 days ago • 33

ghostchoir/rebuttal_w4g128_awq_w2

Text Generation • 2B • Updated 18 days ago • 31

ghostchoir/rebuttal_w4g128_awq

Text Generation • 2B • Updated 18 days ago • 31

Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV

Text Generation • 16B • Updated 14 days ago • 586 • 1

ghostchoir/rebuttal_w3g128_awq_w2

Text Generation • 2B • Updated 18 days ago • 32

ghostchoir/rebuttal_w3g128_awq

Text Generation • 2B • Updated 18 days ago • 35

weili-0234/Qwen3.5-27B-NVFP4-QAD-W4A4-LR1e-5-s2640

17B • Updated 18 days ago • 30

FartingBackwards/wan2.2-t2v-14B-int8-convrot

Text-to-Video • Updated 18 days ago

weili-0234/Qwen3.5-27B-MXFP4-QAD-W4A16-LR1e-5-s2640

16B • Updated 18 days ago • 37

weili-0234/Qwen3.5-27B-NVFP4-QAD-W4A16-LR1e-5-s2640-A4Schema

17B • Updated 18 days ago • 30