Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

801

Base only

Active filters: int4

PhalaCloud/GLM-5.2-W4AFP8

Text Generation • 392B • Updated 3 days ago • 6.39k • 20

mconcat/Qwopus3.6-27B-v2-AWQ-4bit

Text Generation • 11B • Updated May 25 • 22.9k • 7

CosmicRaisins/GLM-5.2-MTP-INT4-aligned

Text Generation • 9B • Updated 2 days ago • 294 • 3

webhie/Qwen3.6-27B-int4-AutoRound-Code

Image-Text-to-Text • 6B • Updated May 12 • 37.1k • 13

terra-cognita-ai/ResAI_Image-to-Text_final

Image-Text-to-Text • 7B • Updated 10 days ago • 176 • 2

tonera/Qwen-Image-2512-Lightning-Nunchaku

Text-to-Image • Updated 3 days ago • 82 • 2

empirischtech/DeepSeek-R1-Distill-Qwen-32B-gptq-4bit

Text Generation • 33B • Updated Apr 20 • 87 • 16

DudePls/Cydonia-24B-v4.3-OpenVINO-INT4

Text Generation • Updated Jan 2 • 6 • 1

bullpoint/Qwen3-Coder-Next-AWQ-4bit

Text Generation • 14B • Updated Feb 3 • 195k • 29

Teaspoon-AI/Voxtral-Mini-4B-INT4-Jetson

Updated Feb 16 • 11 • 4

tonera/FLUX.2-klein-9b-kv-Nunchaku

Image-to-Image • Updated 3 days ago • 381 • 9

MJPansa/MiniMax-M2.7-REAP-172B-A10B-AutoRound-W4A16

Text Generation • 24B • Updated Apr 15 • 2.21k • 11

palmfuture/Qwen3.6-35B-A3B-GPTQ-Int4

Image-Text-to-Text • 36B • Updated Apr 26 • 451k • 24

AMAImedia/Qwen3.5-9B-Darwin-Opus-NOESIS-AWQ-INT4

Image-Text-to-Text • 9B • Updated Apr 26 • 267 • 14

drawais/Qwen3-Embedding-4B-AWQ-INT4

Text Generation • 4B • Updated May 2 • 55.5k • 4

drawais/Qwen3-Reranker-4B-AWQ-INT4

Text Generation • 4B • Updated May 2 • 13.4k • 2

drawais/DeepSeek-R1-Distill-Qwen-32B-AWQ-INT4

Text Generation • 33B • Updated May 3 • 50 • 1

drawais/Qwen3-Embedding-8B-AWQ-INT4

Text Generation • 8B • Updated May 3 • 168k • 3

ncoder-ai/VibeVoice-Large-AWQ

Text-to-Speech • 9B • Updated May 7 • 348 • 1

kizuna-intelligence/Command-A-Plus-Lite

Updated May 22 • 1

squishai/Llama-3.2-1B-Instruct-bf16-squished

0.2B • Updated 12 minutes ago • 60 • 1

squishai/Qwen2.5-1.5B-Instruct-bf16-squished

0.2B • Updated 15 minutes ago • 68 • 1

squishai/Qwen3-4B-bf16-squished

0.6B • Updated 15 minutes ago • 30 • 2

squishai/Qwen3-8B-bf16-squished

1B • Updated 15 minutes ago • 32 • 2

squishai/Llama-3.2-3B-Instruct-bf16-squished

0.5B • Updated 12 minutes ago • 162 • 1

squishai/Qwen2.5-7B-Instruct-bf16-squished

1B • Updated 15 minutes ago • 122 • 2

squishai/gemma-3-1b-it-bf16-squished

0.2B • Updated 12 minutes ago • 115 • 2

nakue/SmolLM2-1.7B-W4A16-wiki

Text Generation • 2B • Updated 4 days ago • 108 • 1

nakue/SmolLM2-1.7B-W4A16-instruct

Text Generation • 2B • Updated 4 days ago • 98 • 2

XReyRobert/Qwopus3.6-27B-Coder-GPTQ-Pro

Text Generation • 28B • Updated 5 days ago • 115 • 1