Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

800

Base only

Active filters: int4

PhalaCloud/GLM-5.2-W4AFP8

Text Generation • 392B • Updated 3 days ago • 6.39k • 20

mconcat/Qwopus3.6-27B-v2-AWQ-4bit

Text Generation • 11B • Updated May 25 • 22.9k • 7

CosmicRaisins/GLM-5.2-MTP-INT4-aligned

Text Generation • 9B • Updated 2 days ago • 294 • 3

webhie/Qwen3.6-27B-int4-AutoRound-Code

Image-Text-to-Text • 6B • Updated May 12 • 37.1k • 13

terra-cognita-ai/ResAI_Image-to-Text_final

Image-Text-to-Text • 7B • Updated 10 days ago • 176 • 2

tonera/Qwen-Image-2512-Lightning-Nunchaku

Text-to-Image • Updated 2 days ago • 82 • 2

empirischtech/DeepSeek-R1-Distill-Qwen-32B-gptq-4bit

Text Generation • 33B • Updated Apr 20 • 87 • 16

DudePls/Cydonia-24B-v4.3-OpenVINO-INT4

Text Generation • Updated Jan 2 • 6 • 1

bullpoint/Qwen3-Coder-Next-AWQ-4bit

Text Generation • 14B • Updated Feb 3 • 195k • 29

Teaspoon-AI/Voxtral-Mini-4B-INT4-Jetson

Updated Feb 16 • 11 • 4

tonera/FLUX.2-klein-9b-kv-Nunchaku

Image-to-Image • Updated 2 days ago • 381 • 9

MJPansa/MiniMax-M2.7-REAP-172B-A10B-AutoRound-W4A16

Text Generation • 24B • Updated Apr 15 • 2.21k • 11

palmfuture/Qwen3.6-35B-A3B-GPTQ-Int4

Image-Text-to-Text • 36B • Updated Apr 26 • 451k • 24

AMAImedia/Qwen3.5-9B-Darwin-Opus-NOESIS-AWQ-INT4

Image-Text-to-Text • 9B • Updated Apr 26 • 267 • 14

drawais/Qwen3-Embedding-4B-AWQ-INT4

Text Generation • 4B • Updated May 2 • 55.5k • 4

drawais/Qwen3-Reranker-4B-AWQ-INT4

Text Generation • 4B • Updated May 2 • 13.4k • 2

drawais/DeepSeek-R1-Distill-Qwen-32B-AWQ-INT4

Text Generation • 33B • Updated May 3 • 50 • 1

drawais/Qwen3-Embedding-8B-AWQ-INT4

Text Generation • 8B • Updated May 3 • 168k • 3

ncoder-ai/VibeVoice-Large-AWQ

Text-to-Speech • 9B • Updated May 7 • 348 • 1

kizuna-intelligence/Command-A-Plus-Lite

Updated May 22 • 1

nakue/SmolLM2-1.7B-W4A16-wiki

Text Generation • 2B • Updated 4 days ago • 108 • 1

nakue/SmolLM2-1.7B-W4A16-instruct

Text Generation • 2B • Updated 4 days ago • 98 • 2

XReyRobert/Qwopus3.6-27B-Coder-GPTQ-Pro

Text Generation • 28B • Updated 5 days ago • 115 • 1

sahilchachra/Qwen3.6-35B-A3B-uncensored-heretic-AWQ

Text Generation • 35B • Updated 6 days ago • 622 • 1

XReyRobert/Nex-N2-mini-GPTQ-Pro

Text Generation • 35B • Updated 5 days ago • 54 • 2

Advantech-EIOT/intel_llama-2-chat-7b

Text Generation • Updated Mar 12, 2024 • 5

RedHatAI/zephyr-7b-beta-marlin

Text Generation • 1B • Updated Mar 6, 2024 • 30

RedHatAI/TinyLlama-1.1B-Chat-v1.0-marlin

Text Generation • 0.3B • Updated Mar 6, 2024 • 22.4k • 2

RedHatAI/OpenHermes-2.5-Mistral-7B-marlin

Text Generation • 1B • Updated Mar 6, 2024 • 11 • 2

RedHatAI/Nous-Hermes-2-Yi-34B-marlin

Text Generation • 5B • Updated Mar 6, 2024 • 11 • 5