Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,238

Base only

Active filters: int4

Pranay2412/sarvam-30b-W4A16-Autoround

Text Generation • 7B • Updated Jun 15

Wondernutts/gemma-4-26B-A4B-it-qat-q4_0-unquantized-uncensored-heretic-int4-ov

Updated 23 days ago • 7.48k

amd/Mistral-7B-Instruct-v0.3-w4a16-llmcompressor-v0.10.0.2

Text Generation • 7B • Updated Jun 17 • 7

XReyRobert/Nex-N2-mini-GPTQ-Pro

Text Generation • 35B • Updated Jun 30 • 74 • 2

ianlav/Ministral-3-8B-Reasoning-INT4-OpenVINO

Text Generation • Updated Jun 15 • 45

terra-cognita-ai/ResAI_Image-to-text_Champ

Image-Text-to-Text • 7B • Updated Jun 15 • 16

XReyRobert/Qwopus3.6-27B-Coder-GPTQ-Pro

Text Generation • 28B • Updated Jun 30 • 281 • 1

XReyRobert/Qwopus3.6-35B-A3B-v1-GPTQ-Pro

Text Generation • 36B • Updated Jun 30 • 114

ForeverBlue/Qwen3-VL-2B-GRACE-W4G128-AWQ

Image-Text-to-Text • 0.9B • Updated 3 days ago • 28 • 1

tonera/Qwen-Image-Edit-2511-Lightning-Nunchaku

Image-to-Image • Updated Jun 23 • 237 • 3

amd/Llama-3.3-70B-Instruct-w4a16-llmcompressor-v0.11.0

Text Generation • 11B • Updated Jun 17 • 332 • 1

xThr45hx/Gemma3-1B-IT-Tensor-G4-NPU

Text Generation • Updated Jul 4 • 32 • 2

sahilchachra/LocateAnything-3B-AWQ-W4A16

Image-Text-to-Text • 4B • Updated Jun 17 • 223

XReyRobert/Qwopus3.6-27B-v2-GPTQ-Pro-MTP-BF16

Image-Text-to-Text • 28B • Updated Jun 17 • 418

jarvis-pet/Qwen3.6-35B-A3B-int4-ov

Image-Text-to-Text • Updated Jun 17 • 12

quant-mind/Huihui-Qwen3-VL-8B-Instruct-abliterated-AWQ-int4

Image-Text-to-Text • 9B • Updated Jun 18 • 228 • 1

jarvis-pet/gemma-4-26B-A4B-int4-ov

Image-Text-to-Text • Updated Jun 18 • 5

HarmenWessels/granite-4.1-8b-int4-cw-code-ov

Text Generation • Updated Jun 18 • 7

sahilchachra/Qwen3.6-27B-Fable-5-AWQ-W4A16

Image-Text-to-Text • 28B • Updated Jun 18 • 226

rootonchair/ERNIE-Image-Turbo-nunchaku-lite

Text-to-Image • Updated Jul 1 • 42

mavis-ai/Multilingual-e5-large-Q4

Feature Extraction • Updated Jun 18 • 24

valoomba/nemotron-speech-en-0.6b-onnx-1120ms-int4

Automatic Speech Recognition • Updated Jun 19

tonera/FLUX.2-klein-4B-Nunchaku

Image-to-Image • 4B • Updated Jun 23 • 824 • 5

sahilchachra/Qwen3.6-35B-A3B-uncensored-heretic-AWQ

Text Generation • 35B • Updated Jun 19 • 11.3k • 1

tonera/Qwen-Image-2512-Lightning-Nunchaku

Text-to-Image • 20B • Updated Jun 23 • 64 • 2

decipherpunk/voxyne

Text Generation • Updated Jun 20

vishnu0967/medgemma-1.5-4b-it-openvino-int4

Image-Text-to-Text • Updated Jun 20 • 4

Avesed/Qwen3.6-27B-INT4-W4A16

Text Generation • 28B • Updated Jun 23 • 3.19k • 2

rufatronics/farmbot-crop-assistant

0.1B • Updated Jul 2 • 5

Avesed/Qwen3.6-35B-A3B-INT4-W4A16

Text Generation • 36B • Updated Jun 23 • 2.16k • 1