Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,236

Base only

Active filters: int4

BareMetalAI/Qwen3-4B-W4A16-AWQ

Text Generation • 2B • Updated Jun 9 • 6

HarmenWessels/granite-4.1-3b-int4-cw-code-ov

Text Generation • Updated Jun 9 • 6

HarmenWessels/LFM2.5-1.2B-Instruct-int4-ov

Text Generation • Updated Jun 9 • 8

challychoi/Lara-TRT-EDGE-LLM-Qwen3.5-9B-INT4

Reza2kn/visualears-fastconformer-fa-full-ab-onnx-w4

Automatic Speech Recognition • Updated Jun 12

Reza2kn/visualears-fastconformer-fa-full-ab-coreml-w4

Automatic Speech Recognition • Updated Jun 11 • 1

Reza2kn/visualears-fastconformer-fa-full-ab-coreml-w4-quality

Automatic Speech Recognition • Updated Jun 11

Reza2kn/visualears-fastconformer-fa-full-ab-litert-w4

Automatic Speech Recognition • Updated Jun 11 • 10

HarmenWessels/Seed-Coder-8B-Instruct-int4-cw-ov

Text Generation • Updated Jun 11 • 5

Mocchibird/Qwen3.6-35B-A3B-W4A4-Hadamard64

Text Generation • Updated Jun 22 • 6 • 1

nakue/SmolLM2-1.7B-W4A16-wiki

Text Generation • 2B • Updated Jun 21 • 29 • 1

nakue/SmolLM2-1.7B-W4A16-instruct

Text Generation • 2B • Updated Jun 21 • 33 • 2

BareMetalAI/Qwen3-8B-W4A16-AWQ

Text Generation • 5B • Updated Jun 12 • 12

nwzjk/MiMo-V2.5-AWQ-int4

Text Generation • 53B • Updated Jun 12 • 29 • 1

shadowlilac/MiMo-V2.5-AWQ-int4

Text Generation • 53B • Updated Jun 12 • 29

BareMetalAI/Llama-3.1-Nemotron-Nano-8B-W4A16-AWQ

Text Generation • 5B • Updated Jun 12 • 8

BareMetalAI/Mistral-7B-Instruct-v0.3-W4A16-AWQ

Text Generation • 4B • Updated Jun 12 • 6

Avesed/Qwopus3.6-27B-v2-abliterated-int4

Text Generation • 12B • Updated Jun 13 • 402

VidraAI/mega-asr-onnx

Automatic Speech Recognition • Updated Jun 13

tonythethompson/Phi-4-Mini-Instruct-CPU-INT4-ONNX

Text Generation • Updated Jun 15

tonythethompson/Phi-4-Mini-Instruct-GPU-INT4-ONNX

Text Generation • Updated Jun 15

spectator2026/MiniMax-M3-AWQ-int4

Image-Text-to-Text • 69B • Updated Jun 24 • 4.37k • 4

kumar2235/Qwen3.5-4B-AWQ

Text Generation • 4B • Updated Jun 17 • 475 • 3

terra-cognita-ai/ResAI_Image-to-Text_final

Image-Text-to-Text • 7B • Updated Jun 15 • 2

pixelkaiser/diffusiongemma-26B-A4B-it-AWQ-MLP-W4A16-G64-S32-L1024

29B • Updated Jun 14 • 1.26k

WaveCut/Qwopus3.6-27B-Coder-FP8-int4-AutoRound

Image-Text-to-Text • 6B • Updated Jun 14 • 11 • 1

fsfsfsfsfsfsfsf24242/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-v2-W4A16

Text Generation • 9B • Updated Jun 14 • 12

Wondernutts/gemma-4-12B-it-qat-q4_0-unquantized-uncensored-heretic-int4-ov

Updated 23 days ago • 36

Wondernutts/gemma-4-31B-it-qat-q4_0-unquantized-uncensored-heretic-int4-ov

Updated 23 days ago • 30

Pranay2412/sarvam-30b-W4A16-Autoround

Text Generation • 7B • Updated Jun 15