Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,247

Base only

Active filters: int4

machine-made-Fibre/Qwen3-4B-Instruct-2507-heretic-OpenVINO-INT4-NPU

Text Generation • Updated Jun 25 • 11

exzile/Qwythos-9B-Claude-Mythos-5-1M-text-int4-ov

Text Generation • Updated Jun 25 • 9 • 2

Patil/krea-turbo-svdquant

Text-to-Image • Updated Jun 26 • 59 • 7

gonuit/Qwen3-VL-Embedding-8B-AWQ-4bit

Sentence Similarity • 2B • Updated Jun 26 • 3.26k

Sebesky/MiniMax-M3-W4A16-GPTQ

Image-Text-to-Text • 430B • Updated Jun 26 • 1.58k • 3

Prog-up/gemma-4-E2B-it-int4-ov

Text Generation • Updated Jun 26 • 7

Prog-up/gemma-4-E4B-it-int4-ov

Text Generation • Updated Jun 26 • 11

Prog-up/Qwen2.5-3B-Instruct-int4-ov

Text Generation • Updated Jun 26 • 10

srv-sngh/Ornith-1.0-9B-MLX-4bit

Image-Text-to-Text • 2B • Updated Jun 27 • 115 • 1

AnishRacherla/aya-expanse-8b-compressed-final

Translation • 7B • Updated Jun 27 • 4

cyburn/Ornith-1.0-35B-int4-AutoRound

Text Generation • 1B • Updated Jun 28 • 594 • 1

Pilcothink/Ornith-1.0-397B-W4A16-AutoRound

Text Generation • Updated Jun 28 • 1.46k • 3

GRRNMAKE/SYNAXIM

Text Generation • Updated 21 days ago • 1

almernzh/Gemma-4-12B-it-AWQ-INT4-Multimodal-LongContext

Image-Text-to-Text • 12B • Updated Jun 28 • 509

XReyRobert/Ornith-1.0-35B-GPTQ-Pro-FOEM-4bit-g128-ns256

Text Generation • 35B • Updated Jul 2 • 6.55k • 5

TrNi/efficient-cube3d

Text-to-3D • Updated Jul 13 • 8

nota-ai/Qwen3.5-122B-A10B-NotaCompression-INT4

Text Generation • 22B • Updated Jun 29 • 68

toxzak/gemma4-e2b-exp-quant

Text Generation • Updated Jun 29

amnibro/granite41-8b-gf17-atex

5B • Updated Jun 29 • 7

litert-community/Qwen3-0.6B-int4

Text Generation • Updated Jun 30 • 1.61k • 1

pyromind/qwen3.5-4b-debug-mlx-int4

Text Generation • 2B • Updated Jun 30 • 24

Teora/qwen3.5-4b-awq-v128k

4B • Updated Jun 30 • 102

hanemay/smartsightCoach

5B • Updated 1 day ago • 162

DimQ1/nemotron-3.5-asr-streaming-0.6b-onnx-int4-cpu

Automatic Speech Recognition • Updated Jun 30

sanskar003/Qwen3.5-4B-AWQ

Image-Text-to-Text • 5B • Updated 27 days ago • 62 • 5

rapatel0/Ornith-1.0-35B-AWQ-asym

Text Generation • 6B • Updated Jul 1 • 326 • 2

88plug/Kimi-VL-A3B-Thinking-2506-W4A16

Image-Text-to-Text • 17B • Updated Jul 10 • 134

xThr45hx/Josiefied-Qwen3-4B-TRT-LLM

bannert/tmax-27b-AWQ-BF16-INT4

Text Generation • 29B • Updated Jul 1 • 220

casperhansen/Qwen3.6-35B-A3B-INT4-RTN

Image-Text-to-Text • 37B • Updated Jul 1 • 458