Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,220

Base only

Active filters: int4

Wondernutts/diffusiongemma-26B-A4B-it-openvino-int4

Updated about 1 month ago • 24 • 1

DimQ1/sortformer-4spk-v2-onnx-int4-cpu

Audio Classification • Updated Jul 12

rapatel0/Ornith-1.0-35B-RTN-AWQ-asym

Text Generation • 6B • Updated Jul 12 • 30

lite-infer/flux.1-kontext-dev-nunchaku-lite-int4_r32-bnb4-text-encoder

Image-to-Image • 5B • Updated Jul 12 • 2

lite-infer/flux.1-schnell-nunchaku-lite-int4_r32-bnb4-text-encoder

Text-to-Image • 5B • Updated Jul 12 • 12

lite-infer/flux.1-krea-dev-nunchaku-lite-int4_r32-bnb4-text-encoder

Text-to-Image • 5B • Updated Jul 12 • 9

lite-infer/flux.1-dev-nunchaku-lite-int4_r32-bnb4-text-encoder

Text-to-Image • 5B • Updated Jul 12 • 29

lite-infer/z-image-turbo-nunchaku-lite-int4_r32-bnb4-text-encoder

Text-to-Image • 3B • Updated Jul 12 • 42

gubernac/GLM-5.2-colibri-int4-with-int8-mtp

Updated Jul 12 • 24 • 1

UnderstandLing/Hy3-colibri-int4

Text Generation • Updated Jul 13 • 298 • 4

ONTONOUS/gemma-4-12B-fable5-uncensored-int4-ov

Text Generation • Updated Jul 13 • 20

fivetech/MiMo-V2.5-colibri-peng-int4-zstd

Updated Jul 13 • 23 • 1

danielrmay/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-W4A16

Text Generation • 82B • Updated Jul 17 • 811 • 7

milo01/INT4-Convrot-Comfy-Models

Updated Jul 13 • 1

c-bf/GLM-5.2-AutoRound-W4G64-MTP

Text Generation • 122B • Updated Jul 14 • 131 • 1

ONTONOUS/gemma-4-E2B-uncensored-int4-ov

Image-Text-to-Text • Updated Jul 14 • 9

ONTONOUS/gemma-4-E4B-uncensored-int4-ov

Image-Text-to-Text • Updated Jul 14 • 38

canada-quant/hy3-w4a16-mtp

Text Generation • 47B • Updated about 1 month ago • 1.61k • 5

deepanwa/Samosa-Chat-Qwen3.6-35B-A3B-group32

Text Generation • Updated Jul 15 • 61

mirai-community/granite-3.3-2b-instruct-int4-gram

1B • Updated 11 days ago • 11

abliter8-ai/Roo-Voice_MOSS_TTS_LT_int4

Text-to-Speech • 3B • Updated Jul 15 • 21

exzile/GLM-Z1-32B-0414-int4-ov

Text Generation • Updated Jul 15 • 10

sabrewing-engine/Inkling-colibri-int4

Updated 21 days ago • 123 • 1

simaai/Gemma-3-1B-it-GPTQ-Safetensors

Text Generation • 1B • Updated 19 days ago • 48

simaai/Llama-2-7B-chat-hf-GPTQ-Safetensors

Text Generation • 7B • Updated 19 days ago • 36

simaai/Llama-3.1-8B-Instruct-GPTQ-Safetensors

Text Generation • 8B • Updated 19 days ago • 38

simaai/Qwen3-1.7B-GPTQ-Safetensors

Text Generation • 2B • Updated 20 days ago • 28

simaai/Qwen3-4B-Instruct-2507-GPTQ-Safetensors

Text Generation • 4B • Updated 20 days ago • 25

simaai/Qwen3-8B-GPTQ-Safetensors

Text Generation • 8B • Updated 20 days ago • 30

Wondernutts/Ternary-Bonsai-27B-int4-sym-ov

Image-Text-to-Text • Updated 23 days ago • 22