Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

677

Base only

Active filters: int4

inference4j/phi-3-mini-4k-instruct

Text Generation • Updated Feb 16 • 4

inference4j/deepseek-r1-distill-qwen-1.5b

Text Generation • Updated Feb 16

Ex0bit/Kimi-K2.5-PRISM-REAP-530B-A32B

Text Generation • 91B • Updated Feb 22 • 155 • 21

mayflowergmbh/bert-german-ler-onnx-int4

Token Classification • Updated Feb 18 • 7

inference4j/phi-3.5-vision-instruct

Image-Text-to-Text • Updated Feb 18

nitrox/Qwen3-4B-abliterated-v2

4B • Updated Feb 20 • 2

mradermacher/Qwen3-4B-abliterated-v2-GGUF

4B • Updated Feb 20 • 134

mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF

4B • Updated Feb 20 • 438 • 1

Sophia-AI/Qwen3-30B-A3B-Instruct-2507-AWQ-W4A16

Text Generation • 5B • Updated Feb 25 • 84

apolo13x/Qwen3.5-35B-A3B-quantized.w4a16

Image-Text-to-Text • 35B • Updated Feb 27 • 1.3k • 2

YCWTG/Qwen3-Coder-30B-A3B-Instruct-int4-mixed-AutoRound

Text Generation • 6B • Updated Apr 1 • 31

apolo13x/Qwen3.5-27B-quantized.w4a16

Image-Text-to-Text • 28B • Updated Feb 27 • 448 • 3

apolo13x/Qwen3.5-9B-quantized.w4a16

Image-Text-to-Text • 10B • Updated Mar 11 • 4.43k

atbender/Qwen3.5-REAP-262B-A17B-W4A16

Text Generation • 40B • Updated Mar 31 • 76 • 3

suedegambit/Gemma-3-27B-it-NP-Abliterated-GPTQ-INT4-128g

Image-Text-to-Text • 5B • Updated Mar 9 • 5

tonera/Chroma1-HD-SVDQ

Text-to-Image • Updated Apr 3 • 297 • 5

lemuriandezapada/VibeVoice-ASR-awq-int4

Automatic Speech Recognition • 1B • Updated Mar 8 • 58 • 5

lemuriandezapada/VibeVoice-ASR-gptq-int4

Automatic Speech Recognition • 1B • Updated Mar 8 • 6 • 1

sonic-speech/parakeet-tdt-0.6b-v3-int4

Automatic Speech Recognition • 0.2B • Updated Mar 8 • 21

sonic-speech/parakeet-tdt-0.6b-v2-int4

Automatic Speech Recognition • 0.2B • Updated Mar 8 • 6

steadyflow/Phi-4-reasoning-AWQ

Text Generation • 15B • Updated Mar 9 • 247

steadyflow/Phi-4-mini-reasoning-AWQ

Text Generation • 4B • Updated Mar 9 • 25

atbender/Qwen3.5-REAP-20B-A3B-W4A16

Text Generation • 3B • Updated Mar 10 • 101

codgician/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-GPTQ-int4

Image-Text-to-Text • 28B • Updated Mar 12 • 102 • 7

oxzoid/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-GPTQ-int4

Image-Text-to-Text • 28B • Updated Mar 11 • 26 • 7

codgician/Qwen3.5-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GPTQ-int4

Image-Text-to-Text • 36B • Updated Mar 12 • 1.51k • 9

JohnTdi/Qwen3-14B-INT4-Mixed-GPTQ

Text Generation • Updated Mar 11

JohnTdi/Qwen3-14B-INT4-Pure-GPTQ

Text Generation • Updated Mar 11

thehighnotes/vllm-jetson-orin

Text Generation • Updated Mar 11

tonera/Beyond_Reality_Zimage_v3_svdq

Text-to-Image • Updated Apr 3 • 66 • 1