Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,250

Base only

Active filters: int4

AMAImedia/Qwen3.5-9B-Darwin-Opus-NOESIS-AWQ-INT4

Image-Text-to-Text • 9B • Updated 4 days ago • 252 • 20

AMAImedia/Qwen3-1.7B-TTS-Cross-Darwin-NOESIS-AWQ-INT4

Text-to-Speech • 2B • Updated 4 days ago • 33 • 14

AMAImedia/Qwen3.5-35B-A3B-Darwin-Opus-NOESIS-AWQ-INT4

Text Generation • 20B • Updated 4 days ago • 25 • 11

foryoung365/Fun-ASR-Nano-2512-int4-onnx

Automatic Speech Recognition • Updated Apr 19 • 1

atbender/Qwen3.6-VL-REAP-26B-A3B-W4A16

Text Generation • 1B • Updated Apr 19 • 452 • 7

eschmidbauer/parakeet-unified-en-0.6b-c

Automatic Speech Recognition • Updated Apr 19 • 1

YuYu1015/Huihui-Qwen3.6-35B-A3B-abliterated-int4-AutoRound

Text Generation • 7B • Updated Jun 8 • 1.09k • 3

qubitron/medgemma-1.5-4b-it-GGUF-int4

4B • Updated Apr 20 • 16

kenpath/svara-tts-v1-openvino-int4

Text-to-Speech • Updated Apr 21 • 248 • 2

dgrauet/ernie-image-turbo-mlx-q4

Updated 5 days ago

dgrauet/ernie-image-sft-mlx-q4

Updated 5 days ago

dgrauet/ernie-image-pe-mlx-q4

Updated 5 days ago

imsufan/Qwen3-4B-DML-ONNX

shieldstar/Qwen3.6-35B-A3B-int4-AutoRound-EC

Image-Text-to-Text • 6B • Updated Apr 23 • 8.18k • 7

thebnbrkr/qwen3-0.6b-awq-hyperband

Text Generation • 0.6B • Updated Apr 22 • 11 • 2

athanor-ai/DeepSeek-Prover-V2-7B-GPTQ-4bit

Text Generation • 7B • Updated Apr 24 • 6 • 1

raydelossantos/Qwen3.6-27B-GPTQ-Int4

Text Generation • 28B • Updated Apr 24 • 731 • 4

aufklarer/VibeVoice-Realtime-0.5B-MLX-INT4

Text-to-Speech • 0.4B • Updated Apr 25 • 45

aufklarer/VibeVoice-1.5B-MLX-INT4

Text-to-Speech • 0.8B • Updated Apr 25 • 108

LeonLeeeeeeeee/Juggernaut-XL_v9_RunDiffusionPhoto_v2

Text-to-Image • 3B • Updated Apr 25 • 19

5dimension/sentinel-tiny-text-int4

5dimension/sentinel-tiny-image-int4

5dimension/sentinel-tiny-video-int4

aufklarer/MADLAD400-3B-MT-MLX

Translation • Updated May 28 • 174

EnsueAI/DeepSeek-V4-Flash-Base-INT4

Updated Apr 26 • 8

abhinand/Qwen3.6-35B-A3B-int4-AutoRound

Image-Text-to-Text • 6B • Updated Apr 27 • 233

drawais/Qwen3-14B-AWQ-INT4

Text Generation • 15B • Updated Apr 27 • 34

drawais/Qwen3-14B-HQQ-INT4

Text Generation • Updated Apr 28 • 20

drawais/Qwen3-32B-AWQ-INT4

Text Generation • 33B • Updated Apr 28 • 192

drawais/Qwen3-32B-HQQ-INT4

Text Generation • Updated Apr 28 • 14