Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,250

Base only

Active filters: int4

drawais/Qwen2.5-Math-1.5B-Instruct-AWQ-INT4

Text Generation • 2B • Updated May 3 • 4

drawais/Phi-4-mini-instruct-AWQ-INT4

Text Generation • 4B • Updated May 3 • 289

drawais/Phi-3.5-mini-instruct-AWQ-INT4

Text Generation • 4B • Updated May 3 • 192

drawais/Phi-3-medium-4k-instruct-AWQ-INT4

Text Generation • 14B • Updated May 3 • 7

drawais/Yi-1.5-34B-Chat-HQQ-INT4

Text Generation • Updated May 3 • 6

drawais/Qwen2.5-32B-Instruct-HQQ-INT4

Text Generation • Updated May 3 • 6

drawais/Qwen2.5-Coder-32B-Instruct-HQQ-INT4

Text Generation • Updated May 3 • 21

kleybrink/Qwen3.6-35B-A3B-Hybrid-INT4-FP8-MTP

Image-Text-to-Text • 7B • Updated May 3 • 266 • 3

drawais/DeepSeek-R1-Distill-Qwen-32B-HQQ-INT4

Text Generation • Updated May 3 • 18

YuYu1015/Huihui-Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated-int4-AutoRound

Text Generation • 7B • Updated Jun 8 • 483 • 1

justinchuby/gemma-4-e2b-it-onnx

Image-Text-to-Text • Updated Jul 3

drawais/Gemma-4-E4B-text-HQQ-INT4

Text Generation • Updated May 4 • 10

amir22010/voxtral-mini-4b-gptq

Automatic Speech Recognition • 5B • Updated May 13

amir22010/gemma4-e4b-w4a16-it

Text Generation • 8B • Updated Jun 15

jpcurada/SmolLM2-1.7B-Scheduled-QAT-Linear-GGUF

Text Generation • 2B • Updated May 5 • 63 • 1

carloshuang1224/MLX_XiaoMi_MiMo-V2.5-ASR-MLX-INT4

Automatic Speech Recognition • 1B • Updated May 5 • 98

d3dx9/Qwen3.6-27B-Heretic2-Uncensored-Finetune-Thinking-int4-autoround

Text Generation • Updated May 6

drawais/Mistral-7B-Instruct-v0.3-SpinQuant-NVFP4

Text Generation • 4B • Updated May 6 • 10

drawais/Qwen3-8B-SpinQuant-NVFP4

Text Generation • 5B • Updated May 6 • 41

drawais/Qwen3-4B-SpinQuant-NVFP4

Text Generation • 2B • Updated May 6 • 30

drawais/Qwen3-14B-NVFP4

Text Generation • 9B • Updated May 6 • 108

drawais/Phi-4-NVFP4

Text Generation • 9B • Updated May 6 • 12

drawais/Phi-4-reasoning-NVFP4

Text Generation • 9B • Updated May 6 • 85

drawais/Qwen3-32B-NVFP4

Text Generation • 19B • Updated May 6 • 51

drawais/QwQ-32B-NVFP4

Text Generation • 19B • Updated May 6 • 7

drawais/Qwen2.5-Coder-32B-Instruct-NVFP4

Text Generation • 19B • Updated May 6 • 496

drawais/DeepSeek-R1-Distill-Qwen-32B-NVFP4

Text Generation • 19B • Updated May 6 • 53

drawais/Granite-4.1-30B-NVFP4

Text Generation • 16B • Updated May 6 • 256 • 1

BlivionIaG/Qwen3.5-0.8B-AWQ-INT4

Text Generation • 0.8B • Updated May 7 • 746 • 1

Truthseeker87/solarhive-e4b-cactus

Image-Text-to-Text • Updated Jun 8