Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,235

Base only

Active filters: int4

openhubresearch/ATLAS-OLMo-3-32B-Think-v4

Text Generation • Updated Jul 8

sanskar003/Qwen3.5-9B-AWQ

Image-Text-to-Text • 9B • Updated 26 days ago • 2.33k • 2

MirilAI/Miril-Drone-2B-1-bnb4

Image-Text-to-Text • 5B • Updated 28 days ago • 51

MirilAI/Miril-Drone-2B-1-MLX-4bit

Image-Text-to-Text • 1B • Updated 28 days ago • 25

LeadingPoint/gemma-4-E4B-it-assistant-w4a16

Text Generation • 78.8M • Updated Jul 7 • 9

compute1/Agents-A1-GPTQ-INT4-Sym

Text Generation • 7B • Updated Jul 11 • 1.35k • 2

sahilchachra/ThinkingCap-Qwen3.6-27B-AWQ

Image-Text-to-Text • 27B • Updated 19 days ago • 532 • 3

lite-infer/Qwen-Image-nunchaku-lite-int4_r32-bnb4-text-encoder

Text-to-Image • 8B • Updated Jul 7 • 5 • 1

lite-infer/Qwen-Image-nunchaku-lite-int4_r128-bnb4-text-encoder

Text-to-Image • 9B • Updated Jul 7 • 1

Danny-Dasilva/Qwen3-4B-antidoom-W4A16-GPTQ-g32-DSpark

Text Generation • 4B • Updated Jul 7 • 17

Raiff1982/codette-llama-3.1-8b-openvino

Text Generation • Updated Jul 12 • 81

Danny-Dasilva/Qwen3-8B-antidoom-W4A16-GPTQ-g32-DSpark

Text Generation • 8B • Updated Jul 8 • 206 • 1

katolikov/SmolVLM2-2.2B-vknn

Danny-Dasilva/Qwen3-14B-antidoom-W4A16-GPTQ-g32-DSpark

Text Generation • 15B • Updated Jul 11 • 77

vanch007/mlx-MOSS-Transcribe-Diarize-4bit

Automatic Speech Recognition • 0.4B • Updated Jul 9 • 80

xjn0412/qwen3p5-0p8b-debug-q4

Hakureirm/rwkv7-sglang-w4gptq-1.5b

Text Generation • 0.9B • Updated 12 days ago

Hakureirm/rwkv7-sglang-w4rtn-1.5b

Text Generation • 0.9B • Updated 12 days ago

Hakureirm/rwkv7-sglang-w4gptq-7.2b

Text Generation • 4B • Updated 12 days ago

Hakureirm/rwkv7-sglang-w4rtn-7.2b

Text Generation • 4B • Updated 12 days ago

Abdullahu5mani/granite-speech-4.1-2b-nar-cuda

Automatic Speech Recognition • Updated Jul 9

Abdullahu5mani/granite-speech-4.1-2b-nar-portable

Automatic Speech Recognition • Updated Jul 10

LostGentoo/Qwen3.5-4B-AWQ

Image-Text-to-Text • 5B • Updated Jul 10 • 420

LostGentoo/Qwen3-Embedding-8B-AWQ

Feature Extraction • 8B • Updated Jul 10 • 367 • 1

wazimondo/Qwen-Image-Edit-2511-int4-tensorwise-mixed

wazimondo/Qwen_image_edit_2511_int4

ajinkyamulay/iolai-qwen35-solver

Text Generation • 9B • Updated Jul 12 • 73

rwillox/Ornith-1.0-35B-int4-AutoRound

1B • Updated Jul 11 • 93

fivetech/MiMo-V2.5-colibri-peng-int4

Updated 29 days ago • 78 • 2

whpthomas/Ornith-1.0-35B-int4-AutoRound

Text Generation • 1B • Updated Jul 11 • 1.22k • 2