Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,253

Base only

Active filters: int4

caiovicentino1/Qwen3.5-27B-HLWQ-Q5

Text Generation • 27B • Updated Apr 13 • 15 • 10

bjk110/Qwen3.5-122B-A10B-abliterated-AWQ

Text Generation • 21B • Updated Mar 31 • 6.6k • 1

caiovicentino1/Qwen3.5-9B-Claude-Opus-HLWQ-Q5

Text Generation • 9B • Updated Apr 13 • 230 • 4

caiovicentino1/Qwen3.5-27B-Claude-Opus-HLWQ-Q5

Text Generation • 27B • Updated Apr 13 • 19

caiovicentino1/Qwopus3.5-9B-v3-HLWQ-Q5

Text Generation • 3B • Updated Apr 13 • 20 • 9

MarkChen1214/cohere-transcribe-03-2026-CoreML-INT4

Automatic Speech Recognition • Updated Apr 1 • 8

LAXMAYDAY/Qwen_image_edit_2511_int4

Updated Apr 30 • 3

qualcomm-ai-hub-community/OpenSparX-7b-cabin-sft-v2-gptq-int4

Image-Text-to-Text • 8B • Updated 2 days ago • 18

HyX3/MiniCPM-V-4-OpenVINO-INT4

Image-to-Text • Updated Apr 2 • 6

HyX3/Magnum-12B-OpenVINO-INT4

Text Generation • Updated Apr 2 • 7 • 1

Lorbus/Qwopus3.5-27B-v3-int4-autoround

6B • Updated Apr 3 • 81 • 4

dahus/gemma-4-e2b-it-q4-nf4

Any-to-Any • 5B • Updated Apr 8 • 7

caiovicentino1/Harmonic-27B-HLWQ-Q5

Text Generation • 26B • Updated Apr 13 • 9

caiovicentino1/Huihui-Qwopus3.5-27B-v3-abliterated-HLWQ-Q5

Text Generation • 26B • Updated Apr 18 • 19 • 15

tonera/FLUX.2-klein-9b-kv-Nunchaku

Image-to-Image • 9B • Updated Jun 23 • 164 • 10

mochiexists528/ace-step-mlx-weights-q4

Z3NN001/gemma4-21b-a4b-REAP-it-mlx-Q4

Image-to-Text • 4B • Updated Apr 6 • 90 • 4

caiovicentino1/Qwopus-MoE-35B-A3B-HLWQ-Q5

Text Generation • 35B • Updated Apr 14 • 9 • 7

Charitarth/olmOCR-2-7B-1025-GPTQ-W4A16

Image-Text-to-Text • 3B • Updated Apr 7 • 1.81k • 1

mconcat/Qwopus3.5-27B-v3-AWQ-4bit

Text Generation • 29B • Updated Apr 8 • 14 • 2

RESMP-DEV/Qwen3.5-35B-A3B-GPTQ-Hybrid

36B • Updated Apr 8 • 6

dylanneve1/Qwen3.5-0.8B_int4_sym_group-1_dyn_stateful

Updated Apr 9 • 6

caiovicentino1/Qwopus3.5-9B-v3-HLWQ-v7-GPTQ

Text Generation • 9B • Updated Apr 13 • 20 • 6

caiovicentino1/Qwopus3.5-27B-v3-HLWQ-v7-GPTQ

Text Generation • 27B • Updated Apr 13 • 7 • 6

dylanneve1/Qwen3.5-0.8B_int4_sym_group128_dyn_stateful

Updated Apr 9 • 7

vrfai/Qwen3-ASR-1.7B-int4

Automatic Speech Recognition • 2B • Updated Jun 6 • 3

Jonatan-1987-xtv/gemma-4-e2b-turboquant-standard-int4

Image-Text-to-Text • 4B • Updated Apr 10 • 5

Jonatan-1987-xtv/gemma-4-e2b-turboquant-atq3

Image-Text-to-Text • 4B • Updated Apr 10 • 4

Jonatan-1987-xtv/gemma-4-e2b-turboquant-tql-4b

Image-Text-to-Text • 4B • Updated Apr 10 • 8

Jonatan-1987-xtv/gemma-4-e2b-turboquant-tql-3b

Image-Text-to-Text • 4B • Updated Apr 10 • 6