Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,220

Base only

Active filters: int4

endnai/DeepSeek-V4-Flash-W4A8-FP8

Text Generation • Updated Jul 2 • 48

rootonchair/ERNIE-Image-Turbo-nunchaku-lite-int4

Text-to-Image • 4B • Updated Jul 3 • 2

musk12/apple-fastvlm-cpu-inference-models

Image-Text-to-Text • 0.6B • Updated Jul 2 • 28

poma-ai/Qwen3.6-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated Jul 2 • 317

sahilchachra/Laguna-XS-2.1-W4A16

Text Generation • 34B • Updated Jul 3 • 429 • 2

GRRNMAKE/Magnus-SYMB

Text Generation • Updated Jul 5

lowbitcoffee/GLM-5.2-W4A16

Text Generation • 101B • Updated Jul 3 • 870 • 4

Wondernutts/tvall43-Qwen3.6-35B-A3B-heretic-int4-ov

Image-Text-to-Text • Updated 22 days ago • 37

Sebesky/MiniMax-M3-EAGLE3-RTN-INT4

3B • Updated Jul 4 • 190

Wondernutts/Ornith-1.0-35B-AEON-Ultimate-Uncensored-BF16-int4-ov

Updated Jul 8 • 22 • 1

Wondernutts/Qwen3.6-27B-AEON-Ultimate-Uncensored-BF16-int4-ov

Updated 22 days ago • 33

LAXMAYDAY/Qwen-Image-Edit-2511-int4-tensorwise-mixed

Updated Jul 6 • 2

LAXMAYDAY/Krea-2-Turbo-int4-tensorwise-mixed

Updated Jul 6 • 2

LAXMAYDAY/Krea-2-Raw-int4-tensorwise-mixed

Updated Jul 6 • 6

Danny-Dasilva/gemma-4-12B-it-W4A16-GPTQ-g32-DSpark

Text Generation • 12B • Updated Jul 4 • 715

nonoskygt/Qwen3-VL-30B-A3B-Thinking-abliterated-GPTQ-INT4

Image-Text-to-Text • 31B • Updated Jul 5 • 16

MLXBits/ltx-2.3-10eros-v1.3-dmd-mlx-q4

Image-Text-to-Video • Updated Jul 5 • 144 • 1

sublatesublate-design/PaddleOCR-VL-1.6-OpenVINO-INT4

Updated Jul 7 • 26

lite-infer/ERNIE-Image-Turbo-nunchaku-lite-int4-bnb4-text-encoder

Text-to-Image • 4B • Updated Jul 5 • 8

Trede98/gemma-4-E2B-coreml

Updated Jul 5 • 8

nota-ai/Qwen3.5-4B-QAD-W4A16

Text Generation • 5B • Updated Jul 6 • 508 • 2

nota-ai/Qwen3.5-4B-DFlash-GPTQ-W4A16

Text Generation • 0.5B • Updated Jul 6 • 35 • 1

Hyun9junn/EXAONE-4.5-33B-FlatQuant-W4A16

Image-Text-to-Text • 7B • Updated Jul 10 • 53

AXERA-TECH/MiniCPM-V-4.6-GPTQ-INT4-C256-P6K-CTX8K

Image-Text-to-Text • Updated Jul 6 • 7 • 1

borkiss/lfm2-350m-webgpu

Text Generation • Updated Jul 6

borkiss/qwen35-2b-webgpu

Text Generation • Updated Jul 6

josefprusa/ThinkingCap-Qwen3.6-27B-int4-AutoRound-v1

Text Generation • 6B • Updated Jul 7 • 5.58k • 50

gandamu/flux2-klein-4b-qwen3-4b-webgpu

Text-to-Image • Updated Jul 7

openhubresearch/ATLAS-OLMo-3-32B-Think-v4

Text Generation • Updated Jul 8

sanskar003/Qwen3.5-9B-AWQ

Image-Text-to-Text • 9B • Updated 25 days ago • 2.33k • 2