Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

81

Base only

Active filters: ampere

halt95/Qwen3.8-Flash-Next-W4A16-Merlin

Image-Text-to-Text • 124B • Updated about 1 hour ago • 1.3k • 17

halt95/Swift1.5-Huihui-Qwen3.8-Flash-Next-W4A16-Merlin

Image-Text-to-Text • 124B • Updated about 1 hour ago • 156 • 3

halt95/ThinkingCap-Qwen3.8-27B-W4A16-Merlin

Image-Text-to-Text • 27B • Updated about 1 hour ago • 211 • 4

jakeatx/Qwen3.8-27B-GGUF

27B • Updated Sep 18 • 190 • 1

imgailab/sdxl-trtx-bf16-ampere

Updated Aug 12, 2025 • 5

imgailab/flux1-schnell-bf16-ampere

Text-to-Image • Updated Aug 13, 2025

imgailab/flux1-dev-bf16-ampere

Text-to-Image • Updated Aug 13, 2025

imgailab/sdxl-bf16-ampere

Text-to-Image • Updated Aug 13, 2025

Winnougan/LTX-2.3-INT8

Updated Jun 27 • 21

sch0tten/Qwen3.5-27B-research-AWQ

Text Generation • 10B • Updated Jun 12 • 1.04k • 2

pranay5255/flash-attn-v2-ampere

Updated Apr 14 • 1

useful-quants/GLM-4.6V-Flash-W4A16-BF16Vision

Image-Text-to-Text • 10B • Updated Jun 18 • 23 • 2

useful-quants/InternVL3_5-4B-Instruct-W4A16-BF16Vision

Image-Text-to-Text • 5B • Updated Apr 30 • 6

useful-quants/Mistral-NeMo-Minitron-8B-Instruct-W4A16

Text Generation • 8B • Updated Apr 30 • 18

useful-quants/Phi-4-mini-instruct-W4A16

Text Generation • 4B • Updated Apr 30 • 17

useful-quants/Qwen3-4B-Instruct-2507-W4A16-G128

Text Generation • 4B • Updated May 6 • 15

useful-quants/Qwen3-VL-4B-Instruct-W4A16-BF16Vision

Image-Text-to-Text • 4B • Updated May 7 • 25

mattbucci/gemma-4-21B-REAP-AWQ

Image-Text-to-Text • 26B • Updated May 10 • 7

useful-quants/Ministral-3-3B-Instruct-2512-W4A16-BF16Vision

Text Generation • 4B • Updated Jun 11 • 23

aidendle94/diffusiongemma-26B-A4B-it-INT8-dynamic

Text Generation • 26B • Updated Jun 12 • 301 • 4

thad0ctor/torch2.12-cu133-cp312-wheels

Updated Jun 15 • 4

aleada/Pixtral-12B-W4A16

Image-Text-to-Text • 13B • Updated Sep 16 • 266 • 1

aleada/Llama-3.2-11B-Vision-Instruct-W4A16

Image-Text-to-Text • 11B • Updated Sep 16 • 74

aleada/Phi-4-mini-instruct-W4A16

Text Generation • 4B • Updated Sep 16 • 150

aleada/SmolLM3-3B-W4A16

Text Generation • 3B • Updated Sep 16 • 143

aleada/Phi-4-W4A16

Text Generation • 15B • Updated Sep 16 • 155

aleada/Gemma-3-12B-it-W4A16

Image-Text-to-Text • 12B • Updated Sep 16 • 35

Winnougan/Wan2.2-INT8-Convrot

Updated Jul 1 • 35

Israeli-AI/DeepSeek-v4-flash-180b-W4A16-VOLTA-Ampere

Text Generation • 180B • Updated Sep 2 • 233 • 2

Relativ3pa1n/Laguna-S-2.1-W4A16

Text Generation • 22B • Updated Jul 25 • 34 • 1