Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

82

Base only

Active filters: ampere

halt95/ThinkingCap-Qwen3.8-27B-W4A16-Merlin

Image-Text-to-Text • 27B • Updated 4 days ago • 293 • 4

halt95/Nemotron-3.5-Super-VL-120B-A12B-W4A16-Merlin

Image-Text-to-Text • 129B • Updated 4 days ago • 48 • 2

BlairQ/qwen3.8_27b_idiotSavant_sm_86

Image-Text-to-Text • 27B • Updated 5 days ago • 249 • 3

halt95/Ornith-1.5-122B-A10B-W4A16-Merlin

Image-Text-to-Text • 128B • Updated 4 days ago • 41 • 1

JRamirez-UAB/hybridagent-8b-exl3-vllm-experimental

Text Generation • 3B • Updated 2 days ago • 51 • 1

imgailab/sdxl-trtx-bf16-ampere

Updated Aug 12, 2025 • 5

imgailab/flux1-schnell-bf16-ampere

Text-to-Image • Updated Aug 13, 2025

imgailab/flux1-dev-bf16-ampere

Text-to-Image • Updated Aug 13, 2025

imgailab/sdxl-bf16-ampere

Text-to-Image • Updated Aug 13, 2025

Winnougan/LTX-2.3-INT8

Updated Jun 27 • 21

sch0tten/Qwen3.5-27B-research-AWQ

Text Generation • 10B • Updated Jun 12 • 1.04k • 2

pranay5255/flash-attn-v2-ampere

Updated Apr 14 • 1

useful-quants/GLM-4.6V-Flash-W4A16-BF16Vision

Image-Text-to-Text • 10B • Updated Jun 18 • 21 • 2

useful-quants/InternVL3_5-4B-Instruct-W4A16-BF16Vision

Image-Text-to-Text • 5B • Updated Apr 30 • 4

useful-quants/Mistral-NeMo-Minitron-8B-Instruct-W4A16

Text Generation • 8B • Updated Apr 30 • 18

useful-quants/Phi-4-mini-instruct-W4A16

Text Generation • 4B • Updated Apr 30 • 17

useful-quants/Qwen3-4B-Instruct-2507-W4A16-G128

Text Generation • 4B • Updated May 6 • 14

useful-quants/Qwen3-VL-4B-Instruct-W4A16-BF16Vision

Image-Text-to-Text • 4B • Updated May 7 • 16

mattbucci/gemma-4-21B-REAP-AWQ

Image-Text-to-Text • 26B • Updated May 10 • 8

useful-quants/Ministral-3-3B-Instruct-2512-W4A16-BF16Vision

Text Generation • 4B • Updated Jun 11 • 21

aidendle94/diffusiongemma-26B-A4B-it-INT8-dynamic

Text Generation • 26B • Updated Jun 12 • 244 • 4

thad0ctor/torch2.12-cu133-cp312-wheels

Updated Jun 15 • 4

aleada/Pixtral-12B-W4A16

Image-Text-to-Text • 13B • Updated Sep 16 • 266 • 1

aleada/Llama-3.2-11B-Vision-Instruct-W4A16

Image-Text-to-Text • 11B • Updated Sep 16 • 77

aleada/Phi-4-mini-instruct-W4A16

Text Generation • 4B • Updated Sep 16 • 128

aleada/SmolLM3-3B-W4A16

Text Generation • 3B • Updated Sep 16 • 128

aleada/Phi-4-W4A16

Text Generation • 15B • Updated Sep 16 • 147

aleada/Gemma-3-12B-it-W4A16

Image-Text-to-Text • 12B • Updated Sep 16 • 38

Winnougan/Wan2.2-INT8-Convrot

Updated Jul 1 • 35

Israeli-AI/DeepSeek-v4-flash-180b-W4A16-VOLTA-Ampere

Text Generation • 180B • Updated Sep 2 • 226 • 2