Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,464

Base only

Active filters: quantization

Tushe/nllb-200-600M-int8-custom-weights-bare-metal

Translation • 0.9B • Updated Feb 25 • 11

elon-trump/pixtral-12b-2409-w4a16-gptq

3B • Updated Apr 25 • 2

damema5941/Qwen-Image-Edit-2511-FP8

Image-to-Image • Updated Feb 26 • 1

Shifusen/Qwen3.5-122B-A10B-abliterated-FP8

Text Generation • 123B • Updated Feb 26 • 743 • 3

joshuaeric/vllm-tool-calling-guide

Text Generation • Updated Feb 26

ApacheOne/ZImageBase-nvfp4_mixed

Updated Apr 19 • 5 • 1

Wojtekb30/Trurl-2-7B-Q4_K_M-GGUF

7B • Updated Feb 26 • 13

chronicskink51/BioMistral-7B-AWQ-QGS128-W4-GEMM

Text Generation • 7B • Updated Feb 27 • 8

CelesteImperia/SDXL-Base

Shifusen/Qwen3.5-122B-A10B-Decensored-SFT-FP8

Image-Text-to-Text • 123B • Updated Mar 2 • 200 • 1

cs2764/MiniMax-M2.5_dq4-mlx

Text Generation • 229B • Updated Mar 2 • 14

cs2764/MiniMax-M2.5_dq3-mlx

Text Generation • 229B • Updated Mar 2 • 13

Ex0bit/Qwen3.5-PRISM-Dynamic-Quant-GGUF

Text Generation • 0.8B • Updated Mar 3 • 491 • 10

aoiandroid/mms-lid-1024-coreml-6bit

Updated May 17 • 1

cs2764/GLM-5_dq3-mlx

Text Generation • 744B • Updated Mar 3 • 11

abrarali113/d360_vlm

Image-to-Text • Updated Mar 5

JongYeop/Llama-3.1-70B-Instruct-MXFP4-W4A4

Text Generation • 38B • Updated Mar 5 • 11

JongYeop/Mistral-7B-Instruct-v0.2-MXFP4-W4A4

Text Generation • 4B • Updated Mar 5 • 20

JongYeop/Qwen2.5-3B-Instruct-MXFP4-W4A4

Text Generation • 2B • Updated Mar 5 • 7

JongYeop/Qwen2.5-14B-Instruct-MXFP4-W4A4

Text Generation • 9B • Updated Mar 5 • 9

Evrmind/EVR-1-Maano-8b

Text Generation • 5B • Updated Mar 13 • 105

tonera/Chroma1-HD-SVDQ

Text-to-Image • 9B • Updated Jun 23 • 151 • 5

dbhavery/fineforge-qlora-pipeline

Text Generation • Updated Mar 8

pedrodev2026/pedro-open-coder-v2-GGUF

Text Generation • 0.8B • Updated Mar 8 • 87

CVLUESTC/TVQRAP

Image-to-Image • Updated Mar 9 • 1

ealexeev/TheDrummer-Anubis-70B-v1.2-NVFP4

41B • Updated Mar 10 • 783

Murasaki-Project/Murasaki-APE-Aligner-2B-AWQ

Text Generation • 2B • Updated Mar 15 • 7 • 1

Murasaki-Project/Murasaki-APE-Aligner-2B-GGUF

Text Generation • 2B • Updated Mar 15 • 60 • 1

ealexeev/TheDrummer-Behemoth-X-123B-v2-NVFP4

69B • Updated Mar 11 • 11

Wwayu/gpt-oss-20b-reap-0.4-mxfp4-mlx-6Bit

Text Generation • 14B • Updated Mar 9 • 22