Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

463

Base only

Active filters: llmcompressor

MilyaShams/Qwen3-1.7B-SmoothQuant_0.5_AutoRound_W8A8_ign

2B • Updated Apr 9 • 9

MilyaShams/Qwen3-1.7B-Pipe_SmoothQuant_0.5_PTQ_W8A8_Wanda_2_4

1B • Updated Apr 9 • 10

MilyaShams/Qwen3-1.7B-Pipe_Wanda_unstruct_0.5_PTQ_W8A8

2B • Updated Apr 9 • 8

MilyaShams/Qwen3-1.7B-Pipe_SparseGPT_unstruct_0.5_GPTQ_W4A16

2B • Updated Apr 9 • 10

MilyaShams/Qwen3-1.7B-Pipe_SparseGPT_unstruct_0.5_SmoothQuant_0.5_PTQ_W8A8

2B • Updated Apr 9 • 8

MilyaShams/Qwen3-1.7B-SmoothQuant_0.5_AutoRound_W8A8_iters200

2B • Updated Apr 9 • 10

MilyaShams/Qwen3-1.7B-SmoothQuant_0.5_AutoRound_W8A8

2B • Updated Apr 9 • 11

embedl/Qwen3.5-0.8B-FlashHead

Image-Text-to-Text • 0.9B • Updated May 19 • 247 • 1

embedl/Qwen3.5-2B-FlashHead

Image-Text-to-Text • 2B • Updated May 19 • 67 • 2

embedl/Qwen3.5-4B-FlashHead

Image-Text-to-Text • 5B • Updated May 19 • 244 • 2

embedl/Qwen3.5-9B-FlashHead

Image-Text-to-Text • 10B • Updated May 19 • 170 • 2

embedl/Qwen3.5-27B-FlashHead

Image-Text-to-Text • 28B • Updated May 19 • 60

embedl/Qwen3.5-9B-W4A16-FlashHead

Image-Text-to-Text • 9B • Updated 24 days ago • 136 • 1

AEON-7/Qwen3.6-35B-A3B-heretic-NVFP4

Image-Text-to-Text • 21B • Updated 25 days ago • 201k • 60

kakrotto/gemma-4-31B-it-uncensored-heretic-FP8

31B • Updated Apr 18 • 1.48k • 3

RedHatAI/MiniMax-M2.5-quantized.w4a16

Text Generation • 34B • Updated May 6 • 60

Farikhan/Llama-3.1-8B-Instruct-GPTQ-4bit

Text Generation • 2B • Updated Apr 29 • 7

RedHatAI/MiniMax-M2.5-quantized.w8a8

Text Generation • 229B • Updated May 6 • 30

neuronpedia-org/nla-gemma3-27b-av-FP8

Text Generation • 27B • Updated Apr 30 • 17

vfrome/Behemoth-X-123B-v2.1-FP8-Dynamic

Text Generation • 123B • Updated May 1 • 4

CyberCastle/XiYanSQL-QwenCoder-7B-2504-W4A16-AWQ

Text Generation • 8B • Updated May 3 • 75

CyberCastle/XiYanSQL-QwenCoder-7B-2504-W4A16-GPTQ

Text Generation • 8B • Updated May 3 • 8

pranavbapat/granite-4.1-8b-awq

Text Generation • 9B • Updated May 4 • 361

amir22010/gemma4-e4b-w4a16-it

Text Generation • 8B • Updated Jun 15

neuronpedia-org/Llama-3.3-70B-NLA-L53-av-FP8

Text Generation • 71B • Updated May 5 • 14

SteadyVictor/Qwen3.6-27B-AEON-Ultimate-Uncensored-NVFP4

Text Generation • 19B • Updated May 7 • 37

Avesed/Qwopus3.6-35B-A3B-v1-int4-mixed

36B • Updated Jun 23 • 332 • 2

meghanamakkapati/sarvam30b_INT4_quantisation

6B • Updated Jun 15

MilyaShams/Qwen3-1.7B-Wanda_unstruct_0.1

2B • Updated May 17 • 4

MilyaShams/Qwen3-1.7B-SparseGPT_unstruct_0.1_bs128_damp0.01

2B • Updated May 17 • 3