Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

dynamic-quantization

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

115

Base only

Active filters: dynamic-quantization

aoiandroid/distil-whisper-large-v3-litert-fp8

Automatic Speech Recognition • Updated Jul 26

aoiandroid/distil-whisper-large-v3-litert-int8

Automatic Speech Recognition • Updated Aug 2

Musyysysy/bge-m3-dynamic-int8

Feature Extraction • Updated Jul 27

amd/gemma-4-26B-A4B-it-w8a8-llmcompressor

Text Generation • 26B • Updated 2 days ago • 571

cjxzdzh/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-MTP-GPTQ-INT4

Text Generation • 28B • Updated Aug 2 • 284 • 2

amd/Qwen3-VL-8B-Instruct-w8a8-llmcompressor

Image-Text-to-Text • 9B • Updated Aug 7 • 615

ModelCloud/Phi-tiny-MoE-instruct-GPTQ-W4-MixedGroup-G32-G128

Text Generation • 4B • Updated Aug 4 • 47

amd/Qwen3.6-35B-A3B-w8a8-llmcompressor

Text Generation • 35B • Updated Aug 10 • 762 • 1

Lebuga/hiv1-recombinant-classifier

zlaabsi/Qwen3.8-27B-OTQ-GGUF

Image-Text-to-Text • 27B • Updated Aug 14 • 450

Kecven/Qwen3.8-27B-MTPLX-Q4-Dynamic

Text Generation • 27B • Updated Aug 15 • 274 • 1

jclyons52/Qwen3.8-27B-Unsloth-Dynamic-v3-mlx

27B • Updated Aug 25 • 2.55k • 2

QuaduxIT/Qwen3.6-35B-A3B-QD-GGUF

Image-Text-to-Text • 36B • Updated Aug 26 • 335

QuaduxIT/Qwen3.5-4B-QD-GGUF

Image-Text-to-Text • 4B • Updated Aug 26 • 134

Gavvvin/Qwen3.8-27B-Uncensored-OID-gguf

Image-Text-to-Text • 27B • Updated Aug 27 • 184 • 1

kimps005/sms-category-model

Text Classification • Updated about 1 month ago • 10

amd/Instella-MoE-16B-A3B-SFT-w8a8-llmcompressor

Text Generation • 16B • Updated 16 days ago • 593

amd/Muse-Glimmer-30B-w8a8-llmcompressor

Text Generation • 30B • Updated 16 days ago • 462

amd/Qwen3.8-27B-w8a8-llmcompressor

Text Generation • 27B • Updated 16 days ago • 489

Valexiem/Qwen3.8-27B-Fast60L-Voodoo-GGUF

Text Generation • 24B • Updated 16 days ago • 394

amd/granite-4.0-h-tiny-w8a8-llmcompressor

Text Generation • 7B • Updated 3 days ago • 296

amd/granite-4.0-h-small-w8a8-llmcompressor

Text Generation • 32B • Updated 13 days ago • 145

amd/gpt-oss-20b-BF16-w4a16-llmcompressor

Text Generation • 21B • Updated 13 days ago • 348 • 1

prakharprasad/Qwen3.8-27B-Uncensored-GGUF

Text Generation • 27B • Updated 10 days ago • 3.4k

inference-optimization/Qwen3-8B-DFlash-FP8-DYNAMIC

Text Generation • 2B • Updated 7 days ago • 32