Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

post-training-quantization

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

128

Base only

Active filters: post-training-quantization

jkim96/GLM-4.7-DASHQ-INT2-g32

Text Generation • 2B • Updated 3 days ago • 642

jkim96/Mistral-Medium-3.5-128B-DASHQ-INT2-g32

Image-Text-to-Text • 6B • Updated 3 days ago • 539 • 2

jkim96/Qwen3.5-35B-A3B-DASHQ-INT2-g32

Text Generation • 1B • Updated 3 days ago • 690

jkim96/Qwen3.6-35B-A3B-DASHQ-INT2-g32

Text Generation • 1B • Updated 3 days ago • 844

jkim96/Llama-3.1-70B-Instruct-DASHQ-INT2-g32

Text Generation • 2B • Updated 3 days ago • 635

jkim96/Llama-3.3-70B-Instruct-DASHQ-INT2-g32

Text Generation • 2B • Updated 3 days ago • 636

jkim96/Llama-3.1-405B-Instruct-DASHQ-INT2-g32

Text Generation • 4B • Updated 3 days ago • 645

cod-tdq/cod-tdq

Updated Jun 22 • 1

88plug/Kimi-VL-A3B-Thinking-2506-W8A16

Image-Text-to-Text • 17B • Updated Jul 13 • 17

88plug/Kimi-VL-A3B-Thinking-2506-W4A16

Image-Text-to-Text • 17B • Updated Jul 10 • 141

QuantNAS/QuantNAS

Updated 24 days ago

yuesheng123/MiniCPM-o-4.5-W4A16

Image-Text-to-Text • 9B • Updated 19 days ago • 19

CezarJedi/Qwen3.5-9B-Abliterated-NVFP4-FP8KV

Text Generation • 6B • Updated 9 days ago • 81 • 1

armanibadboy/WAL-Ternary-27B-RC1

Text Generation • Updated 7 days ago • 378

yitongl/minimax-h3-nvfp4-lora-recovery

Updated 6 days ago

jkim96/phi-4-DASHQ-INT4-g128

Text Generation • 1B • Updated 3 days ago • 26

jkim96/phi-4-DASHQ-INT3-g128

Text Generation • 1B • Updated 3 days ago • 391

jkim96/phi-4-DASHQ-INT3-g64

Text Generation • 1B • Updated 3 days ago • 396

jkim96/phi-4-DASHQ-INT3-g32

Text Generation • 1B • Updated 3 days ago • 397

jkim96/phi-4-DASHQ-INT2-g32

Text Generation • 1B • Updated 3 days ago • 378

SusanHill/jkim96-qwen3.6-35b-a3b-dashq-int2-g32-0811-1500

Text Generation • 1B • Updated 5 days ago

SusanHill/jkim96-qwen3.5-35b-a3b-dashq-int2-g32-0811-1515

Text Generation • 1B • Updated 5 days ago

praveenkumarpranjal/LFM2.5-2.6B-4bit-PathPack-Q

Text Generation • 0.4B • Updated 5 days ago • 59

jkim96/DeepSeek-R1-Distill-Qwen-32B-DASHQ-INT4-g128

Text Generation • 2B • Updated 3 days ago • 17

jkim96/DeepSeek-R1-Distill-Qwen-32B-DASHQ-INT3-g128

Text Generation • 2B • Updated 3 days ago • 361

jkim96/DeepSeek-R1-Distill-Qwen-32B-DASHQ-INT3-g64

Text Generation • 2B • Updated 3 days ago • 350

jkim96/DeepSeek-R1-Distill-Qwen-32B-DASHQ-INT3-g32

Text Generation • 2B • Updated 3 days ago • 256

jkim96/DeepSeek-R1-Distill-Qwen-32B-DASHQ-INT2-g32

Text Generation • 2B • Updated 3 days ago • 475

jkim96/Muse-Glimmer-30B-DASHQ-INT4-g128

Image-Text-to-Text • 5B • Updated 3 days ago • 26

jkim96/Muse-Glimmer-30B-DASHQ-INT3-g128

Image-Text-to-Text • 5B • Updated 3 days ago • 204