Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,219

Base only

Active filters: quantization

Joestar79/Qwen3.8-27B-OBLITERATED-NVFP4

Image-Text-to-Text • 15B • Updated Aug 27 • 1.46k • 4

Vandita/QuantizedSarcBERT-static-v2

Text Classification • Updated Aug 27 • 10

vcruz305/granite-4.2-30b-GGUF

Text Generation • 29B • Updated Aug 25 • 393

vcruz305/granite-4.2-30b-NVFP4

Text Generation • 15B • Updated Aug 25 • 262 • 1

JCorcho/10Eros-Max-TURBO-hybrid-beta3-ComfyUI-Quants

Image-to-Video • Updated Aug 26 • 2

darioooooo0o/granite-4.2-8b-G-Q5-GGUF

9B • Updated 26 days ago • 190 • 1

kaushik3009/industrial-vision-agent

hmarchant/speaker-id-joint-int8

Updated Aug 25 • 8

hmarchant/speaker-id-joint-mlx-int8

Updated Aug 25 • 16

hmarchant/speaker-id-joint-int4

Updated Aug 25 • 7

lackonendes/PAW-35B-A3B-GGUF

4B • Updated 1 day ago • 248

marwanelamami/nabra-82m-int4qat-onnx

Text-to-Speech • Updated Aug 26

marwanelamami/nabra-82m-int8-onnx

Text-to-Speech • Updated Aug 26

marwanelamami/nabra-82m-fp16-onnx

Text-to-Speech • Updated Aug 26

Lucierr8732/Qwen3-1.7B-LOMO-q4f16_1-MLC2

Text Generation • Updated Aug 26 • 1

marwanelamami/nabra-82m-sherpa-onnx

Text-to-Speech • Updated 29 days ago

0xKitkat/Qwen3.8-Flash-Next-GGUF

Image-Text-to-Text • Updated Aug 26 • 4

Ttimms/Ornith-1.5-35B-A3B-REAP-50-NVFP4A16

Text Generation • 19B • Updated 20 days ago • 1.19k • 3

Nichonauta/LFM2.5-230M-ToMoE-INT8

Text Generation • 0.2B • Updated Aug 26 • 22

Nichonauta/LFM2.5-230M-ToMoE-INT4

Text Generation • 0.1B • Updated Aug 26 • 134 • 1

Nichonauta/LFM2.5-350M-ToMoE-INT4

Text Generation • 0.2B • Updated Aug 26 • 53

Nichonauta/LFM2.5-1.2B-Thinking-ToMoE-INT8

Text Generation • 1B • Updated Aug 26 • 129 • 1

Sayankotor/qwen35-122b-a10b-k4e2

Text Generation • 2B • Updated Aug 26 • 65

tensor-tailor/ralph-qwen3-8b-ternary-r4

8B • Updated 15 days ago • 122

guideboardlabs/SuperQwen3.8-27B-abliterated-Q3-DOWN-XS-GGUF

27B • Updated Aug 26 • 119

tensor-tailor/ralph-qwen3-8b-ternary-r5

8B • Updated 15 days ago • 158

armanakbari4/fastwam-ur3-svdquant-nvfp4

Robotics • Updated Aug 26

xv0y5ncu/Qwen3.8-27B-GLQ-trellis-3inst-4bpw

Image-Text-to-Text • 10B • Updated 30 days ago • 656 • 1

MirkoCovizzi/Qwen3.8-27B-QUASAR-NVFP4

Image-Text-to-Text • 28B • Updated about 1 month ago • 189 • 2

brain-lab/Llama-2-70b-QuIP-HARP-2Bit

Text Generation • 3B • Updated 30 days ago • 162