Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

477

Base only

Active filters: llm-compressor

ramblingpolymath/Qwen3-Coder-30B-A3B-Instruct-W4A16

Text Generation • 31B • Updated Aug 3, 2025 • 144 • 2

ramblingpolymath/Qwen3-30B-A3B-Thinking-2507-W4A16

Text Generation • 31B • Updated Aug 3, 2025 • 19 • 3

tachytelicdetonation/medgemma-27b-it-fp8-dynamic

Text Generation • 27B • Updated Aug 11, 2025 • 10

tachytelicdetonation/medgemma-27b-it-fp8-static

Text Generation • 28B • Updated Aug 11, 2025 • 3

kaitchup/Qwen3-0.6B-NVFP4

0.6B • Updated Sep 8, 2025 • 44

kaitchup/Qwen3-1.7B-NVFP4

1B • Updated Sep 8, 2025 • 563

kaitchup/Qwen3-4B-NVFP4

3B • Updated Sep 8, 2025 • 20 • 1

kaitchup/Qwen3-8B-NVFP4

5B • Updated Sep 8, 2025 • 72 • 1

kaitchup/Qwen3-14B-NVFP4

9B • Updated Sep 8, 2025 • 49

brandonbeiler/InternVL3_5-38B-FP8-Dynamic

Image-Text-to-Text • 38B • Updated Aug 28, 2025 • 99 • 1

brandonbeiler/InternVL3_5-30B-A3B-FP8-Dynamic

Image-Text-to-Text • 31B • Updated Aug 28, 2025 • 96 • 3

brandonbeiler/InternVL3_5-GPT-OSS-20B-A4B-Preview-FP8-Dynamic

Image-Text-to-Text • 21B • Updated Aug 30, 2025 • 16.2k • 2

brandonbeiler/InternVL3_5-14B-FP8-Dynamic

Image-Text-to-Text • 15B • Updated Aug 28, 2025 • 606

brandonbeiler/InternVL3_5-8B-FP8-Dynamic

Image-Text-to-Text • 9B • Updated Aug 28, 2025 • 95 • 1

brandonbeiler/InternVL3_5-4B-FP8-Dynamic

Image-Text-to-Text • 5B • Updated Aug 28, 2025 • 211

brandonbeiler/InternVL3_5-2B-FP8-Dynamic

Image-Text-to-Text • 2B • Updated Aug 28, 2025 • 103 • 1

brandonbeiler/InternVL3_5-1B-FP8-Dynamic

Image-Text-to-Text • 1B • Updated Aug 28, 2025 • 26

benyamini/DSR1-8B-llmc-awq-w4

Text Generation • 2B • Updated Aug 29, 2025 • 6

edge-inference/DSR1-8B-llmc-awq-w4

Text Generation • 2B • Updated Aug 30, 2025 • 9

edge-inference/DSR1-14B-llmc-awq-w4

Text Generation • 3B • Updated Aug 30, 2025 • 8

edge-inference/DSR1-32B-llmc-awq-w4

Text Generation • 6B • Updated Aug 30, 2025 • 8

edge-inference/DSR1-1.5B-llmc-awq-w4

Text Generation • 2B • Updated Aug 30, 2025 • 7 • 1

kaitchup/Qwen3-1.7B-calib-OpenR1-Math-220k-16klen-NVFP4

1B • Updated Sep 8, 2025 • 5

kaitchup/Qwen3-1.7B-calib-OpenR1-Math-220k-2klen-NVFP4

1B • Updated Sep 8, 2025 • 8

kaitchup/Qwen3-4B-calib-OpenR1-Math-220k-16klen-NVFP4

3B • Updated Sep 8, 2025 • 5

kaitchup/Qwen3-4B-calib-OpenR1-Math-220k-2klen-NVFP4

3B • Updated Sep 8, 2025 • 4

itroot/Qwen3-4B-Instruct-2507-W8A8

Text Generation • 4B • Updated Sep 24, 2025 • 16

RedHatAI/Apertus-8B-Instruct-2509-FP8-dynamic

Text Generation • 8B • Updated Apr 28 • 1.29k • 5

RedHatAI/Apertus-70B-Instruct-2509-FP8-dynamic

Text Generation • 71B • Updated Sep 30, 2025 • 641 • 1

RedHatAI/Apertus-70B-Instruct-2509-quantized.w4a16

Text Generation • 11B • Updated Sep 23, 2025 • 344k • 1