Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,464

Full-text search

Active filters: fp8

textgeflecht/Devstral-Small-2505-FP8-llmcompressor

Text Generation • 24B • Updated May 25, 2025 • 41

anhnct/qwen3_translate_quantize

Text Generation • 8B • Updated May 27, 2025

unsloth/DeepSeek-R1-0528-GGUF

Text Generation • 671B • Updated Jun 15, 2025 • 15k • 194

unsloth/DeepSeek-R1-0528

Text Generation • Updated Jun 10, 2025 • 29 • 15

context-labs/deepseek-r1-0528-FP8

685B • Updated May 29, 2025 • 25

baseten/DeepSeek-R1-0528-FP4

397B • Updated May 29, 2025 • 24

CLSDNZ/DeepSeek-R1-0528b

685B • Updated May 29, 2025 • 1

bchenbc/Deepseek-V3-Lowrank80p

554B • Updated May 30, 2025 • 1

byteark/Deepseek-V3-Lowrank80p

554B • Updated May 30, 2025

mikasenghaas/DeepSeek-R1-0528-0.2

326B • Updated May 29, 2025 • 1

mikasenghaas/DeepSeek-R1-0528-1.2

347B • Updated May 29, 2025 • 1

clowman/Qwen3-32B-FP8

Text Generation • 33B • Updated May 30, 2025 • 4

clowman/Qwen3-30B-A3B-FP8

Text Generation • 31B • Updated May 30, 2025 • 2

clowman/Llama-4-Scout-17B-16E-Instruct-FP8

Image-Text-to-Text • 109B • Updated Jun 5, 2025 • 3

ConfidentialMind/InternVL3-38B-FP8-Dynamic

Image-Text-to-Text • 38B • Updated Jul 7, 2025 • 17 • 2

th-nuernberg/DeepHermes-3-Mistral-24B-Preview-FP8-Dynamic

Text Generation • 24B • Updated Jun 3, 2025 • 8

clowman/Magistral-Small-2506-FP8

24B • Updated Jun 11, 2025

clowman/Magistral-Small-2506-FP8-W128

24B • Updated Jun 11, 2025 • 11

clowman/Llama-3.3-70B-Instruct-FP8

Text Generation • 71B • Updated Jun 11, 2025 • 1

clowman/Llama-3.3-70B-Instruct-FP8-W128

Text Generation • 71B • Updated Jun 11, 2025 • 1

textgeflecht/Qwen2.5-Coder-32B-Instruct-FP8-dynamic

Text Generation • 33B • Updated Jun 12, 2025 • 3

ka-ops/Meta-Llama-3.1-8B-Instruct-FP8

Text Generation • 8B • Updated Jun 16, 2025 • 1

brandonbeiler/InternVL3-38B-FP8-Dynamic

Image-Text-to-Text • 38B • Updated Jun 23, 2025 • 52

brandonbeiler/InternVL3-78B-FP8-Dynamic

Image-Text-to-Text • 78B • Updated Jun 23, 2025 • 193

kebeliu/DeepSeek-R1-tiny

Text Generation • 38B • Updated Jun 20, 2025 • 7

brandonbeiler/InternVL3-8B-FP8-Dynamic

Image-Text-to-Text • 8B • Updated Jun 23, 2025 • 12 • 2

aarnphm/qwen3-235b-a22b-fp8-sharded-tp4

Text Generation • Updated Jun 23, 2025 • 2

Conexis/DeepSeek-R1-0528-NextN

12B • Updated Jun 24, 2025 • 2

stelterlab/Mistral-Small-3.2-24B-Instruct-2506-FP8

Image-Text-to-Text • Updated Jun 26, 2025 • 228k • 8

tencent/Hunyuan-A13B-Instruct-FP8

Text Generation • 80B • Updated Jul 8, 2025 • 137 • 32