Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,647

Base only

Active filters: fp8

kebeliu/DeepSeek-R1-tiny

Text Generation • 38B • Updated Jun 20, 2025 • 15

brandonbeiler/InternVL3-8B-FP8-Dynamic

Image-Text-to-Text • 8B • Updated Jun 23, 2025 • 70 • 2

aarnphm/qwen3-235b-a22b-fp8-sharded-tp4

Text Generation • Updated Jun 23, 2025 • 7

Conexis/DeepSeek-R1-0528-NextN

12B • Updated Jun 24, 2025 • 2

tencent/Hunyuan-A13B-Instruct-FP8

Text Generation • 80B • Updated Jul 8, 2025 • 289 • 33

novita/inflatebot-MN-12B-Mag-Mell-R1-AWQ-FP8

12B • Updated Jun 27, 2025

novita/Sao10K-L3-8B-Stheno-v3.2-AWQ-FP8

8B • Updated Jun 27, 2025 • 1

dyadya-sam/DeepSeek-R1-0528-GGUF-Q4_K_XL

Text Generation • 671B • Updated Jun 27, 2025 • 194

ArtusDev/TheDrummer_Anubis-70B-v1.1-FP8-Dynamic

Text Generation • 71B • Updated Jun 28, 2025 • 565

RedHatAI/Qwen3-30B-A3B-FP8-block

Text Generation • 31B • Updated Oct 27, 2025 • 20.5k

backups/DeepSeek-R1-0528

Text Generation • 685B • Updated Jul 1, 2025 • 4

tngtech/DeepSeek-TNG-R1T2-Chimera

Text Generation • 685B • Updated Jan 27 • 124 • 284

JustJaro/SmolLM-135M-FP8-Static

Image-Text-to-Text • 0.2B • Updated Jul 7, 2025 • 8

JustJaro/SmolLM-135M-FP8-Dynamic-Test

Image-Text-to-Text • 0.1B • Updated Jul 7, 2025 • 7

JustJaro/GOT-OCR-2.0-hf-FP8-Static

Image-Text-to-Text • 0.6B • Updated Jul 7, 2025 • 16

cmsptcp/PLLuM-12B-instruct-FP8-Dynamic

12B • Updated Jul 2, 2025 • 102

unsloth/DeepSeek-TNG-R1T2-Chimera

Text Generation • 685B • Updated Jul 3, 2025 • 8 • 7

unsloth/DeepSeek-TNG-R1T2-Chimera-BF16

Text Generation • 684B • Updated Jul 4, 2025 • 12 • 4

bullerwins/DeepSeek-TNG-R1T2-Chimera-BF16

Text Generation • 684B • Updated Jul 4, 2025 • 6 • 1

WeMake/Clarity-MR-1

Text Generation • Updated Aug 25, 2025 • 5

fxmarty/Mixtral-8x7B-Instruct-v0.1-FP8-KV-2-layers

3B • Updated Jul 5, 2025 • 4

gaundprats/sy_mistral_instruct_ft_beastiality_450_fp8

7B • Updated Jul 7, 2025 • 1 • 1

enferAI/Rocinante-12B-v1.1-FP8

Updated Jul 8, 2025 • 596

enferAI/UnslopNemo-12B-v4.1-FP8

Updated Jul 8, 2025 • 2

stelterlab/Devstral-Small-2507-FP8

Text Generation • Updated Jul 11, 2025 • 2.26k • 2

brandonbeiler/Skywork-R1V3-38B-FP8-Dynamic

Image-Text-to-Text • 38B • Updated Jul 18, 2025 • 12 • 2

NeuraLake/Kimi-K2-Base

Text Generation • 1T • Updated Jul 11, 2025 • 16 • 1

NeuraLake/Kimi-K2-Base-Instruct

Text Generation • 1T • Updated Jul 11, 2025 • 11

unsloth/Kimi-K2-Instruct

Text Generation • Updated Jul 18, 2025 • 60 • 22

unsloth/Kimi-K2-Base

Text Generation • Updated Jul 12, 2025 • 45 • 5