Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,640

Base only

Active filters: fp8

ajinkya-tejankar/Mistral-7B-Instruct-v0.2-FP8-UltraChat-2000-KV

7B • Updated Oct 15, 2024 • 1

Infermatic/Lumimaid-v0.2-70B-FP8-Dynamic

71B • Updated Oct 15, 2024 • 1

predibase/Qwen2.5-32B-Instruct-FP8

33B • Updated Oct 16, 2024 • 200

Infermatic/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-Dynamic

Text Generation • 71B • Updated Oct 16, 2024 • 5

predibase/Mistral-7B-Instruct-v0.2-FP8-UltraChat-2000-KV

7B • Updated Oct 16, 2024

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic

Text Generation • 71B • Updated Jun 9 • 182 • 15

Infermatic/magnum-v4-72b-FP8-Dynamic

Text Generation • 73B • Updated Oct 21, 2024 • 412 • 6

amd/dbrx-base-FP8-KV

132B • Updated May 19 • 11

Infermatic/Stellar-Odyssey-12b-v0.0-FP8-Dynamic

12B • Updated Oct 24, 2024

Infermatic/Chronos-Platinum-72B-FP8-Dynamic

73B • Updated Oct 27, 2024 • 1

Infermatic/Nautilus-70B-v0.1-FP8-Dynamic

71B • Updated Oct 28, 2024 • 2

yejingfu/nmagic-Meta-Llama-3.1-8B-Instruct-FP8

Text Generation • 8B • Updated Oct 31, 2024 • 264

mysticbeing/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-DYNAMIC

Text Generation • 71B • Updated Nov 6, 2024 • 8 • 3

amd/Mistral-7B-v0.1-FP8-KV

7B • Updated Jul 23, 2025 • 1 • 1

yejingfu/nmagic-Meta-Llama-3.1-70B-Instruct-FP8

Text Generation • 71B • Updated Nov 5, 2024 • 6

tencent-community/Hunyuan-A52B-Instruct-FP8

Text Generation • 389B • Updated Nov 5, 2024 • 6

Dev0502/Qwen2.5-14B-Instruct-abliterated-v2-FP8

15B • Updated Nov 7, 2024 • 6

andecy64/Nxcode-CQ-7B-orpo-FP8

7B • Updated Dec 21, 2024 • 2

SicariusSicariiStuff/DeepSeek-Coder-V2-Instruct-FP8

236B • Updated Nov 8, 2024

EmbeddedLLM/Qwen2.5-72B-Instruct-OCP-FP8-Quark

73B • Updated Nov 15, 2024 • 5

yejingfu/nmagic-Meta-Llama-3-70B-Instruct-FP8

71B • Updated Nov 15, 2024 • 2

EmbeddedLLM/Nexusflow_Athena-V2-Chat-OCP-FP8-Quark

73B • Updated Nov 15, 2024 • 2

EmbeddedLLM/Nexusflow_Athena-V2-Agent-OCP-FP8-Quark

73B • Updated Nov 16, 2024 • 2

liuxl12/Qwen2.5-32B-Instruct-FP8

33B • Updated Nov 18, 2024 • 3

Model-SafeTensors/Meta-Llama-3-8B-Instruct-FP8

8B • Updated Jul 18, 2024 • 11

John6666/jib-mix-flux-v5itsalive-fp8-flux

Text-to-Image • Updated Dec 23, 2024 • 7

John6666/iniverse-mix-sfwnsfw-f1drealnsfwguofengv2-fp8-flux

Text-to-Image • Updated Nov 21, 2024 • 2 • 1

John6666/acorn-is-spinning-flux-aisfluxdedistilled-fp8-flux

Text-to-Image • Updated Dec 23, 2024 • 2

John6666/uncensored-females-flux-fluxdevufv7fp16-fp8-flux

Text-to-Image • Updated Dec 23, 2024 • 106 • 14

John6666/2758-flux-asian-utopian-v30fp8noclip-fp8-flux

Text-to-Image • Updated Dec 23, 2024 • 4