Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,461

Full-text search

Active filters: fp8

ajinkya-tejankar/Mistral-7B-Instruct-v0.2-FP8-UltraChat-2000-KV

7B • Updated Oct 15, 2024

Infermatic/Lumimaid-v0.2-70B-FP8-Dynamic

71B • Updated Oct 15, 2024

predibase/Qwen2.5-32B-Instruct-FP8

33B • Updated Oct 16, 2024 • 68

Infermatic/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-Dynamic

Text Generation • 71B • Updated Oct 16, 2024 • 14

predibase/Mistral-7B-Instruct-v0.2-FP8-UltraChat-2000-KV

7B • Updated Oct 16, 2024

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic

Text Generation • 71B • Updated Oct 23, 2025 • 14.9k • 14

amd/dbrx-base-FP8-KV

132B • Updated Jul 23, 2025

Infermatic/Stellar-Odyssey-12b-v0.0-FP8-Dynamic

12B • Updated Oct 24, 2024

Infermatic/Chronos-Platinum-72B-FP8-Dynamic

73B • Updated Oct 27, 2024 • 5

Infermatic/Nautilus-70B-v0.1-FP8-Dynamic

71B • Updated Oct 28, 2024 • 1

yejingfu/nmagic-Meta-Llama-3.1-8B-Instruct-FP8

Text Generation • 8B • Updated Oct 31, 2024 • 2.81k

mysticbeing/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-DYNAMIC

Text Generation • 71B • Updated Nov 6, 2024 • 5 • 3

amd/Mistral-7B-v0.1-FP8-KV

7B • Updated Jul 23, 2025 • 2 • 1

yejingfu/nmagic-Meta-Llama-3.1-70B-Instruct-FP8

Text Generation • 71B • Updated Nov 5, 2024

tencent-community/Hunyuan-A52B-Instruct-FP8

Text Generation • 389B • Updated Nov 5, 2024 • 3

Dev0502/Qwen2.5-14B-Instruct-abliterated-v2-FP8

15B • Updated Nov 7, 2024 • 5

andecy64/Nxcode-CQ-7B-orpo-FP8

7B • Updated Dec 21, 2024

SicariusSicariiStuff/DeepSeek-Coder-V2-Instruct-FP8

236B • Updated Nov 8, 2024 • 4

EmbeddedLLM/Qwen2.5-72B-Instruct-OCP-FP8-Quark

73B • Updated Nov 15, 2024 • 1

yejingfu/nmagic-Meta-Llama-3-70B-Instruct-FP8

71B • Updated Nov 15, 2024

EmbeddedLLM/Nexusflow_Athena-V2-Chat-OCP-FP8-Quark

73B • Updated Nov 15, 2024 • 1

EmbeddedLLM/Nexusflow_Athena-V2-Agent-OCP-FP8-Quark

73B • Updated Nov 16, 2024

liuxl12/Qwen2.5-32B-Instruct-FP8

33B • Updated Nov 18, 2024

Model-SafeTensors/Meta-Llama-3-8B-Instruct-FP8

8B • Updated Jul 18, 2024 • 3

John6666/jib-mix-flux-v5itsalive-fp8-flux

Text-to-Image • Updated Dec 23, 2024 • 1

John6666/iniverse-mix-sfwnsfw-f1drealnsfwguofengv2-fp8-flux

Text-to-Image • Updated Nov 21, 2024 • 1 • 1

John6666/acorn-is-spinning-flux-aisfluxdedistilled-fp8-flux

Text-to-Image • Updated Dec 23, 2024 • 3

John6666/uncensored-females-flux-fluxdevufv7fp16-fp8-flux

Text-to-Image • Updated Dec 23, 2024 • 14 • 10

John6666/2758-flux-asian-utopian-v30fp8noclip-fp8-flux

Text-to-Image • Updated Dec 23, 2024 • 9

RedHatAI/Qwen2.5-7B-Instruct-FP8-dynamic

Text Generation • 8B • Updated Sep 22, 2025 • 2.72k • 1