Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,613

Base only

Active filters: fp8

skibare87/gemma-4-12B-it-FP8-DSpark

Text Generation • 12B • Updated 7 days ago • 108 • 1

chriswritescode/MiMo-V2.5-DFlash-MXFP4A16

169B • Updated 3 days ago • 156 • 1

thanet-s/Ornith-1.0-35B-uncensored-heretic-nvfp4-fp8dense-gb10

Text Generation • 21B • Updated 6 days ago • 472 • 1

Mochgolf/Krea-2-Turbo-FP8-SGLang

Text-to-Image • Updated 5 days ago • 56 • 1

huginnfork/Tess-4-27B-FP8

Image-Text-to-Text • 28B • Updated 3 days ago • 143 • 1

fal/Qwen3.6-35B-A3B-Magic-Prompt-FP8

Text Generation • 36B • Updated 2 days ago • 235 • 1

N8Programs/Qwen3.6-35B-A3B-AntiLoop-NVFP4

Text Generation • 19B • Updated 1 day ago • 222 • 1

mateogrgic/GLM-5.2-colibri-int4-with-int8-mtp

Updated about 6 hours ago • 55 • 1

williamliao/Qwen3.6-27B-Unsloth-NVFP4-Experimental-GGUF

Text Generation • 27B • Updated about 12 hours ago • 1

FINAL-Bench/Qwen3.5-35B-A3B-VKAE

Text Generation • Updated 7 days ago • 27

Saravutw/ZImageTurbo-NSFW-FP8-bf16

Text-to-Image • Updated Jun 2 • 4

fairy322/ZImageTurbo-NSFW-FP8-bf16

Text-to-Image • Updated Jun 9 • 2

ibyteohdear/DreamFast-gemma-3-12b-it-heretic-v2-fp8

Text Generation • 12B • Updated 6 days ago • 924 • 3

FriendliAI/Meta-Llama-3-8B-Instruct-fp8

Text Generation • 8B • Updated Nov 3, 2024 • 9 • 2

RedHatAI/Meta-Llama-3-8B-Instruct-FP8

Text Generation • 8B • Updated Jul 18, 2024 • 2.81k • • 24

RedHatAI/Mixtral-8x7B-Instruct-v0.1-AutoFP8

Text Generation • 47B • Updated Jul 18, 2024 • 16 • 3

anyisalin/Meta-Llama-3-8B-Instruct-FP8

Text Generation • 8B • Updated May 6, 2024 • 3

anyisalin/Meta-Llama-3-8B-Instruct-FP8-D

Text Generation • 8B • Updated Apr 28, 2024 • 6

anyisalin/lzlv_70b_fp16_hf-FP8-D

Text Generation • 69B • Updated Apr 28, 2024 • 4

anyisalin/Meta-Llama-3-70B-Instruct-FP8-D

Text Generation • 71B • Updated Apr 28, 2024 • 3

anyisalin/Mixtral-8x7B-Instruct-v0.1-FP8-D

Text Generation • 47B • Updated Apr 28, 2024 • 6

pcmoritz/Mixtral-8x7B-v0.1-fp8-act-scale

Text Generation • 47B • Updated May 2, 2024 • 8

anyisalin/Meta-Llama-3-70B-Instruct-FP8

Text Generation • 71B • Updated May 8, 2024 • 12

RedHatAI/Meta-Llama-3-8B-Instruct-FP8-KV

Text Generation • 8B • Updated Sep 15, 2025 • 31.3k • • 10

comaniac/Meta-Llama-3-8B-Instruct-FP8-v1

Text Generation • 8B • Updated May 24, 2024 • 9

comaniac/Mixtral-8x22B-Instruct-v0.1-FP8-v1

Text Generation • 141B • Updated May 28, 2024 • 4

RedHatAI/Meta-Llama-3-70B-Instruct-FP8

Text Generation • 71B • Updated Jul 18, 2024 • 809 • 13

comaniac/Meta-Llama-3-70B-Instruct-FP8-v1

Text Generation • 71B • Updated May 26, 2024 • 2

comaniac/Mixtral-8x7B-Instruct-v0.1-FP8-v1

Text Generation • 47B • Updated May 26, 2024 • 6

comaniac/Mixtral-8x7B-Instruct-v0.1-FP8-v2

Text Generation • 47B • Updated Jun 10, 2024 • 13