Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,660

Base only

Active filters: fp8

Qwen/Qwen3-VL-2B-Thinking-FP8

Image-Text-to-Text • 2B • Updated Nov 26, 2025 • 815 • 31

selimaktas/Qwen3-14B-FP8-MinMax

15B • Updated Oct 20, 2025 • 2

nm-testing/Llama-4-Scout-17B-16E-Instruct-BLOCK-FP8

Text Generation • 109B • Updated Oct 27, 2025 • 13 • 1

RedHatAI/Llama-3.3-70B-Instruct-FP8-block

Text Generation • 71B • Updated Oct 24, 2025 • 689

EvGUT/qm3232_3_f_fp8

15B • Updated Oct 20, 2025 • 1

fraseque/llama-3.2-1B-FP8-Neuron

Text Generation • 1B • Updated Oct 26, 2025 • 20

MiniMaxAI/MiniMax-M2

Text Generation • 229B • Updated Dec 23, 2025 • 112k • • 1.5k

bash99/Qwen3-30B-A3B-Instruct-2507-FP8-Dynamic

Text Generation • Updated Oct 24, 2025 • 6

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-block

Text Generation • 109B • Updated Oct 27, 2025 • 53 • 3

nm-testing/Llama-4-Maverick-17B-128E-Instruct-block-FP8

Text Generation • Updated Oct 27, 2025 • 10

meituan-longcat/LongCat-Flash-Omni-FP8

Text Generation • 561B • Updated Oct 31, 2025 • 25 • 16

Maxtimer97/DSLite2DSA

16B • Updated Oct 31, 2025 • 8

efficient-deep-research/gap_0.3_beta_0.5_lora_ckpt_56_merged_FP8

80B • Updated Oct 25, 2025

aiqwen/DeepSeek-R1

Text Generation • 685B • Updated Oct 25, 2025

aiqwen/DeepSeek-V3

Text Generation • 685B • Updated Oct 25, 2025 • 5

aiqwen/DeepSeek-V3.2-Exp

Text Generation • 685B • Updated Oct 25, 2025 • 7

aiqwen/DeepSeek-V3.1-Terminus

Text Generation • 685B • Updated Oct 25, 2025 • 5

aiqwen/DeepSeek-V3.1

Text Generation • 685B • Updated Oct 25, 2025 • 6

aiqwen/DeepSeek-V3.2-Exp-Base

Text Generation • 685B • Updated Oct 25, 2025 • 6

aiqwen/DeepSeek-Prover-V2-671B

Text Generation • 685B • Updated Oct 25, 2025 • 5

RedHatAI/granite-4.0-h-small-FP8-dynamic

Text Generation • 32B • Updated Apr 28 • 167 • 2

siraxe/HoloCine

Updated Oct 26, 2025 • 1

RedHatAI/Llama-4-Maverick-17B-128E-Instruct-FP8-block

Text Generation • 402B • Updated Oct 27, 2025 • 12 • 1

wangkanai/sdxl-fp8-loras-nsfw

Text-to-Image • Updated Oct 28, 2025 • 2

wangkanai/wan21-fp8-loras

Text-to-Video • Updated Oct 27, 2025 • 1

tencent/DeepSeek-V3.1-Terminus-W4AFP8

Text Generation • 349B • Updated Nov 4, 2025 • 857 • 16

unsloth/MiniMax-M2

Text Generation • 229B • Updated Nov 3, 2025 • 24 • 17

Pavvav/affine-max

Text Generation • 229B • Updated Oct 28, 2025 • 5

nm-testing/granite-4.0-h-small-FP8-block

Text Generation • 32B • Updated Nov 17, 2025 • 12

newmindai/Llama-3.1-8B-Instruct-w16a16-tw

Text Generation • 8B • Updated Dec 9, 2025 • 7