Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,647

Base only

Active filters: fp8

tfc101728/affine-tfc-h00-5HpGjLKSX5tgzb3ESpMSAnCDzaJCq23LCCRG6z8huDqskksA

480B • Updated Feb 3 • 4

INC4AI/Qwen3-30B-A3B-Instruct-2507-FP8-2Layers

2B • Updated Feb 3 • 22 • 1

JongYeop/Llama-3.1-8B-Instruct-FP8-W8A8-Dynamic-Per-Token

8B • Updated Feb 3 • 4

ussoewwin/HSWQ-Z-Image-fp8e4m3

Text-to-Image • Updated 17 days ago • 4

unsloth/Qwen3-Coder-Next-FP8

Text Generation • 80B • Updated Feb 3 • 2.21k • 11

gennady925/Affine-tema-5EcPzTJFhgwhZFt61qM8ojzQt4ccGE49u9GAzy8nv97rmnTW

Text Generation • 1T • Updated Feb 3 • 5 • 1

Simplismart/InternVL3_5-38B-FP8-Dynamic

Image-Text-to-Text • 38B • Updated Feb 4 • 1

Nagata99999/Affine-5G8kUZmJDPvpb4kjH8svunqUufx6p41a7Hns6aimYG2gJNH4

Updated Feb 4 • 3

rtj1/Qwen2.5-0.5B-AWQ-FP8-Dynamic

Text Generation • 0.6B • Updated Feb 10 • 6

rtj1/Qwen2.5-0.5B-AWQ-FP8-Block

Text Generation • 0.6B • Updated Feb 10 • 5

jiries/Kimi-K2-1D-Subchannel-256-FP8

Updated Feb 5 • 4

jiries/Kimi-K2-1D-Subchannel-256-FP4

Updated Feb 5 • 2

Forturne/Qwen3-0.6B-FP8

0.6B • Updated Feb 5

Forturne/Qwen2.5-0.5B-Instruct-FP8

0.5B • Updated Feb 5 • 4

Forturne/Qwen3-VL-Embedding-2B-FP8-v2

2B • Updated Feb 5 • 77

Forturne/Qwen3-VL-Embedding-8B-FP8-v2

9B • Updated Feb 5 • 38

Forturne/Qwen3-Embedding-0.6B-FP8-v2

0.8B • Updated Feb 5 • 3

Forturne/Qwen3-Embedding-4B-FP8-v2

4B • Updated Feb 5 • 68 • 1

Forturne/Qwen3-Embedding-8B-FP8-v2

8B • Updated Feb 5 • 4

Forturne/Qwen3-VL-Embedding-2B-FP8-LLM-Only

2B • Updated Feb 5 • 2

hassanshka/Biomni-R0-32B-FP8

Text Generation • Updated Feb 5 • 43 • 1

hassanshka/Qwen3-32B-FP8-to-BF16

Text Generation • 33B • Updated Feb 5 • 7

rhuanmatias/Deepseek

684B • Updated Feb 5 • 3

JongYeop/Qwen2.5-14B-Instruct-FP8-W8A8

Text Generation • 15B • Updated Feb 6 • 44

JEILDLWLRMA/Qwen3-VL-8B-Instruct-NVFP4-FP8-Dynamic

Image-to-Text • 6B • Updated Feb 6 • 172 • 1

meituan-longcat/LongCat-Flash-Lite-FP8

Text Generation • 69B • Updated Feb 6 • 643 • 8

Geodd/GLM-4.7-Flash-FP8

Text Generation • 30B • Updated Feb 6 • 36

sebelsn/lora-mistral-7b-transition-reference-kassandra

Text Generation • Updated Feb 7 • 1

rhuanmatias/deepseek-int4

685B • Updated Feb 7 • 1

JEILDLWLRMA/Qwen3-VL-4B-Instruct-FP8-Dynamic

Image-to-Text • 5B • Updated Feb 7 • 37