Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,642

Base only

Active filters: fp8

bluetrace/SERA-32B-GA-FP8

Text Generation • 33B • Updated Mar 30 • 4

batsclamp/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-FP8

Image-Text-to-Text • 35B • Updated Mar 28 • 22 • 1

racine-ai-qwen/Qwen3.5-35B-A3B-FP8

Updated Mar 30 • 4

Granddyser/biglove-klein2

Text-to-Image • 9B • Updated Apr 8 • 2.06k • 24

RedHatAI/Mistral-Small-4-119B-2603

119B • Updated 14 days ago • 356 • 1

Alex2112/DeepSeek-R1-0528

Text Generation • 685B • Updated Mar 27 • 3

Walltim3/Mistral-Small-4-REAP-69e

66B • Updated Mar 29 • 10

AkashKakad/Mistral-Small-4-119B-2603

119B • Updated Mar 27

nivvis/Qwen3.5-35B-A3B-EQ-v5-FP8

Text Generation • 35B • Updated Mar 28 • 9

bjk110/Qwen3.5-122B-A10B-abliterated-FP8

Text Generation • 122B • Updated Mar 29 • 36 • 3

vrfai/Qwen3-ASR-1.7B-fp8

Automatic Speech Recognition • 2B • Updated Jun 6 • 345 • 5

prithivMLmods/Qwen3.5-27B-abliterated-v2-MAX-FP8

Image-Text-to-Text • 27B • Updated Mar 31 • 5 • 1

prithivMLmods/Qwen3.5-9B-abliterated-v2-MAX-FP8

Image-Text-to-Text • 9B • Updated Mar 31 • 105 • 1

prithivMLmods/Gliese-Qwen3.5-4B-Abliterated-Caption-NVFP4

Image-Text-to-Text • 4B • Updated Mar 30 • 221 • 2

Armen355/Mistral-Small-4-119B-2603

119B • Updated Mar 29 • 1

Shoolife/Qwen3-0.6B-TensorRT-LLM-Checkpoint-FP8

Text Generation • Updated Mar 29 • 2

N0zero0d/DeepSeek-V3.2

Text Generation • 685B • Updated Mar 29 • 7

Shoolife/Qwen3-1.7B-TensorRT-LLM-Checkpoint-FP8

Text Generation • Updated Mar 29 • 3

Controceasare/lastloop-comms-agent-devstral-24b

24B • Updated Mar 31 • 2

Shoolife/Qwen3-4B-TensorRT-LLM-Checkpoint-FP8

Text Generation • Updated Mar 29 • 4

Johnpickle/DeepSeek-R1

Text Generation • 685B • Updated Mar 30 • 4

mr-zhlj/Mistral-Small-4-119B-2603

119B • Updated Mar 30 • 1

prosoft0405/Kosmic-122B-A10B-FP8

Text Generation • 122B • Updated Apr 1 • 20

prosoft0405/Kosmic-35B-A3B-FP8

35B • Updated Apr 1 • 1

lingfeng1995/Qwen3.5-27B-FP8

Image-Text-to-Text • 28B • Updated Mar 30 • 2

Firworks/Cassiopeia-70B-fp8

71B • Updated Mar 30 • 1

racine-ai-qwen/Qwen3.5-122B-A10B-FP8

125B • Updated Mar 30

racine-ai-qwen/Qwen3.5-397B-A17B-FP8

403B • Updated Mar 30 • 6

BarathwajAnandan/cohere-transcribe-fp8

Automatic Speech Recognition • 2B • Updated Mar 30 • 6 • 1

Local-Novel-LLM-project/RAI-3.0-R1-VECTOR

Text Generation • 685B • Updated Mar 31 • 29 • 5