Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,615

Base only

Active filters: fp8

Soofi-Project/Soofi-S-Instruct-Preview-EntQuant-3bit

Text Generation • 14B • Updated 12 days ago • 24

Soofi-Project/Soofi-S-Instruct-Preview-EntQuant-4bit

Text Generation • 17B • Updated 12 days ago • 25

Soofi-Project/Soofi-S-Isar-Preview-EntQuant-2bit

Text Generation • 12B • Updated 12 days ago • 21

Soofi-Project/Soofi-S-Isar-Preview-EntQuant-3bit

Text Generation • 14B • Updated 12 days ago • 23

Soofi-Project/Soofi-S-Isar-Preview-EntQuant-4bit

Text Generation • 17B • Updated 12 days ago • 20

Soofi-Project/Soofi-S-Rhine-Preview-EntQuant-2bit

Text Generation • 12B • Updated 12 days ago • 20

Soofi-Project/Soofi-S-Rhine-Preview-EntQuant-3bit

Text Generation • 14B • Updated 12 days ago • 17

Soofi-Project/Soofi-S-Rhine-Preview-EntQuant-4bit

Text Generation • 17B • Updated 12 days ago • 21

inference-optimization/Qwen3-8B-FP8-Dynamic

Text Generation • 8B • Updated 12 days ago • 63

furiosa-ai/Qwen3-30B-A3B-FP8

Text Generation • 31B • Updated 3 days ago • 65

indigoskyai/DeepSeek-V3

Text Generation • 685B • Updated 11 days ago • 24

harrisonvanderbyl/GLM-4.6-FP8

Text Generation • 357B • Updated 11 days ago • 327

indigoskyai/DeepSeek-V3.2

Text Generation • 685B • Updated 11 days ago • 24

indigoskyai/DeepSeek-R1

Text Generation • 685B • Updated 11 days ago • 19

Lowkeyss/GLM-5.2-ablated

Text Generation • 743B • Updated 11 days ago • 49

shshdbf/DeepSeek-V3.2

Text Generation • 685B • Updated 11 days ago • 26

INCModel2/DeepSeek-V4-Pro-DSpark-MXFP4-Mixed-CT-AutoRound

Text Generation • 889B • Updated 11 days ago • 43 • 2

oracomputing/OraQwen3-Omni-20B-A3B-Instruct-FP8

Any-to-Any • 25B • Updated 10 days ago • 8

leylaparisdev/DeepSeek-V3.2

Text Generation • 685B • Updated 11 days ago • 28

huginnfork/Ornith-1.0-35B-FP8

Image-Text-to-Text • 35B • Updated 11 days ago • 388

Writer/qwen3.6-35b-a3b-cigna-palmyra-noreason-sft_lr1e-4_ep3_r16_merged_then_quantized_to_fp8_swift

35B • Updated 10 days ago • 37

Writer/qwen3.6-35b-a3b-cigna-palmyra-noreason-sft_lr1e-4_ep3_r16_merged_averaged_quantized_fp8

35B • Updated 10 days ago • 39

Karthik745/DeepSeek-V4-Pro-DSpark

Text Generation • 889B • Updated 11 days ago • 24

anirudmohan26/gpt-oss-20B-FP8

Text Generation • 21B • Updated 10 days ago • 33

Lowkeyss/GLM-5.2-Ablated-Molt

Text Generation • 743B • Updated 10 days ago • 41

xThr45hx/Josiefied-Qwen3-4B-TRT-LLM

Updated 10 days ago

FishPirate/DeepSeek-V4-Flash

Text Generation • 158B • Updated 10 days ago • 84

Nidhal101/deepseek-v3-pruned-8experts

40B • Updated 10 days ago • 18

inference-optimization/Ornith-1.0-9B-FP8-Dynamic

Text Generation • 9B • Updated 10 days ago • 278

kyr0/Ornith-35B-FP8-E4M3-MTP

Text Generation • 36B • Updated 9 days ago • 245 • 3