Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

174

Base only

Active filters: ONNX

PaddlePaddle/PP-OCRv6_medium_det_onnx

Image-to-Text • Updated Jun 18 • 8.03k • 25

INC4AI/gpt-j-6B-int8-dynamic-inc

Text Generation • Updated Apr 19, 2023 • 10 • 16

INC4AI/gpt-j-6B-int8-static-inc

Text Generation • Updated Apr 19, 2023 • 14 • 9

funasr/Paraformer-large

Automatic Speech Recognition • Updated Jun 19 • 178 • 63

Neus/Onnx_DeepDanbooru

Text-to-Image • Updated Jul 9, 2023 • 1

Neus/GFPGANv1.4

Text-to-Image • Updated Jul 9, 2023 • 5

Neus/CommonModels

Text-to-Image • Updated Dec 3, 2023 • 2

vgorce/distilbert-base-multi-cased-ner

Token Classification • Updated Dec 8, 2023 • 5 • 1

amd/HRNet

Image Segmentation • Updated Jan 9, 2024 • 3

amd/retinaface

Updated Mar 29, 2024 • 16

yilunzhang/all-mpnet-base-v2-onnx

Sentence Similarity • Updated Jan 4, 2024 • 7

philipchung/bge-m3-onnx

Feature Extraction • Updated Apr 4, 2024 • 220 • 3

microsoft/Phi-3-mini-4k-instruct-onnx

Text Generation • Updated Dec 10, 2025 • 217 • 148

microsoft/Phi-3-mini-128k-instruct-onnx

Text Generation • Updated May 30, 2025 • 121 • 193

renwoshin/Phi-3-mini-128k-instruct-onnx-tf

Text Generation • Updated Apr 26, 2024 • 11 • 1

Xenova/Phi-3-mini-4k-instruct

Text Generation • Updated Mar 6, 2025 • 395 • 22

Xenova/Phi-3-mini-4k-instruct_fp16

Text Generation • Updated Mar 6, 2025 • 103 • 5

microsoft/Phi-3-mini-4k-instruct-onnx-web

Text Generation • Updated May 30, 2024 • 106 • 27

FusionQuill/Phi-3-mini-128k-instruct-onnx

Text Generation • Updated May 17, 2024 • 4

microsoft/Phi-3-small-8k-instruct-onnx-cuda

Text Generation • Updated Jan 23 • 100 • 14

microsoft/Phi-3-medium-4k-instruct-onnx-cpu

Text Generation • Updated Jan 23 • 102 • 7

microsoft/Phi-3-medium-4k-instruct-onnx-cuda

Text Generation • Updated Jan 23 • 102 • 11

microsoft/Phi-3-medium-4k-instruct-onnx-directml

Text Generation • Updated Jan 23 • 95 • 10

microsoft/Phi-3-medium-128k-instruct-onnx-cpu

Text Generation • Updated Jan 23 • 96 • 14

microsoft/Phi-3-medium-128k-instruct-onnx-cuda

Text Generation • Updated Jan 23 • 104 • 24

microsoft/Phi-3-medium-128k-instruct-onnx-directml

Text Generation • Updated Jan 23 • 96 • 6

microsoft/Phi-3-vision-128k-instruct-onnx-cpu

Text Generation • Updated Nov 14, 2024 • 110 • 30

microsoft/Phi-3-vision-128k-instruct-onnx-cuda

Text Generation • Updated Nov 14, 2024 • 95 • 27

microsoft/Phi-3-vision-128k-instruct-onnx-directml

Text Generation • Updated Nov 14, 2024 • 101 • 8

microsoft/mistral-7b-instruct-v0.2-ONNX

Text Generation • Updated May 21, 2024 • 79 • 6