Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,240

Base only

Active filters: int4

CMSManhattan/JiRackCoderReasoning_14b

Updated Jun 4 • 1

CMSManhattan/JiRackCoderReasoning_32b

Updated Jun 4 • 1

Reza2kn/LocateAnything-3B-ONNX-WebGPU-INT4

Object Detection • Updated May 29 • 24 • 12

dataslab/DSLM-LST-35B-A3B-GPTQ-Int4

Image-Text-to-Text • 35B • Updated 25 days ago • 15 • 2

fredchu/MOSS-Audio-8B-Instruct-MLX

Audio-Text-to-Text • Updated May 29 • 2

spectator2026/Infinity-Parser2-Pro-AWQ-W4A16

Image-Text-to-Text • 35B • Updated May 30 • 240 • 1

spectator2026/Infinity-Parser2-Flash-AWQ-W4A16

Image-Text-to-Text • 2B • Updated May 30 • 56

theophilusowiti/Caracal_instruct

Text Generation • Updated 10 days ago • 131

Reza2kn/openmed-persian-pii-google-mbert-onnx-int4

Token Classification • Updated May 31 • 3

Reza2kn/openmed-persian-pii-tookabert-large-onnx-int4

Token Classification • Updated May 31 • 4

Reza2kn/openmed-persian-pii-google-mbert-coreml-int4

Token Classification • Updated May 31 • 6

Reza2kn/openmed-persian-pii-tookabert-large-coreml-int4

Token Classification • Updated May 31 • 5

Reza2kn/openmed-persian-pii-google-mbert-mlx-int4

Token Classification • Updated May 31 • 40

Reza2kn/openmed-persian-pii-tookabert-large-mlx-int4

Token Classification • Updated May 31 • 12

Reza2kn/openmed-persian-pii-google-mbert-awq-int4

Token Classification • Updated May 31 • 6

Reza2kn/openmed-persian-pii-tookabert-large-awq-int4

Token Classification • Updated May 31 • 5

Reza2kn/openmed-persian-pii-google-mbert-litert-int4

Token Classification • Updated May 31 • 8

Reza2kn/openmed-persian-pii-tookabert-large-litert-int4

Token Classification • Updated May 31 • 8

compute1/qwopus3.5-9b-coder-awq-int4

Text Generation • 9B • Updated May 31 • 167

theophilusowiti/Caracal_AfroLlama_int4

Text Generation • Updated 10 days ago • 15 • 2

RumiLabs/rumi-cerberus-4b-mlx-4bit

Audio-Text-to-Text • Updated 7 days ago

aoiandroid/supertonic-3-litert

Text-to-Speech • Updated Jun 1 • 13

jinhwan000/qwen3-aligner-0.6b-onnx

jinhwan000/qwen3-asr-0.6b-onnx

Automatic Speech Recognition • Updated Jun 15 • 14

jinhwan000/qwen3-asr-1.7b-onnx

Automatic Speech Recognition • Updated Jun 14 • 18

Reza2kn/Cosmos3-Nano-INT4-AWQ

Text-to-Image • Updated Jun 2 • 17 • 2

ForeverBlue/LLaVA-1.5-7B-GRACE-W4G128

Image-Text-to-Text • 7B • Updated Jun 3 • 13 • 1

adilyildiz/gemma-4-E2B-text-only-onnx-int4

Text Generation • Updated Jun 2 • 6

adilyildiz/gemma-4-E4B-text-only-onnx-int4

Text Generation • Updated Jun 2 • 5

ForeverBlue/LLaVA-1.5-7B-GRACE-W4G128-AWQ

Image-Text-to-Text • 1B • Updated 4 days ago • 13 • 1