Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,245

Base only

Active filters: int4

Reza2kn/sapiens2-normal-0.4b-INT4-G128

Reza2kn/sapiens2-normal-0.8b-INT4-G128

Reza2kn/sapiens2-normal-5b-INT4-G128

Reza2kn/sapiens2-pointmap-0.4b-INT4-G128

Reza2kn/sapiens2-pointmap-0.8b-INT4-G128

Reza2kn/sapiens2-pointmap-1b-INT4-G128

Reza2kn/sapiens2-pointmap-5b-INT4-G128

Reza2kn/sapiens2-pose-0.4b-INT4-G128

Advantech-EIOT/intel_google-gemma-4-e2b-it-int4

Image-Text-to-Text • Updated Jun 8 • 8

Advantech-EIOT/intel_qwen-qwen3.5-9b-int4

Image-Text-to-Text • Updated Jun 8 • 4

Reza2kn/sapiens2-pose-0.8b-INT4-G128

Reza2kn/sapiens2-pose-1b-INT4-G128

Reza2kn/sapiens2-pose-5b-INT4-G128

Reza2kn/sapiens2-pretrain-0.1b-INT4-G128

Reza2kn/sapiens2-pretrain-0.4b-INT4-G128

Reza2kn/sapiens2-pretrain-0.8b-INT4-G128

Reza2kn/sapiens2-pretrain-1b-INT4-G128

Reza2kn/sapiens2-pretrain-5b-INT4-G128

Reza2kn/sapiens2-seg-0.4b-INT4-G128

Reza2kn/sapiens2-seg-0.8b-INT4-G128

Reza2kn/sapiens2-seg-1b-INT4-G128

Reza2kn/sapiens2-seg-5b-INT4-G128

HarmenWessels/Qwen2.5-Coder-1.5B-int4-symg128-ov

Text Generation • Updated Jun 8 • 14 • 1

dreamer1cc/hovor-gemma-3-1b-it-coreml-int4

Updated Jun 8 • 3

dreamer1cc/hovor-gemma-4-e2b-coreml-int4

Updated Jun 8 • 1

dreamer1cc/hovor-gemma-3-4b-it-coreml-int4

Updated Jun 8 • 1

spectator2026/MiMo-V2.5-AWQ-int4

Text Generation • 53B • Updated Jun 9 • 176 • 5

LLM-OS-Models/KoHRM-Text-1.4B-CPU-Runtime

Updated Jun 9 • 1

groxaxo/LocateAnything-3B-AutoRound-W4A16

Image-Text-to-Text • 1B • Updated Jun 9 • 106 • 1

challychoi/Lara-TRT-Edge-Qwen3-4B-INT4

Updated Jun 9 • 7 • 1