Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

225

Base only

Active filters: nncf

echarlaix/SmolVLM2-256M-Video-Instruct-openvino-8bit-woq-data-free

Image-Text-to-Text • Updated Jul 14, 2025 • 65

echarlaix/SmolVLM2-256M-Video-Instruct-openvino-8bit-static

Image-Text-to-Text • Updated Jul 14, 2025 • 7

echarlaix/SmolVLM2-256M-Video-Instruct-openvino-8bit-mixed

Image-Text-to-Text • Updated Oct 10, 2025 • 14

echarlaix/SmolVLM2-500M-Video-Instruct-openvino-8bit-static

Image-Text-to-Text • Updated Jul 14, 2025 • 24

echarlaix/SmolVLM2-500M-Video-Instruct-openvino-8bit-woq

Image-Text-to-Text • Updated Jul 14, 2025 • 67

turingevo/bge-base-zh-v1.5-openvino-8bit

Feature Extraction • Updated Jul 15, 2025 • 50

turingevo/bge-reranker-base-openvino-8bit

Text Classification • Updated Jul 15, 2025 • 14

Anonymous6598/Llama-3.2-1B-Instruct-openvino-4bit

Text Generation • Updated Aug 21, 2025 • 4

rpanchum/lcm-sdxl-ov-fp16-quant_unet

Text-to-Image • Updated Sep 10, 2025

Aminfri/Juggernaut_XL_Ragnarok-openvino-8bit

Updated Sep 27, 2025

user0199939/VibeThinker-1.5B-openvino-4bit

Text Generation • Updated Nov 18, 2025 • 38

asaqibs/VibeThinker-1.5B-openvino-8bit

Text Generation • Updated Nov 20, 2025 • 21

mikaelback/Llama-3.2-3B-Instruct-abliterated-openvino-8bit

Text Generation • Updated Nov 21, 2025 • 10

zubinb/Ministral-3b-instruct-openvino-4bit

Text Generation • Updated Dec 2, 2025 • 17

Novaciano/NSFW-3.2-1B-openvino-8bit

Text Generation • Updated Dec 10, 2025 • 8

Novaciano/NSFW-3.2-1B-openvino-4bit

Text Generation • Updated Dec 10, 2025 • 7

Novaciano/NSFW_RP-3.2-1B-openvino-8bit

Text Generation • Updated Dec 10, 2025 • 8

Novaciano/NSFW_RP-3.2-1B-openvino-4bit

Text Generation • Updated Dec 10, 2025 • 6

wizardoftrap/h2o-danube2-1.8b-chat-openvino-8bit

Text Generation • Updated Jan 6 • 27

Fetching/Qwen2.5-Coder-0.5B-Instruct-openvino-8bit

Text Generation • Updated Feb 8 • 7 • 1

Fetching/Qwen2.5-Coder-7B-Instruct-openvino-8bit

Text Generation • Updated Feb 8 • 10

malcolmchan/Qwen2.5-1.5B-Instruct-openvino-8bit

Text Generation • Updated Feb 28 • 7

malcolmchan/mobilenet_v2_1.0_224-openvino-8bit

Image Classification • Updated Feb 28 • 6

CelesteImperia/Qwen2-VL-2B-Instruct-OpenVINO-INT4

Image-to-Text • Updated Mar 24 • 36

CelesteImperia/Whisper-Large-v3-Turbo-OpenVINO-INT4

Automatic Speech Recognition • Updated Mar 23 • 8

amokrov/mobilenet_v2_1.0_224-openvino-8bit

Image Classification • Updated Mar 5 • 5

MiKl-LS/waifu-diffusion-openvino-8bit

Text-to-Image • Updated Mar 13

discoveraniket/Qwen3-VL-8B-Thinking-int4-ov

Image-Text-to-Text • Updated Mar 20

CelesteImperia/Gemma-2-2B-IT-OpenVINO-INT4

Text Generation • Updated Mar 23 • 6

CelesteImperia/Llama-3.2-1B-Instruct-OpenVINO-INT4

Text Generation • Updated Mar 24 • 7