Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

225

Base only

Active filters: nncf

AIFunOver/FLUX.1-dev-openvino-4bit

Text-to-Image • Updated Nov 18, 2024 • 1

TheHierophant/Umbral-Devil-Hermes-Mind-V0.1-openvino-8bit

Text Generation • Updated Nov 29, 2024 • 7

marquesafonso/NuExtract-openvino-8bit

Updated Dec 2, 2024 • 10 • 1

AIFunOver/QwQ-32B-Preview-openvino-8bit

Text Generation • Updated Dec 4, 2024 • 9

AIFunOver/QwQ-32B-Preview-openvino-4bit

Text Generation • Updated Dec 4, 2024 • 7

AIFunOver/Llama-Guard-3-1B-openvino-fp16

Text Generation • Updated Dec 5, 2024 • 10

AIFunOver/Llama-Guard-3-1B-openvino-8bit

Text Generation • Updated Dec 5, 2024 • 8

AIFunOver/Llama-Guard-3-1B-openvino-4bit

Text Generation • Updated Dec 5, 2024 • 16

muhuott/Qwen2.5-1.5B-Instruct-openvino-4bit

Text Generation • Updated Dec 9, 2024 • 5

echarlaix/distilgpt2-openvino-8bit

Text Generation • Updated Dec 12, 2024 • 19

lukeyourheart/distilgpt2-openvino-8bit

Text Generation • Updated Dec 13, 2024 • 20

hsuwill000/stable-diffusion-xl-base-1.0-openvino-8bit

Text-to-Image • Updated Dec 24, 2024 • 1

hsuwill000/AngelBreed-v4-openvino-8bit

Text-to-Image • Updated Dec 24, 2024

AIFunOver/DRT-o1-7B-openvino-fp16

Text Generation • Updated Dec 26, 2024 • 4

AIFunOver/DRT-o1-7B-openvino-8bit

Text Generation • Updated Dec 26, 2024 • 8 • 1

AIFunOver/DRT-o1-7B-openvino-4bit

Text Generation • Updated Dec 26, 2024 • 6

AIFunOver/DRT-o1-14B-openvino-fp16

Text Generation • Updated Dec 26, 2024 • 9

AIFunOver/DRT-o1-14B-openvino-8bit

Text Generation • Updated Dec 26, 2024 • 9

AIFunOver/DRT-o1-14B-openvino-4bit

Text Generation • Updated Dec 26, 2024 • 6

hsuwill000/LCM-absolutereality-openvino-8bit

Updated Dec 27, 2024

AIFunOver/Falcon3-1B-Instruct-openvino-fp16

Text Generation • Updated Dec 27, 2024 • 4

AIFunOver/Falcon3-1B-Instruct-openvino-8bit

Text Generation • Updated Dec 27, 2024 • 4

AIFunOver/Falcon3-1B-Instruct-openvino-4bit

Text Generation • Updated Dec 27, 2024 • 8

AIFunOver/Falcon3-3B-Instruct-openvino-fp16

Text Generation • Updated Dec 27, 2024 • 8

AIFunOver/Falcon3-3B-Instruct-openvino-8bit

Text Generation • Updated Dec 27, 2024 • 6

AIFunOver/Falcon3-3B-Instruct-openvino-4bit

Text Generation • Updated Dec 27, 2024 • 9

AIFunOver/Falcon3-7B-Instruct-openvino-fp16

Text Generation • Updated Dec 27, 2024 • 6

AIFunOver/Falcon3-7B-Instruct-openvino-8bit

Text Generation • Updated Dec 27, 2024 • 6

AIFunOver/Falcon3-7B-Instruct-openvino-4bit

Text Generation • Updated Dec 27, 2024 • 10

AIFunOver/Falcon3-10B-Instruct-openvino-fp16

Text Generation • Updated Dec 27, 2024 • 8