llmware
/

phi-3-npu-ov

Model card Files Files and versions

phi-3-npu-ov

phi-3-npu-ov is an OpenVino int4 quantized version of Microsoft Phi-3-mini-4k-instruct, providing a very fast, very small inference implementation, optimized for AI PCs using Intel NPU.

Model Description

Developed by: microsoft
Quantized by: llmware
Model type: phi3
Parameters: 3.8 billion
Model Parent: microsoft/Phi-3-mini-4k-instruct
Language(s) (NLP): English
License: Apache 2.0
Uses: Chat, general-purpose LLM
Quantization: int4

Model Card Contact

llmware website

Downloads last month: 2

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for llmware/phi-3-npu-ov

Base model

microsoft/Phi-3-mini-4k-instruct

Quantized

(151)

this model

Collection including llmware/phi-3-npu-ov

NPU - OpenVINO

leading models optimized for OpenVINO NPU • 24 items • Updated about 22 hours ago