llmware/qwen-2.5-coder-instruct-npu-ov

qwen2.5-coder-7b-instruct-npu-ov

qwen2.5-coder-7b-instruct-npu-ov is an OpenVino int4 quantized version of Qwen2.5-Coder-7B-Instruct, providing a fast inference implementation, optimized for AI PCs using Intel NPU.

This is from the latest release series from Qwen, and is an excellent chat/instruct coding assistant model.

Model Description

• Developed by: Qwen
• Quantized by: llmware
• Model type: qwen2.5
• Parameters: 7 billion
• Model Parent: Qwen/Qwen2.5-Coder-7B-Instruct
• Language(s) (NLP): English
• License: Apache 2.0
• Uses: Chat, general-purpose LLM
• Quantization: int4

Model Card Contact

llmware on github

llmware on hf

llmware website