qwen3-1.7b-instruct-gguf

qwen3-1.7b-instruct-gguf is a GGUF Q4_K_M int4 quantized version of Qwen3-1.7B, providing a very fast inference implementation, optimized for AI PCs.

Model Description

  • Developed by: Qwen
  • Model type: qwen3
  • Parameters: 1.7 billion
  • Model Parent: Qwen/Qwen3-1.7B-Instruct
  • Language(s) (NLP): English
  • License: Apache 2.0
  • Uses: Chat, general-purpose LLM
  • Quantization: int4

Model Card Contact

llmware on github

llmware on hf

llmware website

Downloads last month
8
GGUF
Model size
2B params
Architecture
qwen3
Hardware compatibility
Log In to add your hardware

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support