NobodyWho/Qwen_Qwen3-1.7B-GGUF

Qwen 3 1.7B

Qwen 3 is not the latest model in the Qwen series. Qwen 3.5 is now available.

---

Model Capabilities

• Text generation — instruction-following chat model
• Tool calling — supports function/tool call syntax
• Thinking mode — can show explicit reasoning steps before answering (see Getting Started)
• Multilinguality — supports over 100 different languages

---

Getting Started

Download the model:

wget https://huggingface.co/NobodyWho/Qwen_Qwen3-1.7B-GGUF/resolve/main/Qwen_Qwen3-1.7B-Q4_K_M.gguf

Run with NobodyWho:

from nobodywho import Chat

chat = Chat("./Qwen_Qwen3-1.7B-Q4_K_M.gguf")
response = chat.ask("What is the capital of Denmark?").completed()
print(response) # Copenhagen!

To enable thinking mode:

chat = Chat("./Qwen_Qwen3-1.7B-Q4_K_M.gguf", template_variables={"enable_thinking": True})
response = chat.ask("Solve this step by step: if x + 3 = 7, what is x?").completed()
print(response) # 4

---

Benchmarks

Coming soon.

---

Model Details

Property	Value
Parameters	1.7B
Context length	32,768 tokens
Knowledge cutoff	Unknown
License	Apache 2.0
Base model	Qwen/Qwen3-1.7B

---

Credits

GGUF quantizations provided by bartowski.