---

license: apache-2.0
library_name: rkllm
base_model: Qwen/Qwen3-4B-Instruct-2507
tags:
  - rkllm
  - rk3588
  - npu
  - rockchip
  - quantized
  - edge-ai
  - orange-pi
model_name: Qwen3-4B-Instruct-2507-RKLLM
pipeline_tag: text-generation

---

# Qwen3-4B-Instruct-2507 for RK3588

This repository contains the optimized **RKLLM** (Language) models for running **Qwen3-4B-Instruct-2507** on Rockchip RK3588 NPUs.

### 📦 Files

| File | Type | Description |
| --- | --- | --- |
| `qwen3-4b-instruct-2507_w8a8_rk3588.rkllm` | **RKLLM** | Language Decoder (w8a8) |

---

### ⚙️ System Requirements

* **NPU Driver:** `≥ 0.9.8`
* **RKLLM Runtime:** `v1.2.3`
* **RKNN-Toolkit2:** `v2.3.0`

### 💻 Tested Hardware

* **Device:** Orange Pi 5 Pro
* **RAM:** 16GB
* **OS:** Armbian OS

---

### 🙏 Acknowledgements

* [Qwen Team](https://huggingface.co/qwen) for the base model architecture.
* [Rockchip / airockchip](https://github.com/airockchip/rknn-llm) for the RKLLM toolkit and runtime.
* Converted by [Akmal Dira](https://huggingface.co/akmaldira).

---