Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+qwen3-4b-instruct-2507_w8a8_rk3588.rkllm filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,99 @@
+---
+
+license: apache-2.0
+
+library_name: rkllm
+
+base_model: Qwen/Qwen3-4B-Instruct-2507
+
+tags:
+
+  - rkllm
+
+  - rk3588
+
+  - npu
+
+  - rockchip
+
+  - quantized
+
+  - edge-ai
+
+  - orange-pi
+
+model_name: Qwen3-4B-Instruct-2507-RKLLM
+
+pipeline_tag: text-generation
+
+---
+
+
+
+
+
+# Qwen3-4B-Instruct-2507 for RK3588
+
+
+
+This repository contains the optimized **RKLLM** (Language) models for running **Qwen3-4B-Instruct-2507** on Rockchip RK3588 NPUs.
+
+
+
+### 📦 Files
+
+
+
+| File | Type | Description |
+
+| --- | --- | --- |
+
+| `qwen3-4b-instruct-2507_w8a8_rk3588.rkllm` | **RKLLM** | Language Decoder (w8a8) |
+
+
+
+---
+
+
+
+### ⚙️  System Requirements
+
+
+
+* **NPU Driver:** `≥ 0.9.8`
+
+* **RKLLM Runtime:** `v1.2.3`
+
+* **RKNN-Toolkit2:** `v2.3.0`
+
+
+
+### 💻 Tested Hardware
+
+
+
+* **Device:** Orange Pi 5 Pro
+
+* **RAM:** 16GB
+
+* **OS:** Armbian OS
+
+
+
+---
+
+
+
+### 🙏 Acknowledgements
+
+
+
+* [Qwen Team](https://huggingface.co/qwen) for the base model architecture.
+
+* [Rockchip / airockchip](https://github.com/airockchip/rknn-llm) for the RKLLM toolkit and runtime.
+
+* Converted by [Akmal Dira](https://huggingface.co/akmaldira).
+
+
+
+---

qwen3-4b-instruct-2507_w8a8_rk3588.rkllm

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:922e60a2f1b2989d6b486707b8b65fe6f923da097cffd388f09ddf63277efce7
+size 4846781764