Hugging Face's logo

c01zaut
/
Qwen2.5-Coder-14B-Instruct-RK3588-1.1.4

Text Generation
Transformers
Safetensors
English
qwen2
code
codeqwen
chat
qwen
qwen-coder
conversational
text-generation-inference
Model card Files
xet
 Community
c01zaut commited on
Commit
aad6a88
·
verified ·
1 Parent(s): d8f3c0e

Upload folder using huggingface_hub

Browse files
Files changed (26) hide show
  1. .gitattributes +18 -0
  2. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8-opt-0-hybrid-ratio-0.0.rkllm +1 -1
  3. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8-opt-0-hybrid-ratio-0.5.rkllm +1 -1
  4. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8-opt-0-hybrid-ratio-1.0.rkllm +1 -1
  5. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.0.rkllm +1 -1
  6. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.5.rkllm +1 -1
  7. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-1.0.rkllm +1 -1
  8. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.0.rkllm +3 -0
  9. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.5.rkllm +3 -0
  10. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-1.0.rkllm +3 -0
  11. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.0.rkllm +3 -0
  12. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.5.rkllm +3 -0
  13. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-1.0.rkllm +3 -0
  14. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.0.rkllm +3 -0
  15. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.5.rkllm +3 -0
  16. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-1.0.rkllm +3 -0
  17. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.0.rkllm +3 -0
  18. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.5.rkllm +3 -0
  19. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-1.0.rkllm +3 -0
  20. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g512-opt-0-hybrid-ratio-0.0.rkllm +3 -0
  21. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g512-opt-0-hybrid-ratio-0.5.rkllm +3 -0
  22. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g512-opt-0-hybrid-ratio-1.0.rkllm +3 -0
  23. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g512-opt-1-hybrid-ratio-0.0.rkllm +3 -0
  24. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g512-opt-1-hybrid-ratio-0.5.rkllm +3 -0
  25. Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g512-opt-1-hybrid-ratio-1.0.rkllm +3 -0
  26. README.md +1 -1
.gitattributes CHANGED
@@ -39,3 +39,21 @@ Qwen2.5-Coder-14B-Instruct-rk3588-w8a8-opt-0-hybrid-ratio-1.0.rkllm filter=lfs d
39
  Qwen2.5-Coder-14B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
40
  Qwen2.5-Coder-14B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
41
  Qwen2.5-Coder-14B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
39
  Qwen2.5-Coder-14B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
40
  Qwen2.5-Coder-14B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
41
  Qwen2.5-Coder-14B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
42
+ Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
43
+ Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
44
+ Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
45
+ Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
46
+ Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
47
+ Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
48
+ Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
49
+ Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
50
+ Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
51
+ Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
52
+ Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
53
+ Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
54
+ Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g512-opt-0-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
55
+ Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g512-opt-0-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
56
+ Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g512-opt-0-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
57
+ Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g512-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
58
+ Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g512-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
59
+ Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g512-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8-opt-0-hybrid-ratio-0.0.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dd988c3a880f88a5fbf79fc3aff31184175ccecd00151d66ddb556c41b185bd6
3
  size 15595364468
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:795aa74bcc598cd0973affd72880ac17fb8016a9671778f838c25e4a1c4e2678
3
  size 15595364468
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8-opt-0-hybrid-ratio-0.5.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dd988c3a880f88a5fbf79fc3aff31184175ccecd00151d66ddb556c41b185bd6
3
  size 15595364468
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:795aa74bcc598cd0973affd72880ac17fb8016a9671778f838c25e4a1c4e2678
3
  size 15595364468
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8-opt-0-hybrid-ratio-1.0.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dd988c3a880f88a5fbf79fc3aff31184175ccecd00151d66ddb556c41b185bd6
3
  size 15595364468
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:795aa74bcc598cd0973affd72880ac17fb8016a9671778f838c25e4a1c4e2678
3
  size 15595364468
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.0.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c27e561a22d7eb6b0595937917e266fb241bc01456ff3a866dc3d2ae835ea24b
3
  size 15595364468
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b92cc8ac8c8fc4653f67fb690aa8d8c5c49d33b78dc96c30e213c45d415e32bc
3
  size 15595364468
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.5.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c27e561a22d7eb6b0595937917e266fb241bc01456ff3a866dc3d2ae835ea24b
3
  size 15595364468
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b92cc8ac8c8fc4653f67fb690aa8d8c5c49d33b78dc96c30e213c45d415e32bc
3
  size 15595364468
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-1.0.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c27e561a22d7eb6b0595937917e266fb241bc01456ff3a866dc3d2ae835ea24b
3
  size 15595364468
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b92cc8ac8c8fc4653f67fb690aa8d8c5c49d33b78dc96c30e213c45d415e32bc
3
  size 15595364468
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45dc95d6fd4bbc691f8603092368421e685304986759464ce6b8d5299e74ce2e
3
+ size 16567551060
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45dc95d6fd4bbc691f8603092368421e685304986759464ce6b8d5299e74ce2e
3
+ size 16567551060
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45dc95d6fd4bbc691f8603092368421e685304986759464ce6b8d5299e74ce2e
3
+ size 16567551060
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d9ce20fbdda41f82b89e3847977197f4323a07aea4ea7ec5a9099a872e113ca9
3
+ size 16517894180
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d9ce20fbdda41f82b89e3847977197f4323a07aea4ea7ec5a9099a872e113ca9
3
+ size 16517894180
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d9ce20fbdda41f82b89e3847977197f4323a07aea4ea7ec5a9099a872e113ca9
3
+ size 16517894180
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:848030c1ec4f1300b58def85d0ec66a5479a30cb2c2706fc2ead5a65fe7963a1
3
+ size 16071066836
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:848030c1ec4f1300b58def85d0ec66a5479a30cb2c2706fc2ead5a65fe7963a1
3
+ size 16071066836
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:848030c1ec4f1300b58def85d0ec66a5479a30cb2c2706fc2ead5a65fe7963a1
3
+ size 16071066836
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63988cda0bbfc500843365e53b8437685e50c81e1bc2f7858e15c08994a1c6cb
3
+ size 16046887404
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63988cda0bbfc500843365e53b8437685e50c81e1bc2f7858e15c08994a1c6cb
3
+ size 16046887404
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63988cda0bbfc500843365e53b8437685e50c81e1bc2f7858e15c08994a1c6cb
3
+ size 16046887404
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g512-opt-0-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f337de000128b8f76592ce3de239abd20c8be118f3402d20f84358902bb3969a
3
+ size 15822824724
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g512-opt-0-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f337de000128b8f76592ce3de239abd20c8be118f3402d20f84358902bb3969a
3
+ size 15822824724
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g512-opt-0-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f337de000128b8f76592ce3de239abd20c8be118f3402d20f84358902bb3969a
3
+ size 15822824724
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g512-opt-1-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ef468e301c5bfacf49a3d06aa3a94ab23f5f17704bb53c191aa6d7e0ec35cc6
3
+ size 15811384004
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g512-opt-1-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ef468e301c5bfacf49a3d06aa3a94ab23f5f17704bb53c191aa6d7e0ec35cc6
3
+ size 15811384004
Qwen2.5-Coder-14B-Instruct-rk3588-w8a8_g512-opt-1-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ef468e301c5bfacf49a3d06aa3a94ab23f5f17704bb53c191aa6d7e0ec35cc6
3
+ size 15811384004
README.md CHANGED
@@ -16,7 +16,7 @@ tags:
16
  ---
17
  # Qwen2.5-Coder-14B-Instruct-RK3588-1.1.2
18
 
19
- This version of Qwen2.5-Coder-14B-Instruct has been converted to run on the RK3588 NPU using ['w8a8'] quantization.
20
  This model has been optimized with the following LoRA:
21
 
22
  Compatible with RKLLM version: 1.1.2
 
16
  ---
17
  # Qwen2.5-Coder-14B-Instruct-RK3588-1.1.2
18
 
19
+ This version of Qwen2.5-Coder-14B-Instruct has been converted to run on the RK3588 NPU using ['w8a8', 'w8a8_g128', 'w8a8_g256', 'w8a8_g512'] quantization.
20
  This model has been optimized with the following LoRA:
21
 
22
  Compatible with RKLLM version: 1.1.2