|
|
--- |
|
|
license: mit |
|
|
language: |
|
|
- en |
|
|
base_model: |
|
|
- Ultralytics/YOLOv8 |
|
|
pipeline_tag: object-detection |
|
|
tags: |
|
|
- Ultralytics |
|
|
- YOLOv8 |
|
|
- YOLOv8-POSE |
|
|
--- |
|
|
|
|
|
# YOLOv8-POSE |
|
|
|
|
|
This version of YOLOv8-POSE has been converted to run on the Axera NPU using **w8a16** quantization. |
|
|
|
|
|
This model has been optimized with the following LoRA: |
|
|
|
|
|
Compatible with Pulsar2 version: 3.4 |
|
|
|
|
|
## Convert tools links: |
|
|
|
|
|
For those who are interested in model conversion, you can try to export axmodel through |
|
|
|
|
|
- [The repo of ax-samples](https://github.com/AXERA-TECH/ax-samples), which you can get the how to build the `ax_yolov8_pose` |
|
|
|
|
|
- [The repo of axcl-samples](https://github.com/AXERA-TECH/axcl-samples), which you can get the how to build the `axcl_yolov8_pose` |
|
|
|
|
|
- [Pulsar2 Link, How to Convert ONNX to axmodel](https://pulsar2-docs.readthedocs.io/en/latest/pulsar2/introduction.html) |
|
|
|
|
|
|
|
|
## Support Platform |
|
|
|
|
|
- AX650 |
|
|
- [M4N-Dock(η±θ―ζ΄ΎPro)](https://wiki.sipeed.com/hardware/zh/maixIV/m4ndock/m4ndock.html) |
|
|
- [M.2 Accelerator card](https://axcl-docs.readthedocs.io/zh-cn/latest/doc_guide_hardware.html) |
|
|
- AX630C |
|
|
- [η±θ―ζ΄Ύ2](https://axera-pi-2-docs-cn.readthedocs.io/zh-cn/latest/index.html) |
|
|
- [Module-LLM](https://docs.m5stack.com/zh_CN/module/Module-LLM) |
|
|
- [LLM630 Compute Kit](https://docs.m5stack.com/zh_CN/core/LLM630%20Compute%20Kit) |
|
|
|
|
|
|Chips|cost| |
|
|
|--|--| |
|
|
|AX650| 10.97 ms | |
|
|
|AX630C| TBD ms | |
|
|
|
|
|
## How to use |
|
|
|
|
|
Download all files from this repository to the device |
|
|
|
|
|
``` |
|
|
root@ax650 ~/yolov8-pose # tree -L 2 |
|
|
. |
|
|
βββ ax650 |
|
|
βΒ Β βββ yolov8s-pose.axmodel |
|
|
βββ ax_aarch64 |
|
|
βΒ Β βββ ax_yolov8_pose |
|
|
βββ config.json |
|
|
βββ football.jpg |
|
|
βββ README.md |
|
|
βββ yolov8_pose_config.json |
|
|
βββ yolov8_pose_out.jpg |
|
|
βββ yolov8s-pose-cut.onnx |
|
|
βββ yolov8s-pose.onnx |
|
|
|
|
|
3 directories, 9 files |
|
|
``` |
|
|
|
|
|
### Inference |
|
|
|
|
|
Input image: |
|
|
 |
|
|
|
|
|
#### Inference with AX650 Host, such as M4N-Dock(η±θ―ζ΄ΎPro) |
|
|
|
|
|
``` |
|
|
root@ax650 ~/yolov8-pose # ./ax_yolov8_pose -m yolov8s-pose.axmodel -i football.jpg |
|
|
-------------------------------------- |
|
|
model file : yolov8s-pose.axmodel |
|
|
image file : football.jpg |
|
|
img_h, img_w : 640 640 |
|
|
-------------------------------------- |
|
|
Engine creating handle is done. |
|
|
Engine creating context is done. |
|
|
Engine get io info is done. |
|
|
Engine alloc io is done. |
|
|
Engine push input is done. |
|
|
-------------------------------------- |
|
|
post process cost time:1.24 ms |
|
|
-------------------------------------- |
|
|
Repeat 1 times, avg time 10.97 ms, max_time 10.97 ms, min_time 10.97 ms |
|
|
-------------------------------------- |
|
|
detection num: 4 |
|
|
0: 93%, [ 760, 211, 1125, 1157], person |
|
|
0: 93%, [1349, 337, 1633, 1039], person |
|
|
0: 92%, [ 0, 354, 324, 1104], person |
|
|
0: 88%, [ 489, 474, 656, 996], person |
|
|
-------------------------------------- |
|
|
``` |
|
|
|
|
|
Output image: |
|
|
 |
|
|
|