add yolov8-pose and ax650 example

README.md

@@ -0,0 +1,103 @@
+---
+license: mit
+language:
+- en
+base_model:
+- Ultralytics/YOLOv8
+pipeline_tag: object-detection
+tags:
+- Ultralytics
+- YOLOv8
+- YOLOv8-POSE
+---
+
+# YOLOv8-POSE
+
+This version of YOLOv8-POSE has been converted to run on the Axera NPU using **w8a16** quantization.
+
+This model has been optimized with the following LoRA: 
+
+Compatible with Pulsar2 version: 3.4
+
+## Convert tools links:
+
+For those who are interested in model conversion, you can try to export axmodel through 
+
+- [The repo of ax-samples](https://github.com/AXERA-TECH/ax-samples), which you can get the how to build the `ax_yolov8_pose`
+
+- [The repo of axcl-samples](https://github.com/AXERA-TECH/axcl-samples), which you can get the how to build the `axcl_yolov8_pose`
+
+- [Pulsar2 Link, How to Convert ONNX to axmodel](https://pulsar2-docs.readthedocs.io/en/latest/pulsar2/introduction.html) 
+
+
+## Support Platform
+
+- AX650
+  - [M4N-Dock(爱芯派Pro)](https://wiki.sipeed.com/hardware/zh/maixIV/m4ndock/m4ndock.html)
+  - [M.2 Accelerator card](https://axcl-docs.readthedocs.io/zh-cn/latest/doc_guide_hardware.html)
+- AX630C
+  - [爱芯派2](https://axera-pi-2-docs-cn.readthedocs.io/zh-cn/latest/index.html)
+  - [Module-LLM](https://docs.m5stack.com/zh_CN/module/Module-LLM)
+  - [LLM630 Compute Kit](https://docs.m5stack.com/zh_CN/core/LLM630%20Compute%20Kit)
+  
+|Chips|cost|
+|--|--|
+|AX650| 10.97 ms |
+|AX630C| TBD ms |
+
+## How to use
+
+Download all files from this repository to the device
+
+```
+root@ax650 ~/yolov8-pose # tree -L 2
+.
+├── ax650
+│   └── yolov8s-pose.axmodel
+├── ax_aarch64
+│   └── ax_yolov8_pose
+├── config.json
+├── football.jpg
+├── README.md
+├── yolov8_pose_config.json
+├── yolov8_pose_out.jpg
+├── yolov8s-pose-cut.onnx
+└── yolov8s-pose.onnx
+
+3 directories, 9 files
+```
+
+### Inference
+
+Input image:
+![](./football.jpg)
+
+#### Inference with AX650 Host, such as M4N-Dock(爱芯派Pro)
+
+```
+root@ax650 ~/yolov8-pose # ./ax_yolov8_pose -m yolov8s-pose.axmodel -i football.jpg
+--------------------------------------
+model file : yolov8s-pose.axmodel
+image file : football.jpg
+img_h, img_w : 640 640
+--------------------------------------
+Engine creating handle is done.
+Engine creating context is done.
+Engine get io info is done.
+Engine alloc io is done.
+Engine push input is done.
+--------------------------------------
+post process cost time:1.24 ms
+--------------------------------------
+Repeat 1 times, avg time 10.97 ms, max_time 10.97 ms, min_time 10.97 ms
+--------------------------------------
+detection num: 4
+ 0:  93%, [ 760,  211, 1125, 1157], person
+ 0:  93%, [1349,  337, 1633, 1039], person
+ 0:  92%, [   0,  354,  324, 1104], person
+ 0:  88%, [ 489,  474,  656,  996], person
+--------------------------------------
+```
+
+Output image:
+![](./yolov8_pose_out.jpg)

ax650/yolov8s-pose.axmodel

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bae976342722cc9b86cbad3ffddfaed8a758fec59c692736fb121098ed22c1b5
+size 12266017

ax_aarch64/ax_yolov8_pose

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6aefe8ba7ee22879e7f187bc36f9a8bd2f7dc22c5f14b0fd677ca2cac1e23d56
+size 5474200

yolov8_pose_config.json

@@ -0,0 +1,54 @@
+{
+  "model_type": "ONNX",
+  "npu_mode": "NPU1",
+  "quant": {
+    "input_configs": [
+      {
+        "tensor_name": "images",
+        "calibration_dataset": "coco_1000.tar",
+        "calibration_size": 32,
+        "calibration_mean": [0, 0, 0],
+        "calibration_std": [255.0, 255.0, 255.0]
+      }
+    ],
+    "calibration_method": "MinMax",
+    "precision_analysis": true,
+    "precision_analysis_method":"EndToEnd"
+  },
+
+  "input_processors": [
+    {
+      "tensor_name": "images",
+      "tensor_format": "RGB",
+      "src_format": "BGR",
+      "src_dtype": "U8",
+      "src_layout": "NHWC"
+    }
+  ],
+
+  "output_processors": [
+    {
+      "tensor_name": "/model.22/Concat_1_output_0",
+      "dst_perm": [0, 2, 3, 1]
+    },    {
+      "tensor_name": "/model.22/Concat_2_output_0",
+      "dst_perm": [0, 2, 3, 1]
+    },    {
+      "tensor_name": "/model.22/Concat_3_output_0",
+      "dst_perm": [0, 2, 3, 1]
+    },    {
+      "tensor_name": "/model.22/cv4.0/cv4.0.2/Conv_output_0",
+      "dst_perm": [0, 2, 3, 1]
+    },    {
+      "tensor_name": "/model.22/cv4.1/cv4.1.2/Conv_output_0",
+      "dst_perm": [0, 2, 3, 1]
+    },    {
+      "tensor_name": "/model.22/cv4.2/cv4.2.2/Conv_output_0",
+      "dst_perm": [0, 2, 3, 1]
+    }
+  ],
+
+  "compiler": {
+    "check": 0
+  }
+}

yolov8s-pose-cut.onnx

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ce399becb192911d9ce09499ed5c404bb25a835f17b1ab7e092dcdd3b418d189
+size 46524597

yolov8s-pose.onnx

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:31fdc9f23b4ad089e74210c7c1924c499dad43d9c39495d65d746e065b961bf6
+size 46817828