fangmingguo commited on
Commit
5264f19
Β·
verified Β·
1 Parent(s): db684b1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +44 -11
README.md CHANGED
@@ -10,14 +10,12 @@ base_model:
10
  pipeline_tag: depth-estimation
11
 
12
  tags:
 
13
  - RAFT-Stereo
 
14
  - Stereo-Matching
15
- - Disparity-Estimation
16
  - Depth-Estimation
17
  - Computer-Vision
18
- - 3DV-2021
19
- - PyTorch
20
- - Convolutional-GRU
21
  ---
22
 
23
  # RAFT-Stereo on Axera NPU
@@ -44,21 +42,56 @@ For model conversion and deployment guidance:
44
  - [LLM630 Compute Kit](https://docs.m5stack.com/zh_CN/core/LLM630%20Compute%20Kit)
45
 
46
 
47
- | Chips | Model Variant | NPU3 Latency (ms) |
48
  | --- | --- | --- |
49
- | AX650 | RAFT-Stereo-Small | TBD |
 
50
 
51
- | Chips | Model Variant | NPU2 Latency (ms) |
52
  | --- | --- | --- |
53
- | AX630C| RAFT-Stereo-Small | TBD |
 
54
 
55
  ## How to Use
56
 
57
  Download the repository and ensure the directory structure is organized as follows:
58
 
59
  ```text
60
-
61
-
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
62
  ```
63
 
64
  ### Prerequisites
@@ -86,7 +119,7 @@ python3 infer.py --left examples/left/000051_11.png --right examples/right/00005
86
  The model generates a dense disparity map representing the depth of the scene. Results are saved as colorized depth maps and point cloud projections where applicable.
87
 
88
  ```
89
- (base) root@ax630c:~/data# python3 infer.py --left examples/left/000051_11.png --right examples/right/000051_11.png --model raft_steoro256x640_r1_npu2.axmodel --width 640 --height 256
90
  [INFO] Available providers: ['AxEngineExecutionProvider']
91
  [INFO] Using provider: AxEngineExecutionProvider
92
  [INFO] Chip type: ChipType.MC20E
 
10
  pipeline_tag: depth-estimation
11
 
12
  tags:
13
+ - Axera
14
  - RAFT-Stereo
15
+ - NPU
16
  - Stereo-Matching
 
17
  - Depth-Estimation
18
  - Computer-Vision
 
 
 
19
  ---
20
 
21
  # RAFT-Stereo on Axera NPU
 
42
  - [LLM630 Compute Kit](https://docs.m5stack.com/zh_CN/core/LLM630%20Compute%20Kit)
43
 
44
 
45
+ | Chips | Model Variant | Latency (ms) |
46
  | --- | --- | --- |
47
+ | AX650 | raft_steoro256x640_r1.axmodel | 20.9 |
48
+ | AX650 | raft_steoro256x640_r4.axmodel | 111.8 |
49
 
50
+ | Chips | Model Variant | Latency (ms) |
51
  | --- | --- | --- |
52
+ | AX630C| raft_steoro256x640_r1_npu2.axmodel | 317.765 |
53
+ | AX630C| raft_steoro256x640_r4_npu2.axmodel | 825.793 |
54
 
55
  ## How to Use
56
 
57
  Download the repository and ensure the directory structure is organized as follows:
58
 
59
  ```text
60
+ β”œβ”€β”€ ax630c
61
+ β”‚ β”œβ”€β”€ raft_steoro256x640_r1.onnx
62
+ β”‚ β”œβ”€β”€ raft_steoro256x640_r1_npu2.axmodel
63
+ β”‚ β”œβ”€β”€ raft_steoro256x640_r4.onnx
64
+ β”‚ └── raft_steoro256x640_r4_npu2.axmodel
65
+ β”œβ”€β”€ ax650
66
+ β”‚ β”œβ”€β”€ raft_steoro256x640_r1.axmodel
67
+ β”‚ β”œβ”€β”€ raft_steoro256x640_r1.onnx
68
+ β”‚ β”œβ”€β”€ raft_steoro384x1280_r4.axmodel
69
+ β”‚ └── raft_steoro384x1280_r4.onnx
70
+ β”œβ”€β”€ examples
71
+ β”‚ β”œβ”€β”€ left
72
+ β”‚ β”‚ β”œβ”€β”€ 000051_11.png
73
+ β”‚ β”‚ β”œβ”€β”€ 000058_11.png
74
+ β”‚ β”‚ β”œβ”€β”€ 000059_10.png
75
+ β”‚ β”‚ β”œβ”€β”€ 000121_10.png
76
+ β”‚ β”‚ β”œβ”€β”€ 000164_10.png
77
+ β”‚ β”‚ β”œβ”€β”€ 000167_11.png
78
+ β”‚ β”‚ β”œβ”€β”€ 000172_11.png
79
+ β”‚ β”‚ β”œβ”€β”€ 000179_10.png
80
+ β”‚ β”‚ β”œβ”€β”€ 000193_10.png
81
+ β”‚ β”‚ └── 000195_10.png
82
+ β”‚ └── right
83
+ β”‚ β”œβ”€β”€ 000051_11.png
84
+ β”‚ β”œβ”€β”€ 000058_11.png
85
+ β”‚ β”œβ”€β”€ 000059_10.png
86
+ β”‚ β”œβ”€β”€ 000121_10.png
87
+ β”‚ β”œβ”€β”€ 000164_10.png
88
+ β”‚ β”œβ”€β”€ 000167_11.png
89
+ β”‚ β”œβ”€β”€ 000172_11.png
90
+ β”‚ β”œβ”€β”€ 000179_10.png
91
+ β”‚ β”œβ”€β”€ 000193_10.png
92
+ β”‚ └── 000195_10.png
93
+ β”œβ”€β”€ infer.py
94
+ └── infer_onnx.py
95
  ```
96
 
97
  ### Prerequisites
 
119
  The model generates a dense disparity map representing the depth of the scene. Results are saved as colorized depth maps and point cloud projections where applicable.
120
 
121
  ```
122
+ (base) root@ax630c:~/data# /python3 infer.py --left examples/left/000051_11.png --right examples/right/000051_11.png --model raft_steoro256x640_r4_npu2.axmodel --width 640 --height 256
123
  [INFO] Available providers: ['AxEngineExecutionProvider']
124
  [INFO] Using provider: AxEngineExecutionProvider
125
  [INFO] Chip type: ChipType.MC20E