Artem Plastinkin commited on
Commit
e3cea77
·
1 Parent(s): ec1e72e

Update steps

Browse files
int8/benchmarks/x5h_mwmx_npu_apm80_12core.yaml CHANGED
@@ -1,90 +1,90 @@
1
- hardware:
2
- vendor: renesas
3
- chip: rcar-x5h
4
- cpu: arm-cortex-a720
5
- npu: npx6-48k
6
- npu_count: 2
7
- npu_cores: 12
8
- npu_default_freq_mhz: 1066
9
- accelerator:
10
- - npu
11
-
12
- runtime:
13
- engine: mwmx
14
- toolchain_version: "MWMX SDK v4.35.0"
15
- format: onnx
16
- execution_provider: npu
17
- execution_precision: int8
18
-
19
- configuration:
20
- npu_instances: 1
21
- npu_cores_per_instance: 12
22
- npu_freq_mhz: 850
23
-
24
- benchmark:
25
- type: hil
26
- parameters:
27
- batch_size: 1
28
- input_resolution: [1, 3, 512, 512] # inferred from "crop512" in the source checkpoint name
29
-
30
- performance:
31
- fps: null
32
- latency: 3.467288 # APM80 pipeline run (metawaremx_runtime CI)
33
-
34
- metrics:
35
- accuracy: null
36
- top5_accuracy: null
37
-
38
- memory:
39
- peak_mb: null
40
-
41
- power:
42
- avg_w: null
43
-
44
- # Exact commands verified against the NNAC "Getting Started" chapter for this
45
- # model (it is that chapter's own worked example), plus the network_configuration
46
- # block verified against the internal model_zoo compile config for this model's
47
- # 12-core slice (see compile_config/l2seg_csm_16mb.json). Rendered by the
48
- # AI-Dashboard in place of the generic placeholder flow — see
49
- # downloadRunHTML() / parse_reproduce(). NOTE: the 1-core vs. 12-core split
50
- # (see `configuration` above) is set at compile time via
51
- # ${WORKDIR}/nnac_config/config.yaml, not a host_app flag — the on-board run
52
- # command below is identical to the 1-core run.
53
- reproduce:
54
- steps:
55
- - title: Download the ONNX model and compile config
56
- command: hf download Renesas/CenterNet-R18-ONNX --repo-type=model --include "fp32/*" --include "compile_config/*"
57
- - title: Configure the network for the 12-core build
58
- command: |
59
- cat >> ${WORKDIR}/nnac_config/config.yaml << 'EOF'
60
- network_configuration:
61
- centernet_r18_8xb16_crop512_140e_coco:
62
- last_nodes:
63
- - /Reshape_output_0
64
- - /Flatten_output_0
65
- - /Reshape_1_output_0
66
- global_config:
67
- weight_symmetric: true
68
- optimization_options:
69
- - -segmentation_json ./compile_config/l2seg_csm_16mb.json
70
- - -enable_shallow_conv_opt
71
- - -enable_dma_fusion
72
- - -stu_weight
73
- - -distributed_coef_stu
74
- EOF
75
- # If config.yaml already has a network_configuration: key (e.g. from a
76
- # previous model), merge this block into it instead of appending a duplicate key.
77
- - title: Compile with the NNAC toolchain (INT8 auto-cast from the FP32 graph)
78
- command: |
79
- python3 nnac_frontend/legalize.py -d binary/nnx ./fp32/centernet_r18_8xb16_crop512_140e_coco.onnx
80
- - title: Set up the R-Car X5H board
81
- command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
82
- - title: Copy the compiled artifact to the board
83
- command: Copy ${WORKDIR}/binary/nnx to the board -- method may vary (NFS mount, scp, USB, etc.).
84
- - title: Run on R-Car X5H (single NPU cluster, 12 AI cores)
85
- command: |
86
- cd binary
87
- ./host_app ./arc_prog_npus ./nnx/centernet_r18_8xb16_crop512_140e_coco
88
- notes: >-
89
- hash[n] = 0x...(OK) means the run's output matches the reference hash in
90
- hash.txt; latency is the NPX execution time reported in cycles and ms.
 
1
+ hardware:
2
+ vendor: renesas
3
+ chip: rcar-x5h
4
+ cpu: arm-cortex-a720
5
+ npu: npx6-48k
6
+ npu_count: 2
7
+ npu_cores: 12
8
+ npu_default_freq_mhz: 1066
9
+ accelerator:
10
+ - npu
11
+
12
+ runtime:
13
+ engine: mwmx
14
+ toolchain_version: "MWMX SDK v4.35.0"
15
+ format: onnx
16
+ execution_provider: npu
17
+ execution_precision: int8
18
+
19
+ configuration:
20
+ npu_instances: 1
21
+ npu_cores_per_instance: 12
22
+ npu_freq_mhz: 850
23
+
24
+ benchmark:
25
+ type: hil
26
+ parameters:
27
+ batch_size: 1
28
+ input_resolution: [1, 3, 512, 512] # inferred from "crop512" in the source checkpoint name
29
+
30
+ performance:
31
+ fps: null
32
+ latency: 3.467288 # APM80 pipeline run (metawaremx_runtime CI)
33
+
34
+ metrics:
35
+ accuracy: null
36
+ top5_accuracy: null
37
+
38
+ memory:
39
+ peak_mb: null
40
+
41
+ power:
42
+ avg_w: null
43
+
44
+ # Exact commands verified against the NNAC "Getting Started" chapter for this
45
+ # model (it is that chapter's own worked example), plus the network_configuration
46
+ # block verified against the internal model_zoo compile config for this model's
47
+ # 12-core slice (see compile_config/l2seg_csm_16mb.json). Rendered by the
48
+ # AI-Dashboard in place of the generic placeholder flow — see
49
+ # downloadRunHTML() / parse_reproduce(). NOTE: the 1-core vs. 12-core split
50
+ # (see `configuration` above) is set at compile time via
51
+ # ${WORKDIR}/nnac_config/config.yaml, not a host_app flag — the on-board run
52
+ # command below is identical to the 1-core run.
53
+ reproduce:
54
+ steps:
55
+ - title: Download the ONNX model and compile config
56
+ command: hf download Renesas/CenterNet-R18-ONNX --repo-type=model --include "fp32/*" --include "compile_config/*"
57
+ - title: Configure the network for the 12-core build
58
+ command: |
59
+ cat >> ${WORKDIR}/nnac_config/config.yaml << 'EOF'
60
+ network_configuration:
61
+ centernet_r18_8xb16_crop512_140e_coco:
62
+ last_nodes:
63
+ - /Reshape_output_0
64
+ - /Flatten_output_0
65
+ - /Reshape_1_output_0
66
+ global_config:
67
+ weight_symmetric: true
68
+ optimization_options:
69
+ - -segmentation_json ./compile_config/l2seg_csm_16mb.json
70
+ - -enable_shallow_conv_opt
71
+ - -enable_dma_fusion
72
+ - -stu_weight
73
+ - -distributed_coef_stu
74
+ EOF
75
+ # If config.yaml already has a network_configuration: key (e.g. from a
76
+ # previous model), merge this block into it instead of appending a duplicate key.
77
+ - title: Compile with the NNAC toolchain (INT8 auto-cast from the FP32 graph)
78
+ command: |
79
+ python3 nnac_frontend/legalize.py -d binary/nnx ./fp32/centernet_r18_8xb16_crop512_140e_coco.onnx
80
+ - title: Set up the R-Car X5H board
81
+ command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
82
+ kind: note
83
+ - title: Copy the compiled artifact to the board
84
+ command: Copy ${WORKDIR}/binary/nnx to the board -- method may vary (NFS mount, scp, USB, etc.).
85
+ kind: note
86
+ - title: Run on R-Car X5H (single NPU cluster, 12 AI cores)
87
+ command: |
88
+ cd binary
89
+ ./host_app ./arc_prog_npus ./nnx/centernet_r18_8xb16_crop512_140e_coco
90
+ expected: hash[n] = 0x...(OK) means the run's output matches the reference hash in hash.txt; latency is the NPX execution time reported in cycles and ms.
int8/benchmarks/x5h_mwmx_npu_apm80_1core.yaml CHANGED
@@ -1,64 +1,64 @@
1
- hardware:
2
- vendor: renesas
3
- chip: rcar-x5h
4
- cpu: arm-cortex-a720
5
- npu: npx6-48k
6
- npu_count: 2
7
- npu_cores: 12
8
- npu_default_freq_mhz: 1066
9
- accelerator:
10
- - npu
11
-
12
- runtime:
13
- engine: mwmx
14
- toolchain_version: "MWMX SDK v4.35.0"
15
- format: onnx
16
- execution_provider: npu
17
- execution_precision: int8
18
-
19
- configuration:
20
- npu_instances: 1
21
- npu_cores_per_instance: 1
22
- npu_freq_mhz: 850
23
-
24
- benchmark:
25
- type: hil
26
- parameters:
27
- batch_size: 1
28
- input_resolution: [1, 3, 512, 512] # inferred from "crop512" in the source checkpoint name
29
-
30
- performance:
31
- fps: null
32
- latency: 11.978266 # APM80 pipeline run (metawaremx_runtime CI)
33
-
34
- metrics:
35
- accuracy: null
36
- top5_accuracy: null
37
-
38
- memory:
39
- peak_mb: null
40
-
41
- power:
42
- avg_w: null
43
-
44
- # Exact commands verified against the NNAC "Getting Started" chapter for this
45
- # model (it is that chapter's own worked example). Rendered by the AI-Dashboard
46
- # in place of the generic placeholder flow — see downloadRunHTML() / parse_reproduce().
47
- reproduce:
48
- steps:
49
- - title: Download the ONNX model
50
- command: hf download Renesas/CenterNet-R18-ONNX --repo-type=model --include "fp32/*"
51
- - title: Compile with the NNAC toolchain (INT8 auto-cast from the FP32 graph)
52
- command: |
53
- python3 nnac_frontend/legalize.py -d binary/nnx ./fp32/centernet_r18_8xb16_crop512_140e_coco.onnx
54
- - title: Set up the R-Car X5H board
55
- command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
56
- - title: Copy the compiled artifact to the board
57
- command: Copy ${WORKDIR}/binary/nnx to the board -- method may vary (NFS mount, scp, USB, etc.).
58
- - title: Run on R-Car X5H (single NPU cluster)
59
- command: |
60
- cd binary
61
- ./host_app ./arc_prog_npus ./nnx/centernet_r18_8xb16_crop512_140e_coco
62
- notes: >-
63
- hash[n] = 0x...(OK) means the run's output matches the reference hash in
64
- hash.txt; latency is the NPX execution time reported in cycles and ms.
 
1
+ hardware:
2
+ vendor: renesas
3
+ chip: rcar-x5h
4
+ cpu: arm-cortex-a720
5
+ npu: npx6-48k
6
+ npu_count: 2
7
+ npu_cores: 12
8
+ npu_default_freq_mhz: 1066
9
+ accelerator:
10
+ - npu
11
+
12
+ runtime:
13
+ engine: mwmx
14
+ toolchain_version: "MWMX SDK v4.35.0"
15
+ format: onnx
16
+ execution_provider: npu
17
+ execution_precision: int8
18
+
19
+ configuration:
20
+ npu_instances: 1
21
+ npu_cores_per_instance: 1
22
+ npu_freq_mhz: 850
23
+
24
+ benchmark:
25
+ type: hil
26
+ parameters:
27
+ batch_size: 1
28
+ input_resolution: [1, 3, 512, 512] # inferred from "crop512" in the source checkpoint name
29
+
30
+ performance:
31
+ fps: null
32
+ latency: 11.978266 # APM80 pipeline run (metawaremx_runtime CI)
33
+
34
+ metrics:
35
+ accuracy: null
36
+ top5_accuracy: null
37
+
38
+ memory:
39
+ peak_mb: null
40
+
41
+ power:
42
+ avg_w: null
43
+
44
+ # Exact commands verified against the NNAC "Getting Started" chapter for this
45
+ # model (it is that chapter's own worked example). Rendered by the AI-Dashboard
46
+ # in place of the generic placeholder flow — see downloadRunHTML() / parse_reproduce().
47
+ reproduce:
48
+ steps:
49
+ - title: Download the ONNX model
50
+ command: hf download Renesas/CenterNet-R18-ONNX --repo-type=model --include "fp32/*"
51
+ - title: Compile with the NNAC toolchain (INT8 auto-cast from the FP32 graph)
52
+ command: |
53
+ python3 nnac_frontend/legalize.py -d binary/nnx ./fp32/centernet_r18_8xb16_crop512_140e_coco.onnx
54
+ - title: Set up the R-Car X5H board
55
+ command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
56
+ kind: note
57
+ - title: Copy the compiled artifact to the board
58
+ command: Copy ${WORKDIR}/binary/nnx to the board -- method may vary (NFS mount, scp, USB, etc.).
59
+ kind: note
60
+ - title: Run on R-Car X5H (single NPU cluster)
61
+ command: |
62
+ cd binary
63
+ ./host_app ./arc_prog_npus ./nnx/centernet_r18_8xb16_crop512_140e_coco
64
+ expected: hash[n] = 0x...(OK) means the run's output matches the reference hash in hash.txt; latency is the NPX execution time reported in cycles and ms.
int8/benchmarks/x5h_mwmx_npu_apm80_1core_2026-09-16.yaml CHANGED
@@ -54,12 +54,12 @@ reproduce:
54
  python3 nnac_frontend/legalize.py -d binary/nnx ./fp32/centernet_r18_8xb16_crop512_140e_coco.onnx
55
  - title: Set up the R-Car X5H board
56
  command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
 
57
  - title: Copy the compiled artifact to the board
58
  command: Copy ${WORKDIR}/binary/nnx to the board -- method may vary (NFS mount, scp, USB, etc.).
 
59
  - title: Run on R-Car X5H (single NPU cluster)
60
  command: |
61
  cd binary
62
  ./host_app ./arc_prog_npus ./nnx/centernet_r18_8xb16_crop512_140e_coco
63
- notes: >-
64
- hash[n] = 0x...(OK) means the run's output matches the reference hash in
65
- hash.txt; latency is the NPX execution time reported in cycles and ms.
 
54
  python3 nnac_frontend/legalize.py -d binary/nnx ./fp32/centernet_r18_8xb16_crop512_140e_coco.onnx
55
  - title: Set up the R-Car X5H board
56
  command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
57
+ kind: note
58
  - title: Copy the compiled artifact to the board
59
  command: Copy ${WORKDIR}/binary/nnx to the board -- method may vary (NFS mount, scp, USB, etc.).
60
+ kind: note
61
  - title: Run on R-Car X5H (single NPU cluster)
62
  command: |
63
  cd binary
64
  ./host_app ./arc_prog_npus ./nnx/centernet_r18_8xb16_crop512_140e_coco
65
+ expected: hash[n] = 0x...(OK) means the run's output matches the reference hash in hash.txt; latency is the NPX execution time reported in cycles and ms.