CtrlX commited on
Commit
71efaae
·
1 Parent(s): 90d9724

Upload folder using huggingface_hub

Browse files
demo/mvitv2-tiny_3rdparty_in1k-pss.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:46fd8154f4f99a9298107448678d18fcd12b7f5ac0d40b308b22c4e298a4c46c
3
+ size 99465796
logs/clip-vit-base-p16_openai-pre_3rdparty_in1k.log ADDED
@@ -0,0 +1,59 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2023-11-29 15:09:12.293580691 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.11/attn/Unsqueeze_3
2
+ 2023-11-29 15:09:12.294661741 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.11/attn/Unsqueeze_1
3
+ 2023-11-29 15:09:12.297861012 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.10/attn/Unsqueeze_3
4
+ 2023-11-29 15:09:12.300248384 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.10/attn/Unsqueeze_1
5
+ 2023-11-29 15:09:12.300581163 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.9/attn/Unsqueeze_3
6
+ 2023-11-29 15:09:12.300893450 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.9/attn/Unsqueeze_1
7
+ 2023-11-29 15:09:12.301199102 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.8/attn/Unsqueeze_3
8
+ 2023-11-29 15:09:12.301620862 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.8/attn/Unsqueeze_1
9
+ 2023-11-29 15:09:12.302088332 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.7/attn/Unsqueeze_3
10
+ 2023-11-29 15:09:12.302479790 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.7/attn/Unsqueeze_1
11
+ 2023-11-29 15:09:12.302824403 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.6/attn/Unsqueeze_3
12
+ 2023-11-29 15:09:12.303150500 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.6/attn/Unsqueeze_1
13
+ 2023-11-29 15:09:12.303542431 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.5/attn/Unsqueeze_3
14
+ 2023-11-29 15:09:12.303944258 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.5/attn/Unsqueeze_1
15
+ 2023-11-29 15:09:12.304276924 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.4/attn/Unsqueeze_3
16
+ 2023-11-29 15:09:12.304626992 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.4/attn/Unsqueeze_1
17
+ 2023-11-29 15:09:12.305012447 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.3/attn/Unsqueeze_3
18
+ 2023-11-29 15:09:12.305353981 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.3/attn/Unsqueeze_1
19
+ 2023-11-29 15:09:12.305676527 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/attn/Unsqueeze_3
20
+ 2023-11-29 15:09:12.305989485 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/attn/Unsqueeze_1
21
+ 2023-11-29 15:09:12.306651191 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/attn/Unsqueeze_3
22
+ 2023-11-29 15:09:12.307020966 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/attn/Unsqueeze_1
23
+ 2023-11-29 15:09:12.307388962 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/attn/Unsqueeze_3
24
+ 2023-11-29 15:09:12.307766027 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/attn/Unsqueeze_1
25
+ [W] 'colored' module is not installed, will not use colors when logging. To enable colors, please install the 'colored' module: python3 -m pip install colored
26
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize original/clip-vit-base-p16_openai-pre_3rdparty_in1k.onnx --fold-constant -o optimized/clip-vit-base-p16_openai-pre_3rdparty_in1k-pss.onnx
27
+ [I] Loading model: /sky/ModelReady/onnx/original/clip-vit-base-p16_openai-pre_3rdparty_in1k.onnx
28
+ [I] Original Model:
29
+ Name: main_graph | ONNX Opset: 14
30
+
31
+ ---- 1 Graph Input(s) ----
32
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
33
+
34
+ ---- 1 Graph Output(s) ----
35
+ {output [dtype=float32, shape=('batch_size', 1000)]}
36
+
37
+ ---- 153 Initializer(s) ----
38
+
39
+ ---- 1052 Node(s) ----
40
+
41
+ [I] Folding Constants | Pass 1
42
+ [I] Total Nodes | Original: 1052, After Folding: 660 | 392 Nodes Folded
43
+ [I] Folding Constants | Pass 2
44
+ [I] Total Nodes | Original: 660, After Folding: 660 | 0 Nodes Folded
45
+ [I] Saving ONNX model to: optimized/clip-vit-base-p16_openai-pre_3rdparty_in1k-pss.onnx
46
+ [I] New Model:
47
+ Name: main_graph | ONNX Opset: 14
48
+
49
+ ---- 1 Graph Input(s) ----
50
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
51
+
52
+ ---- 1 Graph Output(s) ----
53
+ {output [dtype=float32, shape=('batch_size', 1000)]}
54
+
55
+ ---- 387 Initializer(s) ----
56
+
57
+ ---- 660 Node(s) ----
58
+
59
+ [I] PASSED | Runtime: 17.700s | Command: /usr/local/bin/polygraphy surgeon sanitize original/clip-vit-base-p16_openai-pre_3rdparty_in1k.onnx --fold-constant -o optimized/clip-vit-base-p16_openai-pre_3rdparty_in1k-pss.onnx
logs/conformer-tiny-p16_3rdparty_in1k.log ADDED
@@ -0,0 +1,72 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2023-11-29 15:09:14.939900439 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_12/expand_block/Unsqueeze_1
2
+ 2023-11-29 15:09:14.940346342 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_12/trans_block/attn/Unsqueeze_3
3
+ 2023-11-29 15:09:14.940745197 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_12/trans_block/attn/Unsqueeze_1
4
+ 2023-11-29 15:09:14.941394926 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_11/expand_block/Unsqueeze_1
5
+ 2023-11-29 15:09:14.942803165 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_11/trans_block/attn/Unsqueeze_3
6
+ 2023-11-29 15:09:14.943929181 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_11/trans_block/attn/Unsqueeze_1
7
+ 2023-11-29 15:09:14.944518149 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_10/expand_block/Unsqueeze_1
8
+ 2023-11-29 15:09:14.944938725 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_10/trans_block/attn/Unsqueeze_3
9
+ 2023-11-29 15:09:14.945294620 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_10/trans_block/attn/Unsqueeze_1
10
+ 2023-11-29 15:09:14.945887429 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_9/expand_block/Unsqueeze_1
11
+ 2023-11-29 15:09:14.946219329 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_9/trans_block/attn/Unsqueeze_3
12
+ 2023-11-29 15:09:14.946538938 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_9/trans_block/attn/Unsqueeze_1
13
+ 2023-11-29 15:09:14.947429193 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_8/expand_block/Unsqueeze_1
14
+ 2023-11-29 15:09:14.947928555 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_8/trans_block/attn/Unsqueeze_3
15
+ 2023-11-29 15:09:14.948282693 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_8/trans_block/attn/Unsqueeze_1
16
+ 2023-11-29 15:09:14.948908713 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_7/expand_block/Unsqueeze_1
17
+ 2023-11-29 15:09:14.949383183 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_7/trans_block/attn/Unsqueeze_3
18
+ 2023-11-29 15:09:14.949741923 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_7/trans_block/attn/Unsqueeze_1
19
+ 2023-11-29 15:09:14.950632714 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_6/expand_block/Unsqueeze_1
20
+ 2023-11-29 15:09:14.951381488 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_6/trans_block/attn/Unsqueeze_3
21
+ 2023-11-29 15:09:14.951894268 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_6/trans_block/attn/Unsqueeze_1
22
+ 2023-11-29 15:09:14.952620457 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_5/expand_block/Unsqueeze_1
23
+ 2023-11-29 15:09:14.952975687 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_5/trans_block/attn/Unsqueeze_3
24
+ 2023-11-29 15:09:14.953344708 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_5/trans_block/attn/Unsqueeze_1
25
+ 2023-11-29 15:09:14.953800672 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_4/expand_block/Unsqueeze_1
26
+ 2023-11-29 15:09:14.954150023 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_4/trans_block/attn/Unsqueeze_3
27
+ 2023-11-29 15:09:14.954496395 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_4/trans_block/attn/Unsqueeze_1
28
+ 2023-11-29 15:09:14.954867496 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_3/expand_block/Unsqueeze_1
29
+ 2023-11-29 15:09:14.955285772 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_3/trans_block/attn/Unsqueeze_3
30
+ 2023-11-29 15:09:14.955677114 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_3/trans_block/attn/Unsqueeze_1
31
+ 2023-11-29 15:09:14.956033404 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_2/expand_block/Unsqueeze_1
32
+ 2023-11-29 15:09:14.956407043 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_2/trans_block/attn/Unsqueeze_3
33
+ 2023-11-29 15:09:14.956801089 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/conv_trans_2/trans_block/attn/Unsqueeze_1
34
+ 2023-11-29 15:09:14.957204950 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/trans_1/attn/Unsqueeze_3
35
+ 2023-11-29 15:09:14.957581222 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/trans_1/attn/Unsqueeze_1
36
+ [W] 'colored' module is not installed, will not use colors when logging. To enable colors, please install the 'colored' module: python3 -m pip install colored
37
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize original/conformer-tiny-p16_3rdparty_in1k.onnx --fold-constant -o optimized/conformer-tiny-p16_3rdparty_in1k-pss.onnx
38
+ [I] Loading model: /sky/ModelReady/onnx/original/conformer-tiny-p16_3rdparty_in1k.onnx
39
+ [I] Original Model:
40
+ Name: main_graph | ONNX Opset: 14
41
+
42
+ ---- 1 Graph Input(s) ----
43
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
44
+
45
+ ---- 2 Graph Output(s) ----
46
+ {output [dtype=float32, shape=('batch_size', 1000)],
47
+ 3169 [dtype=float32, shape=('batch_size', 1000)]}
48
+
49
+ ---- 367 Initializer(s) ----
50
+
51
+ ---- 2196 Node(s) ----
52
+
53
+ [I] Folding Constants | Pass 1
54
+ [I] Total Nodes | Original: 2196, After Folding: 1250 | 946 Nodes Folded
55
+ [I] Folding Constants | Pass 2
56
+ [I] Total Nodes | Original: 1250, After Folding: 1250 | 0 Nodes Folded
57
+ [I] Saving ONNX model to: optimized/conformer-tiny-p16_3rdparty_in1k-pss.onnx
58
+ [I] New Model:
59
+ Name: main_graph | ONNX Opset: 14
60
+
61
+ ---- 1 Graph Input(s) ----
62
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
63
+
64
+ ---- 2 Graph Output(s) ----
65
+ {output [dtype=float32, shape=('batch_size', 1000)],
66
+ 3169 [dtype=float32, shape=('batch_size', 1000)]}
67
+
68
+ ---- 852 Initializer(s) ----
69
+
70
+ ---- 1250 Node(s) ----
71
+
72
+ [I] PASSED | Runtime: 21.493s | Command: /usr/local/bin/polygraphy surgeon sanitize original/conformer-tiny-p16_3rdparty_in1k.onnx --fold-constant -o optimized/conformer-tiny-p16_3rdparty_in1k-pss.onnx
logs/deit-tiny_4xb256_in1k.log ADDED
@@ -0,0 +1,59 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2023-11-29 15:09:12.573468351 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.11/attn/Unsqueeze_3
2
+ 2023-11-29 15:09:12.574252294 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.11/attn/Unsqueeze_1
3
+ 2023-11-29 15:09:12.574621291 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.10/attn/Unsqueeze_3
4
+ 2023-11-29 15:09:12.575131755 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.10/attn/Unsqueeze_1
5
+ 2023-11-29 15:09:12.575398657 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.9/attn/Unsqueeze_3
6
+ 2023-11-29 15:09:12.575685851 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.9/attn/Unsqueeze_1
7
+ 2023-11-29 15:09:12.575902098 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.8/attn/Unsqueeze_3
8
+ 2023-11-29 15:09:12.576185493 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.8/attn/Unsqueeze_1
9
+ 2023-11-29 15:09:12.576464586 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.7/attn/Unsqueeze_3
10
+ 2023-11-29 15:09:12.576884338 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.7/attn/Unsqueeze_1
11
+ 2023-11-29 15:09:12.577161201 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.6/attn/Unsqueeze_3
12
+ 2023-11-29 15:09:12.577394477 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.6/attn/Unsqueeze_1
13
+ 2023-11-29 15:09:12.577860668 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.5/attn/Unsqueeze_3
14
+ 2023-11-29 15:09:12.578153157 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.5/attn/Unsqueeze_1
15
+ 2023-11-29 15:09:12.578364888 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.4/attn/Unsqueeze_3
16
+ 2023-11-29 15:09:12.578567306 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.4/attn/Unsqueeze_1
17
+ 2023-11-29 15:09:12.579036029 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.3/attn/Unsqueeze_3
18
+ 2023-11-29 15:09:12.579364792 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.3/attn/Unsqueeze_1
19
+ 2023-11-29 15:09:12.579831565 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/attn/Unsqueeze_3
20
+ 2023-11-29 15:09:12.580081433 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/attn/Unsqueeze_1
21
+ 2023-11-29 15:09:12.580926808 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/attn/Unsqueeze_3
22
+ 2023-11-29 15:09:12.581502873 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/attn/Unsqueeze_1
23
+ 2023-11-29 15:09:12.581764516 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/attn/Unsqueeze_3
24
+ 2023-11-29 15:09:12.582766888 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/attn/Unsqueeze_1
25
+ [W] 'colored' module is not installed, will not use colors when logging. To enable colors, please install the 'colored' module: python3 -m pip install colored
26
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize original/deit-tiny_4xb256_in1k.onnx --fold-constant -o optimized/deit-tiny_4xb256_in1k-pss.onnx
27
+ [I] Loading model: /sky/ModelReady/onnx/original/deit-tiny_4xb256_in1k.onnx
28
+ [I] Original Model:
29
+ Name: main_graph | ONNX Opset: 14
30
+
31
+ ---- 1 Graph Input(s) ----
32
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
33
+
34
+ ---- 1 Graph Output(s) ----
35
+ {output [dtype=float32, shape=('batch_size', 1000)]}
36
+
37
+ ---- 152 Initializer(s) ----
38
+
39
+ ---- 1041 Node(s) ----
40
+
41
+ [I] Folding Constants | Pass 1
42
+ [I] Total Nodes | Original: 1041, After Folding: 651 | 390 Nodes Folded
43
+ [I] Folding Constants | Pass 2
44
+ [I] Total Nodes | Original: 651, After Folding: 651 | 0 Nodes Folded
45
+ [I] Saving ONNX model to: optimized/deit-tiny_4xb256_in1k-pss.onnx
46
+ [I] New Model:
47
+ Name: main_graph | ONNX Opset: 14
48
+
49
+ ---- 1 Graph Input(s) ----
50
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
51
+
52
+ ---- 1 Graph Output(s) ----
53
+ {output [dtype=float32, shape=('batch_size', 1000)]}
54
+
55
+ ---- 384 Initializer(s) ----
56
+
57
+ ---- 651 Node(s) ----
58
+
59
+ [I] PASSED | Runtime: 17.564s | Command: /usr/local/bin/polygraphy surgeon sanitize original/deit-tiny_4xb256_in1k.onnx --fold-constant -o optimized/deit-tiny_4xb256_in1k-pss.onnx
logs/deit3-small-p16_3rdparty_in1k.log ADDED
@@ -0,0 +1,59 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2023-11-29 15:09:12.531192075 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.11/attn/Unsqueeze_3
2
+ 2023-11-29 15:09:12.542654826 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.11/attn/Unsqueeze_1
3
+ 2023-11-29 15:09:12.543410565 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.10/attn/Unsqueeze_3
4
+ 2023-11-29 15:09:12.554535030 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.10/attn/Unsqueeze_1
5
+ 2023-11-29 15:09:12.554985166 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.9/attn/Unsqueeze_3
6
+ 2023-11-29 15:09:12.555324748 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.9/attn/Unsqueeze_1
7
+ 2023-11-29 15:09:12.555599208 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.8/attn/Unsqueeze_3
8
+ 2023-11-29 15:09:12.555908011 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.8/attn/Unsqueeze_1
9
+ 2023-11-29 15:09:12.556977290 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.7/attn/Unsqueeze_3
10
+ 2023-11-29 15:09:12.557271351 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.7/attn/Unsqueeze_1
11
+ 2023-11-29 15:09:12.557618691 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.6/attn/Unsqueeze_3
12
+ 2023-11-29 15:09:12.557982970 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.6/attn/Unsqueeze_1
13
+ 2023-11-29 15:09:12.558309710 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.5/attn/Unsqueeze_3
14
+ 2023-11-29 15:09:12.559194097 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.5/attn/Unsqueeze_1
15
+ 2023-11-29 15:09:12.559647362 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.4/attn/Unsqueeze_3
16
+ 2023-11-29 15:09:12.560230151 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.4/attn/Unsqueeze_1
17
+ 2023-11-29 15:09:12.560590522 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.3/attn/Unsqueeze_3
18
+ 2023-11-29 15:09:12.561135991 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.3/attn/Unsqueeze_1
19
+ 2023-11-29 15:09:12.561514864 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/attn/Unsqueeze_3
20
+ 2023-11-29 15:09:12.561950134 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/attn/Unsqueeze_1
21
+ 2023-11-29 15:09:12.564579332 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/attn/Unsqueeze_3
22
+ 2023-11-29 15:09:12.564999004 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/attn/Unsqueeze_1
23
+ 2023-11-29 15:09:12.565487350 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/attn/Unsqueeze_3
24
+ 2023-11-29 15:09:12.565796955 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/attn/Unsqueeze_1
25
+ [W] 'colored' module is not installed, will not use colors when logging. To enable colors, please install the 'colored' module: python3 -m pip install colored
26
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize original/deit3-small-p16_3rdparty_in1k.onnx --fold-constant -o optimized/deit3-small-p16_3rdparty_in1k-pss.onnx
27
+ [I] Loading model: /sky/ModelReady/onnx/original/deit3-small-p16_3rdparty_in1k.onnx
28
+ [I] Original Model:
29
+ Name: main_graph | ONNX Opset: 14
30
+
31
+ ---- 1 Graph Input(s) ----
32
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
33
+
34
+ ---- 1 Graph Output(s) ----
35
+ {output [dtype=float32, shape=('batch_size', 1000)]}
36
+
37
+ ---- 152 Initializer(s) ----
38
+
39
+ ---- 1065 Node(s) ----
40
+
41
+ [I] Folding Constants | Pass 1
42
+ [I] Total Nodes | Original: 1065, After Folding: 675 | 390 Nodes Folded
43
+ [I] Folding Constants | Pass 2
44
+ [I] Total Nodes | Original: 675, After Folding: 675 | 0 Nodes Folded
45
+ [I] Saving ONNX model to: optimized/deit3-small-p16_3rdparty_in1k-pss.onnx
46
+ [I] New Model:
47
+ Name: main_graph | ONNX Opset: 14
48
+
49
+ ---- 1 Graph Input(s) ----
50
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
51
+
52
+ ---- 1 Graph Output(s) ----
53
+ {output [dtype=float32, shape=('batch_size', 1000)]}
54
+
55
+ ---- 384 Initializer(s) ----
56
+
57
+ ---- 675 Node(s) ----
58
+
59
+ [I] PASSED | Runtime: 18.078s | Command: /usr/local/bin/polygraphy surgeon sanitize original/deit3-small-p16_3rdparty_in1k.onnx --fold-constant -o optimized/deit3-small-p16_3rdparty_in1k-pss.onnx
logs/edgenext-xxsmall_3rdparty_in1k.log ADDED
@@ -0,0 +1,44 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2023-11-30 02:59:49.452829434 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/stages.1.1/Unsqueeze_8
2
+ 2023-11-30 02:59:49.455115633 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/stages.1.1/Unsqueeze_7
3
+ 2023-11-30 02:59:49.456045622 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/stages.1.1/Unsqueeze_6
4
+ 2023-11-30 02:59:49.457868728 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/stages.1.1/pos_embed/Unsqueeze_2
5
+ 2023-11-30 02:59:49.458697140 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/stages.1.1/pos_embed/Unsqueeze_1
6
+ 2023-11-30 02:59:49.459548078 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/stages.1.1/Unsqueeze_1
7
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize onnx/edgenext-xxsmall_3rdparty_in1k.onnx --fold-constant -o pt/edgenext-xxsmall_3rdparty_in1k-pss.onnx
8
+ [I] Loading model: /sky/Test/flaskProject/models/script/onnx/edgenext-xxsmall_3rdparty_in1k.onnx
9
+ [W] Falling back to `onnx.shape_inference` because `onnxruntime.tools.symbolic_shape_infer` either could not be loaded or did not run successfully.
10
+ Note that using ONNX-Runtime for shape inference may be faster and require less memory.
11
+ Consider installing ONNX-Runtime or setting POLYGRAPHY_AUTOINSTALL_DEPS=1 in your environment variables to allow Polygraphy to do so automatically.
12
+ [I] Loading model: /tmp/tmp_polygraphy_5b75128cb00a909a5235eba6a1a2a24e6c6e8adab1864677.onnx
13
+ [I] Original Model:
14
+ Name: main_graph | ONNX Opset: 14
15
+
16
+ ---- 1 Graph Input(s) ----
17
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
18
+
19
+ ---- 1 Graph Output(s) ----
20
+ {output [dtype=float32, shape=('batch_size', 1000)]}
21
+
22
+ ---- 160 Initializer(s) ----
23
+
24
+ ---- 855 Node(s) ----
25
+
26
+ [I] Folding Constants | Pass 1
27
+ [I] Total Nodes | Original: 855, After Folding: 619 | 236 Nodes Folded
28
+ [I] Folding Constants | Pass 2
29
+ [I] Total Nodes | Original: 619, After Folding: 619 | 0 Nodes Folded
30
+ [I] Saving ONNX model to: pt/edgenext-xxsmall_3rdparty_in1k-pss.onnx
31
+ [I] New Model:
32
+ Name: main_graph | ONNX Opset: 14
33
+
34
+ ---- 1 Graph Input(s) ----
35
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
36
+
37
+ ---- 1 Graph Output(s) ----
38
+ {output [dtype=float32, shape=('batch_size', 1000)]}
39
+
40
+ ---- 379 Initializer(s) ----
41
+
42
+ ---- 619 Node(s) ----
43
+
44
+ [I] PASSED | Runtime: 20.456s | Command: /usr/local/bin/polygraphy surgeon sanitize onnx/edgenext-xxsmall_3rdparty_in1k.onnx --fold-constant -o pt/edgenext-xxsmall_3rdparty_in1k-pss.onnx
logs/efficientnet-b0_3rdparty_8xb32_in1k.log ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [W] 'colored' module is not installed, will not use colors when logging. To enable colors, please install the 'colored' module: python3 -m pip install colored
2
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize original/efficientnet-b0_3rdparty_8xb32_in1k.onnx --fold-constant -o optimized/efficientnet-b0_3rdparty_8xb32_in1k-pss.onnx
3
+ [I] Loading model: /sky/ModelReady/onnx/original/efficientnet-b0_3rdparty_8xb32_in1k.onnx
4
+ [I] Original Model:
5
+ Name: main_graph | ONNX Opset: 14
6
+
7
+ ---- 1 Graph Input(s) ----
8
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
9
+
10
+ ---- 1 Graph Output(s) ----
11
+ {output [dtype=float32, shape=('batch_size', 1000)]}
12
+
13
+ ---- 164 Initializer(s) ----
14
+
15
+ ---- 1232 Node(s) ----
16
+
17
+ [I] Folding Constants | Pass 1
18
+ [I] Total Nodes | Original: 1232, After Folding: 260 | 972 Nodes Folded
19
+ [I] Folding Constants | Pass 2
20
+ [I] Total Nodes | Original: 260, After Folding: 260 | 0 Nodes Folded
21
+ [I] Saving ONNX model to: optimized/efficientnet-b0_3rdparty_8xb32_in1k-pss.onnx
22
+ [I] New Model:
23
+ Name: main_graph | ONNX Opset: 14
24
+
25
+ ---- 1 Graph Input(s) ----
26
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
27
+
28
+ ---- 1 Graph Output(s) ----
29
+ {output [dtype=float32, shape=('batch_size', 1000)]}
30
+
31
+ ---- 184 Initializer(s) ----
32
+
33
+ ---- 260 Node(s) ----
34
+
35
+ [I] PASSED | Runtime: 16.338s | Command: /usr/local/bin/polygraphy surgeon sanitize original/efficientnet-b0_3rdparty_8xb32_in1k.onnx --fold-constant -o optimized/efficientnet-b0_3rdparty_8xb32_in1k-pss.onnx
logs/efficientnetv2-b0_3rdparty_in1k.log ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [W] 'colored' module is not installed, will not use colors when logging. To enable colors, please install the 'colored' module: python3 -m pip install colored
2
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize original/efficientnetv2-b0_3rdparty_in1k.onnx --fold-constant -o optimized/efficientnetv2-b0_3rdparty_in1k-pss.onnx
3
+ [I] Loading model: /sky/ModelReady/onnx/original/efficientnetv2-b0_3rdparty_in1k.onnx
4
+ [I] Original Model:
5
+ Name: main_graph | ONNX Opset: 14
6
+
7
+ ---- 1 Graph Input(s) ----
8
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
9
+
10
+ ---- 1 Graph Output(s) ----
11
+ {output [dtype=float32, shape=('batch_size', 1000)]}
12
+
13
+ ---- 184 Initializer(s) ----
14
+
15
+ ---- 564 Node(s) ----
16
+
17
+ [I] Folding Constants | Pass 1
18
+ [I] Total Nodes | Original: 564, After Folding: 276 | 288 Nodes Folded
19
+ [I] Folding Constants | Pass 2
20
+ [I] Total Nodes | Original: 276, After Folding: 276 | 0 Nodes Folded
21
+ [I] Saving ONNX model to: optimized/efficientnetv2-b0_3rdparty_in1k-pss.onnx
22
+ [I] New Model:
23
+ Name: main_graph | ONNX Opset: 14
24
+
25
+ ---- 1 Graph Input(s) ----
26
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
27
+
28
+ ---- 1 Graph Output(s) ----
29
+ {output [dtype=float32, shape=('batch_size', 1000)]}
30
+
31
+ ---- 192 Initializer(s) ----
32
+
33
+ ---- 276 Node(s) ----
34
+
35
+ [I] PASSED | Runtime: 15.389s | Command: /usr/local/bin/polygraphy surgeon sanitize original/efficientnetv2-b0_3rdparty_in1k.onnx --fold-constant -o optimized/efficientnetv2-b0_3rdparty_in1k-pss.onnx
logs/efficientvit-b3-r224.log ADDED
@@ -0,0 +1,65 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2023-11-29 15:09:14.213139852 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/op_list.9/context_module/main/Unsqueeze_4
2
+ 2023-11-29 15:09:14.213748853 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/op_list.9/context_module/main/Unsqueeze_3
3
+ 2023-11-29 15:09:14.214137403 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/op_list.8/context_module/main/Unsqueeze_4
4
+ 2023-11-29 15:09:14.214778020 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/op_list.8/context_module/main/Unsqueeze_3
5
+ 2023-11-29 15:09:14.215102478 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/op_list.7/context_module/main/Unsqueeze_4
6
+ 2023-11-29 15:09:14.215439647 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/op_list.7/context_module/main/Unsqueeze_3
7
+ 2023-11-29 15:09:14.215853932 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/op_list.6/context_module/main/Unsqueeze_4
8
+ 2023-11-29 15:09:14.216271634 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/op_list.6/context_module/main/Unsqueeze_3
9
+ 2023-11-29 15:09:14.216935173 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/op_list.5/context_module/main/Unsqueeze_4
10
+ 2023-11-29 15:09:14.221295761 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/op_list.5/context_module/main/Unsqueeze_3
11
+ 2023-11-29 15:09:14.223916031 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/op_list.4/context_module/main/Unsqueeze_4
12
+ 2023-11-29 15:09:14.224512269 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/op_list.4/context_module/main/Unsqueeze_3
13
+ 2023-11-29 15:09:14.225216996 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/op_list.3/context_module/main/Unsqueeze_4
14
+ 2023-11-29 15:09:14.228097329 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/op_list.3/context_module/main/Unsqueeze_3
15
+ 2023-11-29 15:09:14.230307323 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/op_list.2/context_module/main/Unsqueeze_4
16
+ 2023-11-29 15:09:14.231574546 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/op_list.2/context_module/main/Unsqueeze_3
17
+ 2023-11-29 15:09:14.232087476 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/op_list.1/context_module/main/Unsqueeze_4
18
+ 2023-11-29 15:09:14.232520576 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/op_list.1/context_module/main/Unsqueeze_3
19
+ 2023-11-29 15:09:14.232874274 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/op_list.6/context_module/main/Unsqueeze_4
20
+ 2023-11-29 15:09:14.233216939 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/op_list.6/context_module/main/Unsqueeze_3
21
+ 2023-11-29 15:09:14.233604196 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/op_list.5/context_module/main/Unsqueeze_4
22
+ 2023-11-29 15:09:14.234077500 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/op_list.5/context_module/main/Unsqueeze_3
23
+ 2023-11-29 15:09:14.234480233 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/op_list.4/context_module/main/Unsqueeze_4
24
+ 2023-11-29 15:09:14.234954137 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/op_list.4/context_module/main/Unsqueeze_3
25
+ 2023-11-29 15:09:14.235466394 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/op_list.3/context_module/main/Unsqueeze_4
26
+ 2023-11-29 15:09:14.235799341 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/op_list.3/context_module/main/Unsqueeze_3
27
+ 2023-11-29 15:09:14.236113854 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/op_list.2/context_module/main/Unsqueeze_4
28
+ 2023-11-29 15:09:14.236480075 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/op_list.2/context_module/main/Unsqueeze_3
29
+ 2023-11-29 15:09:14.236786777 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/op_list.1/context_module/main/Unsqueeze_4
30
+ 2023-11-29 15:09:14.237149937 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/op_list.1/context_module/main/Unsqueeze_3
31
+ [W] 'colored' module is not installed, will not use colors when logging. To enable colors, please install the 'colored' module: python3 -m pip install colored
32
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize original/efficientvit-b3-r224.onnx --fold-constant -o optimized/efficientvit-b3-r224-pss.onnx
33
+ [I] Loading model: /sky/ModelReady/onnx/original/efficientvit-b3-r224.onnx
34
+ [I] Original Model:
35
+ Name: torch_jit | ONNX Opset: 11
36
+
37
+ ---- 1 Graph Input(s) ----
38
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
39
+
40
+ ---- 1 Graph Output(s) ----
41
+ {output [dtype=float32, shape=('batch_size', 1000)]}
42
+
43
+ ---- 250 Initializer(s) ----
44
+
45
+ ---- 1440 Node(s) ----
46
+
47
+ [I] Folding Constants | Pass 1
48
+ [I] Total Nodes | Original: 1440, After Folding: 673 | 767 Nodes Folded
49
+ [I] Folding Constants | Pass 2
50
+ [I] Total Nodes | Original: 673, After Folding: 673 | 0 Nodes Folded
51
+ [I] Saving ONNX model to: optimized/efficientvit-b3-r224-pss.onnx
52
+ [I] New Model:
53
+ Name: torch_jit | ONNX Opset: 11
54
+
55
+ ---- 1 Graph Input(s) ----
56
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
57
+
58
+ ---- 1 Graph Output(s) ----
59
+ {output [dtype=float32, shape=('batch_size', 1000)]}
60
+
61
+ ---- 702 Initializer(s) ----
62
+
63
+ ---- 673 Node(s) ----
64
+
65
+ [I] PASSED | Runtime: 20.052s | Command: /usr/local/bin/polygraphy surgeon sanitize original/efficientvit-b3-r224.onnx --fold-constant -o optimized/efficientvit-b3-r224-pss.onnx
logs/inception-v3_3rdparty_8xb32_in1k.log ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [W] 'colored' module is not installed, will not use colors when logging. To enable colors, please install the 'colored' module: python3 -m pip install colored
2
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize original/inception-v3_3rdparty_8xb32_in1k.onnx --fold-constant -o optimized/inception-v3_3rdparty_8xb32_in1k-pss.onnx
3
+ [I] Loading model: /sky/ModelReady/onnx/original/inception-v3_3rdparty_8xb32_in1k.onnx
4
+ [I] Original Model:
5
+ Name: main_graph | ONNX Opset: 14
6
+
7
+ ---- 1 Graph Input(s) ----
8
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
9
+
10
+ ---- 1 Graph Output(s) ----
11
+ {output [dtype=float32, shape=('batch_size', 1000)]}
12
+
13
+ ---- 190 Initializer(s) ----
14
+
15
+ ---- 215 Node(s) ----
16
+
17
+ [I] Folding Constants | Pass 1
18
+ [I] Total Nodes | Original: 215, After Folding: 215 | 0 Nodes Folded
19
+ [I] Saving ONNX model to: optimized/inception-v3_3rdparty_8xb32_in1k-pss.onnx
20
+ [I] New Model:
21
+ Name: main_graph | ONNX Opset: 14
22
+
23
+ ---- 1 Graph Input(s) ----
24
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
25
+
26
+ ---- 1 Graph Output(s) ----
27
+ {output [dtype=float32, shape=('batch_size', 1000)]}
28
+
29
+ ---- 190 Initializer(s) ----
30
+
31
+ ---- 215 Node(s) ----
32
+
33
+ [I] PASSED | Runtime: 14.918s | Command: /usr/local/bin/polygraphy surgeon sanitize original/inception-v3_3rdparty_8xb32_in1k.onnx --fold-constant -o optimized/inception-v3_3rdparty_8xb32_in1k-pss.onnx
logs/mobilenet-v2_8xb32_in1k.log ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [W] 'colored' module is not installed, will not use colors when logging. To enable colors, please install the 'colored' module: python3 -m pip install colored
2
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize original/mobilenet-v2_8xb32_in1k.onnx --fold-constant -o optimized/mobilenet-v2_8xb32_in1k-pss.onnx
3
+ [I] Loading model: /sky/ModelReady/onnx/original/mobilenet-v2_8xb32_in1k.onnx
4
+ [I] Original Model:
5
+ Name: main_graph | ONNX Opset: 14
6
+
7
+ ---- 1 Graph Input(s) ----
8
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
9
+
10
+ ---- 1 Graph Output(s) ----
11
+ {output [dtype=float32, shape=('batch_size', 1000)]}
12
+
13
+ ---- 106 Initializer(s) ----
14
+
15
+ ---- 177 Node(s) ----
16
+
17
+ [I] Folding Constants | Pass 1
18
+ [I] Total Nodes | Original: 177, After Folding: 104 | 73 Nodes Folded
19
+ [I] Folding Constants | Pass 2
20
+ [I] Total Nodes | Original: 104, After Folding: 104 | 0 Nodes Folded
21
+ [I] Saving ONNX model to: optimized/mobilenet-v2_8xb32_in1k-pss.onnx
22
+ [I] New Model:
23
+ Name: main_graph | ONNX Opset: 14
24
+
25
+ ---- 1 Graph Input(s) ----
26
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
27
+
28
+ ---- 1 Graph Output(s) ----
29
+ {output [dtype=float32, shape=('batch_size', 1000)]}
30
+
31
+ ---- 179 Initializer(s) ----
32
+
33
+ ---- 104 Node(s) ----
34
+
35
+ [I] PASSED | Runtime: 12.937s | Command: /usr/local/bin/polygraphy surgeon sanitize original/mobilenet-v2_8xb32_in1k.onnx --fold-constant -o optimized/mobilenet-v2_8xb32_in1k-pss.onnx
logs/mobilenet-v3-small-050_3rdparty_in1k.log ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [W] 'colored' module is not installed, will not use colors when logging. To enable colors, please install the 'colored' module: python3 -m pip install colored
2
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize original/mobilenet-v3-small-050_3rdparty_in1k.onnx --fold-constant -o optimized/mobilenet-v3-small-050_3rdparty_in1k-pss.onnx
3
+ [I] Loading model: /sky/ModelReady/onnx/original/mobilenet-v3-small-050_3rdparty_in1k.onnx
4
+ [I] Original Model:
5
+ Name: main_graph | ONNX Opset: 14
6
+
7
+ ---- 1 Graph Input(s) ----
8
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
9
+
10
+ ---- 1 Graph Output(s) ----
11
+ {output [dtype=float32, shape=('batch_size', 1000)]}
12
+
13
+ ---- 108 Initializer(s) ----
14
+
15
+ ---- 184 Node(s) ----
16
+
17
+ [I] Folding Constants | Pass 1
18
+ [I] Total Nodes | Original: 184, After Folding: 145 | 39 Nodes Folded
19
+ [I] Folding Constants | Pass 2
20
+ [I] Total Nodes | Original: 145, After Folding: 145 | 0 Nodes Folded
21
+ [I] Saving ONNX model to: optimized/mobilenet-v3-small-050_3rdparty_in1k-pss.onnx
22
+ [I] New Model:
23
+ Name: main_graph | ONNX Opset: 14
24
+
25
+ ---- 1 Graph Input(s) ----
26
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
27
+
28
+ ---- 1 Graph Output(s) ----
29
+ {output [dtype=float32, shape=('batch_size', 1000)]}
30
+
31
+ ---- 147 Initializer(s) ----
32
+
33
+ ---- 145 Node(s) ----
34
+
35
+ [I] PASSED | Runtime: 12.631s | Command: /usr/local/bin/polygraphy surgeon sanitize original/mobilenet-v3-small-050_3rdparty_in1k.onnx --fold-constant -o optimized/mobilenet-v3-small-050_3rdparty_in1k-pss.onnx
logs/mobileone-s0_8xb32_in1k.log ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize onnx/mobileone-s0_8xb32_in1k.onnx --fold-constant -o pt/mobileone-s0_8xb32_in1k-pss.onnx
2
+ [I] Loading model: /sky/Test/flaskProject/models/script/onnx/mobileone-s0_8xb32_in1k.onnx
3
+ [I] Original Model:
4
+ Name: main_graph | ONNX Opset: 14
5
+
6
+ ---- 1 Graph Input(s) ----
7
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
8
+
9
+ ---- 1 Graph Output(s) ----
10
+ {output [dtype=float32, shape=('batch_size', 1000)]}
11
+
12
+ ---- 524 Initializer(s) ----
13
+
14
+ ---- 478 Node(s) ----
15
+
16
+ [I] Folding Constants | Pass 1
17
+ [I] Total Nodes | Original: 478, After Folding: 467 | 11 Nodes Folded
18
+ [I] Folding Constants | Pass 2
19
+ [I] Total Nodes | Original: 467, After Folding: 467 | 0 Nodes Folded
20
+ [I] Saving ONNX model to: pt/mobileone-s0_8xb32_in1k-pss.onnx
21
+ [I] New Model:
22
+ Name: main_graph | ONNX Opset: 14
23
+
24
+ ---- 1 Graph Input(s) ----
25
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
26
+
27
+ ---- 1 Graph Output(s) ----
28
+ {output [dtype=float32, shape=('batch_size', 1000)]}
29
+
30
+ ---- 535 Initializer(s) ----
31
+
32
+ ---- 467 Node(s) ----
33
+
34
+ [I] PASSED | Runtime: 22.090s | Command: /usr/local/bin/polygraphy surgeon sanitize onnx/mobileone-s0_8xb32_in1k.onnx --fold-constant -o pt/mobileone-s0_8xb32_in1k-pss.onnx
logs/mobilevit-small_3rdparty_in1k.log ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2023-11-30 02:59:50.001822498 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.4/layers.4.1/Unsqueeze_9
2
+ 2023-11-30 02:59:50.004051502 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.4/layers.4.1/Unsqueeze_8
3
+ 2023-11-30 02:59:50.018514416 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.4/layers.4.1/Unsqueeze_7
4
+ 2023-11-30 02:59:50.021192793 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.4/layers.4.1/global_rep/global_rep.2/attn/Unsqueeze_3
5
+ 2023-11-30 02:59:50.022078666 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.4/layers.4.1/global_rep/global_rep.2/attn/Unsqueeze_1
6
+ 2023-11-30 02:59:50.022655695 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.4/layers.4.1/global_rep/global_rep.1/attn/Unsqueeze_3
7
+ 2023-11-30 02:59:50.023167014 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.4/layers.4.1/global_rep/global_rep.1/attn/Unsqueeze_1
8
+ 2023-11-30 02:59:50.023630168 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.4/layers.4.1/global_rep/global_rep.0/attn/Unsqueeze_3
9
+ 2023-11-30 02:59:50.024107063 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.4/layers.4.1/global_rep/global_rep.0/attn/Unsqueeze_1
10
+ 2023-11-30 02:59:50.024547881 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.4/layers.4.1/Unsqueeze_2
11
+ 2023-11-30 02:59:50.025069176 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.3/layers.3.1/Unsqueeze_7
12
+ 2023-11-30 02:59:50.025515965 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.3/layers.3.1/global_rep/global_rep.3/attn/Unsqueeze_3
13
+ 2023-11-30 02:59:50.026049687 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.3/layers.3.1/global_rep/global_rep.3/attn/Unsqueeze_1
14
+ 2023-11-30 02:59:50.026649178 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.3/layers.3.1/global_rep/global_rep.2/attn/Unsqueeze_3
15
+ 2023-11-30 02:59:50.027198754 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.3/layers.3.1/global_rep/global_rep.2/attn/Unsqueeze_1
16
+ 2023-11-30 02:59:50.027639518 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.3/layers.3.1/global_rep/global_rep.1/attn/Unsqueeze_3
17
+ 2023-11-30 02:59:50.028165636 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.3/layers.3.1/global_rep/global_rep.1/attn/Unsqueeze_1
18
+ 2023-11-30 02:59:50.028584050 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.3/layers.3.1/global_rep/global_rep.0/attn/Unsqueeze_3
19
+ 2023-11-30 02:59:50.029357220 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.3/layers.3.1/global_rep/global_rep.0/attn/Unsqueeze_1
20
+ 2023-11-30 02:59:50.032444706 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.3/layers.3.1/Unsqueeze_2
21
+ 2023-11-30 02:59:50.033052955 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.1/Unsqueeze_7
22
+ 2023-11-30 02:59:50.033522218 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.1/global_rep/global_rep.1/attn/Unsqueeze_3
23
+ 2023-11-30 02:59:50.034005775 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.1/global_rep/global_rep.1/attn/Unsqueeze_1
24
+ 2023-11-30 02:59:50.034510554 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.1/global_rep/global_rep.0/attn/Unsqueeze_3
25
+ 2023-11-30 02:59:50.034974803 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.1/global_rep/global_rep.0/attn/Unsqueeze_1
26
+ 2023-11-30 02:59:50.035393742 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.1/Unsqueeze_2
27
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize onnx/mobilevit-small_3rdparty_in1k.onnx --fold-constant -o pt/mobilevit-small_3rdparty_in1k-pss.onnx
28
+ [I] Loading model: /sky/Test/flaskProject/models/script/onnx/mobilevit-small_3rdparty_in1k.onnx
29
+ [I] Original Model:
30
+ Name: main_graph | ONNX Opset: 14
31
+
32
+ ---- 1 Graph Input(s) ----
33
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
34
+
35
+ ---- 1 Graph Output(s) ----
36
+ {output [dtype=float32, shape=('batch_size', 1000)]}
37
+
38
+ ---- 183 Initializer(s) ----
39
+
40
+ ---- 1030 Node(s) ----
41
+
42
+ [I] Folding Constants | Pass 1
43
+ [I] Total Nodes | Original: 1030, After Folding: 654 | 376 Nodes Folded
44
+ [I] Folding Constants | Pass 2
45
+ [I] Total Nodes | Original: 654, After Folding: 654 | 0 Nodes Folded
46
+ [I] Saving ONNX model to: pt/mobilevit-small_3rdparty_in1k-pss.onnx
47
+ [I] New Model:
48
+ Name: main_graph | ONNX Opset: 14
49
+
50
+ ---- 1 Graph Input(s) ----
51
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
52
+
53
+ ---- 1 Graph Output(s) ----
54
+ {output [dtype=float32, shape=('batch_size', 1000)]}
55
+
56
+ ---- 419 Initializer(s) ----
57
+
58
+ ---- 654 Node(s) ----
59
+
60
+ [I] PASSED | Runtime: 23.448s | Command: /usr/local/bin/polygraphy surgeon sanitize onnx/mobilevit-small_3rdparty_in1k.onnx --fold-constant -o pt/mobilevit-small_3rdparty_in1k-pss.onnx
logs/mvitv2-tiny_3rdparty_in1k.log ADDED
@@ -0,0 +1,289 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2023-11-30 03:00:08.268231728 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/Unsqueeze_3
2
+ 2023-11-30 03:00:08.269079919 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/Unsqueeze_2
3
+ 2023-11-30 03:00:08.269729301 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/Unsqueeze_1
4
+ 2023-11-30 03:00:08.270337657 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_38
5
+ 2023-11-30 03:00:08.274264916 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_37
6
+ 2023-11-30 03:00:08.275489348 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_36
7
+ 2023-11-30 03:00:08.276569601 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_35
8
+ 2023-11-30 03:00:08.277208432 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_31
9
+ 2023-11-30 03:00:08.277994856 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_30
10
+ 2023-11-30 03:00:08.283679692 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_29
11
+ 2023-11-30 03:00:08.286339238 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_28
12
+ 2023-11-30 03:00:08.287099710 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_22
13
+ 2023-11-30 03:00:08.287684863 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_21
14
+ 2023-11-30 03:00:08.288287968 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_19
15
+ 2023-11-30 03:00:08.288916423 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_18
16
+ 2023-11-30 03:00:08.289570582 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_17
17
+ 2023-11-30 03:00:08.290168748 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_15
18
+ 2023-11-30 03:00:08.290778810 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_14
19
+ 2023-11-30 03:00:08.291347698 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_12
20
+ 2023-11-30 03:00:08.291930252 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_11
21
+ 2023-11-30 03:00:08.292497771 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_10
22
+ 2023-11-30 03:00:08.293113431 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_8
23
+ 2023-11-30 03:00:08.293731706 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_7
24
+ 2023-11-30 03:00:08.296314265 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_5
25
+ 2023-11-30 03:00:08.302276505 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_4
26
+ 2023-11-30 03:00:08.303379075 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_3
27
+ 2023-11-30 03:00:08.303957602 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.9/attn/Unsqueeze_1
28
+ 2023-11-30 03:00:08.305017072 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/Unsqueeze_5
29
+ 2023-11-30 03:00:08.305578304 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/Unsqueeze_3
30
+ 2023-11-30 03:00:08.306121421 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/Unsqueeze_2
31
+ 2023-11-30 03:00:08.306690913 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/Unsqueeze_1
32
+ 2023-11-30 03:00:08.307307844 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_38
33
+ 2023-11-30 03:00:08.307861300 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_37
34
+ 2023-11-30 03:00:08.308399348 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_36
35
+ 2023-11-30 03:00:08.308929817 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_35
36
+ 2023-11-30 03:00:08.309503490 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_31
37
+ 2023-11-30 03:00:08.310019347 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_30
38
+ 2023-11-30 03:00:08.310590057 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_29
39
+ 2023-11-30 03:00:08.311109169 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_28
40
+ 2023-11-30 03:00:08.311738178 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_22
41
+ 2023-11-30 03:00:08.312279107 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_21
42
+ 2023-11-30 03:00:08.312880553 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_19
43
+ 2023-11-30 03:00:08.313447023 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_18
44
+ 2023-11-30 03:00:08.314037991 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_17
45
+ 2023-11-30 03:00:08.316704585 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_15
46
+ 2023-11-30 03:00:08.318767055 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_14
47
+ 2023-11-30 03:00:08.319345354 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_12
48
+ 2023-11-30 03:00:08.319930161 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_11
49
+ 2023-11-30 03:00:08.320667748 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_10
50
+ 2023-11-30 03:00:08.321212032 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_8
51
+ 2023-11-30 03:00:08.321645221 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_7
52
+ 2023-11-30 03:00:08.322097309 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_5
53
+ 2023-11-30 03:00:08.322492834 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_4
54
+ 2023-11-30 03:00:08.322974637 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_3
55
+ 2023-11-30 03:00:08.323404561 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.8/attn/Unsqueeze_1
56
+ 2023-11-30 03:00:08.323875112 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_38
57
+ 2023-11-30 03:00:08.324288635 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_37
58
+ 2023-11-30 03:00:08.324728618 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_36
59
+ 2023-11-30 03:00:08.325116602 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_35
60
+ 2023-11-30 03:00:08.325561087 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_31
61
+ 2023-11-30 03:00:08.325953037 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_30
62
+ 2023-11-30 03:00:08.326513734 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_29
63
+ 2023-11-30 03:00:08.326931608 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_28
64
+ 2023-11-30 03:00:08.327423853 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_22
65
+ 2023-11-30 03:00:08.327819475 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_21
66
+ 2023-11-30 03:00:08.328303803 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_19
67
+ 2023-11-30 03:00:08.337450136 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_18
68
+ 2023-11-30 03:00:08.337904282 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_17
69
+ 2023-11-30 03:00:08.338322179 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_15
70
+ 2023-11-30 03:00:08.338741590 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_14
71
+ 2023-11-30 03:00:08.339187511 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_12
72
+ 2023-11-30 03:00:08.339653373 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_11
73
+ 2023-11-30 03:00:08.340080554 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_10
74
+ 2023-11-30 03:00:08.340557371 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_8
75
+ 2023-11-30 03:00:08.340970643 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_7
76
+ 2023-11-30 03:00:08.341421733 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_5
77
+ 2023-11-30 03:00:08.341842442 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_4
78
+ 2023-11-30 03:00:08.342302303 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_3
79
+ 2023-11-30 03:00:08.342723604 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.7/attn/Unsqueeze_1
80
+ 2023-11-30 03:00:08.343208135 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_38
81
+ 2023-11-30 03:00:08.343621618 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_37
82
+ 2023-11-30 03:00:08.344314434 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_36
83
+ 2023-11-30 03:00:08.344738355 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_35
84
+ 2023-11-30 03:00:08.345211101 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_31
85
+ 2023-11-30 03:00:08.345619987 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_30
86
+ 2023-11-30 03:00:08.346052238 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_29
87
+ 2023-11-30 03:00:08.346437137 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_28
88
+ 2023-11-30 03:00:08.346948678 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_22
89
+ 2023-11-30 03:00:08.347354650 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_21
90
+ 2023-11-30 03:00:08.348209187 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_19
91
+ 2023-11-30 03:00:08.349512863 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_18
92
+ 2023-11-30 03:00:08.351410050 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_17
93
+ 2023-11-30 03:00:08.352195798 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_15
94
+ 2023-11-30 03:00:08.353128877 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_14
95
+ 2023-11-30 03:00:08.355555154 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_12
96
+ 2023-11-30 03:00:08.356505997 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_11
97
+ 2023-11-30 03:00:08.357768571 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_10
98
+ 2023-11-30 03:00:08.358261080 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_8
99
+ 2023-11-30 03:00:08.358740401 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_7
100
+ 2023-11-30 03:00:08.359180359 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_5
101
+ 2023-11-30 03:00:08.359616485 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_4
102
+ 2023-11-30 03:00:08.360349974 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_3
103
+ 2023-11-30 03:00:08.360785745 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.6/attn/Unsqueeze_1
104
+ 2023-11-30 03:00:08.361272954 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_38
105
+ 2023-11-30 03:00:08.361749275 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_37
106
+ 2023-11-30 03:00:08.362188915 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_36
107
+ 2023-11-30 03:00:08.362604769 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_35
108
+ 2023-11-30 03:00:08.363097316 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_31
109
+ 2023-11-30 03:00:08.363536455 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_30
110
+ 2023-11-30 03:00:08.363967507 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_29
111
+ 2023-11-30 03:00:08.364402351 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_28
112
+ 2023-11-30 03:00:08.364887927 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_22
113
+ 2023-11-30 03:00:08.365282990 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_21
114
+ 2023-11-30 03:00:08.365725271 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_19
115
+ 2023-11-30 03:00:08.366127567 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_18
116
+ 2023-11-30 03:00:08.366566972 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_17
117
+ 2023-11-30 03:00:08.366991617 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_15
118
+ 2023-11-30 03:00:08.367405749 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_14
119
+ 2023-11-30 03:00:08.367854393 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_12
120
+ 2023-11-30 03:00:08.368278056 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_11
121
+ 2023-11-30 03:00:08.368822294 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_10
122
+ 2023-11-30 03:00:08.369316080 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_8
123
+ 2023-11-30 03:00:08.369823559 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_7
124
+ 2023-11-30 03:00:08.370300930 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_5
125
+ 2023-11-30 03:00:08.370758700 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_4
126
+ 2023-11-30 03:00:08.371214733 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_3
127
+ 2023-11-30 03:00:08.371703611 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.5/attn/Unsqueeze_1
128
+ 2023-11-30 03:00:08.372235827 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_38
129
+ 2023-11-30 03:00:08.374779687 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_37
130
+ 2023-11-30 03:00:08.375256281 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_36
131
+ 2023-11-30 03:00:08.375708582 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_35
132
+ 2023-11-30 03:00:08.376156399 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_31
133
+ 2023-11-30 03:00:08.376590677 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_30
134
+ 2023-11-30 03:00:08.377021340 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_29
135
+ 2023-11-30 03:00:08.377444237 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_28
136
+ 2023-11-30 03:00:08.377943187 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_22
137
+ 2023-11-30 03:00:08.378365504 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_21
138
+ 2023-11-30 03:00:08.378805836 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_19
139
+ 2023-11-30 03:00:08.379282240 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_18
140
+ 2023-11-30 03:00:08.379750829 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_17
141
+ 2023-11-30 03:00:08.380231976 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_15
142
+ 2023-11-30 03:00:08.380712751 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_14
143
+ 2023-11-30 03:00:08.381166072 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_12
144
+ 2023-11-30 03:00:08.381688836 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_11
145
+ 2023-11-30 03:00:08.382145389 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_10
146
+ 2023-11-30 03:00:08.382594098 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_8
147
+ 2023-11-30 03:00:08.383057010 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_7
148
+ 2023-11-30 03:00:08.383506981 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_5
149
+ 2023-11-30 03:00:08.383972984 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_4
150
+ 2023-11-30 03:00:08.384461108 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_3
151
+ 2023-11-30 03:00:08.384957417 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.4/attn/Unsqueeze_1
152
+ 2023-11-30 03:00:08.385458068 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/Unsqueeze_5
153
+ 2023-11-30 03:00:08.385934412 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/Unsqueeze_3
154
+ 2023-11-30 03:00:08.386440520 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/Unsqueeze_2
155
+ 2023-11-30 03:00:08.386926290 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/Unsqueeze_1
156
+ 2023-11-30 03:00:08.387398068 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_38
157
+ 2023-11-30 03:00:08.387854716 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_37
158
+ 2023-11-30 03:00:08.388285461 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_36
159
+ 2023-11-30 03:00:08.388706984 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_35
160
+ 2023-11-30 03:00:08.389128957 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_31
161
+ 2023-11-30 03:00:08.389590710 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_30
162
+ 2023-11-30 03:00:08.390090706 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_29
163
+ 2023-11-30 03:00:08.390500097 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_28
164
+ 2023-11-30 03:00:08.391028916 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_22
165
+ 2023-11-30 03:00:08.391441877 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_21
166
+ 2023-11-30 03:00:08.391882231 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_19
167
+ 2023-11-30 03:00:08.392277362 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_18
168
+ 2023-11-30 03:00:08.392711506 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_17
169
+ 2023-11-30 03:00:08.393143169 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_15
170
+ 2023-11-30 03:00:08.393623915 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_14
171
+ 2023-11-30 03:00:08.394054555 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_12
172
+ 2023-11-30 03:00:08.394424513 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_11
173
+ 2023-11-30 03:00:08.394785682 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_10
174
+ 2023-11-30 03:00:08.395142074 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_8
175
+ 2023-11-30 03:00:08.395497543 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_7
176
+ 2023-11-30 03:00:08.395858221 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_5
177
+ 2023-11-30 03:00:08.396213672 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_4
178
+ 2023-11-30 03:00:08.396680311 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_3
179
+ 2023-11-30 03:00:08.397135266 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.3/attn/Unsqueeze_1
180
+ 2023-11-30 03:00:08.397547582 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_38
181
+ 2023-11-30 03:00:08.397922564 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_37
182
+ 2023-11-30 03:00:08.398286207 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_36
183
+ 2023-11-30 03:00:08.398654623 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_35
184
+ 2023-11-30 03:00:08.399014640 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_31
185
+ 2023-11-30 03:00:08.399372472 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_30
186
+ 2023-11-30 03:00:08.399769133 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_29
187
+ 2023-11-30 03:00:08.400265075 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_28
188
+ 2023-11-30 03:00:08.400767667 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_22
189
+ 2023-11-30 03:00:08.401149149 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_21
190
+ 2023-11-30 03:00:08.401514525 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_19
191
+ 2023-11-30 03:00:08.401933179 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_18
192
+ 2023-11-30 03:00:08.402387172 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_17
193
+ 2023-11-30 03:00:08.403063338 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_15
194
+ 2023-11-30 03:00:08.403470449 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_14
195
+ 2023-11-30 03:00:08.403877093 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_12
196
+ 2023-11-30 03:00:08.404307193 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_11
197
+ 2023-11-30 03:00:08.404773951 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_10
198
+ 2023-11-30 03:00:08.405234614 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_8
199
+ 2023-11-30 03:00:08.405677559 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_7
200
+ 2023-11-30 03:00:08.406120198 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_5
201
+ 2023-11-30 03:00:08.406619140 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_4
202
+ 2023-11-30 03:00:08.407116780 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_3
203
+ 2023-11-30 03:00:08.407531619 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.2/attn/Unsqueeze_1
204
+ 2023-11-30 03:00:08.407985741 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/Unsqueeze_5
205
+ 2023-11-30 03:00:08.408387571 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/Unsqueeze_3
206
+ 2023-11-30 03:00:08.408815320 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/Unsqueeze_2
207
+ 2023-11-30 03:00:08.409347564 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/Unsqueeze_1
208
+ 2023-11-30 03:00:08.409859597 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_38
209
+ 2023-11-30 03:00:08.410377855 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_37
210
+ 2023-11-30 03:00:08.410836558 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_36
211
+ 2023-11-30 03:00:08.411276541 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_35
212
+ 2023-11-30 03:00:08.411748108 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_31
213
+ 2023-11-30 03:00:08.412263429 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_30
214
+ 2023-11-30 03:00:08.412756651 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_29
215
+ 2023-11-30 03:00:08.413249724 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_28
216
+ 2023-11-30 03:00:08.413784771 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_22
217
+ 2023-11-30 03:00:08.414298347 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_21
218
+ 2023-11-30 03:00:08.414857073 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_19
219
+ 2023-11-30 03:00:08.415398434 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_18
220
+ 2023-11-30 03:00:08.415990191 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_17
221
+ 2023-11-30 03:00:08.416595447 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_15
222
+ 2023-11-30 03:00:08.417110683 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_14
223
+ 2023-11-30 03:00:08.417640964 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_12
224
+ 2023-11-30 03:00:08.418180755 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_11
225
+ 2023-11-30 03:00:08.418661492 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_10
226
+ 2023-11-30 03:00:08.419197802 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_8
227
+ 2023-11-30 03:00:08.419698718 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_7
228
+ 2023-11-30 03:00:08.420208402 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_5
229
+ 2023-11-30 03:00:08.420670346 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_4
230
+ 2023-11-30 03:00:08.421180513 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_3
231
+ 2023-11-30 03:00:08.421682699 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.1/attn/Unsqueeze_1
232
+ 2023-11-30 03:00:08.422239181 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_38
233
+ 2023-11-30 03:00:08.422739313 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_37
234
+ 2023-11-30 03:00:08.423272228 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_36
235
+ 2023-11-30 03:00:08.423672409 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_35
236
+ 2023-11-30 03:00:08.424046379 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_31
237
+ 2023-11-30 03:00:08.424421869 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_30
238
+ 2023-11-30 03:00:08.424881501 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_29
239
+ 2023-11-30 03:00:08.425263863 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_28
240
+ 2023-11-30 03:00:08.425771223 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_22
241
+ 2023-11-30 03:00:08.426129483 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_21
242
+ 2023-11-30 03:00:08.426792800 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_19
243
+ 2023-11-30 03:00:08.427357195 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_18
244
+ 2023-11-30 03:00:08.427888342 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_17
245
+ 2023-11-30 03:00:08.428487870 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_15
246
+ 2023-11-30 03:00:08.429052914 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_14
247
+ 2023-11-30 03:00:08.429605607 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_12
248
+ 2023-11-30 03:00:08.430220853 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_11
249
+ 2023-11-30 03:00:08.430776541 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_10
250
+ 2023-11-30 03:00:08.431378879 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_8
251
+ 2023-11-30 03:00:08.432022897 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_7
252
+ 2023-11-30 03:00:08.432669865 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_5
253
+ 2023-11-30 03:00:08.433240795 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_4
254
+ 2023-11-30 03:00:08.433757119 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_3
255
+ 2023-11-30 03:00:08.434221168 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/blocks.0/attn/Unsqueeze_1
256
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize onnx/mvitv2-tiny_3rdparty_in1k.onnx --fold-constant -o pt/mvitv2-tiny_3rdparty_in1k-pss.onnx
257
+ [I] Loading model: /sky/Test/flaskProject/models/script/onnx/mvitv2-tiny_3rdparty_in1k.onnx
258
+ [I] Original Model:
259
+ Name: main_graph | ONNX Opset: 14
260
+
261
+ ---- 1 Graph Input(s) ----
262
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
263
+
264
+ ---- 1 Graph Output(s) ----
265
+ {output [dtype=float32, shape=('batch_size', 1000)]}
266
+
267
+ ---- 242 Initializer(s) ----
268
+
269
+ ---- 4317 Node(s) ----
270
+
271
+ [I] Folding Constants | Pass 1
272
+ [I] Total Nodes | Original: 4329, After Folding: 1710 | 2619 Nodes Folded
273
+ [I] Folding Constants | Pass 2
274
+ [I] Total Nodes | Original: 1710, After Folding: 1710 | 0 Nodes Folded
275
+ [I] Saving ONNX model to: pt/mvitv2-tiny_3rdparty_in1k-pss.onnx
276
+ [I] New Model:
277
+ Name: main_graph | ONNX Opset: 14
278
+
279
+ ---- 1 Graph Input(s) ----
280
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
281
+
282
+ ---- 1 Graph Output(s) ----
283
+ {output [dtype=float32, shape=('batch_size', 1000)]}
284
+
285
+ ---- 1236 Initializer(s) ----
286
+
287
+ ---- 1710 Node(s) ----
288
+
289
+ [I] PASSED | Runtime: 51.755s | Command: /usr/local/bin/polygraphy surgeon sanitize onnx/mvitv2-tiny_3rdparty_in1k.onnx --fold-constant -o pt/mvitv2-tiny_3rdparty_in1k-pss.onnx
logs/regnetx-400mf_8xb128_in1k.log ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [W] 'colored' module is not installed, will not use colors when logging. To enable colors, please install the 'colored' module: python3 -m pip install colored
2
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize original/regnetx-400mf_8xb128_in1k.onnx --fold-constant -o optimized/regnetx-400mf_8xb128_in1k-pss.onnx
3
+ [I] Loading model: /sky/ModelReady/onnx/original/regnetx-400mf_8xb128_in1k.onnx
4
+ [I] Original Model:
5
+ Name: main_graph | ONNX Opset: 14
6
+
7
+ ---- 1 Graph Input(s) ----
8
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
9
+
10
+ ---- 1 Graph Output(s) ----
11
+ {output [dtype=float32, shape=('batch_size', 1000)]}
12
+
13
+ ---- 144 Initializer(s) ----
14
+
15
+ ---- 170 Node(s) ----
16
+
17
+ [I] Folding Constants | Pass 1
18
+ [I] Total Nodes | Original: 170, After Folding: 167 | 3 Nodes Folded
19
+ [I] Folding Constants | Pass 2
20
+ [I] Total Nodes | Original: 167, After Folding: 167 | 0 Nodes Folded
21
+ [I] Saving ONNX model to: optimized/regnetx-400mf_8xb128_in1k-pss.onnx
22
+ [I] New Model:
23
+ Name: main_graph | ONNX Opset: 14
24
+
25
+ ---- 1 Graph Input(s) ----
26
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
27
+
28
+ ---- 1 Graph Output(s) ----
29
+ {output [dtype=float32, shape=('batch_size', 1000)]}
30
+
31
+ ---- 147 Initializer(s) ----
32
+
33
+ ---- 167 Node(s) ----
34
+
35
+ [I] PASSED | Runtime: 13.747s | Command: /usr/local/bin/polygraphy surgeon sanitize original/regnetx-400mf_8xb128_in1k.onnx --fold-constant -o optimized/regnetx-400mf_8xb128_in1k-pss.onnx
logs/res2net50-w14-s8_3rdparty_8xb32_in1k.log ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [W] 'colored' module is not installed, will not use colors when logging. To enable colors, please install the 'colored' module: python3 -m pip install colored
2
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize original/res2net50-w14-s8_3rdparty_8xb32_in1k.onnx --fold-constant -o optimized/res2net50-w14-s8_3rdparty_8xb32_in1k-pss.onnx
3
+ [I] Loading model: /sky/ModelReady/onnx/original/res2net50-w14-s8_3rdparty_8xb32_in1k.onnx
4
+ [I] Original Model:
5
+ Name: main_graph | ONNX Opset: 14
6
+
7
+ ---- 1 Graph Input(s) ----
8
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
9
+
10
+ ---- 1 Graph Output(s) ----
11
+ {output [dtype=float32, shape=('batch_size', 1000)]}
12
+
13
+ ---- 300 Initializer(s) ----
14
+
15
+ ---- 445 Node(s) ----
16
+
17
+ [I] Folding Constants | Pass 1
18
+ [I] Total Nodes | Original: 445, After Folding: 426 | 19 Nodes Folded
19
+ [I] Folding Constants | Pass 2
20
+ [I] Total Nodes | Original: 426, After Folding: 426 | 0 Nodes Folded
21
+ [I] Saving ONNX model to: optimized/res2net50-w14-s8_3rdparty_8xb32_in1k-pss.onnx
22
+ [I] New Model:
23
+ Name: main_graph | ONNX Opset: 14
24
+
25
+ ---- 1 Graph Input(s) ----
26
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
27
+
28
+ ---- 1 Graph Output(s) ----
29
+ {output [dtype=float32, shape=('batch_size', 1000)]}
30
+
31
+ ---- 319 Initializer(s) ----
32
+
33
+ ---- 426 Node(s) ----
34
+
35
+ [I] PASSED | Runtime: 16.361s | Command: /usr/local/bin/polygraphy surgeon sanitize original/res2net50-w14-s8_3rdparty_8xb32_in1k.onnx --fold-constant -o optimized/res2net50-w14-s8_3rdparty_8xb32_in1k-pss.onnx
logs/resnet50_8xb256-rsb-a1-600e_in1k.log ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [W] 'colored' module is not installed, will not use colors when logging. To enable colors, please install the 'colored' module: python3 -m pip install colored
2
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize original/resnet50_8xb256-rsb-a1-600e_in1k.onnx --fold-constant -o optimized/resnet50_8xb256-rsb-a1-600e_in1k-pss.onnx
3
+ [I] Loading model: /sky/ModelReady/onnx/original/resnet50_8xb256-rsb-a1-600e_in1k.onnx
4
+ [I] Original Model:
5
+ Name: main_graph | ONNX Opset: 14
6
+
7
+ ---- 1 Graph Input(s) ----
8
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
9
+
10
+ ---- 1 Graph Output(s) ----
11
+ {output [dtype=float32, shape=('batch_size', 1000)]}
12
+
13
+ ---- 108 Initializer(s) ----
14
+
15
+ ---- 129 Node(s) ----
16
+
17
+ [I] Folding Constants | Pass 1
18
+ [I] Total Nodes | Original: 129, After Folding: 126 | 3 Nodes Folded
19
+ [I] Folding Constants | Pass 2
20
+ [I] Total Nodes | Original: 126, After Folding: 126 | 0 Nodes Folded
21
+ [I] Saving ONNX model to: optimized/resnet50_8xb256-rsb-a1-600e_in1k-pss.onnx
22
+ [I] New Model:
23
+ Name: main_graph | ONNX Opset: 14
24
+
25
+ ---- 1 Graph Input(s) ----
26
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
27
+
28
+ ---- 1 Graph Output(s) ----
29
+ {output [dtype=float32, shape=('batch_size', 1000)]}
30
+
31
+ ---- 111 Initializer(s) ----
32
+
33
+ ---- 126 Node(s) ----
34
+
35
+ [I] PASSED | Runtime: 12.446s | Command: /usr/local/bin/polygraphy surgeon sanitize original/resnet50_8xb256-rsb-a1-600e_in1k.onnx --fold-constant -o optimized/resnet50_8xb256-rsb-a1-600e_in1k-pss.onnx
logs/resnext50-32x4d_8xb32_in1k.log ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [W] 'colored' module is not installed, will not use colors when logging. To enable colors, please install the 'colored' module: python3 -m pip install colored
2
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize original/resnext50-32x4d_8xb32_in1k.onnx --fold-constant -o optimized/resnext50-32x4d_8xb32_in1k-pss.onnx
3
+ [I] Loading model: /sky/ModelReady/onnx/original/resnext50-32x4d_8xb32_in1k.onnx
4
+ [I] Original Model:
5
+ Name: main_graph | ONNX Opset: 14
6
+
7
+ ---- 1 Graph Input(s) ----
8
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
9
+
10
+ ---- 1 Graph Output(s) ----
11
+ {output [dtype=float32, shape=('batch_size', 1000)]}
12
+
13
+ ---- 108 Initializer(s) ----
14
+
15
+ ---- 129 Node(s) ----
16
+
17
+ [I] Folding Constants | Pass 1
18
+ [I] Total Nodes | Original: 129, After Folding: 126 | 3 Nodes Folded
19
+ [I] Folding Constants | Pass 2
20
+ [I] Total Nodes | Original: 126, After Folding: 126 | 0 Nodes Folded
21
+ [I] Saving ONNX model to: optimized/resnext50-32x4d_8xb32_in1k-pss.onnx
22
+ [I] New Model:
23
+ Name: main_graph | ONNX Opset: 14
24
+
25
+ ---- 1 Graph Input(s) ----
26
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
27
+
28
+ ---- 1 Graph Output(s) ----
29
+ {output [dtype=float32, shape=('batch_size', 1000)]}
30
+
31
+ ---- 111 Initializer(s) ----
32
+
33
+ ---- 126 Node(s) ----
34
+
35
+ [I] PASSED | Runtime: 14.677s | Command: /usr/local/bin/polygraphy surgeon sanitize original/resnext50-32x4d_8xb32_in1k.onnx --fold-constant -o optimized/resnext50-32x4d_8xb32_in1k-pss.onnx
logs/seresnet50_8xb32_in1k.log ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [W] 'colored' module is not installed, will not use colors when logging. To enable colors, please install the 'colored' module: python3 -m pip install colored
2
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize original/seresnet50_8xb32_in1k.onnx --fold-constant -o optimized/seresnet50_8xb32_in1k-pss.onnx
3
+ [I] Loading model: /sky/ModelReady/onnx/original/seresnet50_8xb32_in1k.onnx
4
+ [I] Original Model:
5
+ Name: main_graph | ONNX Opset: 14
6
+
7
+ ---- 1 Graph Input(s) ----
8
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
9
+
10
+ ---- 1 Graph Output(s) ----
11
+ {output [dtype=float32, shape=('batch_size', 1000)]}
12
+
13
+ ---- 172 Initializer(s) ----
14
+
15
+ ---- 225 Node(s) ----
16
+
17
+ [I] Folding Constants | Pass 1
18
+ [I] Total Nodes | Original: 225, After Folding: 222 | 3 Nodes Folded
19
+ [I] Folding Constants | Pass 2
20
+ [I] Total Nodes | Original: 222, After Folding: 222 | 0 Nodes Folded
21
+ [I] Saving ONNX model to: optimized/seresnet50_8xb32_in1k-pss.onnx
22
+ [I] New Model:
23
+ Name: main_graph | ONNX Opset: 14
24
+
25
+ ---- 1 Graph Input(s) ----
26
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
27
+
28
+ ---- 1 Graph Output(s) ----
29
+ {output [dtype=float32, shape=('batch_size', 1000)]}
30
+
31
+ ---- 175 Initializer(s) ----
32
+
33
+ ---- 222 Node(s) ----
34
+
35
+ [I] PASSED | Runtime: 13.892s | Command: /usr/local/bin/polygraphy surgeon sanitize original/seresnet50_8xb32_in1k.onnx --fold-constant -o optimized/seresnet50_8xb32_in1k-pss.onnx
logs/shufflenet-v1-1x_16xb64_in1k.log ADDED
@@ -0,0 +1,99 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2023-11-29 15:09:12.251239342 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.3/Unsqueeze_6
2
+ 2023-11-29 15:09:12.252498841 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.3/Unsqueeze_5
3
+ 2023-11-29 15:09:12.252854991 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.3/Unsqueeze_3
4
+ 2023-11-29 15:09:12.259034621 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.3/Unsqueeze_2
5
+ 2023-11-29 15:09:12.259921604 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.2/Unsqueeze_6
6
+ 2023-11-29 15:09:12.260879181 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.2/Unsqueeze_5
7
+ 2023-11-29 15:09:12.261430072 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.2/Unsqueeze_3
8
+ 2023-11-29 15:09:12.263286234 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.2/Unsqueeze_2
9
+ 2023-11-29 15:09:12.264054871 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.1/Unsqueeze_6
10
+ 2023-11-29 15:09:12.265260849 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.1/Unsqueeze_5
11
+ 2023-11-29 15:09:12.266224101 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.1/Unsqueeze_3
12
+ 2023-11-29 15:09:12.266621611 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.1/Unsqueeze_2
13
+ 2023-11-29 15:09:12.267197825 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.0/Unsqueeze_6
14
+ 2023-11-29 15:09:12.267647995 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.0/Unsqueeze_5
15
+ 2023-11-29 15:09:12.268020437 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.0/Unsqueeze_3
16
+ 2023-11-29 15:09:12.268401152 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.0/Unsqueeze_2
17
+ 2023-11-29 15:09:12.268799729 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.7/Unsqueeze_6
18
+ 2023-11-29 15:09:12.269213159 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.7/Unsqueeze_5
19
+ 2023-11-29 15:09:12.269647834 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.7/Unsqueeze_3
20
+ 2023-11-29 15:09:12.270045804 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.7/Unsqueeze_2
21
+ 2023-11-29 15:09:12.270533182 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.6/Unsqueeze_6
22
+ 2023-11-29 15:09:12.271049481 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.6/Unsqueeze_5
23
+ 2023-11-29 15:09:12.271398170 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.6/Unsqueeze_3
24
+ 2023-11-29 15:09:12.271694584 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.6/Unsqueeze_2
25
+ 2023-11-29 15:09:12.272167968 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.5/Unsqueeze_6
26
+ 2023-11-29 15:09:12.272496561 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.5/Unsqueeze_5
27
+ 2023-11-29 15:09:12.272795508 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.5/Unsqueeze_3
28
+ 2023-11-29 15:09:12.273280034 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.5/Unsqueeze_2
29
+ 2023-11-29 15:09:12.273795905 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.4/Unsqueeze_6
30
+ 2023-11-29 15:09:12.274158734 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.4/Unsqueeze_5
31
+ 2023-11-29 15:09:12.274611279 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.4/Unsqueeze_3
32
+ 2023-11-29 15:09:12.275173021 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.4/Unsqueeze_2
33
+ 2023-11-29 15:09:12.275808990 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.3/Unsqueeze_6
34
+ 2023-11-29 15:09:12.276194572 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.3/Unsqueeze_5
35
+ 2023-11-29 15:09:12.276578342 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.3/Unsqueeze_3
36
+ 2023-11-29 15:09:12.277285394 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.3/Unsqueeze_2
37
+ 2023-11-29 15:09:12.277730626 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.2/Unsqueeze_6
38
+ 2023-11-29 15:09:12.278310495 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.2/Unsqueeze_5
39
+ 2023-11-29 15:09:12.279046675 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.2/Unsqueeze_3
40
+ 2023-11-29 15:09:12.279593400 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.2/Unsqueeze_2
41
+ 2023-11-29 15:09:12.279976293 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.1/Unsqueeze_6
42
+ 2023-11-29 15:09:12.280457316 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.1/Unsqueeze_5
43
+ 2023-11-29 15:09:12.280805387 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.1/Unsqueeze_3
44
+ 2023-11-29 15:09:12.281255486 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.1/Unsqueeze_2
45
+ 2023-11-29 15:09:12.281649981 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.0/Unsqueeze_6
46
+ 2023-11-29 15:09:12.282036613 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.0/Unsqueeze_5
47
+ 2023-11-29 15:09:12.282391662 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.0/Unsqueeze_3
48
+ 2023-11-29 15:09:12.282780488 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.0/Unsqueeze_2
49
+ 2023-11-29 15:09:12.283188561 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.3/Unsqueeze_6
50
+ 2023-11-29 15:09:12.283664187 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.3/Unsqueeze_5
51
+ 2023-11-29 15:09:12.284105238 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.3/Unsqueeze_3
52
+ 2023-11-29 15:09:12.284529172 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.3/Unsqueeze_2
53
+ 2023-11-29 15:09:12.284847937 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.2/Unsqueeze_6
54
+ 2023-11-29 15:09:12.285139479 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.2/Unsqueeze_5
55
+ 2023-11-29 15:09:12.285515018 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.2/Unsqueeze_3
56
+ 2023-11-29 15:09:12.285830447 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.2/Unsqueeze_2
57
+ 2023-11-29 15:09:12.286151945 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.1/Unsqueeze_6
58
+ 2023-11-29 15:09:12.286539059 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.1/Unsqueeze_5
59
+ 2023-11-29 15:09:12.287065056 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.1/Unsqueeze_3
60
+ 2023-11-29 15:09:12.287676745 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.1/Unsqueeze_2
61
+ 2023-11-29 15:09:12.288296700 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.0/Unsqueeze_6
62
+ 2023-11-29 15:09:12.288745292 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.0/Unsqueeze_5
63
+ 2023-11-29 15:09:12.290332100 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.0/Unsqueeze_3
64
+ 2023-11-29 15:09:12.293627045 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.0/Unsqueeze_2
65
+ [W] 'colored' module is not installed, will not use colors when logging. To enable colors, please install the 'colored' module: python3 -m pip install colored
66
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize original/shufflenet-v1-1x_16xb64_in1k.onnx --fold-constant -o optimized/shufflenet-v1-1x_16xb64_in1k-pss.onnx
67
+ [I] Loading model: /sky/ModelReady/onnx/original/shufflenet-v1-1x_16xb64_in1k.onnx
68
+ [I] Original Model:
69
+ Name: main_graph | ONNX Opset: 14
70
+
71
+ ---- 1 Graph Input(s) ----
72
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
73
+
74
+ ---- 1 Graph Output(s) ----
75
+ {output [dtype=float32, shape=('batch_size', 1000)]}
76
+
77
+ ---- 100 Initializer(s) ----
78
+
79
+ ---- 704 Node(s) ----
80
+
81
+ [I] Folding Constants | Pass 1
82
+ [I] Total Nodes | Original: 704, After Folding: 253 | 451 Nodes Folded
83
+ [I] Folding Constants | Pass 2
84
+ [I] Total Nodes | Original: 253, After Folding: 253 | 0 Nodes Folded
85
+ [I] Saving ONNX model to: optimized/shufflenet-v1-1x_16xb64_in1k-pss.onnx
86
+ [I] New Model:
87
+ Name: main_graph | ONNX Opset: 14
88
+
89
+ ---- 1 Graph Input(s) ----
90
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
91
+
92
+ ---- 1 Graph Output(s) ----
93
+ {output [dtype=float32, shape=('batch_size', 1000)]}
94
+
95
+ ---- 263 Initializer(s) ----
96
+
97
+ ---- 253 Node(s) ----
98
+
99
+ [I] PASSED | Runtime: 14.692s | Command: /usr/local/bin/polygraphy surgeon sanitize original/shufflenet-v1-1x_16xb64_in1k.onnx --fold-constant -o optimized/shufflenet-v1-1x_16xb64_in1k-pss.onnx
logs/shufflenet-v2-1x_16xb64_in1k.log ADDED
@@ -0,0 +1,113 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2023-11-29 15:09:12.698078677 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.3/Unsqueeze_8
2
+ 2023-11-29 15:09:12.700634856 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.3/Unsqueeze_7
3
+ 2023-11-29 15:09:12.700992591 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.3/Unsqueeze_5
4
+ 2023-11-29 15:09:12.701616728 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.3/Unsqueeze_4
5
+ 2023-11-29 15:09:12.702065830 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.2/Unsqueeze_8
6
+ 2023-11-29 15:09:12.703236985 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.2/Unsqueeze_7
7
+ 2023-11-29 15:09:12.703484899 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.2/Unsqueeze_5
8
+ 2023-11-29 15:09:12.704164772 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.2/Unsqueeze_4
9
+ 2023-11-29 15:09:12.704470211 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.1/Unsqueeze_8
10
+ 2023-11-29 15:09:12.704727495 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.1/Unsqueeze_7
11
+ 2023-11-29 15:09:12.706097488 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.1/Unsqueeze_5
12
+ 2023-11-29 15:09:12.707254966 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.1/Unsqueeze_4
13
+ 2023-11-29 15:09:12.707695123 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.0/Unsqueeze_6
14
+ 2023-11-29 15:09:12.708008516 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.0/Unsqueeze_5
15
+ 2023-11-29 15:09:12.708295851 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.0/Unsqueeze_3
16
+ 2023-11-29 15:09:12.708602272 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/layers.2.0/Unsqueeze_2
17
+ 2023-11-29 15:09:12.708888861 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.7/Unsqueeze_8
18
+ 2023-11-29 15:09:12.709347282 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.7/Unsqueeze_7
19
+ 2023-11-29 15:09:12.713208495 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.7/Unsqueeze_5
20
+ 2023-11-29 15:09:12.713571113 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.7/Unsqueeze_4
21
+ 2023-11-29 15:09:12.713887332 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.6/Unsqueeze_8
22
+ 2023-11-29 15:09:12.714158070 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.6/Unsqueeze_7
23
+ 2023-11-29 15:09:12.714455051 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.6/Unsqueeze_5
24
+ 2023-11-29 15:09:12.717906254 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.6/Unsqueeze_4
25
+ 2023-11-29 15:09:12.718319862 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.5/Unsqueeze_8
26
+ 2023-11-29 15:09:12.718968465 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.5/Unsqueeze_7
27
+ 2023-11-29 15:09:12.719532808 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.5/Unsqueeze_5
28
+ 2023-11-29 15:09:12.720302423 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.5/Unsqueeze_4
29
+ 2023-11-29 15:09:12.720658531 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.4/Unsqueeze_8
30
+ 2023-11-29 15:09:12.720989817 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.4/Unsqueeze_7
31
+ 2023-11-29 15:09:12.721288806 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.4/Unsqueeze_5
32
+ 2023-11-29 15:09:12.721774894 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.4/Unsqueeze_4
33
+ 2023-11-29 15:09:12.722141922 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.3/Unsqueeze_8
34
+ 2023-11-29 15:09:12.724389001 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.3/Unsqueeze_7
35
+ 2023-11-29 15:09:12.724850958 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.3/Unsqueeze_5
36
+ 2023-11-29 15:09:12.725146606 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.3/Unsqueeze_4
37
+ 2023-11-29 15:09:12.725414591 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.2/Unsqueeze_8
38
+ 2023-11-29 15:09:12.725704427 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.2/Unsqueeze_7
39
+ 2023-11-29 15:09:12.726036323 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.2/Unsqueeze_5
40
+ 2023-11-29 15:09:12.726304259 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.2/Unsqueeze_4
41
+ 2023-11-29 15:09:12.726642322 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.1/Unsqueeze_8
42
+ 2023-11-29 15:09:12.726888685 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.1/Unsqueeze_7
43
+ 2023-11-29 15:09:12.727164229 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.1/Unsqueeze_5
44
+ 2023-11-29 15:09:12.727709194 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.1/Unsqueeze_4
45
+ 2023-11-29 15:09:12.727965009 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.0/Unsqueeze_6
46
+ 2023-11-29 15:09:12.728243980 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.0/Unsqueeze_5
47
+ 2023-11-29 15:09:12.728637083 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.0/Unsqueeze_3
48
+ 2023-11-29 15:09:12.728910392 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/layers.1.0/Unsqueeze_2
49
+ 2023-11-29 15:09:12.729168118 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.3/Unsqueeze_8
50
+ 2023-11-29 15:09:12.729430331 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.3/Unsqueeze_7
51
+ 2023-11-29 15:09:12.729743050 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.3/Unsqueeze_5
52
+ 2023-11-29 15:09:12.730010886 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.3/Unsqueeze_4
53
+ 2023-11-29 15:09:12.730261883 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.2/Unsqueeze_8
54
+ 2023-11-29 15:09:12.730519669 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.2/Unsqueeze_7
55
+ 2023-11-29 15:09:12.730760017 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.2/Unsqueeze_5
56
+ 2023-11-29 15:09:12.731251872 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.2/Unsqueeze_4
57
+ 2023-11-29 15:09:12.731543594 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.1/Unsqueeze_8
58
+ 2023-11-29 15:09:12.731784965 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.1/Unsqueeze_7
59
+ 2023-11-29 15:09:12.732062618 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.1/Unsqueeze_5
60
+ 2023-11-29 15:09:12.737590664 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.1/Unsqueeze_4
61
+ 2023-11-29 15:09:12.738222892 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.0/Unsqueeze_6
62
+ 2023-11-29 15:09:12.738604044 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.0/Unsqueeze_5
63
+ 2023-11-29 15:09:12.739127357 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.0/Unsqueeze_3
64
+ 2023-11-29 15:09:12.741114503 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/layers.0.0/Unsqueeze_2
65
+ [W] 'colored' module is not installed, will not use colors when logging. To enable colors, please install the 'colored' module: python3 -m pip install colored
66
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize original/shufflenet-v2-1x_16xb64_in1k.onnx --fold-constant -o optimized/shufflenet-v2-1x_16xb64_in1k-pss.onnx
67
+ [I] Loading model: /sky/ModelReady/onnx/original/shufflenet-v2-1x_16xb64_in1k.onnx
68
+ [I] Original Model:
69
+ Name: main_graph | ONNX Opset: 14
70
+
71
+ ---- 1 Graph Input(s) ----
72
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
73
+
74
+ ---- 1 Graph Output(s) ----
75
+ {output [dtype=float32, shape=('batch_size', 1000)]}
76
+
77
+ ---- 114 Initializer(s) ----
78
+
79
+ ---- 998 Node(s) ----
80
+
81
+ [I] Folding Constants | Pass 1
82
+ [I] Total Nodes | Original: 998, After Folding: 455 | 543 Nodes Folded
83
+ [I] Folding Constants | Pass 2
84
+ [I] Total Nodes | Original: 455, After Folding: 410 | 45 Nodes Folded
85
+ [I] Folding Constants | Pass 3
86
+ [I] Total Nodes | Original: 410, After Folding: 365 | 45 Nodes Folded
87
+ [I] Folding Constants | Pass 4
88
+ [I] Total Nodes | Original: 365, After Folding: 338 | 27 Nodes Folded
89
+ [I] Folding Constants | Pass 5
90
+ [I] Total Nodes | Original: 338, After Folding: 323 | 15 Nodes Folded
91
+ [I] Folding Constants | Pass 6
92
+ [I] Total Nodes | Original: 323, After Folding: 308 | 15 Nodes Folded
93
+ [I] Folding Constants | Pass 7
94
+ [I] Total Nodes | Original: 308, After Folding: 293 | 15 Nodes Folded
95
+ [I] Folding Constants | Pass 8
96
+ [I] Total Nodes | Original: 293, After Folding: 287 | 6 Nodes Folded
97
+ [I] Folding Constants | Pass 9
98
+ [I] Total Nodes | Original: 287, After Folding: 287 | 0 Nodes Folded
99
+ [I] Saving ONNX model to: optimized/shufflenet-v2-1x_16xb64_in1k-pss.onnx
100
+ [I] New Model:
101
+ Name: main_graph | ONNX Opset: 14
102
+
103
+ ---- 1 Graph Input(s) ----
104
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
105
+
106
+ ---- 1 Graph Output(s) ----
107
+ {output [dtype=float32, shape=('batch_size', 1000)]}
108
+
109
+ ---- 381 Initializer(s) ----
110
+
111
+ ---- 287 Node(s) ----
112
+
113
+ [I] PASSED | Runtime: 20.308s | Command: /usr/local/bin/polygraphy surgeon sanitize original/shufflenet-v2-1x_16xb64_in1k.onnx --fold-constant -o optimized/shufflenet-v2-1x_16xb64_in1k-pss.onnx
logs/swin-tiny_16xb64_in1k.log ADDED
@@ -0,0 +1,228 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2023-11-29 15:09:37.435239248 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.1/attn/Unsqueeze_17
2
+ 2023-11-29 15:09:37.435579095 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.1/attn/Unsqueeze_10
3
+ 2023-11-29 15:09:37.435777270 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.1/attn/w_msa/Unsqueeze_5
4
+ 2023-11-29 15:09:37.436763071 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.1/attn/w_msa/Unsqueeze_4
5
+ 2023-11-29 15:09:37.436890139 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.1/attn/w_msa/Unsqueeze_1
6
+ 2023-11-29 15:09:37.437034911 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.1/attn/Unsqueeze_9
7
+ 2023-11-29 15:09:37.437159834 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.1/attn/Unsqueeze_3
8
+ 2023-11-29 15:09:37.437308709 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.0/attn/Unsqueeze_25
9
+ 2023-11-29 15:09:37.437481904 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.0/attn/Unsqueeze_18
10
+ 2023-11-29 15:09:37.438179601 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.0/attn/w_msa/Unsqueeze_5
11
+ 2023-11-29 15:09:37.439905549 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.0/attn/w_msa/Unsqueeze_4
12
+ 2023-11-29 15:09:37.440998125 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.0/attn/w_msa/Unsqueeze_1
13
+ 2023-11-29 15:09:37.441274667 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.0/attn/Unsqueeze_17
14
+ 2023-11-29 15:09:37.443748434 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.0/attn/Unsqueeze_3
15
+ 2023-11-29 15:09:37.444295950 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/downsample_2/Unsqueeze_3
16
+ 2023-11-29 15:09:37.445446339 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.5/attn/Unsqueeze_62
17
+ 2023-11-29 15:09:37.445682493 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.5/attn/Unsqueeze_55
18
+ 2023-11-29 15:09:37.445834768 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.5/attn/w_msa/Unsqueeze_13
19
+ 2023-11-29 15:09:37.446126761 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.5/attn/w_msa/Unsqueeze_12
20
+ 2023-11-29 15:09:37.446292364 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.5/attn/w_msa/Unsqueeze_10
21
+ 2023-11-29 15:09:37.446413233 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.5/attn/w_msa/Unsqueeze_9
22
+ 2023-11-29 15:09:37.446547310 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.5/attn/w_msa/Unsqueeze_6
23
+ 2023-11-29 15:09:37.446667026 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.5/attn/w_msa/Unsqueeze_5
24
+ 2023-11-29 15:09:37.446818184 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.5/attn/w_msa/Unsqueeze_1
25
+ 2023-11-29 15:09:37.446938181 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.5/attn/Unsqueeze_54
26
+ 2023-11-29 15:09:37.447108565 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.5/attn/Unsqueeze_46
27
+ 2023-11-29 15:09:37.447218595 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.5/attn/Unsqueeze_45
28
+ 2023-11-29 15:09:37.447348228 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.5/attn/Unsqueeze_42
29
+ 2023-11-29 15:09:37.447548944 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.5/attn/Unsqueeze_3
30
+ 2023-11-29 15:09:37.447676911 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.4/attn/Unsqueeze_17
31
+ 2023-11-29 15:09:37.447781397 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.4/attn/Unsqueeze_10
32
+ 2023-11-29 15:09:37.447910021 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.4/attn/w_msa/Unsqueeze_5
33
+ 2023-11-29 15:09:37.448015408 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.4/attn/w_msa/Unsqueeze_4
34
+ 2023-11-29 15:09:37.448139001 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.4/attn/w_msa/Unsqueeze_1
35
+ 2023-11-29 15:09:37.448267546 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.4/attn/Unsqueeze_9
36
+ 2023-11-29 15:09:37.448404057 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.4/attn/Unsqueeze_3
37
+ 2023-11-29 15:09:37.449194643 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.3/attn/Unsqueeze_62
38
+ 2023-11-29 15:09:37.452370315 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.3/attn/Unsqueeze_55
39
+ 2023-11-29 15:09:37.452680576 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.3/attn/w_msa/Unsqueeze_13
40
+ 2023-11-29 15:09:37.452849841 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.3/attn/w_msa/Unsqueeze_12
41
+ 2023-11-29 15:09:37.452980818 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.3/attn/w_msa/Unsqueeze_10
42
+ 2023-11-29 15:09:37.453139263 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.3/attn/w_msa/Unsqueeze_9
43
+ 2023-11-29 15:09:37.453273590 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.3/attn/w_msa/Unsqueeze_6
44
+ 2023-11-29 15:09:37.453420992 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.3/attn/w_msa/Unsqueeze_5
45
+ 2023-11-29 15:09:37.453547003 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.3/attn/w_msa/Unsqueeze_1
46
+ 2023-11-29 15:09:37.453670410 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.3/attn/Unsqueeze_54
47
+ 2023-11-29 15:09:37.453796564 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.3/attn/Unsqueeze_46
48
+ 2023-11-29 15:09:37.453940416 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.3/attn/Unsqueeze_45
49
+ 2023-11-29 15:09:37.454061152 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.3/attn/Unsqueeze_42
50
+ 2023-11-29 15:09:37.454308665 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.3/attn/Unsqueeze_3
51
+ 2023-11-29 15:09:37.454439884 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.2/attn/Unsqueeze_17
52
+ 2023-11-29 15:09:37.454577217 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.2/attn/Unsqueeze_10
53
+ 2023-11-29 15:09:37.454695205 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.2/attn/w_msa/Unsqueeze_5
54
+ 2023-11-29 15:09:37.454817618 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.2/attn/w_msa/Unsqueeze_4
55
+ 2023-11-29 15:09:37.454937741 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.2/attn/w_msa/Unsqueeze_1
56
+ 2023-11-29 15:09:37.455116594 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.2/attn/Unsqueeze_9
57
+ 2023-11-29 15:09:37.455253365 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.2/attn/Unsqueeze_3
58
+ 2023-11-29 15:09:37.455391918 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.1/attn/Unsqueeze_62
59
+ 2023-11-29 15:09:37.455526693 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.1/attn/Unsqueeze_55
60
+ 2023-11-29 15:09:37.455678856 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.1/attn/w_msa/Unsqueeze_13
61
+ 2023-11-29 15:09:37.455805012 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.1/attn/w_msa/Unsqueeze_12
62
+ 2023-11-29 15:09:37.455942408 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.1/attn/w_msa/Unsqueeze_10
63
+ 2023-11-29 15:09:37.456074463 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.1/attn/w_msa/Unsqueeze_9
64
+ 2023-11-29 15:09:37.456199586 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.1/attn/w_msa/Unsqueeze_6
65
+ 2023-11-29 15:09:37.456336764 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.1/attn/w_msa/Unsqueeze_5
66
+ 2023-11-29 15:09:37.457803314 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.1/attn/w_msa/Unsqueeze_1
67
+ 2023-11-29 15:09:37.457939634 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.1/attn/Unsqueeze_54
68
+ 2023-11-29 15:09:37.458095839 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.1/attn/Unsqueeze_46
69
+ 2023-11-29 15:09:37.458249839 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.1/attn/Unsqueeze_45
70
+ 2023-11-29 15:09:37.458393298 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.1/attn/Unsqueeze_42
71
+ 2023-11-29 15:09:37.458668790 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.1/attn/Unsqueeze_3
72
+ 2023-11-29 15:09:37.458888897 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.0/attn/Unsqueeze_41
73
+ 2023-11-29 15:09:37.459125007 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.0/attn/Unsqueeze_34
74
+ 2023-11-29 15:09:37.459422385 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.0/attn/w_msa/Unsqueeze_5
75
+ 2023-11-29 15:09:37.459692868 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.0/attn/w_msa/Unsqueeze_4
76
+ 2023-11-29 15:09:37.459942637 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.0/attn/w_msa/Unsqueeze_1
77
+ 2023-11-29 15:09:37.460166958 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.0/attn/Unsqueeze_33
78
+ 2023-11-29 15:09:37.460318168 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.0/attn/Unsqueeze_3
79
+ 2023-11-29 15:09:37.460505462 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/downsample_1/Unsqueeze_3
80
+ 2023-11-29 15:09:37.460840376 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.1/attn/Unsqueeze_62
81
+ 2023-11-29 15:09:37.461371637 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.1/attn/Unsqueeze_55
82
+ 2023-11-29 15:09:37.461510502 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.1/attn/w_msa/Unsqueeze_13
83
+ 2023-11-29 15:09:37.461656508 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.1/attn/w_msa/Unsqueeze_12
84
+ 2023-11-29 15:09:37.461795250 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.1/attn/w_msa/Unsqueeze_10
85
+ 2023-11-29 15:09:37.461951392 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.1/attn/w_msa/Unsqueeze_9
86
+ 2023-11-29 15:09:37.462099561 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.1/attn/w_msa/Unsqueeze_6
87
+ 2023-11-29 15:09:37.462259595 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.1/attn/w_msa/Unsqueeze_5
88
+ 2023-11-29 15:09:37.462422018 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.1/attn/w_msa/Unsqueeze_1
89
+ 2023-11-29 15:09:37.462581429 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.1/attn/Unsqueeze_54
90
+ 2023-11-29 15:09:37.462721028 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.1/attn/Unsqueeze_46
91
+ 2023-11-29 15:09:37.462962288 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.1/attn/Unsqueeze_45
92
+ 2023-11-29 15:09:37.463164826 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.1/attn/Unsqueeze_42
93
+ 2023-11-29 15:09:37.463585851 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.1/attn/Unsqueeze_3
94
+ 2023-11-29 15:09:37.463827134 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.0/attn/Unsqueeze_25
95
+ 2023-11-29 15:09:37.464089834 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.0/attn/Unsqueeze_18
96
+ 2023-11-29 15:09:37.464254648 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.0/attn/w_msa/Unsqueeze_5
97
+ 2023-11-29 15:09:37.464504335 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.0/attn/w_msa/Unsqueeze_4
98
+ 2023-11-29 15:09:37.464852107 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.0/attn/w_msa/Unsqueeze_1
99
+ 2023-11-29 15:09:37.465154142 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.0/attn/Unsqueeze_17
100
+ 2023-11-29 15:09:37.465447142 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.0/attn/Unsqueeze_3
101
+ 2023-11-29 15:09:37.465759826 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/downsample/Unsqueeze_3
102
+ 2023-11-29 15:09:37.466052953 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/downsample/Unsqueeze_2
103
+ 2023-11-29 15:09:37.466501759 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/downsample/Unsqueeze_1
104
+ 2023-11-29 15:09:37.467061586 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/Unsqueeze_62
105
+ 2023-11-29 15:09:37.467640427 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/Unsqueeze_55
106
+ 2023-11-29 15:09:37.468306046 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/w_msa/Unsqueeze_13
107
+ 2023-11-29 15:09:37.468770628 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/w_msa/Unsqueeze_12
108
+ 2023-11-29 15:09:37.469178750 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/w_msa/Unsqueeze_10
109
+ 2023-11-29 15:09:37.469617175 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/w_msa/Unsqueeze_9
110
+ 2023-11-29 15:09:37.470097160 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/w_msa/Unsqueeze_6
111
+ 2023-11-29 15:09:37.470441309 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/w_msa/Unsqueeze_5
112
+ 2023-11-29 15:09:37.470866873 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/w_msa/Unsqueeze_1
113
+ 2023-11-29 15:09:37.471306838 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/Unsqueeze_54
114
+ 2023-11-29 15:09:37.471734641 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/Unsqueeze_46
115
+ 2023-11-29 15:09:37.472132756 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/Unsqueeze_45
116
+ 2023-11-29 15:09:37.472587718 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/Unsqueeze_42
117
+ 2023-11-29 15:09:37.473066992 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/Unsqueeze_3
118
+ 2023-11-29 15:09:37.473535380 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/Unsqueeze_2
119
+ 2023-11-29 15:09:37.474040816 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/Unsqueeze_1
120
+ 2023-11-29 15:09:37.474557416 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.0/attn/Unsqueeze_25
121
+ 2023-11-29 15:09:37.475056891 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.0/attn/Unsqueeze_18
122
+ 2023-11-29 15:09:37.475554286 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.0/attn/w_msa/Unsqueeze_5
123
+ 2023-11-29 15:09:37.476115264 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.0/attn/w_msa/Unsqueeze_4
124
+ 2023-11-29 15:09:37.476690963 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.0/attn/w_msa/Unsqueeze_1
125
+ 2023-11-29 15:09:37.477252499 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.0/attn/Unsqueeze_17
126
+ 2023-11-29 15:09:37.477662188 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.0/attn/Unsqueeze_3
127
+ 2023-11-29 15:09:37.477939051 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.0/attn/Unsqueeze_2
128
+ 2023-11-29 15:09:37.478350567 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.0/attn/Unsqueeze_1
129
+ 2023-11-29 15:09:41.443004322 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.1/attn/Unsqueeze_14
130
+ 2023-11-29 15:09:41.443256742 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.1/attn/Unsqueeze_13
131
+ 2023-11-29 15:09:41.443470830 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.1/attn/Unsqueeze_8
132
+ 2023-11-29 15:09:41.443662311 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.1/attn/Unsqueeze_7
133
+ 2023-11-29 15:09:41.443832601 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.0/attn/Unsqueeze_22
134
+ 2023-11-29 15:09:41.443998015 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.0/attn/Unsqueeze_21
135
+ 2023-11-29 15:09:41.444320552 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.0/attn/Unsqueeze_16
136
+ 2023-11-29 15:09:41.447603670 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3/blocks.0/attn/Unsqueeze_15
137
+ 2023-11-29 15:09:41.448454710 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.5/attn/Unsqueeze_59
138
+ 2023-11-29 15:09:41.448588977 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.5/attn/Unsqueeze_58
139
+ 2023-11-29 15:09:41.448798115 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.5/attn/Unsqueeze_5
140
+ 2023-11-29 15:09:41.448904679 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.5/attn/Unsqueeze_4
141
+ 2023-11-29 15:09:41.449064845 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.5/attn/w_msa/Unsqueeze_4
142
+ 2023-11-29 15:09:41.449174187 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.5/attn/Unsqueeze_53
143
+ 2023-11-29 15:09:41.449296617 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.5/attn/Unsqueeze_52
144
+ 2023-11-29 15:09:41.449407369 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.4/attn/Unsqueeze_14
145
+ 2023-11-29 15:09:41.449523577 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.4/attn/Unsqueeze_13
146
+ 2023-11-29 15:09:41.449630853 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.4/attn/Unsqueeze_8
147
+ 2023-11-29 15:09:41.449776562 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.4/attn/Unsqueeze_7
148
+ 2023-11-29 15:09:41.449881685 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.3/attn/Unsqueeze_59
149
+ 2023-11-29 15:09:41.449999782 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.3/attn/Unsqueeze_58
150
+ 2023-11-29 15:09:41.450171243 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.3/attn/Unsqueeze_5
151
+ 2023-11-29 15:09:41.450300297 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.3/attn/Unsqueeze_4
152
+ 2023-11-29 15:09:41.450451832 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.3/attn/w_msa/Unsqueeze_4
153
+ 2023-11-29 15:09:41.450572573 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.3/attn/Unsqueeze_53
154
+ 2023-11-29 15:09:41.450672878 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.3/attn/Unsqueeze_52
155
+ 2023-11-29 15:09:41.450797108 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.2/attn/Unsqueeze_14
156
+ 2023-11-29 15:09:41.450899880 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.2/attn/Unsqueeze_13
157
+ 2023-11-29 15:09:41.451062763 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.2/attn/Unsqueeze_8
158
+ 2023-11-29 15:09:41.451166445 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.2/attn/Unsqueeze_7
159
+ 2023-11-29 15:09:41.451284630 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.1/attn/Unsqueeze_59
160
+ 2023-11-29 15:09:41.451400009 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.1/attn/Unsqueeze_58
161
+ 2023-11-29 15:09:41.451577400 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.1/attn/Unsqueeze_5
162
+ 2023-11-29 15:09:41.451693564 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.1/attn/Unsqueeze_4
163
+ 2023-11-29 15:09:41.451851281 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.1/attn/w_msa/Unsqueeze_4
164
+ 2023-11-29 15:09:41.451984142 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.1/attn/Unsqueeze_53
165
+ 2023-11-29 15:09:41.452095251 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.1/attn/Unsqueeze_52
166
+ 2023-11-29 15:09:41.452213516 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.0/attn/Unsqueeze_38
167
+ 2023-11-29 15:09:41.452337590 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.0/attn/Unsqueeze_37
168
+ 2023-11-29 15:09:41.452450248 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.0/attn/Unsqueeze_32
169
+ 2023-11-29 15:09:41.452575296 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2/blocks.0/attn/Unsqueeze_31
170
+ 2023-11-29 15:09:41.452682854 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.1/attn/Unsqueeze_59
171
+ 2023-11-29 15:09:41.452820439 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.1/attn/Unsqueeze_58
172
+ 2023-11-29 15:09:41.453112241 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.1/attn/Unsqueeze_5
173
+ 2023-11-29 15:09:41.453239886 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.1/attn/Unsqueeze_4
174
+ 2023-11-29 15:09:41.453399529 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.1/attn/w_msa/Unsqueeze_4
175
+ 2023-11-29 15:09:41.453519223 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.1/attn/Unsqueeze_53
176
+ 2023-11-29 15:09:41.453643952 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.1/attn/Unsqueeze_52
177
+ 2023-11-29 15:09:41.453769178 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.0/attn/Unsqueeze_22
178
+ 2023-11-29 15:09:41.453877610 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.0/attn/Unsqueeze_21
179
+ 2023-11-29 15:09:41.453995332 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.0/attn/Unsqueeze_16
180
+ 2023-11-29 15:09:41.454113912 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1/blocks.0/attn/Unsqueeze_15
181
+ 2023-11-29 15:09:41.454227273 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/Unsqueeze_59
182
+ 2023-11-29 15:09:41.454334044 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/Unsqueeze_58
183
+ 2023-11-29 15:09:41.454562562 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/Unsqueeze_5
184
+ 2023-11-29 15:09:41.454678116 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/Unsqueeze_4
185
+ 2023-11-29 15:09:41.454835537 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/w_msa/Unsqueeze_4
186
+ 2023-11-29 15:09:41.454959360 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/Unsqueeze_53
187
+ 2023-11-29 15:09:41.455079711 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.1/attn/Unsqueeze_52
188
+ 2023-11-29 15:09:41.455196979 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.0/attn/Unsqueeze_22
189
+ 2023-11-29 15:09:41.455314088 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.0/attn/Unsqueeze_21
190
+ 2023-11-29 15:09:41.455426513 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.0/attn/Unsqueeze_16
191
+ 2023-11-29 15:09:41.455539851 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0/blocks.0/attn/Unsqueeze_15
192
+ [W] 'colored' module is not installed, will not use colors when logging. To enable colors, please install the 'colored' module: python3 -m pip install colored
193
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize original/swin-tiny_16xb64_in1k.onnx --fold-constant -o optimized/swin-tiny_16xb64_in1k-pss.onnx
194
+ [I] Loading model: /sky/ModelReady/onnx/original/swin-tiny_16xb64_in1k.onnx
195
+ [I] Original Model:
196
+ Name: main_graph | ONNX Opset: 14
197
+
198
+ ---- 1 Graph Input(s) ----
199
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
200
+
201
+ ---- 1 Graph Output(s) ----
202
+ {output [dtype=float32, shape=('batch_size', 1000)]}
203
+
204
+ ---- 173 Initializer(s) ----
205
+
206
+ ---- 8583 Node(s) ----
207
+
208
+ [I] Folding Constants | Pass 1
209
+ [I] Total Nodes | Original: 8583, After Folding: 3007 | 5576 Nodes Folded
210
+ [I] Folding Constants | Pass 2
211
+ [I] Total Nodes | Original: 3007, After Folding: 1091 | 1916 Nodes Folded
212
+ [I] Folding Constants | Pass 3
213
+ [I] Total Nodes | Original: 1091, After Folding: 1091 | 0 Nodes Folded
214
+ [I] Saving ONNX model to: optimized/swin-tiny_16xb64_in1k-pss.onnx
215
+ [I] New Model:
216
+ Name: main_graph | ONNX Opset: 14
217
+
218
+ ---- 1 Graph Input(s) ----
219
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
220
+
221
+ ---- 1 Graph Output(s) ----
222
+ {output [dtype=float32, shape=('batch_size', 1000)]}
223
+
224
+ ---- 852 Initializer(s) ----
225
+
226
+ ---- 1091 Node(s) ----
227
+
228
+ [I] PASSED | Runtime: 44.854s | Command: /usr/local/bin/polygraphy surgeon sanitize original/swin-tiny_16xb64_in1k.onnx --fold-constant -o optimized/swin-tiny_16xb64_in1k-pss.onnx
logs/t2t-vit-t-14_8xb64_in1k.log ADDED
@@ -0,0 +1,68 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2023-11-30 02:59:51.015064858 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.13/attn/Unsqueeze_3
2
+ 2023-11-30 02:59:51.027063505 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.13/attn/Unsqueeze_1
3
+ 2023-11-30 02:59:51.027880414 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.12/attn/Unsqueeze_3
4
+ 2023-11-30 02:59:51.029549565 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.12/attn/Unsqueeze_1
5
+ 2023-11-30 02:59:51.030860204 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.11/attn/Unsqueeze_3
6
+ 2023-11-30 02:59:51.031587076 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.11/attn/Unsqueeze_1
7
+ 2023-11-30 02:59:51.032348044 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.10/attn/Unsqueeze_3
8
+ 2023-11-30 02:59:51.033046694 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.10/attn/Unsqueeze_1
9
+ 2023-11-30 02:59:51.033590167 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.9/attn/Unsqueeze_3
10
+ 2023-11-30 02:59:51.034922370 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.9/attn/Unsqueeze_1
11
+ 2023-11-30 02:59:51.037006858 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.8/attn/Unsqueeze_3
12
+ 2023-11-30 02:59:51.038477670 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.8/attn/Unsqueeze_1
13
+ 2023-11-30 02:59:51.039192735 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.7/attn/Unsqueeze_3
14
+ 2023-11-30 02:59:51.043971308 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.7/attn/Unsqueeze_1
15
+ 2023-11-30 02:59:51.045054758 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.6/attn/Unsqueeze_3
16
+ 2023-11-30 02:59:51.046074937 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.6/attn/Unsqueeze_1
17
+ 2023-11-30 02:59:51.046761522 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.5/attn/Unsqueeze_3
18
+ 2023-11-30 02:59:51.047437564 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.5/attn/Unsqueeze_1
19
+ 2023-11-30 02:59:51.048088274 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.4/attn/Unsqueeze_3
20
+ 2023-11-30 02:59:51.048756282 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.4/attn/Unsqueeze_1
21
+ 2023-11-30 02:59:51.049365986 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.3/attn/Unsqueeze_3
22
+ 2023-11-30 02:59:51.049912994 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.3/attn/Unsqueeze_1
23
+ 2023-11-30 02:59:51.051312243 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.2/attn/Unsqueeze_3
24
+ 2023-11-30 02:59:51.051827893 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.2/attn/Unsqueeze_1
25
+ 2023-11-30 02:59:51.052584629 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.1/attn/Unsqueeze_3
26
+ 2023-11-30 02:59:51.053126976 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.1/attn/Unsqueeze_1
27
+ 2023-11-30 02:59:51.053871276 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.0/attn/Unsqueeze_3
28
+ 2023-11-30 02:59:51.054463688 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/encoder.0/attn/Unsqueeze_1
29
+ 2023-11-30 02:59:51.055262836 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/tokens_to_token/Unsqueeze_5
30
+ 2023-11-30 02:59:51.055997698 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/tokens_to_token/attention2/attn/Unsqueeze_3
31
+ 2023-11-30 02:59:51.056645353 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/tokens_to_token/attention2/attn/Unsqueeze_1
32
+ 2023-11-30 02:59:51.057269295 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/tokens_to_token/Unsqueeze_1
33
+ 2023-11-30 02:59:51.057872385 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/tokens_to_token/attention1/attn/Unsqueeze_3
34
+ 2023-11-30 02:59:51.058417602 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/tokens_to_token/attention1/attn/Unsqueeze_1
35
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize onnx/t2t-vit-t-14_8xb64_in1k.onnx --fold-constant -o pt/t2t-vit-t-14_8xb64_in1k-pss.onnx
36
+ [I] Loading model: /sky/Test/flaskProject/models/script/onnx/t2t-vit-t-14_8xb64_in1k.onnx
37
+ [I] Original Model:
38
+ Name: main_graph | ONNX Opset: 14
39
+
40
+ ---- 1 Graph Input(s) ----
41
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
42
+
43
+ ---- 1 Graph Output(s) ----
44
+ {output [dtype=float32, shape=('batch_size', 1000)]}
45
+
46
+ ---- 184 Initializer(s) ----
47
+
48
+ ---- 1476 Node(s) ----
49
+
50
+ [I] Folding Constants | Pass 1
51
+ [I] Total Nodes | Original: 1476, After Folding: 883 | 593 Nodes Folded
52
+ [I] Folding Constants | Pass 2
53
+ [I] Total Nodes | Original: 883, After Folding: 883 | 0 Nodes Folded
54
+ [I] Saving ONNX model to: pt/t2t-vit-t-14_8xb64_in1k-pss.onnx
55
+ [I] New Model:
56
+ Name: main_graph | ONNX Opset: 14
57
+
58
+ ---- 1 Graph Input(s) ----
59
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
60
+
61
+ ---- 1 Graph Output(s) ----
62
+ {output [dtype=float32, shape=('batch_size', 1000)]}
63
+
64
+ ---- 533 Initializer(s) ----
65
+
66
+ ---- 883 Node(s) ----
67
+
68
+ [I] PASSED | Runtime: 26.984s | Command: /usr/local/bin/polygraphy surgeon sanitize onnx/t2t-vit-t-14_8xb64_in1k.onnx --fold-constant -o pt/t2t-vit-t-14_8xb64_in1k-pss.onnx
logs/twins-pcpvt-small_3rdparty_8xb128_in1k.log ADDED
@@ -0,0 +1,138 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2023-11-30 02:59:53.306930065 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/Unsqueeze_11
2
+ 2023-11-30 02:59:53.311795197 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/Unsqueeze_10
3
+ 2023-11-30 02:59:53.312509198 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3.2/attn/Unsqueeze_5
4
+ 2023-11-30 02:59:53.327160327 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3.2/attn/Unsqueeze_1
5
+ 2023-11-30 02:59:53.335168246 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3.1/attn/Unsqueeze_5
6
+ 2023-11-30 02:59:53.335814943 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3.1/attn/Unsqueeze_1
7
+ 2023-11-30 02:59:53.336346716 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/position_encodings.3/Unsqueeze_3
8
+ 2023-11-30 02:59:53.337312671 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/position_encodings.3/Unsqueeze_2
9
+ 2023-11-30 02:59:53.344905326 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/position_encodings.3/Unsqueeze_1
10
+ 2023-11-30 02:59:53.352750465 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3.0/attn/Unsqueeze_5
11
+ 2023-11-30 02:59:53.355070692 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.3.0/attn/Unsqueeze_1
12
+ 2023-11-30 02:59:53.362364753 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/Unsqueeze_8
13
+ 2023-11-30 02:59:53.369412352 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/Unsqueeze_7
14
+ 2023-11-30 02:59:53.370368873 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.5/attn/Unsqueeze_11
15
+ 2023-11-30 02:59:53.371357402 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.5/attn/Unsqueeze_8
16
+ 2023-11-30 02:59:53.377471749 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.5/attn/Unsqueeze_6
17
+ 2023-11-30 02:59:53.381392518 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.5/attn/Unsqueeze_5
18
+ 2023-11-30 02:59:53.386640088 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.5/attn/Unsqueeze_4
19
+ 2023-11-30 02:59:53.387133200 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.5/attn/Unsqueeze_1
20
+ 2023-11-30 02:59:53.388914197 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.4/attn/Unsqueeze_11
21
+ 2023-11-30 02:59:53.396088173 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.4/attn/Unsqueeze_8
22
+ 2023-11-30 02:59:53.403237220 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.4/attn/Unsqueeze_6
23
+ 2023-11-30 02:59:53.403783224 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.4/attn/Unsqueeze_5
24
+ 2023-11-30 02:59:53.404256823 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.4/attn/Unsqueeze_4
25
+ 2023-11-30 02:59:53.404736378 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.4/attn/Unsqueeze_1
26
+ 2023-11-30 02:59:53.405196630 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.3/attn/Unsqueeze_11
27
+ 2023-11-30 02:59:53.405750278 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.3/attn/Unsqueeze_8
28
+ 2023-11-30 02:59:53.406216895 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.3/attn/Unsqueeze_6
29
+ 2023-11-30 02:59:53.406686692 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.3/attn/Unsqueeze_5
30
+ 2023-11-30 02:59:53.407137184 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.3/attn/Unsqueeze_4
31
+ 2023-11-30 02:59:53.407601368 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.3/attn/Unsqueeze_1
32
+ 2023-11-30 02:59:53.408009615 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.2/attn/Unsqueeze_11
33
+ 2023-11-30 02:59:53.408422687 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.2/attn/Unsqueeze_8
34
+ 2023-11-30 02:59:53.408867528 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.2/attn/Unsqueeze_6
35
+ 2023-11-30 02:59:53.409325652 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.2/attn/Unsqueeze_5
36
+ 2023-11-30 02:59:53.409735713 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.2/attn/Unsqueeze_4
37
+ 2023-11-30 02:59:53.410242183 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.2/attn/Unsqueeze_1
38
+ 2023-11-30 02:59:53.410737816 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.1/attn/Unsqueeze_11
39
+ 2023-11-30 02:59:53.411231926 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.1/attn/Unsqueeze_8
40
+ 2023-11-30 02:59:53.411672106 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.1/attn/Unsqueeze_6
41
+ 2023-11-30 02:59:53.412064502 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.1/attn/Unsqueeze_5
42
+ 2023-11-30 02:59:53.412537194 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.1/attn/Unsqueeze_4
43
+ 2023-11-30 02:59:53.412962003 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.1/attn/Unsqueeze_1
44
+ 2023-11-30 02:59:53.413391625 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/position_encodings.2/Unsqueeze_3
45
+ 2023-11-30 02:59:53.414425975 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/position_encodings.2/Unsqueeze_2
46
+ 2023-11-30 02:59:53.414835500 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/position_encodings.2/Unsqueeze_1
47
+ 2023-11-30 02:59:53.415260971 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.0/attn/Unsqueeze_11
48
+ 2023-11-30 02:59:53.415687210 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.0/attn/Unsqueeze_8
49
+ 2023-11-30 02:59:53.416119091 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.0/attn/Unsqueeze_6
50
+ 2023-11-30 02:59:53.416576148 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.0/attn/Unsqueeze_5
51
+ 2023-11-30 02:59:53.416997957 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.0/attn/Unsqueeze_4
52
+ 2023-11-30 02:59:53.417407236 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.2.0/attn/Unsqueeze_1
53
+ 2023-11-30 02:59:53.417897339 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/Unsqueeze_5
54
+ 2023-11-30 02:59:53.418408196 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/Unsqueeze_4
55
+ 2023-11-30 02:59:53.418815025 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.3/attn/Unsqueeze_11
56
+ 2023-11-30 02:59:53.419257174 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.3/attn/Unsqueeze_8
57
+ 2023-11-30 02:59:53.419692243 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.3/attn/Unsqueeze_6
58
+ 2023-11-30 02:59:53.420179391 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.3/attn/Unsqueeze_5
59
+ 2023-11-30 02:59:53.420708560 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.3/attn/Unsqueeze_4
60
+ 2023-11-30 02:59:53.421167157 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.3/attn/Unsqueeze_1
61
+ 2023-11-30 02:59:53.421630353 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.2/attn/Unsqueeze_11
62
+ 2023-11-30 02:59:53.422075418 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.2/attn/Unsqueeze_8
63
+ 2023-11-30 02:59:53.422496581 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.2/attn/Unsqueeze_6
64
+ 2023-11-30 02:59:53.422906157 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.2/attn/Unsqueeze_5
65
+ 2023-11-30 02:59:53.423319843 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.2/attn/Unsqueeze_4
66
+ 2023-11-30 02:59:53.423727303 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.2/attn/Unsqueeze_1
67
+ 2023-11-30 02:59:53.424173139 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.1/attn/Unsqueeze_11
68
+ 2023-11-30 02:59:53.424576671 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.1/attn/Unsqueeze_8
69
+ 2023-11-30 02:59:53.425004157 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.1/attn/Unsqueeze_6
70
+ 2023-11-30 02:59:53.425401935 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.1/attn/Unsqueeze_5
71
+ 2023-11-30 02:59:53.425827735 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.1/attn/Unsqueeze_4
72
+ 2023-11-30 02:59:53.426295556 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.1/attn/Unsqueeze_1
73
+ 2023-11-30 02:59:53.427258696 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/position_encodings.1/Unsqueeze_3
74
+ 2023-11-30 02:59:53.428628486 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/position_encodings.1/Unsqueeze_2
75
+ 2023-11-30 02:59:53.429067683 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/position_encodings.1/Unsqueeze_1
76
+ 2023-11-30 02:59:53.429489997 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.0/attn/Unsqueeze_11
77
+ 2023-11-30 02:59:53.429914616 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.0/attn/Unsqueeze_8
78
+ 2023-11-30 02:59:53.430326846 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.0/attn/Unsqueeze_6
79
+ 2023-11-30 02:59:53.430897012 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.0/attn/Unsqueeze_5
80
+ 2023-11-30 02:59:53.431365504 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.0/attn/Unsqueeze_4
81
+ 2023-11-30 02:59:53.431797166 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.1.0/attn/Unsqueeze_1
82
+ 2023-11-30 02:59:53.432209292 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/Unsqueeze_2
83
+ 2023-11-30 02:59:53.432614804 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/Unsqueeze_1
84
+ 2023-11-30 02:59:53.433047623 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0.2/attn/Unsqueeze_11
85
+ 2023-11-30 02:59:53.433488030 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0.2/attn/Unsqueeze_8
86
+ 2023-11-30 02:59:53.433888428 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0.2/attn/Unsqueeze_6
87
+ 2023-11-30 02:59:53.434296511 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0.2/attn/Unsqueeze_5
88
+ 2023-11-30 02:59:53.434717560 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0.2/attn/Unsqueeze_4
89
+ 2023-11-30 02:59:53.435188267 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0.2/attn/Unsqueeze_1
90
+ 2023-11-30 02:59:53.435620797 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0.1/attn/Unsqueeze_11
91
+ 2023-11-30 02:59:53.436027845 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0.1/attn/Unsqueeze_8
92
+ 2023-11-30 02:59:53.436447440 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0.1/attn/Unsqueeze_6
93
+ 2023-11-30 02:59:53.436835867 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0.1/attn/Unsqueeze_5
94
+ 2023-11-30 02:59:53.437251399 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0.1/attn/Unsqueeze_4
95
+ 2023-11-30 02:59:53.437653039 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0.1/attn/Unsqueeze_1
96
+ 2023-11-30 02:59:53.438061634 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/position_encodings.0/Unsqueeze_3
97
+ 2023-11-30 02:59:53.438452517 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/position_encodings.0/Unsqueeze_2
98
+ 2023-11-30 02:59:53.438931437 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/position_encodings.0/Unsqueeze_1
99
+ 2023-11-30 02:59:53.439408688 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0.0/attn/Unsqueeze_11
100
+ 2023-11-30 02:59:53.439842156 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0.0/attn/Unsqueeze_8
101
+ 2023-11-30 02:59:53.440258436 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0.0/attn/Unsqueeze_6
102
+ 2023-11-30 02:59:53.440717213 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0.0/attn/Unsqueeze_5
103
+ 2023-11-30 02:59:53.441229534 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0.0/attn/Unsqueeze_4
104
+ 2023-11-30 02:59:53.441713734 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/stages.0.0/attn/Unsqueeze_1
105
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize onnx/twins-pcpvt-small_3rdparty_8xb128_in1k.onnx --fold-constant -o pt/twins-pcpvt-small_3rdparty_8xb128_in1k-pss.onnx
106
+ [I] Loading model: /sky/Test/flaskProject/models/script/onnx/twins-pcpvt-small_3rdparty_8xb128_in1k.onnx
107
+ [I] Original Model:
108
+ Name: main_graph | ONNX Opset: 14
109
+
110
+ ---- 1 Graph Input(s) ----
111
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
112
+
113
+ ---- 1 Graph Output(s) ----
114
+ {output [dtype=float32, shape=('batch_size', 1000)]}
115
+
116
+ ---- 304 Initializer(s) ----
117
+
118
+ ---- 2289 Node(s) ----
119
+
120
+ [I] Folding Constants | Pass 1
121
+ [I] Total Nodes | Original: 2289, After Folding: 1292 | 997 Nodes Folded
122
+ [I] Folding Constants | Pass 2
123
+ [I] Total Nodes | Original: 1292, After Folding: 1292 | 0 Nodes Folded
124
+ [I] Saving ONNX model to: pt/twins-pcpvt-small_3rdparty_8xb128_in1k-pss.onnx
125
+ [I] New Model:
126
+ Name: main_graph | ONNX Opset: 14
127
+
128
+ ---- 1 Graph Input(s) ----
129
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
130
+
131
+ ---- 1 Graph Output(s) ----
132
+ {output [dtype=float32, shape=('batch_size', 1000)]}
133
+
134
+ ---- 857 Initializer(s) ----
135
+
136
+ ---- 1292 Node(s) ----
137
+
138
+ [I] PASSED | Runtime: 33.635s | Command: /usr/local/bin/polygraphy surgeon sanitize onnx/twins-pcpvt-small_3rdparty_8xb128_in1k.onnx --fold-constant -o pt/twins-pcpvt-small_3rdparty_8xb128_in1k-pss.onnx
logs/vgg11_8xb32_in1k.log ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [W] 'colored' module is not installed, will not use colors when logging. To enable colors, please install the 'colored' module: python3 -m pip install colored
2
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize original/vgg11_8xb32_in1k.onnx --fold-constant -o optimized/vgg11_8xb32_in1k-pss.onnx
3
+ [I] Loading model: /sky/ModelReady/onnx/original/vgg11_8xb32_in1k.onnx
4
+ [I] Original Model:
5
+ Name: main_graph | ONNX Opset: 14
6
+
7
+ ---- 1 Graph Input(s) ----
8
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
9
+
10
+ ---- 1 Graph Output(s) ----
11
+ {output [dtype=float32, shape=('batch_size', 1000)]}
12
+
13
+ ---- 22 Initializer(s) ----
14
+
15
+ ---- 34 Node(s) ----
16
+
17
+ [I] Folding Constants | Pass 1
18
+ [I] Total Nodes | Original: 34, After Folding: 31 | 3 Nodes Folded
19
+ [I] Folding Constants | Pass 2
20
+ [I] Total Nodes | Original: 31, After Folding: 31 | 0 Nodes Folded
21
+ [I] Saving ONNX model to: optimized/vgg11_8xb32_in1k-pss.onnx
22
+ [I] New Model:
23
+ Name: main_graph | ONNX Opset: 14
24
+
25
+ ---- 1 Graph Input(s) ----
26
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
27
+
28
+ ---- 1 Graph Output(s) ----
29
+ {output [dtype=float32, shape=('batch_size', 1000)]}
30
+
31
+ ---- 25 Initializer(s) ----
32
+
33
+ ---- 31 Node(s) ----
34
+
35
+ [I] PASSED | Runtime: 13.043s | Command: /usr/local/bin/polygraphy surgeon sanitize original/vgg11_8xb32_in1k.onnx --fold-constant -o optimized/vgg11_8xb32_in1k-pss.onnx
logs/vit-base-p32_in21k-pre_3rdparty_in1k-384px.log ADDED
@@ -0,0 +1,61 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2023-11-29 15:09:12.463490558 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.11/attn/Unsqueeze_3
2
+ 2023-11-29 15:09:12.466081784 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.11/attn/Unsqueeze_1
3
+ 2023-11-29 15:09:12.466461461 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.10/attn/Unsqueeze_3
4
+ 2023-11-29 15:09:12.468335908 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.10/attn/Unsqueeze_1
5
+ 2023-11-29 15:09:12.470553387 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.9/attn/Unsqueeze_3
6
+ 2023-11-29 15:09:12.470887482 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.9/attn/Unsqueeze_1
7
+ 2023-11-29 15:09:12.471189300 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.8/attn/Unsqueeze_3
8
+ 2023-11-29 15:09:12.471512249 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.8/attn/Unsqueeze_1
9
+ 2023-11-29 15:09:12.471793321 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.7/attn/Unsqueeze_3
10
+ 2023-11-29 15:09:12.472102277 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.7/attn/Unsqueeze_1
11
+ 2023-11-29 15:09:12.472409131 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.6/attn/Unsqueeze_3
12
+ 2023-11-29 15:09:12.472706151 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.6/attn/Unsqueeze_1
13
+ 2023-11-29 15:09:12.473169313 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.5/attn/Unsqueeze_3
14
+ 2023-11-29 15:09:12.473579048 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.5/attn/Unsqueeze_1
15
+ 2023-11-29 15:09:12.473868498 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.4/attn/Unsqueeze_3
16
+ 2023-11-29 15:09:12.474134704 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.4/attn/Unsqueeze_1
17
+ 2023-11-29 15:09:12.474556364 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.3/attn/Unsqueeze_3
18
+ 2023-11-29 15:09:12.474842240 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.3/attn/Unsqueeze_1
19
+ 2023-11-29 15:09:12.475156067 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/attn/Unsqueeze_3
20
+ 2023-11-29 15:09:12.475509341 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.2/attn/Unsqueeze_1
21
+ 2023-11-29 15:09:12.475735295 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/attn/Unsqueeze_3
22
+ 2023-11-29 15:09:12.476014519 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.1/attn/Unsqueeze_1
23
+ 2023-11-29 15:09:12.476403197 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/attn/Unsqueeze_3
24
+ 2023-11-29 15:09:12.476685884 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/layers.0/attn/Unsqueeze_1
25
+ 2023-11-29 15:09:12.476993257 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/Unsqueeze_2
26
+ 2023-11-29 15:09:12.477389100 [W:onnxruntime:, unsqueeze_elimination.cc:20 Apply] UnsqueezeElimination cannot remove node /backbone/Unsqueeze_1
27
+ [W] 'colored' module is not installed, will not use colors when logging. To enable colors, please install the 'colored' module: python3 -m pip install colored
28
+ [I] RUNNING | Command: /usr/local/bin/polygraphy surgeon sanitize original/vit-base-p32_in21k-pre_3rdparty_in1k-384px.onnx --fold-constant -o optimized/vit-base-p32_in21k-pre_3rdparty_in1k-384px-pss.onnx
29
+ [I] Loading model: /sky/ModelReady/onnx/original/vit-base-p32_in21k-pre_3rdparty_in1k-384px.onnx
30
+ [I] Original Model:
31
+ Name: main_graph | ONNX Opset: 14
32
+
33
+ ---- 1 Graph Input(s) ----
34
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
35
+
36
+ ---- 1 Graph Output(s) ----
37
+ {output [dtype=float32, shape=('batch_size', 1000)]}
38
+
39
+ ---- 154 Initializer(s) ----
40
+
41
+ ---- 1066 Node(s) ----
42
+
43
+ [I] Folding Constants | Pass 1
44
+ [I] Total Nodes | Original: 1066, After Folding: 656 | 410 Nodes Folded
45
+ [I] Folding Constants | Pass 2
46
+ [I] Total Nodes | Original: 656, After Folding: 656 | 0 Nodes Folded
47
+ [I] Saving ONNX model to: optimized/vit-base-p32_in21k-pre_3rdparty_in1k-384px-pss.onnx
48
+ [I] New Model:
49
+ Name: main_graph | ONNX Opset: 14
50
+
51
+ ---- 1 Graph Input(s) ----
52
+ {input [dtype=float32, shape=('batch_size', 3, 224, 224)]}
53
+
54
+ ---- 1 Graph Output(s) ----
55
+ {output [dtype=float32, shape=('batch_size', 1000)]}
56
+
57
+ ---- 387 Initializer(s) ----
58
+
59
+ ---- 656 Node(s) ----
60
+
61
+ [I] PASSED | Runtime: 17.345s | Command: /usr/local/bin/polygraphy surgeon sanitize original/vit-base-p32_in21k-pre_3rdparty_in1k-384px.onnx --fold-constant -o optimized/vit-base-p32_in21k-pre_3rdparty_in1k-384px-pss.onnx