File size: 2,928 Bytes
961a58e | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 | DynamicDispatch Offload - not offloaded
+-------------------+-------+------------------------+------------------------+
| Op Type | Count | Inputs | Outputs |
+===================+=======+========================+========================+
| CastAvx | 1 | [1,'height','width',4] | [1,'height','width',4] |
| | | - FLOAT | - BFLOAT16 |
| CastAvx | 1 | [1,'floor(2.0*floor(2� | [1,'floor(2.0*floor(2� |
| | | - BFLOAT16 | - FLOAT |
| Transpose | 1 | [1,4,'height','width'] | [1,'height','width',4] |
| | | - FLOAT | - FLOAT |
| Transpose | 1 | [1,'floor(2.0*floor(2� | [1,3,'floor(2.0*floor� |
| | | - FLOAT | - FLOAT |
+-------------------+-------+------------------------+------------------------+
| Not offloaded sum | 4 | | |
+-------------------+-------+------------------------+------------------------+
DynamicDispatch Offload - offloaded
+--------------------+-------------+---------------------+--------------------+
| Op Type | Count | Inputs | Outputs |
+====================+=============+=====================+====================+
| DynamicDispatch | 1 | [1,'height','width� | [1,'floor(2.0*flo� |
| | | - BFLOAT16 | - BFLOAT16 |
+--------------------+-------------+---------------------+--------------------+
| Offloaded sum | 1 | | |
+--------------------+-------------+---------------------+--------------------+
| Offloaded Op Types | SDGroupNorm | | |
| | SDResize | | |
| | SDMHA_VAE | | |
| | SDGemm | | |
| | SDConv | | |
| | SDAdd | | |
+--------------------+-------------+---------------------+--------------------+
| Offloaded sum (dd | 89 | | |
| fusion) | | | |
| Offload Ratio (dd | 95.7% | | |
| fusion) | | | |
+--------------------+-------------+---------------------+--------------------+
|