| DynamicDispatch Offload - not offloaded | |
| +-------------------+-------+------------------------+------------------------+ | |
| | Op Type | Count | Inputs | Outputs | | |
| +===================+=======+========================+========================+ | |
| | CastAvx | 1 | [1,'height','width',4] | [1,'height','width',4] | | |
| | | | - FLOAT | - BFLOAT16 | | |
| | CastAvx | 1 | [1,'floor(2.0*floor(2� | [1,'floor(2.0*floor(2� | | |
| | | | - BFLOAT16 | - FLOAT | | |
| | Transpose | 1 | [1,4,'height','width'] | [1,'height','width',4] | | |
| | | | - FLOAT | - FLOAT | | |
| | Transpose | 1 | [1,'floor(2.0*floor(2� | [1,3,'floor(2.0*floor� | | |
| | | | - FLOAT | - FLOAT | | |
| +-------------------+-------+------------------------+------------------------+ | |
| | Not offloaded sum | 4 | | | | |
| +-------------------+-------+------------------------+------------------------+ | |
| DynamicDispatch Offload - offloaded | |
| +--------------------+-------------+---------------------+--------------------+ | |
| | Op Type | Count | Inputs | Outputs | | |
| +====================+=============+=====================+====================+ | |
| | DynamicDispatch | 1 | [1,'height','width� | [1,'floor(2.0*flo� | | |
| | | | - BFLOAT16 | - BFLOAT16 | | |
| +--------------------+-------------+---------------------+--------------------+ | |
| | Offloaded sum | 1 | | | | |
| +--------------------+-------------+---------------------+--------------------+ | |
| | Offloaded Op Types | SDGroupNorm | | | | |
| | | SDResize | | | | |
| | | SDMHA_VAE | | | | |
| | | SDGemm | | | | |
| | | SDConv | | | | |
| | | SDAdd | | | | |
| +--------------------+-------------+---------------------+--------------------+ | |
| | Offloaded sum (dd | 89 | | | | |
| | fusion) | | | | | |
| | Offload Ratio (dd | 95.7% | | | | |
| | fusion) | | | | | |
| +--------------------+-------------+---------------------+--------------------+ | |